2024-09-10T09:44:42.659 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T09:44:42.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T09:44:42.783 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899010 branch: wip-rishabh-testing-20240909.165402-squid description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: null first_in_suite: false job_id: '7899010' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240909.165402-squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240909.165402-squid sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 9893 sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b sleep_before_teardown: 0 subset: 197/1024 suite: fs suite_branch: wip-rishabh-testing-20240909.165402-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b targets: smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN52riiZKCwkzPkOp2sYQwPkzi1gmx+3lbmjnCwciGZg5O1MAiAC3KMrlSAPPczLiy1Lf/xeIl/K9+UAaMJ3M20= smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP4jXlDo20+9BrPeq/HVVT4rtB7i9Ri3frpg8liU6PKs+fVXaU3NmKvjoBxOcqgCgi1NUASgty9SXsD8TKCQibM= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/rishabh/src/git.ceph.com_ceph-c_wip-rishabh-testing-20240909.165402-squid/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_06:58:10 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-10T09:44:42.784 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa; will attempt to use it 2024-09-10T09:44:42.784 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks 2024-09-10T09:44:42.785 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T09:44:42.786 INFO:teuthology.task.internal:Checking packages... 2024-09-10T09:44:42.807 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1cf819b7212a6048e92fc78c4eff963344f6d56b' 2024-09-10T09:44:42.807 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T09:44:42.808 INFO:teuthology.packaging:ref: None 2024-09-10T09:44:42.808 INFO:teuthology.packaging:tag: None 2024-09-10T09:44:42.808 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240909.165402-squid 2024-09-10T09:44:42.808 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:44:42.808 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240909.165402-squid 2024-09-10T09:44:42.956 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-305.g1cf819b7 2024-09-10T09:44:42.957 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T09:44:42.964 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T09:44:42.964 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T09:44:42.985 INFO:teuthology.task.internal:Saving configuration 2024-09-10T09:44:43.004 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T09:44:43.011 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T09:44:43.035 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899010', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 09:39:28.139976', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN52riiZKCwkzPkOp2sYQwPkzi1gmx+3lbmjnCwciGZg5O1MAiAC3KMrlSAPPczLiy1Lf/xeIl/K9+UAaMJ3M20='} 2024-09-10T09:44:43.061 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899010', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 09:39:28.141305', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP4jXlDo20+9BrPeq/HVVT4rtB7i9Ri3frpg8liU6PKs+fVXaU3NmKvjoBxOcqgCgi1NUASgty9SXsD8TKCQibM='} 2024-09-10T09:44:43.061 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T09:44:43.067 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-10T09:44:43.067 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-10T09:44:43.067 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T09:44:43.144 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fade4fc7be0>, signals=[15]) 2024-09-10T09:44:43.144 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T09:44:43.150 INFO:teuthology.task.internal:Opening connections... 2024-09-10T09:44:43.150 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T09:44:43.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:44:43.228 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-09-10T09:44:43.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:44:43.304 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T09:44:43.311 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-09-10T09:44:43.329 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-09-10T09:44:43.329 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-09-10T09:44:43.387 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-09-10T09:44:43.388 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-09-10T09:44:43.388 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-09-10T09:44:43.388 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-09-10T09:44:43.388 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-09-10T09:44:43.388 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-09-10T09:44:43.388 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T09:44:43.388 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-09-10T09:44:43.388 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-09-10T09:44:43.388 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T09:44:43.388 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-09-10T09:44:43.388 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T09:44:43.389 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T09:44:43.389 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T09:44:43.389 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-09-10T09:44:43.410 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-09-10T09:44:43.429 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-09-10T09:44:43.429 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-09-10T09:44:43.487 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-09-10T09:44:43.487 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-09-10T09:44:43.487 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-09-10T09:44:43.488 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-09-10T09:44:43.488 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-09-10T09:44:43.488 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-09-10T09:44:43.488 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T09:44:43.488 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-09-10T09:44:43.488 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-09-10T09:44:43.488 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T09:44:43.488 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-09-10T09:44:43.488 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T09:44:43.488 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T09:44:43.488 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T09:44:43.489 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-09-10T09:44:43.519 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T09:44:43.527 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T09:44:43.533 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T09:44:43.533 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-09-10T09:44:43.535 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-09-10T09:44:43.552 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T09:44:43.558 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T09:44:43.558 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-09-10T09:44:43.594 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-09-10T09:44:43.623 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T09:44:43.681 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T09:44:43.695 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T09:44:43.695 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T09:44:43.695 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T09:44:43.696 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T09:44:43.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:44:43.712 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-09-10T09:44:43.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:44:43.713 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-10T09:44:43.769 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-503.el9.x86_64 2024-09-10T09:44:43.769 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.14.0-503.el9.x86_64 2024-09-10T09:44:43.770 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2024-09-10T09:44:43.771 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-503.el9.x86_64 2024-09-10T09:44:43.771 INFO:teuthology.task.kernel:Running kernel on smithi071: 5.14.0-503.el9.x86_64 2024-09-10T09:44:43.771 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum install -y kernel 2024-09-10T09:44:46.075 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-10T09:44:47.423 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.2 MB 00:01 2024-09-10T09:44:51.431 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 7.1 MB/s | 20 MB 00:02 2024-09-10T09:44:52.566 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 3.8 MB/s | 20 MB 00:05 2024-09-10T09:44:56.990 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-10T09:44:57.017 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-10T09:44:58.459 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 19 kB 00:00 2024-09-10T09:44:58.782 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-10T09:44:59.197 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-10T09:44:59.669 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-10T09:45:04.652 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T09:45:05.116 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-10T09:45:06.692 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T09:45:06.692 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T09:45:06.789 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:45:06.793 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:45:06.793 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-10T09:45:06.793 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:45:06.793 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:45:06.793 INFO:teuthology.orchestra.run.smithi071.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T09:45:06.793 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-10T09:45:06.793 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T09:45:06.793 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T09:45:06.793 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T09:45:06.793 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:45:06.793 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:45:06.793 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:45:06.794 INFO:teuthology.orchestra.run.smithi071.stdout:Install 4 Packages 2024-09-10T09:45:06.794 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:45:06.794 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 79 M 2024-09-10T09:45:06.794 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 126 M 2024-09-10T09:45:06.794 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:45:07.054 INFO:teuthology.orchestra.run.smithi071.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 237 kB/s | 23 kB 00:00 2024-09-10T09:45:07.165 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T09:45:07.165 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T09:45:07.248 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:45:07.254 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:45:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-09-10T09:45:07.254 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:45:07.254 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:45:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T09:45:07.254 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-10T09:45:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T09:45:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T09:45:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T09:45:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:45:07.254 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:45:07.254 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:45:07.254 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2024-09-10T09:45:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:45:07.255 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 79 M 2024-09-10T09:45:07.255 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 126 M 2024-09-10T09:45:07.256 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:45:07.426 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 327 kB/s | 23 kB 00:00 2024-09-10T09:45:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-10T09:45:07.921 INFO:teuthology.orchestra.run.smithi071.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-10T09:45:08.230 INFO:teuthology.orchestra.run.smithi071.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-10T09:45:08.230 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:45:08.230 INFO:teuthology.orchestra.run.smithi071.stdout:Total 55 MB/s | 79 MB 00:01 2024-09-10T09:45:08.916 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:45:09.253 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:45:09.253 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:45:10.219 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:45:10.220 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:45:11.393 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:04 2024-09-10T09:45:12.656 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:45:13.296 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T09:45:13.390 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:45:14.642 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 4.0 MB/s | 29 MB 00:07 2024-09-10T09:45:16.181 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:45:16.320 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:45:16.592 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.7 MB/s | 35 MB 00:09 2024-09-10T09:45:16.592 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:45:16.592 INFO:teuthology.orchestra.run.smithi107.stdout:Total 8.4 MB/s | 79 MB 00:09 2024-09-10T09:45:17.280 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:45:17.633 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:45:17.633 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:45:18.592 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:45:18.593 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:45:21.053 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:45:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:45:21.444 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:45:21.757 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T09:45:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:45:24.664 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:45:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:45:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:45:29.612 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:45:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:45:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:46:04.717 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:46:04.757 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:46:05.127 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:46:05.128 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T09:46:05.128 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:46:05.128 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:46:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:46:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:46:05.969 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:46:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T09:46:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T09:46:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T09:46:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T09:46:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:46:05.969 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:46:06.328 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T09:46:06.423 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T09:46:06.424 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T09:46:06.424 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T09:46:06.424 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T09:46:06.424 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T09:46:06.424 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-10T09:46:06.425 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T09:46:06.425 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T09:46:06.484 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T09:46:06.484 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T09:46:06.484 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2024-09-10T09:46:06.524 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2024-09-10T09:46:06.524 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2024-09-10T09:46:06.524 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.06 2024-09-10T09:46:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 82.el9 2024-09-10T09:46:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2024-09-10T09:46:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T09:46:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:Group : Unspecified 2024-09-10T09:46:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 8274670 2024-09-10T09:46:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2024-09-10T09:46:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T09:46:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T09:46:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T09:46:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T09:46:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : builder@centos.org 2024-09-10T09:46:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : CentOS 2024-09-10T09:46:06.525 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T09:46:06.526 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2024-09-10T09:46:06.526 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2024-09-10T09:46:06.526 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:46:06.526 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T09:46:06.526 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T09:46:06.526 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T09:46:06.526 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2024-09-10T09:46:06.526 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:46:06.526 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T09:46:06.527 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T09:46:06.527 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 5.14.0-505.el9.x86_64 2024-09-10T09:46:06.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T09:46:07.180 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2024-09-10T09:46:08.481 INFO:teuthology.orchestra.run.smithi071.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T09:46:08.512 INFO:teuthology.orchestra.run.smithi071.stderr:done 2024-09-10T09:46:08.514 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-10T09:46:08.530 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.kz0ELN97L2 2024-09-10T09:46:08.530 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kz0ELN97L2 2024-09-10T09:46:08.599 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.kz0ELN97L2 2024-09-10T09:46:08.737 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.kz0ELN97L2 is 6KB 2024-09-10T09:46:08.785 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.kz0ELN97L2 2024-09-10T09:46:08.800 DEBUG:teuthology.orchestra.run.smithi071:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T09:46:08.863 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T09:46:08.864 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T09:46:08.864 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T09:46:08.864 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T09:46:08.865 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T09:46:09.024 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2024-09-10T09:46:12.806 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:46:12.847 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:46:13.097 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:46:13.097 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T09:46:13.098 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:46:13.098 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:46:13.964 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:46:13.964 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:46:13.964 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:46:13.965 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T09:46:13.965 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T09:46:13.965 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T09:46:13.965 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T09:46:13.965 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:46:13.965 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:46:14.325 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T09:46:14.409 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T09:46:14.409 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T09:46:14.409 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T09:46:14.409 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T09:46:14.409 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T09:46:14.410 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-10T09:46:14.410 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T09:46:14.410 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T09:46:14.469 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T09:46:14.469 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T09:46:14.469 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2024-09-10T09:46:14.510 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2024-09-10T09:46:14.510 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2024-09-10T09:46:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.06 2024-09-10T09:46:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 82.el9 2024-09-10T09:46:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2024-09-10T09:46:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T09:46:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:Group : Unspecified 2024-09-10T09:46:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 8274670 2024-09-10T09:46:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2024-09-10T09:46:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T09:46:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T09:46:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T09:46:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T09:46:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : builder@centos.org 2024-09-10T09:46:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2024-09-10T09:46:14.512 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T09:46:14.512 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2024-09-10T09:46:14.512 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2024-09-10T09:46:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:46:14.512 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T09:46:14.512 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T09:46:14.512 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T09:46:14.512 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2024-09-10T09:46:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:46:14.513 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T09:46:14.513 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T09:46:14.514 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 5.14.0-505.el9.x86_64 2024-09-10T09:46:14.514 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T09:46:15.202 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-09-10T09:46:16.535 INFO:teuthology.orchestra.run.smithi107.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T09:46:16.563 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-09-10T09:46:16.565 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-09-10T09:46:16.581 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.T7dtse0RDa 2024-09-10T09:46:16.582 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.T7dtse0RDa 2024-09-10T09:46:16.648 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.T7dtse0RDa 2024-09-10T09:46:16.796 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.T7dtse0RDa is 6KB 2024-09-10T09:46:16.845 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.T7dtse0RDa 2024-09-10T09:46:16.860 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T09:46:16.932 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T09:46:16.932 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T09:46:16.932 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T09:46:16.932 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T09:46:16.933 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T09:46:17.083 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-09-10T09:46:39.046 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-10T09:46:39.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-10T09:46:39.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:46:47.094 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-10T09:46:47.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-10T09:46:47.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:46:57.469 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-09-10T09:47:05.661 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-10T09:47:06.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-10T09:47:06.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:47:09.533 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-09-10T09:47:14.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-10T09:47:14.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:47:17.728 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-10T09:47:21.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-10T09:47:21.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:47:29.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-10T09:47:29.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:47:39.969 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-09-10T09:47:48.161 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-10T09:47:54.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-10T09:47:54.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:47:55.374 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-10T09:47:55.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-10T09:47:55.742 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-10T09:47:55.742 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-10T09:47:55.757 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-505.el9.x86_64 2024-09-10T09:47:55.757 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T09:47:55.757 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T09:47:55.757 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T09:47:56.758 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-10T09:47:56.758 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T09:47:56.843 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2024-09-10T09:47:56.860 DEBUG:teuthology.parallel:result is None 2024-09-10T09:48:03.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-10T09:48:03.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:48:03.489 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-09-10T09:48:03.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-10T09:48:03.892 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-10T09:48:03.892 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-09-10T09:48:03.906 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-505.el9.x86_64 2024-09-10T09:48:03.906 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T09:48:03.907 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T09:48:03.907 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T09:48:04.908 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-10T09:48:04.908 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T09:48:05.029 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-09-10T09:48:05.056 DEBUG:teuthology.parallel:result is None 2024-09-10T09:48:05.056 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T09:48:05.062 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T09:48:05.062 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T09:48:05.065 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T09:48:05.081 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T09:48:05.087 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T09:48:05.094 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T09:48:05.094 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T09:48:05.124 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T09:48:05.192 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T09:48:05.198 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T09:48:05.199 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T09:48:05.201 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T09:48:05.225 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:48:05.228 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:48:05.241 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:48:05.248 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:48:05.250 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T09:48:05.257 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T09:48:05.257 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T09:48:05.286 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T09:48:05.319 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T09:48:05.328 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T09:48:05.328 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T09:48:05.353 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T09:48:05.378 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:48:05.452 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:48:05.509 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:48:05.592 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:48:05.633 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:48:05.633 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T09:48:05.697 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:48:05.735 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:48:05.807 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:48:05.902 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:48:05.996 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-10T09:48:05.996 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T09:48:06.060 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-09-10T09:48:06.063 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-09-10T09:48:06.113 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T09:48:06.186 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T09:48:06.584 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T09:48:06.592 INFO:teuthology.task.internal:Starting timer... 2024-09-10T09:48:06.593 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T09:48:06.618 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T09:48:06.627 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-10T09:48:06.627 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-09-10T09:48:06.671 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-09-10T09:48:06.673 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-09-10T09:48:06.793 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-09-10T09:48:06.795 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T09:48:06.795 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-09-10T09:48:06.824 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-09-10T09:48:06.825 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-09-10T09:48:06.865 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-09-10T09:48:06.865 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi107.front.sepia.ceph.com': 'permissive'} 2024-09-10T09:48:06.865 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T09:48:06.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:48:06.894 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T09:48:06.934 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:48:06.935 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T09:48:06.935 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-09-10T09:48:06.978 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-09-10T09:48:07.009 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T09:48:07.019 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T09:48:07.021 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T09:48:07.146 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T09:48:07.157 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T09:48:07.158 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi071.front.sepia.ceph.com,smithi107.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T09:51:48.756 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com')] 2024-09-10T09:51:48.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-10T09:51:48.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:51:48.835 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-10T09:51:48.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-10T09:51:48.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-10T09:51:48.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:51:48.991 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-09-10T09:51:49.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-10T09:51:49.065 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T09:51:49.075 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T09:51:49.075 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T09:51:49.075 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T09:51:49.078 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T09:51:49.078 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T09:51:49.105 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T09:51:49.119 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T09:51:49.134 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T09:51:49.144 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-09-10T09:51:49.149 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T09:51:49.155 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-09-10T09:51:49.168 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T09:51:49.173 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-09-10T09:51:49.182 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T09:51:49.184 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-09-10T09:51:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T09:51:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T09:51:49.242 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-10T09:51:49.245 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T09:51:49.245 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-10T09:51:49.245 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:51:49.245 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:51:49.245 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:51:49.246 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:51:49.267 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-10T09:51:49.270 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T09:51:49.270 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-10T09:51:49.270 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:51:49.270 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:51:49.270 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:51:49.271 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:51:49.271 INFO:teuthology.run_tasks:Running task install... 2024-09-10T09:51:49.279 DEBUG:teuthology.task.install:project ceph 2024-09-10T09:51:49.280 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}} 2024-09-10T09:51:49.280 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T09:51:49.280 INFO:teuthology.task.install:Using flavor: default 2024-09-10T09:51:49.285 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T09:51:49.285 INFO:teuthology.task.install:extra packages: [] 2024-09-10T09:51:49.286 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T09:51:49.286 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T09:51:49.286 INFO:teuthology.packaging:ref: None 2024-09-10T09:51:49.286 INFO:teuthology.packaging:tag: None 2024-09-10T09:51:49.286 INFO:teuthology.packaging:branch: quincy 2024-09-10T09:51:49.287 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:51:49.287 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-10T09:51:49.289 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T09:51:49.289 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T09:51:49.289 INFO:teuthology.packaging:ref: None 2024-09-10T09:51:49.289 INFO:teuthology.packaging:tag: None 2024-09-10T09:51:49.289 INFO:teuthology.packaging:branch: quincy 2024-09-10T09:51:49.289 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:51:49.289 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-10T09:51:49.503 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/96d63e75d310869e716ce7c8655577b0e88a04aa/centos/9/flavors/default/ 2024-09-10T09:51:49.503 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1597.g96d63e75 2024-09-10T09:51:49.528 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/96d63e75d310869e716ce7c8655577b0e88a04aa/centos/9/flavors/default/ 2024-09-10T09:51:49.528 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1597.g96d63e75 2024-09-10T09:51:49.618 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/96d63e75d310869e716ce7c8655577b0e88a04aa/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/96d63e75d310869e716ce7c8655577b0e88a04aa/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/96d63e75d310869e716ce7c8655577b0e88a04aa/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T09:51:49.619 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:51:49.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T09:51:49.637 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/96d63e75d310869e716ce7c8655577b0e88a04aa/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/96d63e75d310869e716ce7c8655577b0e88a04aa/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/96d63e75d310869e716ce7c8655577b0e88a04aa/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T09:51:49.638 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-10T09:51:49.638 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T09:51:49.644 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-10T09:51:49.645 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T09:51:49.645 INFO:teuthology.packaging:ref: None 2024-09-10T09:51:49.645 INFO:teuthology.packaging:tag: None 2024-09-10T09:51:49.645 INFO:teuthology.packaging:branch: quincy 2024-09-10T09:51:49.645 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:51:49.645 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T09:51:49.665 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-10T09:51:49.665 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T09:51:49.665 INFO:teuthology.packaging:ref: None 2024-09-10T09:51:49.665 INFO:teuthology.packaging:tag: None 2024-09-10T09:51:49.665 INFO:teuthology.packaging:branch: quincy 2024-09-10T09:51:49.665 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:51:49.666 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T09:51:49.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T09:51:49.732 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T09:51:49.786 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T09:51:49.810 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T09:51:49.850 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-09-10T09:51:49.851 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-09-10T09:51:49.874 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-09-10T09:51:49.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-09-10T09:51:50.078 INFO:teuthology.orchestra.run.smithi071.stdout:45 files removed 2024-09-10T09:51:50.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw 2024-09-10T09:51:50.109 INFO:teuthology.orchestra.run.smithi107.stdout:45 files removed 2024-09-10T09:51:50.136 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw 2024-09-10T09:51:50.664 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 279 kB/s | 77 kB 00:00 2024-09-10T09:51:50.677 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 297 kB/s | 77 kB 00:00 2024-09-10T09:51:50.948 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-10T09:51:50.953 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-10T09:51:51.228 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 7.5 kB/s | 1.8 kB 00:00 2024-09-10T09:51:51.232 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 7.2 kB/s | 1.8 kB 00:00 2024-09-10T09:51:51.907 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-10T09:51:52.753 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.2 MB 00:01 2024-09-10T09:51:53.925 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-10T09:52:00.392 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-10T09:52:02.459 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 19 kB 00:00 2024-09-10T09:52:03.546 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-10T09:52:04.278 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 2.0 MB/s | 20 MB 00:10 2024-09-10T09:52:08.670 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-10T09:52:08.921 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-10T09:52:10.162 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-10T09:52:11.225 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-10T09:52:11.319 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:52:11.342 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:52:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-10T09:52:11.343 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:52:11.343 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:52:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 14 M 2024-09-10T09:52:11.343 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-09-10T09:52:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 3.1 M 2024-09-10T09:52:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 2.9 M 2024-09-10T09:52:11.343 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-10T09:52:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 5.0 M 2024-09-10T09:52:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 22 M 2024-09-10T09:52:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 25 k 2024-09-10T09:52:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T09:52:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 637 k 2024-09-10T09:52:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T09:52:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T09:52:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T09:52:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 457 k 2024-09-10T09:52:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T09:52:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 4.9 M 2024-09-10T09:52:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T09:52:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T09:52:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 45 k 2024-09-10T09:52:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 120 k 2024-09-10T09:52:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 156 k 2024-09-10T09:52:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T09:52:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 320 k 2024-09-10T09:52:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 295 k 2024-09-10T09:52:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 99 k 2024-09-10T09:52:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T09:52:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:11.345 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:52:11.345 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:52:11.345 INFO:teuthology.orchestra.run.smithi071.stdout:Install 22 Packages 2024-09-10T09:52:11.345 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 2 Packages 2024-09-10T09:52:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:11.346 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 58 M 2024-09-10T09:52:11.346 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:52:12.270 INFO:teuthology.orchestra.run.smithi071.stdout:(1/24): ceph-base-17.2.7-1597.g96d63e75.el9.x86 8.7 MB/s | 5.0 MB 00:00 2024-09-10T09:52:12.328 INFO:teuthology.orchestra.run.smithi071.stdout:(2/24): ceph-selinux-17.2.7-1597.g96d63e75.el9. 434 kB/s | 25 kB 00:00 2024-09-10T09:52:12.453 INFO:teuthology.orchestra.run.smithi071.stdout:(3/24): libcephfs2-17.2.7-1597.g96d63e75.el9.x8 5.0 MB/s | 637 kB 00:00 2024-09-10T09:52:12.545 INFO:teuthology.orchestra.run.smithi071.stdout:(4/24): libradosstriper1-17.2.7-1597.g96d63e75. 4.9 MB/s | 457 kB 00:00 2024-09-10T09:52:12.771 INFO:teuthology.orchestra.run.smithi071.stdout:(5/24): ceph-common-17.2.7-1597.g96d63e75.el9.x 21 MB/s | 22 MB 00:01 2024-09-10T09:52:12.804 INFO:teuthology.orchestra.run.smithi071.stdout:(6/24): python3-ceph-argparse-17.2.7-1597.g96d6 1.3 MB/s | 45 kB 00:00 2024-09-10T09:52:12.879 INFO:teuthology.orchestra.run.smithi071.stdout:(7/24): librgw2-17.2.7-1597.g96d63e75.el9.x86_6 15 MB/s | 4.9 MB 00:00 2024-09-10T09:52:12.905 INFO:teuthology.orchestra.run.smithi071.stdout:(8/24): python3-ceph-common-17.2.7-1597.g96d63e 1.2 MB/s | 120 kB 00:00 2024-09-10T09:52:12.930 INFO:teuthology.orchestra.run.smithi071.stdout:(9/24): python3-cephfs-17.2.7-1597.g96d63e75.el 3.0 MB/s | 156 kB 00:00 2024-09-10T09:52:13.081 INFO:teuthology.orchestra.run.smithi071.stdout:(10/24): ceph-radosgw-17.2.7-1597.g96d63e75.el9 10 MB/s | 14 MB 00:01 2024-09-10T09:52:13.105 INFO:teuthology.orchestra.run.smithi071.stdout:(11/24): python3-rados-17.2.7-1597.g96d63e75.el 1.6 MB/s | 320 kB 00:00 2024-09-10T09:52:13.148 INFO:teuthology.orchestra.run.smithi071.stdout:(12/24): python3-rgw-17.2.7-1597.g96d63e75.el9. 1.4 MB/s | 99 kB 00:00 2024-09-10T09:52:13.173 INFO:teuthology.orchestra.run.smithi071.stdout:(13/24): python3-rbd-17.2.7-1597.g96d63e75.el9. 1.2 MB/s | 295 kB 00:00 2024-09-10T09:52:13.490 INFO:teuthology.orchestra.run.smithi071.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 132 kB/s | 45 kB 00:00 2024-09-10T09:52:13.606 INFO:teuthology.orchestra.run.smithi071.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 320 kB/s | 160 kB 00:00 2024-09-10T09:52:13.707 INFO:teuthology.orchestra.run.smithi071.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 422 kB/s | 42 kB 00:00 2024-09-10T09:52:13.757 INFO:teuthology.orchestra.run.smithi071.stdout:(17/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 6.0 MB/s | 309 kB 00:00 2024-09-10T09:52:13.782 INFO:teuthology.orchestra.run.smithi071.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T09:52:13.808 INFO:teuthology.orchestra.run.smithi071.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T09:52:13.833 INFO:teuthology.orchestra.run.smithi071.stdout:(20/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 852 kB/s | 292 kB 00:00 2024-09-10T09:52:13.883 INFO:teuthology.orchestra.run.smithi071.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-10T09:52:13.950 INFO:teuthology.orchestra.run.smithi071.stdout:(22/24): librdkafka-1.6.1-102.el9.x86_64.rpm 852 kB/s | 662 kB 00:00 2024-09-10T09:52:14.067 INFO:teuthology.orchestra.run.smithi071.stdout:(23/24): librados2-17.2.7-1597.g96d63e75.el9.x8 13 MB/s | 3.1 MB 00:00 2024-09-10T09:52:14.134 INFO:teuthology.orchestra.run.smithi071.stdout:(24/24): librbd1-17.2.7-1597.g96d63e75.el9.x86_ 12 MB/s | 2.9 MB 00:00 2024-09-10T09:52:14.137 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:52:14.138 INFO:teuthology.orchestra.run.smithi071.stdout:Total 21 MB/s | 58 MB 00:02 2024-09-10T09:52:14.200 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:52:14.233 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:52:14.233 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:52:14.883 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:52:14.883 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:52:16.097 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:52:16.479 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-10T09:52:16.563 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:17.2.7-1597.g96d63e75.el9.x86_64 2/26 2024-09-10T09:52:16.655 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:17.2.7-1597.g96d63e75.el9.x86_64 2/26 2024-09-10T09:52:16.734 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:17.2.7-1597.g96d63e75.el9.x86_64 3/26 2024-09-10T09:52:16.756 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:17.2.7-1597.g96d63e75.el9.x86_64 4/26 2024-09-10T09:52:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:17.2.7-1597.g96d63e75.el9.x86_64 4/26 2024-09-10T09:52:16.863 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-10T09:52:16.890 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-10T09:52:16.927 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-10T09:52:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-10T09:52:17.392 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:17.2.7-1597.g96d63e75.el9.x86_64 8/26 2024-09-10T09:52:17.455 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:17.2.7-1597.g96d63e75.el9.x86_64 8/26 2024-09-10T09:52:17.483 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-10T09:52:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:17.2.7-1597.g96d63e75.el9. 10/26 2024-09-10T09:52:17.572 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:17.2.7-1597.g96d63e75.el9.x86_64 11/26 2024-09-10T09:52:17.634 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:17.2.7-1597.g96d63e75.el9.x86_64 12/26 2024-09-10T09:52:17.661 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:17.2.7-1597.g96d63e75.el9.x86_6 13/26 2024-09-10T09:52:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1597.g96d63e75.el9.x86_6 13/26 2024-09-10T09:52:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-10T09:52:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-09-10T09:52:17.836 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-10T09:52:18.137 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-10T09:52:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:17.2.7-1597.g96d63e75.el9.x86_64 18/26 2024-09-10T09:52:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:17.2.7-1597.g96d63e75.el9.x86_64 18/26 2024-09-10T09:52:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:17.2.7-1597.g96d63e75.el9.x86_64 19/26 2024-09-10T09:52:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:17.2.7-1597.g96d63e75.el9.x8 20/26 2024-09-10T09:52:19.230 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:52:19.242 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:52:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-10T09:52:19.242 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:52:19.243 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:52:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 14 M 2024-09-10T09:52:19.243 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-09-10T09:52:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 3.1 M 2024-09-10T09:52:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 2.9 M 2024-09-10T09:52:19.243 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-10T09:52:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 5.0 M 2024-09-10T09:52:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 22 M 2024-09-10T09:52:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 25 k 2024-09-10T09:52:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T09:52:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 637 k 2024-09-10T09:52:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T09:52:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T09:52:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T09:52:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 457 k 2024-09-10T09:52:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T09:52:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 4.9 M 2024-09-10T09:52:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T09:52:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T09:52:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 45 k 2024-09-10T09:52:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 120 k 2024-09-10T09:52:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 156 k 2024-09-10T09:52:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T09:52:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 320 k 2024-09-10T09:52:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 295 k 2024-09-10T09:52:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 99 k 2024-09-10T09:52:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T09:52:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:52:19.245 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:52:19.245 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:52:19.245 INFO:teuthology.orchestra.run.smithi107.stdout:Install 22 Packages 2024-09-10T09:52:19.245 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 2 Packages 2024-09-10T09:52:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:52:19.246 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 58 M 2024-09-10T09:52:19.246 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:52:20.198 INFO:teuthology.orchestra.run.smithi107.stdout:(1/24): ceph-base-17.2.7-1597.g96d63e75.el9.x86 5.7 MB/s | 5.0 MB 00:00 2024-09-10T09:52:20.348 INFO:teuthology.orchestra.run.smithi107.stdout:(2/24): ceph-radosgw-17.2.7-1597.g96d63e75.el9. 14 MB/s | 14 MB 00:01 2024-09-10T09:52:20.373 INFO:teuthology.orchestra.run.smithi107.stdout:(3/24): ceph-selinux-17.2.7-1597.g96d63e75.el9. 144 kB/s | 25 kB 00:00 2024-09-10T09:52:20.415 INFO:teuthology.orchestra.run.smithi107.stdout:(4/24): libcephfs2-17.2.7-1597.g96d63e75.el9.x8 9.3 MB/s | 637 kB 00:00 2024-09-10T09:52:20.440 INFO:teuthology.orchestra.run.smithi107.stdout:(5/24): libradosstriper1-17.2.7-1597.g96d63e75. 6.7 MB/s | 457 kB 00:00 2024-09-10T09:52:20.674 INFO:teuthology.orchestra.run.smithi107.stdout:(6/24): ceph-common-17.2.7-1597.g96d63e75.el9.x 17 MB/s | 22 MB 00:01 2024-09-10T09:52:20.699 INFO:teuthology.orchestra.run.smithi107.stdout:(7/24): python3-ceph-argparse-17.2.7-1597.g96d6 174 kB/s | 45 kB 00:00 2024-09-10T09:52:20.724 INFO:teuthology.orchestra.run.smithi107.stdout:(8/24): python3-ceph-common-17.2.7-1597.g96d63e 2.4 MB/s | 120 kB 00:00 2024-09-10T09:52:20.747 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:17.2.7-1597.g96d63e75.el9.x86_64 21/26 2024-09-10T09:52:20.750 INFO:teuthology.orchestra.run.smithi107.stdout:(9/24): python3-cephfs-17.2.7-1597.g96d63e75.el 3.0 MB/s | 156 kB 00:00 2024-09-10T09:52:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:17.2.7-1597.g96d63e75.el9.x86_64 21/26 2024-09-10T09:52:20.800 INFO:teuthology.orchestra.run.smithi107.stdout:(10/24): python3-rados-17.2.7-1597.g96d63e75.el 4.2 MB/s | 320 kB 00:00 2024-09-10T09:52:20.825 INFO:teuthology.orchestra.run.smithi107.stdout:(11/24): python3-rbd-17.2.7-1597.g96d63e75.el9. 3.8 MB/s | 295 kB 00:00 2024-09-10T09:52:20.851 INFO:teuthology.orchestra.run.smithi107.stdout:(12/24): python3-rgw-17.2.7-1597.g96d63e75.el9. 1.9 MB/s | 99 kB 00:00 2024-09-10T09:52:20.934 INFO:teuthology.orchestra.run.smithi107.stdout:(13/24): librgw2-17.2.7-1597.g96d63e75.el9.x86_ 9.5 MB/s | 4.9 MB 00:00 2024-09-10T09:52:21.009 INFO:teuthology.orchestra.run.smithi107.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 872 kB/s | 160 kB 00:00 2024-09-10T09:52:21.026 INFO:teuthology.orchestra.run.smithi107.stdout:(15/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 258 kB/s | 45 kB 00:00 2024-09-10T09:52:21.085 INFO:teuthology.orchestra.run.smithi107.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 724 kB/s | 42 kB 00:00 2024-09-10T09:52:21.135 INFO:teuthology.orchestra.run.smithi107.stdout:(17/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-10T09:52:21.169 INFO:teuthology.orchestra.run.smithi107.stdout:(18/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 3.6 MB/s | 309 kB 00:00 2024-09-10T09:52:21.202 INFO:teuthology.orchestra.run.smithi107.stdout:(19/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 292 kB 00:00 2024-09-10T09:52:21.219 INFO:teuthology.orchestra.run.smithi107.stdout:(20/24): liboath-2.6.7-2.el9.x86_64.rpm 580 kB/s | 49 kB 00:00 2024-09-10T09:52:21.253 INFO:teuthology.orchestra.run.smithi107.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 822 kB/s | 67 kB 00:00 2024-09-10T09:52:21.303 INFO:teuthology.orchestra.run.smithi107.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T09:52:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:17.2.7-1597.g96d63e75.el9.x86_64 21/26 2024-09-10T09:52:21.358 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:17.2.7-1597.g96d63e75.el9.x86_64 22/26 2024-09-10T09:52:21.445 INFO:teuthology.orchestra.run.smithi107.stdout:(23/24): librbd1-17.2.7-1597.g96d63e75.el9.x86_ 15 MB/s | 2.9 MB 00:00 2024-09-10T09:52:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:17.2.7-1597.g96d63e75.el9.x86_64 22/26 2024-09-10T09:52:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T09:52:21.461 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T09:52:21.461 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:17.2.7-1597.g96d63e75.el9.x86_64 23/26 2024-09-10T09:52:21.503 INFO:teuthology.orchestra.run.smithi107.stdout:(24/24): librados2-17.2.7-1597.g96d63e75.el9.x8 11 MB/s | 3.1 MB 00:00 2024-09-10T09:52:21.509 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:52:21.510 INFO:teuthology.orchestra.run.smithi107.stdout:Total 26 MB/s | 58 MB 00:02 2024-09-10T09:52:21.575 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:52:21.609 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:52:21.609 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:52:22.272 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:52:22.272 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:52:23.519 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:52:23.885 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-10T09:52:23.955 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:17.2.7-1597.g96d63e75.el9.x86_64 2/26 2024-09-10T09:52:24.047 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:17.2.7-1597.g96d63e75.el9.x86_64 2/26 2024-09-10T09:52:24.134 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:17.2.7-1597.g96d63e75.el9.x86_64 3/26 2024-09-10T09:52:24.157 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:17.2.7-1597.g96d63e75.el9.x86_64 4/26 2024-09-10T09:52:24.244 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:17.2.7-1597.g96d63e75.el9.x86_64 4/26 2024-09-10T09:52:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-10T09:52:24.337 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-10T09:52:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-10T09:52:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:17.2.7-1597.g96d63e75.el9.x86_64 8/26 2024-09-10T09:52:24.873 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:17.2.7-1597.g96d63e75.el9.x86_64 8/26 2024-09-10T09:52:24.909 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-10T09:52:24.953 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:17.2.7-1597.g96d63e75.el9. 10/26 2024-09-10T09:52:24.989 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:17.2.7-1597.g96d63e75.el9.x86_64 11/26 2024-09-10T09:52:25.060 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:17.2.7-1597.g96d63e75.el9.x86_64 12/26 2024-09-10T09:52:25.087 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:17.2.7-1597.g96d63e75.el9.x86_6 13/26 2024-09-10T09:52:25.136 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1597.g96d63e75.el9.x86_6 13/26 2024-09-10T09:52:25.176 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-10T09:52:25.212 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-09-10T09:52:25.245 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-10T09:52:25.537 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-10T09:52:25.583 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:17.2.7-1597.g96d63e75.el9.x86_64 18/26 2024-09-10T09:52:25.673 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:17.2.7-1597.g96d63e75.el9.x86_64 18/26 2024-09-10T09:52:25.754 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:17.2.7-1597.g96d63e75.el9.x86_64 19/26 2024-09-10T09:52:25.785 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:17.2.7-1597.g96d63e75.el9.x8 20/26 2024-09-10T09:52:28.190 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:17.2.7-1597.g96d63e75.el9.x86_64 21/26 2024-09-10T09:52:28.232 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:17.2.7-1597.g96d63e75.el9.x86_64 21/26 2024-09-10T09:52:28.759 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:17.2.7-1597.g96d63e75.el9.x86_64 21/26 2024-09-10T09:52:28.860 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:17.2.7-1597.g96d63e75.el9.x86_64 22/26 2024-09-10T09:52:28.958 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:17.2.7-1597.g96d63e75.el9.x86_64 22/26 2024-09-10T09:52:28.958 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T09:52:28.959 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T09:52:28.959 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:52:28.994 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:17.2.7-1597.g96d63e75.el9.x86_64 23/26 2024-09-10T09:52:31.401 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1597.g96d63e75.el9.x86_64 23/26 2024-09-10T09:52:31.401 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-09-10T09:52:31.402 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-09-10T09:52:31.402 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-09-10T09:52:31.402 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-09-10T09:52:31.402 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-09-10T09:52:31.402 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2024-09-10T09:52:31.402 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-09-10T09:52:31.402 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:32.750 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:17.2.7-1597.g96d63e75.el9.x86_64 24/26 2024-09-10T09:52:32.811 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1597.g96d63e75.el9.x86_64 24/26 2024-09-10T09:52:32.811 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:52:32.811 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T09:52:32.811 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:52:32.811 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:52:32.811 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:32.813 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-10T09:52:32.894 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-10T09:52:32.894 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-10T09:52:34.153 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-10T09:52:34.153 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:17.2.7-1597.g96d63e75.el9.x86_64 1/26 2024-09-10T09:52:34.154 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:17.2.7-1597.g96d63e75.el9.x86_64 2/26 2024-09-10T09:52:34.154 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:17.2.7-1597.g96d63e75.el9.x86_64 3/26 2024-09-10T09:52:34.154 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:17.2.7-1597.g96d63e75.el9.x86_64 4/26 2024-09-10T09:52:34.154 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:17.2.7-1597.g96d63e75.el9.x86_64 5/26 2024-09-10T09:52:34.154 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:17.2.7-1597.g96d63e75.el9.x86_6 6/26 2024-09-10T09:52:34.154 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:17.2.7-1597.g96d63e75.el9.x86_64 7/26 2024-09-10T09:52:34.154 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1597.g96d63e75.el9. 8/26 2024-09-10T09:52:34.154 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:17.2.7-1597.g96d63e75.el9.x8 9/26 2024-09-10T09:52:34.154 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:17.2.7-1597.g96d63e75.el9.x86_64 10/26 2024-09-10T09:52:34.154 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:17.2.7-1597.g96d63e75.el9.x86_64 11/26 2024-09-10T09:52:34.154 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:17.2.7-1597.g96d63e75.el9.x86_64 12/26 2024-09-10T09:52:34.154 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:17.2.7-1597.g96d63e75.el9.x86_64 13/26 2024-09-10T09:52:34.154 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-10T09:52:34.155 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-10T09:52:34.155 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-10T09:52:34.155 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-10T09:52:34.155 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-10T09:52:34.155 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-09-10T09:52:34.155 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-10T09:52:34.155 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-10T09:52:34.155 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-10T09:52:34.155 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:17.2.7-1597.g96d63e75.el9.x86_64 23/26 2024-09-10T09:52:34.155 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-10T09:52:34.155 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:17.2.7-1597.g96d63e75.el9.x86_64 25/26 2024-09-10T09:52:35.059 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-10T09:52:35.059 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:35.059 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-09-10T09:52:35.059 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.059 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.060 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:52:35.060 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.060 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.060 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.060 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.060 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T09:52:35.060 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.060 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T09:52:35.060 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T09:52:35.060 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T09:52:35.060 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.060 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T09:52:35.060 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.061 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T09:52:35.061 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T09:52:35.061 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.061 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.061 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.061 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T09:52:35.061 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.061 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.061 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:35.061 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T09:52:35.061 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:35.061 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:52:35.439 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-test 2024-09-10T09:52:36.011 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:28 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:52:36.146 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:52:36.147 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:52:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-10T09:52:36.147 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:52:36.147 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:52:36.147 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 48 M 2024-09-10T09:52:36.147 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-10T09:52:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 163 k 2024-09-10T09:52:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T09:52:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T09:52:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:36.148 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:52:36.148 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:52:36.148 INFO:teuthology.orchestra.run.smithi071.stdout:Install 4 Packages 2024-09-10T09:52:36.148 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:36.149 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 48 M 2024-09-10T09:52:36.149 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 193 M 2024-09-10T09:52:36.149 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:52:36.383 INFO:teuthology.orchestra.run.smithi071.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.3 MB/s | 304 kB 00:00 2024-09-10T09:52:36.425 INFO:teuthology.orchestra.run.smithi071.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-10T09:52:36.475 INFO:teuthology.orchestra.run.smithi071.stdout:(3/4): libcephsqlite-17.2.7-1597.g96d63e75.el9. 730 kB/s | 163 kB 00:00 2024-09-10T09:52:37.767 INFO:teuthology.orchestra.run.smithi071.stdout:(4/4): ceph-test-17.2.7-1597.g96d63e75.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-10T09:52:37.769 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:52:37.769 INFO:teuthology.orchestra.run.smithi071.stdout:Total 30 MB/s | 48 MB 00:01 2024-09-10T09:52:37.798 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:52:37.817 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:52:37.817 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:52:38.192 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:52:38.192 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:52:38.723 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:52:38.743 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1597.g96d63e75.el9.x86_64 23/26 2024-09-10T09:52:38.743 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-09-10T09:52:38.743 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-09-10T09:52:38.743 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-09-10T09:52:38.743 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-09-10T09:52:38.743 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-09-10T09:52:38.743 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-09-10T09:52:38.743 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-09-10T09:52:38.744 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:52:38.812 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-10T09:52:38.857 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-10T09:52:38.885 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:17.2.7-1597.g96d63e75.el9.x86_64 3/4 2024-09-10T09:52:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:17.2.7-1597.g96d63e75.el9.x86_64 24/26 2024-09-10T09:52:40.147 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1597.g96d63e75.el9.x86_64 24/26 2024-09-10T09:52:40.147 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:52:40.147 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T09:52:40.147 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:52:40.147 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:52:40.147 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:52:40.149 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-10T09:52:40.238 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-10T09:52:40.239 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-10T09:52:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-10T09:52:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:17.2.7-1597.g96d63e75.el9.x86_64 1/26 2024-09-10T09:52:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:17.2.7-1597.g96d63e75.el9.x86_64 2/26 2024-09-10T09:52:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:17.2.7-1597.g96d63e75.el9.x86_64 3/26 2024-09-10T09:52:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:17.2.7-1597.g96d63e75.el9.x86_64 4/26 2024-09-10T09:52:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:17.2.7-1597.g96d63e75.el9.x86_64 5/26 2024-09-10T09:52:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:17.2.7-1597.g96d63e75.el9.x86_6 6/26 2024-09-10T09:52:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:17.2.7-1597.g96d63e75.el9.x86_64 7/26 2024-09-10T09:52:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1597.g96d63e75.el9. 8/26 2024-09-10T09:52:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:17.2.7-1597.g96d63e75.el9.x8 9/26 2024-09-10T09:52:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:17.2.7-1597.g96d63e75.el9.x86_64 10/26 2024-09-10T09:52:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:17.2.7-1597.g96d63e75.el9.x86_64 11/26 2024-09-10T09:52:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:17.2.7-1597.g96d63e75.el9.x86_64 12/26 2024-09-10T09:52:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:17.2.7-1597.g96d63e75.el9.x86_64 13/26 2024-09-10T09:52:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-10T09:52:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-10T09:52:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-10T09:52:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-10T09:52:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-10T09:52:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-09-10T09:52:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-10T09:52:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-10T09:52:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-10T09:52:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:17.2.7-1597.g96d63e75.el9.x86_64 23/26 2024-09-10T09:52:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-10T09:52:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:17.2.7-1597.g96d63e75.el9.x86_64 25/26 2024-09-10T09:52:42.462 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-10T09:52:42.463 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:52:42.463 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-09-10T09:52:42.463 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.463 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.463 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:52:42.463 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.463 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.463 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.463 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.463 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T09:52:42.463 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.464 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T09:52:42.464 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T09:52:42.464 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T09:52:42.464 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.464 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T09:52:42.464 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.464 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T09:52:42.464 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T09:52:42.464 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.464 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.464 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.464 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T09:52:42.464 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.465 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.465 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:42.465 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T09:52:42.465 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:52:42.465 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:52:42.834 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-test 2024-09-10T09:52:43.314 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1597.g96d63e75.el9.x86_64 3/4 2024-09-10T09:52:43.390 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:17.2.7-1597.g96d63e75.el9.x86_64 4/4 2024-09-10T09:52:43.397 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:27 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:52:43.529 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:52:43.530 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:52:43.530 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-10T09:52:43.530 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:52:43.530 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:52:43.530 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 48 M 2024-09-10T09:52:43.530 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-10T09:52:43.530 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 163 k 2024-09-10T09:52:43.530 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T09:52:43.530 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T09:52:43.530 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:52:43.530 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:52:43.531 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:52:43.531 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2024-09-10T09:52:43.531 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:52:43.531 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 48 M 2024-09-10T09:52:43.531 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 193 M 2024-09-10T09:52:43.531 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:52:43.845 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-10T09:52:43.870 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): libcephsqlite-17.2.7-1597.g96d63e75.el9. 680 kB/s | 163 kB 00:00 2024-09-10T09:52:43.895 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T09:52:45.162 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): ceph-test-17.2.7-1597.g96d63e75.el9.x86_ 31 MB/s | 48 MB 00:01 2024-09-10T09:52:45.165 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:52:45.165 INFO:teuthology.orchestra.run.smithi107.stdout:Total 30 MB/s | 48 MB 00:01 2024-09-10T09:52:45.192 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:52:45.211 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:52:45.211 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:52:45.590 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:52:45.591 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:52:45.614 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-test-2:17.2.7-1597.g96d63e75.el9.x86_64 4/4 2024-09-10T09:52:45.614 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:17.2.7-1597.g96d63e75.el9.x86_64 1/4 2024-09-10T09:52:45.614 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:17.2.7-1597.g96d63e75.el9.x86_64 2/4 2024-09-10T09:52:45.614 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-10T09:52:45.939 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-10T09:52:45.939 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:45.939 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:52:45.939 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:45.940 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:45.940 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T09:52:45.940 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T09:52:45.940 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:45.940 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:52:46.109 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:52:46.197 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-10T09:52:46.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph 2024-09-10T09:52:46.244 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-10T09:52:46.272 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:17.2.7-1597.g96d63e75.el9.x86_64 3/4 2024-09-10T09:52:46.769 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:38 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:52:46.902 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:52:46.904 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:52:46.904 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-10T09:52:46.905 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:52:46.905 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:52:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 6.5 k 2024-09-10T09:52:46.905 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-10T09:52:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 2.1 M 2024-09-10T09:52:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 1.4 M 2024-09-10T09:52:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 240 k 2024-09-10T09:52:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 3.9 M 2024-09-10T09:52:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 15 M 2024-09-10T09:52:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T09:52:46.905 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T09:52:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T09:52:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T09:52:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T09:52:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T09:52:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T09:52:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections 2024-09-10T09:52:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-10T09:52:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T09:52:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T09:52:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T09:52:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T09:52:46.906 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T09:52:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T09:52:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T09:52:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T09:52:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T09:52:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T09:52:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T09:52:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T09:52:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T09:52:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T09:52:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T09:52:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T09:52:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T09:52:46.907 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T09:52:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T09:52:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T09:52:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:46.908 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:52:46.908 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:52:46.908 INFO:teuthology.orchestra.run.smithi071.stdout:Install 34 Packages 2024-09-10T09:52:46.908 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:46.909 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 27 M 2024-09-10T09:52:46.909 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 96 M 2024-09-10T09:52:46.909 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:52:47.276 INFO:teuthology.orchestra.run.smithi071.stdout:(1/34): ceph-17.2.7-1597.g96d63e75.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-10T09:52:47.476 INFO:teuthology.orchestra.run.smithi071.stdout:(2/34): ceph-mds-17.2.7-1597.g96d63e75.el9.x86_ 6.4 MB/s | 2.1 MB 00:00 2024-09-10T09:52:47.517 INFO:teuthology.orchestra.run.smithi071.stdout:(3/34): ceph-mgr-17.2.7-1597.g96d63e75.el9.x86_ 3.8 MB/s | 1.4 MB 00:00 2024-09-10T09:52:47.610 INFO:teuthology.orchestra.run.smithi071.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1597.g96d6 2.6 MB/s | 240 kB 00:00 2024-09-10T09:52:47.952 INFO:teuthology.orchestra.run.smithi071.stdout:(5/34): ceph-osd-17.2.7-1597.g96d63e75.el9.x86_ 32 MB/s | 15 MB 00:00 2024-09-10T09:52:48.018 INFO:teuthology.orchestra.run.smithi071.stdout:(6/34): ceph-mon-17.2.7-1597.g96d63e75.el9.x86_ 5.3 MB/s | 3.9 MB 00:00 2024-09-10T09:52:48.318 INFO:teuthology.orchestra.run.smithi071.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 355 kB/s | 106 kB 00:00 2024-09-10T09:52:48.344 INFO:teuthology.orchestra.run.smithi071.stdout:(8/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 345 kB/s | 253 kB 00:00 2024-09-10T09:52:48.519 INFO:teuthology.orchestra.run.smithi071.stdout:(9/34): python3-requests-2.25.1-8.el9.noarch.rp 713 kB/s | 125 kB 00:00 2024-09-10T09:52:48.586 INFO:teuthology.orchestra.run.smithi071.stdout:(10/34): python3-pycparser-2.20-6.el9.noarch.rp 505 kB/s | 135 kB 00:00 2024-09-10T09:52:48.703 INFO:teuthology.orchestra.run.smithi071.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 1.1 MB/s | 215 kB 00:00 2024-09-10T09:52:48.787 INFO:teuthology.orchestra.run.smithi071.stdout:(12/34): python3-cryptography-36.0.1-4.el9.x86_ 1.5 MB/s | 1.2 MB 00:00 2024-09-10T09:52:49.320 INFO:teuthology.orchestra.run.smithi071.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 56 kB/s | 35 kB 00:00 2024-09-10T09:52:49.362 INFO:teuthology.orchestra.run.smithi071.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 222 kB/s | 172 kB 00:00 2024-09-10T09:52:49.463 INFO:teuthology.orchestra.run.smithi071.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 114 kB/s | 77 kB 00:00 2024-09-10T09:52:49.504 INFO:teuthology.orchestra.run.smithi071.stdout:(16/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-09-10T09:52:49.530 INFO:teuthology.orchestra.run.smithi071.stdout:(17/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2024-09-10T09:52:49.563 INFO:teuthology.orchestra.run.smithi071.stdout:(18/34): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-10T09:52:49.580 INFO:teuthology.orchestra.run.smithi071.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 642 kB/s | 11 kB 00:00 2024-09-10T09:52:49.605 INFO:teuthology.orchestra.run.smithi071.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 983 kB/s | 18 kB 00:00 2024-09-10T09:52:49.622 INFO:teuthology.orchestra.run.smithi071.stdout:(21/34): python3-jaraco-collections-3.0.0-8.el9 1.4 MB/s | 23 kB 00:00 2024-09-10T09:52:49.639 INFO:teuthology.orchestra.run.smithi071.stdout:(22/34): python3-jaraco-functools-3.5.0-2.el9.n 1.2 MB/s | 19 kB 00:00 2024-09-10T09:52:49.656 INFO:teuthology.orchestra.run.smithi071.stdout:(23/34): python3-jaraco-text-3.2.0-6.el9.noarch 1.2 MB/s | 20 kB 00:00 2024-09-10T09:52:49.673 INFO:teuthology.orchestra.run.smithi071.stdout:(24/34): python3-logutils-0.3.5-21.el9.noarch.r 2.7 MB/s | 46 kB 00:00 2024-09-10T09:52:49.698 INFO:teuthology.orchestra.run.smithi071.stdout:(25/34): python3-more-itertools-8.12.0-2.el9.no 3.1 MB/s | 79 kB 00:00 2024-09-10T09:52:49.740 INFO:teuthology.orchestra.run.smithi071.stdout:(26/34): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-09-10T09:52:49.757 INFO:teuthology.orchestra.run.smithi071.stdout:(27/34): python3-portend-3.1.0-2.el9.noarch.rpm 990 kB/s | 16 kB 00:00 2024-09-10T09:52:49.782 INFO:teuthology.orchestra.run.smithi071.stdout:(28/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-10T09:52:49.800 INFO:teuthology.orchestra.run.smithi071.stdout:(29/34): python3-tempora-5.0.0-2.el9.noarch.rpm 2.1 MB/s | 36 kB 00:00 2024-09-10T09:52:49.825 INFO:teuthology.orchestra.run.smithi071.stdout:(30/34): python3-webob-1.8.8-2.el9.noarch.rpm 9.1 MB/s | 230 kB 00:00 2024-09-10T09:52:49.859 INFO:teuthology.orchestra.run.smithi071.stdout:(31/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 13 MB/s | 427 kB 00:00 2024-09-10T09:52:49.875 INFO:teuthology.orchestra.run.smithi071.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-10T09:52:49.926 INFO:teuthology.orchestra.run.smithi071.stdout:(33/34): python3-pytz-2021.1-5.el9.noarch.rpm 84 kB/s | 51 kB 00:00 2024-09-10T09:52:49.951 INFO:teuthology.orchestra.run.smithi071.stdout:(34/34): python3-toml-0.10.2-6.el9.noarch.rpm 71 kB/s | 42 kB 00:00 2024-09-10T09:52:49.955 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:52:49.955 INFO:teuthology.orchestra.run.smithi071.stdout:Total 8.9 MB/s | 27 MB 00:03 2024-09-10T09:52:50.089 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:52:50.127 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:52:50.127 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:52:50.537 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:52:50.537 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:52:50.667 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1597.g96d63e75.el9.x86_64 3/4 2024-09-10T09:52:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:17.2.7-1597.g96d63e75.el9.x86_64 4/4 2024-09-10T09:52:51.818 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:52:51.896 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-10T09:52:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-10T09:52:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-10T09:52:52.056 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-10T09:52:52.140 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-10T09:52:52.179 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-10T09:52:52.215 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-10T09:52:52.244 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-10T09:52:52.280 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-10T09:52:52.321 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-10T09:52:52.362 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-10T09:52:52.397 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-10T09:52:52.431 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-10T09:52:52.479 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-10T09:52:52.519 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-10T09:52:52.594 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-10T09:52:52.735 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-10T09:52:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-10T09:52:52.876 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-10T09:52:52.923 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-10T09:52:52.972 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-10T09:52:53.035 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-10T09:52:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-test-2:17.2.7-1597.g96d63e75.el9.x86_64 4/4 2024-09-10T09:52:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:17.2.7-1597.g96d63e75.el9.x86_64 1/4 2024-09-10T09:52:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:17.2.7-1597.g96d63e75.el9.x86_64 2/4 2024-09-10T09:52:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-10T09:52:53.219 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-10T09:52:53.276 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-10T09:52:53.355 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-10T09:52:53.398 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-10T09:52:53.398 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:52:53.399 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:52:53.399 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:53.399 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:53.399 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T09:52:53.399 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T09:52:53.399 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:52:53.399 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:52:53.443 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-10T09:52:53.487 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-10T09:52:53.616 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-10T09:52:53.678 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph 2024-09-10T09:52:53.771 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1597.g96d63e75.el9. 29/34 2024-09-10T09:52:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:17.2.7-1597.g96d63e75.el9.x86_64 30/34 2024-09-10T09:52:53.829 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1597.g96d63e75.el9.x86_64 30/34 2024-09-10T09:52:53.829 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:52:53.829 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T09:52:53.829 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:52:53.829 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:52:53.829 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:54.246 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:38 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:52:54.385 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:52:54.387 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:52:54.387 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-10T09:52:54.388 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:52:54.388 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:52:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 6.5 k 2024-09-10T09:52:54.388 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-10T09:52:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 2.1 M 2024-09-10T09:52:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 1.4 M 2024-09-10T09:52:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 240 k 2024-09-10T09:52:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 3.9 M 2024-09-10T09:52:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 15 M 2024-09-10T09:52:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T09:52:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T09:52:54.388 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T09:52:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T09:52:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T09:52:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T09:52:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T09:52:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections 2024-09-10T09:52:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-10T09:52:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T09:52:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T09:52:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T09:52:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T09:52:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T09:52:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T09:52:54.389 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T09:52:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T09:52:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T09:52:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T09:52:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T09:52:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T09:52:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T09:52:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T09:52:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T09:52:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T09:52:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T09:52:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T09:52:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T09:52:54.390 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T09:52:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:52:54.391 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:52:54.391 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:52:54.391 INFO:teuthology.orchestra.run.smithi107.stdout:Install 34 Packages 2024-09-10T09:52:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:52:54.391 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 27 M 2024-09-10T09:52:54.391 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 96 M 2024-09-10T09:52:54.392 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:52:54.889 INFO:teuthology.orchestra.run.smithi107.stdout:(1/34): ceph-17.2.7-1597.g96d63e75.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-10T09:52:55.064 INFO:teuthology.orchestra.run.smithi107.stdout:(2/34): ceph-mgr-17.2.7-1597.g96d63e75.el9.x86_ 4.6 MB/s | 1.4 MB 00:00 2024-09-10T09:52:55.130 INFO:teuthology.orchestra.run.smithi107.stdout:(3/34): ceph-mds-17.2.7-1597.g96d63e75.el9.x86_ 5.6 MB/s | 2.1 MB 00:00 2024-09-10T09:52:55.137 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:17.2.7-1597.g96d63e75.el9.x86_64 31/34 2024-09-10T09:52:55.164 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:17.2.7-1597.g96d63e75.el9.x86_64 31/34 2024-09-10T09:52:55.164 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:52:55.164 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T09:52:55.164 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:52:55.164 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:52:55.164 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:55.198 INFO:teuthology.orchestra.run.smithi107.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1597.g96d6 3.5 MB/s | 240 kB 00:00 2024-09-10T09:52:55.306 INFO:teuthology.orchestra.run.smithi107.stdout:(5/34): ceph-mon-17.2.7-1597.g96d63e75.el9.x86_ 9.4 MB/s | 3.9 MB 00:00 2024-09-10T09:52:55.529 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:17.2.7-1597.g96d63e75.el9.x86_64 32/34 2024-09-10T09:52:55.553 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:17.2.7-1597.g96d63e75.el9.x86_64 32/34 2024-09-10T09:52:55.553 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:52:55.553 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T09:52:55.553 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:52:55.553 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:52:55.553 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:55.590 INFO:teuthology.orchestra.run.smithi107.stdout:(6/34): ceph-osd-17.2.7-1597.g96d63e75.el9.x86_ 29 MB/s | 15 MB 00:00 2024-09-10T09:52:55.754 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:17.2.7-1597.g96d63e75.el9.x86_64 33/34 2024-09-10T09:52:55.778 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:17.2.7-1597.g96d63e75.el9.x86_64 33/34 2024-09-10T09:52:55.778 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:52:55.778 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T09:52:55.778 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:52:55.778 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:52:55.778 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:55.843 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:17.2.7-1597.g96d63e75.el9.x86_64 34/34 2024-09-10T09:52:55.965 INFO:teuthology.orchestra.run.smithi107.stdout:(7/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 330 kB/s | 253 kB 00:00 2024-09-10T09:52:56.040 INFO:teuthology.orchestra.run.smithi107.stdout:(8/34): python3-ply-3.11-14.el9.noarch.rpm 237 kB/s | 106 kB 00:00 2024-09-10T09:52:56.074 INFO:teuthology.orchestra.run.smithi107.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-09-10T09:52:56.183 INFO:teuthology.orchestra.run.smithi107.stdout:(10/34): python3-urllib3-1.26.5-6.el9.noarch.rp 1.9 MB/s | 215 kB 00:00 2024-09-10T09:52:56.225 INFO:teuthology.orchestra.run.smithi107.stdout:(11/34): python3-requests-2.25.1-8.el9.noarch.r 679 kB/s | 125 kB 00:00 2024-09-10T09:52:56.275 INFO:teuthology.orchestra.run.smithi107.stdout:(12/34): python3-cryptography-36.0.1-4.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2024-09-10T09:52:56.333 INFO:teuthology.orchestra.run.smithi107.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-09-10T09:52:56.359 INFO:teuthology.orchestra.run.smithi107.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 979 kB/s | 172 kB 00:00 2024-09-10T09:52:56.384 INFO:teuthology.orchestra.run.smithi107.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 708 kB/s | 77 kB 00:00 2024-09-10T09:52:56.409 INFO:teuthology.orchestra.run.smithi107.stdout:(16/34): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-10T09:52:56.435 INFO:teuthology.orchestra.run.smithi107.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-09-10T09:52:56.485 INFO:teuthology.orchestra.run.smithi107.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 578 kB/s | 43 kB 00:00 2024-09-10T09:52:56.510 INFO:teuthology.orchestra.run.smithi107.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 462 kB/s | 11 kB 00:00 2024-09-10T09:52:56.535 INFO:teuthology.orchestra.run.smithi107.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-10T09:52:56.560 INFO:teuthology.orchestra.run.smithi107.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-09-10T09:52:56.586 INFO:teuthology.orchestra.run.smithi107.stdout:(22/34): python3-jaraco-functools-3.5.0-2.el9.n 786 kB/s | 19 kB 00:00 2024-09-10T09:52:56.611 INFO:teuthology.orchestra.run.smithi107.stdout:(23/34): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-10T09:52:56.636 INFO:teuthology.orchestra.run.smithi107.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-10T09:52:56.662 INFO:teuthology.orchestra.run.smithi107.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-10T09:52:56.687 INFO:teuthology.orchestra.run.smithi107.stdout:(26/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-10T09:52:56.712 INFO:teuthology.orchestra.run.smithi107.stdout:(27/34): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-10T09:52:56.738 INFO:teuthology.orchestra.run.smithi107.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-10T09:52:56.763 INFO:teuthology.orchestra.run.smithi107.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-10T09:52:56.788 INFO:teuthology.orchestra.run.smithi107.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-10T09:52:56.822 INFO:teuthology.orchestra.run.smithi107.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-10T09:52:56.847 INFO:teuthology.orchestra.run.smithi107.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-10T09:52:56.873 INFO:teuthology.orchestra.run.smithi107.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 396 kB/s | 20 kB 00:00 2024-09-10T09:52:56.898 INFO:teuthology.orchestra.run.smithi107.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-10T09:52:56.903 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:52:56.903 INFO:teuthology.orchestra.run.smithi107.stdout:Total 11 MB/s | 27 MB 00:02 2024-09-10T09:52:57.036 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:52:57.075 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:52:57.075 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:52:57.466 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:52:57.466 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:52:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-2:17.2.7-1597.g96d63e75.el9.x86_64 34/34 2024-09-10T09:52:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:17.2.7-1597.g96d63e75.el9.x86_64 1/34 2024-09-10T09:52:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:17.2.7-1597.g96d63e75.el9.x86_64 2/34 2024-09-10T09:52:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:17.2.7-1597.g96d63e75.el9.x86_64 3/34 2024-09-10T09:52:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:17.2.7-1597.g96d63e75.el9.x86_64 4/34 2024-09-10T09:52:57.651 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:17.2.7-1597.g96d63e75.el9.x86_64 5/34 2024-09-10T09:52:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1597.g96d63e75.el9. 6/34 2024-09-10T09:52:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-10T09:52:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-10T09:52:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-10T09:52:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-10T09:52:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-10T09:52:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-10T09:52:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-10T09:52:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-10T09:52:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-10T09:52:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-10T09:52:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-10T09:52:57.652 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-10T09:52:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-10T09:52:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-10T09:52:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-10T09:52:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-10T09:52:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-10T09:52:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-10T09:52:57.653 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-10T09:52:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-10T09:52:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-10T09:52:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-10T09:52:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-10T09:52:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-10T09:52:57.654 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-10T09:52:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-10T09:52:57.655 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-10T09:52:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-10T09:52:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:58.564 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:52:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:52:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:52:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T09:52:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T09:52:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T09:52:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T09:52:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T09:52:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T09:52:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T09:52:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T09:52:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T09:52:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T09:52:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T09:52:58.565 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T09:52:58.566 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T09:52:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T09:52:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T09:52:58.567 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:52:58.567 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:52:58.711 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:52:58.776 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-10T09:52:58.816 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-10T09:52:58.849 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-10T09:52:58.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-base 2024-09-10T09:52:58.957 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-10T09:52:59.037 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-10T09:52:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-10T09:52:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-10T09:52:59.151 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-10T09:52:59.185 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-10T09:52:59.219 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-10T09:52:59.259 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-10T09:52:59.294 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-10T09:52:59.329 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-10T09:52:59.377 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-10T09:52:59.417 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-10T09:52:59.493 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-10T09:52:59.523 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:51 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:52:59.613 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-base-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:52:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-10T09:52:59.654 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:52:59.655 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-10T09:52:59.656 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:52:59.713 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-10T09:52:59.730 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install cephadm 2024-09-10T09:52:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-10T09:52:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-10T09:52:59.870 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-10T09:52:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-10T09:53:00.110 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-10T09:53:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-10T09:53:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-10T09:53:00.297 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:52 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:00.334 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-10T09:53:00.384 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-10T09:53:00.427 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:00.428 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:00.428 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-10T09:53:00.428 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:00.428 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:53:00.428 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 83 k 2024-09-10T09:53:00.429 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:00.429 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:53:00.429 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:00.429 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-10T09:53:00.429 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:00.429 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 83 k 2024-09-10T09:53:00.429 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 375 k 2024-09-10T09:53:00.429 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:53:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-10T09:53:00.603 INFO:teuthology.orchestra.run.smithi071.stdout:cephadm-17.2.7-1597.g96d63e75.el9.noarch.rpm 478 kB/s | 83 kB 00:00 2024-09-10T09:53:00.603 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:00.603 INFO:teuthology.orchestra.run.smithi071.stdout:Total 473 kB/s | 83 kB 00:00 2024-09-10T09:53:00.603 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:53:00.608 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:53:00.609 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:53:00.610 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:53:00.611 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:53:00.675 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1597.g96d63e75.el9. 29/34 2024-09-10T09:53:00.688 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:53:00.702 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:17.2.7-1597.g96d63e75.el9.x86_64 30/34 2024-09-10T09:53:00.728 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1597.g96d63e75.el9.x86_64 30/34 2024-09-10T09:53:00.728 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:53:00.728 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T09:53:00.728 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:53:00.729 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:53:00.729 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 1/1 2024-09-10T09:53:01.222 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 1/1 2024-09-10T09:53:01.609 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 1/1 2024-09-10T09:53:01.878 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 1/1 2024-09-10T09:53:01.878 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:01.878 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:53:01.878 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:01.879 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:01.879 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:02.089 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-immutable-object-cache 2024-09-10T09:53:02.104 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:17.2.7-1597.g96d63e75.el9.x86_64 31/34 2024-09-10T09:53:02.136 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:17.2.7-1597.g96d63e75.el9.x86_64 31/34 2024-09-10T09:53:02.136 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:53:02.136 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T09:53:02.136 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:53:02.136 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:53:02.137 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:02.521 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:17.2.7-1597.g96d63e75.el9.x86_64 32/34 2024-09-10T09:53:02.546 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:17.2.7-1597.g96d63e75.el9.x86_64 32/34 2024-09-10T09:53:02.546 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:53:02.546 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T09:53:02.546 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:53:02.546 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:53:02.547 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:02.666 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:54 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:17.2.7-1597.g96d63e75.el9.x86_64 33/34 2024-09-10T09:53:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:17.2.7-1597.g96d63e75.el9.x86_64 33/34 2024-09-10T09:53:02.771 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:53:02.771 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T09:53:02.771 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:53:02.772 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:53:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:02.800 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:02.801 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:02.801 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-10T09:53:02.801 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:02.801 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:53:02.801 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 137 k 2024-09-10T09:53:02.801 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:02.801 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:53:02.801 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:02.801 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-10T09:53:02.802 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:02.802 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 137 k 2024-09-10T09:53:02.802 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 379 k 2024-09-10T09:53:02.802 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:53:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:17.2.7-1597.g96d63e75.el9.x86_64 34/34 2024-09-10T09:53:02.992 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-immutable-object-cache-17.2.7-1597.g96d63e 725 kB/s | 137 kB 00:00 2024-09-10T09:53:02.992 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:02.992 INFO:teuthology.orchestra.run.smithi071.stdout:Total 719 kB/s | 137 kB 00:00 2024-09-10T09:53:02.993 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:53:03.000 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:53:03.000 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:53:03.057 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:53:03.057 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:53:03.201 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:53:03.267 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1597.g96d63e75. 1/1 2024-09-10T09:53:03.293 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1597.g96d63e75. 1/1 2024-09-10T09:53:03.293 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:53:03.293 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T09:53:03.293 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1597.g96d63e75. 1/1 2024-09-10T09:53:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:04.228 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:53:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:04.229 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:04.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr 2024-09-10T09:53:04.620 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-2:17.2.7-1597.g96d63e75.el9.x86_64 34/34 2024-09-10T09:53:04.620 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:17.2.7-1597.g96d63e75.el9.x86_64 1/34 2024-09-10T09:53:04.620 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:17.2.7-1597.g96d63e75.el9.x86_64 2/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:17.2.7-1597.g96d63e75.el9.x86_64 3/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:17.2.7-1597.g96d63e75.el9.x86_64 4/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:17.2.7-1597.g96d63e75.el9.x86_64 5/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1597.g96d63e75.el9. 6/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-10T09:53:04.621 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-10T09:53:04.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-10T09:53:04.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-10T09:53:04.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-10T09:53:04.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-10T09:53:04.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-10T09:53:04.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-10T09:53:04.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-10T09:53:04.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-10T09:53:04.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-10T09:53:04.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-10T09:53:04.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-10T09:53:04.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-10T09:53:04.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-10T09:53:04.623 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-10T09:53:04.623 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-10T09:53:04.623 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-10T09:53:04.623 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-10T09:53:05.012 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:57 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:05.105 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-mgr-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:05.147 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:05.148 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-10T09:53:05.148 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:05.235 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-dashboard 2024-09-10T09:53:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-10T09:53:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:05.395 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:53:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T09:53:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T09:53:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T09:53:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T09:53:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T09:53:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T09:53:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T09:53:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T09:53:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T09:53:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T09:53:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T09:53:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T09:53:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T09:53:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T09:53:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T09:53:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T09:53:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T09:53:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T09:53:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T09:53:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T09:53:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T09:53:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T09:53:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T09:53:05.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T09:53:05.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T09:53:05.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T09:53:05.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T09:53:05.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T09:53:05.398 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:05.398 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:05.765 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-base 2024-09-10T09:53:05.797 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:57 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:05.929 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:05.930 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:05.930 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-10T09:53:05.930 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:05.930 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:53:05.930 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 3.4 M 2024-09-10T09:53:05.930 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-10T09:53:05.930 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 24 k 2024-09-10T09:53:05.930 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 15 k 2024-09-10T09:53:05.931 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-10T09:53:05.931 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T09:53:05.931 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T09:53:05.931 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-09-10T09:53:05.931 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-10T09:53:05.931 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:05.931 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:53:05.931 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:05.931 INFO:teuthology.orchestra.run.smithi071.stdout:Install 7 Packages 2024-09-10T09:53:05.931 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:05.932 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 3.7 M 2024-09-10T09:53:05.932 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 80 M 2024-09-10T09:53:05.932 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:53:06.144 INFO:teuthology.orchestra.run.smithi071.stdout:(1/7): ceph-prometheus-alerts-17.2.7-1597.g96d6 99 kB/s | 15 kB 00:00 2024-09-10T09:53:06.170 INFO:teuthology.orchestra.run.smithi071.stdout:(2/7): ceph-grafana-dashboards-17.2.7-1597.g96d 141 kB/s | 24 kB 00:00 2024-09-10T09:53:06.220 INFO:teuthology.orchestra.run.smithi071.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 120 kB/s | 9.0 kB 00:00 2024-09-10T09:53:06.245 INFO:teuthology.orchestra.run.smithi071.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 543 kB/s | 41 kB 00:00 2024-09-10T09:53:06.270 INFO:teuthology.orchestra.run.smithi071.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 612 kB/s | 31 kB 00:00 2024-09-10T09:53:06.295 INFO:teuthology.orchestra.run.smithi071.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-10T09:53:06.332 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:50 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:06.363 INFO:teuthology.orchestra.run.smithi071.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1597.g96d63e75 9.2 MB/s | 3.4 MB 00:00 2024-09-10T09:53:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:Total 8.4 MB/s | 3.7 MB 00:00 2024-09-10T09:53:06.366 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:53:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:53:06.374 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:53:06.421 INFO:teuthology.orchestra.run.smithi107.stdout:Package ceph-base-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:06.458 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:53:06.459 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:53:06.462 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:06.463 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-10T09:53:06.463 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:06.543 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install cephadm 2024-09-10T09:53:06.767 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:53:06.831 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-10T09:53:06.864 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-10T09:53:06.910 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-10T09:53:06.943 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-10T09:53:06.972 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1597.g96d63e75.el9.n 5/7 2024-09-10T09:53:07.100 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:51 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:07.231 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:07.232 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-10T09:53:07.232 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:07.232 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:53:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 83 k 2024-09-10T09:53:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:07.232 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:53:07.232 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:07.233 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-10T09:53:07.233 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:07.233 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 83 k 2024-09-10T09:53:07.233 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 375 k 2024-09-10T09:53:07.233 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:53:07.428 INFO:teuthology.orchestra.run.smithi107.stdout:cephadm-17.2.7-1597.g96d63e75.el9.noarch.rpm 424 kB/s | 83 kB 00:00 2024-09-10T09:53:07.429 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:07.430 INFO:teuthology.orchestra.run.smithi107.stdout:Total 420 kB/s | 83 kB 00:00 2024-09-10T09:53:07.430 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:53:07.434 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:53:07.434 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:53:07.436 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:53:07.436 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:53:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:53:07.950 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 1/1 2024-09-10T09:53:07.966 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1597.g96d63e75.el9. 6/7 2024-09-10T09:53:08.011 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1597.g96d63e75.el9.noarc 7/7 2024-09-10T09:53:08.037 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 1/1 2024-09-10T09:53:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 1/1 2024-09-10T09:53:08.644 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 1/1 2024-09-10T09:53:08.645 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:08.645 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:53:08.645 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:08.645 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:08.645 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:08.855 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-immutable-object-cache 2024-09-10T09:53:09.117 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1597.g96d63e75.el9.noarc 7/7 2024-09-10T09:53:09.117 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1597.g96d63e75.el9. 1/7 2024-09-10T09:53:09.117 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1597.g96d63e75.el9.noarc 2/7 2024-09-10T09:53:09.117 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1597.g96d63e75.el9.n 3/7 2024-09-10T09:53:09.117 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-10T09:53:09.117 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-10T09:53:09.117 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-10T09:53:09.410 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-10T09:53:09.411 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:09.411 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:53:09.411 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:09.411 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:09.411 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:09.411 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-10T09:53:09.411 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-10T09:53:09.411 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T09:53:09.411 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T09:53:09.411 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:09.412 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:09.427 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:53 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:09.561 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:09.562 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:09.562 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2024-09-10T09:53:09.562 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:09.562 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:53:09.562 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 137 k 2024-09-10T09:53:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:09.563 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:53:09.563 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:09.563 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-10T09:53:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:09.563 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 137 k 2024-09-10T09:53:09.563 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 379 k 2024-09-10T09:53:09.563 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:53:09.615 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-10T09:53:09.774 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-immutable-object-cache-17.2.7-1597.g96d63e 651 kB/s | 137 kB 00:00 2024-09-10T09:53:09.775 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:09.775 INFO:teuthology.orchestra.run.smithi107.stdout:Total 647 kB/s | 137 kB 00:00 2024-09-10T09:53:09.775 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:53:09.782 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:53:09.782 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:53:09.838 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:53:09.839 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:53:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:53:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1597.g96d63e75. 1/1 2024-09-10T09:53:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1597.g96d63e75. 1/1 2024-09-10T09:53:10.058 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:53:10.058 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T09:53:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:10.172 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:02 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:10.305 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:10.306 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-10T09:53:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-10T09:53:10.306 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-10T09:53:10.306 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:53:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 7.4 M 2024-09-10T09:53:10.307 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-10T09:53:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T09:53:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T09:53:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T09:53:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T09:53:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T09:53:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T09:53:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T09:53:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T09:53:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T09:53:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T09:53:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T09:53:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:10.308 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:53:10.308 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-10T09:53:10.308 INFO:teuthology.orchestra.run.smithi071.stdout:Install 12 Packages 2024-09-10T09:53:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:10.309 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 38 M 2024-09-10T09:53:10.309 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 212 M 2024-09-10T09:53:10.309 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:53:10.839 INFO:teuthology.orchestra.run.smithi071.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 871 kB/s | 191 kB 00:00 2024-09-10T09:53:10.888 INFO:teuthology.orchestra.run.smithi071.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-10T09:53:10.905 INFO:teuthology.orchestra.run.smithi071.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-10T09:53:10.939 INFO:teuthology.orchestra.run.smithi071.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 547 kB/s | 18 kB 00:00 2024-09-10T09:53:10.970 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1597.g96d63e75. 1/1 2024-09-10T09:53:10.970 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:10.970 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:53:10.970 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:10.971 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:10.971 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:10.973 INFO:teuthology.orchestra.run.smithi071.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 1.1 MB/s | 38 kB 00:00 2024-09-10T09:53:11.115 INFO:teuthology.orchestra.run.smithi071.stdout:(6/12): ceph-mgr-diskprediction-local-17.2.7-15 15 MB/s | 7.4 MB 00:00 2024-09-10T09:53:11.194 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr 2024-09-10T09:53:11.223 INFO:teuthology.orchestra.run.smithi071.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.9 MB/s | 3.0 MB 00:00 2024-09-10T09:53:11.315 INFO:teuthology.orchestra.run.smithi071.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2024-09-10T09:53:11.340 INFO:teuthology.orchestra.run.smithi071.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-09-10T09:53:11.366 INFO:teuthology.orchestra.run.smithi071.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 4.9 MB/s | 250 kB 00:00 2024-09-10T09:53:11.449 INFO:teuthology.orchestra.run.smithi071.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-10T09:53:11.766 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:55 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:11.874 INFO:teuthology.orchestra.run.smithi107.stdout:Package ceph-mgr-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:11.916 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:11.917 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-10T09:53:11.918 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:11.997 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-dashboard 2024-09-10T09:53:12.568 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:56 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:12.702 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:12.703 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:12.703 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-10T09:53:12.703 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:12.703 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:53:12.703 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 3.4 M 2024-09-10T09:53:12.703 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-10T09:53:12.703 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 24 k 2024-09-10T09:53:12.703 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 15 k 2024-09-10T09:53:12.704 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-10T09:53:12.704 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T09:53:12.704 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T09:53:12.704 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-09-10T09:53:12.704 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-10T09:53:12.704 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:12.704 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:53:12.704 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:12.704 INFO:teuthology.orchestra.run.smithi107.stdout:Install 7 Packages 2024-09-10T09:53:12.704 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:12.705 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 3.7 M 2024-09-10T09:53:12.705 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 80 M 2024-09-10T09:53:12.705 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:53:12.920 INFO:teuthology.orchestra.run.smithi107.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1597.g96d 156 kB/s | 24 kB 00:00 2024-09-10T09:53:12.945 INFO:teuthology.orchestra.run.smithi107.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1597.g96d6 81 kB/s | 15 kB 00:00 2024-09-10T09:53:12.987 INFO:teuthology.orchestra.run.smithi107.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-10T09:53:13.013 INFO:teuthology.orchestra.run.smithi107.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 610 kB/s | 41 kB 00:00 2024-09-10T09:53:13.038 INFO:teuthology.orchestra.run.smithi107.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 633 kB/s | 31 kB 00:00 2024-09-10T09:53:13.063 INFO:teuthology.orchestra.run.smithi107.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 7.3 MB/s | 188 kB 00:00 2024-09-10T09:53:13.172 INFO:teuthology.orchestra.run.smithi107.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1597.g96d63e75 8.2 MB/s | 3.4 MB 00:00 2024-09-10T09:53:13.175 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:13.176 INFO:teuthology.orchestra.run.smithi107.stdout:Total 7.7 MB/s | 3.7 MB 00:00 2024-09-10T09:53:13.176 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:53:13.184 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:53:13.184 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:53:13.273 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:53:13.274 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:53:13.577 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:53:13.657 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-10T09:53:13.691 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-10T09:53:13.754 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-10T09:53:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-10T09:53:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1597.g96d63e75.el9.n 5/7 2024-09-10T09:53:14.802 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1597.g96d63e75.el9. 6/7 2024-09-10T09:53:14.835 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1597.g96d63e75.el9.noarc 7/7 2024-09-10T09:53:15.499 INFO:teuthology.orchestra.run.smithi071.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:04 2024-09-10T09:53:15.500 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:15.500 INFO:teuthology.orchestra.run.smithi071.stdout:Total 7.4 MB/s | 38 MB 00:05 2024-09-10T09:53:15.862 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:53:15.869 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1597.g96d63e75.el9.noarc 7/7 2024-09-10T09:53:15.869 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1597.g96d63e75.el9. 1/7 2024-09-10T09:53:15.869 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1597.g96d63e75.el9.noarc 2/7 2024-09-10T09:53:15.869 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1597.g96d63e75.el9.n 3/7 2024-09-10T09:53:15.869 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-10T09:53:15.869 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-10T09:53:15.869 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-10T09:53:15.888 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:53:15.888 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:53:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-10T09:53:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:16.162 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:53:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-10T09:53:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-10T09:53:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T09:53:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T09:53:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:16.162 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:16.392 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-10T09:53:16.393 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:53:16.393 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:53:16.946 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:00 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:17.078 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:17.079 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-09-10T09:53:17.079 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-10T09:53:17.079 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-09-10T09:53:17.079 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:53:17.079 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 7.4 M 2024-09-10T09:53:17.079 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-10T09:53:17.079 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T09:53:17.079 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T09:53:17.080 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T09:53:17.080 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T09:53:17.080 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T09:53:17.080 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T09:53:17.080 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T09:53:17.080 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T09:53:17.080 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T09:53:17.080 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T09:53:17.080 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T09:53:17.080 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:17.080 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:53:17.080 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-09-10T09:53:17.080 INFO:teuthology.orchestra.run.smithi107.stdout:Install 12 Packages 2024-09-10T09:53:17.081 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:17.081 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 38 M 2024-09-10T09:53:17.081 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 212 M 2024-09-10T09:53:17.081 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:53:17.145 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:53:17.219 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-10T09:53:17.271 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-10T09:53:17.347 INFO:teuthology.orchestra.run.smithi107.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-10T09:53:17.388 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-10T09:53:17.406 INFO:teuthology.orchestra.run.smithi107.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.8 MB/s | 801 kB 00:00 2024-09-10T09:53:17.431 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-10T09:53:17.489 INFO:teuthology.orchestra.run.smithi107.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 231 kB/s | 33 kB 00:00 2024-09-10T09:53:17.540 INFO:teuthology.orchestra.run.smithi107.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-10T09:53:17.590 INFO:teuthology.orchestra.run.smithi107.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-10T09:53:17.614 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-10T09:53:17.647 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-10T09:53:17.711 INFO:teuthology.orchestra.run.smithi107.stdout:(6/12): ceph-mgr-diskprediction-local-17.2.7-15 15 MB/s | 7.4 MB 00:00 2024-09-10T09:53:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-10T09:53:17.949 INFO:teuthology.orchestra.run.smithi107.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 979 kB/s | 245 kB 00:00 2024-09-10T09:53:18.299 INFO:teuthology.orchestra.run.smithi107.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.3 MB/s | 3.0 MB 00:00 2024-09-10T09:53:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-10T09:53:18.449 INFO:teuthology.orchestra.run.smithi107.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.6 MB/s | 250 kB 00:00 2024-09-10T09:53:18.485 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-10T09:53:19.400 INFO:teuthology.orchestra.run.smithi107.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.7 MB/s | 4.9 MB 00:01 2024-09-10T09:53:19.747 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T09:53:19.992 INFO:teuthology.orchestra.run.smithi107.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.5 MB/s | 5.1 MB 00:02 2024-09-10T09:53:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-10T09:53:20.820 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1597.g96d63 12/12 2024-09-10T09:53:23.427 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1597.g96d63 12/12 2024-09-10T09:53:23.427 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1597.g96d63 1/12 2024-09-10T09:53:23.428 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-10T09:53:23.428 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-10T09:53:23.428 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-10T09:53:23.428 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-10T09:53:23.428 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-10T09:53:23.428 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-10T09:53:23.428 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-10T09:53:23.428 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-10T09:53:23.428 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T09:53:23.428 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-10T09:53:23.842 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-10T09:53:23.843 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:23.843 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:53:23.843 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:23.843 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T09:53:23.843 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T09:53:23.843 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T09:53:23.843 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T09:53:23.843 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T09:53:23.843 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T09:53:23.843 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T09:53:23.843 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T09:53:23.844 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T09:53:23.844 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T09:53:23.844 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T09:53:23.844 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:23.844 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:24.317 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-rook 2024-09-10T09:53:24.896 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:16 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:25.041 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:25.042 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:25.042 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-10T09:53:25.042 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:25.042 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:53:25.042 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 47 k 2024-09-10T09:53:25.042 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-10T09:53:25.042 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T09:53:25.042 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T09:53:25.042 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T09:53:25.042 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T09:53:25.043 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T09:53:25.043 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T09:53:25.043 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T09:53:25.043 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T09:53:25.043 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T09:53:25.043 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T09:53:25.043 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T09:53:25.043 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T09:53:25.043 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:25.043 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:53:25.043 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:25.043 INFO:teuthology.orchestra.run.smithi071.stdout:Install 13 Packages 2024-09-10T09:53:25.044 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:25.044 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 2.2 M 2024-09-10T09:53:25.044 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 26 M 2024-09-10T09:53:25.044 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:53:25.262 INFO:teuthology.orchestra.run.smithi071.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 230 kB/s | 19 kB 00:00 2024-09-10T09:53:25.279 INFO:teuthology.orchestra.run.smithi071.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 256 kB/s | 26 kB 00:00 2024-09-10T09:53:25.338 INFO:teuthology.orchestra.run.smithi071.stdout:(3/13): ceph-mgr-rook-17.2.7-1597.g96d63e75.el9 299 kB/s | 47 kB 00:00 2024-09-10T09:53:25.388 INFO:teuthology.orchestra.run.smithi071.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-10T09:53:25.413 INFO:teuthology.orchestra.run.smithi071.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-10T09:53:25.472 INFO:teuthology.orchestra.run.smithi071.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 641 kB/s | 54 kB 00:00 2024-09-10T09:53:25.506 INFO:teuthology.orchestra.run.smithi071.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-10T09:53:25.531 INFO:teuthology.orchestra.run.smithi071.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 248 kB/s | 14 kB 00:00 2024-09-10T09:53:25.564 INFO:teuthology.orchestra.run.smithi071.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 3.8 MB/s | 220 kB 00:00 2024-09-10T09:53:25.590 INFO:teuthology.orchestra.run.smithi071.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.1 MB/s | 279 kB 00:00 2024-09-10T09:53:25.615 INFO:teuthology.orchestra.run.smithi071.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-10T09:53:25.665 INFO:teuthology.orchestra.run.smithi071.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2024-09-10T09:53:25.691 INFO:teuthology.orchestra.run.smithi071.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 891 kB/s | 90 kB 00:00 2024-09-10T09:53:25.693 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:25.694 INFO:teuthology.orchestra.run.smithi071.stdout:Total 3.4 MB/s | 2.2 MB 00:00 2024-09-10T09:53:25.758 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:53:25.773 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:53:25.773 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:53:25.862 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:53:25.869 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:53:26.249 INFO:teuthology.orchestra.run.smithi107.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.1 MB/s | 16 MB 00:07 2024-09-10T09:53:26.250 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:26.251 INFO:teuthology.orchestra.run.smithi107.stdout:Total 4.2 MB/s | 38 MB 00:09 2024-09-10T09:53:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:53:26.545 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-10T09:53:26.600 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-10T09:53:26.609 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:53:26.635 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:53:26.635 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:53:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-10T09:53:26.709 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-10T09:53:26.751 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-10T09:53:26.851 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-10T09:53:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-10T09:53:27.011 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-10T09:53:27.138 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:53:27.138 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:53:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-10T09:53:27.783 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-10T09:53:27.816 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-10T09:53:27.862 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-10T09:53:27.895 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:17.2.7-1597.g96d63e75.el9.noarch 13/13 2024-09-10T09:53:27.911 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:53:27.981 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-10T09:53:28.026 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-10T09:53:28.130 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-10T09:53:28.182 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-10T09:53:28.365 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-10T09:53:28.397 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-10T09:53:28.474 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-10T09:53:28.639 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1597.g96d63e75.el9.noarch 13/13 2024-09-10T09:53:28.639 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1597.g96d63e75.el9.noarch 1/13 2024-09-10T09:53:28.640 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-10T09:53:28.640 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-10T09:53:28.640 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-10T09:53:28.640 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-10T09:53:28.640 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-10T09:53:28.640 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-10T09:53:28.640 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-10T09:53:28.640 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-10T09:53:28.640 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-10T09:53:28.640 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-10T09:53:28.640 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-10T09:53:28.990 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-10T09:53:28.990 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:28.990 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:53:28.990 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:28.990 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T09:53:28.990 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T09:53:28.991 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T09:53:28.991 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T09:53:28.991 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T09:53:28.991 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T09:53:28.991 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T09:53:28.991 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T09:53:28.991 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T09:53:28.991 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T09:53:28.991 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T09:53:28.991 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T09:53:28.991 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:28.992 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:29.115 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-10T09:53:29.239 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-10T09:53:29.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-cephadm 2024-09-10T09:53:29.821 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:21 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:29.954 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:29.954 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:29.954 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-10T09:53:29.954 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:29.955 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:53:29.955 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 124 k 2024-09-10T09:53:29.955 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-10T09:53:29.955 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T09:53:29.955 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T09:53:29.955 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T09:53:29.955 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T09:53:29.955 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T09:53:29.955 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:29.955 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:53:29.955 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:29.955 INFO:teuthology.orchestra.run.smithi071.stdout:Install 6 Packages 2024-09-10T09:53:29.955 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:29.956 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 7.0 M 2024-09-10T09:53:29.956 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 33 M 2024-09-10T09:53:29.956 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:53:30.367 INFO:teuthology.orchestra.run.smithi071.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1597.g96d63e75.e 635 kB/s | 124 kB 00:00 2024-09-10T09:53:30.425 INFO:teuthology.orchestra.run.smithi071.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-10T09:53:30.450 INFO:teuthology.orchestra.run.smithi071.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-10T09:53:30.484 INFO:teuthology.orchestra.run.smithi071.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.7 MB/s | 74 kB 00:00 2024-09-10T09:53:30.489 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T09:53:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 319 kB/s | 248 kB 00:00 2024-09-10T09:53:31.484 INFO:teuthology.orchestra.run.smithi071.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.5 MB/s | 6.0 MB 00:01 2024-09-10T09:53:31.487 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:31.487 INFO:teuthology.orchestra.run.smithi071.stdout:Total 4.6 MB/s | 7.0 MB 00:01 2024-09-10T09:53:31.532 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-10T09:53:31.558 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1597.g96d63 12/12 2024-09-10T09:53:31.563 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:53:31.575 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:53:31.575 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:53:31.675 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:53:31.676 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:53:31.977 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:53:32.162 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-10T09:53:32.211 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-10T09:53:32.735 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-10T09:53:32.821 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-10T09:53:32.886 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-10T09:53:32.915 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 6/6 2024-09-10T09:53:33.757 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 6/6 2024-09-10T09:53:33.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 1/6 2024-09-10T09:53:33.757 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-10T09:53:33.758 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-10T09:53:33.758 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-10T09:53:33.758 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-10T09:53:33.913 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1597.g96d63 12/12 2024-09-10T09:53:33.914 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1597.g96d63 1/12 2024-09-10T09:53:33.914 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-10T09:53:33.914 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-10T09:53:33.914 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-10T09:53:33.914 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-10T09:53:33.915 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-10T09:53:33.915 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-10T09:53:33.915 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-10T09:53:33.915 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-10T09:53:33.915 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T09:53:33.915 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-10T09:53:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-10T09:53:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:34.030 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:53:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T09:53:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T09:53:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T09:53:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T09:53:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T09:53:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:34.031 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:34.301 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-fuse 2024-09-10T09:53:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-10T09:53:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:34.310 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:53:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T09:53:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T09:53:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T09:53:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T09:53:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T09:53:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T09:53:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T09:53:34.310 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T09:53:34.311 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T09:53:34.311 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T09:53:34.311 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T09:53:34.311 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:34.311 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:34.753 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-rook 2024-09-10T09:53:34.866 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:26 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:34.997 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:34.998 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:34.998 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-10T09:53:34.998 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:34.998 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:53:34.998 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 813 k 2024-09-10T09:53:34.998 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-10T09:53:34.998 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T09:53:34.998 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:34.998 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:53:34.998 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:34.998 INFO:teuthology.orchestra.run.smithi071.stdout:Install 2 Packages 2024-09-10T09:53:34.998 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:34.999 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 893 k 2024-09-10T09:53:34.999 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 2.6 M 2024-09-10T09:53:34.999 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:53:35.144 INFO:teuthology.orchestra.run.smithi071.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 641 kB/s | 80 kB 00:00 2024-09-10T09:53:35.311 INFO:teuthology.orchestra.run.smithi071.stdout:(2/2): ceph-fuse-17.2.7-1597.g96d63e75.el9.x86_ 2.7 MB/s | 813 kB 00:00 2024-09-10T09:53:35.311 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:35.312 INFO:teuthology.orchestra.run.smithi071.stdout:Total 2.8 MB/s | 893 kB 00:00 2024-09-10T09:53:35.323 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:53:35.327 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:19 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:35.345 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:53:35.345 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:53:35.424 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:53:35.424 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:53:35.461 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:35.462 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:35.462 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-10T09:53:35.462 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:35.462 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:53:35.462 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 47 k 2024-09-10T09:53:35.463 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-10T09:53:35.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T09:53:35.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T09:53:35.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T09:53:35.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T09:53:35.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T09:53:35.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T09:53:35.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T09:53:35.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T09:53:35.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T09:53:35.463 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T09:53:35.464 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T09:53:35.464 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T09:53:35.464 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:35.464 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:53:35.464 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:35.464 INFO:teuthology.orchestra.run.smithi107.stdout:Install 13 Packages 2024-09-10T09:53:35.464 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:35.465 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 2.2 M 2024-09-10T09:53:35.465 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 26 M 2024-09-10T09:53:35.465 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:53:35.610 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:53:35.686 INFO:teuthology.orchestra.run.smithi107.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 209 kB/s | 19 kB 00:00 2024-09-10T09:53:35.711 INFO:teuthology.orchestra.run.smithi107.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 219 kB/s | 26 kB 00:00 2024-09-10T09:53:35.740 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-10T09:53:35.769 INFO:teuthology.orchestra.run.smithi107.stdout:(3/13): ceph-mgr-rook-17.2.7-1597.g96d63e75.el9 270 kB/s | 47 kB 00:00 2024-09-10T09:53:35.811 INFO:teuthology.orchestra.run.smithi107.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-09-10T09:53:35.817 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 2/2 2024-09-10T09:53:35.837 INFO:teuthology.orchestra.run.smithi107.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-10T09:53:35.862 INFO:teuthology.orchestra.run.smithi107.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-10T09:53:35.904 INFO:teuthology.orchestra.run.smithi107.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-10T09:53:35.929 INFO:teuthology.orchestra.run.smithi107.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 210 kB/s | 14 kB 00:00 2024-09-10T09:53:35.963 INFO:teuthology.orchestra.run.smithi107.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-10T09:53:35.997 INFO:teuthology.orchestra.run.smithi107.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-10T09:53:36.014 INFO:teuthology.orchestra.run.smithi107.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 5.8 MB/s | 90 kB 00:00 2024-09-10T09:53:36.039 INFO:teuthology.orchestra.run.smithi107.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 786 kB/s | 59 kB 00:00 2024-09-10T09:53:36.073 INFO:teuthology.orchestra.run.smithi107.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-10T09:53:36.076 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:36.076 INFO:teuthology.orchestra.run.smithi107.stdout:Total 3.6 MB/s | 2.2 MB 00:00 2024-09-10T09:53:36.141 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:53:36.155 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:53:36.156 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:53:36.244 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:53:36.246 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:53:36.514 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 2/2 2024-09-10T09:53:36.514 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 1/2 2024-09-10T09:53:36.751 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:53:36.796 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-10T09:53:36.796 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:36.796 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:53:36.796 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-10T09:53:36.796 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:36.796 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:36.954 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-10T09:53:37.007 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-10T09:53:37.056 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados-devel 2024-09-10T09:53:37.063 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-10T09:53:37.100 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-10T09:53:37.141 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-10T09:53:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-10T09:53:37.346 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-10T09:53:37.402 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-10T09:53:37.631 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:29 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:37.767 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:37.768 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-10T09:53:37.768 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:37.768 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:53:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 126 k 2024-09-10T09:53:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:37.769 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:53:37.769 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:37.769 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-10T09:53:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:37.769 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 126 k 2024-09-10T09:53:37.769 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 448 k 2024-09-10T09:53:37.769 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:53:37.957 INFO:teuthology.orchestra.run.smithi071.stdout:librados-devel-17.2.7-1597.g96d63e75.el9.x86_64 671 kB/s | 126 kB 00:00 2024-09-10T09:53:37.958 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:37.958 INFO:teuthology.orchestra.run.smithi071.stdout:Total 665 kB/s | 126 kB 00:00 2024-09-10T09:53:37.959 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:53:37.964 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:53:37.964 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:53:38.028 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:53:38.028 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:53:38.127 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-10T09:53:38.174 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-10T09:53:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:53:38.208 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-10T09:53:38.254 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-10T09:53:38.277 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:17.2.7-1597.g96d63e75.el9.noarch 13/13 2024-09-10T09:53:38.331 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:38.762 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:39.021 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:53:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:39.021 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1597.g96d63e75.el9.noarch 13/13 2024-09-10T09:53:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1597.g96d63e75.el9.noarch 1/13 2024-09-10T09:53:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-10T09:53:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-10T09:53:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-10T09:53:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-10T09:53:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-10T09:53:39.073 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-10T09:53:39.073 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-10T09:53:39.073 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-10T09:53:39.073 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-10T09:53:39.073 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-10T09:53:39.073 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-10T09:53:39.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs2 2024-09-10T09:53:39.406 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-10T09:53:39.406 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:39.406 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:53:39.406 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:39.406 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T09:53:39.406 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T09:53:39.407 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T09:53:39.407 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T09:53:39.407 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T09:53:39.407 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T09:53:39.407 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T09:53:39.407 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T09:53:39.407 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T09:53:39.407 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T09:53:39.407 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T09:53:39.407 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T09:53:39.407 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:39.407 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:39.680 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-cephadm 2024-09-10T09:53:39.884 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:31 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:39.975 INFO:teuthology.orchestra.run.smithi071.stdout:Package libcephfs2-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:40.018 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:40.019 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-10T09:53:40.019 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:40.086 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs-devel 2024-09-10T09:53:40.240 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:24 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:40.372 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:40.373 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-10T09:53:40.373 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:40.373 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:53:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1597.g96d63e75.el9 ceph-noarch 124 k 2024-09-10T09:53:40.373 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-10T09:53:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T09:53:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T09:53:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T09:53:40.374 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T09:53:40.374 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T09:53:40.374 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:40.374 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:53:40.374 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:40.374 INFO:teuthology.orchestra.run.smithi107.stdout:Install 6 Packages 2024-09-10T09:53:40.374 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:40.375 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 7.0 M 2024-09-10T09:53:40.375 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 33 M 2024-09-10T09:53:40.375 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:53:40.654 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:32 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:40.785 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:40.786 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:40.786 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-10T09:53:40.787 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:40.787 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:53:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 25 k 2024-09-10T09:53:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:40.787 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:53:40.787 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:40.787 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-10T09:53:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:40.787 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 25 k 2024-09-10T09:53:40.787 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 110 k 2024-09-10T09:53:40.788 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:53:40.801 INFO:teuthology.orchestra.run.smithi107.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1597.g96d63e75.e 635 kB/s | 124 kB 00:00 2024-09-10T09:53:40.859 INFO:teuthology.orchestra.run.smithi107.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-10T09:53:40.885 INFO:teuthology.orchestra.run.smithi107.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-10T09:53:40.910 INFO:teuthology.orchestra.run.smithi107.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-10T09:53:40.936 INFO:teuthology.orchestra.run.smithi071.stdout:libcephfs-devel-17.2.7-1597.g96d63e75.el9.x86_6 168 kB/s | 25 kB 00:00 2024-09-10T09:53:40.936 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:40.937 INFO:teuthology.orchestra.run.smithi071.stdout:Total 166 kB/s | 25 kB 00:00 2024-09-10T09:53:40.937 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:53:40.941 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:53:40.941 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:53:40.942 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:53:40.942 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:53:41.023 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:53:41.124 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:41.418 INFO:teuthology.orchestra.run.smithi107.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 305 kB/s | 248 kB 00:00 2024-09-10T09:53:41.515 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:41.752 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:41.752 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:41.752 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:53:41.752 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:41.752 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:41.752 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:41.786 INFO:teuthology.orchestra.run.smithi107.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-10T09:53:41.787 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:41.788 INFO:teuthology.orchestra.run.smithi107.stdout:Total 4.9 MB/s | 7.0 MB 00:01 2024-09-10T09:53:41.858 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:53:41.869 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:53:41.869 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:53:41.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados2 2024-09-10T09:53:41.966 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:53:41.967 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:53:42.271 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:53:42.443 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-10T09:53:42.495 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-10T09:53:42.520 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:34 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:42.609 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:42.652 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:42.653 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-10T09:53:42.653 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:42.725 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librbd1 2024-09-10T09:53:43.032 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-10T09:53:43.125 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-10T09:53:43.181 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-10T09:53:43.208 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 6/6 2024-09-10T09:53:43.291 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:35 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:43.379 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:43.421 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:43.422 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-10T09:53:43.422 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:43.492 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rados 2024-09-10T09:53:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 6/6 2024-09-10T09:53:43.998 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 1/6 2024-09-10T09:53:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-10T09:53:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-10T09:53:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-10T09:53:43.999 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-10T09:53:44.054 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:36 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:44.145 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rados-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:44.188 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:44.189 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-10T09:53:44.189 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:44.258 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rgw 2024-09-10T09:53:44.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-10T09:53:44.280 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:44.280 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:53:44.280 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:17.2.7-1597.g96d63e75.el9.noarch 2024-09-10T09:53:44.280 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T09:53:44.280 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T09:53:44.280 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T09:53:44.281 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T09:53:44.281 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T09:53:44.281 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:44.281 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:44.566 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-fuse 2024-09-10T09:53:44.821 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:36 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:44.910 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rgw-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:44.953 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:44.954 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-10T09:53:44.954 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:45.036 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-cephfs 2024-09-10T09:53:45.130 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:29 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:45.261 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:45.261 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:45.261 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-10T09:53:45.261 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:45.262 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:53:45.262 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 813 k 2024-09-10T09:53:45.262 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-10T09:53:45.262 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T09:53:45.262 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:45.262 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:53:45.262 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:45.262 INFO:teuthology.orchestra.run.smithi107.stdout:Install 2 Packages 2024-09-10T09:53:45.262 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:45.263 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 893 k 2024-09-10T09:53:45.263 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 2.6 M 2024-09-10T09:53:45.263 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:53:45.488 INFO:teuthology.orchestra.run.smithi107.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 616 kB/s | 80 kB 00:00 2024-09-10T09:53:45.594 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:37 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:45.638 INFO:teuthology.orchestra.run.smithi107.stdout:(2/2): ceph-fuse-17.2.7-1597.g96d63e75.el9.x86_ 2.8 MB/s | 813 kB 00:00 2024-09-10T09:53:45.639 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:45.639 INFO:teuthology.orchestra.run.smithi107.stdout:Total 2.3 MB/s | 893 kB 00:00 2024-09-10T09:53:45.650 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:53:45.671 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:53:45.671 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:53:45.683 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-cephfs-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:45.725 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:45.726 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-10T09:53:45.726 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:53:45.750 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:53:45.792 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rbd 2024-09-10T09:53:45.938 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:53:46.083 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-10T09:53:46.153 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 2/2 2024-09-10T09:53:46.358 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:38 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:46.447 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rbd-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:46.490 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:46.491 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-10T09:53:46.491 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:46.561 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-fuse 2024-09-10T09:53:46.834 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 2/2 2024-09-10T09:53:46.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 1/2 2024-09-10T09:53:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-10T09:53:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:47.104 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:53:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-10T09:53:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:47.104 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:47.123 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:39 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:47.254 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:47.255 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:47.255 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-10T09:53:47.255 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:47.255 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:53:47.255 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 82 k 2024-09-10T09:53:47.255 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:47.255 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:53:47.255 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:47.255 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-10T09:53:47.255 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:47.256 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 82 k 2024-09-10T09:53:47.256 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 222 k 2024-09-10T09:53:47.256 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:53:47.399 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install librados-devel 2024-09-10T09:53:47.447 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-fuse-17.2.7-1597.g96d63e75.el9.x86_64.rpm 428 kB/s | 82 kB 00:00 2024-09-10T09:53:47.448 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:47.448 INFO:teuthology.orchestra.run.smithi071.stdout:Total 424 kB/s | 82 kB 00:00 2024-09-10T09:53:47.448 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:53:47.455 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:53:47.455 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:53:47.517 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:53:47.518 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:53:47.662 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:53:47.769 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:47.975 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:31 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:48.114 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:48.115 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:48.115 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2024-09-10T09:53:48.115 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:48.115 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:53:48.115 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 126 k 2024-09-10T09:53:48.115 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:48.115 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:53:48.115 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:48.115 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-10T09:53:48.115 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:48.116 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 126 k 2024-09-10T09:53:48.116 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 448 k 2024-09-10T09:53:48.116 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:53:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:48.346 INFO:teuthology.orchestra.run.smithi107.stdout:librados-devel-17.2.7-1597.g96d63e75.el9.x86_64 549 kB/s | 126 kB 00:00 2024-09-10T09:53:48.347 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:48.347 INFO:teuthology.orchestra.run.smithi107.stdout:Total 546 kB/s | 126 kB 00:00 2024-09-10T09:53:48.347 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:53:48.352 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:53:48.353 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:53:48.411 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:48.411 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:48.411 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:53:48.411 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:48.411 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:48.412 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:48.415 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:53:48.416 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:53:48.563 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:53:48.667 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:48.668 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-mirror 2024-09-10T09:53:49.112 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:49.246 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:41 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:49.371 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:49.372 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:49.372 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:53:49.372 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:49.372 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:49.372 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:49.382 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:49.382 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-10T09:53:49.382 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:49.382 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:53:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 2.9 M 2024-09-10T09:53:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:49.383 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:53:49.383 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:49.383 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-10T09:53:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:49.383 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 2.9 M 2024-09-10T09:53:49.383 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 12 M 2024-09-10T09:53:49.383 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:53:49.627 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install libcephfs2 2024-09-10T09:53:49.733 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-mirror-17.2.7-1597.g96d63e75.el9.x86_64.rpm 8.4 MB/s | 2.9 MB 00:00 2024-09-10T09:53:49.734 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:49.734 INFO:teuthology.orchestra.run.smithi071.stdout:Total 8.4 MB/s | 2.9 MB 00:00 2024-09-10T09:53:49.734 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:53:49.743 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:53:49.743 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:53:49.823 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:53:49.823 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:53:50.204 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:34 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:50.235 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:53:50.284 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:50.294 INFO:teuthology.orchestra.run.smithi107.stdout:Package libcephfs2-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:50.309 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:53:50.309 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T09:53:50.309 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:53:50.309 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:53:50.309 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:50.337 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:50.338 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-10T09:53:50.339 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:50.413 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install libcephfs-devel 2024-09-10T09:53:50.973 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:34 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:51.104 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:51.105 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:51.105 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2024-09-10T09:53:51.105 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:51.105 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:53:51.105 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 25 k 2024-09-10T09:53:51.105 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:51.105 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:53:51.105 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:51.106 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-10T09:53:51.106 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:51.106 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 25 k 2024-09-10T09:53:51.106 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 110 k 2024-09-10T09:53:51.106 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:53:51.265 INFO:teuthology.orchestra.run.smithi107.stdout:libcephfs-devel-17.2.7-1597.g96d63e75.el9.x86_6 157 kB/s | 25 kB 00:00 2024-09-10T09:53:51.266 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:51.266 INFO:teuthology.orchestra.run.smithi107.stdout:Total 156 kB/s | 25 kB 00:00 2024-09-10T09:53:51.266 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:53:51.270 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:53:51.270 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:53:51.271 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:53:51.272 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:53:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:53:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:51.401 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:53:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:51.402 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:51.478 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:51.674 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-nbd 2024-09-10T09:53:51.858 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:52.093 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:52.093 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:52.093 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:53:52.093 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:52.093 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:52.094 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:52.258 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:44 ago on Tue 10 Sep 2024 09:52:08 AM UTC. 2024-09-10T09:53:52.289 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install librados2 2024-09-10T09:53:52.398 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-10T09:53:52.399 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:52.399 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-10T09:53:52.399 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:52.399 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-10T09:53:52.399 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 165 k 2024-09-10T09:53:52.399 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:52.399 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-10T09:53:52.399 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-10T09:53:52.400 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-10T09:53:52.400 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:52.400 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 165 k 2024-09-10T09:53:52.400 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 477 k 2024-09-10T09:53:52.400 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-10T09:53:52.746 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-nbd-17.2.7-1597.g96d63e75.el9.x86_64.rpm 478 kB/s | 165 kB 00:00 2024-09-10T09:53:52.746 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:52.747 INFO:teuthology.orchestra.run.smithi071.stdout:Total 475 kB/s | 165 kB 00:00 2024-09-10T09:53:52.747 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-10T09:53:52.755 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-10T09:53:52.755 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-10T09:53:52.821 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-10T09:53:52.822 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-10T09:53:52.855 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:36 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:52.945 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:52.981 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-10T09:53:52.987 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:52.989 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-10T09:53:52.989 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:53.058 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install librbd1 2024-09-10T09:53:53.085 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:53.548 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:53.622 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:37 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:53.711 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:53.753 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:53.788 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:53.788 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:53.788 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-10T09:53:53.788 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:53.788 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:53:53.788 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-10T09:53:53.789 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-10T09:53:53.789 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:53.823 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-rados 2024-09-10T09:53:54.007 DEBUG:teuthology.parallel:result is None 2024-09-10T09:53:54.385 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:38 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:54.474 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-rados-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:54.516 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:54.517 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-10T09:53:54.517 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:54.599 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-rgw 2024-09-10T09:53:55.157 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:39 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:55.246 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-rgw-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:55.288 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:55.289 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-10T09:53:55.289 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:55.355 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-cephfs 2024-09-10T09:53:55.916 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:39 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:56.005 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-cephfs-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:56.047 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:56.048 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-10T09:53:56.048 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:56.131 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-rbd 2024-09-10T09:53:56.690 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:40 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:56.778 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-rbd-2:17.2.7-1597.g96d63e75.el9.x86_64 is already installed. 2024-09-10T09:53:56.820 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:56.821 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-09-10T09:53:56.822 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:56.889 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install rbd-fuse 2024-09-10T09:53:57.445 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:41 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:57.579 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:57.579 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:57.579 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-09-10T09:53:57.579 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:57.580 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:53:57.580 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 82 k 2024-09-10T09:53:57.580 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:57.580 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:53:57.580 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:57.580 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-10T09:53:57.580 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:57.581 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 82 k 2024-09-10T09:53:57.581 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 222 k 2024-09-10T09:53:57.581 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:53:57.776 INFO:teuthology.orchestra.run.smithi107.stdout:rbd-fuse-17.2.7-1597.g96d63e75.el9.x86_64.rpm 418 kB/s | 82 kB 00:00 2024-09-10T09:53:57.777 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:53:57.777 INFO:teuthology.orchestra.run.smithi107.stdout:Total 415 kB/s | 82 kB 00:00 2024-09-10T09:53:57.777 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:53:57.784 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:53:57.784 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:53:57.848 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:53:57.848 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:53:57.999 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:53:58.107 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:58.727 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:53:58.727 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:58.727 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:53:58.727 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:53:58.727 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:58.727 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:53:58.961 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install rbd-mirror 2024-09-10T09:53:59.532 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:43 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:53:59.665 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:53:59.666 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:59.666 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2024-09-10T09:53:59.666 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:59.666 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:53:59.666 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 2.9 M 2024-09-10T09:53:59.666 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:59.666 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:53:59.666 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:53:59.666 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-10T09:53:59.666 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:53:59.666 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 2.9 M 2024-09-10T09:53:59.667 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 12 M 2024-09-10T09:53:59.667 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:54:00.005 INFO:teuthology.orchestra.run.smithi107.stdout:rbd-mirror-17.2.7-1597.g96d63e75.el9.x86_64.rpm 8.7 MB/s | 2.9 MB 00:00 2024-09-10T09:54:00.006 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:54:00.006 INFO:teuthology.orchestra.run.smithi107.stdout:Total 8.6 MB/s | 2.9 MB 00:00 2024-09-10T09:54:00.006 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:54:00.015 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:54:00.015 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:54:00.093 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:54:00.094 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:54:00.515 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:54:00.573 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:54:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:54:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:54:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T09:54:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:54:00.597 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:54:00.597 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:54:01.667 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:54:01.667 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:54:01.667 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:54:01.667 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:54:01.667 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:54:01.667 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:54:01.920 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install rbd-nbd 2024-09-10T09:54:02.517 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:46 ago on Tue 10 Sep 2024 09:52:16 AM UTC. 2024-09-10T09:54:02.656 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-10T09:54:02.657 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:54:02.657 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-09-10T09:54:02.657 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:54:02.657 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-10T09:54:02.657 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:17.2.7-1597.g96d63e75.el9 ceph 165 k 2024-09-10T09:54:02.657 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:54:02.657 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-10T09:54:02.657 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-10T09:54:02.657 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2024-09-10T09:54:02.658 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:54:02.658 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 165 k 2024-09-10T09:54:02.658 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 477 k 2024-09-10T09:54:02.658 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-10T09:54:02.868 INFO:teuthology.orchestra.run.smithi107.stdout:rbd-nbd-17.2.7-1597.g96d63e75.el9.x86_64.rpm 785 kB/s | 165 kB 00:00 2024-09-10T09:54:02.869 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:54:02.870 INFO:teuthology.orchestra.run.smithi107.stdout:Total 777 kB/s | 165 kB 00:00 2024-09-10T09:54:02.870 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-10T09:54:02.877 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-10T09:54:02.877 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-10T09:54:02.943 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-10T09:54:02.943 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-10T09:54:03.102 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-10T09:54:03.209 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:54:03.666 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:54:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:17.2.7-1597.g96d63e75.el9.x86_64 1/1 2024-09-10T09:54:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:54:03.942 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-10T09:54:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:17.2.7-1597.g96d63e75.el9.x86_64 2024-09-10T09:54:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:54:03.943 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-10T09:54:04.205 DEBUG:teuthology.parallel:result is None 2024-09-10T09:54:04.206 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T09:54:04.206 INFO:teuthology.packaging:ref: None 2024-09-10T09:54:04.206 INFO:teuthology.packaging:tag: None 2024-09-10T09:54:04.206 INFO:teuthology.packaging:branch: quincy 2024-09-10T09:54:04.206 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:54:04.206 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-10T09:54:04.444 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T09:54:04.470 INFO:teuthology.orchestra.run.smithi071.stdout:17.2.7-1597.g96d63e75.el9 2024-09-10T09:54:04.470 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1597.g96d63e75.el9 2024-09-10T09:54:04.470 INFO:teuthology.task.install:The correct ceph version 17.2.7-1597.g96d63e75 is installed. 2024-09-10T09:54:04.472 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T09:54:04.473 INFO:teuthology.packaging:ref: None 2024-09-10T09:54:04.473 INFO:teuthology.packaging:tag: None 2024-09-10T09:54:04.473 INFO:teuthology.packaging:branch: quincy 2024-09-10T09:54:04.473 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:54:04.473 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-10T09:54:04.703 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T09:54:04.725 INFO:teuthology.orchestra.run.smithi107.stdout:17.2.7-1597.g96d63e75.el9 2024-09-10T09:54:04.726 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1597.g96d63e75.el9 2024-09-10T09:54:04.726 INFO:teuthology.task.install:The correct ceph version 17.2.7-1597.g96d63e75 is installed. 2024-09-10T09:54:04.727 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T09:54:04.728 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:54:04.728 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T09:54:04.759 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-10T09:54:04.759 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T09:54:04.792 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T09:54:04.792 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:54:04.792 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T09:54:04.827 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T09:54:04.894 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-10T09:54:04.894 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T09:54:04.940 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T09:54:05.004 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T09:54:05.005 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:54:05.005 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T09:54:05.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T09:54:05.098 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-10T09:54:05.098 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T09:54:05.122 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T09:54:05.186 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T09:54:05.186 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:54:05.186 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T09:54:05.212 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T09:54:05.278 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-10T09:54:05.278 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T09:54:05.303 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T09:54:05.367 INFO:teuthology.run_tasks:Running task print... 2024-09-10T09:54:05.376 INFO:teuthology.task.print:**** done install task... 2024-09-10T09:54:05.376 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T09:54:05.496 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T09:54:05.497 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-09-10T09:54:05.497 INFO:tasks.cephadm:Cluster fsid is 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:54:05.497 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T09:54:05.497 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-10T09:54:05.498 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi071': '172.21.15.71', 'mon.smithi107': '172.21.15.107'} 2024-09-10T09:54:05.498 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T09:54:05.498 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname $(hostname -s) 2024-09-10T09:54:05.525 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname $(hostname -s) 2024-09-10T09:54:05.550 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-09-10T09:54:05.550 DEBUG:teuthology.orchestra.run.smithi071:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T09:54:05.797 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 10 09:54 /home/ubuntu/cephtest/cephadm 2024-09-10T09:54:05.798 DEBUG:teuthology.orchestra.run.smithi107:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T09:54:05.930 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 10 09:54 /home/ubuntu/cephtest/cephadm 2024-09-10T09:54:05.931 DEBUG:teuthology.orchestra.run.smithi071:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T09:54:05.948 DEBUG:teuthology.orchestra.run.smithi107:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T09:54:05.972 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-09-10T09:54:05.973 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-10T09:54:05.991 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-10T09:54:07.592 INFO:teuthology.orchestra.run.smithi071.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-10T09:54:07.648 INFO:teuthology.orchestra.run.smithi107.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-10T09:54:33.616 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-10T09:54:33.617 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)", 2024-09-10T09:54:33.617 INFO:teuthology.orchestra.run.smithi107.stdout: "image_id": "f3fc7d52e2333ce256d91e3fea7102108584b9294bcc075f619f9369d33f3045", 2024-09-10T09:54:33.617 INFO:teuthology.orchestra.run.smithi107.stdout: "repo_digests": [ 2024-09-10T09:54:33.617 INFO:teuthology.orchestra.run.smithi107.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e" 2024-09-10T09:54:33.617 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-10T09:54:33.617 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-10T09:54:36.696 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T09:54:36.696 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)", 2024-09-10T09:54:36.696 INFO:teuthology.orchestra.run.smithi071.stdout: "image_id": "f3fc7d52e2333ce256d91e3fea7102108584b9294bcc075f619f9369d33f3045", 2024-09-10T09:54:36.696 INFO:teuthology.orchestra.run.smithi071.stdout: "repo_digests": [ 2024-09-10T09:54:36.696 INFO:teuthology.orchestra.run.smithi071.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e" 2024-09-10T09:54:36.696 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-10T09:54:36.696 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T09:54:36.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph 2024-09-10T09:54:36.772 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph 2024-09-10T09:54:36.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /etc/ceph 2024-09-10T09:54:36.830 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /etc/ceph 2024-09-10T09:54:36.874 INFO:tasks.cephadm:Writing seed config... 2024-09-10T09:54:36.875 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-10T09:54:36.875 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-10T09:54:36.876 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-10T09:54:36.876 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-10T09:54:36.876 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-10T09:54:36.876 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T09:54:36.876 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T09:54:36.876 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-10T09:54:36.876 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-10T09:54:36.876 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T09:54:36.876 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T09:54:36.877 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-10T09:54:36.877 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T09:54:36.877 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T09:54:36.877 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T09:54:36.877 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T09:54:36.877 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T09:54:36.877 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-10T09:54:36.877 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-10T09:54:36.877 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-10T09:54:36.877 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-10T09:54:36.877 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-10T09:54:36.877 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-10T09:54:36.877 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T09:54:36.878 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T09:54:36.879 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T09:54:36.879 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T09:54:36.879 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T09:54:36.879 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-10T09:54:36.879 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-10T09:54:36.880 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:54:36.880 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T09:54:36.895 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 9dae8622-6f5a-11ef-bcea-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-10T09:54:36.895 DEBUG:teuthology.orchestra.run.smithi071:mon.smithi071> sudo journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi071.service 2024-09-10T09:54:36.937 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T09:54:36.937 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.71 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T09:54:37.137 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:54:37.137 INFO:teuthology.orchestra.run.smithi071.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '9dae8622-6f5a-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.71', '--skip-admin-label'] 2024-09-10T09:54:37.289 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stdout 5.2.2 2024-09-10T09:54:37.290 INFO:teuthology.orchestra.run.smithi071.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T09:54:37.290 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying podman|docker is present... 2024-09-10T09:54:37.312 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stdout 5.2.2 2024-09-10T09:54:37.312 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying lvm2 is present... 2024-09-10T09:54:37.312 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying time synchronization is in place... 2024-09-10T09:54:37.320 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T09:54:37.320 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T09:54:37.326 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T09:54:37.327 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout inactive 2024-09-10T09:54:37.333 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout enabled 2024-09-10T09:54:37.340 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout active 2024-09-10T09:54:37.341 INFO:teuthology.orchestra.run.smithi071.stdout:Unit chronyd.service is enabled and running 2024-09-10T09:54:37.341 INFO:teuthology.orchestra.run.smithi071.stdout:Repeating the final host check... 2024-09-10T09:54:37.362 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stdout 5.2.2 2024-09-10T09:54:37.362 INFO:teuthology.orchestra.run.smithi071.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T09:54:37.362 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl is present 2024-09-10T09:54:37.362 INFO:teuthology.orchestra.run.smithi071.stdout:lvcreate is present 2024-09-10T09:54:37.369 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T09:54:37.369 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T09:54:37.376 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T09:54:37.376 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout inactive 2024-09-10T09:54:37.382 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout enabled 2024-09-10T09:54:37.389 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout active 2024-09-10T09:54:37.389 INFO:teuthology.orchestra.run.smithi071.stdout:Unit chronyd.service is enabled and running 2024-09-10T09:54:37.389 INFO:teuthology.orchestra.run.smithi071.stdout:Host looks OK 2024-09-10T09:54:37.390 INFO:teuthology.orchestra.run.smithi071.stdout:Cluster fsid: 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:54:37.390 INFO:teuthology.orchestra.run.smithi071.stdout:Acquiring lock 140326643638624 on /run/cephadm/9dae8622-6f5a-11ef-bcea-c7b262605968.lock 2024-09-10T09:54:37.390 INFO:teuthology.orchestra.run.smithi071.stdout:Lock 140326643638624 acquired on /run/cephadm/9dae8622-6f5a-11ef-bcea-c7b262605968.lock 2024-09-10T09:54:37.390 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying IP 172.21.15.71 port 3300 ... 2024-09-10T09:54:37.390 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying IP 172.21.15.71 port 6789 ... 2024-09-10T09:54:37.390 INFO:teuthology.orchestra.run.smithi071.stdout:Base mon IP(s) is [172.21.15.71:3300, 172.21.15.71:6789], mon addrv is [v2:172.21.15.71:3300,v1:172.21.15.71:6789] 2024-09-10T09:54:37.394 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.71 metric 100 2024-09-10T09:54:37.394 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.71 metric 100 2024-09-10T09:54:37.397 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T09:54:37.397 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-10T09:54:37.397 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-10T09:54:37.399 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T09:54:37.400 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T09:54:37.400 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T09:54:37.400 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-10T09:54:37.400 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d765/64 scope link noprefixroute 2024-09-10T09:54:37.400 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T09:54:37.400 INFO:teuthology.orchestra.run.smithi071.stdout:Mon IP `172.21.15.71` is in CIDR network `172.21.0.0/20` 2024-09-10T09:54:37.401 INFO:teuthology.orchestra.run.smithi071.stdout:Mon IP `172.21.15.71` is in CIDR network `172.21.0.0/20` 2024-09-10T09:54:37.401 INFO:teuthology.orchestra.run.smithi071.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T09:54:37.401 INFO:teuthology.orchestra.run.smithi071.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T09:54:37.402 INFO:teuthology.orchestra.run.smithi071.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-10T09:54:37.888 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stdout f3fc7d52e2333ce256d91e3fea7102108584b9294bcc075f619f9369d33f3045 2024-09-10T09:54:37.888 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-10T09:54:37.888 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T09:54:37.888 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stderr Copying blob sha256:f705a2581a075bb4cc989e726d1f9d9c82245ea3104b51e3dc6437f415d800ef 2024-09-10T09:54:37.888 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T09:54:37.888 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stderr Copying config sha256:f3fc7d52e2333ce256d91e3fea7102108584b9294bcc075f619f9369d33f3045 2024-09-10T09:54:37.888 INFO:teuthology.orchestra.run.smithi071.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T09:54:38.792 INFO:teuthology.orchestra.run.smithi071.stdout:ceph: stdout ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable) 2024-09-10T09:54:38.792 INFO:teuthology.orchestra.run.smithi071.stdout:Ceph version: ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable) 2024-09-10T09:54:38.792 INFO:teuthology.orchestra.run.smithi071.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T09:54:39.731 INFO:teuthology.orchestra.run.smithi071.stdout:stat: stdout 167 167 2024-09-10T09:54:39.731 INFO:teuthology.orchestra.run.smithi071.stdout:Creating initial keys... 2024-09-10T09:54:40.596 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph-authtool: stdout AQBgF+BmzqmsARAACIhkNu3vkwFZI/R6PGbifQ== 2024-09-10T09:54:41.476 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph-authtool: stdout AQBgF+Bm6de5NRAAOBr5o2LxfSbxNqQJPqll7A== 2024-09-10T09:54:42.382 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph-authtool: stdout AQBhF+BmT7IGLxAA6VbEXZcstse9D/oS6G1aYg== 2024-09-10T09:54:42.384 INFO:teuthology.orchestra.run.smithi071.stdout:Creating initial monmap... 2024-09-10T09:54:43.313 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T09:54:43.313 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-10T09:54:43.313 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:54:43.313 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T09:54:43.313 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool for smithi071 [v2:172.21.15.71:3300,v1:172.21.15.71:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T09:54:43.314 INFO:teuthology.orchestra.run.smithi071.stdout:setting min_mon_release = octopus 2024-09-10T09:54:43.314 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/monmaptool: set fsid to 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:54:43.314 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T09:54:43.314 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:54:43.314 INFO:teuthology.orchestra.run.smithi071.stdout:Creating mon... 2024-09-10T09:54:44.302 INFO:teuthology.orchestra.run.smithi071.stdout:create mon.smithi071 on 2024-09-10T09:54:44.509 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T09:54:44.668 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T09:54:44.823 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-9dae8622-6f5a-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-9dae8622-6f5a-11ef-bcea-c7b262605968.target. 2024-09-10T09:54:44.824 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-9dae8622-6f5a-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-9dae8622-6f5a-11ef-bcea-c7b262605968.target. 2024-09-10T09:54:45.021 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi071 2024-09-10T09:54:45.022 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi071.service: Unit ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi071.service not loaded. 2024-09-10T09:54:45.189 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9dae8622-6f5a-11ef-bcea-c7b262605968.target.wants/ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi071.service → /etc/systemd/system/ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@.service. 2024-09-10T09:54:45.257 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:45 smithi071 systemd[1]: Starting Ceph mon.smithi071 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T09:54:45.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:45 smithi071 podman[27175]: 2024-09-10 09:54:45.441879085 +0000 UTC m=+0.110137201 container create 62858883b267cfd7889299930e0b8bd3ed89087d8173ec220d4e846206498286 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=quincy-96d63e7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T09:54:45.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:45 smithi071 podman[27175]: 2024-09-10 09:54:45.34747226 +0000 UTC m=+0.015730377 image pull f3fc7d52e2333ce256d91e3fea7102108584b9294bcc075f619f9369d33f3045 quay.ceph.io/ceph-ci/ceph:quincy 2024-09-10T09:54:45.744 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T09:54:45.744 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout disabled 2024-09-10T09:54:45.753 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T09:54:45.753 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout inactive 2024-09-10T09:54:45.753 INFO:teuthology.orchestra.run.smithi071.stdout:firewalld.service is not enabled 2024-09-10T09:54:45.754 INFO:teuthology.orchestra.run.smithi071.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T09:54:45.754 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for mon to start... 2024-09-10T09:54:45.754 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for mon... 2024-09-10T09:54:45.808 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:45 smithi071 podman[27175]: 2024-09-10 09:54:45.636382792 +0000 UTC m=+0.304640907 container init 62858883b267cfd7889299930e0b8bd3ed89087d8173ec220d4e846206498286 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, RELEASE=quincy-96d63e7, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T09:54:45.808 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:45 smithi071 podman[27175]: 2024-09-10 09:54:45.639636627 +0000 UTC m=+0.307894744 container start 62858883b267cfd7889299930e0b8bd3ed89087d8173ec220d4e846206498286 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, RELEASE=quincy-96d63e7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T09:54:45.808 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:45 smithi071 ceph-mon[27194]: mkfs 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:54:45.808 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:45 smithi071 ceph-mon[27194]: mon.smithi071 is new leader, mons smithi071 in quorum (ranks 0) 2024-09-10T09:54:45.808 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:45 smithi071 bash[27175]: 62858883b267cfd7889299930e0b8bd3ed89087d8173ec220d4e846206498286 2024-09-10T09:54:45.808 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:45 smithi071 systemd[1]: Started Ceph mon.smithi071 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T09:54:46.827 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T09:54:46.827 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout id: 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:54:46.827 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T09:54:46.827 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-09-10T09:54:46.827 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout services: 2024-09-10T09:54:46.827 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi071 (age 0.582039s) 2024-09-10T09:54:46.827 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T09:54:46.827 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T09:54:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-09-10T09:54:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout data: 2024-09-10T09:54:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T09:54:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T09:54:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T09:54:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T09:54:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-09-10T09:54:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.187+0000 7f657e25d640 1 Processor -- start 2024-09-10T09:54:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.187+0000 7f657e25d640 1 -- start start 2024-09-10T09:54:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.187+0000 7f657e25d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 0x7f6578102460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.187+0000 7f657e25d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65781029a0 con 0x7f6578102050 2024-09-10T09:54:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.188+0000 7f65777fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 0x7f6578102460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:46.828 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.188+0000 7f65777fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 0x7f6578102460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36512/0 (socket says 172.21.15.71:36512) 2024-09-10T09:54:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.188+0000 7f65777fe640 1 -- 172.21.15.71:0/2990161531 learned_addr learned my addr 172.21.15.71:0/2990161531 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.188+0000 7f65777fe640 1 -- 172.21.15.71:0/2990161531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6578102ae0 con 0x7f6578102050 2024-09-10T09:54:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.190+0000 7f65777fe640 1 --2- 172.21.15.71:0/2990161531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 0x7f6578102460 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6568009840 tx=0x7f65680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832835b37d1d35d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.190+0000 7f65767fc640 1 -- 172.21.15.71:0/2990161531 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6568032440 con 0x7f6578102050 2024-09-10T09:54:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.190+0000 7f65767fc640 1 -- 172.21.15.71:0/2990161531 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65680325a0 con 0x7f6578102050 2024-09-10T09:54:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.190+0000 7f65767fc640 1 -- 172.21.15.71:0/2990161531 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65680328d0 con 0x7f6578102050 2024-09-10T09:54:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.191+0000 7f657e25d640 1 -- 172.21.15.71:0/2990161531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 msgr2=0x7f6578102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.191+0000 7f657e25d640 1 --2- 172.21.15.71:0/2990161531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 0x7f6578102460 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6568009840 tx=0x7f65680091d0 comp rx=0 tx=0).stop 2024-09-10T09:54:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.191+0000 7f657e25d640 1 -- 172.21.15.71:0/2990161531 shutdown_connections 2024-09-10T09:54:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.191+0000 7f657e25d640 1 --2- 172.21.15.71:0/2990161531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 0x7f6578102460 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.191+0000 7f657e25d640 1 -- 172.21.15.71:0/2990161531 >> 172.21.15.71:0/2990161531 conn(0x7f65780fd7f0 msgr2=0x7f65780ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.191+0000 7f657e25d640 1 -- 172.21.15.71:0/2990161531 shutdown_connections 2024-09-10T09:54:46.829 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.191+0000 7f657e25d640 1 -- 172.21.15.71:0/2990161531 wait complete. 2024-09-10T09:54:46.830 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.191+0000 7f657e25d640 1 Processor -- start 2024-09-10T09:54:46.830 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.192+0000 7f657e25d640 1 -- start start 2024-09-10T09:54:46.830 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.192+0000 7f657e25d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 0x7f6578110580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:46.830 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.192+0000 7f657e25d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6578110ac0 con 0x7f6578102050 2024-09-10T09:54:46.830 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.192+0000 7f65777fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 0x7f6578110580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:46.830 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.192+0000 7f65777fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 0x7f6578110580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36526/0 (socket says 172.21.15.71:36526) 2024-09-10T09:54:46.830 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.192+0000 7f65777fe640 1 -- 172.21.15.71:0/3773583139 learned_addr learned my addr 172.21.15.71:0/3773583139 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:46.830 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.192+0000 7f65777fe640 1 -- 172.21.15.71:0/3773583139 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6568009450 con 0x7f6578102050 2024-09-10T09:54:46.830 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.192+0000 7f65777fe640 1 --2- 172.21.15.71:0/3773583139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 0x7f6578110580 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f656802a700 tx=0x7f6568032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:46.830 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.192+0000 7f655ffff640 1 -- 172.21.15.71:0/3773583139 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6568031be0 con 0x7f6578102050 2024-09-10T09:54:46.830 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.192+0000 7f655ffff640 1 -- 172.21.15.71:0/3773583139 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6568031d40 con 0x7f6578102050 2024-09-10T09:54:46.830 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.192+0000 7f657e25d640 1 -- 172.21.15.71:0/3773583139 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6578110cc0 con 0x7f6578102050 2024-09-10T09:54:46.831 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.192+0000 7f655ffff640 1 -- 172.21.15.71:0/3773583139 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f656803b5a0 con 0x7f6578102050 2024-09-10T09:54:46.831 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.192+0000 7f657e25d640 1 -- 172.21.15.71:0/3773583139 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65781110d0 con 0x7f6578102050 2024-09-10T09:54:46.831 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.193+0000 7f655ffff640 1 -- 172.21.15.71:0/3773583139 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6568039040 con 0x7f6578102050 2024-09-10T09:54:46.831 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.193+0000 7f655ffff640 1 -- 172.21.15.71:0/3773583139 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6568041030 con 0x7f6578102050 2024-09-10T09:54:46.831 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.193+0000 7f657e25d640 1 -- 172.21.15.71:0/3773583139 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657804b720 con 0x7f6578102050 2024-09-10T09:54:46.831 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.196+0000 7f655ffff640 1 -- 172.21.15.71:0/3773583139 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f6568037070 con 0x7f6578102050 2024-09-10T09:54:46.831 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.253+0000 7f657e25d640 1 -- 172.21.15.71:0/3773583139 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f6578109d80 con 0x7f6578102050 2024-09-10T09:54:46.831 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.253+0000 7f655ffff640 1 -- 172.21.15.71:0/3773583139 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f656803bbd0 con 0x7f6578102050 2024-09-10T09:54:46.831 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.254+0000 7f657e25d640 1 -- 172.21.15.71:0/3773583139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 msgr2=0x7f6578110580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:46.831 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.254+0000 7f657e25d640 1 --2- 172.21.15.71:0/3773583139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 0x7f6578110580 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f656802a700 tx=0x7f6568032000 comp rx=0 tx=0).stop 2024-09-10T09:54:46.831 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.254+0000 7f657e25d640 1 -- 172.21.15.71:0/3773583139 shutdown_connections 2024-09-10T09:54:46.831 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.254+0000 7f657e25d640 1 --2- 172.21.15.71:0/3773583139 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6578102050 0x7f6578110580 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:46.831 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.254+0000 7f657e25d640 1 -- 172.21.15.71:0/3773583139 >> 172.21.15.71:0/3773583139 conn(0x7f65780fd7f0 msgr2=0x7f65781074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:46.832 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.254+0000 7f657e25d640 1 -- 172.21.15.71:0/3773583139 shutdown_connections 2024-09-10T09:54:46.832 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:46.254+0000 7f657e25d640 1 -- 172.21.15.71:0/3773583139 wait complete. 2024-09-10T09:54:46.832 INFO:teuthology.orchestra.run.smithi071.stdout:mon is available 2024-09-10T09:54:46.832 INFO:teuthology.orchestra.run.smithi071.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T09:54:46.936 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:46 smithi071 ceph-mon[27194]: mon.smithi071 is new leader, mons smithi071 in quorum (ranks 0) 2024-09-10T09:54:46.936 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:46 smithi071 ceph-mon[27194]: monmap e1: 1 mons at {smithi071=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-10T09:54:46.936 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:46 smithi071 ceph-mon[27194]: fsmap 2024-09-10T09:54:46.936 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:46 smithi071 ceph-mon[27194]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T09:54:46.937 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:46 smithi071 ceph-mon[27194]: mgrmap e1: no daemons active 2024-09-10T09:54:46.937 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:46 smithi071 ceph-mon[27194]: from='client.? 172.21.15.71:0/3773583139' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-10T09:54:47.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-09-10T09:54:47.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T09:54:47.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout fsid = 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:54:47.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T09:54:47.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.71:3300,v1:172.21.15.71:6789] 2024-09-10T09:54:47.852 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T09:54:47.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T09:54:47.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T09:54:47.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T09:54:47.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-09-10T09:54:47.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T09:54:47.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T09:54:47.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-09-10T09:54:47.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T09:54:47.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T09:54:47.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T09:54:47.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T09:54:47.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T09:54:47.853 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T09:54:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.210+0000 7fbd7c665640 1 Processor -- start 2024-09-10T09:54:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.210+0000 7fbd7c665640 1 -- start start 2024-09-10T09:54:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.210+0000 7fbd7c665640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 0x7fbd741039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.210+0000 7fbd7c665640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74070e30 con 0x7fbd741035d0 2024-09-10T09:54:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.211+0000 7fbd7a401640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 0x7fbd741039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.211+0000 7fbd7a401640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 0x7fbd741039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36536/0 (socket says 172.21.15.71:36536) 2024-09-10T09:54:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.211+0000 7fbd7a401640 1 -- 172.21.15.71:0/4071146524 learned_addr learned my addr 172.21.15.71:0/4071146524 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.211+0000 7fbd7a401640 1 -- 172.21.15.71:0/4071146524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd74103f20 con 0x7fbd741035d0 2024-09-10T09:54:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.212+0000 7fbd7a401640 1 --2- 172.21.15.71:0/4071146524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 0x7fbd741039e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009840 tx=0x7fbd700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9faba739fe337417 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.212+0000 7fbd793ff640 1 -- 172.21.15.71:0/4071146524 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd70032440 con 0x7fbd741035d0 2024-09-10T09:54:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.212+0000 7fbd793ff640 1 -- 172.21.15.71:0/4071146524 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd700325a0 con 0x7fbd741035d0 2024-09-10T09:54:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.212+0000 7fbd793ff640 1 -- 172.21.15.71:0/4071146524 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd700328d0 con 0x7fbd741035d0 2024-09-10T09:54:47.854 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.212+0000 7fbd7c665640 1 -- 172.21.15.71:0/4071146524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 msgr2=0x7fbd741039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.212+0000 7fbd7c665640 1 --2- 172.21.15.71:0/4071146524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 0x7fbd741039e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009840 tx=0x7fbd700091d0 comp rx=0 tx=0).stop 2024-09-10T09:54:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.213+0000 7fbd7c665640 1 -- 172.21.15.71:0/4071146524 shutdown_connections 2024-09-10T09:54:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.213+0000 7fbd7c665640 1 --2- 172.21.15.71:0/4071146524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 0x7fbd741039e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.213+0000 7fbd7c665640 1 -- 172.21.15.71:0/4071146524 >> 172.21.15.71:0/4071146524 conn(0x7fbd740fbdd0 msgr2=0x7fbd740fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.213+0000 7fbd7c665640 1 -- 172.21.15.71:0/4071146524 shutdown_connections 2024-09-10T09:54:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.213+0000 7fbd7c665640 1 -- 172.21.15.71:0/4071146524 wait complete. 2024-09-10T09:54:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.213+0000 7fbd7c665640 1 Processor -- start 2024-09-10T09:54:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.213+0000 7fbd7c665640 1 -- start start 2024-09-10T09:54:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.213+0000 7fbd7c665640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 0x7fbd74102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.213+0000 7fbd7c665640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74103220 con 0x7fbd741035d0 2024-09-10T09:54:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.214+0000 7fbd7a401640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 0x7fbd74102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.214+0000 7fbd7a401640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 0x7fbd74102ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36550/0 (socket says 172.21.15.71:36550) 2024-09-10T09:54:47.855 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.214+0000 7fbd7a401640 1 -- 172.21.15.71:0/1890911799 learned_addr learned my addr 172.21.15.71:0/1890911799 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.214+0000 7fbd7a401640 1 -- 172.21.15.71:0/1890911799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd70009450 con 0x7fbd741035d0 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.214+0000 7fbd7a401640 1 --2- 172.21.15.71:0/1890911799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 0x7fbd74102ce0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbd7002a700 tx=0x7fbd70032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.214+0000 7fbd66ffd640 1 -- 172.21.15.71:0/1890911799 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd70031be0 con 0x7fbd741035d0 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.214+0000 7fbd66ffd640 1 -- 172.21.15.71:0/1890911799 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd70031d40 con 0x7fbd741035d0 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.214+0000 7fbd7c665640 1 -- 172.21.15.71:0/1890911799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd741012b0 con 0x7fbd741035d0 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.214+0000 7fbd66ffd640 1 -- 172.21.15.71:0/1890911799 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd7003b5a0 con 0x7fbd741035d0 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.214+0000 7fbd7c665640 1 -- 172.21.15.71:0/1890911799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd741016c0 con 0x7fbd741035d0 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.214+0000 7fbd66ffd640 1 -- 172.21.15.71:0/1890911799 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbd70039040 con 0x7fbd741035d0 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.214+0000 7fbd66ffd640 1 -- 172.21.15.71:0/1890911799 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbd70041030 con 0x7fbd741035d0 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.215+0000 7fbd7c665640 1 -- 172.21.15.71:0/1890911799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd74102180 con 0x7fbd741035d0 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.217+0000 7fbd66ffd640 1 -- 172.21.15.71:0/1890911799 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fbd74102180 con 0x7fbd741035d0 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.273+0000 7fbd7c665640 1 -- 172.21.15.71:0/1890911799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fbd740ffa70 con 0x7fbd741035d0 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.277+0000 7fbd66ffd640 1 -- 172.21.15.71:0/1890911799 <== mon.0 v2:172.21.15.71:3300/0 7 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fbd70046c30 con 0x7fbd741035d0 2024-09-10T09:54:47.856 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.277+0000 7fbd66ffd640 1 -- 172.21.15.71:0/1890911799 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+465 (secure 0 0 0) 0x7fbd70054d80 con 0x7fbd741035d0 2024-09-10T09:54:47.857 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.278+0000 7fbd7c665640 1 -- 172.21.15.71:0/1890911799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 msgr2=0x7fbd74102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:47.857 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.278+0000 7fbd7c665640 1 --2- 172.21.15.71:0/1890911799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 0x7fbd74102ce0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbd7002a700 tx=0x7fbd70032000 comp rx=0 tx=0).stop 2024-09-10T09:54:47.857 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.278+0000 7fbd7c665640 1 -- 172.21.15.71:0/1890911799 shutdown_connections 2024-09-10T09:54:47.857 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.278+0000 7fbd7c665640 1 --2- 172.21.15.71:0/1890911799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd741035d0 0x7fbd74102ce0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:47.857 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.278+0000 7fbd7c665640 1 -- 172.21.15.71:0/1890911799 >> 172.21.15.71:0/1890911799 conn(0x7fbd740fbdd0 msgr2=0x7fbd74104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:47.857 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.278+0000 7fbd7c665640 1 -- 172.21.15.71:0/1890911799 shutdown_connections 2024-09-10T09:54:47.857 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:47.278+0000 7fbd7c665640 1 -- 172.21.15.71:0/1890911799 wait complete. 2024-09-10T09:54:47.857 INFO:teuthology.orchestra.run.smithi071.stdout:Generating new minimal ceph.conf... 2024-09-10T09:54:47.967 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:47 smithi071 ceph-mon[27194]: from='client.? 172.21.15.71:0/1890911799' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T09:54:47.967 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:47 smithi071 ceph-mon[27194]: from='client.? 172.21.15.71:0/1890911799' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T09:54:48.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.259+0000 7fdd03dc5640 1 Processor -- start 2024-09-10T09:54:48.897 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.259+0000 7fdd03dc5640 1 -- start start 2024-09-10T09:54:48.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.259+0000 7fdd03dc5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 0x7fdcfc102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:48.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.259+0000 7fdd03dc5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc1029c0 con 0x7fdcfc102070 2024-09-10T09:54:48.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.259+0000 7fdd01b61640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 0x7fdcfc102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:48.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.259+0000 7fdd01b61640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 0x7fdcfc102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36558/0 (socket says 172.21.15.71:36558) 2024-09-10T09:54:48.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.259+0000 7fdd01b61640 1 -- 172.21.15.71:0/629901945 learned_addr learned my addr 172.21.15.71:0/629901945 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:48.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.259+0000 7fdd01b61640 1 -- 172.21.15.71:0/629901945 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc102b00 con 0x7fdcfc102070 2024-09-10T09:54:48.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.260+0000 7fdd01b61640 1 --2- 172.21.15.71:0/629901945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 0x7fdcfc102480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009840 tx=0x7fdcf80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e227d8e1c76021 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:48.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.260+0000 7fdd00b5f640 1 -- 172.21.15.71:0/629901945 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcf8032440 con 0x7fdcfc102070 2024-09-10T09:54:48.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.260+0000 7fdd00b5f640 1 -- 172.21.15.71:0/629901945 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fdcf8032a00 con 0x7fdcfc102070 2024-09-10T09:54:48.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.260+0000 7fdd00b5f640 1 -- 172.21.15.71:0/629901945 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcf8031a10 con 0x7fdcfc102070 2024-09-10T09:54:48.898 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.261+0000 7fdd03dc5640 1 -- 172.21.15.71:0/629901945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 msgr2=0x7fdcfc102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:48.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.261+0000 7fdd03dc5640 1 --2- 172.21.15.71:0/629901945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 0x7fdcfc102480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009840 tx=0x7fdcf80091d0 comp rx=0 tx=0).stop 2024-09-10T09:54:48.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.261+0000 7fdd03dc5640 1 -- 172.21.15.71:0/629901945 shutdown_connections 2024-09-10T09:54:48.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.261+0000 7fdd03dc5640 1 --2- 172.21.15.71:0/629901945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 0x7fdcfc102480 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:48.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.261+0000 7fdd03dc5640 1 -- 172.21.15.71:0/629901945 >> 172.21.15.71:0/629901945 conn(0x7fdcfc0fd850 msgr2=0x7fdcfc0ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:48.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.261+0000 7fdd03dc5640 1 -- 172.21.15.71:0/629901945 shutdown_connections 2024-09-10T09:54:48.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.261+0000 7fdd03dc5640 1 -- 172.21.15.71:0/629901945 wait complete. 2024-09-10T09:54:48.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.262+0000 7fdd03dc5640 1 Processor -- start 2024-09-10T09:54:48.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.262+0000 7fdd03dc5640 1 -- start start 2024-09-10T09:54:48.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.262+0000 7fdd03dc5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 0x7fdcfc110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:48.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.262+0000 7fdd03dc5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc111310 con 0x7fdcfc102070 2024-09-10T09:54:48.899 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.262+0000 7fdd01b61640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 0x7fdcfc110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:48.900 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.262+0000 7fdd01b61640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 0x7fdcfc110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36562/0 (socket says 172.21.15.71:36562) 2024-09-10T09:54:48.900 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.262+0000 7fdd01b61640 1 -- 172.21.15.71:0/43079104 learned_addr learned my addr 172.21.15.71:0/43079104 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:48.900 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.262+0000 7fdd01b61640 1 -- 172.21.15.71:0/43079104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf8009450 con 0x7fdcfc102070 2024-09-10T09:54:48.900 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.263+0000 7fdd01b61640 1 --2- 172.21.15.71:0/43079104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 0x7fdcfc110dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80098a0 tx=0x7fdcf802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:48.900 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.263+0000 7fdcf27fc640 1 -- 172.21.15.71:0/43079104 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcf80327b0 con 0x7fdcfc102070 2024-09-10T09:54:48.900 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.263+0000 7fdcf27fc640 1 -- 172.21.15.71:0/43079104 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fdcf803b870 con 0x7fdcfc102070 2024-09-10T09:54:48.900 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.263+0000 7fdd03dc5640 1 -- 172.21.15.71:0/43079104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc111510 con 0x7fdcfc102070 2024-09-10T09:54:48.900 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.263+0000 7fdcf27fc640 1 -- 172.21.15.71:0/43079104 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcf803a550 con 0x7fdcfc102070 2024-09-10T09:54:48.900 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.263+0000 7fdd03dc5640 1 -- 172.21.15.71:0/43079104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc111f60 con 0x7fdcfc102070 2024-09-10T09:54:48.900 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.263+0000 7fdcf27fc640 1 -- 172.21.15.71:0/43079104 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fdcf8039040 con 0x7fdcfc102070 2024-09-10T09:54:48.900 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.263+0000 7fdcf27fc640 1 -- 172.21.15.71:0/43079104 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdcf80447a0 con 0x7fdcfc102070 2024-09-10T09:54:48.901 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.264+0000 7fdd03dc5640 1 -- 172.21.15.71:0/43079104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc1014d0 con 0x7fdcfc102070 2024-09-10T09:54:48.901 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.266+0000 7fdcf27fc640 1 -- 172.21.15.71:0/43079104 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fdcf8049060 con 0x7fdcfc102070 2024-09-10T09:54:48.901 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.321+0000 7fdd03dc5640 1 -- 172.21.15.71:0/43079104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fdcfc103cf0 con 0x7fdcfc102070 2024-09-10T09:54:48.901 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.321+0000 7fdcf27fc640 1 -- 172.21.15.71:0/43079104 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fdcf803f070 con 0x7fdcfc102070 2024-09-10T09:54:48.901 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.322+0000 7fdd03dc5640 1 -- 172.21.15.71:0/43079104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 msgr2=0x7fdcfc110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:48.901 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.322+0000 7fdd03dc5640 1 --2- 172.21.15.71:0/43079104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 0x7fdcfc110dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80098a0 tx=0x7fdcf802c040 comp rx=0 tx=0).stop 2024-09-10T09:54:48.901 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.322+0000 7fdd03dc5640 1 -- 172.21.15.71:0/43079104 shutdown_connections 2024-09-10T09:54:48.901 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.322+0000 7fdd03dc5640 1 --2- 172.21.15.71:0/43079104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdcfc102070 0x7fdcfc110dd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:48.901 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.322+0000 7fdd03dc5640 1 -- 172.21.15.71:0/43079104 >> 172.21.15.71:0/43079104 conn(0x7fdcfc0fd850 msgr2=0x7fdcfc0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:48.901 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.322+0000 7fdd03dc5640 1 -- 172.21.15.71:0/43079104 shutdown_connections 2024-09-10T09:54:48.902 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:48.322+0000 7fdd03dc5640 1 -- 172.21.15.71:0/43079104 wait complete. 2024-09-10T09:54:48.902 INFO:teuthology.orchestra.run.smithi071.stdout:Restarting the monitor... 2024-09-10T09:54:49.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:48 smithi071 ceph-mon[27194]: from='client.? 172.21.15.71:0/43079104' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:54:49.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:48 smithi071 systemd[1]: Stopping Ceph mon.smithi071 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T09:54:49.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:49 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071[27190]: 2024-09-10T09:54:49.151+0000 7f27bfabc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi071 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:54:49.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:49 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071[27190]: 2024-09-10T09:54:49.151+0000 7f27bfabc640 -1 mon.smithi071@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T09:54:49.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:49 smithi071 podman[27434]: 2024-09-10 09:54:49.193068433 +0000 UTC m=+0.140202573 container died 62858883b267cfd7889299930e0b8bd3ed89087d8173ec220d4e846206498286 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=quincy-96d63e7, GIT_BRANCH=HEAD) 2024-09-10T09:54:49.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:49 smithi071 podman[27434]: 2024-09-10 09:54:49.534532651 +0000 UTC m=+0.481666791 container cleanup 62858883b267cfd7889299930e0b8bd3ed89087d8173ec220d4e846206498286 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=quincy-96d63e7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T09:54:49.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:49 smithi071 bash[27434]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071 2024-09-10T09:54:50.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:49 smithi071 podman[27446]: 2024-09-10 09:54:49.694158482 +0000 UTC m=+0.495497621 container remove 62858883b267cfd7889299930e0b8bd3ed89087d8173ec220d4e846206498286 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=quincy-96d63e7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T09:54:50.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:49 smithi071 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi071.service: Deactivated successfully. 2024-09-10T09:54:50.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:49 smithi071 systemd[1]: Stopped Ceph mon.smithi071 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T09:54:50.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:49 smithi071 systemd[1]: Starting Ceph mon.smithi071 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T09:54:50.387 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 podman[27540]: 2024-09-10 09:54:50.094825864 +0000 UTC m=+0.106198541 container create 35e491e574a399a496726a9d61a0ae04f41c6851e874590c8f4dfef27d1e38e6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=quincy-96d63e7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T09:54:50.387 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 podman[27540]: 2024-09-10 09:54:50.004132117 +0000 UTC m=+0.015504792 image pull f3fc7d52e2333ce256d91e3fea7102108584b9294bcc075f619f9369d33f3045 quay.ceph.io/ceph-ci/ceph:quincy 2024-09-10T09:54:50.387 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 podman[27540]: 2024-09-10 09:54:50.297093271 +0000 UTC m=+0.308465946 container init 35e491e574a399a496726a9d61a0ae04f41c6851e874590c8f4dfef27d1e38e6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=quincy-96d63e7, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T09:54:50.387 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 podman[27540]: 2024-09-10 09:54:50.300165504 +0000 UTC m=+0.311538176 container start 35e491e574a399a496726a9d61a0ae04f41c6851e874590c8f4dfef27d1e38e6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=quincy-96d63e7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T09:54:50.387 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T09:54:50.387 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable), process ceph-mon, pid 2 2024-09-10T09:54:50.387 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: pidfile_write: ignore empty --pid-file 2024-09-10T09:54:50.387 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: load: jerasure load: lrc 2024-09-10T09:54:50.387 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: RocksDB version: 6.15.5 2024-09-10T09:54:50.388 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-10T09:54:50.388 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Compile date Sep 9 2024 2024-09-10T09:54:50.388 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: DB SUMMARY 2024-09-10T09:54:50.388 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: DB Session ID: XBWEJVF9ZJ1FISUHHKC0 2024-09-10T09:54:50.388 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: CURRENT file: CURRENT 2024-09-10T09:54:50.388 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T09:54:50.388 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-10T09:54:50.388 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi071/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T09:54:50.388 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi071/store.db: 000010.log size: 98112 ; 2024-09-10T09:54:50.388 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.error_if_exists: 0 2024-09-10T09:54:50.388 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.create_if_missing: 0 2024-09-10T09:54:50.388 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.paranoid_checks: 1 2024-09-10T09:54:50.388 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.env: 0x555f8fe83440 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.fs: Posix File System 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.info_log: 0x555f91e530c0 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.statistics: (nil) 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.use_fsync: 0 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_log_file_size: 0 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.allow_fallocate: 1 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T09:54:50.389 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.use_direct_reads: 0 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.db_log_dir: 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi071/store.db 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.write_buffer_manager: 0x555f91f10870 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T09:54:50.390 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-10T09:54:50.391 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T09:54:50.391 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T09:54:50.391 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T09:54:50.391 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T09:54:50.391 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T09:54:50.391 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T09:54:50.391 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T09:54:50.392 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.unordered_write: 0 2024-09-10T09:54:50.392 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T09:54:50.392 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.row_cache: None 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.wal_filter: None 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.preserve_deletes: 0 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.two_write_queues: 0 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.atomic_flush: 0 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.log_readahead_size: 0 2024-09-10T09:54:50.393 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_background_jobs: 2 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_background_compactions: -1 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_subcompactions: 1 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T09:54:50.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_open_files: -1 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_background_flushes: -1 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Compression algorithms supported: 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: kZSTD supported: 0 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: kXpressCompression supported: 0 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: kBZip2Compression supported: 0 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: kLZ4Compression supported: 1 2024-09-10T09:54:50.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: kZlibCompression supported: 1 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: kSnappyCompression supported: 1 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi071/store.db/MANIFEST-000009 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.merge_operator: 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compaction_filter: None 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555f91df9a38) 2024-09-10T09:54:50.396 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: cache_index_and_filter_blocks: 1 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: pin_top_level_index_and_filter: 1 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: index_type: 0 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: data_block_index_type: 0 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: index_shortening: 1 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: hash_index_allow_collision: 1 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: checksum: 1 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: no_block_cache: 0 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_cache: 0x555f91e2f1f0 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_cache_name: BinnedLRUCache 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_cache_options: 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: capacity : 536870912 2024-09-10T09:54:50.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: num_shard_bits : 4 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: strict_capacity_limit : 0 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: high_pri_pool_ratio: 0.000 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_cache_compressed: (nil) 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: persistent_cache: (nil) 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_size: 4096 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_size_deviation: 10 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_restart_interval: 16 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: index_block_restart_interval: 1 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: metadata_block_size: 4096 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: partition_filters: 0 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: use_delta_encoding: 1 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: whole_key_filtering: 1 2024-09-10T09:54:50.398 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: verify_compression: 0 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: read_amp_bytes_per_bit: 0 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: format_version: 4 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: enable_index_compression: 1 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_align: 0 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compression: NoCompression 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.num_levels: 7 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T09:54:50.399 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T09:54:50.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T09:54:50.401 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.arena_block_size: 4194304 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T09:54:50.402 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.inplace_update_support: 0 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.bloom_locality: 0 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.max_successive_merges: 0 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.ttl: 2592000 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.enable_blob_files: false 2024-09-10T09:54:50.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.min_blob_size: 0 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi071/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962090323451, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962090324333, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93344, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91424, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13564, "raw_average_key_size": 49, "raw_value_size": 84006, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1725962090, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "75704ef2-353d-4775-853e-437e199df493", "db_session_id": "XBWEJVF9ZJ1FISUHHKC0"}} 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962090324693, "job": 1, "event": "recovery_finished"} 2024-09-10T09:54:50.404 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi071/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x555f91e62700 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: DB pointer 0x555f91e32000 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ** DB Stats ** 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-10T09:54:50.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: L0 2/0 92.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.5 0.00 0.00 1 0.001 0 0 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Sum 2/0 92.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.5 0.00 0.00 1 0.001 0 0 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.5 0.00 0.00 1 0.001 0 0 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 145.5 0.00 0.00 1 0.001 0 0 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T09:54:50.406 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Cumulative compaction: 0.00 GB write, 27.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Interval compaction: 0.00 GB write, 27.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: L0 2/0 92.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.5 0.00 0.00 1 0.001 0 0 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Sum 2/0 92.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.5 0.00 0.00 1 0.001 0 0 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-10T09:54:50.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T09:54:50.408 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 145.5 0.00 0.00 1 0.001 0 0 2024-09-10T09:54:50.408 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T09:54:50.408 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T09:54:50.408 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T09:54:50.408 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T09:54:50.408 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T09:54:50.408 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T09:54:50.408 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Cumulative compaction: 0.00 GB write, 27.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T09:54:50.408 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T09:54:50.408 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T09:54:50.408 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T09:54:50.408 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T09:54:50.408 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: starting mon.smithi071 rank 0 at public addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] at bind addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi071 fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:54:50.409 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: mon.smithi071@-1(???) e1 preinit fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:54:50.409 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: mon.smithi071@-1(???).mds e1 new map 2024-09-10T09:54:50.409 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: mon.smithi071@-1(???).mds e1 print_map 2024-09-10T09:54:50.409 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: e1 2024-09-10T09:54:50.409 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:54:50.409 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:54:50.409 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: legacy client fscid: -1 2024-09-10T09:54:50.409 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T09:54:50.409 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: No filesystems configured 2024-09-10T09:54:50.409 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: mon.smithi071@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T09:54:50.409 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: mon.smithi071@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T09:54:50.409 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: mon.smithi071@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T09:54:50.409 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: mon.smithi071@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T09:54:50.410 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: mon.smithi071@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T09:54:50.410 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: mon.smithi071 is new leader, mons smithi071 in quorum (ranks 0) 2024-09-10T09:54:50.410 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: monmap e1: 1 mons at {smithi071=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-10T09:54:50.410 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: fsmap 2024-09-10T09:54:50.410 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T09:54:50.410 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 ceph-mon[27559]: mgrmap e1: no daemons active 2024-09-10T09:54:50.412 INFO:teuthology.orchestra.run.smithi071.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T09:54:50.691 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 bash[27540]: 35e491e574a399a496726a9d61a0ae04f41c6851e874590c8f4dfef27d1e38e6 2024-09-10T09:54:50.692 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:50 smithi071 systemd[1]: Started Ceph mon.smithi071 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T09:54:51.339 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.768+0000 7f812c608640 1 Processor -- start 2024-09-10T09:54:51.343 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.768+0000 7f812c608640 1 -- start start 2024-09-10T09:54:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.768+0000 7f812c608640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 0x7f81241013a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.769+0000 7f812c608640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81241018e0 con 0x7f8124100f90 2024-09-10T09:54:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.769+0000 7f812a3a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 0x7f81241013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.769+0000 7f812a3a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 0x7f81241013a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36572/0 (socket says 172.21.15.71:36572) 2024-09-10T09:54:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.769+0000 7f812a3a4640 1 -- 172.21.15.71:0/541612603 learned_addr learned my addr 172.21.15.71:0/541612603 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.769+0000 7f812a3a4640 1 -- 172.21.15.71:0/541612603 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8124101a20 con 0x7f8124100f90 2024-09-10T09:54:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.771+0000 7f812a3a4640 1 --2- 172.21.15.71:0/541612603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 0x7f81241013a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8120009840 tx=0x7f81200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456abb84aed04f9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.771+0000 7f81293a2640 1 -- 172.21.15.71:0/541612603 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8120032440 con 0x7f8124100f90 2024-09-10T09:54:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.771+0000 7f81293a2640 1 -- 172.21.15.71:0/541612603 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f8120032a00 con 0x7f8124100f90 2024-09-10T09:54:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.771+0000 7f81293a2640 1 -- 172.21.15.71:0/541612603 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8120031a10 con 0x7f8124100f90 2024-09-10T09:54:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.772+0000 7f812c608640 1 -- 172.21.15.71:0/541612603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 msgr2=0x7f81241013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.772+0000 7f812c608640 1 --2- 172.21.15.71:0/541612603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 0x7f81241013a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8120009840 tx=0x7f81200091d0 comp rx=0 tx=0).stop 2024-09-10T09:54:51.344 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.772+0000 7f812c608640 1 -- 172.21.15.71:0/541612603 shutdown_connections 2024-09-10T09:54:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.772+0000 7f812c608640 1 --2- 172.21.15.71:0/541612603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 0x7f81241013a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.772+0000 7f812c608640 1 -- 172.21.15.71:0/541612603 >> 172.21.15.71:0/541612603 conn(0x7f81240fc790 msgr2=0x7f81240feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.772+0000 7f812c608640 1 -- 172.21.15.71:0/541612603 shutdown_connections 2024-09-10T09:54:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.772+0000 7f812c608640 1 -- 172.21.15.71:0/541612603 wait complete. 2024-09-10T09:54:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.772+0000 7f812c608640 1 Processor -- start 2024-09-10T09:54:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.772+0000 7f812c608640 1 -- start start 2024-09-10T09:54:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.773+0000 7f812c608640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 0x7f812410eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.773+0000 7f812c608640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812410f060 con 0x7f8124100f90 2024-09-10T09:54:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.773+0000 7f812a3a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 0x7f812410eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.773+0000 7f812a3a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 0x7f812410eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36574/0 (socket says 172.21.15.71:36574) 2024-09-10T09:54:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.773+0000 7f812a3a4640 1 -- 172.21.15.71:0/1941174870 learned_addr learned my addr 172.21.15.71:0/1941174870 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.773+0000 7f812a3a4640 1 -- 172.21.15.71:0/1941174870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120009450 con 0x7f8124100f90 2024-09-10T09:54:51.345 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.773+0000 7f812a3a4640 1 --2- 172.21.15.71:0/1941174870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 0x7f812410eb20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f81200098a0 tx=0x7f812002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:51.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.773+0000 7f811affd640 1 -- 172.21.15.71:0/1941174870 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f81200327b0 con 0x7f8124100f90 2024-09-10T09:54:51.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.773+0000 7f811affd640 1 -- 172.21.15.71:0/1941174870 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f812003b870 con 0x7f8124100f90 2024-09-10T09:54:51.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.773+0000 7f812c608640 1 -- 172.21.15.71:0/1941174870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812410f260 con 0x7f8124100f90 2024-09-10T09:54:51.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.773+0000 7f811affd640 1 -- 172.21.15.71:0/1941174870 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f812003a550 con 0x7f8124100f90 2024-09-10T09:54:51.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.773+0000 7f812c608640 1 -- 172.21.15.71:0/1941174870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812410f6d0 con 0x7f8124100f90 2024-09-10T09:54:51.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.774+0000 7f811affd640 1 -- 172.21.15.71:0/1941174870 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8120039040 con 0x7f8124100f90 2024-09-10T09:54:51.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.774+0000 7f811affd640 1 -- 172.21.15.71:0/1941174870 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f81200447a0 con 0x7f8124100f90 2024-09-10T09:54:51.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.774+0000 7f812c608640 1 -- 172.21.15.71:0/1941174870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812404b720 con 0x7f8124100f90 2024-09-10T09:54:51.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.776+0000 7f811affd640 1 -- 172.21.15.71:0/1941174870 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f812410f6d0 con 0x7f8124100f90 2024-09-10T09:54:51.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.831+0000 7f812c608640 1 -- 172.21.15.71:0/1941174870 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f812410feb0 con 0x7f8124100f90 2024-09-10T09:54:51.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.837+0000 7f811affd640 1 -- 172.21.15.71:0/1941174870 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8120049060 con 0x7f8124100f90 2024-09-10T09:54:51.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.838+0000 7f812c608640 1 -- 172.21.15.71:0/1941174870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 msgr2=0x7f812410eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:51.346 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.838+0000 7f812c608640 1 --2- 172.21.15.71:0/1941174870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 0x7f812410eb20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f81200098a0 tx=0x7f812002c040 comp rx=0 tx=0).stop 2024-09-10T09:54:51.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.838+0000 7f812c608640 1 -- 172.21.15.71:0/1941174870 shutdown_connections 2024-09-10T09:54:51.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.838+0000 7f812c608640 1 --2- 172.21.15.71:0/1941174870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8124100f90 0x7f812410eb20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:51.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.838+0000 7f812c608640 1 -- 172.21.15.71:0/1941174870 >> 172.21.15.71:0/1941174870 conn(0x7f81240fc790 msgr2=0x7f81241053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:51.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.838+0000 7f812c608640 1 -- 172.21.15.71:0/1941174870 shutdown_connections 2024-09-10T09:54:51.347 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:50.838+0000 7f812c608640 1 -- 172.21.15.71:0/1941174870 wait complete. 2024-09-10T09:54:51.347 INFO:teuthology.orchestra.run.smithi071.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T09:54:51.347 INFO:teuthology.orchestra.run.smithi071.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T09:54:51.347 INFO:teuthology.orchestra.run.smithi071.stdout:Creating mgr... 2024-09-10T09:54:51.347 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T09:54:51.347 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T09:54:51.347 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-10T09:54:51.517 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mgr.smithi071.gtqytr 2024-09-10T09:54:51.517 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mgr.smithi071.gtqytr.service: Unit ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mgr.smithi071.gtqytr.service not loaded. 2024-09-10T09:54:51.672 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9dae8622-6f5a-11ef-bcea-c7b262605968.target.wants/ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mgr.smithi071.gtqytr.service → /etc/systemd/system/ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@.service. 2024-09-10T09:54:52.166 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:51 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1941174870' entity='client.admin' 2024-09-10T09:54:52.180 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T09:54:52.180 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout disabled 2024-09-10T09:54:52.188 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T09:54:52.188 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout inactive 2024-09-10T09:54:52.188 INFO:teuthology.orchestra.run.smithi071.stdout:firewalld.service is not enabled 2024-09-10T09:54:52.188 INFO:teuthology.orchestra.run.smithi071.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T09:54:52.197 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T09:54:52.198 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout disabled 2024-09-10T09:54:52.206 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T09:54:52.206 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout inactive 2024-09-10T09:54:52.206 INFO:teuthology.orchestra.run.smithi071.stdout:firewalld.service is not enabled 2024-09-10T09:54:52.206 INFO:teuthology.orchestra.run.smithi071.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-10T09:54:52.207 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for mgr to start... 2024-09-10T09:54:52.207 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for mgr... 2024-09-10T09:54:53.013 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:52 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1223081744' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T09:54:53.283 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-09-10T09:54:53.283 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:54:53.283 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsid": "9dae8622-6f5a-11ef-bcea-c7b262605968", 2024-09-10T09:54:53.283 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T09:54:53.283 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 0 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "smithi071" 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:54:53.284 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T09:54:53.285 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T09:54:53.286 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T09:54:45.673435+0000", 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:54:53.287 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.627+0000 7f6bf7909640 1 Processor -- start 2024-09-10T09:54:53.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.627+0000 7f6bf7909640 1 -- start start 2024-09-10T09:54:53.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.627+0000 7f6bf7909640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 0x7f6bf0104b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:53.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.627+0000 7f6bf7909640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf01050c0 con 0x7f6bf0076b70 2024-09-10T09:54:53.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.628+0000 7f6bf56a5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 0x7f6bf0104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:53.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.628+0000 7f6bf56a5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 0x7f6bf0104b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36598/0 (socket says 172.21.15.71:36598) 2024-09-10T09:54:53.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.628+0000 7f6bf56a5640 1 -- 172.21.15.71:0/1564852999 learned_addr learned my addr 172.21.15.71:0/1564852999 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:53.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.628+0000 7f6bf56a5640 1 -- 172.21.15.71:0/1564852999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf0105200 con 0x7f6bf0076b70 2024-09-10T09:54:53.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.629+0000 7f6bf56a5640 1 --2- 172.21.15.71:0/1564852999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 0x7f6bf0104b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009840 tx=0x7f6bec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcf9b06ee57c74e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:53.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.629+0000 7f6be7fff640 1 -- 172.21.15.71:0/1564852999 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bec032440 con 0x7f6bf0076b70 2024-09-10T09:54:53.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.629+0000 7f6be7fff640 1 -- 172.21.15.71:0/1564852999 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6bec032a00 con 0x7f6bf0076b70 2024-09-10T09:54:53.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.629+0000 7f6be7fff640 1 -- 172.21.15.71:0/1564852999 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bec031a10 con 0x7f6bf0076b70 2024-09-10T09:54:53.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.630+0000 7f6bf7909640 1 -- 172.21.15.71:0/1564852999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 msgr2=0x7f6bf0104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:53.288 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.630+0000 7f6bf7909640 1 --2- 172.21.15.71:0/1564852999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 0x7f6bf0104b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009840 tx=0x7f6bec0091d0 comp rx=0 tx=0).stop 2024-09-10T09:54:53.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.630+0000 7f6bf7909640 1 -- 172.21.15.71:0/1564852999 shutdown_connections 2024-09-10T09:54:53.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.630+0000 7f6bf7909640 1 --2- 172.21.15.71:0/1564852999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 0x7f6bf0104b80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:53.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.630+0000 7f6bf7909640 1 -- 172.21.15.71:0/1564852999 >> 172.21.15.71:0/1564852999 conn(0x7f6bf00fc6d0 msgr2=0x7f6bf00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:53.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.630+0000 7f6bf7909640 1 -- 172.21.15.71:0/1564852999 shutdown_connections 2024-09-10T09:54:53.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.630+0000 7f6bf7909640 1 -- 172.21.15.71:0/1564852999 wait complete. 2024-09-10T09:54:53.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.630+0000 7f6bf7909640 1 Processor -- start 2024-09-10T09:54:53.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.631+0000 7f6bf7909640 1 -- start start 2024-09-10T09:54:53.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.631+0000 7f6bf7909640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 0x7f6bf0110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:53.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.631+0000 7f6bf7909640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0111340 con 0x7f6bf0076b70 2024-09-10T09:54:53.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.631+0000 7f6bf56a5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 0x7f6bf0110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:53.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.631+0000 7f6bf56a5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 0x7f6bf0110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36600/0 (socket says 172.21.15.71:36600) 2024-09-10T09:54:53.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.631+0000 7f6bf56a5640 1 -- 172.21.15.71:0/1223081744 learned_addr learned my addr 172.21.15.71:0/1223081744 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:53.289 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.631+0000 7f6bf56a5640 1 -- 172.21.15.71:0/1223081744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec009450 con 0x7f6bf0076b70 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.631+0000 7f6bf56a5640 1 --2- 172.21.15.71:0/1223081744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 0x7f6bf0110e00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0098a0 tx=0x7f6bec02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.631+0000 7f6be5ffb640 1 -- 172.21.15.71:0/1223081744 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bec0327b0 con 0x7f6bf0076b70 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.632+0000 7f6be5ffb640 1 -- 172.21.15.71:0/1223081744 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6bec03b870 con 0x7f6bf0076b70 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.632+0000 7f6bf7909640 1 -- 172.21.15.71:0/1223081744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf0111540 con 0x7f6bf0076b70 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.632+0000 7f6be5ffb640 1 -- 172.21.15.71:0/1223081744 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bec03a550 con 0x7f6bf0076b70 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.632+0000 7f6bf7909640 1 -- 172.21.15.71:0/1223081744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf0111f90 con 0x7f6bf0076b70 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.632+0000 7f6be5ffb640 1 -- 172.21.15.71:0/1223081744 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6bec039040 con 0x7f6bf0076b70 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.632+0000 7f6be5ffb640 1 -- 172.21.15.71:0/1223081744 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6bec0447e0 con 0x7f6bf0076b70 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.633+0000 7f6bf7909640 1 -- 172.21.15.71:0/1223081744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf01002f0 con 0x7f6bf0076b70 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.635+0000 7f6be5ffb640 1 -- 172.21.15.71:0/1223081744 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f6bec049060 con 0x7f6bf0076b70 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.694+0000 7f6bf7909640 1 -- 172.21.15.71:0/1223081744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6bf0105ec0 con 0x7f6bf0076b70 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.694+0000 7f6be5ffb640 1 -- 172.21.15.71:0/1223081744 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f6bec03f070 con 0x7f6bf0076b70 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.695+0000 7f6bf7909640 1 -- 172.21.15.71:0/1223081744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 msgr2=0x7f6bf0110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.695+0000 7f6bf7909640 1 --2- 172.21.15.71:0/1223081744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 0x7f6bf0110e00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0098a0 tx=0x7f6bec02c040 comp rx=0 tx=0).stop 2024-09-10T09:54:53.290 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.695+0000 7f6bf7909640 1 -- 172.21.15.71:0/1223081744 shutdown_connections 2024-09-10T09:54:53.291 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.695+0000 7f6bf7909640 1 --2- 172.21.15.71:0/1223081744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf0076b70 0x7f6bf0110e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:53.291 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.695+0000 7f6bf7909640 1 -- 172.21.15.71:0/1223081744 >> 172.21.15.71:0/1223081744 conn(0x7f6bf00fc6d0 msgr2=0x7f6bf00fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:53.291 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.695+0000 7f6bf7909640 1 -- 172.21.15.71:0/1223081744 shutdown_connections 2024-09-10T09:54:53.291 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:52.695+0000 7f6bf7909640 1 -- 172.21.15.71:0/1223081744 wait complete. 2024-09-10T09:54:53.291 INFO:teuthology.orchestra.run.smithi071.stdout:mgr not available, waiting (1/15)... 2024-09-10T09:54:56.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:55 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/166126808' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T09:54:56.383 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-09-10T09:54:56.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:54:56.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsid": "9dae8622-6f5a-11ef-bcea-c7b262605968", 2024-09-10T09:54:56.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T09:54:56.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T09:54:56.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T09:54:56.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T09:54:56.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:56.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T09:54:56.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T09:54:56.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 0 2024-09-10T09:54:56.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:54:56.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T09:54:56.384 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "smithi071" 2024-09-10T09:54:56.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:54:56.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-10T09:54:56.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T09:54:56.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:54:56.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-10T09:54:56.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T09:54:56.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:56.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T09:54:56.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:54:56.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T09:54:56.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T09:54:56.385 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T09:54:56.393 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T09:54:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:54:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T09:54:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T09:54:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T09:54:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T09:54:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T09:54:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T09:54:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T09:54:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T09:54:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T09:54:56.394 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T09:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T09:54:45.673435+0000", 2024-09-10T09:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T09:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.714+0000 7fad93765640 1 Processor -- start 2024-09-10T09:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.714+0000 7fad93765640 1 -- start start 2024-09-10T09:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.714+0000 7fad93765640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 0x7fad8c106f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:56.395 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.714+0000 7fad93765640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c076e70 con 0x7fad8c076a60 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.715+0000 7fad91501640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 0x7fad8c106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.715+0000 7fad91501640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 0x7fad8c106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40968/0 (socket says 172.21.15.71:40968) 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.715+0000 7fad91501640 1 -- 172.21.15.71:0/1377056488 learned_addr learned my addr 172.21.15.71:0/1377056488 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.715+0000 7fad91501640 1 -- 172.21.15.71:0/1377056488 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c1074c0 con 0x7fad8c076a60 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.716+0000 7fad91501640 1 --2- 172.21.15.71:0/1377056488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 0x7fad8c106f80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fad88009840 tx=0x7fad880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee330998f8bf063 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.716+0000 7fad83fff640 1 -- 172.21.15.71:0/1377056488 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad88032440 con 0x7fad8c076a60 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.716+0000 7fad83fff640 1 -- 172.21.15.71:0/1377056488 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fad88032a00 con 0x7fad8c076a60 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.716+0000 7fad83fff640 1 -- 172.21.15.71:0/1377056488 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad88031a10 con 0x7fad8c076a60 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.717+0000 7fad93765640 1 -- 172.21.15.71:0/1377056488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 msgr2=0x7fad8c106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.717+0000 7fad93765640 1 --2- 172.21.15.71:0/1377056488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 0x7fad8c106f80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fad88009840 tx=0x7fad880091d0 comp rx=0 tx=0).stop 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.717+0000 7fad93765640 1 -- 172.21.15.71:0/1377056488 shutdown_connections 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.717+0000 7fad93765640 1 --2- 172.21.15.71:0/1377056488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 0x7fad8c106f80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.717+0000 7fad93765640 1 -- 172.21.15.71:0/1377056488 >> 172.21.15.71:0/1377056488 conn(0x7fad8c0fc6d0 msgr2=0x7fad8c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:56.396 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.717+0000 7fad93765640 1 -- 172.21.15.71:0/1377056488 shutdown_connections 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.717+0000 7fad93765640 1 -- 172.21.15.71:0/1377056488 wait complete. 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.717+0000 7fad93765640 1 Processor -- start 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.717+0000 7fad93765640 1 -- start start 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.718+0000 7fad93765640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 0x7fad8c112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.718+0000 7fad93765640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c1134a0 con 0x7fad8c076a60 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.718+0000 7fad91501640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 0x7fad8c112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.718+0000 7fad91501640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 0x7fad8c112f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40978/0 (socket says 172.21.15.71:40978) 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.718+0000 7fad91501640 1 -- 172.21.15.71:0/166126808 learned_addr learned my addr 172.21.15.71:0/166126808 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.718+0000 7fad91501640 1 -- 172.21.15.71:0/166126808 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88009450 con 0x7fad8c076a60 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.718+0000 7fad91501640 1 --2- 172.21.15.71:0/166126808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 0x7fad8c112f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fad880098a0 tx=0x7fad8802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.718+0000 7fad81ffb640 1 -- 172.21.15.71:0/166126808 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad880327b0 con 0x7fad8c076a60 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.718+0000 7fad81ffb640 1 -- 172.21.15.71:0/166126808 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fad8803b870 con 0x7fad8c076a60 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.718+0000 7fad93765640 1 -- 172.21.15.71:0/166126808 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8c1136a0 con 0x7fad8c076a60 2024-09-10T09:54:56.397 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.718+0000 7fad81ffb640 1 -- 172.21.15.71:0/166126808 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad8803a550 con 0x7fad8c076a60 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.719+0000 7fad93765640 1 -- 172.21.15.71:0/166126808 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8c113b10 con 0x7fad8c076a60 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.719+0000 7fad81ffb640 1 -- 172.21.15.71:0/166126808 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fad88039040 con 0x7fad8c076a60 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.719+0000 7fad81ffb640 1 -- 172.21.15.71:0/166126808 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fad88044830 con 0x7fad8c076a60 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.720+0000 7fad93765640 1 -- 172.21.15.71:0/166126808 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8c04b720 con 0x7fad8c076a60 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.722+0000 7fad81ffb640 1 -- 172.21.15.71:0/166126808 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fad8c113b10 con 0x7fad8c076a60 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.780+0000 7fad93765640 1 -- 172.21.15.71:0/166126808 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fad8c1080d0 con 0x7fad8c076a60 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.780+0000 7fad81ffb640 1 -- 172.21.15.71:0/166126808 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fad88049060 con 0x7fad8c076a60 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.782+0000 7fad93765640 1 -- 172.21.15.71:0/166126808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 msgr2=0x7fad8c112f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.782+0000 7fad93765640 1 --2- 172.21.15.71:0/166126808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 0x7fad8c112f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fad880098a0 tx=0x7fad8802c040 comp rx=0 tx=0).stop 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.782+0000 7fad93765640 1 -- 172.21.15.71:0/166126808 shutdown_connections 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.782+0000 7fad93765640 1 --2- 172.21.15.71:0/166126808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad8c076a60 0x7fad8c112f60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.782+0000 7fad93765640 1 -- 172.21.15.71:0/166126808 >> 172.21.15.71:0/166126808 conn(0x7fad8c0fc6d0 msgr2=0x7fad8c0fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.782+0000 7fad93765640 1 -- 172.21.15.71:0/166126808 shutdown_connections 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:55.782+0000 7fad93765640 1 -- 172.21.15.71:0/166126808 wait complete. 2024-09-10T09:54:56.398 INFO:teuthology.orchestra.run.smithi071.stdout:mgr not available, waiting (2/15)... 2024-09-10T09:54:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:56 smithi071 ceph-mon[27559]: Activating manager daemon smithi071.gtqytr 2024-09-10T09:54:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:56 smithi071 ceph-mon[27559]: mgrmap e2: smithi071.gtqytr(active, starting, since 0.0031452s) 2024-09-10T09:54:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:56 smithi071 ceph-mon[27559]: from='mgr.14100 172.21.15.71:0/4251419165' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:54:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:56 smithi071 ceph-mon[27559]: from='mgr.14100 172.21.15.71:0/4251419165' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:54:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:56 smithi071 ceph-mon[27559]: from='mgr.14100 172.21.15.71:0/4251419165' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:54:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:56 smithi071 ceph-mon[27559]: from='mgr.14100 172.21.15.71:0/4251419165' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T09:54:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:56 smithi071 ceph-mon[27559]: from='mgr.14100 172.21.15.71:0/4251419165' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr metadata", "who": "smithi071.gtqytr", "id": "smithi071.gtqytr"}]: dispatch 2024-09-10T09:54:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:56 smithi071 ceph-mon[27559]: Manager daemon smithi071.gtqytr is now available 2024-09-10T09:54:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:56 smithi071 ceph-mon[27559]: from='mgr.14100 172.21.15.71:0/4251419165' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:54:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:56 smithi071 ceph-mon[27559]: from='mgr.14100 172.21.15.71:0/4251419165' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/trash_purge_schedule"}]: dispatch 2024-09-10T09:54:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:56 smithi071 ceph-mon[27559]: from='mgr.14100 172.21.15.71:0/4251419165' entity='mgr.smithi071.gtqytr' 2024-09-10T09:54:57.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:56 smithi071 ceph-mon[27559]: from='mgr.14100 172.21.15.71:0/4251419165' entity='mgr.smithi071.gtqytr' 2024-09-10T09:54:57.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:56 smithi071 ceph-mon[27559]: from='mgr.14100 172.21.15.71:0/4251419165' entity='mgr.smithi071.gtqytr' 2024-09-10T09:54:58.731 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:58 smithi071 ceph-mon[27559]: mgrmap e3: smithi071.gtqytr(active, since 1.00716s) 2024-09-10T09:54:59.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-09-10T09:54:59.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:54:59.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsid": "9dae8622-6f5a-11ef-bcea-c7b262605968", 2024-09-10T09:54:59.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T09:54:59.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T09:54:59.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T09:54:59.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T09:54:59.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:59.573 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 0 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "smithi071" 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T09:54:59.574 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:54:59.575 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T09:54:59.575 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T09:54:59.575 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T09:54:59.583 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T09:54:59.583 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T09:54:59.583 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T09:54:59.583 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:59.583 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T09:54:59.583 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T09:54:59.583 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T09:54:59.583 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T09:54:59.583 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T09:54:59.583 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T09:54:59.583 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T09:54:59.584 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T09:54:59.584 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T09:54:59.584 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:59.584 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T09:54:59.584 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:54:59.584 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T09:54:59.584 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T09:54:59.584 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:59.584 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T09:54:59.584 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T09:54:59.584 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T09:54:59.584 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T09:54:45.673435+0000", 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:54:59.585 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.810+0000 7f9cabdcb640 1 Processor -- start 2024-09-10T09:54:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.810+0000 7f9cabdcb640 1 -- start start 2024-09-10T09:54:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.810+0000 7f9cabdcb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 0x7f9ca4107100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.810+0000 7f9cabdcb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca4102af0 con 0x7f9ca4076a70 2024-09-10T09:54:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.811+0000 7f9ca9b67640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 0x7f9ca4107100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.811+0000 7f9ca9b67640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 0x7f9ca4107100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41052/0 (socket says 172.21.15.71:41052) 2024-09-10T09:54:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.811+0000 7f9ca9b67640 1 -- 172.21.15.71:0/834652364 learned_addr learned my addr 172.21.15.71:0/834652364 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.811+0000 7f9ca9b67640 1 -- 172.21.15.71:0/834652364 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4076e80 con 0x7f9ca4076a70 2024-09-10T09:54:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.812+0000 7f9ca9b67640 1 --2- 172.21.15.71:0/834652364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 0x7f9ca4107100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009e50 tx=0x7f9ca0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2b1ad9a93724ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.812+0000 7f9ca8b65640 1 -- 172.21.15.71:0/834652364 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ca0031560 con 0x7f9ca4076a70 2024-09-10T09:54:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.812+0000 7f9ca8b65640 1 -- 172.21.15.71:0/834652364 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9ca002d050 con 0x7f9ca4076a70 2024-09-10T09:54:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.812+0000 7f9ca8b65640 1 -- 172.21.15.71:0/834652364 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ca00079b0 con 0x7f9ca4076a70 2024-09-10T09:54:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.813+0000 7f9cabdcb640 1 -- 172.21.15.71:0/834652364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 msgr2=0x7f9ca4107100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:59.586 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.813+0000 7f9cabdcb640 1 --2- 172.21.15.71:0/834652364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 0x7f9ca4107100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009e50 tx=0x7f9ca0009840 comp rx=0 tx=0).stop 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.813+0000 7f9cabdcb640 1 -- 172.21.15.71:0/834652364 shutdown_connections 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.813+0000 7f9cabdcb640 1 --2- 172.21.15.71:0/834652364 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 0x7f9ca4107100 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.813+0000 7f9cabdcb640 1 -- 172.21.15.71:0/834652364 >> 172.21.15.71:0/834652364 conn(0x7f9ca40fc790 msgr2=0x7f9ca40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.813+0000 7f9cabdcb640 1 -- 172.21.15.71:0/834652364 shutdown_connections 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.813+0000 7f9cabdcb640 1 -- 172.21.15.71:0/834652364 wait complete. 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.813+0000 7f9cabdcb640 1 Processor -- start 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.813+0000 7f9cabdcb640 1 -- start start 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.814+0000 7f9cabdcb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 0x7f9ca4112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.814+0000 7f9cabdcb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca41134a0 con 0x7f9ca4076a70 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.814+0000 7f9ca9b67640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 0x7f9ca4112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.814+0000 7f9ca9b67640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 0x7f9ca4112f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41054/0 (socket says 172.21.15.71:41054) 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.814+0000 7f9ca9b67640 1 -- 172.21.15.71:0/1953899834 learned_addr learned my addr 172.21.15.71:0/1953899834 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.814+0000 7f9ca9b67640 1 -- 172.21.15.71:0/1953899834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca0009ae0 con 0x7f9ca4076a70 2024-09-10T09:54:59.587 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.814+0000 7f9ca9b67640 1 --2- 172.21.15.71:0/1953899834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 0x7f9ca4112f60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009eb0 tx=0x7f9ca0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.814+0000 7f9c9a7fc640 1 -- 172.21.15.71:0/1953899834 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ca003a400 con 0x7f9ca4076a70 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.814+0000 7f9c9a7fc640 1 -- 172.21.15.71:0/1953899834 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9ca003a9c0 con 0x7f9ca4076a70 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.814+0000 7f9cabdcb640 1 -- 172.21.15.71:0/1953899834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca41136a0 con 0x7f9ca4076a70 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.814+0000 7f9c9a7fc640 1 -- 172.21.15.71:0/1953899834 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ca00447e0 con 0x7f9ca4076a70 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.815+0000 7f9cabdcb640 1 -- 172.21.15.71:0/1953899834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca4113b10 con 0x7f9ca4076a70 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.815+0000 7f9c9a7fc640 1 -- 172.21.15.71:0/1953899834 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f9ca0038040 con 0x7f9ca4076a70 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.815+0000 7f9c9a7fc640 1 --2- 172.21.15.71:0/1953899834 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f9c90039450 0x7f9c9003b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.816+0000 7f9c9a7fc640 1 -- 172.21.15.71:0/1953899834 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9ca0040030 con 0x7f9ca4076a70 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.816+0000 7f9ca9366640 1 --2- 172.21.15.71:0/1953899834 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f9c90039450 0x7f9c9003b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.816+0000 7f9cabdcb640 1 -- 172.21.15.71:0/1953899834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca41003f0 con 0x7f9ca4076a70 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.816+0000 7f9ca9366640 1 --2- 172.21.15.71:0/1953899834 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f9c90039450 0x7f9c9003b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9c94006fd0 tx=0x7f9c94006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:58.821+0000 7f9c9a7fc640 1 -- 172.21.15.71:0/1953899834 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9ca0036070 con 0x7f9ca4076a70 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.030+0000 7f9cabdcb640 1 -- 172.21.15.71:0/1953899834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9ca404b720 con 0x7f9ca4076a70 2024-09-10T09:54:59.588 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.031+0000 7f9c9a7fc640 1 -- 172.21.15.71:0/1953899834 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7f9ca0042ad0 con 0x7f9ca4076a70 2024-09-10T09:54:59.589 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.033+0000 7f9cabdcb640 1 -- 172.21.15.71:0/1953899834 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f9c90039450 msgr2=0x7f9c9003b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:59.589 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.033+0000 7f9cabdcb640 1 --2- 172.21.15.71:0/1953899834 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f9c90039450 0x7f9c9003b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9c94006fd0 tx=0x7f9c94006db0 comp rx=0 tx=0).stop 2024-09-10T09:54:59.589 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.033+0000 7f9cabdcb640 1 -- 172.21.15.71:0/1953899834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 msgr2=0x7f9ca4112f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:54:59.589 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.033+0000 7f9cabdcb640 1 --2- 172.21.15.71:0/1953899834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 0x7f9ca4112f60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009eb0 tx=0x7f9ca0009840 comp rx=0 tx=0).stop 2024-09-10T09:54:59.589 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.033+0000 7f9cabdcb640 1 -- 172.21.15.71:0/1953899834 shutdown_connections 2024-09-10T09:54:59.589 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.033+0000 7f9cabdcb640 1 --2- 172.21.15.71:0/1953899834 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f9c90039450 0x7f9c9003b900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:59.589 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.033+0000 7f9cabdcb640 1 --2- 172.21.15.71:0/1953899834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca4076a70 0x7f9ca4112f60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:54:59.589 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.033+0000 7f9cabdcb640 1 -- 172.21.15.71:0/1953899834 >> 172.21.15.71:0/1953899834 conn(0x7f9ca40fc790 msgr2=0x7f9ca40fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:54:59.589 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.033+0000 7f9cabdcb640 1 -- 172.21.15.71:0/1953899834 shutdown_connections 2024-09-10T09:54:59.589 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.033+0000 7f9cabdcb640 1 -- 172.21.15.71:0/1953899834 wait complete. 2024-09-10T09:54:59.589 INFO:teuthology.orchestra.run.smithi071.stdout:mgr is available 2024-09-10T09:54:59.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:59 smithi071 ceph-mon[27559]: mgrmap e4: smithi071.gtqytr(active, since 2s) 2024-09-10T09:54:59.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:54:59 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1953899834' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T09:55:00.649 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-09-10T09:55:00.649 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T09:55:00.649 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout fsid = 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:55:00.649 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T09:55:00.649 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T09:55:00.649 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T09:55:00.649 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T09:55:00.649 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T09:55:00.649 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-09-10T09:55:00.649 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T09:55:00.649 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T09:55:00.649 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 2024-09-10T09:55:00.650 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T09:55:00.650 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T09:55:00.650 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T09:55:00.650 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T09:55:00.650 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T09:55:00.650 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T09:55:00.650 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.950+0000 7f6448d04640 1 Processor -- start 2024-09-10T09:55:00.650 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.951+0000 7f6448d04640 1 -- start start 2024-09-10T09:55:00.650 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.951+0000 7f6448d04640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 0x7f6444077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:00.650 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.951+0000 7f6448d04640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6444078f60 con 0x7f6444078b50 2024-09-10T09:55:00.650 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.951+0000 7f644259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 0x7f6444077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:00.650 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.951+0000 7f644259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 0x7f6444077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41062/0 (socket says 172.21.15.71:41062) 2024-09-10T09:55:00.651 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.951+0000 7f644259c640 1 -- 172.21.15.71:0/3887393241 learned_addr learned my addr 172.21.15.71:0/3887393241 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:00.651 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.951+0000 7f644259c640 1 -- 172.21.15.71:0/3887393241 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64440790a0 con 0x7f6444078b50 2024-09-10T09:55:00.651 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.952+0000 7f644259c640 1 --2- 172.21.15.71:0/3887393241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 0x7f6444077210 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6434009840 tx=0x7f64340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bc645dcdd6fbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:00.651 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.952+0000 7f644159a640 1 -- 172.21.15.71:0/3887393241 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6434032440 con 0x7f6444078b50 2024-09-10T09:55:00.651 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.952+0000 7f644159a640 1 -- 172.21.15.71:0/3887393241 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6434032a00 con 0x7f6444078b50 2024-09-10T09:55:00.651 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.952+0000 7f644159a640 1 -- 172.21.15.71:0/3887393241 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6434031a10 con 0x7f6444078b50 2024-09-10T09:55:00.651 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.953+0000 7f6448d04640 1 -- 172.21.15.71:0/3887393241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 msgr2=0x7f6444077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:00.651 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.953+0000 7f6448d04640 1 --2- 172.21.15.71:0/3887393241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 0x7f6444077210 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6434009840 tx=0x7f64340091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:00.651 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.953+0000 7f6448d04640 1 -- 172.21.15.71:0/3887393241 shutdown_connections 2024-09-10T09:55:00.651 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.953+0000 7f6448d04640 1 --2- 172.21.15.71:0/3887393241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 0x7f6444077210 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:00.651 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.953+0000 7f6448d04640 1 -- 172.21.15.71:0/3887393241 >> 172.21.15.71:0/3887393241 conn(0x7f64440fd850 msgr2=0x7f64440ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.953+0000 7f6448d04640 1 -- 172.21.15.71:0/3887393241 shutdown_connections 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.953+0000 7f6448d04640 1 -- 172.21.15.71:0/3887393241 wait complete. 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.953+0000 7f6448d04640 1 Processor -- start 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.954+0000 7f6448d04640 1 -- start start 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.954+0000 7f6448d04640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 0x7f6444112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.954+0000 7f6448d04640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64441134a0 con 0x7f6444078b50 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.954+0000 7f644259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 0x7f6444112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.954+0000 7f644259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 0x7f6444112f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41070/0 (socket says 172.21.15.71:41070) 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.954+0000 7f644259c640 1 -- 172.21.15.71:0/2834156315 learned_addr learned my addr 172.21.15.71:0/2834156315 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.954+0000 7f644259c640 1 -- 172.21.15.71:0/2834156315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6434009450 con 0x7f6444078b50 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.954+0000 7f644259c640 1 --2- 172.21.15.71:0/2834156315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 0x7f6444112f60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f64340329d0 tx=0x7f643402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.954+0000 7f6432ffd640 1 -- 172.21.15.71:0/2834156315 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6434031d10 con 0x7f6444078b50 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.954+0000 7f6432ffd640 1 -- 172.21.15.71:0/2834156315 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6434031e70 con 0x7f6444078b50 2024-09-10T09:55:00.652 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.954+0000 7f6448d04640 1 -- 172.21.15.71:0/2834156315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64441136a0 con 0x7f6444078b50 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.954+0000 7f6432ffd640 1 -- 172.21.15.71:0/2834156315 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f643403b670 con 0x7f6444078b50 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.954+0000 7f6448d04640 1 -- 172.21.15.71:0/2834156315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6444113b10 con 0x7f6444078b50 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.955+0000 7f6432ffd640 1 -- 172.21.15.71:0/2834156315 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f6434039070 con 0x7f6444078b50 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.955+0000 7f6448d04640 1 -- 172.21.15.71:0/2834156315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644404b720 con 0x7f6444078b50 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.955+0000 7f6432ffd640 1 --2- 172.21.15.71:0/2834156315 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f642c039450 0x7f642c03b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.956+0000 7f6432ffd640 1 -- 172.21.15.71:0/2834156315 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f643406cb70 con 0x7f6444078b50 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.956+0000 7f6441d9b640 1 --2- 172.21.15.71:0/2834156315 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f642c039450 0x7f642c03b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.956+0000 7f6441d9b640 1 --2- 172.21.15.71:0/2834156315 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f642c039450 0x7f642c03b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6438006fd0 tx=0x7f6438006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:54:59.960+0000 7f6432ffd640 1 -- 172.21.15.71:0/2834156315 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f643403db20 con 0x7f6444078b50 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:00.116+0000 7f6448d04640 1 -- 172.21.15.71:0/2834156315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6444114470 con 0x7f6444078b50 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:00.117+0000 7f6432ffd640 1 -- 172.21.15.71:0/2834156315 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7f6434041030 con 0x7f6444078b50 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:00.119+0000 7f6448d04640 1 -- 172.21.15.71:0/2834156315 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f642c039450 msgr2=0x7f642c03b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:00.119+0000 7f6448d04640 1 --2- 172.21.15.71:0/2834156315 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f642c039450 0x7f642c03b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6438006fd0 tx=0x7f6438006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:00.653 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:00.119+0000 7f6448d04640 1 -- 172.21.15.71:0/2834156315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 msgr2=0x7f6444112f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:00.654 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:00.119+0000 7f6448d04640 1 --2- 172.21.15.71:0/2834156315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 0x7f6444112f60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f64340329d0 tx=0x7f643402c040 comp rx=0 tx=0).stop 2024-09-10T09:55:00.654 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:00.119+0000 7f6448d04640 1 -- 172.21.15.71:0/2834156315 shutdown_connections 2024-09-10T09:55:00.654 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:00.119+0000 7f6448d04640 1 --2- 172.21.15.71:0/2834156315 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f642c039450 0x7f642c03b900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:00.654 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:00.119+0000 7f6448d04640 1 --2- 172.21.15.71:0/2834156315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6444078b50 0x7f6444112f60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:00.654 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:00.119+0000 7f6448d04640 1 -- 172.21.15.71:0/2834156315 >> 172.21.15.71:0/2834156315 conn(0x7f64440fd850 msgr2=0x7f64440fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:00.654 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:00.119+0000 7f6448d04640 1 -- 172.21.15.71:0/2834156315 shutdown_connections 2024-09-10T09:55:00.654 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:00.119+0000 7f6448d04640 1 -- 172.21.15.71:0/2834156315 wait complete. 2024-09-10T09:55:00.654 INFO:teuthology.orchestra.run.smithi071.stdout:Enabling cephadm module... 2024-09-10T09:55:00.749 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:00 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/2834156315' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T09:55:01.723 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:01 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1402437617' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-10T09:55:02.046 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.000+0000 7fa006b08640 1 Processor -- start 2024-09-10T09:55:02.046 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.001+0000 7fa006b08640 1 -- start start 2024-09-10T09:55:02.046 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.001+0000 7fa006b08640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 0x7fa000102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:02.046 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.001+0000 7fa006b08640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0001029c0 con 0x7fa000102070 2024-09-10T09:55:02.046 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.001+0000 7fa0048a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 0x7fa000102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:02.046 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.001+0000 7fa0048a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 0x7fa000102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41084/0 (socket says 172.21.15.71:41084) 2024-09-10T09:55:02.046 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.001+0000 7fa0048a4640 1 -- 172.21.15.71:0/1549647899 learned_addr learned my addr 172.21.15.71:0/1549647899 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:02.046 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.001+0000 7fa0048a4640 1 -- 172.21.15.71:0/1549647899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa000102b00 con 0x7fa000102070 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.002+0000 7fa0048a4640 1 --2- 172.21.15.71:0/1549647899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 0x7fa000102480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009840 tx=0x7f9ff40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a73a62933a64b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.002+0000 7f9fff7fe640 1 -- 172.21.15.71:0/1549647899 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ff4032440 con 0x7fa000102070 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.002+0000 7f9fff7fe640 1 -- 172.21.15.71:0/1549647899 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9ff4032a00 con 0x7fa000102070 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.002+0000 7f9fff7fe640 1 -- 172.21.15.71:0/1549647899 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ff4031a10 con 0x7fa000102070 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.003+0000 7fa006b08640 1 -- 172.21.15.71:0/1549647899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 msgr2=0x7fa000102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.003+0000 7fa006b08640 1 --2- 172.21.15.71:0/1549647899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 0x7fa000102480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009840 tx=0x7f9ff40091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.003+0000 7fa006b08640 1 -- 172.21.15.71:0/1549647899 shutdown_connections 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.003+0000 7fa006b08640 1 --2- 172.21.15.71:0/1549647899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 0x7fa000102480 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.003+0000 7fa006b08640 1 -- 172.21.15.71:0/1549647899 >> 172.21.15.71:0/1549647899 conn(0x7fa0000fd850 msgr2=0x7fa0000ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.003+0000 7fa006b08640 1 -- 172.21.15.71:0/1549647899 shutdown_connections 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.003+0000 7fa006b08640 1 -- 172.21.15.71:0/1549647899 wait complete. 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.003+0000 7fa006b08640 1 Processor -- start 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.003+0000 7fa006b08640 1 -- start start 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.003+0000 7fa006b08640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 0x7fa000110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.003+0000 7fa006b08640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa000111310 con 0x7fa000102070 2024-09-10T09:55:02.047 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.004+0000 7fa0048a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 0x7fa000110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.004+0000 7fa0048a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 0x7fa000110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41092/0 (socket says 172.21.15.71:41092) 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.004+0000 7fa0048a4640 1 -- 172.21.15.71:0/1402437617 learned_addr learned my addr 172.21.15.71:0/1402437617 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.004+0000 7fa0048a4640 1 -- 172.21.15.71:0/1402437617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4009450 con 0x7fa000102070 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.004+0000 7fa0048a4640 1 --2- 172.21.15.71:0/1402437617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 0x7fa000110dd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40098a0 tx=0x7f9ff402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.004+0000 7f9ffd7fa640 1 -- 172.21.15.71:0/1402437617 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ff40327b0 con 0x7fa000102070 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.004+0000 7f9ffd7fa640 1 -- 172.21.15.71:0/1402437617 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9ff403b870 con 0x7fa000102070 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.004+0000 7fa006b08640 1 -- 172.21.15.71:0/1402437617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa000111510 con 0x7fa000102070 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.004+0000 7f9ffd7fa640 1 -- 172.21.15.71:0/1402437617 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ff403a550 con 0x7fa000102070 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.004+0000 7fa006b08640 1 -- 172.21.15.71:0/1402437617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa000111f60 con 0x7fa000102070 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.005+0000 7f9ffd7fa640 1 -- 172.21.15.71:0/1402437617 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f9ff4039040 con 0x7fa000102070 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.005+0000 7f9ffd7fa640 1 --2- 172.21.15.71:0/1402437617 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f9ff0039450 0x7f9ff003b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.005+0000 7fa006b08640 1 -- 172.21.15.71:0/1402437617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0001014d0 con 0x7fa000102070 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.005+0000 7f9ffd7fa640 1 -- 172.21.15.71:0/1402437617 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9ff406c860 con 0x7fa000102070 2024-09-10T09:55:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.005+0000 7f9ffffff640 1 --2- 172.21.15.71:0/1402437617 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f9ff0039450 0x7f9ff003b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.006+0000 7f9ffffff640 1 --2- 172.21.15.71:0/1402437617 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f9ff0039450 0x7f9ff003b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9fec006fd0 tx=0x7f9fec006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.009+0000 7f9ffd7fa640 1 -- 172.21.15.71:0/1402437617 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9ff403f020 con 0x7fa000102070 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.203+0000 7fa006b08640 1 -- 172.21.15.71:0/1402437617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fa00004b720 con 0x7fa000102070 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.472+0000 7f9ffd7fa640 1 -- 172.21.15.71:0/1402437617 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f9ff406a090 con 0x7fa000102070 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.473+0000 7f9ffd7fa640 1 -- 172.21.15.71:0/1402437617 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f9ff4030340 con 0x7fa000102070 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.475+0000 7fa006b08640 1 -- 172.21.15.71:0/1402437617 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f9ff0039450 msgr2=0x7f9ff003b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.475+0000 7fa006b08640 1 --2- 172.21.15.71:0/1402437617 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f9ff0039450 0x7f9ff003b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9fec006fd0 tx=0x7f9fec006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.475+0000 7fa006b08640 1 -- 172.21.15.71:0/1402437617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 msgr2=0x7fa000110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.475+0000 7fa006b08640 1 --2- 172.21.15.71:0/1402437617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 0x7fa000110dd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40098a0 tx=0x7f9ff402c040 comp rx=0 tx=0).stop 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.475+0000 7fa006b08640 1 -- 172.21.15.71:0/1402437617 shutdown_connections 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.475+0000 7fa006b08640 1 --2- 172.21.15.71:0/1402437617 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f9ff0039450 0x7f9ff003b900 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.475+0000 7fa006b08640 1 --2- 172.21.15.71:0/1402437617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa000102070 0x7fa000110dd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.475+0000 7fa006b08640 1 -- 172.21.15.71:0/1402437617 >> 172.21.15.71:0/1402437617 conn(0x7fa0000fd850 msgr2=0x7fa0000fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:02.049 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.475+0000 7fa006b08640 1 -- 172.21.15.71:0/1402437617 shutdown_connections 2024-09-10T09:55:02.050 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:01.475+0000 7fa006b08640 1 -- 172.21.15.71:0/1402437617 wait complete. 2024-09-10T09:55:02.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:02 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1402437617' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T09:55:02.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:02 smithi071 ceph-mon[27559]: mgrmap e5: smithi071.gtqytr(active, since 5s) 2024-09-10T09:55:03.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:03 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1191836708' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T09:55:06.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: Active manager daemon smithi071.gtqytr restarted 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: Activating manager daemon smithi071.gtqytr 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: mgrmap e6: smithi071.gtqytr(active, starting, since 0.00533196s) 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr metadata", "who": "smithi071.gtqytr", "id": "smithi071.gtqytr"}]: dispatch 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: Manager daemon smithi071.gtqytr is now available 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:55:06.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:55:06.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:05 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/trash_purge_schedule"}]: dispatch 2024-09-10T09:55:07.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:06 smithi071 ceph-mon[27559]: Found migration_current of "None". Setting to last migration. 2024-09-10T09:55:07.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:06 smithi071 ceph-mon[27559]: mgrmap e7: smithi071.gtqytr(active, since 1.00552s) 2024-09-10T09:55:08.317 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:55:08.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T09:55:08.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T09:55:08.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "active_name": "smithi071.gtqytr", 2024-09-10T09:55:08.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T09:55:08.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:55:08.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.455+0000 7f5244327640 1 Processor -- start 2024-09-10T09:55:08.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.456+0000 7f5244327640 1 -- start start 2024-09-10T09:55:08.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.456+0000 7f5244327640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 0x7f523c104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:08.323 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.456+0000 7f5244327640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c076f20 con 0x7f523c076b10 2024-09-10T09:55:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.456+0000 7f52420c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 0x7f523c104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.456+0000 7f52420c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 0x7f523c104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41130/0 (socket says 172.21.15.71:41130) 2024-09-10T09:55:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.456+0000 7f52420c3640 1 -- 172.21.15.71:0/840061628 learned_addr learned my addr 172.21.15.71:0/840061628 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.456+0000 7f52420c3640 1 -- 172.21.15.71:0/840061628 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c105120 con 0x7f523c076b10 2024-09-10T09:55:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.457+0000 7f52420c3640 1 --2- 172.21.15.71:0/840061628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 0x7f523c104be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5238009840 tx=0x7f52380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99aaed78e32407d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.457+0000 7f52410c1640 1 -- 172.21.15.71:0/840061628 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5238032440 con 0x7f523c076b10 2024-09-10T09:55:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.457+0000 7f52410c1640 1 -- 172.21.15.71:0/840061628 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f5238032a00 con 0x7f523c076b10 2024-09-10T09:55:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.457+0000 7f52410c1640 1 -- 172.21.15.71:0/840061628 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5238031a10 con 0x7f523c076b10 2024-09-10T09:55:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.458+0000 7f5244327640 1 -- 172.21.15.71:0/840061628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 msgr2=0x7f523c104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.458+0000 7f5244327640 1 --2- 172.21.15.71:0/840061628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 0x7f523c104be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5238009840 tx=0x7f52380091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.458+0000 7f5244327640 1 -- 172.21.15.71:0/840061628 shutdown_connections 2024-09-10T09:55:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.458+0000 7f5244327640 1 --2- 172.21.15.71:0/840061628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 0x7f523c104be0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:08.324 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.458+0000 7f5244327640 1 -- 172.21.15.71:0/840061628 >> 172.21.15.71:0/840061628 conn(0x7f523c0fc6d0 msgr2=0x7f523c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.458+0000 7f5244327640 1 -- 172.21.15.71:0/840061628 shutdown_connections 2024-09-10T09:55:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.458+0000 7f5244327640 1 -- 172.21.15.71:0/840061628 wait complete. 2024-09-10T09:55:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.459+0000 7f5244327640 1 Processor -- start 2024-09-10T09:55:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.459+0000 7f5244327640 1 -- start start 2024-09-10T09:55:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.459+0000 7f5244327640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 0x7f523c110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.459+0000 7f5244327640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c111330 con 0x7f523c076b10 2024-09-10T09:55:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.459+0000 7f52420c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 0x7f523c110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.459+0000 7f52420c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 0x7f523c110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41140/0 (socket says 172.21.15.71:41140) 2024-09-10T09:55:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.459+0000 7f52420c3640 1 -- 172.21.15.71:0/1191836708 learned_addr learned my addr 172.21.15.71:0/1191836708 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.459+0000 7f52420c3640 1 -- 172.21.15.71:0/1191836708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238009450 con 0x7f523c076b10 2024-09-10T09:55:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.459+0000 7f52420c3640 1 --2- 172.21.15.71:0/1191836708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 0x7f523c110df0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5238006a70 tx=0x7f523802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.460+0000 7f5232ffd640 1 -- 172.21.15.71:0/1191836708 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5238031d10 con 0x7f523c076b10 2024-09-10T09:55:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.460+0000 7f5244327640 1 -- 172.21.15.71:0/1191836708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c111530 con 0x7f523c076b10 2024-09-10T09:55:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.460+0000 7f5232ffd640 1 -- 172.21.15.71:0/1191836708 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f5238031e70 con 0x7f523c076b10 2024-09-10T09:55:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.460+0000 7f5232ffd640 1 -- 172.21.15.71:0/1191836708 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f523803b6f0 con 0x7f523c076b10 2024-09-10T09:55:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.460+0000 7f5244327640 1 -- 172.21.15.71:0/1191836708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c111f80 con 0x7f523c076b10 2024-09-10T09:55:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.461+0000 7f5232ffd640 1 -- 172.21.15.71:0/1191836708 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f5238039070 con 0x7f523c076b10 2024-09-10T09:55:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.461+0000 7f5244327640 1 -- 172.21.15.71:0/1191836708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c1002f0 con 0x7f523c076b10 2024-09-10T09:55:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.461+0000 7f5232ffd640 1 --2- 172.21.15.71:0/1191836708 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f5228039490 0x7f522803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.461+0000 7f5232ffd640 1 -- 172.21.15.71:0/1191836708 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f523806cc30 con 0x7f523c076b10 2024-09-10T09:55:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.461+0000 7f52418c2640 1 -- 172.21.15.71:0/1191836708 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f5228039490 msgr2=0x7f522803b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/89381066 2024-09-10T09:55:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.461+0000 7f52418c2640 1 --2- 172.21.15.71:0/1191836708 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f5228039490 0x7f522803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:55:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.465+0000 7f5232ffd640 1 -- 172.21.15.71:0/1191836708 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5238045b50 con 0x7f523c076b10 2024-09-10T09:55:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.662+0000 7f52418c2640 1 -- 172.21.15.71:0/1191836708 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f5228039490 msgr2=0x7f522803b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/89381066 2024-09-10T09:55:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.662+0000 7f52418c2640 1 --2- 172.21.15.71:0/1191836708 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f5228039490 0x7f522803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T09:55:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.670+0000 7f5244327640 1 -- 172.21.15.71:0/1191836708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f523c112380 con 0x7f523c076b10 2024-09-10T09:55:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.670+0000 7f5232ffd640 1 -- 172.21.15.71:0/1191836708 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f5238037070 con 0x7f523c076b10 2024-09-10T09:55:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.672+0000 7f5244327640 1 -- 172.21.15.71:0/1191836708 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f5228039490 msgr2=0x7f522803b940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:55:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.672+0000 7f5244327640 1 --2- 172.21.15.71:0/1191836708 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f5228039490 0x7f522803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.672+0000 7f5244327640 1 -- 172.21.15.71:0/1191836708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 msgr2=0x7f523c110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.672+0000 7f5244327640 1 --2- 172.21.15.71:0/1191836708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 0x7f523c110df0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5238006a70 tx=0x7f523802c040 comp rx=0 tx=0).stop 2024-09-10T09:55:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.672+0000 7f5244327640 1 -- 172.21.15.71:0/1191836708 shutdown_connections 2024-09-10T09:55:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.672+0000 7f5244327640 1 --2- 172.21.15.71:0/1191836708 >> [v2:172.21.15.71:6800/89381066,v1:172.21.15.71:6801/89381066] conn(0x7f5228039490 0x7f522803b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.672+0000 7f5244327640 1 --2- 172.21.15.71:0/1191836708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f523c076b10 0x7f523c110df0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.672+0000 7f5244327640 1 -- 172.21.15.71:0/1191836708 >> 172.21.15.71:0/1191836708 conn(0x7f523c0fc6d0 msgr2=0x7f523c0fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.672+0000 7f5244327640 1 -- 172.21.15.71:0/1191836708 shutdown_connections 2024-09-10T09:55:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:02.672+0000 7f5244327640 1 -- 172.21.15.71:0/1191836708 wait complete. 2024-09-10T09:55:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for the mgr to restart... 2024-09-10T09:55:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for mgr epoch 5... 2024-09-10T09:55:09.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:08 smithi071 ceph-mon[27559]: mgrmap e8: smithi071.gtqytr(active, since 2s) 2024-09-10T09:55:09.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:08 smithi071 ceph-mon[27559]: [10/Sep/2024:09:55:08] ENGINE Bus STARTING 2024-09-10T09:55:09.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:08 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:09.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:08 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:55:10.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:09 smithi071 ceph-mon[27559]: [10/Sep/2024:09:55:08] ENGINE Serving on https://172.21.15.71:7150 2024-09-10T09:55:10.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:09 smithi071 ceph-mon[27559]: [10/Sep/2024:09:55:08] ENGINE Bus STARTED 2024-09-10T09:55:10.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:09 smithi071 ceph-mon[27559]: [10/Sep/2024:09:55:08] ENGINE Error in HTTPServer.serve 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Traceback (most recent call last): 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._run(expiration_interval) 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: s = self.context.wrap_socket( 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: return self.sslsocket_class._create( 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T09:55:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self.do_handshake() 2024-09-10T09:55:10.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T09:55:10.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._sslobj.do_handshake() 2024-09-10T09:55:10.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T09:55:13.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:12 smithi071 ceph-mon[27559]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T09:55:13.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:12 smithi071 ceph-mon[27559]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T09:55:14.803 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:55:14.803 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 8, 2024-09-10T09:55:14.803 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T09:55:14.803 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:55:14.803 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.867+0000 7f7947cf2640 1 Processor -- start 2024-09-10T09:55:14.803 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.867+0000 7f7947cf2640 1 -- start start 2024-09-10T09:55:14.803 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.867+0000 7f7947cf2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 0x7f79401029d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:14.803 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.867+0000 7f7947cf2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7940102f10 con 0x7f7940076b90 2024-09-10T09:55:14.803 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.867+0000 7f7945a8e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 0x7f79401029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:14.803 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.867+0000 7f7945a8e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 0x7f79401029d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60664/0 (socket says 172.21.15.71:60664) 2024-09-10T09:55:14.804 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.867+0000 7f7945a8e640 1 -- 172.21.15.71:0/782168144 learned_addr learned my addr 172.21.15.71:0/782168144 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:14.804 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.867+0000 7f7945a8e640 1 -- 172.21.15.71:0/782168144 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940103050 con 0x7f7940076b90 2024-09-10T09:55:14.804 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.868+0000 7f7945a8e640 1 --2- 172.21.15.71:0/782168144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 0x7f79401029d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f793c009840 tx=0x7f793c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427652384247b6f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:14.804 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.868+0000 7f7944a8c640 1 -- 172.21.15.71:0/782168144 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f793c032440 con 0x7f7940076b90 2024-09-10T09:55:14.804 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.868+0000 7f7944a8c640 1 -- 172.21.15.71:0/782168144 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f793c032a00 con 0x7f7940076b90 2024-09-10T09:55:14.804 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.868+0000 7f7944a8c640 1 -- 172.21.15.71:0/782168144 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f793c0319e0 con 0x7f7940076b90 2024-09-10T09:55:14.804 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.869+0000 7f7947cf2640 1 -- 172.21.15.71:0/782168144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 msgr2=0x7f79401029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:14.804 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.869+0000 7f7947cf2640 1 --2- 172.21.15.71:0/782168144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 0x7f79401029d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f793c009840 tx=0x7f793c0091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:14.804 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.869+0000 7f7947cf2640 1 -- 172.21.15.71:0/782168144 shutdown_connections 2024-09-10T09:55:14.804 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.869+0000 7f7947cf2640 1 --2- 172.21.15.71:0/782168144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 0x7f79401029d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:14.804 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.869+0000 7f7947cf2640 1 -- 172.21.15.71:0/782168144 >> 172.21.15.71:0/782168144 conn(0x7f79400fc710 msgr2=0x7f79400feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:14.805 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.869+0000 7f7947cf2640 1 -- 172.21.15.71:0/782168144 shutdown_connections 2024-09-10T09:55:14.805 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.869+0000 7f7947cf2640 1 -- 172.21.15.71:0/782168144 wait complete. 2024-09-10T09:55:14.805 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.870+0000 7f7947cf2640 1 Processor -- start 2024-09-10T09:55:14.805 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.870+0000 7f7947cf2640 1 -- start start 2024-09-10T09:55:14.805 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.870+0000 7f7947cf2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 0x7f7940117370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:14.805 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.870+0000 7f7947cf2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79401178b0 con 0x7f7940076b90 2024-09-10T09:55:14.805 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.870+0000 7f7945a8e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 0x7f7940117370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:14.805 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.870+0000 7f7945a8e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 0x7f7940117370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60680/0 (socket says 172.21.15.71:60680) 2024-09-10T09:55:14.805 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.870+0000 7f7945a8e640 1 -- 172.21.15.71:0/3655459177 learned_addr learned my addr 172.21.15.71:0/3655459177 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:14.805 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.870+0000 7f7945a8e640 1 -- 172.21.15.71:0/3655459177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c009450 con 0x7f7940076b90 2024-09-10T09:55:14.805 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.870+0000 7f7945a8e640 1 --2- 172.21.15.71:0/3655459177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 0x7f7940117370 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f793c006f00 tx=0x7f793c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:14.806 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.870+0000 7f79367fc640 1 -- 172.21.15.71:0/3655459177 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f793c031e30 con 0x7f7940076b90 2024-09-10T09:55:14.806 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.870+0000 7f79367fc640 1 -- 172.21.15.71:0/3655459177 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f793c03d8b0 con 0x7f7940076b90 2024-09-10T09:55:14.806 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.870+0000 7f79367fc640 1 -- 172.21.15.71:0/3655459177 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f793c03b8f0 con 0x7f7940076b90 2024-09-10T09:55:14.806 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.870+0000 7f7947cf2640 1 -- 172.21.15.71:0/3655459177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7940117ab0 con 0x7f7940076b90 2024-09-10T09:55:14.806 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.871+0000 7f7947cf2640 1 -- 172.21.15.71:0/3655459177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7940117f20 con 0x7f7940076b90 2024-09-10T09:55:14.806 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.871+0000 7f79367fc640 1 -- 172.21.15.71:0/3655459177 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f793c039070 con 0x7f7940076b90 2024-09-10T09:55:14.806 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.872+0000 7f79367fc640 1 --2- 172.21.15.71:0/3655459177 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f792c0394e0 0x7f792c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:14.806 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.872+0000 7f79367fc640 1 -- 172.21.15.71:0/3655459177 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f792c03c0a0 con 0x7f792c0394e0 2024-09-10T09:55:14.806 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.872+0000 7f79367fc640 1 -- 172.21.15.71:0/3655459177 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f793c06d0b0 con 0x7f7940076b90 2024-09-10T09:55:14.806 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.872+0000 7f794528d640 1 --2- 172.21.15.71:0/3655459177 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f792c0394e0 0x7f792c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.872+0000 7f794528d640 1 --2- 172.21.15.71:0/3655459177 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f792c0394e0 0x7f792c03b990 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7930006fd0 tx=0x7f7930006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.872+0000 7f79367fc640 1 -- 172.21.15.71:0/3655459177 <== mgr.14118 v2:172.21.15.71:6800/4098346293 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f792c03c0a0 con 0x7f792c0394e0 2024-09-10T09:55:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.877+0000 7f7947cf2640 1 -- 172.21.15.71:0/3655459177 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7940117f20 con 0x7f792c0394e0 2024-09-10T09:55:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.877+0000 7f79367fc640 1 -- 172.21.15.71:0/3655459177 <== mgr.14118 v2:172.21.15.71:6800/4098346293 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7940117f20 con 0x7f792c0394e0 2024-09-10T09:55:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.878+0000 7f7947cf2640 1 -- 172.21.15.71:0/3655459177 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f792c0394e0 msgr2=0x7f792c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.878+0000 7f7947cf2640 1 --2- 172.21.15.71:0/3655459177 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f792c0394e0 0x7f792c03b990 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7930006fd0 tx=0x7f7930006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.878+0000 7f7947cf2640 1 -- 172.21.15.71:0/3655459177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 msgr2=0x7f7940117370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.878+0000 7f7947cf2640 1 --2- 172.21.15.71:0/3655459177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 0x7f7940117370 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f793c006f00 tx=0x7f793c008040 comp rx=0 tx=0).stop 2024-09-10T09:55:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.878+0000 7f7947cf2640 1 -- 172.21.15.71:0/3655459177 shutdown_connections 2024-09-10T09:55:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.878+0000 7f7947cf2640 1 --2- 172.21.15.71:0/3655459177 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f792c0394e0 0x7f792c03b990 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:14.807 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.878+0000 7f7947cf2640 1 --2- 172.21.15.71:0/3655459177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7940076b90 0x7f7940117370 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:14.808 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.878+0000 7f7947cf2640 1 -- 172.21.15.71:0/3655459177 >> 172.21.15.71:0/3655459177 conn(0x7f79400fc710 msgr2=0x7f7940106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:14.808 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.878+0000 7f7947cf2640 1 -- 172.21.15.71:0/3655459177 shutdown_connections 2024-09-10T09:55:14.808 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:11.878+0000 7f7947cf2640 1 -- 172.21.15.71:0/3655459177 wait complete. 2024-09-10T09:55:14.808 INFO:teuthology.orchestra.run.smithi071.stdout:mgr epoch 5 is available 2024-09-10T09:55:14.808 INFO:teuthology.orchestra.run.smithi071.stdout:Setting orchestrator backend to cephadm... 2024-09-10T09:55:15.873 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.178+0000 7f53d5224640 1 Processor -- start 2024-09-10T09:55:15.873 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.178+0000 7f53d5224640 1 -- start start 2024-09-10T09:55:15.873 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.178+0000 7f53d5224640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 0x7f53d0077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:15.873 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.178+0000 7f53d5224640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d0078f80 con 0x7f53d0078b70 2024-09-10T09:55:15.873 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.178+0000 7f53ced9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 0x7f53d0077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:15.873 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.178+0000 7f53ced9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 0x7f53d0077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44352/0 (socket says 172.21.15.71:44352) 2024-09-10T09:55:15.873 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.178+0000 7f53ced9d640 1 -- 172.21.15.71:0/4090192038 learned_addr learned my addr 172.21.15.71:0/4090192038 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:15.873 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.179+0000 7f53ced9d640 1 -- 172.21.15.71:0/4090192038 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00790c0 con 0x7f53d0078b70 2024-09-10T09:55:15.873 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.179+0000 7f53ced9d640 1 --2- 172.21.15.71:0/4090192038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 0x7f53d0077230 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009840 tx=0x7f53c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126e0671a11a45dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:15.873 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.179+0000 7f53cdd9b640 1 -- 172.21.15.71:0/4090192038 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53c0032440 con 0x7f53d0078b70 2024-09-10T09:55:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.180+0000 7f53cdd9b640 1 -- 172.21.15.71:0/4090192038 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f53c0032a00 con 0x7f53d0078b70 2024-09-10T09:55:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.180+0000 7f53cdd9b640 1 -- 172.21.15.71:0/4090192038 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53c0031a10 con 0x7f53d0078b70 2024-09-10T09:55:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.180+0000 7f53d5224640 1 -- 172.21.15.71:0/4090192038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 msgr2=0x7f53d0077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.180+0000 7f53d5224640 1 --2- 172.21.15.71:0/4090192038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 0x7f53d0077230 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009840 tx=0x7f53c00091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.180+0000 7f53d5224640 1 -- 172.21.15.71:0/4090192038 shutdown_connections 2024-09-10T09:55:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.180+0000 7f53d5224640 1 --2- 172.21.15.71:0/4090192038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 0x7f53d0077230 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.180+0000 7f53d5224640 1 -- 172.21.15.71:0/4090192038 >> 172.21.15.71:0/4090192038 conn(0x7f53d00fd850 msgr2=0x7f53d00ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.180+0000 7f53d5224640 1 -- 172.21.15.71:0/4090192038 shutdown_connections 2024-09-10T09:55:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.180+0000 7f53d5224640 1 -- 172.21.15.71:0/4090192038 wait complete. 2024-09-10T09:55:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.181+0000 7f53d5224640 1 Processor -- start 2024-09-10T09:55:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.181+0000 7f53d5224640 1 -- start start 2024-09-10T09:55:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.181+0000 7f53d5224640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 0x7f53d0112f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:15.874 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.181+0000 7f53d5224640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d0113440 con 0x7f53d0078b70 2024-09-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.181+0000 7f53ced9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 0x7f53d0112f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.181+0000 7f53ced9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 0x7f53d0112f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44368/0 (socket says 172.21.15.71:44368) 2024-09-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.181+0000 7f53ced9d640 1 -- 172.21.15.71:0/3533224192 learned_addr learned my addr 172.21.15.71:0/3533224192 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.181+0000 7f53ced9d640 1 -- 172.21.15.71:0/3533224192 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c0009450 con 0x7f53d0078b70 2024-09-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.182+0000 7f53ced9d640 1 --2- 172.21.15.71:0/3533224192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 0x7f53d0112f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f53c00329d0 tx=0x7f53c002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.182+0000 7f53b77fe640 1 -- 172.21.15.71:0/3533224192 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53c0031d10 con 0x7f53d0078b70 2024-09-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.182+0000 7f53b77fe640 1 -- 172.21.15.71:0/3533224192 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f53c0031e70 con 0x7f53d0078b70 2024-09-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.182+0000 7f53d5224640 1 -- 172.21.15.71:0/3533224192 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d01136a0 con 0x7f53d0078b70 2024-09-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.182+0000 7f53b77fe640 1 -- 172.21.15.71:0/3533224192 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53c003b670 con 0x7f53d0078b70 2024-09-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.182+0000 7f53d5224640 1 -- 172.21.15.71:0/3533224192 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d01141d0 con 0x7f53d0078b70 2024-09-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.183+0000 7f53b77fe640 1 -- 172.21.15.71:0/3533224192 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f53c0039070 con 0x7f53d0078b70 2024-09-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.183+0000 7f53d5224640 1 -- 172.21.15.71:0/3533224192 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d01014f0 con 0x7f53d0078b70 2024-09-10T09:55:15.876 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.183+0000 7f53b77fe640 1 --2- 172.21.15.71:0/3533224192 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f53b80394e0 0x7f53b803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:15.876 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.183+0000 7f53b77fe640 1 -- 172.21.15.71:0/3533224192 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f53c006d1e0 con 0x7f53d0078b70 2024-09-10T09:55:15.876 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.183+0000 7f53ce59c640 1 --2- 172.21.15.71:0/3533224192 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f53b80394e0 0x7f53b803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:15.876 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.184+0000 7f53ce59c640 1 --2- 172.21.15.71:0/3533224192 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f53b80394e0 0x7f53b803b990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f53c4006fd0 tx=0x7f53c4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:15.876 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.188+0000 7f53b77fe640 1 -- 172.21.15.71:0/3533224192 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f53c004e350 con 0x7f53d0078b70 2024-09-10T09:55:15.876 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.357+0000 7f53d5224640 1 -- 172.21.15.71:0/3533224192 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f53d00febb0 con 0x7f53b80394e0 2024-09-10T09:55:15.876 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.364+0000 7f53b77fe640 1 -- 172.21.15.71:0/3533224192 <== mgr.14118 v2:172.21.15.71:6800/4098346293 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f53d00febb0 con 0x7f53b80394e0 2024-09-10T09:55:15.876 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.366+0000 7f53d5224640 1 -- 172.21.15.71:0/3533224192 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f53b80394e0 msgr2=0x7f53b803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:15.876 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.366+0000 7f53d5224640 1 --2- 172.21.15.71:0/3533224192 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f53b80394e0 0x7f53b803b990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f53c4006fd0 tx=0x7f53c4006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:15.876 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.366+0000 7f53d5224640 1 -- 172.21.15.71:0/3533224192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 msgr2=0x7f53d0112f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:15.876 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.366+0000 7f53d5224640 1 --2- 172.21.15.71:0/3533224192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 0x7f53d0112f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f53c00329d0 tx=0x7f53c002c040 comp rx=0 tx=0).stop 2024-09-10T09:55:15.876 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.366+0000 7f53d5224640 1 -- 172.21.15.71:0/3533224192 shutdown_connections 2024-09-10T09:55:15.876 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.366+0000 7f53d5224640 1 --2- 172.21.15.71:0/3533224192 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f53b80394e0 0x7f53b803b990 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:15.877 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.366+0000 7f53d5224640 1 --2- 172.21.15.71:0/3533224192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53d0078b70 0x7f53d0112f00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:15.877 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.367+0000 7f53d5224640 1 -- 172.21.15.71:0/3533224192 >> 172.21.15.71:0/3533224192 conn(0x7f53d00fd850 msgr2=0x7f53d00fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:15.877 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.367+0000 7f53d5224640 1 -- 172.21.15.71:0/3533224192 shutdown_connections 2024-09-10T09:55:15.877 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:15.367+0000 7f53d5224640 1 -- 172.21.15.71:0/3533224192 wait complete. 2024-09-10T09:55:16.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:16 smithi071 ceph-mon[27559]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:16.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:16 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:16.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:16 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:55:16.962 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T09:55:16.962 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.232+0000 7fe79df2f640 1 Processor -- start 2024-09-10T09:55:16.962 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.232+0000 7fe79df2f640 1 -- start start 2024-09-10T09:55:16.962 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.233+0000 7fe79df2f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 0x7fe7981039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:16.963 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.233+0000 7fe79df2f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe798070e30 con 0x7fe7981035d0 2024-09-10T09:55:16.963 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.233+0000 7fe7977fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 0x7fe7981039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:16.963 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.233+0000 7fe7977fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 0x7fe7981039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44374/0 (socket says 172.21.15.71:44374) 2024-09-10T09:55:16.963 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.233+0000 7fe7977fe640 1 -- 172.21.15.71:0/3798770017 learned_addr learned my addr 172.21.15.71:0/3798770017 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:16.963 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.233+0000 7fe7977fe640 1 -- 172.21.15.71:0/3798770017 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe798103f20 con 0x7fe7981035d0 2024-09-10T09:55:16.963 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.234+0000 7fe7977fe640 1 --2- 172.21.15.71:0/3798770017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 0x7fe7981039e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe788009840 tx=0x7fe7880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b52a8de92704f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:16.963 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.234+0000 7fe796ffd640 1 -- 172.21.15.71:0/3798770017 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe788032440 con 0x7fe7981035d0 2024-09-10T09:55:16.963 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.234+0000 7fe796ffd640 1 -- 172.21.15.71:0/3798770017 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fe788032a00 con 0x7fe7981035d0 2024-09-10T09:55:16.963 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.234+0000 7fe796ffd640 1 -- 172.21.15.71:0/3798770017 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7880319e0 con 0x7fe7981035d0 2024-09-10T09:55:16.963 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.234+0000 7fe79df2f640 1 -- 172.21.15.71:0/3798770017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 msgr2=0x7fe7981039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:16.963 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.234+0000 7fe79df2f640 1 --2- 172.21.15.71:0/3798770017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 0x7fe7981039e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe788009840 tx=0x7fe7880091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:16.963 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.234+0000 7fe79df2f640 1 -- 172.21.15.71:0/3798770017 shutdown_connections 2024-09-10T09:55:16.963 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.234+0000 7fe79df2f640 1 --2- 172.21.15.71:0/3798770017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 0x7fe7981039e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:16.964 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.234+0000 7fe79df2f640 1 -- 172.21.15.71:0/3798770017 >> 172.21.15.71:0/3798770017 conn(0x7fe7980fbdd0 msgr2=0x7fe7980fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:16.964 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.235+0000 7fe79df2f640 1 -- 172.21.15.71:0/3798770017 shutdown_connections 2024-09-10T09:55:16.964 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.235+0000 7fe79df2f640 1 -- 172.21.15.71:0/3798770017 wait complete. 2024-09-10T09:55:16.964 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.235+0000 7fe79df2f640 1 Processor -- start 2024-09-10T09:55:16.964 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.235+0000 7fe79df2f640 1 -- start start 2024-09-10T09:55:16.964 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.235+0000 7fe79df2f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 0x7fe798102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:16.964 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.235+0000 7fe79df2f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe798103220 con 0x7fe7981035d0 2024-09-10T09:55:16.964 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.235+0000 7fe7977fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 0x7fe798102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:16.964 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.235+0000 7fe7977fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 0x7fe798102ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44378/0 (socket says 172.21.15.71:44378) 2024-09-10T09:55:16.964 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.235+0000 7fe7977fe640 1 -- 172.21.15.71:0/753508202 learned_addr learned my addr 172.21.15.71:0/753508202 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:16.964 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.236+0000 7fe7977fe640 1 -- 172.21.15.71:0/753508202 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe788009450 con 0x7fe7981035d0 2024-09-10T09:55:16.964 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.236+0000 7fe7977fe640 1 --2- 172.21.15.71:0/753508202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 0x7fe798102ce0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe7880098a0 tx=0x7fe788008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:16.965 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.236+0000 7fe794ff9640 1 -- 172.21.15.71:0/753508202 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe788032880 con 0x7fe7981035d0 2024-09-10T09:55:16.965 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.236+0000 7fe794ff9640 1 -- 172.21.15.71:0/753508202 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fe78803d8b0 con 0x7fe7981035d0 2024-09-10T09:55:16.965 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.236+0000 7fe79df2f640 1 -- 172.21.15.71:0/753508202 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7981012b0 con 0x7fe7981035d0 2024-09-10T09:55:16.965 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.236+0000 7fe794ff9640 1 -- 172.21.15.71:0/753508202 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe78803b910 con 0x7fe7981035d0 2024-09-10T09:55:16.965 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.236+0000 7fe79df2f640 1 -- 172.21.15.71:0/753508202 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe798101720 con 0x7fe7981035d0 2024-09-10T09:55:16.965 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.237+0000 7fe794ff9640 1 -- 172.21.15.71:0/753508202 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fe788039070 con 0x7fe7981035d0 2024-09-10T09:55:16.965 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.237+0000 7fe794ff9640 1 --2- 172.21.15.71:0/753508202 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fe7840394e0 0x7fe78403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:16.965 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.237+0000 7fe794ff9640 1 -- 172.21.15.71:0/753508202 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe78806d440 con 0x7fe7981035d0 2024-09-10T09:55:16.965 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.237+0000 7fe78effd640 1 --2- 172.21.15.71:0/753508202 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fe7840394e0 0x7fe78403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:16.965 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.237+0000 7fe79df2f640 1 -- 172.21.15.71:0/753508202 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79804b720 con 0x7fe7981035d0 2024-09-10T09:55:16.965 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.238+0000 7fe78effd640 1 --2- 172.21.15.71:0/753508202 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fe7840394e0 0x7fe78403b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe780006fd0 tx=0x7fe780006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:16.965 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.242+0000 7fe794ff9640 1 -- 172.21.15.71:0/753508202 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe788041070 con 0x7fe7981035d0 2024-09-10T09:55:16.965 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.398+0000 7fe79df2f640 1 -- 172.21.15.71:0/753508202 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fe798101cc0 con 0x7fe7840394e0 2024-09-10T09:55:16.966 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.398+0000 7fe794ff9640 1 -- 172.21.15.71:0/753508202 <== mgr.14118 v2:172.21.15.71:6800/4098346293 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fe798101cc0 con 0x7fe7840394e0 2024-09-10T09:55:16.966 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.400+0000 7fe79df2f640 1 -- 172.21.15.71:0/753508202 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fe7840394e0 msgr2=0x7fe78403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:16.966 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.400+0000 7fe79df2f640 1 --2- 172.21.15.71:0/753508202 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fe7840394e0 0x7fe78403b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe780006fd0 tx=0x7fe780006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:16.966 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.400+0000 7fe79df2f640 1 -- 172.21.15.71:0/753508202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 msgr2=0x7fe798102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:16.966 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.400+0000 7fe79df2f640 1 --2- 172.21.15.71:0/753508202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 0x7fe798102ce0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe7880098a0 tx=0x7fe788008040 comp rx=0 tx=0).stop 2024-09-10T09:55:16.966 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.400+0000 7fe79df2f640 1 -- 172.21.15.71:0/753508202 shutdown_connections 2024-09-10T09:55:16.966 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.400+0000 7fe79df2f640 1 --2- 172.21.15.71:0/753508202 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fe7840394e0 0x7fe78403b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:16.966 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.400+0000 7fe79df2f640 1 --2- 172.21.15.71:0/753508202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7981035d0 0x7fe798102ce0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:16.966 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.400+0000 7fe79df2f640 1 -- 172.21.15.71:0/753508202 >> 172.21.15.71:0/753508202 conn(0x7fe7980fbdd0 msgr2=0x7fe7980fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:16.966 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.400+0000 7fe79df2f640 1 -- 172.21.15.71:0/753508202 shutdown_connections 2024-09-10T09:55:16.966 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:16.400+0000 7fe79df2f640 1 -- 172.21.15.71:0/753508202 wait complete. 2024-09-10T09:55:16.966 INFO:teuthology.orchestra.run.smithi071.stdout:Generating ssh key... 2024-09-10T09:55:17.602 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:17 smithi071 ceph-mon[27559]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:18.269 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.321+0000 7f1ef1fcf640 1 Processor -- start 2024-09-10T09:55:18.269 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.321+0000 7f1ef1fcf640 1 -- start start 2024-09-10T09:55:18.269 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.321+0000 7f1ef1fcf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 0x7f1eec102360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:18.269 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.321+0000 7f1ef1fcf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec1028a0 con 0x7f1eec101f50 2024-09-10T09:55:18.269 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.321+0000 7f1eeb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 0x7f1eec102360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:18.269 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.321+0000 7f1eeb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 0x7f1eec102360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44386/0 (socket says 172.21.15.71:44386) 2024-09-10T09:55:18.269 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.321+0000 7f1eeb7fe640 1 -- 172.21.15.71:0/2006097136 learned_addr learned my addr 172.21.15.71:0/2006097136 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:18.269 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.321+0000 7f1eeb7fe640 1 -- 172.21.15.71:0/2006097136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec1029e0 con 0x7f1eec101f50 2024-09-10T09:55:18.269 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.322+0000 7f1eeb7fe640 1 --2- 172.21.15.71:0/2006097136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 0x7f1eec102360 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1edc009840 tx=0x7f1edc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcea08da5e9052 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.322+0000 7f1eea7fc640 1 -- 172.21.15.71:0/2006097136 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1edc032440 con 0x7f1eec101f50 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.322+0000 7f1eea7fc640 1 -- 172.21.15.71:0/2006097136 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1edc032a00 con 0x7f1eec101f50 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.322+0000 7f1eea7fc640 1 -- 172.21.15.71:0/2006097136 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1edc0319e0 con 0x7f1eec101f50 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.323+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/2006097136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 msgr2=0x7f1eec102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.323+0000 7f1ef1fcf640 1 --2- 172.21.15.71:0/2006097136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 0x7f1eec102360 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1edc009840 tx=0x7f1edc0091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.323+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/2006097136 shutdown_connections 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.323+0000 7f1ef1fcf640 1 --2- 172.21.15.71:0/2006097136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 0x7f1eec102360 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.323+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/2006097136 >> 172.21.15.71:0/2006097136 conn(0x7f1eec0fd6b0 msgr2=0x7f1eec0ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.323+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/2006097136 shutdown_connections 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.323+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/2006097136 wait complete. 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.323+0000 7f1ef1fcf640 1 Processor -- start 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.324+0000 7f1ef1fcf640 1 -- start start 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.324+0000 7f1ef1fcf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 0x7f1eec110cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.324+0000 7f1ef1fcf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec111210 con 0x7f1eec101f50 2024-09-10T09:55:18.270 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.324+0000 7f1eeb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 0x7f1eec110cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.324+0000 7f1eeb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 0x7f1eec110cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44392/0 (socket says 172.21.15.71:44392) 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.324+0000 7f1eeb7fe640 1 -- 172.21.15.71:0/624064655 learned_addr learned my addr 172.21.15.71:0/624064655 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.324+0000 7f1eeb7fe640 1 -- 172.21.15.71:0/624064655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc009450 con 0x7f1eec101f50 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.324+0000 7f1eeb7fe640 1 --2- 172.21.15.71:0/624064655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 0x7f1eec110cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0098a0 tx=0x7f1edc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.324+0000 7f1ed3fff640 1 -- 172.21.15.71:0/624064655 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1edc032880 con 0x7f1eec101f50 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.324+0000 7f1ed3fff640 1 -- 172.21.15.71:0/624064655 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1edc03d8b0 con 0x7f1eec101f50 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.324+0000 7f1ed3fff640 1 -- 172.21.15.71:0/624064655 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1edc03b910 con 0x7f1eec101f50 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.324+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/624064655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eec111410 con 0x7f1eec101f50 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.324+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/624064655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eec111880 con 0x7f1eec101f50 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.325+0000 7f1ed3fff640 1 -- 172.21.15.71:0/624064655 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f1edc039070 con 0x7f1eec101f50 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.325+0000 7f1ed3fff640 1 --2- 172.21.15.71:0/624064655 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f1ed40394e0 0x7f1ed403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.325+0000 7f1ed3fff640 1 -- 172.21.15.71:0/624064655 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1edc06d270 con 0x7f1eec101f50 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.325+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/624064655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eec101310 con 0x7f1eec101f50 2024-09-10T09:55:18.271 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.326+0000 7f1eeaffd640 1 --2- 172.21.15.71:0/624064655 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f1ed40394e0 0x7f1ed403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.326+0000 7f1eeaffd640 1 --2- 172.21.15.71:0/624064655 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f1ed40394e0 0x7f1ed403b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0006fd0 tx=0x7f1ee0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.330+0000 7f1ed3fff640 1 -- 172.21.15.71:0/624064655 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1edc041020 con 0x7f1eec101f50 2024-09-10T09:55:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.487+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/624064655 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1eec0fe8e0 con 0x7f1ed40394e0 2024-09-10T09:55:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.694+0000 7f1ed3fff640 1 -- 172.21.15.71:0/624064655 <== mgr.14118 v2:172.21.15.71:6800/4098346293 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1eec0fe8e0 con 0x7f1ed40394e0 2024-09-10T09:55:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.696+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/624064655 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f1ed40394e0 msgr2=0x7f1ed403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.696+0000 7f1ef1fcf640 1 --2- 172.21.15.71:0/624064655 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f1ed40394e0 0x7f1ed403b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0006fd0 tx=0x7f1ee0006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.696+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/624064655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 msgr2=0x7f1eec110cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.696+0000 7f1ef1fcf640 1 --2- 172.21.15.71:0/624064655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 0x7f1eec110cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0098a0 tx=0x7f1edc008040 comp rx=0 tx=0).stop 2024-09-10T09:55:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.696+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/624064655 shutdown_connections 2024-09-10T09:55:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.696+0000 7f1ef1fcf640 1 --2- 172.21.15.71:0/624064655 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f1ed40394e0 0x7f1ed403b990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.696+0000 7f1ef1fcf640 1 --2- 172.21.15.71:0/624064655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1eec101f50 0x7f1eec110cd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.696+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/624064655 >> 172.21.15.71:0/624064655 conn(0x7f1eec0fd6b0 msgr2=0x7f1eec0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:18.272 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.697+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/624064655 shutdown_connections 2024-09-10T09:55:18.273 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:17.697+0000 7f1ef1fcf640 1 -- 172.21.15.71:0/624064655 wait complete. 2024-09-10T09:55:18.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:18 smithi071 ceph-mon[27559]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:18.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:18 smithi071 ceph-mon[27559]: Generating ssh key... 2024-09-10T09:55:18.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:18 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:18.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:18 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:19.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjdodOYfFm+Q+o3IcVBS3XGiXZc/M0DY3fEsM9N6vVxVQge0siWgXde7Feolod5sXRoMEDXHMnGzLBA7I3uduP7U5TF8mx3LyjLhRp+wxwFSQ5g324lFdFlfQoYlB4GGsG+sfH6kOKDaGc8yUlwQUUUSmvS/iaShC86WeRLReuzeVXyKvSvr/sH0xqOQ6SVjEV35hHc/7tQAJSJoE26gvwMIy9cErAai4+C/3c6J5KgAdRmbtNSliawNxe6Btkb0oLPQDTTJn2ZKFT4+OKDCNH+dBrWiAyT7CDSFRZHcQrT9dH1qUcacY9suwnBidu45EoObu5SB2Am9BIwpxVxd9htXsRWqmKcrHudBWcYYSrvd8vCd/RbZY0gpstMHGlgQ6+KEKORkBcscwpBU9NDWgQMxrC7oX4L50/t9oE8SdlQnUTxfHI5IyIGG0af6333RyFDSW+LEBbY7kLF8pQU8FuD6rqQ6CeCMui4hit3144u+9LxAe8IPCdMfITUHZJUXc= ceph-9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:55:19.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.637+0000 7f89b03fa640 1 Processor -- start 2024-09-10T09:55:19.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.637+0000 7f89b03fa640 1 -- start start 2024-09-10T09:55:19.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.637+0000 7f89b03fa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 0x7f89a8102790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:19.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.637+0000 7f89b03fa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a8102d60 con 0x7f89a81023a0 2024-09-10T09:55:19.401 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.637+0000 7f89ae196640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 0x7f89a8102790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.637+0000 7f89ae196640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 0x7f89a8102790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44408/0 (socket says 172.21.15.71:44408) 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.637+0000 7f89ae196640 1 -- 172.21.15.71:0/995498280 learned_addr learned my addr 172.21.15.71:0/995498280 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.637+0000 7f89ae196640 1 -- 172.21.15.71:0/995498280 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a8102ea0 con 0x7f89a81023a0 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.638+0000 7f89ae196640 1 --2- 172.21.15.71:0/995498280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 0x7f89a8102790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009840 tx=0x7f89a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8618a53b63461c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.638+0000 7f89ad194640 1 -- 172.21.15.71:0/995498280 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89a4032440 con 0x7f89a81023a0 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.638+0000 7f89ad194640 1 -- 172.21.15.71:0/995498280 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f89a4032a00 con 0x7f89a81023a0 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.638+0000 7f89ad194640 1 -- 172.21.15.71:0/995498280 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89a40319e0 con 0x7f89a81023a0 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.639+0000 7f89b03fa640 1 -- 172.21.15.71:0/995498280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 msgr2=0x7f89a8102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.639+0000 7f89b03fa640 1 --2- 172.21.15.71:0/995498280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 0x7f89a8102790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009840 tx=0x7f89a40091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.639+0000 7f89b03fa640 1 -- 172.21.15.71:0/995498280 shutdown_connections 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.639+0000 7f89b03fa640 1 --2- 172.21.15.71:0/995498280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 0x7f89a8102790 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.639+0000 7f89b03fa640 1 -- 172.21.15.71:0/995498280 >> 172.21.15.71:0/995498280 conn(0x7f89a80fbdc0 msgr2=0x7f89a80fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.639+0000 7f89b03fa640 1 -- 172.21.15.71:0/995498280 shutdown_connections 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.639+0000 7f89b03fa640 1 -- 172.21.15.71:0/995498280 wait complete. 2024-09-10T09:55:19.402 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.639+0000 7f89b03fa640 1 Processor -- start 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.639+0000 7f89b03fa640 1 -- start start 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.640+0000 7f89b03fa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 0x7f89a8112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.640+0000 7f89b03fa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a8113470 con 0x7f89a81023a0 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.640+0000 7f89ae196640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 0x7f89a8112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.640+0000 7f89ae196640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 0x7f89a8112f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44424/0 (socket says 172.21.15.71:44424) 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.640+0000 7f89ae196640 1 -- 172.21.15.71:0/3921251019 learned_addr learned my addr 172.21.15.71:0/3921251019 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.640+0000 7f89ae196640 1 -- 172.21.15.71:0/3921251019 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a4009450 con 0x7f89a81023a0 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.640+0000 7f89ae196640 1 --2- 172.21.15.71:0/3921251019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 0x7f89a8112f30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f89a4000c00 tx=0x7f89a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.640+0000 7f899effd640 1 -- 172.21.15.71:0/3921251019 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89a403d450 con 0x7f89a81023a0 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.640+0000 7f899effd640 1 -- 172.21.15.71:0/3921251019 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f89a403da10 con 0x7f89a81023a0 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.640+0000 7f89b03fa640 1 -- 172.21.15.71:0/3921251019 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a8113670 con 0x7f89a81023a0 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.640+0000 7f899effd640 1 -- 172.21.15.71:0/3921251019 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89a403b8e0 con 0x7f89a81023a0 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.640+0000 7f89b03fa640 1 -- 172.21.15.71:0/3921251019 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a8113ae0 con 0x7f89a81023a0 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.641+0000 7f899effd640 1 -- 172.21.15.71:0/3921251019 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f89a4039070 con 0x7f89a81023a0 2024-09-10T09:55:19.403 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.641+0000 7f89b03fa640 1 -- 172.21.15.71:0/3921251019 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a804b720 con 0x7f89a81023a0 2024-09-10T09:55:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.641+0000 7f899effd640 1 --2- 172.21.15.71:0/3921251019 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f89940394e0 0x7f899403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.641+0000 7f899effd640 1 -- 172.21.15.71:0/3921251019 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f89a406d1f0 con 0x7f89a81023a0 2024-09-10T09:55:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.641+0000 7f89ad995640 1 --2- 172.21.15.71:0/3921251019 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f89940394e0 0x7f899403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.642+0000 7f89ad995640 1 --2- 172.21.15.71:0/3921251019 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f89940394e0 0x7f899403b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8998006fd0 tx=0x7f8998006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.646+0000 7f899effd640 1 -- 172.21.15.71:0/3921251019 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f89a403c820 con 0x7f89a81023a0 2024-09-10T09:55:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.803+0000 7f89b03fa640 1 -- 172.21.15.71:0/3921251019 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f89a8113ae0 con 0x7f89940394e0 2024-09-10T09:55:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.804+0000 7f899effd640 1 -- 172.21.15.71:0/3921251019 <== mgr.14118 v2:172.21.15.71:6800/4098346293 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f89a8113ae0 con 0x7f89940394e0 2024-09-10T09:55:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.806+0000 7f89b03fa640 1 -- 172.21.15.71:0/3921251019 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f89940394e0 msgr2=0x7f899403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.806+0000 7f89b03fa640 1 --2- 172.21.15.71:0/3921251019 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f89940394e0 0x7f899403b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8998006fd0 tx=0x7f8998006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.806+0000 7f89b03fa640 1 -- 172.21.15.71:0/3921251019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 msgr2=0x7f89a8112f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.806+0000 7f89b03fa640 1 --2- 172.21.15.71:0/3921251019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 0x7f89a8112f30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f89a4000c00 tx=0x7f89a4008040 comp rx=0 tx=0).stop 2024-09-10T09:55:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.806+0000 7f89b03fa640 1 -- 172.21.15.71:0/3921251019 shutdown_connections 2024-09-10T09:55:19.404 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.806+0000 7f89b03fa640 1 --2- 172.21.15.71:0/3921251019 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f89940394e0 0x7f899403b990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:19.405 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.806+0000 7f89b03fa640 1 --2- 172.21.15.71:0/3921251019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89a81023a0 0x7f89a8112f30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:19.405 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.806+0000 7f89b03fa640 1 -- 172.21.15.71:0/3921251019 >> 172.21.15.71:0/3921251019 conn(0x7f89a80fbdc0 msgr2=0x7f89a80fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:19.405 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.806+0000 7f89b03fa640 1 -- 172.21.15.71:0/3921251019 shutdown_connections 2024-09-10T09:55:19.405 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:18.806+0000 7f89b03fa640 1 -- 172.21.15.71:0/3921251019 wait complete. 2024-09-10T09:55:19.405 INFO:teuthology.orchestra.run.smithi071.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T09:55:19.405 INFO:teuthology.orchestra.run.smithi071.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T09:55:19.405 INFO:teuthology.orchestra.run.smithi071.stdout:Adding host smithi071... 2024-09-10T09:55:19.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:19 smithi071 ceph-mon[27559]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:20.666 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:20 smithi071 ceph-mon[27559]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi071", "addr": "172.21.15.71", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:21.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:21 smithi071 ceph-mon[27559]: Deploying cephadm binary to smithi071 2024-09-10T09:55:23.700 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout Added host 'smithi071' with addr '172.21.15.71' 2024-09-10T09:55:23.701 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.230+0000 7f5fc8f4e640 1 Processor -- start 2024-09-10T09:55:23.701 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.231+0000 7f5fc8f4e640 1 -- start start 2024-09-10T09:55:23.701 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.231+0000 7f5fc8f4e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 0x7f5fc4104cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:23.701 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.231+0000 7f5fc8f4e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc4076ec0 con 0x7f5fc4076ab0 2024-09-10T09:55:23.701 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.231+0000 7f5fc259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 0x7f5fc4104cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:23.701 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.231+0000 7f5fc259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 0x7f5fc4104cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44426/0 (socket says 172.21.15.71:44426) 2024-09-10T09:55:23.701 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.231+0000 7f5fc259c640 1 -- 172.21.15.71:0/1650811442 learned_addr learned my addr 172.21.15.71:0/1650811442 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:23.701 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.232+0000 7f5fc259c640 1 -- 172.21.15.71:0/1650811442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc4105200 con 0x7f5fc4076ab0 2024-09-10T09:55:23.701 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.232+0000 7f5fc259c640 1 --2- 172.21.15.71:0/1650811442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 0x7f5fc4104cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009840 tx=0x7f5fb40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9664aa50fc431439 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:23.701 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.232+0000 7f5fc159a640 1 -- 172.21.15.71:0/1650811442 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fb4032440 con 0x7f5fc4076ab0 2024-09-10T09:55:23.701 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.233+0000 7f5fc159a640 1 -- 172.21.15.71:0/1650811442 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f5fb4032a00 con 0x7f5fc4076ab0 2024-09-10T09:55:23.701 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.233+0000 7f5fc159a640 1 -- 172.21.15.71:0/1650811442 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fb4031a10 con 0x7f5fc4076ab0 2024-09-10T09:55:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.233+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/1650811442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 msgr2=0x7f5fc4104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.233+0000 7f5fc8f4e640 1 --2- 172.21.15.71:0/1650811442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 0x7f5fc4104cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009840 tx=0x7f5fb40091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.233+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/1650811442 shutdown_connections 2024-09-10T09:55:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.233+0000 7f5fc8f4e640 1 --2- 172.21.15.71:0/1650811442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 0x7f5fc4104cc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.233+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/1650811442 >> 172.21.15.71:0/1650811442 conn(0x7f5fc40fc790 msgr2=0x7f5fc40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.233+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/1650811442 shutdown_connections 2024-09-10T09:55:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.233+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/1650811442 wait complete. 2024-09-10T09:55:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.234+0000 7f5fc8f4e640 1 Processor -- start 2024-09-10T09:55:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.234+0000 7f5fc8f4e640 1 -- start start 2024-09-10T09:55:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.234+0000 7f5fc8f4e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 0x7f5fc4110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.234+0000 7f5fc8f4e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc4111360 con 0x7f5fc4076ab0 2024-09-10T09:55:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.234+0000 7f5fc259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 0x7f5fc4110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:23.702 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.234+0000 7f5fc259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 0x7f5fc4110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44428/0 (socket says 172.21.15.71:44428) 2024-09-10T09:55:23.703 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.234+0000 7f5fc259c640 1 -- 172.21.15.71:0/4256367296 learned_addr learned my addr 172.21.15.71:0/4256367296 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:23.703 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.234+0000 7f5fc259c640 1 -- 172.21.15.71:0/4256367296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb4009450 con 0x7f5fc4076ab0 2024-09-10T09:55:23.703 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.235+0000 7f5fc259c640 1 --2- 172.21.15.71:0/4256367296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 0x7f5fc4110e20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40329d0 tx=0x7f5fb402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:23.703 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.235+0000 7f5fb2ffd640 1 -- 172.21.15.71:0/4256367296 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fb4031d10 con 0x7f5fc4076ab0 2024-09-10T09:55:23.703 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.235+0000 7f5fb2ffd640 1 -- 172.21.15.71:0/4256367296 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f5fb4031e70 con 0x7f5fc4076ab0 2024-09-10T09:55:23.703 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.235+0000 7f5fb2ffd640 1 -- 172.21.15.71:0/4256367296 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fb403b670 con 0x7f5fc4076ab0 2024-09-10T09:55:23.703 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.235+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/4256367296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc4111560 con 0x7f5fc4076ab0 2024-09-10T09:55:23.703 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.235+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/4256367296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc4111fb0 con 0x7f5fc4076ab0 2024-09-10T09:55:23.703 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.236+0000 7f5fb2ffd640 1 -- 172.21.15.71:0/4256367296 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f5fb4039070 con 0x7f5fc4076ab0 2024-09-10T09:55:23.703 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.236+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/4256367296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc41003f0 con 0x7f5fc4076ab0 2024-09-10T09:55:23.703 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.236+0000 7f5fb2ffd640 1 --2- 172.21.15.71:0/4256367296 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f5fac0394e0 0x7f5fac03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:23.703 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.236+0000 7f5fb2ffd640 1 -- 172.21.15.71:0/4256367296 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5fb406d010 con 0x7f5fc4076ab0 2024-09-10T09:55:23.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.236+0000 7f5fc1d9b640 1 --2- 172.21.15.71:0/4256367296 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f5fac0394e0 0x7f5fac03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:23.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.237+0000 7f5fc1d9b640 1 --2- 172.21.15.71:0/4256367296 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f5fac0394e0 0x7f5fac03b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8006fd0 tx=0x7f5fb8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:23.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.241+0000 7f5fb2ffd640 1 -- 172.21.15.71:0/4256367296 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5fb409f2a0 con 0x7f5fc4076ab0 2024-09-10T09:55:23.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:20.400+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/4256367296 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi071", "addr": "172.21.15.71", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fc40fdb40 con 0x7f5fac0394e0 2024-09-10T09:55:23.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:23.110+0000 7f5fb2ffd640 1 -- 172.21.15.71:0/4256367296 <== mgr.14118 v2:172.21.15.71:6800/4098346293 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f5fc40fdb40 con 0x7f5fac0394e0 2024-09-10T09:55:23.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:23.113+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/4256367296 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f5fac0394e0 msgr2=0x7f5fac03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:23.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:23.113+0000 7f5fc8f4e640 1 --2- 172.21.15.71:0/4256367296 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f5fac0394e0 0x7f5fac03b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8006fd0 tx=0x7f5fb8006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:23.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:23.114+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/4256367296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 msgr2=0x7f5fc4110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:23.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:23.114+0000 7f5fc8f4e640 1 --2- 172.21.15.71:0/4256367296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 0x7f5fc4110e20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40329d0 tx=0x7f5fb402c040 comp rx=0 tx=0).stop 2024-09-10T09:55:23.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:23.114+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/4256367296 shutdown_connections 2024-09-10T09:55:23.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:23.114+0000 7f5fc8f4e640 1 --2- 172.21.15.71:0/4256367296 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f5fac0394e0 0x7f5fac03b990 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:23.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:23.114+0000 7f5fc8f4e640 1 --2- 172.21.15.71:0/4256367296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5fc4076ab0 0x7f5fc4110e20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:23.704 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:23.114+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/4256367296 >> 172.21.15.71:0/4256367296 conn(0x7f5fc40fc790 msgr2=0x7f5fc40fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:23.705 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:23.114+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/4256367296 shutdown_connections 2024-09-10T09:55:23.705 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:23.114+0000 7f5fc8f4e640 1 -- 172.21.15.71:0/4256367296 wait complete. 2024-09-10T09:55:23.705 INFO:teuthology.orchestra.run.smithi071.stdout:Deploying mon service with default placement... 2024-09-10T09:55:24.242 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:24 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:24.242 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:24 smithi071 ceph-mon[27559]: Added host smithi071 2024-09-10T09:55:24.242 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:24 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.062+0000 7fc8cd888640 1 Processor -- start 2024-09-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.062+0000 7fc8cd888640 1 -- start start 2024-09-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.062+0000 7fc8cd888640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 0x7fc8c8101300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.062+0000 7fc8cd888640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8101840 con 0x7fc8c8100ef0 2024-09-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.062+0000 7fc8c6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 0x7fc8c8101300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.062+0000 7fc8c6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 0x7fc8c8101300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34340/0 (socket says 172.21.15.71:34340) 2024-09-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.062+0000 7fc8c6ffd640 1 -- 172.21.15.71:0/2540425875 learned_addr learned my addr 172.21.15.71:0/2540425875 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.063+0000 7fc8c6ffd640 1 -- 172.21.15.71:0/2540425875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c8101980 con 0x7fc8c8100ef0 2024-09-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.063+0000 7fc8c6ffd640 1 --2- 172.21.15.71:0/2540425875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 0x7fc8c8101300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009e50 tx=0x7fc8b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de223eaabbfb12c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.063+0000 7fc8c5ffb640 1 -- 172.21.15.71:0/2540425875 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8b8031560 con 0x7fc8c8100ef0 2024-09-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.064+0000 7fc8c5ffb640 1 -- 172.21.15.71:0/2540425875 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fc8b802d050 con 0x7fc8c8100ef0 2024-09-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.064+0000 7fc8c5ffb640 1 -- 172.21.15.71:0/2540425875 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8b80079b0 con 0x7fc8c8100ef0 2024-09-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.064+0000 7fc8cd888640 1 -- 172.21.15.71:0/2540425875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 msgr2=0x7fc8c8101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.064+0000 7fc8cd888640 1 --2- 172.21.15.71:0/2540425875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 0x7fc8c8101300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009e50 tx=0x7fc8b8009840 comp rx=0 tx=0).stop 2024-09-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.064+0000 7fc8cd888640 1 -- 172.21.15.71:0/2540425875 shutdown_connections 2024-09-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.064+0000 7fc8cd888640 1 --2- 172.21.15.71:0/2540425875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 0x7fc8c8101300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.064+0000 7fc8cd888640 1 -- 172.21.15.71:0/2540425875 >> 172.21.15.71:0/2540425875 conn(0x7fc8c80fc710 msgr2=0x7fc8c80feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.064+0000 7fc8cd888640 1 -- 172.21.15.71:0/2540425875 shutdown_connections 2024-09-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.064+0000 7fc8cd888640 1 -- 172.21.15.71:0/2540425875 wait complete. 2024-09-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.065+0000 7fc8cd888640 1 Processor -- start 2024-09-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.065+0000 7fc8cd888640 1 -- start start 2024-09-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.065+0000 7fc8cd888640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 0x7fc8c81070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.065+0000 7fc8cd888640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c81075f0 con 0x7fc8c8100ef0 2024-09-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.065+0000 7fc8c6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 0x7fc8c81070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.065+0000 7fc8c6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 0x7fc8c81070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34342/0 (socket says 172.21.15.71:34342) 2024-09-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.065+0000 7fc8c6ffd640 1 -- 172.21.15.71:0/2750418813 learned_addr learned my addr 172.21.15.71:0/2750418813 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.065+0000 7fc8c6ffd640 1 -- 172.21.15.71:0/2750418813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b8009ae0 con 0x7fc8c8100ef0 2024-09-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.066+0000 7fc8c6ffd640 1 --2- 172.21.15.71:0/2750418813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 0x7fc8c81070b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009eb0 tx=0x7fc8b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.066+0000 7fc8bf7fe640 1 -- 172.21.15.71:0/2750418813 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8b803a400 con 0x7fc8c8100ef0 2024-09-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.066+0000 7fc8bf7fe640 1 -- 172.21.15.71:0/2750418813 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fc8b803a9c0 con 0x7fc8c8100ef0 2024-09-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.066+0000 7fc8cd888640 1 -- 172.21.15.71:0/2750418813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c8105680 con 0x7fc8c8100ef0 2024-09-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.066+0000 7fc8bf7fe640 1 -- 172.21.15.71:0/2750418813 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8b80447d0 con 0x7fc8c8100ef0 2024-09-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.066+0000 7fc8cd888640 1 -- 172.21.15.71:0/2750418813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c8105af0 con 0x7fc8c8100ef0 2024-09-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.067+0000 7fc8bf7fe640 1 -- 172.21.15.71:0/2750418813 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fc8b8038040 con 0x7fc8c8100ef0 2024-09-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.067+0000 7fc8cd888640 1 -- 172.21.15.71:0/2750418813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c8100350 con 0x7fc8c8100ef0 2024-09-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.067+0000 7fc8bf7fe640 1 --2- 172.21.15.71:0/2750418813 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fc8b40394e0 0x7fc8b403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.067+0000 7fc8bf7fe640 1 -- 172.21.15.71:0/2750418813 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc8b8040030 con 0x7fc8c8100ef0 2024-09-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.067+0000 7fc8c67fc640 1 --2- 172.21.15.71:0/2750418813 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fc8b40394e0 0x7fc8b403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.067+0000 7fc8c67fc640 1 --2- 172.21.15.71:0/2750418813 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fc8b40394e0 0x7fc8b403b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0006fd0 tx=0x7fc8b0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.071+0000 7fc8bf7fe640 1 -- 172.21.15.71:0/2750418813 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc8b8042b20 con 0x7fc8c8100ef0 2024-09-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.241+0000 7fc8cd888640 1 -- 172.21.15.71:0/2750418813 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8c810ab60 con 0x7fc8b40394e0 2024-09-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.248+0000 7fc8bf7fe640 1 -- 172.21.15.71:0/2750418813 <== mgr.14118 v2:172.21.15.71:6800/4098346293 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc8c810ab60 con 0x7fc8b40394e0 2024-09-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.250+0000 7fc8cd888640 1 -- 172.21.15.71:0/2750418813 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fc8b40394e0 msgr2=0x7fc8b403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.250+0000 7fc8cd888640 1 --2- 172.21.15.71:0/2750418813 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fc8b40394e0 0x7fc8b403b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0006fd0 tx=0x7fc8b0006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.250+0000 7fc8cd888640 1 -- 172.21.15.71:0/2750418813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 msgr2=0x7fc8c81070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.250+0000 7fc8cd888640 1 --2- 172.21.15.71:0/2750418813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 0x7fc8c81070b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009eb0 tx=0x7fc8b8009840 comp rx=0 tx=0).stop 2024-09-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.250+0000 7fc8cd888640 1 -- 172.21.15.71:0/2750418813 shutdown_connections 2024-09-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.250+0000 7fc8cd888640 1 --2- 172.21.15.71:0/2750418813 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fc8b40394e0 0x7fc8b403b990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.250+0000 7fc8cd888640 1 --2- 172.21.15.71:0/2750418813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8c8100ef0 0x7fc8c81070b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.250+0000 7fc8cd888640 1 -- 172.21.15.71:0/2750418813 >> 172.21.15.71:0/2750418813 conn(0x7fc8c80fc710 msgr2=0x7fc8c80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.250+0000 7fc8cd888640 1 -- 172.21.15.71:0/2750418813 shutdown_connections 2024-09-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:24.250+0000 7fc8cd888640 1 -- 172.21.15.71:0/2750418813 wait complete. 2024-09-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi071.stdout:Deploying mgr service with default placement... 2024-09-10T09:55:25.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:25 smithi071 ceph-mon[27559]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:25.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:25 smithi071 ceph-mon[27559]: Saving service mon spec with placement count:5 2024-09-10T09:55:25.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:25 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T09:55:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.405+0000 7f8c4c27c640 1 Processor -- start 2024-09-10T09:55:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.405+0000 7f8c4c27c640 1 -- start start 2024-09-10T09:55:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.405+0000 7f8c4c27c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 0x7f8c441023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.405+0000 7f8c4c27c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c441028e0 con 0x7f8c44101f90 2024-09-10T09:55:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.405+0000 7f8c4a018640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 0x7f8c441023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.405+0000 7f8c4a018640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 0x7f8c441023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34354/0 (socket says 172.21.15.71:34354) 2024-09-10T09:55:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.405+0000 7f8c4a018640 1 -- 172.21.15.71:0/433324732 learned_addr learned my addr 172.21.15.71:0/433324732 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:26.454 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.406+0000 7f8c4a018640 1 -- 172.21.15.71:0/433324732 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c44102a20 con 0x7f8c44101f90 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.406+0000 7f8c4a018640 1 --2- 172.21.15.71:0/433324732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 0x7f8c441023a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009840 tx=0x7f8c400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f78fd0b629f612 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.407+0000 7f8c49016640 1 -- 172.21.15.71:0/433324732 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c40032440 con 0x7f8c44101f90 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.407+0000 7f8c49016640 1 -- 172.21.15.71:0/433324732 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f8c40032a00 con 0x7f8c44101f90 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.407+0000 7f8c49016640 1 -- 172.21.15.71:0/433324732 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c400319e0 con 0x7f8c44101f90 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.407+0000 7f8c4c27c640 1 -- 172.21.15.71:0/433324732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 msgr2=0x7f8c441023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.407+0000 7f8c4c27c640 1 --2- 172.21.15.71:0/433324732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 0x7f8c441023a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009840 tx=0x7f8c400091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.407+0000 7f8c4c27c640 1 -- 172.21.15.71:0/433324732 shutdown_connections 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.407+0000 7f8c4c27c640 1 --2- 172.21.15.71:0/433324732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 0x7f8c441023a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.407+0000 7f8c4c27c640 1 -- 172.21.15.71:0/433324732 >> 172.21.15.71:0/433324732 conn(0x7f8c440fd710 msgr2=0x7f8c440ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.407+0000 7f8c4c27c640 1 -- 172.21.15.71:0/433324732 shutdown_connections 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.407+0000 7f8c4c27c640 1 -- 172.21.15.71:0/433324732 wait complete. 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.408+0000 7f8c4c27c640 1 Processor -- start 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.408+0000 7f8c4c27c640 1 -- start start 2024-09-10T09:55:26.455 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.408+0000 7f8c4c27c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 0x7f8c44110ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:26.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.408+0000 7f8c4c27c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c44111220 con 0x7f8c44101f90 2024-09-10T09:55:26.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.408+0000 7f8c4a018640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 0x7f8c44110ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:26.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.408+0000 7f8c4a018640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 0x7f8c44110ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34364/0 (socket says 172.21.15.71:34364) 2024-09-10T09:55:26.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.408+0000 7f8c4a018640 1 -- 172.21.15.71:0/2538074854 learned_addr learned my addr 172.21.15.71:0/2538074854 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:26.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.408+0000 7f8c4a018640 1 -- 172.21.15.71:0/2538074854 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c40009450 con 0x7f8c44101f90 2024-09-10T09:55:26.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.409+0000 7f8c4a018640 1 --2- 172.21.15.71:0/2538074854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 0x7f8c44110ce0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8c40000c00 tx=0x7f8c40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:26.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.409+0000 7f8c3affd640 1 -- 172.21.15.71:0/2538074854 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c4003d450 con 0x7f8c44101f90 2024-09-10T09:55:26.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.409+0000 7f8c3affd640 1 -- 172.21.15.71:0/2538074854 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f8c4003da10 con 0x7f8c44101f90 2024-09-10T09:55:26.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.409+0000 7f8c3affd640 1 -- 172.21.15.71:0/2538074854 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c4003b8e0 con 0x7f8c44101f90 2024-09-10T09:55:26.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.409+0000 7f8c4c27c640 1 -- 172.21.15.71:0/2538074854 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c44111420 con 0x7f8c44101f90 2024-09-10T09:55:26.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.409+0000 7f8c4c27c640 1 -- 172.21.15.71:0/2538074854 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c44111890 con 0x7f8c44101f90 2024-09-10T09:55:26.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.410+0000 7f8c3affd640 1 -- 172.21.15.71:0/2538074854 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f8c40039070 con 0x7f8c44101f90 2024-09-10T09:55:26.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.410+0000 7f8c4c27c640 1 -- 172.21.15.71:0/2538074854 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4404b720 con 0x7f8c44101f90 2024-09-10T09:55:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.410+0000 7f8c3affd640 1 --2- 172.21.15.71:0/2538074854 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f8c300394e0 0x7f8c3003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.410+0000 7f8c3affd640 1 -- 172.21.15.71:0/2538074854 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8c4006d1c0 con 0x7f8c44101f90 2024-09-10T09:55:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.410+0000 7f8c49817640 1 --2- 172.21.15.71:0/2538074854 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f8c300394e0 0x7f8c3003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.410+0000 7f8c49817640 1 --2- 172.21.15.71:0/2538074854 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f8c300394e0 0x7f8c3003b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c34006fd0 tx=0x7f8c34006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.414+0000 7f8c3affd640 1 -- 172.21.15.71:0/2538074854 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8c4003db80 con 0x7f8c44101f90 2024-09-10T09:55:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.583+0000 7f8c4c27c640 1 -- 172.21.15.71:0/2538074854 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c44111890 con 0x7f8c300394e0 2024-09-10T09:55:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.587+0000 7f8c3affd640 1 -- 172.21.15.71:0/2538074854 <== mgr.14118 v2:172.21.15.71:6800/4098346293 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8c44111890 con 0x7f8c300394e0 2024-09-10T09:55:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.589+0000 7f8c4c27c640 1 -- 172.21.15.71:0/2538074854 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f8c300394e0 msgr2=0x7f8c3003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.589+0000 7f8c4c27c640 1 --2- 172.21.15.71:0/2538074854 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f8c300394e0 0x7f8c3003b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c34006fd0 tx=0x7f8c34006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.589+0000 7f8c4c27c640 1 -- 172.21.15.71:0/2538074854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 msgr2=0x7f8c44110ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.589+0000 7f8c4c27c640 1 --2- 172.21.15.71:0/2538074854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 0x7f8c44110ce0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8c40000c00 tx=0x7f8c40008040 comp rx=0 tx=0).stop 2024-09-10T09:55:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.589+0000 7f8c4c27c640 1 -- 172.21.15.71:0/2538074854 shutdown_connections 2024-09-10T09:55:26.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.590+0000 7f8c4c27c640 1 --2- 172.21.15.71:0/2538074854 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f8c300394e0 0x7f8c3003b990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:26.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.590+0000 7f8c4c27c640 1 --2- 172.21.15.71:0/2538074854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c44101f90 0x7f8c44110ce0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:26.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.590+0000 7f8c4c27c640 1 -- 172.21.15.71:0/2538074854 >> 172.21.15.71:0/2538074854 conn(0x7f8c440fd710 msgr2=0x7f8c440fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:26.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.590+0000 7f8c4c27c640 1 -- 172.21.15.71:0/2538074854 shutdown_connections 2024-09-10T09:55:26.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:25.590+0000 7f8c4c27c640 1 -- 172.21.15.71:0/2538074854 wait complete. 2024-09-10T09:55:26.458 INFO:teuthology.orchestra.run.smithi071.stdout:Deploying crash service with default placement... 2024-09-10T09:55:26.702 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:26 smithi071 ceph-mon[27559]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:26.702 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:26 smithi071 ceph-mon[27559]: Saving service mgr spec with placement count:2 2024-09-10T09:55:26.702 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:26 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:26.702 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:26 smithi071 ceph-mon[27559]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:55:28.098 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:28 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:28.098 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:28 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:28.098 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:28 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:28.105 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-10T09:55:28.105 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.327+0000 7fb622b73640 1 Processor -- start 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.327+0000 7fb622b73640 1 -- start start 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.327+0000 7fb622b73640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 0x7fb61c107020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.327+0000 7fb622b73640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c076dd0 con 0x7fb61c0769c0 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.327+0000 7fb62090f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 0x7fb61c107020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.327+0000 7fb62090f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 0x7fb61c107020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34380/0 (socket says 172.21.15.71:34380) 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.327+0000 7fb62090f640 1 -- 172.21.15.71:0/1742615297 learned_addr learned my addr 172.21.15.71:0/1742615297 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.327+0000 7fb62090f640 1 -- 172.21.15.71:0/1742615297 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c076f10 con 0x7fb61c0769c0 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.328+0000 7fb62090f640 1 --2- 172.21.15.71:0/1742615297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 0x7fb61c107020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb610009840 tx=0x7fb6100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c028db8674285c54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.328+0000 7fb61b7fe640 1 -- 172.21.15.71:0/1742615297 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb610032440 con 0x7fb61c0769c0 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.328+0000 7fb61b7fe640 1 -- 172.21.15.71:0/1742615297 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb610032a40 con 0x7fb61c0769c0 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.328+0000 7fb61b7fe640 1 -- 172.21.15.71:0/1742615297 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb610031aa0 con 0x7fb61c0769c0 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.329+0000 7fb622b73640 1 -- 172.21.15.71:0/1742615297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 msgr2=0x7fb61c107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.329+0000 7fb622b73640 1 --2- 172.21.15.71:0/1742615297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 0x7fb61c107020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb610009840 tx=0x7fb6100091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:28.106 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.329+0000 7fb622b73640 1 -- 172.21.15.71:0/1742615297 shutdown_connections 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.329+0000 7fb622b73640 1 --2- 172.21.15.71:0/1742615297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 0x7fb61c107020 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.329+0000 7fb622b73640 1 -- 172.21.15.71:0/1742615297 >> 172.21.15.71:0/1742615297 conn(0x7fb61c0fc6d0 msgr2=0x7fb61c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.329+0000 7fb622b73640 1 -- 172.21.15.71:0/1742615297 shutdown_connections 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.329+0000 7fb622b73640 1 -- 172.21.15.71:0/1742615297 wait complete. 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.329+0000 7fb622b73640 1 Processor -- start 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.329+0000 7fb622b73640 1 -- start start 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.330+0000 7fb622b73640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 0x7fb61c112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.330+0000 7fb622b73640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c113500 con 0x7fb61c0769c0 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.330+0000 7fb62090f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 0x7fb61c112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.330+0000 7fb62090f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 0x7fb61c112fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34384/0 (socket says 172.21.15.71:34384) 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.330+0000 7fb62090f640 1 -- 172.21.15.71:0/2268977690 learned_addr learned my addr 172.21.15.71:0/2268977690 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.330+0000 7fb62090f640 1 -- 172.21.15.71:0/2268977690 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610009450 con 0x7fb61c0769c0 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.330+0000 7fb62090f640 1 --2- 172.21.15.71:0/2268977690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 0x7fb61c112fc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb610009810 tx=0x7fb6100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.330+0000 7fb6197fa640 1 -- 172.21.15.71:0/2268977690 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb6100327b0 con 0x7fb61c0769c0 2024-09-10T09:55:28.107 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.330+0000 7fb6197fa640 1 -- 172.21.15.71:0/2268977690 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb61003b8d0 con 0x7fb61c0769c0 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.330+0000 7fb6197fa640 1 -- 172.21.15.71:0/2268977690 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb61003a6f0 con 0x7fb61c0769c0 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.330+0000 7fb622b73640 1 -- 172.21.15.71:0/2268977690 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61c113700 con 0x7fb61c0769c0 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.330+0000 7fb622b73640 1 -- 172.21.15.71:0/2268977690 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61c113b70 con 0x7fb61c0769c0 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.331+0000 7fb6197fa640 1 -- 172.21.15.71:0/2268977690 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fb610039040 con 0x7fb61c0769c0 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.331+0000 7fb622b73640 1 -- 172.21.15.71:0/2268977690 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61c04b720 con 0x7fb61c0769c0 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.331+0000 7fb6197fa640 1 --2- 172.21.15.71:0/2268977690 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fb60c039490 0x7fb60c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.331+0000 7fb6197fa640 1 -- 172.21.15.71:0/2268977690 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb61006c7d0 con 0x7fb61c0769c0 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.331+0000 7fb61bfff640 1 --2- 172.21.15.71:0/2268977690 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fb60c039490 0x7fb60c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.332+0000 7fb61bfff640 1 --2- 172.21.15.71:0/2268977690 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fb60c039490 0x7fb60c03b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb608006fd0 tx=0x7fb608006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.336+0000 7fb6197fa640 1 -- 172.21.15.71:0/2268977690 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb610030b00 con 0x7fb61c0769c0 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.515+0000 7fb622b73640 1 -- 172.21.15.71:0/2268977690 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fb61c076f10 con 0x7fb60c039490 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.521+0000 7fb6197fa640 1 -- 172.21.15.71:0/2268977690 <== mgr.14118 v2:172.21.15.71:6800/4098346293 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fb61c076f10 con 0x7fb60c039490 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.523+0000 7fb622b73640 1 -- 172.21.15.71:0/2268977690 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fb60c039490 msgr2=0x7fb60c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:28.108 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.523+0000 7fb622b73640 1 --2- 172.21.15.71:0/2268977690 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fb60c039490 0x7fb60c03b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb608006fd0 tx=0x7fb608006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:28.109 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.523+0000 7fb622b73640 1 -- 172.21.15.71:0/2268977690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 msgr2=0x7fb61c112fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:28.109 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.523+0000 7fb622b73640 1 --2- 172.21.15.71:0/2268977690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 0x7fb61c112fc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb610009810 tx=0x7fb6100091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:28.109 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.524+0000 7fb622b73640 1 -- 172.21.15.71:0/2268977690 shutdown_connections 2024-09-10T09:55:28.109 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.524+0000 7fb622b73640 1 --2- 172.21.15.71:0/2268977690 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fb60c039490 0x7fb60c03b940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:28.109 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.524+0000 7fb622b73640 1 --2- 172.21.15.71:0/2268977690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c0769c0 0x7fb61c112fc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:28.109 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.524+0000 7fb622b73640 1 -- 172.21.15.71:0/2268977690 >> 172.21.15.71:0/2268977690 conn(0x7fb61c0fc6d0 msgr2=0x7fb61c0fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:28.109 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.524+0000 7fb622b73640 1 -- 172.21.15.71:0/2268977690 shutdown_connections 2024-09-10T09:55:28.109 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:27.524+0000 7fb622b73640 1 -- 172.21.15.71:0/2268977690 wait complete. 2024-09-10T09:55:28.109 INFO:teuthology.orchestra.run.smithi071.stdout:Deploying prometheus service with default placement... 2024-09-10T09:55:29.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:29 smithi071 ceph-mon[27559]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:29.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:29 smithi071 ceph-mon[27559]: Saving service crash spec with placement * 2024-09-10T09:55:29.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:29 smithi071 ceph-mon[27559]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:55:29.407 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:29 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:29.414 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-10T09:55:29.414 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.482+0000 7febe0dd7640 1 Processor -- start 2024-09-10T09:55:29.414 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.482+0000 7febe0dd7640 1 -- start start 2024-09-10T09:55:29.414 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.482+0000 7febe0dd7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 0x7febdc104c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:29.414 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.482+0000 7febe0dd7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc076ea0 con 0x7febdc076a90 2024-09-10T09:55:29.414 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.483+0000 7febda59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 0x7febdc104c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:29.414 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.483+0000 7febda59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 0x7febdc104c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34392/0 (socket says 172.21.15.71:34392) 2024-09-10T09:55:29.414 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.483+0000 7febda59c640 1 -- 172.21.15.71:0/3581261399 learned_addr learned my addr 172.21.15.71:0/3581261399 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.483+0000 7febda59c640 1 -- 172.21.15.71:0/3581261399 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc1051a0 con 0x7febdc076a90 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.484+0000 7febda59c640 1 --2- 172.21.15.71:0/3581261399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 0x7febdc104c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7febcc009e50 tx=0x7febcc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5744989e53ee996e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.484+0000 7febd959a640 1 -- 172.21.15.71:0/3581261399 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febcc031560 con 0x7febdc076a90 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.484+0000 7febd959a640 1 -- 172.21.15.71:0/3581261399 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7febcc02d050 con 0x7febdc076a90 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.484+0000 7febd959a640 1 -- 172.21.15.71:0/3581261399 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febcc007a60 con 0x7febdc076a90 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.484+0000 7febe0dd7640 1 -- 172.21.15.71:0/3581261399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 msgr2=0x7febdc104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.484+0000 7febe0dd7640 1 --2- 172.21.15.71:0/3581261399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 0x7febdc104c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7febcc009e50 tx=0x7febcc009840 comp rx=0 tx=0).stop 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.484+0000 7febe0dd7640 1 -- 172.21.15.71:0/3581261399 shutdown_connections 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.484+0000 7febe0dd7640 1 --2- 172.21.15.71:0/3581261399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 0x7febdc104c60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.484+0000 7febe0dd7640 1 -- 172.21.15.71:0/3581261399 >> 172.21.15.71:0/3581261399 conn(0x7febdc0fc6d0 msgr2=0x7febdc0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.484+0000 7febe0dd7640 1 -- 172.21.15.71:0/3581261399 shutdown_connections 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.484+0000 7febe0dd7640 1 -- 172.21.15.71:0/3581261399 wait complete. 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.485+0000 7febe0dd7640 1 Processor -- start 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.485+0000 7febe0dd7640 1 -- start start 2024-09-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.485+0000 7febe0dd7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 0x7febdc110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.485+0000 7febe0dd7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc111310 con 0x7febdc076a90 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.485+0000 7febda59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 0x7febdc110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.485+0000 7febda59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 0x7febdc110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34404/0 (socket says 172.21.15.71:34404) 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.485+0000 7febda59c640 1 -- 172.21.15.71:0/2649155498 learned_addr learned my addr 172.21.15.71:0/2649155498 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.486+0000 7febda59c640 1 -- 172.21.15.71:0/2649155498 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc009ae0 con 0x7febdc076a90 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.486+0000 7febda59c640 1 --2- 172.21.15.71:0/2649155498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 0x7febdc110dd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7febcc009e20 tx=0x7febcc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.486+0000 7febcaffd640 1 -- 172.21.15.71:0/2649155498 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febcc03b410 con 0x7febdc076a90 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.486+0000 7febcaffd640 1 -- 172.21.15.71:0/2649155498 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7febcc03ba10 con 0x7febdc076a90 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.486+0000 7febe0dd7640 1 -- 172.21.15.71:0/2649155498 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febdc111510 con 0x7febdc076a90 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.486+0000 7febcaffd640 1 -- 172.21.15.71:0/2649155498 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febcc0458a0 con 0x7febdc076a90 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.486+0000 7febe0dd7640 1 -- 172.21.15.71:0/2649155498 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febdc111f60 con 0x7febdc076a90 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.487+0000 7febcaffd640 1 -- 172.21.15.71:0/2649155498 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7febcc038050 con 0x7febdc076a90 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.487+0000 7febe0dd7640 1 -- 172.21.15.71:0/2649155498 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febdc1002f0 con 0x7febdc076a90 2024-09-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.487+0000 7febcaffd640 1 --2- 172.21.15.71:0/2649155498 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7febc4039490 0x7febc403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.487+0000 7febcaffd640 1 -- 172.21.15.71:0/2649155498 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7febcc06d0d0 con 0x7febdc076a90 2024-09-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.487+0000 7febd9d9b640 1 --2- 172.21.15.71:0/2649155498 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7febc4039490 0x7febc403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.487+0000 7febd9d9b640 1 --2- 172.21.15.71:0/2649155498 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7febc4039490 0x7febc403b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7febd0006fd0 tx=0x7febd0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.491+0000 7febcaffd640 1 -- 172.21.15.71:0/2649155498 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7febcc04d4e0 con 0x7febdc076a90 2024-09-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.684+0000 7febe0dd7640 1 -- 172.21.15.71:0/2649155498 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7febdc0fdbe0 con 0x7febc4039490 2024-09-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.688+0000 7febcaffd640 1 -- 172.21.15.71:0/2649155498 <== mgr.14118 v2:172.21.15.71:6800/4098346293 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7febdc0fdbe0 con 0x7febc4039490 2024-09-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.690+0000 7febe0dd7640 1 -- 172.21.15.71:0/2649155498 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7febc4039490 msgr2=0x7febc403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.690+0000 7febe0dd7640 1 --2- 172.21.15.71:0/2649155498 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7febc4039490 0x7febc403b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7febd0006fd0 tx=0x7febd0006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.690+0000 7febe0dd7640 1 -- 172.21.15.71:0/2649155498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 msgr2=0x7febdc110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.690+0000 7febe0dd7640 1 --2- 172.21.15.71:0/2649155498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 0x7febdc110dd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7febcc009e20 tx=0x7febcc009840 comp rx=0 tx=0).stop 2024-09-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.690+0000 7febe0dd7640 1 -- 172.21.15.71:0/2649155498 shutdown_connections 2024-09-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.690+0000 7febe0dd7640 1 --2- 172.21.15.71:0/2649155498 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7febc4039490 0x7febc403b940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.690+0000 7febe0dd7640 1 --2- 172.21.15.71:0/2649155498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febdc076a90 0x7febdc110dd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.690+0000 7febe0dd7640 1 -- 172.21.15.71:0/2649155498 >> 172.21.15.71:0/2649155498 conn(0x7febdc0fc6d0 msgr2=0x7febdc0fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.690+0000 7febe0dd7640 1 -- 172.21.15.71:0/2649155498 shutdown_connections 2024-09-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:28.690+0000 7febe0dd7640 1 -- 172.21.15.71:0/2649155498 wait complete. 2024-09-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi071.stdout:Deploying grafana service with default placement... 2024-09-10T09:55:30.149 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:30 smithi071 ceph-mon[27559]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:30.149 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:30 smithi071 ceph-mon[27559]: Saving service prometheus spec with placement count:1 2024-09-10T09:55:30.149 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:30 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.147+0000 7fbead476640 1 Processor -- start 2024-09-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.147+0000 7fbead476640 1 -- start start 2024-09-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.147+0000 7fbead476640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 0x7fbea8102780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.147+0000 7fbead476640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8102d50 con 0x7fbea8102370 2024-09-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.148+0000 7fbea6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 0x7fbea8102780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.148+0000 7fbea6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 0x7fbea8102780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34412/0 (socket says 172.21.15.71:34412) 2024-09-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.148+0000 7fbea6ffd640 1 -- 172.21.15.71:0/2954252634 learned_addr learned my addr 172.21.15.71:0/2954252634 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.148+0000 7fbea6ffd640 1 -- 172.21.15.71:0/2954252634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea8102e90 con 0x7fbea8102370 2024-09-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.149+0000 7fbea6ffd640 1 --2- 172.21.15.71:0/2954252634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 0x7fbea8102780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009840 tx=0x7fbe980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634551182a8a6702 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.149+0000 7fbea5ffb640 1 -- 172.21.15.71:0/2954252634 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe98032440 con 0x7fbea8102370 2024-09-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.149+0000 7fbea5ffb640 1 -- 172.21.15.71:0/2954252634 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbe98032a40 con 0x7fbea8102370 2024-09-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.149+0000 7fbea5ffb640 1 -- 172.21.15.71:0/2954252634 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe98031a70 con 0x7fbea8102370 2024-09-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.150+0000 7fbead476640 1 -- 172.21.15.71:0/2954252634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 msgr2=0x7fbea8102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.150+0000 7fbead476640 1 --2- 172.21.15.71:0/2954252634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 0x7fbea8102780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009840 tx=0x7fbe980091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.150+0000 7fbead476640 1 -- 172.21.15.71:0/2954252634 shutdown_connections 2024-09-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.150+0000 7fbead476640 1 --2- 172.21.15.71:0/2954252634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 0x7fbea8102780 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.150+0000 7fbead476640 1 -- 172.21.15.71:0/2954252634 >> 172.21.15.71:0/2954252634 conn(0x7fbea80fbd90 msgr2=0x7fbea80fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.150+0000 7fbead476640 1 -- 172.21.15.71:0/2954252634 shutdown_connections 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.150+0000 7fbead476640 1 -- 172.21.15.71:0/2954252634 wait complete. 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.150+0000 7fbead476640 1 Processor -- start 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.151+0000 7fbead476640 1 -- start start 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.151+0000 7fbead476640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 0x7fbea8112fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.151+0000 7fbead476640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8113510 con 0x7fbea8102370 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.151+0000 7fbea6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 0x7fbea8112fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.151+0000 7fbea6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 0x7fbea8112fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34416/0 (socket says 172.21.15.71:34416) 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.151+0000 7fbea6ffd640 1 -- 172.21.15.71:0/2345652599 learned_addr learned my addr 172.21.15.71:0/2345652599 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.151+0000 7fbea6ffd640 1 -- 172.21.15.71:0/2345652599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009450 con 0x7fbea8102370 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.151+0000 7fbea6ffd640 1 --2- 172.21.15.71:0/2345652599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 0x7fbea8112fd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009810 tx=0x7fbe980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.151+0000 7fbe9f7fe640 1 -- 172.21.15.71:0/2345652599 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe9803c400 con 0x7fbea8102370 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.151+0000 7fbe9f7fe640 1 -- 172.21.15.71:0/2345652599 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbe9803ca00 con 0x7fbea8102370 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.151+0000 7fbe9f7fe640 1 -- 172.21.15.71:0/2345652599 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe9803a870 con 0x7fbea8102370 2024-09-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.151+0000 7fbead476640 1 -- 172.21.15.71:0/2345652599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea8113710 con 0x7fbea8102370 2024-09-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.151+0000 7fbead476640 1 -- 172.21.15.71:0/2345652599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea8113b80 con 0x7fbea8102370 2024-09-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.152+0000 7fbe9f7fe640 1 -- 172.21.15.71:0/2345652599 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fbe9803aae0 con 0x7fbea8102370 2024-09-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.152+0000 7fbead476640 1 -- 172.21.15.71:0/2345652599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea804b720 con 0x7fbea8102370 2024-09-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.153+0000 7fbe9f7fe640 1 --2- 172.21.15.71:0/2345652599 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fbe940394e0 0x7fbe9403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.153+0000 7fbe9f7fe640 1 -- 172.21.15.71:0/2345652599 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fbe9806ccd0 con 0x7fbea8102370 2024-09-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.153+0000 7fbea67fc640 1 --2- 172.21.15.71:0/2345652599 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fbe940394e0 0x7fbe9403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.153+0000 7fbea67fc640 1 --2- 172.21.15.71:0/2345652599 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fbe940394e0 0x7fbe9403b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbe90006fd0 tx=0x7fbe90006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.159+0000 7fbe9f7fe640 1 -- 172.21.15.71:0/2345652599 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbe98072020 con 0x7fbea8102370 2024-09-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.331+0000 7fbead476640 1 -- 172.21.15.71:0/2345652599 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fbea8113b80 con 0x7fbe940394e0 2024-09-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.339+0000 7fbe9f7fe640 1 -- 172.21.15.71:0/2345652599 <== mgr.14118 v2:172.21.15.71:6800/4098346293 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fbea8113b80 con 0x7fbe940394e0 2024-09-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.341+0000 7fbead476640 1 -- 172.21.15.71:0/2345652599 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fbe940394e0 msgr2=0x7fbe9403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.341+0000 7fbead476640 1 --2- 172.21.15.71:0/2345652599 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fbe940394e0 0x7fbe9403b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbe90006fd0 tx=0x7fbe90006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.341+0000 7fbead476640 1 -- 172.21.15.71:0/2345652599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 msgr2=0x7fbea8112fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.341+0000 7fbead476640 1 --2- 172.21.15.71:0/2345652599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 0x7fbea8112fd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009810 tx=0x7fbe980091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.341+0000 7fbead476640 1 -- 172.21.15.71:0/2345652599 shutdown_connections 2024-09-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.341+0000 7fbead476640 1 --2- 172.21.15.71:0/2345652599 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fbe940394e0 0x7fbe9403b990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.342+0000 7fbead476640 1 --2- 172.21.15.71:0/2345652599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea8102370 0x7fbea8112fd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.342+0000 7fbead476640 1 -- 172.21.15.71:0/2345652599 >> 172.21.15.71:0/2345652599 conn(0x7fbea80fbd90 msgr2=0x7fbea80fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.342+0000 7fbead476640 1 -- 172.21.15.71:0/2345652599 shutdown_connections 2024-09-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:30.342+0000 7fbead476640 1 -- 172.21.15.71:0/2345652599 wait complete. 2024-09-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi071.stdout:Deploying node-exporter service with default placement... 2024-09-10T09:55:31.537 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:31 smithi071 ceph-mon[27559]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:55:31.537 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:31 smithi071 ceph-mon[27559]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:31.537 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:31 smithi071 ceph-mon[27559]: Saving service grafana spec with placement count:1 2024-09-10T09:55:31.537 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:31 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:31.537 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:31 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:32.208 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-10T09:55:32.208 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.333+0000 7f5517cc0640 1 Processor -- start 2024-09-10T09:55:32.208 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.333+0000 7f5517cc0640 1 -- start start 2024-09-10T09:55:32.208 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.333+0000 7f5517cc0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 0x7f5510104b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:32.208 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.333+0000 7f5517cc0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5510105040 con 0x7f5510076c40 2024-09-10T09:55:32.208 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.334+0000 7f5515a5c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 0x7f5510104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.334+0000 7f5515a5c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 0x7f5510104b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34426/0 (socket says 172.21.15.71:34426) 2024-09-10T09:55:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.334+0000 7f5515a5c640 1 -- 172.21.15.71:0/4252699069 learned_addr learned my addr 172.21.15.71:0/4252699069 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.334+0000 7f5515a5c640 1 -- 172.21.15.71:0/4252699069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5510105180 con 0x7f5510076c40 2024-09-10T09:55:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.335+0000 7f5515a5c640 1 --2- 172.21.15.71:0/4252699069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 0x7f5510104b00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f550c009840 tx=0x7f550c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb920450906dd212 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.335+0000 7f5514a5a640 1 -- 172.21.15.71:0/4252699069 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f550c032440 con 0x7f5510076c40 2024-09-10T09:55:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.335+0000 7f5514a5a640 1 -- 172.21.15.71:0/4252699069 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f550c032a40 con 0x7f5510076c40 2024-09-10T09:55:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.335+0000 7f5514a5a640 1 -- 172.21.15.71:0/4252699069 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f550c031a70 con 0x7f5510076c40 2024-09-10T09:55:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.335+0000 7f5517cc0640 1 -- 172.21.15.71:0/4252699069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 msgr2=0x7f5510104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.335+0000 7f5517cc0640 1 --2- 172.21.15.71:0/4252699069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 0x7f5510104b00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f550c009840 tx=0x7f550c0091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:32.209 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.335+0000 7f5517cc0640 1 -- 172.21.15.71:0/4252699069 shutdown_connections 2024-09-10T09:55:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.335+0000 7f5517cc0640 1 --2- 172.21.15.71:0/4252699069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 0x7f5510104b00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.335+0000 7f5517cc0640 1 -- 172.21.15.71:0/4252699069 >> 172.21.15.71:0/4252699069 conn(0x7f55100fc590 msgr2=0x7f55100fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.336+0000 7f5517cc0640 1 -- 172.21.15.71:0/4252699069 shutdown_connections 2024-09-10T09:55:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.336+0000 7f5517cc0640 1 -- 172.21.15.71:0/4252699069 wait complete. 2024-09-10T09:55:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.336+0000 7f5517cc0640 1 Processor -- start 2024-09-10T09:55:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.336+0000 7f5517cc0640 1 -- start start 2024-09-10T09:55:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.336+0000 7f5517cc0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 0x7f5510110e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.336+0000 7f5517cc0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55101113a0 con 0x7f5510076c40 2024-09-10T09:55:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.337+0000 7f5515a5c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 0x7f5510110e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.337+0000 7f5515a5c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 0x7f5510110e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34440/0 (socket says 172.21.15.71:34440) 2024-09-10T09:55:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.337+0000 7f5515a5c640 1 -- 172.21.15.71:0/398186986 learned_addr learned my addr 172.21.15.71:0/398186986 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:32.210 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.337+0000 7f5515a5c640 1 -- 172.21.15.71:0/398186986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c009450 con 0x7f5510076c40 2024-09-10T09:55:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.337+0000 7f5515a5c640 1 --2- 172.21.15.71:0/398186986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 0x7f5510110e60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f550c031750 tx=0x7f550c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.341+0000 7f55067fc640 1 -- 172.21.15.71:0/398186986 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f550c03c400 con 0x7f5510076c40 2024-09-10T09:55:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.341+0000 7f55067fc640 1 -- 172.21.15.71:0/398186986 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f550c03ca00 con 0x7f5510076c40 2024-09-10T09:55:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.341+0000 7f5517cc0640 1 -- 172.21.15.71:0/398186986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55101115a0 con 0x7f5510076c40 2024-09-10T09:55:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.341+0000 7f55067fc640 1 -- 172.21.15.71:0/398186986 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f550c03a880 con 0x7f5510076c40 2024-09-10T09:55:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.341+0000 7f5517cc0640 1 -- 172.21.15.71:0/398186986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5510111ff0 con 0x7f5510076c40 2024-09-10T09:55:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.342+0000 7f55067fc640 1 -- 172.21.15.71:0/398186986 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f550c03aaf0 con 0x7f5510076c40 2024-09-10T09:55:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.343+0000 7f55067fc640 1 --2- 172.21.15.71:0/398186986 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f54fc039490 0x7f54fc03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.343+0000 7f5517cc0640 1 -- 172.21.15.71:0/398186986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551005ed70 con 0x7f5510076c40 2024-09-10T09:55:32.211 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.343+0000 7f55067fc640 1 -- 172.21.15.71:0/398186986 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f550c06cef0 con 0x7f5510076c40 2024-09-10T09:55:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.343+0000 7f551525b640 1 --2- 172.21.15.71:0/398186986 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f54fc039490 0x7f54fc03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.343+0000 7f551525b640 1 --2- 172.21.15.71:0/398186986 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f54fc039490 0x7f54fc03b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f550800ad90 tx=0x7f5508009410 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.351+0000 7f55067fc640 1 -- 172.21.15.71:0/398186986 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f550c030340 con 0x7f5510076c40 2024-09-10T09:55:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.548+0000 7f5517cc0640 1 -- 172.21.15.71:0/398186986 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f55100fda10 con 0x7f54fc039490 2024-09-10T09:55:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.555+0000 7f55067fc640 1 -- 172.21.15.71:0/398186986 <== mgr.14118 v2:172.21.15.71:6800/4098346293 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f55100fda10 con 0x7f54fc039490 2024-09-10T09:55:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.557+0000 7f5517cc0640 1 -- 172.21.15.71:0/398186986 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f54fc039490 msgr2=0x7f54fc03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.557+0000 7f5517cc0640 1 --2- 172.21.15.71:0/398186986 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f54fc039490 0x7f54fc03b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f550800ad90 tx=0x7f5508009410 comp rx=0 tx=0).stop 2024-09-10T09:55:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.557+0000 7f5517cc0640 1 -- 172.21.15.71:0/398186986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 msgr2=0x7f5510110e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.557+0000 7f5517cc0640 1 --2- 172.21.15.71:0/398186986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 0x7f5510110e60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f550c031750 tx=0x7f550c0091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.557+0000 7f5517cc0640 1 -- 172.21.15.71:0/398186986 shutdown_connections 2024-09-10T09:55:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.557+0000 7f5517cc0640 1 --2- 172.21.15.71:0/398186986 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f54fc039490 0x7f54fc03b940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.557+0000 7f5517cc0640 1 --2- 172.21.15.71:0/398186986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5510076c40 0x7f5510110e60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:32.212 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.557+0000 7f5517cc0640 1 -- 172.21.15.71:0/398186986 >> 172.21.15.71:0/398186986 conn(0x7f55100fc590 msgr2=0x7f55100fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:32.213 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.557+0000 7f5517cc0640 1 -- 172.21.15.71:0/398186986 shutdown_connections 2024-09-10T09:55:32.213 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:31.557+0000 7f5517cc0640 1 -- 172.21.15.71:0/398186986 wait complete. 2024-09-10T09:55:32.213 INFO:teuthology.orchestra.run.smithi071.stdout:Deploying alertmanager service with default placement... 2024-09-10T09:55:32.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:32 smithi071 ceph-mon[27559]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:32.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:32 smithi071 ceph-mon[27559]: Saving service node-exporter spec with placement * 2024-09-10T09:55:32.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:32 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:32.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:32 smithi071 ceph-mon[27559]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:55:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-10T09:55:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.311+0000 7fabb4b23640 1 Processor -- start 2024-09-10T09:55:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.311+0000 7fabb4b23640 1 -- start start 2024-09-10T09:55:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.312+0000 7fabb4b23640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 0x7fabb01012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.312+0000 7fabb4b23640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb01017e0 con 0x7fabb0100e90 2024-09-10T09:55:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.312+0000 7fabae59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 0x7fabb01012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.312+0000 7fabae59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 0x7fabb01012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40902/0 (socket says 172.21.15.71:40902) 2024-09-10T09:55:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.312+0000 7fabae59c640 1 -- 172.21.15.71:0/3587347693 learned_addr learned my addr 172.21.15.71:0/3587347693 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.312+0000 7fabae59c640 1 -- 172.21.15.71:0/3587347693 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb0101920 con 0x7fabb0100e90 2024-09-10T09:55:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.313+0000 7fabae59c640 1 --2- 172.21.15.71:0/3587347693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 0x7fabb01012a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faba000d0d0 tx=0x7faba000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8874b11d2a58d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.313+0000 7fabad59a640 1 -- 172.21.15.71:0/3587347693 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faba000b440 con 0x7fabb0100e90 2024-09-10T09:55:34.053 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.313+0000 7fabad59a640 1 -- 172.21.15.71:0/3587347693 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faba0009ab0 con 0x7fabb0100e90 2024-09-10T09:55:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.313+0000 7fabad59a640 1 -- 172.21.15.71:0/3587347693 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faba0031b90 con 0x7fabb0100e90 2024-09-10T09:55:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.313+0000 7fabb4b23640 1 -- 172.21.15.71:0/3587347693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 msgr2=0x7fabb01012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.313+0000 7fabb4b23640 1 --2- 172.21.15.71:0/3587347693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 0x7fabb01012a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faba000d0d0 tx=0x7faba000ba50 comp rx=0 tx=0).stop 2024-09-10T09:55:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.314+0000 7fabb4b23640 1 -- 172.21.15.71:0/3587347693 shutdown_connections 2024-09-10T09:55:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.314+0000 7fabb4b23640 1 --2- 172.21.15.71:0/3587347693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 0x7fabb01012a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.314+0000 7fabb4b23640 1 -- 172.21.15.71:0/3587347693 >> 172.21.15.71:0/3587347693 conn(0x7fabb00fc6d0 msgr2=0x7fabb00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.314+0000 7fabb4b23640 1 -- 172.21.15.71:0/3587347693 shutdown_connections 2024-09-10T09:55:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.314+0000 7fabb4b23640 1 -- 172.21.15.71:0/3587347693 wait complete. 2024-09-10T09:55:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.314+0000 7fabb4b23640 1 Processor -- start 2024-09-10T09:55:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.314+0000 7fabb4b23640 1 -- start start 2024-09-10T09:55:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.314+0000 7fabb4b23640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 0x7fabb010ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.314+0000 7fabb4b23640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb010f110 con 0x7fabb0100e90 2024-09-10T09:55:34.054 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.314+0000 7fabae59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 0x7fabb010ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.314+0000 7fabae59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 0x7fabb010ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40916/0 (socket says 172.21.15.71:40916) 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.314+0000 7fabae59c640 1 -- 172.21.15.71:0/2947320069 learned_addr learned my addr 172.21.15.71:0/2947320069 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.315+0000 7fabae59c640 1 -- 172.21.15.71:0/2947320069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba000bcf0 con 0x7fabb0100e90 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.315+0000 7fabae59c640 1 --2- 172.21.15.71:0/2947320069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 0x7fabb010ebd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faba0007030 tx=0x7faba000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.315+0000 7faba6ffd640 1 -- 172.21.15.71:0/2947320069 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faba003a420 con 0x7fabb0100e90 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.315+0000 7faba6ffd640 1 -- 172.21.15.71:0/2947320069 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faba003aa20 con 0x7fabb0100e90 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.315+0000 7faba6ffd640 1 -- 172.21.15.71:0/2947320069 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faba00459d0 con 0x7fabb0100e90 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.315+0000 7fabb4b23640 1 -- 172.21.15.71:0/2947320069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb010f310 con 0x7fabb0100e90 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.315+0000 7fabb4b23640 1 -- 172.21.15.71:0/2947320069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb010f780 con 0x7fabb0100e90 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.316+0000 7faba6ffd640 1 -- 172.21.15.71:0/2947320069 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7faba003ab90 con 0x7fabb0100e90 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.316+0000 7faba6ffd640 1 --2- 172.21.15.71:0/2947320069 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fab9c0394e0 0x7fab9c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.316+0000 7fabb4b23640 1 -- 172.21.15.71:0/2947320069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb004b720 con 0x7fabb0100e90 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.316+0000 7faba6ffd640 1 -- 172.21.15.71:0/2947320069 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7faba006f6b0 con 0x7fabb0100e90 2024-09-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.316+0000 7fabadd9b640 1 --2- 172.21.15.71:0/2947320069 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fab9c0394e0 0x7fab9c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.317+0000 7fabadd9b640 1 --2- 172.21.15.71:0/2947320069 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fab9c0394e0 0x7fab9c03b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fab98006fd0 tx=0x7fab98006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.321+0000 7faba6ffd640 1 -- 172.21.15.71:0/2947320069 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faba0035070 con 0x7fabb0100e90 2024-09-10T09:55:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.484+0000 7fabb4b23640 1 -- 172.21.15.71:0/2947320069 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fabb0110130 con 0x7fab9c0394e0 2024-09-10T09:55:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.489+0000 7faba6ffd640 1 -- 172.21.15.71:0/2947320069 <== mgr.14118 v2:172.21.15.71:6800/4098346293 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fabb0110130 con 0x7fab9c0394e0 2024-09-10T09:55:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.491+0000 7fabb4b23640 1 -- 172.21.15.71:0/2947320069 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fab9c0394e0 msgr2=0x7fab9c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.491+0000 7fabb4b23640 1 --2- 172.21.15.71:0/2947320069 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fab9c0394e0 0x7fab9c03b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fab98006fd0 tx=0x7fab98006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.491+0000 7fabb4b23640 1 -- 172.21.15.71:0/2947320069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 msgr2=0x7fabb010ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.491+0000 7fabb4b23640 1 --2- 172.21.15.71:0/2947320069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 0x7fabb010ebd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faba0007030 tx=0x7faba000ba50 comp rx=0 tx=0).stop 2024-09-10T09:55:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.491+0000 7fabb4b23640 1 -- 172.21.15.71:0/2947320069 shutdown_connections 2024-09-10T09:55:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.491+0000 7fabb4b23640 1 --2- 172.21.15.71:0/2947320069 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fab9c0394e0 0x7fab9c03b990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.491+0000 7fabb4b23640 1 --2- 172.21.15.71:0/2947320069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabb0100e90 0x7fabb010ebd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.491+0000 7fabb4b23640 1 -- 172.21.15.71:0/2947320069 >> 172.21.15.71:0/2947320069 conn(0x7fabb00fc6d0 msgr2=0x7fabb0105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.491+0000 7fabb4b23640 1 -- 172.21.15.71:0/2947320069 shutdown_connections 2024-09-10T09:55:34.057 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:33.491+0000 7fabb4b23640 1 -- 172.21.15.71:0/2947320069 wait complete. 2024-09-10T09:55:34.624 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:34 smithi071 ceph-mon[27559]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:34.624 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:34 smithi071 ceph-mon[27559]: Saving service alertmanager spec with placement count:1 2024-09-10T09:55:34.624 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:34 smithi071 ceph-mon[27559]: from='mgr.14118 172.21.15.71:0/2269673378' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.453+0000 7fe9a7790640 1 Processor -- start 2024-09-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.453+0000 7fe9a7790640 1 -- start start 2024-09-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.453+0000 7fe9a7790640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 0x7fe9a0077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.453+0000 7fe9a7790640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0078fa0 con 0x7fe9a0078b00 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.453+0000 7fe9a552c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 0x7fe9a0077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.453+0000 7fe9a552c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 0x7fe9a0077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40920/0 (socket says 172.21.15.71:40920) 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.453+0000 7fe9a552c640 1 -- 172.21.15.71:0/2000003334 learned_addr learned my addr 172.21.15.71:0/2000003334 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.453+0000 7fe9a552c640 1 -- 172.21.15.71:0/2000003334 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a00790e0 con 0x7fe9a0078b00 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.454+0000 7fe9a552c640 1 --2- 172.21.15.71:0/2000003334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 0x7fe9a0077210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009840 tx=0x7fe99c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45bc5ff18de0f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.454+0000 7fe993fff640 1 -- 172.21.15.71:0/2000003334 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe99c032440 con 0x7fe9a0078b00 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.454+0000 7fe993fff640 1 -- 172.21.15.71:0/2000003334 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe99c032a40 con 0x7fe9a0078b00 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.454+0000 7fe993fff640 1 -- 172.21.15.71:0/2000003334 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe99c031a70 con 0x7fe9a0078b00 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.455+0000 7fe9a7790640 1 -- 172.21.15.71:0/2000003334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 msgr2=0x7fe9a0077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.455+0000 7fe9a7790640 1 --2- 172.21.15.71:0/2000003334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 0x7fe9a0077210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009840 tx=0x7fe99c0091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.455+0000 7fe9a7790640 1 -- 172.21.15.71:0/2000003334 shutdown_connections 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.455+0000 7fe9a7790640 1 --2- 172.21.15.71:0/2000003334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 0x7fe9a0077210 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.455+0000 7fe9a7790640 1 -- 172.21.15.71:0/2000003334 >> 172.21.15.71:0/2000003334 conn(0x7fe9a00fd850 msgr2=0x7fe9a00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.455+0000 7fe9a7790640 1 -- 172.21.15.71:0/2000003334 shutdown_connections 2024-09-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.455+0000 7fe9a7790640 1 -- 172.21.15.71:0/2000003334 wait complete. 2024-09-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.455+0000 7fe9a7790640 1 Processor -- start 2024-09-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.456+0000 7fe9a7790640 1 -- start start 2024-09-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.456+0000 7fe9a7790640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 0x7fe9a0112fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.456+0000 7fe9a7790640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0113520 con 0x7fe9a0078b00 2024-09-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.456+0000 7fe9a552c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 0x7fe9a0112fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.456+0000 7fe9a552c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 0x7fe9a0112fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40924/0 (socket says 172.21.15.71:40924) 2024-09-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.456+0000 7fe9a552c640 1 -- 172.21.15.71:0/47582734 learned_addr learned my addr 172.21.15.71:0/47582734 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.456+0000 7fe9a552c640 1 -- 172.21.15.71:0/47582734 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c009450 con 0x7fe9a0078b00 2024-09-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.456+0000 7fe9a552c640 1 --2- 172.21.15.71:0/47582734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 0x7fe9a0112fe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe99c035040 tx=0x7fe99c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.456+0000 7fe991ffb640 1 -- 172.21.15.71:0/47582734 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe99c03b470 con 0x7fe9a0078b00 2024-09-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.456+0000 7fe991ffb640 1 -- 172.21.15.71:0/47582734 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe99c03ba70 con 0x7fe9a0078b00 2024-09-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.456+0000 7fe9a7790640 1 -- 172.21.15.71:0/47582734 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a0113720 con 0x7fe9a0078b00 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.456+0000 7fe991ffb640 1 -- 172.21.15.71:0/47582734 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe99c03a970 con 0x7fe9a0078b00 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.457+0000 7fe9a7790640 1 -- 172.21.15.71:0/47582734 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a0113b30 con 0x7fe9a0078b00 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.457+0000 7fe991ffb640 1 -- 172.21.15.71:0/47582734 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fe99c03aba0 con 0x7fe9a0078b00 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.457+0000 7fe9a7790640 1 -- 172.21.15.71:0/47582734 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a004b720 con 0x7fe9a0078b00 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.458+0000 7fe991ffb640 1 --2- 172.21.15.71:0/47582734 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fe98c0394e0 0x7fe98c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.458+0000 7fe991ffb640 1 -- 172.21.15.71:0/47582734 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe99c06cff0 con 0x7fe9a0078b00 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.458+0000 7fe9a4d2b640 1 --2- 172.21.15.71:0/47582734 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fe98c0394e0 0x7fe98c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.458+0000 7fe9a4d2b640 1 --2- 172.21.15.71:0/47582734 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fe98c0394e0 0x7fe98c03b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe994006fd0 tx=0x7fe994006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.462+0000 7fe991ffb640 1 -- 172.21.15.71:0/47582734 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe99c09f2a0 con 0x7fe9a0078b00 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.618+0000 7fe9a7790640 1 -- 172.21.15.71:0/47582734 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fe9a0108240 con 0x7fe9a0078b00 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.621+0000 7fe991ffb640 1 -- 172.21.15.71:0/47582734 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe99c03f030 con 0x7fe9a0078b00 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.624+0000 7fe9a7790640 1 -- 172.21.15.71:0/47582734 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fe98c0394e0 msgr2=0x7fe98c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.624+0000 7fe9a7790640 1 --2- 172.21.15.71:0/47582734 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fe98c0394e0 0x7fe98c03b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe994006fd0 tx=0x7fe994006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.624+0000 7fe9a7790640 1 -- 172.21.15.71:0/47582734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 msgr2=0x7fe9a0112fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.624+0000 7fe9a7790640 1 --2- 172.21.15.71:0/47582734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 0x7fe9a0112fe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe99c035040 tx=0x7fe99c0091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.624+0000 7fe9a7790640 1 -- 172.21.15.71:0/47582734 shutdown_connections 2024-09-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.624+0000 7fe9a7790640 1 --2- 172.21.15.71:0/47582734 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7fe98c0394e0 0x7fe98c03b990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.624+0000 7fe9a7790640 1 --2- 172.21.15.71:0/47582734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9a0078b00 0x7fe9a0112fe0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.624+0000 7fe9a7790640 1 -- 172.21.15.71:0/47582734 >> 172.21.15.71:0/47582734 conn(0x7fe9a00fd850 msgr2=0x7fe9a00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.624+0000 7fe9a7790640 1 -- 172.21.15.71:0/47582734 shutdown_connections 2024-09-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:34.624+0000 7fe9a7790640 1 -- 172.21.15.71:0/47582734 wait complete. 2024-09-10T09:55:35.655 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:35 smithi071 ceph-mon[27559]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:55:35.655 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:35 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/47582734' entity='client.admin' 2024-09-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.658+0000 7f16406d2640 1 Processor -- start 2024-09-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.658+0000 7f16406d2640 1 -- start start 2024-09-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.658+0000 7f16406d2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 0x7f16381039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.658+0000 7f16406d2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1638070e30 con 0x7f16381035c0 2024-09-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.658+0000 7f163e46e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 0x7f16381039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.658+0000 7f163e46e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 0x7f16381039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40938/0 (socket says 172.21.15.71:40938) 2024-09-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.658+0000 7f163e46e640 1 -- 172.21.15.71:0/3053179375 learned_addr learned my addr 172.21.15.71:0/3053179375 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.659+0000 7f163e46e640 1 -- 172.21.15.71:0/3053179375 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1638103f10 con 0x7f16381035c0 2024-09-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.659+0000 7f163e46e640 1 --2- 172.21.15.71:0/3053179375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 0x7f16381039d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1630009e50 tx=0x7f1630009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e3c2d8f48dc512 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.660+0000 7f163d46c640 1 -- 172.21.15.71:0/3053179375 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1630031560 con 0x7f16381035c0 2024-09-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.660+0000 7f163d46c640 1 -- 172.21.15.71:0/3053179375 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f163002d050 con 0x7f16381035c0 2024-09-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.660+0000 7f163d46c640 1 -- 172.21.15.71:0/3053179375 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1630007a60 con 0x7f16381035c0 2024-09-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.660+0000 7f16406d2640 1 -- 172.21.15.71:0/3053179375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 msgr2=0x7f16381039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.660+0000 7f16406d2640 1 --2- 172.21.15.71:0/3053179375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 0x7f16381039d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1630009e50 tx=0x7f1630009840 comp rx=0 tx=0).stop 2024-09-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.660+0000 7f16406d2640 1 -- 172.21.15.71:0/3053179375 shutdown_connections 2024-09-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.660+0000 7f16406d2640 1 --2- 172.21.15.71:0/3053179375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 0x7f16381039d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.660+0000 7f16406d2640 1 -- 172.21.15.71:0/3053179375 >> 172.21.15.71:0/3053179375 conn(0x7f16380fbdc0 msgr2=0x7f16380fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.660+0000 7f16406d2640 1 -- 172.21.15.71:0/3053179375 shutdown_connections 2024-09-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.660+0000 7f16406d2640 1 -- 172.21.15.71:0/3053179375 wait complete. 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.661+0000 7f16406d2640 1 Processor -- start 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.661+0000 7f16406d2640 1 -- start start 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.661+0000 7f16406d2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 0x7f1638110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.661+0000 7f16406d2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1638111370 con 0x7f16381035c0 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.661+0000 7f163e46e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 0x7f1638110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.661+0000 7f163e46e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 0x7f1638110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40952/0 (socket says 172.21.15.71:40952) 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.661+0000 7f163e46e640 1 -- 172.21.15.71:0/1883405359 learned_addr learned my addr 172.21.15.71:0/1883405359 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.661+0000 7f163e46e640 1 -- 172.21.15.71:0/1883405359 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1630009ae0 con 0x7f16381035c0 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.661+0000 7f163e46e640 1 --2- 172.21.15.71:0/1883405359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 0x7f1638110e30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1630009560 tx=0x7f1630009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.662+0000 7f162effd640 1 -- 172.21.15.71:0/1883405359 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f163003b410 con 0x7f16381035c0 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.662+0000 7f162effd640 1 -- 172.21.15.71:0/1883405359 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f163003ba10 con 0x7f16381035c0 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.662+0000 7f16406d2640 1 -- 172.21.15.71:0/1883405359 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1638111570 con 0x7f16381035c0 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.662+0000 7f162effd640 1 -- 172.21.15.71:0/1883405359 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1630045710 con 0x7f16381035c0 2024-09-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.662+0000 7f16406d2640 1 -- 172.21.15.71:0/1883405359 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1638111fc0 con 0x7f16381035c0 2024-09-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.663+0000 7f162effd640 1 -- 172.21.15.71:0/1883405359 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f1630038050 con 0x7f16381035c0 2024-09-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.663+0000 7f16406d2640 1 -- 172.21.15.71:0/1883405359 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16380ffa60 con 0x7f16381035c0 2024-09-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.663+0000 7f162effd640 1 --2- 172.21.15.71:0/1883405359 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f16240394e0 0x7f162403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.663+0000 7f162effd640 1 -- 172.21.15.71:0/1883405359 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f163006cf20 con 0x7f16381035c0 2024-09-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.663+0000 7f163dc6d640 1 --2- 172.21.15.71:0/1883405359 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f16240394e0 0x7f162403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.663+0000 7f163dc6d640 1 --2- 172.21.15.71:0/1883405359 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f16240394e0 0x7f162403b990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1628006fd0 tx=0x7f1628006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.667+0000 7f162effd640 1 -- 172.21.15.71:0/1883405359 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f163003bb80 con 0x7f16381035c0 2024-09-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.821+0000 7f16406d2640 1 -- 172.21.15.71:0/1883405359 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f163804b720 con 0x7f16381035c0 2024-09-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.827+0000 7f162effd640 1 -- 172.21.15.71:0/1883405359 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f1630041070 con 0x7f16381035c0 2024-09-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.829+0000 7f16406d2640 1 -- 172.21.15.71:0/1883405359 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f16240394e0 msgr2=0x7f162403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.829+0000 7f16406d2640 1 --2- 172.21.15.71:0/1883405359 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f16240394e0 0x7f162403b990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1628006fd0 tx=0x7f1628006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.829+0000 7f16406d2640 1 -- 172.21.15.71:0/1883405359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 msgr2=0x7f1638110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.829+0000 7f16406d2640 1 --2- 172.21.15.71:0/1883405359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 0x7f1638110e30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1630009560 tx=0x7f1630009840 comp rx=0 tx=0).stop 2024-09-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.829+0000 7f16406d2640 1 -- 172.21.15.71:0/1883405359 shutdown_connections 2024-09-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.829+0000 7f16406d2640 1 --2- 172.21.15.71:0/1883405359 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f16240394e0 0x7f162403b990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.829+0000 7f16406d2640 1 --2- 172.21.15.71:0/1883405359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16381035c0 0x7f1638110e30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.829+0000 7f16406d2640 1 -- 172.21.15.71:0/1883405359 >> 172.21.15.71:0/1883405359 conn(0x7f16380fbdc0 msgr2=0x7f16380fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.829+0000 7f16406d2640 1 -- 172.21.15.71:0/1883405359 shutdown_connections 2024-09-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:35.829+0000 7f16406d2640 1 -- 172.21.15.71:0/1883405359 wait complete. 2024-09-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi071.stdout:Enabling the dashboard module... 2024-09-10T09:55:37.033 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:36 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1883405359' entity='client.admin' 2024-09-10T09:55:37.033 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:36 smithi071 ceph-mon[27559]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:55:38.026 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:37 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3105528599' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-10T09:55:38.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.729+0000 7ff9adf5a640 1 Processor -- start 2024-09-10T09:55:38.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.729+0000 7ff9adf5a640 1 -- start start 2024-09-10T09:55:38.456 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.729+0000 7ff9adf5a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 0x7ff9a81012b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.729+0000 7ff9adf5a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a81017f0 con 0x7ff9a8100ea0 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.729+0000 7ff9a77fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 0x7ff9a81012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.729+0000 7ff9a77fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 0x7ff9a81012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40956/0 (socket says 172.21.15.71:40956) 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.729+0000 7ff9a77fe640 1 -- 172.21.15.71:0/3820500015 learned_addr learned my addr 172.21.15.71:0/3820500015 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.730+0000 7ff9a77fe640 1 -- 172.21.15.71:0/3820500015 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a8101930 con 0x7ff9a8100ea0 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.730+0000 7ff9a77fe640 1 --2- 172.21.15.71:0/3820500015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 0x7ff9a81012b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff998009840 tx=0x7ff9980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86131e668a179233 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.730+0000 7ff9a67fc640 1 -- 172.21.15.71:0/3820500015 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff998032440 con 0x7ff9a8100ea0 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.730+0000 7ff9a67fc640 1 -- 172.21.15.71:0/3820500015 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff998032a40 con 0x7ff9a8100ea0 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.730+0000 7ff9a67fc640 1 -- 172.21.15.71:0/3820500015 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff998031aa0 con 0x7ff9a8100ea0 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.731+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3820500015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 msgr2=0x7ff9a81012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.731+0000 7ff9adf5a640 1 --2- 172.21.15.71:0/3820500015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 0x7ff9a81012b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff998009840 tx=0x7ff9980091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.731+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3820500015 shutdown_connections 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.731+0000 7ff9adf5a640 1 --2- 172.21.15.71:0/3820500015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 0x7ff9a81012b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:38.457 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.731+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3820500015 >> 172.21.15.71:0/3820500015 conn(0x7ff9a80fc700 msgr2=0x7ff9a80feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:38.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.731+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3820500015 shutdown_connections 2024-09-10T09:55:38.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.731+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3820500015 wait complete. 2024-09-10T09:55:38.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.732+0000 7ff9adf5a640 1 Processor -- start 2024-09-10T09:55:38.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.732+0000 7ff9adf5a640 1 -- start start 2024-09-10T09:55:38.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.732+0000 7ff9adf5a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 0x7ff9a810fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:38.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.732+0000 7ff9adf5a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a8110200 con 0x7ff9a8100ea0 2024-09-10T09:55:38.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.732+0000 7ff9a77fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 0x7ff9a810fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:38.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.732+0000 7ff9a77fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 0x7ff9a810fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40962/0 (socket says 172.21.15.71:40962) 2024-09-10T09:55:38.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.732+0000 7ff9a77fe640 1 -- 172.21.15.71:0/3105528599 learned_addr learned my addr 172.21.15.71:0/3105528599 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:38.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.732+0000 7ff9a77fe640 1 -- 172.21.15.71:0/3105528599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff998009450 con 0x7ff9a8100ea0 2024-09-10T09:55:38.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.733+0000 7ff9a77fe640 1 --2- 172.21.15.71:0/3105528599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 0x7ff9a810fcc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff9980316a0 tx=0x7ff9980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:38.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.733+0000 7ff98ffff640 1 -- 172.21.15.71:0/3105528599 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9980327b0 con 0x7ff9a8100ea0 2024-09-10T09:55:38.458 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.733+0000 7ff98ffff640 1 -- 172.21.15.71:0/3105528599 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff99803b8d0 con 0x7ff9a8100ea0 2024-09-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.733+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3105528599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a8110400 con 0x7ff9a8100ea0 2024-09-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.733+0000 7ff98ffff640 1 -- 172.21.15.71:0/3105528599 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff99803a780 con 0x7ff9a8100ea0 2024-09-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.733+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3105528599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a8110870 con 0x7ff9a8100ea0 2024-09-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.734+0000 7ff98ffff640 1 -- 172.21.15.71:0/3105528599 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7ff998039040 con 0x7ff9a8100ea0 2024-09-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.734+0000 7ff98ffff640 1 --2- 172.21.15.71:0/3105528599 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7ff990039490 0x7ff99003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.734+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3105528599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a804b720 con 0x7ff9a8100ea0 2024-09-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.734+0000 7ff98ffff640 1 -- 172.21.15.71:0/3105528599 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff99806c910 con 0x7ff9a8100ea0 2024-09-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.734+0000 7ff9a6ffd640 1 --2- 172.21.15.71:0/3105528599 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7ff990039490 0x7ff99003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.734+0000 7ff9a6ffd640 1 --2- 172.21.15.71:0/3105528599 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7ff990039490 0x7ff99003b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff99c006fd0 tx=0x7ff99c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.738+0000 7ff98ffff640 1 -- 172.21.15.71:0/3105528599 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff99803f020 con 0x7ff9a8100ea0 2024-09-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:36.939+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3105528599 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7ff9a8110870 con 0x7ff9a8100ea0 2024-09-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:37.833+0000 7ff98ffff640 1 -- 172.21.15.71:0/3105528599 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7ff99804bd10 con 0x7ff9a8100ea0 2024-09-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:37.835+0000 7ff98ffff640 1 -- 172.21.15.71:0/3105528599 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7ff99804b300 con 0x7ff9a8100ea0 2024-09-10T09:55:38.460 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:37.836+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3105528599 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7ff990039490 msgr2=0x7ff99003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:38.460 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:37.836+0000 7ff9adf5a640 1 --2- 172.21.15.71:0/3105528599 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7ff990039490 0x7ff99003b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff99c006fd0 tx=0x7ff99c006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:38.460 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:37.836+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3105528599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 msgr2=0x7ff9a810fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:38.460 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:37.836+0000 7ff9adf5a640 1 --2- 172.21.15.71:0/3105528599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 0x7ff9a810fcc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff9980316a0 tx=0x7ff9980091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:38.460 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:37.836+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3105528599 shutdown_connections 2024-09-10T09:55:38.460 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:37.837+0000 7ff9adf5a640 1 --2- 172.21.15.71:0/3105528599 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7ff990039490 0x7ff99003b940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:38.460 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:37.837+0000 7ff9adf5a640 1 --2- 172.21.15.71:0/3105528599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9a8100ea0 0x7ff9a810fcc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:38.460 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:37.837+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3105528599 >> 172.21.15.71:0/3105528599 conn(0x7ff9a80fc700 msgr2=0x7ff9a80fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:38.460 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:37.837+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3105528599 shutdown_connections 2024-09-10T09:55:38.460 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:37.837+0000 7ff9adf5a640 1 -- 172.21.15.71:0/3105528599 wait complete. 2024-09-10T09:55:38.880 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:38 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3105528599' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T09:55:38.880 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:38 smithi071 ceph-mon[27559]: mgrmap e9: smithi071.gtqytr(active, since 31s) 2024-09-10T09:55:39.674 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:55:39.674 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T09:55:39.675 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T09:55:39.675 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "active_name": "smithi071.gtqytr", 2024-09-10T09:55:39.675 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T09:55:39.675 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:55:39.675 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.879+0000 7f3088b1f640 1 Processor -- start 2024-09-10T09:55:39.675 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.879+0000 7f3088b1f640 1 -- start start 2024-09-10T09:55:39.675 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.879+0000 7f3088b1f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 0x7f30841012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:39.675 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.879+0000 7f3088b1f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30841017e0 con 0x7f3084100e90 2024-09-10T09:55:39.675 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.879+0000 7f308259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 0x7f30841012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:39.675 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.879+0000 7f308259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 0x7f30841012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40994/0 (socket says 172.21.15.71:40994) 2024-09-10T09:55:39.675 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.879+0000 7f308259c640 1 -- 172.21.15.71:0/1441602776 learned_addr learned my addr 172.21.15.71:0/1441602776 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:39.675 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.880+0000 7f308259c640 1 -- 172.21.15.71:0/1441602776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3084101920 con 0x7f3084100e90 2024-09-10T09:55:39.676 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.880+0000 7f308259c640 1 --2- 172.21.15.71:0/1441602776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 0x7f30841012a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3074009840 tx=0x7f30740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f32ca98025e926 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:39.676 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.880+0000 7f308159a640 1 -- 172.21.15.71:0/1441602776 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3074032440 con 0x7f3084100e90 2024-09-10T09:55:39.676 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.881+0000 7f308159a640 1 -- 172.21.15.71:0/1441602776 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3074032a40 con 0x7f3084100e90 2024-09-10T09:55:39.676 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.881+0000 7f308159a640 1 -- 172.21.15.71:0/1441602776 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3074031aa0 con 0x7f3084100e90 2024-09-10T09:55:39.676 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.881+0000 7f3088b1f640 1 -- 172.21.15.71:0/1441602776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 msgr2=0x7f30841012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:39.676 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.881+0000 7f3088b1f640 1 --2- 172.21.15.71:0/1441602776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 0x7f30841012a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3074009840 tx=0x7f30740091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:39.676 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.881+0000 7f3088b1f640 1 -- 172.21.15.71:0/1441602776 shutdown_connections 2024-09-10T09:55:39.676 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.881+0000 7f3088b1f640 1 --2- 172.21.15.71:0/1441602776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 0x7f30841012a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:39.676 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.881+0000 7f3088b1f640 1 -- 172.21.15.71:0/1441602776 >> 172.21.15.71:0/1441602776 conn(0x7f30840fc6d0 msgr2=0x7f30840feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:39.676 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.881+0000 7f3088b1f640 1 -- 172.21.15.71:0/1441602776 shutdown_connections 2024-09-10T09:55:39.676 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.881+0000 7f3088b1f640 1 -- 172.21.15.71:0/1441602776 wait complete. 2024-09-10T09:55:39.676 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.882+0000 7f3088b1f640 1 Processor -- start 2024-09-10T09:55:39.677 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.882+0000 7f3088b1f640 1 -- start start 2024-09-10T09:55:39.677 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.882+0000 7f3088b1f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 0x7f3084110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:39.677 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.882+0000 7f3088b1f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3084111370 con 0x7f3084100e90 2024-09-10T09:55:39.677 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.882+0000 7f308259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 0x7f3084110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:39.677 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.882+0000 7f308259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 0x7f3084110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41006/0 (socket says 172.21.15.71:41006) 2024-09-10T09:55:39.677 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.882+0000 7f308259c640 1 -- 172.21.15.71:0/1191412321 learned_addr learned my addr 172.21.15.71:0/1191412321 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:39.677 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.883+0000 7f308259c640 1 -- 172.21.15.71:0/1191412321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3074009450 con 0x7f3084100e90 2024-09-10T09:55:39.677 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.883+0000 7f308259c640 1 --2- 172.21.15.71:0/1191412321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 0x7f3084110e30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3074009810 tx=0x7f30740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:39.677 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.883+0000 7f3072ffd640 1 -- 172.21.15.71:0/1191412321 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30740327b0 con 0x7f3084100e90 2024-09-10T09:55:39.677 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.883+0000 7f3088b1f640 1 -- 172.21.15.71:0/1191412321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3084111570 con 0x7f3084100e90 2024-09-10T09:55:39.677 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.883+0000 7f3072ffd640 1 -- 172.21.15.71:0/1191412321 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f307403b8d0 con 0x7f3084100e90 2024-09-10T09:55:39.677 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.883+0000 7f3072ffd640 1 -- 172.21.15.71:0/1191412321 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f307403a6f0 con 0x7f3084100e90 2024-09-10T09:55:39.677 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.883+0000 7f3088b1f640 1 -- 172.21.15.71:0/1191412321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3084111fc0 con 0x7f3084100e90 2024-09-10T09:55:39.678 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.884+0000 7f3072ffd640 1 -- 172.21.15.71:0/1191412321 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f3074039040 con 0x7f3084100e90 2024-09-10T09:55:39.678 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.884+0000 7f3088b1f640 1 -- 172.21.15.71:0/1191412321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30841002f0 con 0x7f3084100e90 2024-09-10T09:55:39.678 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.884+0000 7f3072ffd640 1 --2- 172.21.15.71:0/1191412321 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f306c0394e0 0x7f306c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:39.678 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.884+0000 7f3072ffd640 1 -- 172.21.15.71:0/1191412321 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f307406cb30 con 0x7f3084100e90 2024-09-10T09:55:39.678 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.884+0000 7f3081d9b640 1 -- 172.21.15.71:0/1191412321 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f306c0394e0 msgr2=0x7f306c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/4098346293 2024-09-10T09:55:39.678 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.884+0000 7f3081d9b640 1 --2- 172.21.15.71:0/1191412321 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f306c0394e0 0x7f306c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:55:39.678 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:38.889+0000 7f3072ffd640 1 -- 172.21.15.71:0/1191412321 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f307404bac0 con 0x7f3084100e90 2024-09-10T09:55:39.678 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.085+0000 7f3081d9b640 1 -- 172.21.15.71:0/1191412321 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f306c0394e0 msgr2=0x7f306c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/4098346293 2024-09-10T09:55:39.678 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.085+0000 7f3081d9b640 1 --2- 172.21.15.71:0/1191412321 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f306c0394e0 0x7f306c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T09:55:39.678 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.091+0000 7f3088b1f640 1 -- 172.21.15.71:0/1191412321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f3084112b80 con 0x7f3084100e90 2024-09-10T09:55:39.678 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.091+0000 7f3072ffd640 1 -- 172.21.15.71:0/1191412321 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f3074037020 con 0x7f3084100e90 2024-09-10T09:55:39.678 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.093+0000 7f3088b1f640 1 -- 172.21.15.71:0/1191412321 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f306c0394e0 msgr2=0x7f306c03b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:55:39.678 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.093+0000 7f3088b1f640 1 --2- 172.21.15.71:0/1191412321 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f306c0394e0 0x7f306c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.093+0000 7f3088b1f640 1 -- 172.21.15.71:0/1191412321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 msgr2=0x7f3084110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.093+0000 7f3088b1f640 1 --2- 172.21.15.71:0/1191412321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 0x7f3084110e30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3074009810 tx=0x7f30740091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.093+0000 7f3088b1f640 1 -- 172.21.15.71:0/1191412321 shutdown_connections 2024-09-10T09:55:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.093+0000 7f3088b1f640 1 --2- 172.21.15.71:0/1191412321 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f306c0394e0 0x7f306c03b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.093+0000 7f3088b1f640 1 --2- 172.21.15.71:0/1191412321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3084100e90 0x7f3084110e30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.093+0000 7f3088b1f640 1 -- 172.21.15.71:0/1191412321 >> 172.21.15.71:0/1191412321 conn(0x7f30840fc6d0 msgr2=0x7f30840fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.093+0000 7f3088b1f640 1 -- 172.21.15.71:0/1191412321 shutdown_connections 2024-09-10T09:55:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:39.093+0000 7f3088b1f640 1 -- 172.21.15.71:0/1191412321 wait complete. 2024-09-10T09:55:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for the mgr to restart... 2024-09-10T09:55:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:Waiting for mgr epoch 9... 2024-09-10T09:55:39.985 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:39 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1191412321' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T09:55:42.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:42 smithi071 ceph-mon[27559]: Active manager daemon smithi071.gtqytr restarted 2024-09-10T09:55:42.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:42 smithi071 ceph-mon[27559]: Activating manager daemon smithi071.gtqytr 2024-09-10T09:55:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:42 smithi071 ceph-mon[27559]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T09:55:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:42 smithi071 ceph-mon[27559]: mgrmap e10: smithi071.gtqytr(active, starting, since 0.00546785s) 2024-09-10T09:55:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:42 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T09:55:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:42 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr metadata", "who": "smithi071.gtqytr", "id": "smithi071.gtqytr"}]: dispatch 2024-09-10T09:55:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:42 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:55:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:42 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:55:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:42 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:55:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:42 smithi071 ceph-mon[27559]: Manager daemon smithi071.gtqytr is now available 2024-09-10T09:55:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:42 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:55:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:42 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:55:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:42 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/trash_purge_schedule"}]: dispatch 2024-09-10T09:55:43.936 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:55:43.936 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T09:55:43.936 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T09:55:43.936 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:55:43.936 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.060+0000 7f558f5f6640 1 Processor -- start 2024-09-10T09:55:43.936 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.060+0000 7f558f5f6640 1 -- start start 2024-09-10T09:55:43.936 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.060+0000 7f558f5f6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 0x7f5588102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:43.936 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.060+0000 7f558f5f6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55881028d0 con 0x7f5588101f80 2024-09-10T09:55:43.936 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.060+0000 7f558d392640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 0x7f5588102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.060+0000 7f558d392640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 0x7f5588102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41016/0 (socket says 172.21.15.71:41016) 2024-09-10T09:55:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.060+0000 7f558d392640 1 -- 172.21.15.71:0/3840571018 learned_addr learned my addr 172.21.15.71:0/3840571018 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.061+0000 7f558d392640 1 -- 172.21.15.71:0/3840571018 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5588102a10 con 0x7f5588101f80 2024-09-10T09:55:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.061+0000 7f558d392640 1 --2- 172.21.15.71:0/3840571018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 0x7f5588102390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5584009840 tx=0x7f55840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a482b2e1ef541144 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.061+0000 7f557ffff640 1 -- 172.21.15.71:0/3840571018 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5584032440 con 0x7f5588101f80 2024-09-10T09:55:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.061+0000 7f557ffff640 1 -- 172.21.15.71:0/3840571018 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5584032a40 con 0x7f5588101f80 2024-09-10T09:55:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.061+0000 7f557ffff640 1 -- 172.21.15.71:0/3840571018 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5584031a70 con 0x7f5588101f80 2024-09-10T09:55:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.062+0000 7f558f5f6640 1 -- 172.21.15.71:0/3840571018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 msgr2=0x7f5588102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.062+0000 7f558f5f6640 1 --2- 172.21.15.71:0/3840571018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 0x7f5588102390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5584009840 tx=0x7f55840091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.062+0000 7f558f5f6640 1 -- 172.21.15.71:0/3840571018 shutdown_connections 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.062+0000 7f558f5f6640 1 --2- 172.21.15.71:0/3840571018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 0x7f5588102390 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.062+0000 7f558f5f6640 1 -- 172.21.15.71:0/3840571018 >> 172.21.15.71:0/3840571018 conn(0x7f55880fd740 msgr2=0x7f55880ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.062+0000 7f558f5f6640 1 -- 172.21.15.71:0/3840571018 shutdown_connections 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.062+0000 7f558f5f6640 1 -- 172.21.15.71:0/3840571018 wait complete. 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.063+0000 7f558f5f6640 1 Processor -- start 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.063+0000 7f558f5f6640 1 -- start start 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.063+0000 7f558f5f6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 0x7f5588110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.063+0000 7f558f5f6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5588111370 con 0x7f5588101f80 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.063+0000 7f558d392640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 0x7f5588110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.063+0000 7f558d392640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 0x7f5588110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41026/0 (socket says 172.21.15.71:41026) 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.063+0000 7f558d392640 1 -- 172.21.15.71:0/2961619617 learned_addr learned my addr 172.21.15.71:0/2961619617 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.063+0000 7f558d392640 1 -- 172.21.15.71:0/2961619617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5584009450 con 0x7f5588101f80 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.063+0000 7f558d392640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 0x7f5588110e30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5584009420 tx=0x7f55840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.064+0000 7f557dffb640 1 -- 172.21.15.71:0/2961619617 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f558403c400 con 0x7f5588101f80 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.064+0000 7f557dffb640 1 -- 172.21.15.71:0/2961619617 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f558403ca00 con 0x7f5588101f80 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.064+0000 7f558f5f6640 1 -- 172.21.15.71:0/2961619617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5588111570 con 0x7f5588101f80 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.064+0000 7f557dffb640 1 -- 172.21.15.71:0/2961619617 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f558403a850 con 0x7f5588101f80 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.064+0000 7f558f5f6640 1 -- 172.21.15.71:0/2961619617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5588111fc0 con 0x7f5588101f80 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.065+0000 7f557dffb640 1 -- 172.21.15.71:0/2961619617 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f558403ab10 con 0x7f5588101f80 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.065+0000 7f557dffb640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f55740394e0 0x7f557403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.065+0000 7f557dffb640 1 -- 172.21.15.71:0/2961619617 --> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f557403c0a0 con 0x7f55740394e0 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.065+0000 7f557dffb640 1 -- 172.21.15.71:0/2961619617 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f558406cf20 con 0x7f5588101f80 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.065+0000 7f558cb91640 1 -- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f55740394e0 msgr2=0x7f557403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/4098346293 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.065+0000 7f558cb91640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f55740394e0 0x7f557403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.266+0000 7f558cb91640 1 -- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f55740394e0 msgr2=0x7f557403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/4098346293 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.266+0000 7f558cb91640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f55740394e0 0x7f557403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.667+0000 7f558cb91640 1 -- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f55740394e0 msgr2=0x7f557403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/4098346293 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:40.667+0000 7f558cb91640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f55740394e0 0x7f557403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T09:55:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:41.468+0000 7f558cb91640 1 -- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f55740394e0 msgr2=0x7f557403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/4098346293 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:41.468+0000 7f558cb91640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f55740394e0 0x7f557403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:42.213+0000 7f557dffb640 1 -- 172.21.15.71:0/2961619617 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mgrmap(e 10) v1 ==== 45287+0+0 (secure 0 0 0) 0x7f558403adc0 con 0x7f5588101f80 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:42.213+0000 7f557dffb640 1 -- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f55740394e0 msgr2=0x7f557403b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:42.213+0000 7f557dffb640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f55740394e0 0x7f557403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.212+0000 7f557dffb640 1 -- 172.21.15.71:0/2961619617 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f5584039310 con 0x7f5588101f80 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.212+0000 7f557dffb640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f557403cf80 0x7f557403f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.212+0000 7f557dffb640 1 -- 172.21.15.71:0/2961619617 --> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f557403c0a0 con 0x7f557403cf80 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.213+0000 7f558cb91640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f557403cf80 0x7f557403f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.213+0000 7f558cb91640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f557403cf80 0x7f557403f360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5578003940 tx=0x7f5578009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.214+0000 7f557dffb640 1 -- 172.21.15.71:0/2961619617 <== mgr.14160 v2:172.21.15.71:6800/404028021 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f557403c0a0 con 0x7f557403cf80 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.219+0000 7f558f5f6640 1 -- 172.21.15.71:0/2961619617 --> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f55881119e0 con 0x7f557403cf80 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.219+0000 7f557dffb640 1 -- 172.21.15.71:0/2961619617 <== mgr.14160 v2:172.21.15.71:6800/404028021 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f55881119e0 con 0x7f557403cf80 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.220+0000 7f558f5f6640 1 -- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f557403cf80 msgr2=0x7f557403f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:43.940 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.220+0000 7f558f5f6640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f557403cf80 0x7f557403f360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5578003940 tx=0x7f5578009350 comp rx=0 tx=0).stop 2024-09-10T09:55:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.220+0000 7f558f5f6640 1 -- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 msgr2=0x7f5588110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.220+0000 7f558f5f6640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 0x7f5588110e30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5584009420 tx=0x7f55840091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.220+0000 7f558f5f6640 1 -- 172.21.15.71:0/2961619617 shutdown_connections 2024-09-10T09:55:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.220+0000 7f558f5f6640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f557403cf80 0x7f557403f360 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.220+0000 7f558f5f6640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:6800/4098346293,v1:172.21.15.71:6801/4098346293] conn(0x7f55740394e0 0x7f557403b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.220+0000 7f558f5f6640 1 --2- 172.21.15.71:0/2961619617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5588101f80 0x7f5588110e30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.220+0000 7f558f5f6640 1 -- 172.21.15.71:0/2961619617 >> 172.21.15.71:0/2961619617 conn(0x7f55880fd740 msgr2=0x7f55880fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.220+0000 7f558f5f6640 1 -- 172.21.15.71:0/2961619617 shutdown_connections 2024-09-10T09:55:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:43.220+0000 7f558f5f6640 1 -- 172.21.15.71:0/2961619617 wait complete. 2024-09-10T09:55:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:mgr epoch 9 is available 2024-09-10T09:55:43.941 INFO:teuthology.orchestra.run.smithi071.stdout:Generating a dashboard self-signed certificate... 2024-09-10T09:55:44.286 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:44 smithi071 ceph-mon[27559]: mgrmap e11: smithi071.gtqytr(active, since 1.00553s) 2024-09-10T09:55:44.286 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:44 smithi071 ceph-mon[27559]: [10/Sep/2024:09:55:43] ENGINE Bus STARTING 2024-09-10T09:55:44.287 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:44 smithi071 ceph-mon[27559]: [10/Sep/2024:09:55:43] ENGINE Serving on https://172.21.15.71:7150 2024-09-10T09:55:44.287 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:44 smithi071 ceph-mon[27559]: [10/Sep/2024:09:55:43] ENGINE Bus STARTED 2024-09-10T09:55:44.287 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:44 smithi071 ceph-mon[27559]: [10/Sep/2024:09:55:43] ENGINE Error in HTTPServer.serve 2024-09-10T09:55:44.287 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Traceback (most recent call last): 2024-09-10T09:55:44.287 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T09:55:44.287 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-10T09:55:44.287 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T09:55:44.287 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._run(expiration_interval) 2024-09-10T09:55:44.287 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T09:55:44.287 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T09:55:44.287 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T09:55:44.287 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T09:55:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T09:55:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: s = self.context.wrap_socket( 2024-09-10T09:55:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T09:55:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: return self.sslsocket_class._create( 2024-09-10T09:55:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T09:55:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self.do_handshake() 2024-09-10T09:55:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T09:55:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._sslobj.do_handshake() 2024-09-10T09:55:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T09:55:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:44 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:44 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:45.033 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-10T09:55:45.033 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.283+0000 7f091ba31640 1 Processor -- start 2024-09-10T09:55:45.033 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.284+0000 7f091ba31640 1 -- start start 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.284+0000 7f091ba31640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 0x7f0914104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.284+0000 7f091ba31640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0914076f20 con 0x7f0914076b10 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.284+0000 7f09197cd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 0x7f0914104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.284+0000 7f09197cd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 0x7f0914104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35980/0 (socket says 172.21.15.71:35980) 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.284+0000 7f09197cd640 1 -- 172.21.15.71:0/3981550721 learned_addr learned my addr 172.21.15.71:0/3981550721 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.284+0000 7f09197cd640 1 -- 172.21.15.71:0/3981550721 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0914105120 con 0x7f0914076b10 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.285+0000 7f09197cd640 1 --2- 172.21.15.71:0/3981550721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 0x7f0914104be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0910009840 tx=0x7f09100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c8ae1aa51d94b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.285+0000 7f090bfff640 1 -- 172.21.15.71:0/3981550721 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0910032440 con 0x7f0914076b10 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.285+0000 7f090bfff640 1 -- 172.21.15.71:0/3981550721 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0910032a40 con 0x7f0914076b10 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.285+0000 7f090bfff640 1 -- 172.21.15.71:0/3981550721 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0910031aa0 con 0x7f0914076b10 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.286+0000 7f091ba31640 1 -- 172.21.15.71:0/3981550721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 msgr2=0x7f0914104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.286+0000 7f091ba31640 1 --2- 172.21.15.71:0/3981550721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 0x7f0914104be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0910009840 tx=0x7f09100091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.286+0000 7f091ba31640 1 -- 172.21.15.71:0/3981550721 shutdown_connections 2024-09-10T09:55:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.286+0000 7f091ba31640 1 --2- 172.21.15.71:0/3981550721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 0x7f0914104be0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.286+0000 7f091ba31640 1 -- 172.21.15.71:0/3981550721 >> 172.21.15.71:0/3981550721 conn(0x7f09140fc6d0 msgr2=0x7f09140feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.286+0000 7f091ba31640 1 -- 172.21.15.71:0/3981550721 shutdown_connections 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.286+0000 7f091ba31640 1 -- 172.21.15.71:0/3981550721 wait complete. 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.286+0000 7f091ba31640 1 Processor -- start 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.287+0000 7f091ba31640 1 -- start start 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.287+0000 7f091ba31640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 0x7f0914102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.287+0000 7f091ba31640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0914102a50 con 0x7f0914076b10 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.287+0000 7f09197cd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 0x7f0914102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.287+0000 7f09197cd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 0x7f0914102510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35992/0 (socket says 172.21.15.71:35992) 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.287+0000 7f09197cd640 1 -- 172.21.15.71:0/1714974725 learned_addr learned my addr 172.21.15.71:0/1714974725 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.287+0000 7f09197cd640 1 -- 172.21.15.71:0/1714974725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910009450 con 0x7f0914076b10 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.287+0000 7f09197cd640 1 --2- 172.21.15.71:0/1714974725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 0x7f0914102510 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0910009810 tx=0x7f09100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.287+0000 7f0909ffb640 1 -- 172.21.15.71:0/1714974725 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09100327b0 con 0x7f0914076b10 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.287+0000 7f0909ffb640 1 -- 172.21.15.71:0/1714974725 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f091003b8d0 con 0x7f0914076b10 2024-09-10T09:55:45.035 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.287+0000 7f091ba31640 1 -- 172.21.15.71:0/1714974725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0914100ae0 con 0x7f0914076b10 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.287+0000 7f0909ffb640 1 -- 172.21.15.71:0/1714974725 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f091003a6f0 con 0x7f0914076b10 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.288+0000 7f091ba31640 1 -- 172.21.15.71:0/1714974725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0914100f50 con 0x7f0914076b10 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.288+0000 7f0909ffb640 1 -- 172.21.15.71:0/1714974725 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f0910039040 con 0x7f0914076b10 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.289+0000 7f0909ffb640 1 --2- 172.21.15.71:0/1714974725 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f09000393d0 0x7f090003b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.289+0000 7f0909ffb640 1 -- 172.21.15.71:0/1714974725 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f091006cb60 con 0x7f0914076b10 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.289+0000 7f091ba31640 1 -- 172.21.15.71:0/1714974725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091404b720 con 0x7f0914076b10 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.289+0000 7f0918fcc640 1 --2- 172.21.15.71:0/1714974725 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f09000393d0 0x7f090003b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.289+0000 7f0918fcc640 1 --2- 172.21.15.71:0/1714974725 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f09000393d0 0x7f090003b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0904006fd0 tx=0x7f0904006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.293+0000 7f0909ffb640 1 -- 172.21.15.71:0/1714974725 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f091003f020 con 0x7f0914076b10 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.461+0000 7f091ba31640 1 -- 172.21.15.71:0/1714974725 --> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f0914101450 con 0x7f09000393d0 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.484+0000 7f0909ffb640 1 -- 172.21.15.71:0/1714974725 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f091004bd10 con 0x7f0914076b10 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.490+0000 7f0909ffb640 1 -- 172.21.15.71:0/1714974725 <== mgr.14160 v2:172.21.15.71:6800/404028021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f0914101450 con 0x7f09000393d0 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.492+0000 7f091ba31640 1 -- 172.21.15.71:0/1714974725 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f09000393d0 msgr2=0x7f090003b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:45.036 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.492+0000 7f091ba31640 1 --2- 172.21.15.71:0/1714974725 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f09000393d0 0x7f090003b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0904006fd0 tx=0x7f0904006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:45.037 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.492+0000 7f091ba31640 1 -- 172.21.15.71:0/1714974725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 msgr2=0x7f0914102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:45.037 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.492+0000 7f091ba31640 1 --2- 172.21.15.71:0/1714974725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 0x7f0914102510 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0910009810 tx=0x7f09100091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:45.037 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.492+0000 7f091ba31640 1 -- 172.21.15.71:0/1714974725 shutdown_connections 2024-09-10T09:55:45.037 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.492+0000 7f091ba31640 1 --2- 172.21.15.71:0/1714974725 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f09000393d0 0x7f090003b880 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:45.037 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.492+0000 7f091ba31640 1 --2- 172.21.15.71:0/1714974725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0914076b10 0x7f0914102510 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:45.037 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.492+0000 7f091ba31640 1 -- 172.21.15.71:0/1714974725 >> 172.21.15.71:0/1714974725 conn(0x7f09140fc6d0 msgr2=0x7f09140fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:45.037 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.493+0000 7f091ba31640 1 -- 172.21.15.71:0/1714974725 shutdown_connections 2024-09-10T09:55:45.037 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:44.493+0000 7f091ba31640 1 -- 172.21.15.71:0/1714974725 wait complete. 2024-09-10T09:55:45.037 INFO:teuthology.orchestra.run.smithi071.stdout:Creating initial admin user... 2024-09-10T09:55:45.622 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:45 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:45.622 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:45 smithi071 ceph-mon[27559]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:45.622 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:45 smithi071 ceph-mon[27559]: mgrmap e12: smithi071.gtqytr(active, since 2s) 2024-09-10T09:55:45.622 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:45 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:45.622 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:45 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:46.972 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$5a5R2RxOCzYOD4ftHH9NUuQJm53FDVkEy5VDjjFIh5elBM9HVd2U.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725962145, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T09:55:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.430+0000 7f4d0c4eb640 1 Processor -- start 2024-09-10T09:55:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.431+0000 7f4d0c4eb640 1 -- start start 2024-09-10T09:55:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.431+0000 7f4d0c4eb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 0x7f4d04104c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.431+0000 7f4d0c4eb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04076f40 con 0x7f4d04076b30 2024-09-10T09:55:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.431+0000 7f4d0a287640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 0x7f4d04104c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.431+0000 7f4d0a287640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 0x7f4d04104c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35996/0 (socket says 172.21.15.71:35996) 2024-09-10T09:55:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.431+0000 7f4d0a287640 1 -- 172.21.15.71:0/4093522215 learned_addr learned my addr 172.21.15.71:0/4093522215 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.432+0000 7f4d0a287640 1 -- 172.21.15.71:0/4093522215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d041051b0 con 0x7f4d04076b30 2024-09-10T09:55:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.432+0000 7f4d0a287640 1 --2- 172.21.15.71:0/4093522215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 0x7f4d04104c70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009840 tx=0x7f4d000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc344d702ac1c243 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.432+0000 7f4d09285640 1 -- 172.21.15.71:0/4093522215 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d00032440 con 0x7f4d04076b30 2024-09-10T09:55:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.432+0000 7f4d09285640 1 -- 172.21.15.71:0/4093522215 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4d00032a40 con 0x7f4d04076b30 2024-09-10T09:55:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.433+0000 7f4d09285640 1 -- 172.21.15.71:0/4093522215 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d00031a70 con 0x7f4d04076b30 2024-09-10T09:55:46.973 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.433+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4093522215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 msgr2=0x7f4d04104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.433+0000 7f4d0c4eb640 1 --2- 172.21.15.71:0/4093522215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 0x7f4d04104c70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009840 tx=0x7f4d000091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.433+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4093522215 shutdown_connections 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.433+0000 7f4d0c4eb640 1 --2- 172.21.15.71:0/4093522215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 0x7f4d04104c70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.433+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4093522215 >> 172.21.15.71:0/4093522215 conn(0x7f4d040fc6e0 msgr2=0x7f4d040feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.433+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4093522215 shutdown_connections 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.433+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4093522215 wait complete. 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.434+0000 7f4d0c4eb640 1 Processor -- start 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.434+0000 7f4d0c4eb640 1 -- start start 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.434+0000 7f4d0c4eb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 0x7f4d04110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.434+0000 7f4d0c4eb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04111360 con 0x7f4d04076b30 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.434+0000 7f4d0a287640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 0x7f4d04110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.434+0000 7f4d0a287640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 0x7f4d04110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36002/0 (socket says 172.21.15.71:36002) 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.434+0000 7f4d0a287640 1 -- 172.21.15.71:0/4103379786 learned_addr learned my addr 172.21.15.71:0/4103379786 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.434+0000 7f4d0a287640 1 -- 172.21.15.71:0/4103379786 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d00009450 con 0x7f4d04076b30 2024-09-10T09:55:46.974 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.435+0000 7f4d0a287640 1 --2- 172.21.15.71:0/4103379786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 0x7f4d04110e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009420 tx=0x7f4d000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.435+0000 7f4cfaffd640 1 -- 172.21.15.71:0/4103379786 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d0003c400 con 0x7f4d04076b30 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.435+0000 7f4cfaffd640 1 -- 172.21.15.71:0/4103379786 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4d0003ca00 con 0x7f4d04076b30 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.435+0000 7f4cfaffd640 1 -- 172.21.15.71:0/4103379786 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d0003a920 con 0x7f4d04076b30 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.435+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4103379786 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d04111560 con 0x7f4d04076b30 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.435+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4103379786 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d04111fb0 con 0x7f4d04076b30 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.436+0000 7f4cfaffd640 1 -- 172.21.15.71:0/4103379786 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f4d0003aa80 con 0x7f4d04076b30 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.436+0000 7f4cfaffd640 1 --2- 172.21.15.71:0/4103379786 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f4cf0039530 0x7f4cf003b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.436+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4103379786 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d04100380 con 0x7f4d04076b30 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.436+0000 7f4cfaffd640 1 -- 172.21.15.71:0/4103379786 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4d0006d200 con 0x7f4d04076b30 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.436+0000 7f4d09a86640 1 --2- 172.21.15.71:0/4103379786 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f4cf0039530 0x7f4cf003b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.437+0000 7f4d09a86640 1 --2- 172.21.15.71:0/4103379786 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f4cf0039530 0x7f4cf003b9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4006fd0 tx=0x7f4cf4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.441+0000 7f4cfaffd640 1 -- 172.21.15.71:0/4103379786 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4d00037030 con 0x7f4d04076b30 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.621+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4103379786 --> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4d0405eb60 con 0x7f4cf0039530 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.847+0000 7f4cfaffd640 1 -- 172.21.15.71:0/4103379786 <== mgr.14160 v2:172.21.15.71:6800/404028021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f4d0405eb60 con 0x7f4cf0039530 2024-09-10T09:55:46.975 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.850+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4103379786 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f4cf0039530 msgr2=0x7f4cf003b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:46.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.850+0000 7f4d0c4eb640 1 --2- 172.21.15.71:0/4103379786 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f4cf0039530 0x7f4cf003b9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4006fd0 tx=0x7f4cf4006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:46.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.850+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4103379786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 msgr2=0x7f4d04110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:46.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.850+0000 7f4d0c4eb640 1 --2- 172.21.15.71:0/4103379786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 0x7f4d04110e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009420 tx=0x7f4d000091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:46.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.850+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4103379786 shutdown_connections 2024-09-10T09:55:46.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.850+0000 7f4d0c4eb640 1 --2- 172.21.15.71:0/4103379786 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f4cf0039530 0x7f4cf003b9e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:46.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.850+0000 7f4d0c4eb640 1 --2- 172.21.15.71:0/4103379786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d04076b30 0x7f4d04110e20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:46.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.850+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4103379786 >> 172.21.15.71:0/4103379786 conn(0x7f4d040fc6e0 msgr2=0x7f4d040fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:46.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.850+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4103379786 shutdown_connections 2024-09-10T09:55:46.976 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:45.850+0000 7f4d0c4eb640 1 -- 172.21.15.71:0/4103379786 wait complete. 2024-09-10T09:55:46.976 INFO:teuthology.orchestra.run.smithi071.stdout:Fetching dashboard port number... 2024-09-10T09:55:47.176 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:46 smithi071 ceph-mon[27559]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:47.176 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:46 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:48.085 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:47 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3007121743' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-10T09:55:48.137 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T09:55:48.137 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.339+0000 7f6747ee2640 1 Processor -- start 2024-09-10T09:55:48.137 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.339+0000 7f6747ee2640 1 -- start start 2024-09-10T09:55:48.137 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.339+0000 7f6747ee2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 0x7f67401039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.339+0000 7f6747ee2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6740103f20 con 0x7f67401035d0 2024-09-10T09:55:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.339+0000 7f6745c7e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 0x7f67401039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.339+0000 7f6745c7e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 0x7f67401039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36012/0 (socket says 172.21.15.71:36012) 2024-09-10T09:55:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.339+0000 7f6745c7e640 1 -- 172.21.15.71:0/2391674461 learned_addr learned my addr 172.21.15.71:0/2391674461 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.340+0000 7f6745c7e640 1 -- 172.21.15.71:0/2391674461 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740104060 con 0x7f67401035d0 2024-09-10T09:55:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.340+0000 7f6745c7e640 1 --2- 172.21.15.71:0/2391674461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 0x7f67401039e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f673c009840 tx=0x7f673c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5a5dff3c3b022b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.340+0000 7f6744c7c640 1 -- 172.21.15.71:0/2391674461 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f673c032440 con 0x7f67401035d0 2024-09-10T09:55:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.340+0000 7f6744c7c640 1 -- 172.21.15.71:0/2391674461 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f673c032a40 con 0x7f67401035d0 2024-09-10T09:55:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.340+0000 7f6744c7c640 1 -- 172.21.15.71:0/2391674461 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f673c031a70 con 0x7f67401035d0 2024-09-10T09:55:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.341+0000 7f6747ee2640 1 -- 172.21.15.71:0/2391674461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 msgr2=0x7f67401039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.341+0000 7f6747ee2640 1 --2- 172.21.15.71:0/2391674461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 0x7f67401039e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f673c009840 tx=0x7f673c0091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.341+0000 7f6747ee2640 1 -- 172.21.15.71:0/2391674461 shutdown_connections 2024-09-10T09:55:48.138 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.341+0000 7f6747ee2640 1 --2- 172.21.15.71:0/2391674461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 0x7f67401039e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.341+0000 7f6747ee2640 1 -- 172.21.15.71:0/2391674461 >> 172.21.15.71:0/2391674461 conn(0x7f67400fbd90 msgr2=0x7f67400fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.341+0000 7f6747ee2640 1 -- 172.21.15.71:0/2391674461 shutdown_connections 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.341+0000 7f6747ee2640 1 -- 172.21.15.71:0/2391674461 wait complete. 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.342+0000 7f6747ee2640 1 Processor -- start 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.342+0000 7f6747ee2640 1 -- start start 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.342+0000 7f6747ee2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 0x7f6740110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.342+0000 7f6747ee2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6740111390 con 0x7f67401035d0 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.342+0000 7f6745c7e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 0x7f6740110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.342+0000 7f6745c7e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 0x7f6740110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36020/0 (socket says 172.21.15.71:36020) 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.342+0000 7f6745c7e640 1 -- 172.21.15.71:0/3007121743 learned_addr learned my addr 172.21.15.71:0/3007121743 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.342+0000 7f6745c7e640 1 -- 172.21.15.71:0/3007121743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c009450 con 0x7f67401035d0 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.342+0000 7f6745c7e640 1 --2- 172.21.15.71:0/3007121743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 0x7f6740110e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f673c009420 tx=0x7f673c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.343+0000 7f67367fc640 1 -- 172.21.15.71:0/3007121743 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f673c03c400 con 0x7f67401035d0 2024-09-10T09:55:48.139 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.343+0000 7f67367fc640 1 -- 172.21.15.71:0/3007121743 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f673c03ca00 con 0x7f67401035d0 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.343+0000 7f6747ee2640 1 -- 172.21.15.71:0/3007121743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6740111590 con 0x7f67401035d0 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.343+0000 7f67367fc640 1 -- 172.21.15.71:0/3007121743 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f673c03a920 con 0x7f67401035d0 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.343+0000 7f6747ee2640 1 -- 172.21.15.71:0/3007121743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6740112070 con 0x7f67401035d0 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.344+0000 7f6747ee2640 1 -- 172.21.15.71:0/3007121743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67400ffa10 con 0x7f67401035d0 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.344+0000 7f67367fc640 1 -- 172.21.15.71:0/3007121743 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f673c03c560 con 0x7f67401035d0 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.344+0000 7f67367fc640 1 --2- 172.21.15.71:0/3007121743 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f672c039530 0x7f672c03b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.344+0000 7f67367fc640 1 -- 172.21.15.71:0/3007121743 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f673c06cff0 con 0x7f67401035d0 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.344+0000 7f674547d640 1 --2- 172.21.15.71:0/3007121743 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f672c039530 0x7f672c03b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.345+0000 7f674547d640 1 --2- 172.21.15.71:0/3007121743 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f672c039530 0x7f672c03b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6730006fd0 tx=0x7f6730006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.348+0000 7f67367fc640 1 -- 172.21.15.71:0/3007121743 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f673c09f2a0 con 0x7f67401035d0 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.506+0000 7f6747ee2640 1 -- 172.21.15.71:0/3007121743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f674004b720 con 0x7f67401035d0 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.507+0000 7f67367fc640 1 -- 172.21.15.71:0/3007121743 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f673c037030 con 0x7f67401035d0 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.509+0000 7f6747ee2640 1 -- 172.21.15.71:0/3007121743 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f672c039530 msgr2=0x7f672c03b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:48.140 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.509+0000 7f6747ee2640 1 --2- 172.21.15.71:0/3007121743 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f672c039530 0x7f672c03b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6730006fd0 tx=0x7f6730006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:48.141 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.509+0000 7f6747ee2640 1 -- 172.21.15.71:0/3007121743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 msgr2=0x7f6740110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:48.141 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.509+0000 7f6747ee2640 1 --2- 172.21.15.71:0/3007121743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 0x7f6740110e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f673c009420 tx=0x7f673c0091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:48.141 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.509+0000 7f6747ee2640 1 -- 172.21.15.71:0/3007121743 shutdown_connections 2024-09-10T09:55:48.141 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.509+0000 7f6747ee2640 1 --2- 172.21.15.71:0/3007121743 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f672c039530 0x7f672c03b9e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:48.141 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.509+0000 7f6747ee2640 1 --2- 172.21.15.71:0/3007121743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67401035d0 0x7f6740110e50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:48.141 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.509+0000 7f6747ee2640 1 -- 172.21.15.71:0/3007121743 >> 172.21.15.71:0/3007121743 conn(0x7f67400fbd90 msgr2=0x7f67400fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:48.141 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.509+0000 7f6747ee2640 1 -- 172.21.15.71:0/3007121743 shutdown_connections 2024-09-10T09:55:48.141 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:47.509+0000 7f6747ee2640 1 -- 172.21.15.71:0/3007121743 wait complete. 2024-09-10T09:55:48.144 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T09:55:48.145 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout disabled 2024-09-10T09:55:48.152 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T09:55:48.152 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stdout inactive 2024-09-10T09:55:48.152 INFO:teuthology.orchestra.run.smithi071.stdout:firewalld.service is not enabled 2024-09-10T09:55:48.152 INFO:teuthology.orchestra.run.smithi071.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T09:55:48.154 INFO:teuthology.orchestra.run.smithi071.stdout:Ceph Dashboard is now available at: 2024-09-10T09:55:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:55:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: URL: https://smithi071.front.sepia.ceph.com:8443/ 2024-09-10T09:55:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: User: admin 2024-09-10T09:55:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: Password: hdxul4bwke 2024-09-10T09:55:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:55:48.154 INFO:teuthology.orchestra.run.smithi071.stdout:Saving cluster configuration to /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config directory 2024-09-10T09:55:48.155 INFO:teuthology.orchestra.run.smithi071.stdout:Enabling autotune for osd_memory_target 2024-09-10T09:55:49.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.533+0000 7fa8cbf1b640 1 Processor -- start 2024-09-10T09:55:49.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.533+0000 7fa8cbf1b640 1 -- start start 2024-09-10T09:55:49.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.534+0000 7fa8cbf1b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 0x7fa8c4104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:49.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.534+0000 7fa8cbf1b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4076f40 con 0x7fa8c4076b30 2024-09-10T09:55:49.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.534+0000 7fa8c9cb7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 0x7fa8c4104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:49.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.534+0000 7fa8c9cb7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 0x7fa8c4104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36034/0 (socket says 172.21.15.71:36034) 2024-09-10T09:55:49.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.534+0000 7fa8c9cb7640 1 -- 172.21.15.71:0/3667831304 learned_addr learned my addr 172.21.15.71:0/3667831304 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:49.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.534+0000 7fa8c9cb7640 1 -- 172.21.15.71:0/3667831304 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4105100 con 0x7fa8c4076b30 2024-09-10T09:55:49.162 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.535+0000 7fa8c9cb7640 1 --2- 172.21.15.71:0/3667831304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 0x7fa8c4104bc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009840 tx=0x7fa8bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c7f2eecb1ffd25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:49.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.535+0000 7fa8c8cb5640 1 -- 172.21.15.71:0/3667831304 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8bc032440 con 0x7fa8c4076b30 2024-09-10T09:55:49.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.535+0000 7fa8c8cb5640 1 -- 172.21.15.71:0/3667831304 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa8bc032a40 con 0x7fa8c4076b30 2024-09-10T09:55:49.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.535+0000 7fa8c8cb5640 1 -- 172.21.15.71:0/3667831304 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8bc031aa0 con 0x7fa8c4076b30 2024-09-10T09:55:49.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.535+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/3667831304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 msgr2=0x7fa8c4104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:49.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.535+0000 7fa8cbf1b640 1 --2- 172.21.15.71:0/3667831304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 0x7fa8c4104bc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009840 tx=0x7fa8bc0091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:49.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.535+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/3667831304 shutdown_connections 2024-09-10T09:55:49.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.535+0000 7fa8cbf1b640 1 --2- 172.21.15.71:0/3667831304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 0x7fa8c4104bc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:49.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.535+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/3667831304 >> 172.21.15.71:0/3667831304 conn(0x7fa8c40fc6d0 msgr2=0x7fa8c40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:49.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.536+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/3667831304 shutdown_connections 2024-09-10T09:55:49.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.536+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/3667831304 wait complete. 2024-09-10T09:55:49.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.536+0000 7fa8cbf1b640 1 Processor -- start 2024-09-10T09:55:49.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.536+0000 7fa8cbf1b640 1 -- start start 2024-09-10T09:55:49.163 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.536+0000 7fa8cbf1b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 0x7fa8c4110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:49.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.536+0000 7fa8cbf1b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c4111380 con 0x7fa8c4076b30 2024-09-10T09:55:49.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.536+0000 7fa8c9cb7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 0x7fa8c4110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:49.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.536+0000 7fa8c9cb7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 0x7fa8c4110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36042/0 (socket says 172.21.15.71:36042) 2024-09-10T09:55:49.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.536+0000 7fa8c9cb7640 1 -- 172.21.15.71:0/1990098035 learned_addr learned my addr 172.21.15.71:0/1990098035 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:49.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.537+0000 7fa8c9cb7640 1 -- 172.21.15.71:0/1990098035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc009450 con 0x7fa8c4076b30 2024-09-10T09:55:49.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.537+0000 7fa8c9cb7640 1 --2- 172.21.15.71:0/1990098035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 0x7fa8c4110e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009810 tx=0x7fa8bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:49.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.537+0000 7fa8c27fc640 1 -- 172.21.15.71:0/1990098035 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8bc0327b0 con 0x7fa8c4076b30 2024-09-10T09:55:49.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.537+0000 7fa8c27fc640 1 -- 172.21.15.71:0/1990098035 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa8bc03b8d0 con 0x7fa8c4076b30 2024-09-10T09:55:49.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.537+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/1990098035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c4111580 con 0x7fa8c4076b30 2024-09-10T09:55:49.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.537+0000 7fa8c27fc640 1 -- 172.21.15.71:0/1990098035 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8bc03a6f0 con 0x7fa8c4076b30 2024-09-10T09:55:49.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.537+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/1990098035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c4111fd0 con 0x7fa8c4076b30 2024-09-10T09:55:49.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.538+0000 7fa8c27fc640 1 -- 172.21.15.71:0/1990098035 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fa8bc039040 con 0x7fa8c4076b30 2024-09-10T09:55:49.164 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.538+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/1990098035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c41002f0 con 0x7fa8c4076b30 2024-09-10T09:55:49.165 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.538+0000 7fa8c27fc640 1 --2- 172.21.15.71:0/1990098035 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fa8ac0394e0 0x7fa8ac03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:49.165 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.538+0000 7fa8c27fc640 1 -- 172.21.15.71:0/1990098035 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa8bc06cc10 con 0x7fa8c4076b30 2024-09-10T09:55:49.165 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.538+0000 7fa8c94b6640 1 --2- 172.21.15.71:0/1990098035 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fa8ac0394e0 0x7fa8ac03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:49.165 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.538+0000 7fa8c94b6640 1 --2- 172.21.15.71:0/1990098035 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fa8ac0394e0 0x7fa8ac03b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8006fd0 tx=0x7fa8b8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:49.165 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.542+0000 7fa8c27fc640 1 -- 172.21.15.71:0/1990098035 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa8bc030990 con 0x7fa8c4076b30 2024-09-10T09:55:49.165 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.697+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/1990098035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fa8c404b720 con 0x7fa8c4076b30 2024-09-10T09:55:49.165 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.697+0000 7fa8c27fc640 1 -- 172.21.15.71:0/1990098035 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fa8bc03f070 con 0x7fa8c4076b30 2024-09-10T09:55:49.165 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.700+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/1990098035 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fa8ac0394e0 msgr2=0x7fa8ac03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:49.165 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.700+0000 7fa8cbf1b640 1 --2- 172.21.15.71:0/1990098035 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fa8ac0394e0 0x7fa8ac03b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8006fd0 tx=0x7fa8b8006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:49.165 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.700+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/1990098035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 msgr2=0x7fa8c4110e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:49.165 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.700+0000 7fa8cbf1b640 1 --2- 172.21.15.71:0/1990098035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 0x7fa8c4110e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009810 tx=0x7fa8bc0091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:49.165 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.700+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/1990098035 shutdown_connections 2024-09-10T09:55:49.166 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.700+0000 7fa8cbf1b640 1 --2- 172.21.15.71:0/1990098035 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fa8ac0394e0 0x7fa8ac03b990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:49.166 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.700+0000 7fa8cbf1b640 1 --2- 172.21.15.71:0/1990098035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8c4076b30 0x7fa8c4110e40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:49.166 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.700+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/1990098035 >> 172.21.15.71:0/1990098035 conn(0x7fa8c40fc6d0 msgr2=0x7fa8c40fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:49.166 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.700+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/1990098035 shutdown_connections 2024-09-10T09:55:49.166 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:48.700+0000 7fa8cbf1b640 1 -- 172.21.15.71:0/1990098035 wait complete. 2024-09-10T09:55:50.085 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:49 smithi071 ceph-mon[27559]: mgrmap e13: smithi071.gtqytr(active, since 6s) 2024-09-10T09:55:50.085 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:49 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/759294084' entity='client.admin' 2024-09-10T09:55:50.328 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.544+0000 7f51be934640 1 Processor -- start 2024-09-10T09:55:50.329 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.545+0000 7f51be934640 1 -- start start 2024-09-10T09:55:50.329 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.545+0000 7f51be934640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 0x7f51b8102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:50.329 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.545+0000 7f51be934640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b81029c0 con 0x7f51b8102070 2024-09-10T09:55:50.329 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.545+0000 7f51b7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 0x7f51b8102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:50.329 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.545+0000 7f51b7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 0x7f51b8102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36058/0 (socket says 172.21.15.71:36058) 2024-09-10T09:55:50.329 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.545+0000 7f51b7fff640 1 -- 172.21.15.71:0/434777648 learned_addr learned my addr 172.21.15.71:0/434777648 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:50.329 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.545+0000 7f51b7fff640 1 -- 172.21.15.71:0/434777648 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b8102b00 con 0x7f51b8102070 2024-09-10T09:55:50.329 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.546+0000 7f51b7fff640 1 --2- 172.21.15.71:0/434777648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 0x7f51b8102480 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009840 tx=0x7f51a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29da25313a178164 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:50.329 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.546+0000 7f51b6ffd640 1 -- 172.21.15.71:0/434777648 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51a8032440 con 0x7f51b8102070 2024-09-10T09:55:50.329 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.546+0000 7f51b6ffd640 1 -- 172.21.15.71:0/434777648 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f51a8032a40 con 0x7f51b8102070 2024-09-10T09:55:50.329 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.546+0000 7f51b6ffd640 1 -- 172.21.15.71:0/434777648 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51a8031aa0 con 0x7f51b8102070 2024-09-10T09:55:50.330 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.547+0000 7f51be934640 1 -- 172.21.15.71:0/434777648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 msgr2=0x7f51b8102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:50.330 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.547+0000 7f51be934640 1 --2- 172.21.15.71:0/434777648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 0x7f51b8102480 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009840 tx=0x7f51a80091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:50.330 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.547+0000 7f51be934640 1 -- 172.21.15.71:0/434777648 shutdown_connections 2024-09-10T09:55:50.330 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.547+0000 7f51be934640 1 --2- 172.21.15.71:0/434777648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 0x7f51b8102480 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:50.330 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.547+0000 7f51be934640 1 -- 172.21.15.71:0/434777648 >> 172.21.15.71:0/434777648 conn(0x7f51b80fd850 msgr2=0x7f51b80ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:50.330 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.547+0000 7f51be934640 1 -- 172.21.15.71:0/434777648 shutdown_connections 2024-09-10T09:55:50.330 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.547+0000 7f51be934640 1 -- 172.21.15.71:0/434777648 wait complete. 2024-09-10T09:55:50.330 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.547+0000 7f51be934640 1 Processor -- start 2024-09-10T09:55:50.330 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.547+0000 7f51be934640 1 -- start start 2024-09-10T09:55:50.330 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.548+0000 7f51be934640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 0x7f51b8110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:50.330 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.548+0000 7f51be934640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b8111340 con 0x7f51b8102070 2024-09-10T09:55:50.330 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.548+0000 7f51b7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 0x7f51b8110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:50.330 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.548+0000 7f51b7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 0x7f51b8110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36072/0 (socket says 172.21.15.71:36072) 2024-09-10T09:55:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.548+0000 7f51b7fff640 1 -- 172.21.15.71:0/759294084 learned_addr learned my addr 172.21.15.71:0/759294084 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.548+0000 7f51b7fff640 1 -- 172.21.15.71:0/759294084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a8009450 con 0x7f51b8102070 2024-09-10T09:55:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.548+0000 7f51b7fff640 1 --2- 172.21.15.71:0/759294084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 0x7f51b8110e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51a8006a70 tx=0x7f51a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.548+0000 7f51b4ff9640 1 -- 172.21.15.71:0/759294084 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51a8031d20 con 0x7f51b8102070 2024-09-10T09:55:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.548+0000 7f51b4ff9640 1 -- 172.21.15.71:0/759294084 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f51a8031e80 con 0x7f51b8102070 2024-09-10T09:55:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.548+0000 7f51be934640 1 -- 172.21.15.71:0/759294084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b8111540 con 0x7f51b8102070 2024-09-10T09:55:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.548+0000 7f51b4ff9640 1 -- 172.21.15.71:0/759294084 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51a803a750 con 0x7f51b8102070 2024-09-10T09:55:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.548+0000 7f51be934640 1 -- 172.21.15.71:0/759294084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b8111f90 con 0x7f51b8102070 2024-09-10T09:55:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.549+0000 7f51b4ff9640 1 -- 172.21.15.71:0/759294084 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f51a8039040 con 0x7f51b8102070 2024-09-10T09:55:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.549+0000 7f51b4ff9640 1 --2- 172.21.15.71:0/759294084 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f51a4039580 0x7f51a403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.549+0000 7f51b4ff9640 1 -- 172.21.15.71:0/759294084 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f51a806cd90 con 0x7f51b8102070 2024-09-10T09:55:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.550+0000 7f51be934640 1 -- 172.21.15.71:0/759294084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b81014d0 con 0x7f51b8102070 2024-09-10T09:55:50.331 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.550+0000 7f51b77fe640 1 --2- 172.21.15.71:0/759294084 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f51a4039580 0x7f51a403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.550+0000 7f51b77fe640 1 --2- 172.21.15.71:0/759294084 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f51a4039580 0x7f51a403ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f51a0006fd0 tx=0x7f51a0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.554+0000 7f51b4ff9640 1 -- 172.21.15.71:0/759294084 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f51a803f070 con 0x7f51b8102070 2024-09-10T09:55:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.793+0000 7f51be934640 1 -- 172.21.15.71:0/759294084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f51b804b720 con 0x7f51b8102070 2024-09-10T09:55:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.796+0000 7f51b4ff9640 1 -- 172.21.15.71:0/759294084 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f51a8037030 con 0x7f51b8102070 2024-09-10T09:55:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T09:55:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.798+0000 7f51be934640 1 -- 172.21.15.71:0/759294084 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f51a4039580 msgr2=0x7f51a403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.798+0000 7f51be934640 1 --2- 172.21.15.71:0/759294084 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f51a4039580 0x7f51a403ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f51a0006fd0 tx=0x7f51a0006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.798+0000 7f51be934640 1 -- 172.21.15.71:0/759294084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 msgr2=0x7f51b8110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.798+0000 7f51be934640 1 --2- 172.21.15.71:0/759294084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 0x7f51b8110e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51a8006a70 tx=0x7f51a80091d0 comp rx=0 tx=0).stop 2024-09-10T09:55:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.798+0000 7f51be934640 1 -- 172.21.15.71:0/759294084 shutdown_connections 2024-09-10T09:55:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.798+0000 7f51be934640 1 --2- 172.21.15.71:0/759294084 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f51a4039580 0x7f51a403ba30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:50.332 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.798+0000 7f51be934640 1 --2- 172.21.15.71:0/759294084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b8102070 0x7f51b8110e00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.798+0000 7f51be934640 1 -- 172.21.15.71:0/759294084 >> 172.21.15.71:0/759294084 conn(0x7f51b80fd850 msgr2=0x7f51b80fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.798+0000 7f51be934640 1 -- 172.21.15.71:0/759294084 shutdown_connections 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout:/usr/bin/ceph: stderr 2024-09-10T09:55:49.798+0000 7f51be934640 1 -- 172.21.15.71:0/759294084 wait complete. 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: ceph telemetry on 2024-09-10T09:55:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:55:50.334 INFO:teuthology.orchestra.run.smithi071.stdout:For more information see: 2024-09-10T09:55:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:55:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-10T09:55:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:55:50.334 INFO:teuthology.orchestra.run.smithi071.stdout:Bootstrap complete. 2024-09-10T09:55:50.361 INFO:tasks.cephadm:Fetching config... 2024-09-10T09:55:50.362 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:55:50.362 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T09:55:50.378 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T09:55:50.378 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:55:50.378 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T09:55:50.434 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T09:55:50.434 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:55:50.434 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/keyring of=/dev/stdout 2024-09-10T09:55:50.498 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T09:55:50.499 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:55:50.499 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T09:55:50.554 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T09:55:50.554 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjdodOYfFm+Q+o3IcVBS3XGiXZc/M0DY3fEsM9N6vVxVQge0siWgXde7Feolod5sXRoMEDXHMnGzLBA7I3uduP7U5TF8mx3LyjLhRp+wxwFSQ5g324lFdFlfQoYlB4GGsG+sfH6kOKDaGc8yUlwQUUUSmvS/iaShC86WeRLReuzeVXyKvSvr/sH0xqOQ6SVjEV35hHc/7tQAJSJoE26gvwMIy9cErAai4+C/3c6J5KgAdRmbtNSliawNxe6Btkb0oLPQDTTJn2ZKFT4+OKDCNH+dBrWiAyT7CDSFRZHcQrT9dH1qUcacY9suwnBidu45EoObu5SB2Am9BIwpxVxd9htXsRWqmKcrHudBWcYYSrvd8vCd/RbZY0gpstMHGlgQ6+KEKORkBcscwpBU9NDWgQMxrC7oX4L50/t9oE8SdlQnUTxfHI5IyIGG0af6333RyFDSW+LEBbY7kLF8pQU8FuD6rqQ6CeCMui4hit3144u+9LxAe8IPCdMfITUHZJUXc= ceph-9dae8622-6f5a-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T09:55:50.627 INFO:teuthology.orchestra.run.smithi071.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjdodOYfFm+Q+o3IcVBS3XGiXZc/M0DY3fEsM9N6vVxVQge0siWgXde7Feolod5sXRoMEDXHMnGzLBA7I3uduP7U5TF8mx3LyjLhRp+wxwFSQ5g324lFdFlfQoYlB4GGsG+sfH6kOKDaGc8yUlwQUUUSmvS/iaShC86WeRLReuzeVXyKvSvr/sH0xqOQ6SVjEV35hHc/7tQAJSJoE26gvwMIy9cErAai4+C/3c6J5KgAdRmbtNSliawNxe6Btkb0oLPQDTTJn2ZKFT4+OKDCNH+dBrWiAyT7CDSFRZHcQrT9dH1qUcacY9suwnBidu45EoObu5SB2Am9BIwpxVxd9htXsRWqmKcrHudBWcYYSrvd8vCd/RbZY0gpstMHGlgQ6+KEKORkBcscwpBU9NDWgQMxrC7oX4L50/t9oE8SdlQnUTxfHI5IyIGG0af6333RyFDSW+LEBbY7kLF8pQU8FuD6rqQ6CeCMui4hit3144u+9LxAe8IPCdMfITUHZJUXc= ceph-9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:55:50.638 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjdodOYfFm+Q+o3IcVBS3XGiXZc/M0DY3fEsM9N6vVxVQge0siWgXde7Feolod5sXRoMEDXHMnGzLBA7I3uduP7U5TF8mx3LyjLhRp+wxwFSQ5g324lFdFlfQoYlB4GGsG+sfH6kOKDaGc8yUlwQUUUSmvS/iaShC86WeRLReuzeVXyKvSvr/sH0xqOQ6SVjEV35hHc/7tQAJSJoE26gvwMIy9cErAai4+C/3c6J5KgAdRmbtNSliawNxe6Btkb0oLPQDTTJn2ZKFT4+OKDCNH+dBrWiAyT7CDSFRZHcQrT9dH1qUcacY9suwnBidu45EoObu5SB2Am9BIwpxVxd9htXsRWqmKcrHudBWcYYSrvd8vCd/RbZY0gpstMHGlgQ6+KEKORkBcscwpBU9NDWgQMxrC7oX4L50/t9oE8SdlQnUTxfHI5IyIGG0af6333RyFDSW+LEBbY7kLF8pQU8FuD6rqQ6CeCMui4hit3144u+9LxAe8IPCdMfITUHZJUXc= ceph-9dae8622-6f5a-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T09:55:50.689 INFO:teuthology.orchestra.run.smithi107.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjdodOYfFm+Q+o3IcVBS3XGiXZc/M0DY3fEsM9N6vVxVQge0siWgXde7Feolod5sXRoMEDXHMnGzLBA7I3uduP7U5TF8mx3LyjLhRp+wxwFSQ5g324lFdFlfQoYlB4GGsG+sfH6kOKDaGc8yUlwQUUUSmvS/iaShC86WeRLReuzeVXyKvSvr/sH0xqOQ6SVjEV35hHc/7tQAJSJoE26gvwMIy9cErAai4+C/3c6J5KgAdRmbtNSliawNxe6Btkb0oLPQDTTJn2ZKFT4+OKDCNH+dBrWiAyT7CDSFRZHcQrT9dH1qUcacY9suwnBidu45EoObu5SB2Am9BIwpxVxd9htXsRWqmKcrHudBWcYYSrvd8vCd/RbZY0gpstMHGlgQ6+KEKORkBcscwpBU9NDWgQMxrC7oX4L50/t9oE8SdlQnUTxfHI5IyIGG0af6333RyFDSW+LEBbY7kLF8pQU8FuD6rqQ6CeCMui4hit3144u+9LxAe8IPCdMfITUHZJUXc= ceph-9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:55:50.702 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T09:55:50.978 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T09:55:53.359 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:53 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:53.359 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:53 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:53.359 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:53 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:55:53.359 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:53 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:53.359 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:53 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi071", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:55:53.359 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:53 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi071", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-10T09:55:53.359 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:53 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:55:53.359 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:53 smithi071 ceph-mon[27559]: Deploying daemon crash.smithi071 on smithi071 2024-09-10T09:55:53.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.356+0000 7fd004a1f640 1 -- 172.21.15.71:0/2722229161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0000fc1f0 msgr2=0x7fd0000fc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:53.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.356+0000 7fd004a1f640 1 --2- 172.21.15.71:0/2722229161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0000fc1f0 0x7fd0000fc600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcff0004850 tx=0x7fcff0009da0 comp rx=0 tx=0).stop 2024-09-10T09:55:53.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.356+0000 7fd004a1f640 1 -- 172.21.15.71:0/2722229161 shutdown_connections 2024-09-10T09:55:53.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.356+0000 7fd004a1f640 1 --2- 172.21.15.71:0/2722229161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0000fc1f0 0x7fd0000fc600 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:53.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.356+0000 7fd004a1f640 1 -- 172.21.15.71:0/2722229161 >> 172.21.15.71:0/2722229161 conn(0x7fd0000f79b0 msgr2=0x7fd0000f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:53.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.357+0000 7fd004a1f640 1 -- 172.21.15.71:0/2722229161 shutdown_connections 2024-09-10T09:55:53.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.357+0000 7fd004a1f640 1 -- 172.21.15.71:0/2722229161 wait complete. 2024-09-10T09:55:53.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.357+0000 7fd004a1f640 1 Processor -- start 2024-09-10T09:55:53.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.357+0000 7fd004a1f640 1 -- start start 2024-09-10T09:55:53.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.357+0000 7fd004a1f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0000fc1f0 0x7fd00010c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:53.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.357+0000 7fd004a1f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00010cc70 con 0x7fd0000fc1f0 2024-09-10T09:55:53.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.357+0000 7fcffe59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0000fc1f0 0x7fd00010c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:53.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.357+0000 7fcffe59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0000fc1f0 0x7fd00010c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48252/0 (socket says 172.21.15.71:48252) 2024-09-10T09:55:53.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.357+0000 7fcffe59c640 1 -- 172.21.15.71:0/3715290083 learned_addr learned my addr 172.21.15.71:0/3715290083 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:53.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.358+0000 7fcffe59c640 1 -- 172.21.15.71:0/3715290083 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff0005040 con 0x7fd0000fc1f0 2024-09-10T09:55:53.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.358+0000 7fcffe59c640 1 --2- 172.21.15.71:0/3715290083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0000fc1f0 0x7fd00010c730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcff002a6d0 tx=0x7fcff0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:53.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.358+0000 7fcfeeffd640 1 -- 172.21.15.71:0/3715290083 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcff0033630 con 0x7fd0000fc1f0 2024-09-10T09:55:53.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.358+0000 7fcfeeffd640 1 -- 172.21.15.71:0/3715290083 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcff0033c30 con 0x7fd0000fc1f0 2024-09-10T09:55:53.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.358+0000 7fcfeeffd640 1 -- 172.21.15.71:0/3715290083 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcff003dc00 con 0x7fd0000fc1f0 2024-09-10T09:55:53.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.358+0000 7fd004a1f640 1 -- 172.21.15.71:0/3715290083 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00010ce70 con 0x7fd0000fc1f0 2024-09-10T09:55:53.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.358+0000 7fd004a1f640 1 -- 172.21.15.71:0/3715290083 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00010d220 con 0x7fd0000fc1f0 2024-09-10T09:55:53.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.359+0000 7fcfeeffd640 1 -- 172.21.15.71:0/3715290083 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7fcff0030020 con 0x7fd0000fc1f0 2024-09-10T09:55:53.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.359+0000 7fcfeeffd640 1 --2- 172.21.15.71:0/3715290083 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fcfe80395d0 0x7fcfe803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:53.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.360+0000 7fcfeeffd640 1 -- 172.21.15.71:0/3715290083 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcff006ca10 con 0x7fd0000fc1f0 2024-09-10T09:55:53.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.360+0000 7fd004a1f640 1 -- 172.21.15.71:0/3715290083 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00005ed70 con 0x7fd0000fc1f0 2024-09-10T09:55:53.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.360+0000 7fcffdd9b640 1 --2- 172.21.15.71:0/3715290083 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fcfe80395d0 0x7fcfe803ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:53.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.360+0000 7fcffdd9b640 1 --2- 172.21.15.71:0/3715290083 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fcfe80395d0 0x7fcfe803ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcff4006fd0 tx=0x7fcff4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:53.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.364+0000 7fcfeeffd640 1 -- 172.21.15.71:0/3715290083 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcff003bb10 con 0x7fd0000fc1f0 2024-09-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.555+0000 7fd004a1f640 1 -- 172.21.15.71:0/3715290083 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fd00004b720 con 0x7fd0000fc1f0 2024-09-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.558+0000 7fcfeeffd640 1 -- 172.21.15.71:0/3715290083 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fcff003b6f0 con 0x7fd0000fc1f0 2024-09-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.560+0000 7fd004a1f640 1 -- 172.21.15.71:0/3715290083 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fcfe80395d0 msgr2=0x7fcfe803ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.560+0000 7fd004a1f640 1 --2- 172.21.15.71:0/3715290083 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fcfe80395d0 0x7fcfe803ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcff4006fd0 tx=0x7fcff4006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.560+0000 7fd004a1f640 1 -- 172.21.15.71:0/3715290083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0000fc1f0 msgr2=0x7fd00010c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.560+0000 7fd004a1f640 1 --2- 172.21.15.71:0/3715290083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0000fc1f0 0x7fd00010c730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcff002a6d0 tx=0x7fcff0009da0 comp rx=0 tx=0).stop 2024-09-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.560+0000 7fd004a1f640 1 -- 172.21.15.71:0/3715290083 shutdown_connections 2024-09-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.560+0000 7fd004a1f640 1 --2- 172.21.15.71:0/3715290083 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fcfe80395d0 0x7fcfe803ba80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.560+0000 7fd004a1f640 1 --2- 172.21.15.71:0/3715290083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0000fc1f0 0x7fd00010c730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.560+0000 7fd004a1f640 1 -- 172.21.15.71:0/3715290083 >> 172.21.15.71:0/3715290083 conn(0x7fd0000f79b0 msgr2=0x7fd0000f8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.560+0000 7fd004a1f640 1 -- 172.21.15.71:0/3715290083 shutdown_connections 2024-09-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:53.560+0000 7fd004a1f640 1 -- 172.21.15.71:0/3715290083 wait complete. 2024-09-10T09:55:54.649 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T09:55:54.649 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T09:55:54.867 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:54 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3715290083' entity='client.admin' 2024-09-10T09:55:55.644 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T09:55:57.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.053+0000 7f7678bdc640 1 -- 172.21.15.71:0/2246124298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76740fb0c0 msgr2=0x7f76740fb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:57.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.053+0000 7f7678bdc640 1 --2- 172.21.15.71:0/2246124298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76740fb0c0 0x7f76740fb4d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7664004850 tx=0x7f7664009da0 comp rx=0 tx=0).stop 2024-09-10T09:55:57.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.053+0000 7f7678bdc640 1 -- 172.21.15.71:0/2246124298 shutdown_connections 2024-09-10T09:55:57.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.053+0000 7f7678bdc640 1 --2- 172.21.15.71:0/2246124298 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76740fb0c0 0x7f76740fb4d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:57.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.053+0000 7f7678bdc640 1 -- 172.21.15.71:0/2246124298 >> 172.21.15.71:0/2246124298 conn(0x7f76740f6880 msgr2=0x7f76740f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.053+0000 7f7678bdc640 1 -- 172.21.15.71:0/2246124298 shutdown_connections 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.053+0000 7f7678bdc640 1 -- 172.21.15.71:0/2246124298 wait complete. 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.053+0000 7f7678bdc640 1 Processor -- start 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.053+0000 7f7678bdc640 1 -- start start 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.054+0000 7f7678bdc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76740fb0c0 0x7f7674065d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.054+0000 7f7678bdc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767410f470 con 0x7f76740fb0c0 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.054+0000 7f767259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76740fb0c0 0x7f7674065d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.054+0000 7f767259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76740fb0c0 0x7f7674065d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48270/0 (socket says 172.21.15.71:48270) 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.054+0000 7f767259c640 1 -- 172.21.15.71:0/1221326106 learned_addr learned my addr 172.21.15.71:0/1221326106 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.054+0000 7f767259c640 1 -- 172.21.15.71:0/1221326106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7664005040 con 0x7f76740fb0c0 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.054+0000 7f767259c640 1 --2- 172.21.15.71:0/1221326106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76740fb0c0 0x7f7674065d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f766402a6d0 tx=0x7f7664009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.054+0000 7f7662ffd640 1 -- 172.21.15.71:0/1221326106 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7664033630 con 0x7f76740fb0c0 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.054+0000 7f7662ffd640 1 -- 172.21.15.71:0/1221326106 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7664033c30 con 0x7f76740fb0c0 2024-09-10T09:55:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.054+0000 7f7662ffd640 1 -- 172.21.15.71:0/1221326106 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f766403dc00 con 0x7f76740fb0c0 2024-09-10T09:55:57.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.054+0000 7f7678bdc640 1 -- 172.21.15.71:0/1221326106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767410f5b0 con 0x7f76740fb0c0 2024-09-10T09:55:57.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.054+0000 7f7678bdc640 1 -- 172.21.15.71:0/1221326106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767410fa20 con 0x7f76740fb0c0 2024-09-10T09:55:57.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.055+0000 7f7662ffd640 1 -- 172.21.15.71:0/1221326106 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f7664030020 con 0x7f76740fb0c0 2024-09-10T09:55:57.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.055+0000 7f7678bdc640 1 -- 172.21.15.71:0/1221326106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767405ed70 con 0x7f76740fb0c0 2024-09-10T09:55:57.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.055+0000 7f7662ffd640 1 --2- 172.21.15.71:0/1221326106 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f765c039580 0x7f765c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:55:57.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.055+0000 7f7662ffd640 1 -- 172.21.15.71:0/1221326106 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f766406ca70 con 0x7f76740fb0c0 2024-09-10T09:55:57.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.055+0000 7f7671d9b640 1 --2- 172.21.15.71:0/1221326106 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f765c039580 0x7f765c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:55:57.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.056+0000 7f7671d9b640 1 --2- 172.21.15.71:0/1221326106 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f765c039580 0x7f765c03ba30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7668006fd0 tx=0x7f7668006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:55:57.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.060+0000 7f7662ffd640 1 -- 172.21.15.71:0/1221326106 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7664045800 con 0x7f76740fb0c0 2024-09-10T09:55:57.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.230+0000 7f7678bdc640 1 -- 172.21.15.71:0/1221326106 --> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f767405db50 con 0x7f765c039580 2024-09-10T09:55:57.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.233+0000 7f7662ffd640 1 -- 172.21.15.71:0/1221326106 <== mgr.14160 v2:172.21.15.71:6800/404028021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f767405db50 con 0x7f765c039580 2024-09-10T09:55:57.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.235+0000 7f7678bdc640 1 -- 172.21.15.71:0/1221326106 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f765c039580 msgr2=0x7f765c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:57.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.235+0000 7f7678bdc640 1 --2- 172.21.15.71:0/1221326106 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f765c039580 0x7f765c03ba30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7668006fd0 tx=0x7f7668006db0 comp rx=0 tx=0).stop 2024-09-10T09:55:57.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.235+0000 7f7678bdc640 1 -- 172.21.15.71:0/1221326106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76740fb0c0 msgr2=0x7f7674065d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:55:57.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.235+0000 7f7678bdc640 1 --2- 172.21.15.71:0/1221326106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76740fb0c0 0x7f7674065d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f766402a6d0 tx=0x7f7664009da0 comp rx=0 tx=0).stop 2024-09-10T09:55:57.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.235+0000 7f7678bdc640 1 -- 172.21.15.71:0/1221326106 shutdown_connections 2024-09-10T09:55:57.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.235+0000 7f7678bdc640 1 --2- 172.21.15.71:0/1221326106 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f765c039580 0x7f765c03ba30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:57.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.235+0000 7f7678bdc640 1 --2- 172.21.15.71:0/1221326106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76740fb0c0 0x7f7674065d80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:55:57.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.235+0000 7f7678bdc640 1 -- 172.21.15.71:0/1221326106 >> 172.21.15.71:0/1221326106 conn(0x7f76740f6880 msgr2=0x7f76740f7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:55:57.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.236+0000 7f7678bdc640 1 -- 172.21.15.71:0/1221326106 shutdown_connections 2024-09-10T09:55:57.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:55:57.236+0000 7f7678bdc640 1 -- 172.21.15.71:0/1221326106 wait complete. 2024-09-10T09:55:58.222 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi107 2024-09-10T09:55:58.223 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-10T09:55:58.223 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/etc/ceph/ceph.conf 2024-09-10T09:55:58.243 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-10T09:55:58.243 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:55:58.301 INFO:tasks.cephadm:Adding host smithi107 to orchestrator... 2024-09-10T09:55:58.301 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph orch host add smithi107 2024-09-10T09:55:58.473 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:58 smithi071 ceph-mon[27559]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:55:58.473 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:58 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:58.473 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:58 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:58.474 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:58 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:58.474 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:58 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:58.474 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:58 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:55:58.474 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:55:58 smithi071 ceph-mon[27559]: Deploying daemon node-exporter.smithi071 on smithi071 2024-09-10T09:55:58.704 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T09:56:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.091+0000 7faa71cff640 1 -- 172.21.15.71:0/414964494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa6c0fb2e0 msgr2=0x7faa6c0fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.091+0000 7faa71cff640 1 --2- 172.21.15.71:0/414964494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa6c0fb2e0 0x7faa6c0fb6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faa5c004850 tx=0x7faa5c009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.091+0000 7faa71cff640 1 -- 172.21.15.71:0/414964494 shutdown_connections 2024-09-10T09:56:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.091+0000 7faa71cff640 1 --2- 172.21.15.71:0/414964494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa6c0fb2e0 0x7faa6c0fb6f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.091+0000 7faa71cff640 1 -- 172.21.15.71:0/414964494 >> 172.21.15.71:0/414964494 conn(0x7faa6c0f6ac0 msgr2=0x7faa6c0f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.091+0000 7faa71cff640 1 -- 172.21.15.71:0/414964494 shutdown_connections 2024-09-10T09:56:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.091+0000 7faa71cff640 1 -- 172.21.15.71:0/414964494 wait complete. 2024-09-10T09:56:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.092+0000 7faa71cff640 1 Processor -- start 2024-09-10T09:56:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.092+0000 7faa71cff640 1 -- start start 2024-09-10T09:56:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.092+0000 7faa71cff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa6c0fb2e0 0x7faa6c10b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.092+0000 7faa71cff640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c10bd60 con 0x7faa6c0fb2e0 2024-09-10T09:56:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.092+0000 7faa6b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa6c0fb2e0 0x7faa6c10b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.092+0000 7faa6b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa6c0fb2e0 0x7faa6c10b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48304/0 (socket says 172.21.15.71:48304) 2024-09-10T09:56:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.092+0000 7faa6b7fe640 1 -- 172.21.15.71:0/881203434 learned_addr learned my addr 172.21.15.71:0/881203434 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:56:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.092+0000 7faa6b7fe640 1 -- 172.21.15.71:0/881203434 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c005040 con 0x7faa6c0fb2e0 2024-09-10T09:56:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.093+0000 7faa6b7fe640 1 --2- 172.21.15.71:0/881203434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa6c0fb2e0 0x7faa6c10b820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faa5c000c00 tx=0x7faa5c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.093+0000 7faa53fff640 1 -- 172.21.15.71:0/881203434 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa5c033630 con 0x7faa6c0fb2e0 2024-09-10T09:56:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.093+0000 7faa53fff640 1 -- 172.21.15.71:0/881203434 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faa5c033c30 con 0x7faa6c0fb2e0 2024-09-10T09:56:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.093+0000 7faa53fff640 1 -- 172.21.15.71:0/881203434 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa5c03fbc0 con 0x7faa6c0fb2e0 2024-09-10T09:56:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.093+0000 7faa71cff640 1 -- 172.21.15.71:0/881203434 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6c10bf60 con 0x7faa6c0fb2e0 2024-09-10T09:56:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.093+0000 7faa71cff640 1 -- 172.21.15.71:0/881203434 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c10c3d0 con 0x7faa6c0fb2e0 2024-09-10T09:56:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.094+0000 7faa53fff640 1 -- 172.21.15.71:0/881203434 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7faa5c030020 con 0x7faa6c0fb2e0 2024-09-10T09:56:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.094+0000 7faa53fff640 1 --2- 172.21.15.71:0/881203434 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7faa540395d0 0x7faa5403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.094+0000 7faa53fff640 1 -- 172.21.15.71:0/881203434 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7faa5c06e590 con 0x7faa6c0fb2e0 2024-09-10T09:56:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.094+0000 7faa71cff640 1 -- 172.21.15.71:0/881203434 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c101700 con 0x7faa6c0fb2e0 2024-09-10T09:56:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.094+0000 7faa6affd640 1 --2- 172.21.15.71:0/881203434 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7faa540395d0 0x7faa5403ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.095+0000 7faa6affd640 1 --2- 172.21.15.71:0/881203434 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7faa540395d0 0x7faa5403ba80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faa60006fd0 tx=0x7faa60006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:00.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.100+0000 7faa53fff640 1 -- 172.21.15.71:0/881203434 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faa5c047390 con 0x7faa6c0fb2e0 2024-09-10T09:56:00.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:00.284+0000 7faa71cff640 1 -- 172.21.15.71:0/881203434 --> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi107", "target": ["mon-mgr", ""]}) v1 -- 0x7faa6c100fa0 con 0x7faa540395d0 2024-09-10T09:56:01.241 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:00 smithi071 ceph-mon[27559]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi107", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:56:01.973 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:01 smithi071 ceph-mon[27559]: Deploying cephadm binary to smithi107 2024-09-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:03.227+0000 7faa53fff640 1 -- 172.21.15.71:0/881203434 <== mgr.14160 v2:172.21.15.71:6800/404028021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7faa6c100fa0 con 0x7faa540395d0 2024-09-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi071.stdout:Added host 'smithi107' with addr '172.21.15.107' 2024-09-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:03.229+0000 7faa71cff640 1 -- 172.21.15.71:0/881203434 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7faa540395d0 msgr2=0x7faa5403ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:03.229+0000 7faa71cff640 1 --2- 172.21.15.71:0/881203434 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7faa540395d0 0x7faa5403ba80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faa60006fd0 tx=0x7faa60006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:03.229+0000 7faa71cff640 1 -- 172.21.15.71:0/881203434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa6c0fb2e0 msgr2=0x7faa6c10b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:03.229+0000 7faa71cff640 1 --2- 172.21.15.71:0/881203434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa6c0fb2e0 0x7faa6c10b820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faa5c000c00 tx=0x7faa5c009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:03.229+0000 7faa71cff640 1 -- 172.21.15.71:0/881203434 shutdown_connections 2024-09-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:03.229+0000 7faa71cff640 1 --2- 172.21.15.71:0/881203434 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7faa540395d0 0x7faa5403ba80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:03.229+0000 7faa71cff640 1 --2- 172.21.15.71:0/881203434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa6c0fb2e0 0x7faa6c10b820 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:03.229+0000 7faa71cff640 1 -- 172.21.15.71:0/881203434 >> 172.21.15.71:0/881203434 conn(0x7faa6c0f6ac0 msgr2=0x7faa6c0f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:03.229+0000 7faa71cff640 1 -- 172.21.15.71:0/881203434 shutdown_connections 2024-09-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:03.229+0000 7faa71cff640 1 -- 172.21.15.71:0/881203434 wait complete. 2024-09-10T09:56:03.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:03 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:03.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:03 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:03.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:03 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:03.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:03 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:03.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:03 smithi071 ceph-mon[27559]: Deploying daemon alertmanager.smithi071 on smithi071 2024-09-10T09:56:03.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:03 smithi071 ceph-mon[27559]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:03.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:03 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:04.276 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T09:56:04.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:04 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:04.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:04 smithi071 ceph-mon[27559]: Added host smithi107 2024-09-10T09:56:04.541 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T09:56:05.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:05 smithi071 ceph-mon[27559]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:07.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.272+0000 7ff31ecf5640 1 -- 172.21.15.71:0/3283566488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3180fb2e0 msgr2=0x7ff3180fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:07.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.272+0000 7ff31ecf5640 1 --2- 172.21.15.71:0/3283566488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3180fb2e0 0x7ff3180fb6f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff314004850 tx=0x7ff314009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:07.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.272+0000 7ff31ecf5640 1 -- 172.21.15.71:0/3283566488 shutdown_connections 2024-09-10T09:56:07.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.272+0000 7ff31ecf5640 1 --2- 172.21.15.71:0/3283566488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3180fb2e0 0x7ff3180fb6f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:07.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.272+0000 7ff31ecf5640 1 -- 172.21.15.71:0/3283566488 >> 172.21.15.71:0/3283566488 conn(0x7ff3180f6ac0 msgr2=0x7ff3180f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:07.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.272+0000 7ff31ecf5640 1 -- 172.21.15.71:0/3283566488 shutdown_connections 2024-09-10T09:56:07.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.272+0000 7ff31ecf5640 1 -- 172.21.15.71:0/3283566488 wait complete. 2024-09-10T09:56:07.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.272+0000 7ff31ecf5640 1 Processor -- start 2024-09-10T09:56:07.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.272+0000 7ff31ecf5640 1 -- start start 2024-09-10T09:56:07.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.273+0000 7ff31ecf5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3180fb2e0 0x7ff31810c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:07.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.273+0000 7ff31ecf5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31810ce40 con 0x7ff3180fb2e0 2024-09-10T09:56:07.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.273+0000 7ff31ca91640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3180fb2e0 0x7ff31810c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:07.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.273+0000 7ff31ca91640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3180fb2e0 0x7ff31810c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56502/0 (socket says 172.21.15.71:56502) 2024-09-10T09:56:07.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.273+0000 7ff31ca91640 1 -- 172.21.15.71:0/148629770 learned_addr learned my addr 172.21.15.71:0/148629770 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:56:07.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.273+0000 7ff31ca91640 1 -- 172.21.15.71:0/148629770 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff314005040 con 0x7ff3180fb2e0 2024-09-10T09:56:07.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.273+0000 7ff31ca91640 1 --2- 172.21.15.71:0/148629770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3180fb2e0 0x7ff31810c900 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff314009920 tx=0x7ff314009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:07.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.273+0000 7ff30d7fa640 1 -- 172.21.15.71:0/148629770 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff314033630 con 0x7ff3180fb2e0 2024-09-10T09:56:07.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.273+0000 7ff30d7fa640 1 -- 172.21.15.71:0/148629770 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff314033c30 con 0x7ff3180fb2e0 2024-09-10T09:56:07.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.273+0000 7ff31ecf5640 1 -- 172.21.15.71:0/148629770 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31810d040 con 0x7ff3180fb2e0 2024-09-10T09:56:07.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.273+0000 7ff30d7fa640 1 -- 172.21.15.71:0/148629770 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff31403dc40 con 0x7ff3180fb2e0 2024-09-10T09:56:07.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.273+0000 7ff31ecf5640 1 -- 172.21.15.71:0/148629770 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31810d4b0 con 0x7ff3180fb2e0 2024-09-10T09:56:07.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.274+0000 7ff30d7fa640 1 -- 172.21.15.71:0/148629770 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7ff314030020 con 0x7ff3180fb2e0 2024-09-10T09:56:07.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.274+0000 7ff31ecf5640 1 -- 172.21.15.71:0/148629770 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31805ed70 con 0x7ff3180fb2e0 2024-09-10T09:56:07.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.275+0000 7ff30d7fa640 1 --2- 172.21.15.71:0/148629770 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7ff3000395d0 0x7ff30003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:07.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.275+0000 7ff30d7fa640 1 -- 172.21.15.71:0/148629770 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff31406c8c0 con 0x7ff3180fb2e0 2024-09-10T09:56:07.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.275+0000 7ff30ffff640 1 --2- 172.21.15.71:0/148629770 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7ff3000395d0 0x7ff30003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:07.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.275+0000 7ff30ffff640 1 --2- 172.21.15.71:0/148629770 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7ff3000395d0 0x7ff30003ba80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff308006fd0 tx=0x7ff308006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:07.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.279+0000 7ff30d7fa640 1 -- 172.21.15.71:0/148629770 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff31403bb50 con 0x7ff3180fb2e0 2024-09-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.440+0000 7ff31ecf5640 1 -- 172.21.15.71:0/148629770 --> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff31810d4b0 con 0x7ff3000395d0 2024-09-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.441+0000 7ff30d7fa640 1 -- 172.21.15.71:0/148629770 <== mgr.14160 v2:172.21.15.71:6800/404028021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7ff31810d4b0 con 0x7ff3000395d0 2024-09-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi071.stdout:[{"addr": "172.21.15.71", "hostname": "smithi071", "labels": [], "status": ""}, {"addr": "172.21.15.107", "hostname": "smithi107", "labels": [], "status": ""}] 2024-09-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.443+0000 7ff31ecf5640 1 -- 172.21.15.71:0/148629770 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7ff3000395d0 msgr2=0x7ff30003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.443+0000 7ff31ecf5640 1 --2- 172.21.15.71:0/148629770 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7ff3000395d0 0x7ff30003ba80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff308006fd0 tx=0x7ff308006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.443+0000 7ff31ecf5640 1 -- 172.21.15.71:0/148629770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3180fb2e0 msgr2=0x7ff31810c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.443+0000 7ff31ecf5640 1 --2- 172.21.15.71:0/148629770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3180fb2e0 0x7ff31810c900 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff314009920 tx=0x7ff314009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.443+0000 7ff31ecf5640 1 -- 172.21.15.71:0/148629770 shutdown_connections 2024-09-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.443+0000 7ff31ecf5640 1 --2- 172.21.15.71:0/148629770 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7ff3000395d0 0x7ff30003ba80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.443+0000 7ff31ecf5640 1 --2- 172.21.15.71:0/148629770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3180fb2e0 0x7ff31810c900 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.443+0000 7ff31ecf5640 1 -- 172.21.15.71:0/148629770 >> 172.21.15.71:0/148629770 conn(0x7ff3180f6ac0 msgr2=0x7ff318064990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.443+0000 7ff31ecf5640 1 -- 172.21.15.71:0/148629770 shutdown_connections 2024-09-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:07.443+0000 7ff31ecf5640 1 -- 172.21.15.71:0/148629770 wait complete. 2024-09-10T09:56:07.453 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:07 smithi071 ceph-mon[27559]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:08.522 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:08 smithi071 ceph-mon[27559]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T09:56:09.305 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T09:56:09.306 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T09:56:09.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:09 smithi071 ceph-mon[27559]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:09.979 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T09:56:11.498 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:11 smithi071 ceph-mon[27559]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.798+0000 7f93d9b93640 1 -- 172.21.15.71:0/3545199375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d40fb2e0 msgr2=0x7f93d40fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.798+0000 7f93d9b93640 1 --2- 172.21.15.71:0/3545199375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d40fb2e0 0x7f93d40fb6f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f93c4004850 tx=0x7f93c4009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.798+0000 7f93d9b93640 1 -- 172.21.15.71:0/3545199375 shutdown_connections 2024-09-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.798+0000 7f93d9b93640 1 --2- 172.21.15.71:0/3545199375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d40fb2e0 0x7f93d40fb6f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.798+0000 7f93d9b93640 1 -- 172.21.15.71:0/3545199375 >> 172.21.15.71:0/3545199375 conn(0x7f93d40f6ac0 msgr2=0x7f93d40f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.798+0000 7f93d9b93640 1 -- 172.21.15.71:0/3545199375 shutdown_connections 2024-09-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.798+0000 7f93d9b93640 1 -- 172.21.15.71:0/3545199375 wait complete. 2024-09-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.799+0000 7f93d9b93640 1 Processor -- start 2024-09-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.799+0000 7f93d9b93640 1 -- start start 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.799+0000 7f93d9b93640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d40fb2e0 0x7f93d4065530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.799+0000 7f93d9b93640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d410f600 con 0x7f93d40fb2e0 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.799+0000 7f93d37fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d40fb2e0 0x7f93d4065530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.799+0000 7f93d37fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d40fb2e0 0x7f93d4065530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56522/0 (socket says 172.21.15.71:56522) 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.799+0000 7f93d37fe640 1 -- 172.21.15.71:0/3561441850 learned_addr learned my addr 172.21.15.71:0/3561441850 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.799+0000 7f93d37fe640 1 -- 172.21.15.71:0/3561441850 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c4005040 con 0x7f93d40fb2e0 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.799+0000 7f93d37fe640 1 --2- 172.21.15.71:0/3561441850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d40fb2e0 0x7f93d4065530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f93c402a6d0 tx=0x7f93c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.800+0000 7f93bbfff640 1 -- 172.21.15.71:0/3561441850 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93c4033630 con 0x7f93d40fb2e0 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.800+0000 7f93bbfff640 1 -- 172.21.15.71:0/3561441850 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f93c4033c30 con 0x7f93d40fb2e0 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.800+0000 7f93d9b93640 1 -- 172.21.15.71:0/3561441850 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d410f740 con 0x7f93d40fb2e0 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.800+0000 7f93bbfff640 1 -- 172.21.15.71:0/3561441850 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93c403dc00 con 0x7f93d40fb2e0 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.800+0000 7f93d9b93640 1 -- 172.21.15.71:0/3561441850 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d410fbb0 con 0x7f93d40fb2e0 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.801+0000 7f93bbfff640 1 -- 172.21.15.71:0/3561441850 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f93c4030020 con 0x7f93d40fb2e0 2024-09-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.801+0000 7f93d9b93640 1 -- 172.21.15.71:0/3561441850 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d405ed70 con 0x7f93d40fb2e0 2024-09-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.801+0000 7f93bbfff640 1 --2- 172.21.15.71:0/3561441850 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f93bc039580 0x7f93bc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.801+0000 7f93bbfff640 1 -- 172.21.15.71:0/3561441850 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f93c406ca50 con 0x7f93d40fb2e0 2024-09-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.801+0000 7f93d2ffd640 1 --2- 172.21.15.71:0/3561441850 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f93bc039580 0x7f93bc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.802+0000 7f93d2ffd640 1 --2- 172.21.15.71:0/3561441850 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f93bc039580 0x7f93bc03ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006fd0 tx=0x7f93c8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.809+0000 7f93bbfff640 1 -- 172.21.15.71:0/3561441850 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f93c403bdb0 con 0x7f93d40fb2e0 2024-09-10T09:56:12.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:12.984+0000 7f93d9b93640 1 -- 172.21.15.71:0/3561441850 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f93d404b720 con 0x7f93d40fb2e0 2024-09-10T09:56:13.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:13.717+0000 7f93bbfff640 1 -- 172.21.15.71:0/3561441850 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f93c403b7e0 con 0x7f93d40fb2e0 2024-09-10T09:56:13.718 INFO:teuthology.orchestra.run.smithi071.stderr:adjusted tunables profile to default 2024-09-10T09:56:13.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:13.719+0000 7f93d9b93640 1 -- 172.21.15.71:0/3561441850 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f93bc039580 msgr2=0x7f93bc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:13.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:13.719+0000 7f93d9b93640 1 --2- 172.21.15.71:0/3561441850 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f93bc039580 0x7f93bc03ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006fd0 tx=0x7f93c8006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:13.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:13.719+0000 7f93d9b93640 1 -- 172.21.15.71:0/3561441850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d40fb2e0 msgr2=0x7f93d4065530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:13.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:13.719+0000 7f93d9b93640 1 --2- 172.21.15.71:0/3561441850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d40fb2e0 0x7f93d4065530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f93c402a6d0 tx=0x7f93c4009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:13.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:13.719+0000 7f93d9b93640 1 -- 172.21.15.71:0/3561441850 shutdown_connections 2024-09-10T09:56:13.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:13.719+0000 7f93d9b93640 1 --2- 172.21.15.71:0/3561441850 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f93bc039580 0x7f93bc03ba30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:13.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:13.719+0000 7f93d9b93640 1 --2- 172.21.15.71:0/3561441850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93d40fb2e0 0x7f93d4065530 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:13.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:13.719+0000 7f93d9b93640 1 -- 172.21.15.71:0/3561441850 >> 172.21.15.71:0/3561441850 conn(0x7f93d40f6ac0 msgr2=0x7f93d40f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:13.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:13.720+0000 7f93d9b93640 1 -- 172.21.15.71:0/3561441850 shutdown_connections 2024-09-10T09:56:13.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:56:13.720+0000 7f93d9b93640 1 -- 172.21.15.71:0/3561441850 wait complete. 2024-09-10T09:56:14.029 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:13 smithi071 ceph-mon[27559]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:14.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:13 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:14.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:13 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:14.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:13 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:14.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:13 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:14.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:13 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:14.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:13 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:14.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:13 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-10T09:56:14.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:13 smithi071 ceph-mon[27559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-10T09:56:14.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:13 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:14.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:13 smithi071 ceph-mon[27559]: Deploying daemon grafana.smithi071 on smithi071 2024-09-10T09:56:14.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:13 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3561441850' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T09:56:14.383 INFO:tasks.cephadm:Adding mon.smithi071 on smithi071 2024-09-10T09:56:14.383 INFO:tasks.cephadm:Adding mon.smithi107 on smithi107 2024-09-10T09:56:14.383 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph orch apply mon '2;smithi071:172.21.15.71=smithi071;smithi107:172.21.15.107=smithi107' 2024-09-10T09:56:14.626 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:14.670 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:15.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:14 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3561441850' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T09:56:15.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:14 smithi071 ceph-mon[27559]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T09:56:16.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:15 smithi071 ceph-mon[27559]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:16.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.222+0000 7ff01c28b640 1 -- 172.21.15.107:0/3375979224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0140fb2e0 msgr2=0x7ff0140fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:16.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.222+0000 7ff01c28b640 1 --2- 172.21.15.107:0/3375979224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0140fb2e0 0x7ff0140fb6f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff008004850 tx=0x7ff008009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:16.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.222+0000 7ff01c28b640 1 -- 172.21.15.107:0/3375979224 shutdown_connections 2024-09-10T09:56:16.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.222+0000 7ff01c28b640 1 --2- 172.21.15.107:0/3375979224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0140fb2e0 0x7ff0140fb6f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:16.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.222+0000 7ff01c28b640 1 -- 172.21.15.107:0/3375979224 >> 172.21.15.107:0/3375979224 conn(0x7ff0140f6ac0 msgr2=0x7ff0140f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:16.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.222+0000 7ff01c28b640 1 -- 172.21.15.107:0/3375979224 shutdown_connections 2024-09-10T09:56:16.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.222+0000 7ff01c28b640 1 -- 172.21.15.107:0/3375979224 wait complete. 2024-09-10T09:56:16.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.223+0000 7ff01c28b640 1 Processor -- start 2024-09-10T09:56:16.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.223+0000 7ff01c28b640 1 -- start start 2024-09-10T09:56:16.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.223+0000 7ff01c28b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0140fb2e0 0x7ff0140f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:16.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.223+0000 7ff01c28b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0140f8f20 con 0x7ff0140fb2e0 2024-09-10T09:56:16.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.223+0000 7ff01a027640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0140fb2e0 0x7ff0140f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:16.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.223+0000 7ff01a027640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0140fb2e0 0x7ff0140f89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:46608/0 (socket says 172.21.15.107:46608) 2024-09-10T09:56:16.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.223+0000 7ff01a027640 1 -- 172.21.15.107:0/2163465846 learned_addr learned my addr 172.21.15.107:0/2163465846 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:56:16.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.223+0000 7ff01a027640 1 -- 172.21.15.107:0/2163465846 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff008005040 con 0x7ff0140fb2e0 2024-09-10T09:56:16.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.224+0000 7ff01a027640 1 --2- 172.21.15.107:0/2163465846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0140fb2e0 0x7ff0140f89e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff00802a6d0 tx=0x7ff008009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:16.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.224+0000 7ff006ffd640 1 -- 172.21.15.107:0/2163465846 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff008033630 con 0x7ff0140fb2e0 2024-09-10T09:56:16.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.224+0000 7ff006ffd640 1 -- 172.21.15.107:0/2163465846 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff008033c30 con 0x7ff0140fb2e0 2024-09-10T09:56:16.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.224+0000 7ff006ffd640 1 -- 172.21.15.107:0/2163465846 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff00803dc00 con 0x7ff0140fb2e0 2024-09-10T09:56:16.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.224+0000 7ff01c28b640 1 -- 172.21.15.107:0/2163465846 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0140f6fb0 con 0x7ff0140fb2e0 2024-09-10T09:56:16.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.224+0000 7ff01c28b640 1 -- 172.21.15.107:0/2163465846 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0140f7420 con 0x7ff0140fb2e0 2024-09-10T09:56:16.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.225+0000 7ff006ffd640 1 -- 172.21.15.107:0/2163465846 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7ff008030020 con 0x7ff0140fb2e0 2024-09-10T09:56:16.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.225+0000 7ff01c28b640 1 -- 172.21.15.107:0/2163465846 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01405ed70 con 0x7ff0140fb2e0 2024-09-10T09:56:16.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.225+0000 7ff006ffd640 1 --2- 172.21.15.107:0/2163465846 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7ff0000395d0 0x7ff00003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:16.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.225+0000 7ff006ffd640 1 -- 172.21.15.107:0/2163465846 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff00806ca90 con 0x7ff0140fb2e0 2024-09-10T09:56:16.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.225+0000 7ff019826640 1 --2- 172.21.15.107:0/2163465846 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7ff0000395d0 0x7ff00003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:16.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.226+0000 7ff019826640 1 --2- 172.21.15.107:0/2163465846 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7ff0000395d0 0x7ff00003ba80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff010006fd0 tx=0x7ff010006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:16.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.230+0000 7ff006ffd640 1 -- 172.21.15.107:0/2163465846 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff008045800 con 0x7ff0140fb2e0 2024-09-10T09:56:16.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.396+0000 7ff01c28b640 1 -- 172.21.15.107:0/2163465846 --> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi071:172.21.15.71=smithi071;smithi107:172.21.15.107=smithi107", "target": ["mon-mgr", ""]}) v1 -- 0x7ff014065150 con 0x7ff0000395d0 2024-09-10T09:56:16.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.402+0000 7ff006ffd640 1 -- 172.21.15.107:0/2163465846 <== mgr.14160 v2:172.21.15.71:6800/404028021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff014065150 con 0x7ff0000395d0 2024-09-10T09:56:16.404 INFO:teuthology.orchestra.run.smithi107.stdout:Scheduled mon update... 2024-09-10T09:56:16.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.403+0000 7ff01c28b640 1 -- 172.21.15.107:0/2163465846 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7ff0000395d0 msgr2=0x7ff00003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.403+0000 7ff01c28b640 1 --2- 172.21.15.107:0/2163465846 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7ff0000395d0 0x7ff00003ba80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff010006fd0 tx=0x7ff010006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.403+0000 7ff01c28b640 1 -- 172.21.15.107:0/2163465846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0140fb2e0 msgr2=0x7ff0140f89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.403+0000 7ff01c28b640 1 --2- 172.21.15.107:0/2163465846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0140fb2e0 0x7ff0140f89e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff00802a6d0 tx=0x7ff008009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.403+0000 7ff01c28b640 1 -- 172.21.15.107:0/2163465846 shutdown_connections 2024-09-10T09:56:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.403+0000 7ff01c28b640 1 --2- 172.21.15.107:0/2163465846 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7ff0000395d0 0x7ff00003ba80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.403+0000 7ff01c28b640 1 --2- 172.21.15.107:0/2163465846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0140fb2e0 0x7ff0140f89e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.403+0000 7ff01c28b640 1 -- 172.21.15.107:0/2163465846 >> 172.21.15.107:0/2163465846 conn(0x7ff0140f6ac0 msgr2=0x7ff014064990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.403+0000 7ff01c28b640 1 -- 172.21.15.107:0/2163465846 shutdown_connections 2024-09-10T09:56:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:16.403+0000 7ff01c28b640 1 -- 172.21.15.107:0/2163465846 wait complete. 2024-09-10T09:56:16.992 DEBUG:teuthology.orchestra.run.smithi107:mon.smithi107> sudo journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi107.service 2024-09-10T09:56:16.995 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:56:16.995 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:56:17.263 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:17.308 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:17.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:17 smithi071 ceph-mon[27559]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:17.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:17 smithi071 ceph-mon[27559]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi071:172.21.15.71=smithi071;smithi107:172.21.15.107=smithi107", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:56:17.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:17 smithi071 ceph-mon[27559]: Saving service mon spec with placement smithi071:172.21.15.71=smithi071;smithi107:172.21.15.107=smithi107;count:2 2024-09-10T09:56:17.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:17 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:17.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:17 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:18.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.633+0000 7f4d78859640 1 -- 172.21.15.107:0/3599175541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d740fa850 msgr2=0x7f4d740fac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:18.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.633+0000 7f4d78859640 1 --2- 172.21.15.107:0/3599175541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d740fa850 0x7f4d740fac60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4d64004850 tx=0x7f4d64009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:18.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.633+0000 7f4d78859640 1 -- 172.21.15.107:0/3599175541 shutdown_connections 2024-09-10T09:56:18.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.633+0000 7f4d78859640 1 --2- 172.21.15.107:0/3599175541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d740fa850 0x7f4d740fac60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:18.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.633+0000 7f4d78859640 1 -- 172.21.15.107:0/3599175541 >> 172.21.15.107:0/3599175541 conn(0x7f4d740f6010 msgr2=0x7f4d740f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:18.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.633+0000 7f4d78859640 1 -- 172.21.15.107:0/3599175541 shutdown_connections 2024-09-10T09:56:18.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.633+0000 7f4d78859640 1 -- 172.21.15.107:0/3599175541 wait complete. 2024-09-10T09:56:18.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.634+0000 7f4d78859640 1 Processor -- start 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.634+0000 7f4d78859640 1 -- start start 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.634+0000 7f4d78859640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d740fa850 0x7f4d740f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.634+0000 7f4d78859640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7410f4a0 con 0x7f4d740fa850 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.634+0000 7f4d7259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d740fa850 0x7f4d740f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.634+0000 7f4d7259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d740fa850 0x7f4d740f6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:46630/0 (socket says 172.21.15.107:46630) 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.634+0000 7f4d7259c640 1 -- 172.21.15.107:0/2585791229 learned_addr learned my addr 172.21.15.107:0/2585791229 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.634+0000 7f4d7259c640 1 -- 172.21.15.107:0/2585791229 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d64005040 con 0x7f4d740fa850 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.634+0000 7f4d7259c640 1 --2- 172.21.15.107:0/2585791229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d740fa850 0x7f4d740f6f70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d6402a6d0 tx=0x7f4d64009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.635+0000 7f4d6affd640 1 -- 172.21.15.107:0/2585791229 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d64033630 con 0x7f4d740fa850 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.635+0000 7f4d78859640 1 -- 172.21.15.107:0/2585791229 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7410f5e0 con 0x7f4d740fa850 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.635+0000 7f4d6affd640 1 -- 172.21.15.107:0/2585791229 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4d64033c30 con 0x7f4d740fa850 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.635+0000 7f4d6affd640 1 -- 172.21.15.107:0/2585791229 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d6403dc30 con 0x7f4d740fa850 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.635+0000 7f4d78859640 1 -- 172.21.15.107:0/2585791229 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7410f9f0 con 0x7f4d740fa850 2024-09-10T09:56:18.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.636+0000 7f4d78859640 1 -- 172.21.15.107:0/2585791229 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7405ed70 con 0x7f4d740fa850 2024-09-10T09:56:18.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.636+0000 7f4d6affd640 1 -- 172.21.15.107:0/2585791229 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f4d64030020 con 0x7f4d740fa850 2024-09-10T09:56:18.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.636+0000 7f4d6affd640 1 --2- 172.21.15.107:0/2585791229 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f4d60039580 0x7f4d6003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:18.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.636+0000 7f4d6affd640 1 -- 172.21.15.107:0/2585791229 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4d6406ca40 con 0x7f4d740fa850 2024-09-10T09:56:18.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.636+0000 7f4d6bfff640 1 --2- 172.21.15.107:0/2585791229 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f4d60039580 0x7f4d6003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:18.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.636+0000 7f4d6bfff640 1 --2- 172.21.15.107:0/2585791229 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f4d60039580 0x7f4d6003ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c006fd0 tx=0x7f4d5c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:18.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.644+0000 7f4d6affd640 1 -- 172.21.15.107:0/2585791229 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4d64033da0 con 0x7f4d740fa850 2024-09-10T09:56:18.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.859+0000 7f4d78859640 1 -- 172.21.15.107:0/2585791229 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4d74104f00 con 0x7f4d740fa850 2024-09-10T09:56:18.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.860+0000 7f4d6affd640 1 -- 172.21.15.107:0/2585791229 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4d6403de60 con 0x7f4d740fa850 2024-09-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.862+0000 7f4d78859640 1 -- 172.21.15.107:0/2585791229 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f4d60039580 msgr2=0x7f4d6003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.862+0000 7f4d78859640 1 --2- 172.21.15.107:0/2585791229 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f4d60039580 0x7f4d6003ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c006fd0 tx=0x7f4d5c006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.862+0000 7f4d78859640 1 -- 172.21.15.107:0/2585791229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d740fa850 msgr2=0x7f4d740f6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.862+0000 7f4d78859640 1 --2- 172.21.15.107:0/2585791229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d740fa850 0x7f4d740f6f70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d6402a6d0 tx=0x7f4d64009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.862+0000 7f4d78859640 1 -- 172.21.15.107:0/2585791229 shutdown_connections 2024-09-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.862+0000 7f4d78859640 1 --2- 172.21.15.107:0/2585791229 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f4d60039580 0x7f4d6003ba30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.862+0000 7f4d78859640 1 --2- 172.21.15.107:0/2585791229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d740fa850 0x7f4d740f6f70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.862+0000 7f4d78859640 1 -- 172.21.15.107:0/2585791229 >> 172.21.15.107:0/2585791229 conn(0x7f4d740f6010 msgr2=0x7f4d740fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.862+0000 7f4d78859640 1 -- 172.21.15.107:0/2585791229 shutdown_connections 2024-09-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:18.862+0000 7f4d78859640 1 -- 172.21.15.107:0/2585791229 wait complete. 2024-09-10T09:56:19.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:19 smithi071 ceph-mon[27559]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:19.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:19 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/2585791229' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:56:20.422 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:56:20.422 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:56:20.668 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:20.713 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:21.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:21 smithi071 ceph-mon[27559]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:22.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.135+0000 7fd7f91a7640 1 -- 172.21.15.107:0/416871226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f40fc1b0 msgr2=0x7fd7f40fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:22.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.135+0000 7fd7f91a7640 1 --2- 172.21.15.107:0/416871226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f40fc1b0 0x7fd7f40fc5c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4004850 tx=0x7fd7e4009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:22.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.135+0000 7fd7f91a7640 1 -- 172.21.15.107:0/416871226 shutdown_connections 2024-09-10T09:56:22.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.135+0000 7fd7f91a7640 1 --2- 172.21.15.107:0/416871226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f40fc1b0 0x7fd7f40fc5c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:22.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.135+0000 7fd7f91a7640 1 -- 172.21.15.107:0/416871226 >> 172.21.15.107:0/416871226 conn(0x7fd7f40f7990 msgr2=0x7fd7f40f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:22.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.135+0000 7fd7f91a7640 1 -- 172.21.15.107:0/416871226 shutdown_connections 2024-09-10T09:56:22.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.135+0000 7fd7f91a7640 1 -- 172.21.15.107:0/416871226 wait complete. 2024-09-10T09:56:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.136+0000 7fd7f91a7640 1 Processor -- start 2024-09-10T09:56:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.136+0000 7fd7f91a7640 1 -- start start 2024-09-10T09:56:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.136+0000 7fd7f91a7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f40fc1b0 0x7fd7f410c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.136+0000 7fd7f91a7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f410cc30 con 0x7fd7f40fc1b0 2024-09-10T09:56:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.136+0000 7fd7f2d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f40fc1b0 0x7fd7f410c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:22.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.136+0000 7fd7f2d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f40fc1b0 0x7fd7f410c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:46648/0 (socket says 172.21.15.107:46648) 2024-09-10T09:56:22.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.136+0000 7fd7f2d9d640 1 -- 172.21.15.107:0/1092467875 learned_addr learned my addr 172.21.15.107:0/1092467875 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:56:22.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.137+0000 7fd7f2d9d640 1 -- 172.21.15.107:0/1092467875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e4005040 con 0x7fd7f40fc1b0 2024-09-10T09:56:22.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.137+0000 7fd7f2d9d640 1 --2- 172.21.15.107:0/1092467875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f40fc1b0 0x7fd7f410c6f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd7e402a6d0 tx=0x7fd7e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:22.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.137+0000 7fd7db7fe640 1 -- 172.21.15.107:0/1092467875 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7e4033630 con 0x7fd7f40fc1b0 2024-09-10T09:56:22.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.137+0000 7fd7f91a7640 1 -- 172.21.15.107:0/1092467875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f410ce30 con 0x7fd7f40fc1b0 2024-09-10T09:56:22.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.137+0000 7fd7db7fe640 1 -- 172.21.15.107:0/1092467875 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd7e4033c30 con 0x7fd7f40fc1b0 2024-09-10T09:56:22.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.137+0000 7fd7db7fe640 1 -- 172.21.15.107:0/1092467875 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7e403dc00 con 0x7fd7f40fc1b0 2024-09-10T09:56:22.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.137+0000 7fd7f91a7640 1 -- 172.21.15.107:0/1092467875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f410d2a0 con 0x7fd7f40fc1b0 2024-09-10T09:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.138+0000 7fd7f91a7640 1 -- 172.21.15.107:0/1092467875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f405ed70 con 0x7fd7f40fc1b0 2024-09-10T09:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.138+0000 7fd7db7fe640 1 -- 172.21.15.107:0/1092467875 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7fd7e4030020 con 0x7fd7f40fc1b0 2024-09-10T09:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.138+0000 7fd7db7fe640 1 --2- 172.21.15.107:0/1092467875 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fd7dc039580 0x7fd7dc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.138+0000 7fd7db7fe640 1 -- 172.21.15.107:0/1092467875 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd7e406c980 con 0x7fd7f40fc1b0 2024-09-10T09:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.139+0000 7fd7f259c640 1 --2- 172.21.15.107:0/1092467875 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fd7dc039580 0x7fd7dc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.139+0000 7fd7f259c640 1 --2- 172.21.15.107:0/1092467875 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fd7dc039580 0x7fd7dc03ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8006fd0 tx=0x7fd7e8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:22.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.143+0000 7fd7db7fe640 1 -- 172.21.15.107:0/1092467875 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd7e4033790 con 0x7fd7f40fc1b0 2024-09-10T09:56:22.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.361+0000 7fd7f91a7640 1 -- 172.21.15.107:0/1092467875 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd7f404b720 con 0x7fd7f40fc1b0 2024-09-10T09:56:22.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.361+0000 7fd7db7fe640 1 -- 172.21.15.107:0/1092467875 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd7e4042210 con 0x7fd7f40fc1b0 2024-09-10T09:56:22.363 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:56:22.363 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:56:22.364 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:56:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.363+0000 7fd7f91a7640 1 -- 172.21.15.107:0/1092467875 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fd7dc039580 msgr2=0x7fd7dc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.363+0000 7fd7f91a7640 1 --2- 172.21.15.107:0/1092467875 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fd7dc039580 0x7fd7dc03ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8006fd0 tx=0x7fd7e8006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.363+0000 7fd7f91a7640 1 -- 172.21.15.107:0/1092467875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f40fc1b0 msgr2=0x7fd7f410c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.363+0000 7fd7f91a7640 1 --2- 172.21.15.107:0/1092467875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f40fc1b0 0x7fd7f410c6f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd7e402a6d0 tx=0x7fd7e4009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.363+0000 7fd7f91a7640 1 -- 172.21.15.107:0/1092467875 shutdown_connections 2024-09-10T09:56:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.363+0000 7fd7f91a7640 1 --2- 172.21.15.107:0/1092467875 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7fd7dc039580 0x7fd7dc03ba30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.363+0000 7fd7f91a7640 1 --2- 172.21.15.107:0/1092467875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f40fc1b0 0x7fd7f410c6f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.363+0000 7fd7f91a7640 1 -- 172.21.15.107:0/1092467875 >> 172.21.15.107:0/1092467875 conn(0x7fd7f40f7990 msgr2=0x7fd7f40f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.363+0000 7fd7f91a7640 1 -- 172.21.15.107:0/1092467875 shutdown_connections 2024-09-10T09:56:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:22.363+0000 7fd7f91a7640 1 -- 172.21.15.107:0/1092467875 wait complete. 2024-09-10T09:56:22.494 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:22 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/1092467875' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:56:23.581 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:23 smithi071 ceph-mon[27559]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:23.582 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:23 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:23.582 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:23 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:23.582 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:23 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:23.582 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:23 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:23.582 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:23 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:23.582 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:23 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:23.931 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:56:23.931 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:56:24.181 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:24.529 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:24 smithi071 ceph-mon[27559]: Deploying daemon prometheus.smithi071 on smithi071 2024-09-10T09:56:25.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.547+0000 7f02b962b640 1 -- 172.21.15.107:0/1799747592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02b40fc1d0 msgr2=0x7f02b40fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:25.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.547+0000 7f02b962b640 1 --2- 172.21.15.107:0/1799747592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02b40fc1d0 0x7f02b40fc5e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f02a4004850 tx=0x7f02a4009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:25.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.547+0000 7f02b962b640 1 -- 172.21.15.107:0/1799747592 shutdown_connections 2024-09-10T09:56:25.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.547+0000 7f02b962b640 1 --2- 172.21.15.107:0/1799747592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02b40fc1d0 0x7f02b40fc5e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:25.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.547+0000 7f02b962b640 1 -- 172.21.15.107:0/1799747592 >> 172.21.15.107:0/1799747592 conn(0x7f02b40f79b0 msgr2=0x7f02b40f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:25.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.548+0000 7f02b962b640 1 -- 172.21.15.107:0/1799747592 shutdown_connections 2024-09-10T09:56:25.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.548+0000 7f02b962b640 1 -- 172.21.15.107:0/1799747592 wait complete. 2024-09-10T09:56:25.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.548+0000 7f02b962b640 1 Processor -- start 2024-09-10T09:56:25.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.548+0000 7f02b962b640 1 -- start start 2024-09-10T09:56:25.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.548+0000 7f02b962b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02b40fc1d0 0x7f02b4071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:25.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.548+0000 7f02b962b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40719d0 con 0x7f02b40fc1d0 2024-09-10T09:56:25.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.548+0000 7f02b2ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02b40fc1d0 0x7f02b4071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:25.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.549+0000 7f02b2ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02b40fc1d0 0x7f02b4071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:53260/0 (socket says 172.21.15.107:53260) 2024-09-10T09:56:25.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.549+0000 7f02b2ffd640 1 -- 172.21.15.107:0/2513205587 learned_addr learned my addr 172.21.15.107:0/2513205587 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:56:25.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.549+0000 7f02b2ffd640 1 -- 172.21.15.107:0/2513205587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a4005040 con 0x7f02b40fc1d0 2024-09-10T09:56:25.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.549+0000 7f02b2ffd640 1 --2- 172.21.15.107:0/2513205587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02b40fc1d0 0x7f02b4071490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f02a402a6d0 tx=0x7f02a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:25.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.549+0000 7f02abfff640 1 -- 172.21.15.107:0/2513205587 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02a4033630 con 0x7f02b40fc1d0 2024-09-10T09:56:25.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.549+0000 7f02b962b640 1 -- 172.21.15.107:0/2513205587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b406fa60 con 0x7f02b40fc1d0 2024-09-10T09:56:25.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.549+0000 7f02abfff640 1 -- 172.21.15.107:0/2513205587 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f02a4033c30 con 0x7f02b40fc1d0 2024-09-10T09:56:25.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.549+0000 7f02abfff640 1 -- 172.21.15.107:0/2513205587 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02a403dc00 con 0x7f02b40fc1d0 2024-09-10T09:56:25.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.549+0000 7f02b962b640 1 -- 172.21.15.107:0/2513205587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b406fed0 con 0x7f02b40fc1d0 2024-09-10T09:56:25.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.550+0000 7f02abfff640 1 -- 172.21.15.107:0/2513205587 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f02a4030020 con 0x7f02b40fc1d0 2024-09-10T09:56:25.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.550+0000 7f02b962b640 1 -- 172.21.15.107:0/2513205587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b41025f0 con 0x7f02b40fc1d0 2024-09-10T09:56:25.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.550+0000 7f02abfff640 1 --2- 172.21.15.107:0/2513205587 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f02a0039580 0x7f02a003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:25.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.550+0000 7f02abfff640 1 -- 172.21.15.107:0/2513205587 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f02a406cb60 con 0x7f02b40fc1d0 2024-09-10T09:56:25.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.551+0000 7f02aa7fc640 1 --2- 172.21.15.107:0/2513205587 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f02a0039580 0x7f02a003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:25.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.551+0000 7f02aa7fc640 1 --2- 172.21.15.107:0/2513205587 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f02a0039580 0x7f02a003ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f029c006fd0 tx=0x7f029c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:25.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.555+0000 7f02abfff640 1 -- 172.21.15.107:0/2513205587 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f02a4045800 con 0x7f02b40fc1d0 2024-09-10T09:56:25.714 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:25 smithi071 ceph-mon[27559]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:25.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.771+0000 7f02b962b640 1 -- 172.21.15.107:0/2513205587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f02b405ed70 con 0x7f02b40fc1d0 2024-09-10T09:56:25.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.772+0000 7f02abfff640 1 -- 172.21.15.107:0/2513205587 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f02a4045800 con 0x7f02b40fc1d0 2024-09-10T09:56:25.773 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:56:25.773 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:56:25.774 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:56:25.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.774+0000 7f02b962b640 1 -- 172.21.15.107:0/2513205587 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f02a0039580 msgr2=0x7f02a003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:25.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.774+0000 7f02b962b640 1 --2- 172.21.15.107:0/2513205587 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f02a0039580 0x7f02a003ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f029c006fd0 tx=0x7f029c006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:25.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.774+0000 7f02b962b640 1 -- 172.21.15.107:0/2513205587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02b40fc1d0 msgr2=0x7f02b4071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:25.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.774+0000 7f02b962b640 1 --2- 172.21.15.107:0/2513205587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02b40fc1d0 0x7f02b4071490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f02a402a6d0 tx=0x7f02a4009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:25.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.774+0000 7f02b962b640 1 -- 172.21.15.107:0/2513205587 shutdown_connections 2024-09-10T09:56:25.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.774+0000 7f02b962b640 1 --2- 172.21.15.107:0/2513205587 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f02a0039580 0x7f02a003ba30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:25.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.774+0000 7f02b962b640 1 --2- 172.21.15.107:0/2513205587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02b40fc1d0 0x7f02b4071490 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:25.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.774+0000 7f02b962b640 1 -- 172.21.15.107:0/2513205587 >> 172.21.15.107:0/2513205587 conn(0x7f02b40f79b0 msgr2=0x7f02b40f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:25.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.774+0000 7f02b962b640 1 -- 172.21.15.107:0/2513205587 shutdown_connections 2024-09-10T09:56:25.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:25.774+0000 7f02b962b640 1 -- 172.21.15.107:0/2513205587 wait complete. 2024-09-10T09:56:26.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:26 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/2513205587' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:56:27.367 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:56:27.367 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:56:27.609 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:27.653 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:27.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:27 smithi071 ceph-mon[27559]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:27.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:27 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:29.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.004+0000 7f27794fb640 1 -- 172.21.15.107:0/3124697409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27740fa850 msgr2=0x7f27740fac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:29.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.004+0000 7f27794fb640 1 --2- 172.21.15.107:0/3124697409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27740fa850 0x7f27740fac60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2764004850 tx=0x7f2764009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:29.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.004+0000 7f27794fb640 1 -- 172.21.15.107:0/3124697409 shutdown_connections 2024-09-10T09:56:29.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.004+0000 7f27794fb640 1 --2- 172.21.15.107:0/3124697409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27740fa850 0x7f27740fac60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:29.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.004+0000 7f27794fb640 1 -- 172.21.15.107:0/3124697409 >> 172.21.15.107:0/3124697409 conn(0x7f27740f6010 msgr2=0x7f27740f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:29.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.004+0000 7f27794fb640 1 -- 172.21.15.107:0/3124697409 shutdown_connections 2024-09-10T09:56:29.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.004+0000 7f27794fb640 1 -- 172.21.15.107:0/3124697409 wait complete. 2024-09-10T09:56:29.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.004+0000 7f27794fb640 1 Processor -- start 2024-09-10T09:56:29.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.004+0000 7f27794fb640 1 -- start start 2024-09-10T09:56:29.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.005+0000 7f27794fb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27740fa850 0x7f27740f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:29.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.005+0000 7f27794fb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277410f4a0 con 0x7f27740fa850 2024-09-10T09:56:29.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.005+0000 7f2772ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27740fa850 0x7f27740f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:29.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.005+0000 7f2772ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27740fa850 0x7f27740f6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:53268/0 (socket says 172.21.15.107:53268) 2024-09-10T09:56:29.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.005+0000 7f2772ffd640 1 -- 172.21.15.107:0/397061370 learned_addr learned my addr 172.21.15.107:0/397061370 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:56:29.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.005+0000 7f2772ffd640 1 -- 172.21.15.107:0/397061370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2764005040 con 0x7f27740fa850 2024-09-10T09:56:29.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.005+0000 7f2772ffd640 1 --2- 172.21.15.107:0/397061370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27740fa850 0x7f27740f6f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f276402a6d0 tx=0x7f2764009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:29.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.006+0000 7f275b7fe640 1 -- 172.21.15.107:0/397061370 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2764033630 con 0x7f27740fa850 2024-09-10T09:56:29.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.006+0000 7f275b7fe640 1 -- 172.21.15.107:0/397061370 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2764033c30 con 0x7f27740fa850 2024-09-10T09:56:29.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.006+0000 7f27794fb640 1 -- 172.21.15.107:0/397061370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277410f5e0 con 0x7f27740fa850 2024-09-10T09:56:29.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.006+0000 7f275b7fe640 1 -- 172.21.15.107:0/397061370 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f276403dc30 con 0x7f27740fa850 2024-09-10T09:56:29.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.006+0000 7f27794fb640 1 -- 172.21.15.107:0/397061370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277410f9f0 con 0x7f27740fa850 2024-09-10T09:56:29.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.007+0000 7f275b7fe640 1 -- 172.21.15.107:0/397061370 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f2764030020 con 0x7f27740fa850 2024-09-10T09:56:29.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.007+0000 7f27794fb640 1 -- 172.21.15.107:0/397061370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277405ed70 con 0x7f27740fa850 2024-09-10T09:56:29.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.007+0000 7f275b7fe640 1 --2- 172.21.15.107:0/397061370 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f275c039580 0x7f275c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:29.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.007+0000 7f275b7fe640 1 -- 172.21.15.107:0/397061370 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f276406c950 con 0x7f27740fa850 2024-09-10T09:56:29.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.007+0000 7f27727fc640 1 --2- 172.21.15.107:0/397061370 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f275c039580 0x7f275c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:29.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.008+0000 7f27727fc640 1 --2- 172.21.15.107:0/397061370 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f275c039580 0x7f275c03ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2768006fd0 tx=0x7f2768006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:29.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.012+0000 7f275b7fe640 1 -- 172.21.15.107:0/397061370 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2764033da0 con 0x7f27740fa850 2024-09-10T09:56:29.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.228+0000 7f27794fb640 1 -- 172.21.15.107:0/397061370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2774104f00 con 0x7f27740fa850 2024-09-10T09:56:29.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.228+0000 7f275b7fe640 1 -- 172.21.15.107:0/397061370 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2764045800 con 0x7f27740fa850 2024-09-10T09:56:29.229 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:56:29.230 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:56:29.230 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:56:29.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.230+0000 7f27794fb640 1 -- 172.21.15.107:0/397061370 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f275c039580 msgr2=0x7f275c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:29.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.230+0000 7f27794fb640 1 --2- 172.21.15.107:0/397061370 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f275c039580 0x7f275c03ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2768006fd0 tx=0x7f2768006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:29.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.230+0000 7f27794fb640 1 -- 172.21.15.107:0/397061370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27740fa850 msgr2=0x7f27740f6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:29.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.230+0000 7f27794fb640 1 --2- 172.21.15.107:0/397061370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27740fa850 0x7f27740f6f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f276402a6d0 tx=0x7f2764009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:29.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.230+0000 7f27794fb640 1 -- 172.21.15.107:0/397061370 shutdown_connections 2024-09-10T09:56:29.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.230+0000 7f27794fb640 1 --2- 172.21.15.107:0/397061370 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f275c039580 0x7f275c03ba30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:29.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.230+0000 7f27794fb640 1 --2- 172.21.15.107:0/397061370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27740fa850 0x7f27740f6f70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:29.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.230+0000 7f27794fb640 1 -- 172.21.15.107:0/397061370 >> 172.21.15.107:0/397061370 conn(0x7f27740f6010 msgr2=0x7f27740fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:29.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.230+0000 7f27794fb640 1 -- 172.21.15.107:0/397061370 shutdown_connections 2024-09-10T09:56:29.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:29.230+0000 7f27794fb640 1 -- 172.21.15.107:0/397061370 wait complete. 2024-09-10T09:56:29.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:29 smithi071 ceph-mon[27559]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:29.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:29 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/397061370' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:56:30.802 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:56:30.803 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:56:31.041 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:31.085 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:31.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:31 smithi071 ceph-mon[27559]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:32.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.509+0000 7f30fbf4d640 1 -- 172.21.15.107:0/1585208889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30f4065590 msgr2=0x7f30f40ff0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:32.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.509+0000 7f30fbf4d640 1 --2- 172.21.15.107:0/1585208889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30f4065590 0x7f30f40ff0b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f30f0004850 tx=0x7f30f0009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:32.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.509+0000 7f30fbf4d640 1 -- 172.21.15.107:0/1585208889 shutdown_connections 2024-09-10T09:56:32.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.509+0000 7f30fbf4d640 1 --2- 172.21.15.107:0/1585208889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30f4065590 0x7f30f40ff0b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:32.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.509+0000 7f30fbf4d640 1 -- 172.21.15.107:0/1585208889 >> 172.21.15.107:0/1585208889 conn(0x7f30f40f6ac0 msgr2=0x7f30f40f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:32.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.509+0000 7f30fbf4d640 1 -- 172.21.15.107:0/1585208889 shutdown_connections 2024-09-10T09:56:32.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.509+0000 7f30fbf4d640 1 -- 172.21.15.107:0/1585208889 wait complete. 2024-09-10T09:56:32.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.510+0000 7f30fbf4d640 1 Processor -- start 2024-09-10T09:56:32.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.510+0000 7f30fbf4d640 1 -- start start 2024-09-10T09:56:32.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.510+0000 7f30fbf4d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30f4065590 0x7f30f410c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:32.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.510+0000 7f30fbf4d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f410cee0 con 0x7f30f4065590 2024-09-10T09:56:32.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.510+0000 7f30f9ce9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30f4065590 0x7f30f410c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:32.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.510+0000 7f30f9ce9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30f4065590 0x7f30f410c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:36408/0 (socket says 172.21.15.107:36408) 2024-09-10T09:56:32.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.510+0000 7f30f9ce9640 1 -- 172.21.15.107:0/2260139999 learned_addr learned my addr 172.21.15.107:0/2260139999 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:56:32.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.510+0000 7f30f9ce9640 1 -- 172.21.15.107:0/2260139999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0005040 con 0x7f30f4065590 2024-09-10T09:56:32.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.511+0000 7f30f9ce9640 1 --2- 172.21.15.107:0/2260139999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30f4065590 0x7f30f410c9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f30f002a6d0 tx=0x7f30f0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:32.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.511+0000 7f30ea7fc640 1 -- 172.21.15.107:0/2260139999 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f0033630 con 0x7f30f4065590 2024-09-10T09:56:32.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.511+0000 7f30fbf4d640 1 -- 172.21.15.107:0/2260139999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f410d0e0 con 0x7f30f4065590 2024-09-10T09:56:32.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.511+0000 7f30ea7fc640 1 -- 172.21.15.107:0/2260139999 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f30f0033c30 con 0x7f30f4065590 2024-09-10T09:56:32.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.511+0000 7f30ea7fc640 1 -- 172.21.15.107:0/2260139999 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f003dc30 con 0x7f30f4065590 2024-09-10T09:56:32.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.511+0000 7f30fbf4d640 1 -- 172.21.15.107:0/2260139999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f410d550 con 0x7f30f4065590 2024-09-10T09:56:32.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.512+0000 7f30ea7fc640 1 -- 172.21.15.107:0/2260139999 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f30f0030020 con 0x7f30f4065590 2024-09-10T09:56:32.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.512+0000 7f30fbf4d640 1 -- 172.21.15.107:0/2260139999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f405ed70 con 0x7f30f4065590 2024-09-10T09:56:32.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.512+0000 7f30ea7fc640 1 --2- 172.21.15.107:0/2260139999 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f30e0039580 0x7f30e003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:32.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.512+0000 7f30ea7fc640 1 -- 172.21.15.107:0/2260139999 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f30f006c8e0 con 0x7f30f4065590 2024-09-10T09:56:32.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.512+0000 7f30f94e8640 1 --2- 172.21.15.107:0/2260139999 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f30e0039580 0x7f30e003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:32.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.512+0000 7f30f94e8640 1 --2- 172.21.15.107:0/2260139999 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f30e0039580 0x7f30e003ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f30e4006fd0 tx=0x7f30e4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:32.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.517+0000 7f30ea7fc640 1 -- 172.21.15.107:0/2260139999 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f30f0045800 con 0x7f30f4065590 2024-09-10T09:56:32.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.729+0000 7f30fbf4d640 1 -- 172.21.15.107:0/2260139999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f30f404b720 con 0x7f30f4065590 2024-09-10T09:56:32.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.730+0000 7f30ea7fc640 1 -- 172.21.15.107:0/2260139999 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f30f0045800 con 0x7f30f4065590 2024-09-10T09:56:32.731 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:56:32.731 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:56:32.731 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:56:32.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.731+0000 7f30fbf4d640 1 -- 172.21.15.107:0/2260139999 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f30e0039580 msgr2=0x7f30e003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:32.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.731+0000 7f30fbf4d640 1 --2- 172.21.15.107:0/2260139999 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f30e0039580 0x7f30e003ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f30e4006fd0 tx=0x7f30e4006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:32.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.731+0000 7f30fbf4d640 1 -- 172.21.15.107:0/2260139999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30f4065590 msgr2=0x7f30f410c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:32.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.731+0000 7f30fbf4d640 1 --2- 172.21.15.107:0/2260139999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30f4065590 0x7f30f410c9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f30f002a6d0 tx=0x7f30f0009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:32.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.731+0000 7f30fbf4d640 1 -- 172.21.15.107:0/2260139999 shutdown_connections 2024-09-10T09:56:32.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.731+0000 7f30fbf4d640 1 --2- 172.21.15.107:0/2260139999 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f30e0039580 0x7f30e003ba30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:32.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.731+0000 7f30fbf4d640 1 --2- 172.21.15.107:0/2260139999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30f4065590 0x7f30f410c9a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:32.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.731+0000 7f30fbf4d640 1 -- 172.21.15.107:0/2260139999 >> 172.21.15.107:0/2260139999 conn(0x7f30f40f6ac0 msgr2=0x7f30f40f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:32.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.732+0000 7f30fbf4d640 1 -- 172.21.15.107:0/2260139999 shutdown_connections 2024-09-10T09:56:32.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:32.732+0000 7f30fbf4d640 1 -- 172.21.15.107:0/2260139999 wait complete. 2024-09-10T09:56:33.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:33 smithi071 ceph-mon[27559]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:33 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/2260139999' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:56:34.330 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:56:34.330 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:56:34.569 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:34.612 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:35.530 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:35 smithi071 ceph-mon[27559]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:36.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.105+0000 7f24663f0640 1 -- 172.21.15.107:0/3464200764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24600fb2e0 msgr2=0x7f24600fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:36.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.105+0000 7f24663f0640 1 --2- 172.21.15.107:0/3464200764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24600fb2e0 0x7f24600fb6f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2450004850 tx=0x7f2450009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:36.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.105+0000 7f24663f0640 1 -- 172.21.15.107:0/3464200764 shutdown_connections 2024-09-10T09:56:36.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.105+0000 7f24663f0640 1 --2- 172.21.15.107:0/3464200764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24600fb2e0 0x7f24600fb6f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:36.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.105+0000 7f24663f0640 1 -- 172.21.15.107:0/3464200764 >> 172.21.15.107:0/3464200764 conn(0x7f24600f6ac0 msgr2=0x7f24600f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:36.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.105+0000 7f24663f0640 1 -- 172.21.15.107:0/3464200764 shutdown_connections 2024-09-10T09:56:36.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.105+0000 7f24663f0640 1 -- 172.21.15.107:0/3464200764 wait complete. 2024-09-10T09:56:36.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.106+0000 7f24663f0640 1 Processor -- start 2024-09-10T09:56:36.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.106+0000 7f24663f0640 1 -- start start 2024-09-10T09:56:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.106+0000 7f24663f0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24600fb2e0 0x7f24600f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.106+0000 7f24663f0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24600f8f20 con 0x7f24600fb2e0 2024-09-10T09:56:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.106+0000 7f245ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24600fb2e0 0x7f24600f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.106+0000 7f245ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24600fb2e0 0x7f24600f89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:36428/0 (socket says 172.21.15.107:36428) 2024-09-10T09:56:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.106+0000 7f245ffff640 1 -- 172.21.15.107:0/3890964472 learned_addr learned my addr 172.21.15.107:0/3890964472 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:56:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.106+0000 7f245ffff640 1 -- 172.21.15.107:0/3890964472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2450005040 con 0x7f24600fb2e0 2024-09-10T09:56:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.106+0000 7f245ffff640 1 --2- 172.21.15.107:0/3890964472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24600fb2e0 0x7f24600f89e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f245002a6d0 tx=0x7f2450009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.107+0000 7f245d7fa640 1 -- 172.21.15.107:0/3890964472 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2450033630 con 0x7f24600fb2e0 2024-09-10T09:56:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.107+0000 7f24663f0640 1 -- 172.21.15.107:0/3890964472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24600f6fb0 con 0x7f24600fb2e0 2024-09-10T09:56:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.107+0000 7f245d7fa640 1 -- 172.21.15.107:0/3890964472 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2450033c30 con 0x7f24600fb2e0 2024-09-10T09:56:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.107+0000 7f245d7fa640 1 -- 172.21.15.107:0/3890964472 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f245003dc00 con 0x7f24600fb2e0 2024-09-10T09:56:36.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.107+0000 7f24663f0640 1 -- 172.21.15.107:0/3890964472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24600f7420 con 0x7f24600fb2e0 2024-09-10T09:56:36.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.108+0000 7f24663f0640 1 -- 172.21.15.107:0/3890964472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246005ed70 con 0x7f24600fb2e0 2024-09-10T09:56:36.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.108+0000 7f245d7fa640 1 -- 172.21.15.107:0/3890964472 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f2450030020 con 0x7f24600fb2e0 2024-09-10T09:56:36.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.108+0000 7f245d7fa640 1 --2- 172.21.15.107:0/3890964472 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f244c039580 0x7f244c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:36.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.108+0000 7f245d7fa640 1 -- 172.21.15.107:0/3890964472 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f245006caa0 con 0x7f24600fb2e0 2024-09-10T09:56:36.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.108+0000 7f2457fff640 1 --2- 172.21.15.107:0/3890964472 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f244c039580 0x7f244c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:36.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.109+0000 7f2457fff640 1 --2- 172.21.15.107:0/3890964472 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f244c039580 0x7f244c03ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2448006fd0 tx=0x7f2448006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:36.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.116+0000 7f245d7fa640 1 -- 172.21.15.107:0/3890964472 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2450045800 con 0x7f24600fb2e0 2024-09-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.329+0000 7f24663f0640 1 -- 172.21.15.107:0/3890964472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f246004b720 con 0x7f24600fb2e0 2024-09-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.330+0000 7f245d7fa640 1 -- 172.21.15.107:0/3890964472 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2450045800 con 0x7f24600fb2e0 2024-09-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.332+0000 7f24663f0640 1 -- 172.21.15.107:0/3890964472 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f244c039580 msgr2=0x7f244c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.332+0000 7f24663f0640 1 --2- 172.21.15.107:0/3890964472 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f244c039580 0x7f244c03ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2448006fd0 tx=0x7f2448006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.332+0000 7f24663f0640 1 -- 172.21.15.107:0/3890964472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24600fb2e0 msgr2=0x7f24600f89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.332+0000 7f24663f0640 1 --2- 172.21.15.107:0/3890964472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24600fb2e0 0x7f24600f89e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f245002a6d0 tx=0x7f2450009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.332+0000 7f24663f0640 1 -- 172.21.15.107:0/3890964472 shutdown_connections 2024-09-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.332+0000 7f24663f0640 1 --2- 172.21.15.107:0/3890964472 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f244c039580 0x7f244c03ba30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.332+0000 7f24663f0640 1 --2- 172.21.15.107:0/3890964472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24600fb2e0 0x7f24600f89e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.332+0000 7f24663f0640 1 -- 172.21.15.107:0/3890964472 >> 172.21.15.107:0/3890964472 conn(0x7f24600f6ac0 msgr2=0x7f2460064990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.332+0000 7f24663f0640 1 -- 172.21.15.107:0/3890964472 shutdown_connections 2024-09-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:36.332+0000 7f24663f0640 1 -- 172.21.15.107:0/3890964472 wait complete. 2024-09-10T09:56:36.689 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:36 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/3890964472' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:56:37.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:37 smithi071 ceph-mon[27559]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:37.941 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:56:37.941 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:56:38.178 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:39.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.541+0000 7f54abe94640 1 -- 172.21.15.107:0/1347566581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a40fc1d0 msgr2=0x7f54a40fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:39.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.541+0000 7f54abe94640 1 --2- 172.21.15.107:0/1347566581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a40fc1d0 0x7f54a40fc5e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f54a0004850 tx=0x7f54a0009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:39.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.541+0000 7f54abe94640 1 -- 172.21.15.107:0/1347566581 shutdown_connections 2024-09-10T09:56:39.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.541+0000 7f54abe94640 1 --2- 172.21.15.107:0/1347566581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a40fc1d0 0x7f54a40fc5e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:39.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.541+0000 7f54abe94640 1 -- 172.21.15.107:0/1347566581 >> 172.21.15.107:0/1347566581 conn(0x7f54a40f79b0 msgr2=0x7f54a40f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:39.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.541+0000 7f54abe94640 1 -- 172.21.15.107:0/1347566581 shutdown_connections 2024-09-10T09:56:39.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.541+0000 7f54abe94640 1 -- 172.21.15.107:0/1347566581 wait complete. 2024-09-10T09:56:39.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.541+0000 7f54abe94640 1 Processor -- start 2024-09-10T09:56:39.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.541+0000 7f54abe94640 1 -- start start 2024-09-10T09:56:39.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.541+0000 7f54abe94640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a40fc1d0 0x7f54a410c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:39.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.541+0000 7f54abe94640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a410cc10 con 0x7f54a40fc1d0 2024-09-10T09:56:39.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.542+0000 7f54a9c30640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a40fc1d0 0x7f54a410c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:39.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.542+0000 7f54a9c30640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a40fc1d0 0x7f54a410c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:36454/0 (socket says 172.21.15.107:36454) 2024-09-10T09:56:39.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.542+0000 7f54a9c30640 1 -- 172.21.15.107:0/128228653 learned_addr learned my addr 172.21.15.107:0/128228653 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.542+0000 7f54a9c30640 1 -- 172.21.15.107:0/128228653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0005040 con 0x7f54a40fc1d0 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.542+0000 7f54a9c30640 1 --2- 172.21.15.107:0/128228653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a40fc1d0 0x7f54a410c6d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f54a002a6d0 tx=0x7f54a0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.542+0000 7f549a7fc640 1 -- 172.21.15.107:0/128228653 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54a0033630 con 0x7f54a40fc1d0 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.542+0000 7f54abe94640 1 -- 172.21.15.107:0/128228653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a410ce10 con 0x7f54a40fc1d0 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.542+0000 7f549a7fc640 1 -- 172.21.15.107:0/128228653 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f54a0033c30 con 0x7f54a40fc1d0 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.542+0000 7f549a7fc640 1 -- 172.21.15.107:0/128228653 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54a003dc00 con 0x7f54a40fc1d0 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.542+0000 7f54abe94640 1 -- 172.21.15.107:0/128228653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a410d280 con 0x7f54a40fc1d0 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.543+0000 7f54abe94640 1 -- 172.21.15.107:0/128228653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a405ed70 con 0x7f54a40fc1d0 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.543+0000 7f549a7fc640 1 -- 172.21.15.107:0/128228653 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f54a0030020 con 0x7f54a40fc1d0 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.543+0000 7f549a7fc640 1 --2- 172.21.15.107:0/128228653 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f5490039580 0x7f549003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.543+0000 7f549a7fc640 1 -- 172.21.15.107:0/128228653 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f54a006c980 con 0x7f54a40fc1d0 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.544+0000 7f54a942f640 1 --2- 172.21.15.107:0/128228653 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f5490039580 0x7f549003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.544+0000 7f54a942f640 1 --2- 172.21.15.107:0/128228653 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f5490039580 0x7f549003ba30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5494006fd0 tx=0x7f5494006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:39.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.548+0000 7f549a7fc640 1 -- 172.21.15.107:0/128228653 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f54a0033790 con 0x7f54a40fc1d0 2024-09-10T09:56:39.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.761+0000 7f54abe94640 1 -- 172.21.15.107:0/128228653 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f54a404b720 con 0x7f54a40fc1d0 2024-09-10T09:56:39.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.762+0000 7f549a7fc640 1 -- 172.21.15.107:0/128228653 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f54a0042210 con 0x7f54a40fc1d0 2024-09-10T09:56:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:56:39.763 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:56:39.763 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:56:39.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.763+0000 7f54abe94640 1 -- 172.21.15.107:0/128228653 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f5490039580 msgr2=0x7f549003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:39.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.763+0000 7f54abe94640 1 --2- 172.21.15.107:0/128228653 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f5490039580 0x7f549003ba30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5494006fd0 tx=0x7f5494006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:39.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.763+0000 7f54abe94640 1 -- 172.21.15.107:0/128228653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a40fc1d0 msgr2=0x7f54a410c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:39.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.763+0000 7f54abe94640 1 --2- 172.21.15.107:0/128228653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a40fc1d0 0x7f54a410c6d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f54a002a6d0 tx=0x7f54a0009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:39.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.763+0000 7f54abe94640 1 -- 172.21.15.107:0/128228653 shutdown_connections 2024-09-10T09:56:39.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.763+0000 7f54abe94640 1 --2- 172.21.15.107:0/128228653 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f5490039580 0x7f549003ba30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:39.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.763+0000 7f54abe94640 1 --2- 172.21.15.107:0/128228653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54a40fc1d0 0x7f54a410c6d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:39.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.763+0000 7f54abe94640 1 -- 172.21.15.107:0/128228653 >> 172.21.15.107:0/128228653 conn(0x7f54a40f79b0 msgr2=0x7f54a40f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:39.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.763+0000 7f54abe94640 1 -- 172.21.15.107:0/128228653 shutdown_connections 2024-09-10T09:56:39.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:39.764+0000 7f54abe94640 1 -- 172.21.15.107:0/128228653 wait complete. 2024-09-10T09:56:39.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:39 smithi071 ceph-mon[27559]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:56:39.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:39 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:39 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:39 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:39 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-10T09:56:40.743 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:40 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/128228653' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:56:40.743 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:40 smithi071 ceph-mon[27559]: from='mgr.14160 172.21.15.71:0/3084956901' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-10T09:56:40.743 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:40 smithi071 ceph-mon[27559]: mgrmap e14: smithi071.gtqytr(active, since 57s) 2024-09-10T09:56:41.470 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:56:41.471 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:56:41.710 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:41.754 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:43.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.152+0000 7f1a250ed640 1 -- 172.21.15.107:0/1709588473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200fa860 msgr2=0x7f1a200fac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:43.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.152+0000 7f1a250ed640 1 --2- 172.21.15.107:0/1709588473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200fa860 0x7f1a200fac70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1a10004850 tx=0x7f1a10009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:43.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.152+0000 7f1a250ed640 1 -- 172.21.15.107:0/1709588473 shutdown_connections 2024-09-10T09:56:43.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.152+0000 7f1a250ed640 1 --2- 172.21.15.107:0/1709588473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200fa860 0x7f1a200fac70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:43.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.152+0000 7f1a250ed640 1 -- 172.21.15.107:0/1709588473 >> 172.21.15.107:0/1709588473 conn(0x7f1a200f6040 msgr2=0x7f1a200f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:43.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.152+0000 7f1a250ed640 1 -- 172.21.15.107:0/1709588473 shutdown_connections 2024-09-10T09:56:43.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.152+0000 7f1a250ed640 1 -- 172.21.15.107:0/1709588473 wait complete. 2024-09-10T09:56:43.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.153+0000 7f1a250ed640 1 Processor -- start 2024-09-10T09:56:43.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.153+0000 7f1a250ed640 1 -- start start 2024-09-10T09:56:43.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.153+0000 7f1a250ed640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200fa860 0x7f1a2010b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:43.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.153+0000 7f1a250ed640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2010bb70 con 0x7f1a200fa860 2024-09-10T09:56:43.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.153+0000 7f1a1ed9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200fa860 0x7f1a2010b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:43.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.153+0000 7f1a1ed9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200fa860 0x7f1a2010b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:49996/0 (socket says 172.21.15.107:49996) 2024-09-10T09:56:43.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.153+0000 7f1a1ed9d640 1 -- 172.21.15.107:0/2312826400 learned_addr learned my addr 172.21.15.107:0/2312826400 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:56:43.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.153+0000 7f1a1ed9d640 1 -- 172.21.15.107:0/2312826400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a10005040 con 0x7f1a200fa860 2024-09-10T09:56:43.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.153+0000 7f1a1ed9d640 1 --2- 172.21.15.107:0/2312826400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200fa860 0x7f1a2010b630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1a1002a6d0 tx=0x7f1a10009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:43.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.154+0000 7f1a177fe640 1 -- 172.21.15.107:0/2312826400 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a10033630 con 0x7f1a200fa860 2024-09-10T09:56:43.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.154+0000 7f1a177fe640 1 -- 172.21.15.107:0/2312826400 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1a10033c30 con 0x7f1a200fa860 2024-09-10T09:56:43.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.154+0000 7f1a250ed640 1 -- 172.21.15.107:0/2312826400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2010bd70 con 0x7f1a200fa860 2024-09-10T09:56:43.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.154+0000 7f1a177fe640 1 -- 172.21.15.107:0/2312826400 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a1003dc00 con 0x7f1a200fa860 2024-09-10T09:56:43.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.154+0000 7f1a250ed640 1 -- 172.21.15.107:0/2312826400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2010c1e0 con 0x7f1a200fa860 2024-09-10T09:56:43.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.154+0000 7f1a177fe640 1 -- 172.21.15.107:0/2312826400 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 14) v1 ==== 45577+0+0 (secure 0 0 0) 0x7f1a10030020 con 0x7f1a200fa860 2024-09-10T09:56:43.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.155+0000 7f1a177fe640 1 --2- 172.21.15.107:0/2312826400 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f1a0c0395d0 0x7f1a0c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:43.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.155+0000 7f1a250ed640 1 -- 172.21.15.107:0/2312826400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2005ed70 con 0x7f1a200fa860 2024-09-10T09:56:43.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.155+0000 7f1a17fff640 1 -- 172.21.15.107:0/2312826400 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f1a0c0395d0 msgr2=0x7f1a0c03ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/404028021 2024-09-10T09:56:43.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.155+0000 7f1a177fe640 1 -- 172.21.15.107:0/2312826400 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1a1006ca20 con 0x7f1a200fa860 2024-09-10T09:56:43.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.155+0000 7f1a17fff640 1 --2- 172.21.15.107:0/2312826400 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f1a0c0395d0 0x7f1a0c03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:56:43.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.160+0000 7f1a177fe640 1 -- 172.21.15.107:0/2312826400 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1a1003bb50 con 0x7f1a200fa860 2024-09-10T09:56:43.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.356+0000 7f1a17fff640 1 -- 172.21.15.107:0/2312826400 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f1a0c0395d0 msgr2=0x7f1a0c03ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:6800/404028021 2024-09-10T09:56:43.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.356+0000 7f1a17fff640 1 --2- 172.21.15.107:0/2312826400 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f1a0c0395d0 0x7f1a0c03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T09:56:43.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.378+0000 7f1a250ed640 1 -- 172.21.15.107:0/2312826400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1a201004b0 con 0x7f1a200fa860 2024-09-10T09:56:43.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.379+0000 7f1a177fe640 1 -- 172.21.15.107:0/2312826400 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1a1003f0c0 con 0x7f1a200fa860 2024-09-10T09:56:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:56:43.380 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:56:43.380 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:56:43.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.381+0000 7f1a250ed640 1 -- 172.21.15.107:0/2312826400 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f1a0c0395d0 msgr2=0x7f1a0c03ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:56:43.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.381+0000 7f1a250ed640 1 --2- 172.21.15.107:0/2312826400 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f1a0c0395d0 0x7f1a0c03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:43.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.381+0000 7f1a250ed640 1 -- 172.21.15.107:0/2312826400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200fa860 msgr2=0x7f1a2010b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:43.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.381+0000 7f1a250ed640 1 --2- 172.21.15.107:0/2312826400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200fa860 0x7f1a2010b630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1a1002a6d0 tx=0x7f1a10009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:43.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.381+0000 7f1a250ed640 1 -- 172.21.15.107:0/2312826400 shutdown_connections 2024-09-10T09:56:43.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.381+0000 7f1a250ed640 1 --2- 172.21.15.107:0/2312826400 >> [v2:172.21.15.71:6800/404028021,v1:172.21.15.71:6801/404028021] conn(0x7f1a0c0395d0 0x7f1a0c03ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:43.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.381+0000 7f1a250ed640 1 --2- 172.21.15.107:0/2312826400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200fa860 0x7f1a2010b630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:43.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.381+0000 7f1a250ed640 1 -- 172.21.15.107:0/2312826400 >> 172.21.15.107:0/2312826400 conn(0x7f1a200f6040 msgr2=0x7f1a200fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:43.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.381+0000 7f1a250ed640 1 -- 172.21.15.107:0/2312826400 shutdown_connections 2024-09-10T09:56:43.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:43.381+0000 7f1a250ed640 1 -- 172.21.15.107:0/2312826400 wait complete. 2024-09-10T09:56:43.493 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:43 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/2312826400' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:56:44.610 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: Active manager daemon smithi071.gtqytr restarted 2024-09-10T09:56:44.610 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: Activating manager daemon smithi071.gtqytr 2024-09-10T09:56:44.611 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T09:56:44.611 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: mgrmap e15: smithi071.gtqytr(active, starting, since 0.00530498s) 2024-09-10T09:56:44.611 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T09:56:44.611 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr metadata", "who": "smithi071.gtqytr", "id": "smithi071.gtqytr"}]: dispatch 2024-09-10T09:56:44.611 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:56:44.611 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:56:44.611 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:56:44.611 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: Manager daemon smithi071.gtqytr is now available 2024-09-10T09:56:44.611 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:56:44.611 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:44.611 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:56:44.611 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:56:44.611 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/trash_purge_schedule"}]: dispatch 2024-09-10T09:56:44.946 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:56:44.946 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:56:45.189 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:45.249 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:46.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:46.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:46.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:45 smithi071 ceph-mon[27559]: mgrmap e16: smithi071.gtqytr(active, since 1.00522s) 2024-09-10T09:56:46.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:46.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:47.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.277+0000 7f6c76c35640 1 -- 172.21.15.107:0/2607685735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c700fc1d0 msgr2=0x7f6c700fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:47.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.277+0000 7f6c76c35640 1 --2- 172.21.15.107:0/2607685735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c700fc1d0 0x7f6c700fc5e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6c64004850 tx=0x7f6c64009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:47.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.277+0000 7f6c76c35640 1 -- 172.21.15.107:0/2607685735 shutdown_connections 2024-09-10T09:56:47.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.277+0000 7f6c76c35640 1 --2- 172.21.15.107:0/2607685735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c700fc1d0 0x7f6c700fc5e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:47.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.277+0000 7f6c76c35640 1 -- 172.21.15.107:0/2607685735 >> 172.21.15.107:0/2607685735 conn(0x7f6c700f79b0 msgr2=0x7f6c700f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:47.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.277+0000 7f6c76c35640 1 -- 172.21.15.107:0/2607685735 shutdown_connections 2024-09-10T09:56:47.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.277+0000 7f6c76c35640 1 -- 172.21.15.107:0/2607685735 wait complete. 2024-09-10T09:56:47.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.277+0000 7f6c76c35640 1 Processor -- start 2024-09-10T09:56:47.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.278+0000 7f6c76c35640 1 -- start start 2024-09-10T09:56:47.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.278+0000 7f6c76c35640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c700fc1d0 0x7f6c7010c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:47.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.278+0000 7f6c76c35640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7010cc10 con 0x7f6c700fc1d0 2024-09-10T09:56:47.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.278+0000 7f6c749d1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c700fc1d0 0x7f6c7010c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:47.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.278+0000 7f6c749d1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c700fc1d0 0x7f6c7010c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:50008/0 (socket says 172.21.15.107:50008) 2024-09-10T09:56:47.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.278+0000 7f6c749d1640 1 -- 172.21.15.107:0/3626734347 learned_addr learned my addr 172.21.15.107:0/3626734347 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:56:47.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.279+0000 7f6c749d1640 1 -- 172.21.15.107:0/3626734347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c64005040 con 0x7f6c700fc1d0 2024-09-10T09:56:47.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.279+0000 7f6c749d1640 1 --2- 172.21.15.107:0/3626734347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c700fc1d0 0x7f6c7010c6d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6c6402a6d0 tx=0x7f6c64009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:47.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.279+0000 7f6c6d7fa640 1 -- 172.21.15.107:0/3626734347 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c64033630 con 0x7f6c700fc1d0 2024-09-10T09:56:47.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.279+0000 7f6c6d7fa640 1 -- 172.21.15.107:0/3626734347 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c64033c30 con 0x7f6c700fc1d0 2024-09-10T09:56:47.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.279+0000 7f6c76c35640 1 -- 172.21.15.107:0/3626734347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7010ce10 con 0x7f6c700fc1d0 2024-09-10T09:56:47.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.279+0000 7f6c6d7fa640 1 -- 172.21.15.107:0/3626734347 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c6403dc00 con 0x7f6c700fc1d0 2024-09-10T09:56:47.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.279+0000 7f6c76c35640 1 -- 172.21.15.107:0/3626734347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7010d280 con 0x7f6c700fc1d0 2024-09-10T09:56:47.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.280+0000 7f6c6d7fa640 1 -- 172.21.15.107:0/3626734347 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f6c64030020 con 0x7f6c700fc1d0 2024-09-10T09:56:47.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.280+0000 7f6c76c35640 1 -- 172.21.15.107:0/3626734347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7005ed70 con 0x7f6c700fc1d0 2024-09-10T09:56:47.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.280+0000 7f6c6d7fa640 1 --2- 172.21.15.107:0/3626734347 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f6c60039670 0x7f6c6003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:47.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.280+0000 7f6c6d7fa640 1 -- 172.21.15.107:0/3626734347 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6c6406cb80 con 0x7f6c700fc1d0 2024-09-10T09:56:47.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.280+0000 7f6c6ffff640 1 --2- 172.21.15.107:0/3626734347 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f6c60039670 0x7f6c6003bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:47.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.281+0000 7f6c6ffff640 1 --2- 172.21.15.107:0/3626734347 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f6c60039670 0x7f6c6003bb20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c006fd0 tx=0x7f6c5c006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:47.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.285+0000 7f6c6d7fa640 1 -- 172.21.15.107:0/3626734347 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6c6403bb50 con 0x7f6c700fc1d0 2024-09-10T09:56:47.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:46 smithi071 ceph-mon[27559]: [10/Sep/2024:09:56:45] ENGINE Bus STARTING 2024-09-10T09:56:47.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:46 smithi071 ceph-mon[27559]: [10/Sep/2024:09:56:45] ENGINE Serving on https://172.21.15.71:7150 2024-09-10T09:56:47.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:46 smithi071 ceph-mon[27559]: [10/Sep/2024:09:56:45] ENGINE Bus STARTED 2024-09-10T09:56:47.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:46 smithi071 ceph-mon[27559]: [10/Sep/2024:09:56:45] ENGINE Error in HTTPServer.serve 2024-09-10T09:56:47.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Traceback (most recent call last): 2024-09-10T09:56:47.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._run(expiration_interval) 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: s = self.context.wrap_socket( 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: return self.sslsocket_class._create( 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self.do_handshake() 2024-09-10T09:56:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T09:56:47.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._sslobj.do_handshake() 2024-09-10T09:56:47.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.503+0000 7f6c76c35640 1 -- 172.21.15.107:0/3626734347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6c7004b720 con 0x7f6c700fc1d0 2024-09-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.504+0000 7f6c6d7fa640 1 -- 172.21.15.107:0/3626734347 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6c6406ce60 con 0x7f6c700fc1d0 2024-09-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.506+0000 7f6c76c35640 1 -- 172.21.15.107:0/3626734347 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f6c60039670 msgr2=0x7f6c6003bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.506+0000 7f6c76c35640 1 --2- 172.21.15.107:0/3626734347 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f6c60039670 0x7f6c6003bb20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c006fd0 tx=0x7f6c5c006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.506+0000 7f6c76c35640 1 -- 172.21.15.107:0/3626734347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c700fc1d0 msgr2=0x7f6c7010c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.506+0000 7f6c76c35640 1 --2- 172.21.15.107:0/3626734347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c700fc1d0 0x7f6c7010c6d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6c6402a6d0 tx=0x7f6c64009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.506+0000 7f6c76c35640 1 -- 172.21.15.107:0/3626734347 shutdown_connections 2024-09-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.506+0000 7f6c76c35640 1 --2- 172.21.15.107:0/3626734347 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f6c60039670 0x7f6c6003bb20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.506+0000 7f6c76c35640 1 --2- 172.21.15.107:0/3626734347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c700fc1d0 0x7f6c7010c6d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.506+0000 7f6c76c35640 1 -- 172.21.15.107:0/3626734347 >> 172.21.15.107:0/3626734347 conn(0x7f6c700f79b0 msgr2=0x7f6c700f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.506+0000 7f6c76c35640 1 -- 172.21.15.107:0/3626734347 shutdown_connections 2024-09-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:47.506+0000 7f6c76c35640 1 -- 172.21.15.107:0/3626734347 wait complete. 2024-09-10T09:56:48.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:47 smithi071 ceph-mon[27559]: mgrmap e17: smithi071.gtqytr(active, since 2s) 2024-09-10T09:56:48.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:47 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/3626734347' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:56:49.197 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:56:49.198 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:56:49.613 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:49.658 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:56:49.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:49 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:49.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:49 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:49.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:49 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:49.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:49 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:49.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:49 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:56:51.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi107", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:51.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:51.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:56:51.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-10T09:56:51.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:56:51.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.297+0000 7f874edad640 1 -- 172.21.15.107:0/2883040322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8748102200 msgr2=0x7f87481025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:51.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.297+0000 7f874edad640 1 --2- 172.21.15.107:0/2883040322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8748102200 0x7f87481025d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f873c004850 tx=0x7f873c009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:51.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.297+0000 7f874edad640 1 -- 172.21.15.107:0/2883040322 shutdown_connections 2024-09-10T09:56:51.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.297+0000 7f874edad640 1 --2- 172.21.15.107:0/2883040322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8748102200 0x7f87481025d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:51.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.297+0000 7f874edad640 1 -- 172.21.15.107:0/2883040322 >> 172.21.15.107:0/2883040322 conn(0x7f87480f7dd0 msgr2=0x7f87480fa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:51.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.297+0000 7f874edad640 1 -- 172.21.15.107:0/2883040322 shutdown_connections 2024-09-10T09:56:51.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.297+0000 7f874edad640 1 -- 172.21.15.107:0/2883040322 wait complete. 2024-09-10T09:56:51.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.297+0000 7f874edad640 1 Processor -- start 2024-09-10T09:56:51.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.297+0000 7f874edad640 1 -- start start 2024-09-10T09:56:51.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.298+0000 7f874edad640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8748102200 0x7f8748112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:51.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.298+0000 7f874edad640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8748112cc0 con 0x7f8748102200 2024-09-10T09:56:51.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.298+0000 7f874cb49640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8748102200 0x7f8748112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:51.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.298+0000 7f874cb49640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8748102200 0x7f8748112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:50018/0 (socket says 172.21.15.107:50018) 2024-09-10T09:56:51.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.298+0000 7f874cb49640 1 -- 172.21.15.107:0/1825423638 learned_addr learned my addr 172.21.15.107:0/1825423638 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:56:51.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.299+0000 7f874cb49640 1 -- 172.21.15.107:0/1825423638 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c005040 con 0x7f8748102200 2024-09-10T09:56:51.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.299+0000 7f874cb49640 1 --2- 172.21.15.107:0/1825423638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8748102200 0x7f8748112780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f873c02a6d0 tx=0x7f873c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:51.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.299+0000 7f87457fa640 1 -- 172.21.15.107:0/1825423638 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f873c02cf10 con 0x7f8748102200 2024-09-10T09:56:51.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.299+0000 7f874edad640 1 -- 172.21.15.107:0/1825423638 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8748112ec0 con 0x7f8748102200 2024-09-10T09:56:51.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.299+0000 7f87457fa640 1 -- 172.21.15.107:0/1825423638 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f873c033ad0 con 0x7f8748102200 2024-09-10T09:56:51.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.299+0000 7f87457fa640 1 -- 172.21.15.107:0/1825423638 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f873c03ebb0 con 0x7f8748102200 2024-09-10T09:56:51.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.299+0000 7f874edad640 1 -- 172.21.15.107:0/1825423638 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8748113390 con 0x7f8748102200 2024-09-10T09:56:51.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.300+0000 7f87457fa640 1 -- 172.21.15.107:0/1825423638 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f873c030020 con 0x7f8748102200 2024-09-10T09:56:51.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.300+0000 7f874edad640 1 -- 172.21.15.107:0/1825423638 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87480fd970 con 0x7f8748102200 2024-09-10T09:56:51.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.300+0000 7f87457fa640 1 --2- 172.21.15.107:0/1825423638 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8738039670 0x7f873803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:51.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.300+0000 7f87457fa640 1 -- 172.21.15.107:0/1825423638 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f873c06c610 con 0x7f8748102200 2024-09-10T09:56:51.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.301+0000 7f8747fff640 1 --2- 172.21.15.107:0/1825423638 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8738039670 0x7f873803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:51.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.301+0000 7f8747fff640 1 --2- 172.21.15.107:0/1825423638 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8738039670 0x7f873803bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8734006fd0 tx=0x7f8734006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:51.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.305+0000 7f87457fa640 1 -- 172.21.15.107:0/1825423638 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f873c043210 con 0x7f8748102200 2024-09-10T09:56:51.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.531+0000 7f874edad640 1 -- 172.21.15.107:0/1825423638 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8748113390 con 0x7f8748102200 2024-09-10T09:56:51.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.532+0000 7f87457fa640 1 -- 172.21.15.107:0/1825423638 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8748113390 con 0x7f8748102200 2024-09-10T09:56:51.533 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:56:51.533 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:56:51.534 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:56:51.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.534+0000 7f874edad640 1 -- 172.21.15.107:0/1825423638 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8738039670 msgr2=0x7f873803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:51.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.534+0000 7f874edad640 1 --2- 172.21.15.107:0/1825423638 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8738039670 0x7f873803bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8734006fd0 tx=0x7f8734006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:51.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.534+0000 7f874edad640 1 -- 172.21.15.107:0/1825423638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8748102200 msgr2=0x7f8748112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:51.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.534+0000 7f874edad640 1 --2- 172.21.15.107:0/1825423638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8748102200 0x7f8748112780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f873c02a6d0 tx=0x7f873c009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:51.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.534+0000 7f874edad640 1 -- 172.21.15.107:0/1825423638 shutdown_connections 2024-09-10T09:56:51.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.534+0000 7f874edad640 1 --2- 172.21.15.107:0/1825423638 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8738039670 0x7f873803bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:51.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.534+0000 7f874edad640 1 --2- 172.21.15.107:0/1825423638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8748102200 0x7f8748112780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:51.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.534+0000 7f874edad640 1 -- 172.21.15.107:0/1825423638 >> 172.21.15.107:0/1825423638 conn(0x7f87480f7dd0 msgr2=0x7f87480f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:51.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.534+0000 7f874edad640 1 -- 172.21.15.107:0/1825423638 shutdown_connections 2024-09-10T09:56:51.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:51.534+0000 7f874edad640 1 -- 172.21.15.107:0/1825423638 wait complete. 2024-09-10T09:56:52.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:51 smithi071 ceph-mon[27559]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:56:52.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:51 smithi071 ceph-mon[27559]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:56:52.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:51 smithi071 ceph-mon[27559]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:56:52.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:51 smithi071 ceph-mon[27559]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:56:52.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:51 smithi071 ceph-mon[27559]: Deploying daemon crash.smithi107 on smithi107 2024-09-10T09:56:52.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:51 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/1825423638' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:56:53.554 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:56:53.554 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:56:53.873 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:56:55.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.794+0000 7ffa02744640 1 -- 172.21.15.107:0/706190384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9fc102200 msgr2=0x7ff9fc1025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:55.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.794+0000 7ffa02744640 1 --2- 172.21.15.107:0/706190384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9fc102200 0x7ff9fc1025d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec004850 tx=0x7ff9ec009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:55.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.794+0000 7ffa02744640 1 -- 172.21.15.107:0/706190384 shutdown_connections 2024-09-10T09:56:55.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.794+0000 7ffa02744640 1 --2- 172.21.15.107:0/706190384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9fc102200 0x7ff9fc1025d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.794+0000 7ffa02744640 1 -- 172.21.15.107:0/706190384 >> 172.21.15.107:0/706190384 conn(0x7ff9fc0f7dd0 msgr2=0x7ff9fc0fa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.794+0000 7ffa02744640 1 -- 172.21.15.107:0/706190384 shutdown_connections 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.794+0000 7ffa02744640 1 -- 172.21.15.107:0/706190384 wait complete. 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.794+0000 7ffa02744640 1 Processor -- start 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.794+0000 7ffa02744640 1 -- start start 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.795+0000 7ffa02744640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9fc102200 0x7ff9fc06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.795+0000 7ffa02744640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc06ff50 con 0x7ff9fc102200 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.795+0000 7ff9fbfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9fc102200 0x7ff9fc06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.795+0000 7ff9fbfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9fc102200 0x7ff9fc06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:55092/0 (socket says 172.21.15.107:55092) 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.795+0000 7ff9fbfff640 1 -- 172.21.15.107:0/2853971800 learned_addr learned my addr 172.21.15.107:0/2853971800 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.795+0000 7ff9fbfff640 1 -- 172.21.15.107:0/2853971800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec005040 con 0x7ff9fc102200 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.795+0000 7ff9fbfff640 1 --2- 172.21.15.107:0/2853971800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9fc102200 0x7ff9fc06fa10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec02a6d0 tx=0x7ff9ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.796+0000 7ff9f8ff9640 1 -- 172.21.15.107:0/2853971800 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9ec02cf10 con 0x7ff9fc102200 2024-09-10T09:56:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.796+0000 7ffa02744640 1 -- 172.21.15.107:0/2853971800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9fc070150 con 0x7ff9fc102200 2024-09-10T09:56:55.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.796+0000 7ff9f8ff9640 1 -- 172.21.15.107:0/2853971800 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff9ec033ad0 con 0x7ff9fc102200 2024-09-10T09:56:55.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.796+0000 7ffa02744640 1 -- 172.21.15.107:0/2853971800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9fc070620 con 0x7ff9fc102200 2024-09-10T09:56:55.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.796+0000 7ff9f8ff9640 1 -- 172.21.15.107:0/2853971800 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9ec03eb50 con 0x7ff9fc102200 2024-09-10T09:56:55.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.797+0000 7ffa02744640 1 -- 172.21.15.107:0/2853971800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9fc070860 con 0x7ff9fc102200 2024-09-10T09:56:55.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.797+0000 7ff9f8ff9640 1 -- 172.21.15.107:0/2853971800 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7ff9ec030020 con 0x7ff9fc102200 2024-09-10T09:56:55.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.797+0000 7ff9f8ff9640 1 --2- 172.21.15.107:0/2853971800 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff9e4039670 0x7ff9e403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:56:55.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.797+0000 7ff9f8ff9640 1 -- 172.21.15.107:0/2853971800 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ff9ec06c6d0 con 0x7ff9fc102200 2024-09-10T09:56:55.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.797+0000 7ff9fb7fe640 1 --2- 172.21.15.107:0/2853971800 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff9e4039670 0x7ff9e403bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:56:55.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.798+0000 7ff9fb7fe640 1 --2- 172.21.15.107:0/2853971800 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff9e4039670 0x7ff9e403bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0006fd0 tx=0x7ff9f0006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:56:55.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:55.802+0000 7ff9f8ff9640 1 -- 172.21.15.107:0/2853971800 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff9ec03e430 con 0x7ff9fc102200 2024-09-10T09:56:56.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:56.041+0000 7ffa02744640 1 -- 172.21.15.107:0/2853971800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff9fc0fd970 con 0x7ff9fc102200 2024-09-10T09:56:56.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:56.041+0000 7ff9f8ff9640 1 -- 172.21.15.107:0/2853971800 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff9ec043210 con 0x7ff9fc102200 2024-09-10T09:56:56.044 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:56:56.044 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:56:56.046 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:56:56.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:56.043+0000 7ffa02744640 1 -- 172.21.15.107:0/2853971800 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff9e4039670 msgr2=0x7ff9e403bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:56.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:56.044+0000 7ffa02744640 1 --2- 172.21.15.107:0/2853971800 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff9e4039670 0x7ff9e403bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0006fd0 tx=0x7ff9f0006db0 comp rx=0 tx=0).stop 2024-09-10T09:56:56.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:56.044+0000 7ffa02744640 1 -- 172.21.15.107:0/2853971800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9fc102200 msgr2=0x7ff9fc06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:56:56.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:56.044+0000 7ffa02744640 1 --2- 172.21.15.107:0/2853971800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9fc102200 0x7ff9fc06fa10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec02a6d0 tx=0x7ff9ec009da0 comp rx=0 tx=0).stop 2024-09-10T09:56:56.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:56.044+0000 7ffa02744640 1 -- 172.21.15.107:0/2853971800 shutdown_connections 2024-09-10T09:56:56.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:56.044+0000 7ffa02744640 1 --2- 172.21.15.107:0/2853971800 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff9e4039670 0x7ff9e403bb20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:56.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:56.044+0000 7ffa02744640 1 --2- 172.21.15.107:0/2853971800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9fc102200 0x7ff9fc06fa10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:56:56.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:56.044+0000 7ffa02744640 1 -- 172.21.15.107:0/2853971800 >> 172.21.15.107:0/2853971800 conn(0x7ff9fc0f7dd0 msgr2=0x7ff9fc0f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:56:56.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:56.044+0000 7ffa02744640 1 -- 172.21.15.107:0/2853971800 shutdown_connections 2024-09-10T09:56:56.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:56:56.044+0000 7ffa02744640 1 -- 172.21.15.107:0/2853971800 wait complete. 2024-09-10T09:56:56.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:56 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:56.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:56 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:56.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:56 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:56.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:56 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:56:56.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:56 smithi071 ceph-mon[27559]: Deploying daemon node-exporter.smithi107 on smithi107 2024-09-10T09:56:56.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:56:56 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/2853971800' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:56:57.687 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:56:57.687 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:56:58.616 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:57:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:00 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:00 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:57:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:00 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:00 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:00 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:00 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:00 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.qurtcs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:57:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:00 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.qurtcs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T09:57:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:00 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:57:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:00 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:00 smithi071 ceph-mon[27559]: Deploying daemon mgr.smithi107.qurtcs on smithi107 2024-09-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.803+0000 7fe483351640 1 -- 172.21.15.107:0/1316316301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe47c1010e0 msgr2=0x7fe47c1014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.803+0000 7fe483351640 1 --2- 172.21.15.107:0/1316316301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe47c1010e0 0x7fe47c1014b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe46c004850 tx=0x7fe46c009da0 comp rx=0 tx=0).stop 2024-09-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.803+0000 7fe483351640 1 -- 172.21.15.107:0/1316316301 shutdown_connections 2024-09-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.803+0000 7fe483351640 1 --2- 172.21.15.107:0/1316316301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe47c1010e0 0x7fe47c1014b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.803+0000 7fe483351640 1 -- 172.21.15.107:0/1316316301 >> 172.21.15.107:0/1316316301 conn(0x7fe47c0710b0 msgr2=0x7fe47c0714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.803+0000 7fe483351640 1 -- 172.21.15.107:0/1316316301 shutdown_connections 2024-09-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.803+0000 7fe483351640 1 -- 172.21.15.107:0/1316316301 wait complete. 2024-09-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.803+0000 7fe483351640 1 Processor -- start 2024-09-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.803+0000 7fe483351640 1 -- start start 2024-09-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.804+0000 7fe483351640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe47c1010e0 0x7fe47c111700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.804+0000 7fe483351640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c111c40 con 0x7fe47c1010e0 2024-09-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.804+0000 7fe4810ed640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe47c1010e0 0x7fe47c111700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.804+0000 7fe4810ed640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe47c1010e0 0x7fe47c111700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:55120/0 (socket says 172.21.15.107:55120) 2024-09-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.804+0000 7fe4810ed640 1 -- 172.21.15.107:0/2564197283 learned_addr learned my addr 172.21.15.107:0/2564197283 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.804+0000 7fe4810ed640 1 -- 172.21.15.107:0/2564197283 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c005040 con 0x7fe47c1010e0 2024-09-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.804+0000 7fe4810ed640 1 --2- 172.21.15.107:0/2564197283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe47c1010e0 0x7fe47c111700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe46c004820 tx=0x7fe46c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.805+0000 7fe471ffb640 1 -- 172.21.15.107:0/2564197283 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe46c033630 con 0x7fe47c1010e0 2024-09-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.805+0000 7fe483351640 1 -- 172.21.15.107:0/2564197283 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c111e40 con 0x7fe47c1010e0 2024-09-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.805+0000 7fe483351640 1 -- 172.21.15.107:0/2564197283 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c112230 con 0x7fe47c1010e0 2024-09-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.805+0000 7fe471ffb640 1 -- 172.21.15.107:0/2564197283 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe46c033c30 con 0x7fe47c1010e0 2024-09-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.805+0000 7fe471ffb640 1 -- 172.21.15.107:0/2564197283 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe46c03dbe0 con 0x7fe47c1010e0 2024-09-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.806+0000 7fe471ffb640 1 -- 172.21.15.107:0/2564197283 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7fe46c030020 con 0x7fe47c1010e0 2024-09-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.806+0000 7fe483351640 1 -- 172.21.15.107:0/2564197283 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe460005210 con 0x7fe47c1010e0 2024-09-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.806+0000 7fe471ffb640 1 --2- 172.21.15.107:0/2564197283 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe468039670 0x7fe46803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.806+0000 7fe471ffb640 1 -- 172.21.15.107:0/2564197283 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe46c06cb10 con 0x7fe47c1010e0 2024-09-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.806+0000 7fe4808ec640 1 --2- 172.21.15.107:0/2564197283 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe468039670 0x7fe46803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.807+0000 7fe4808ec640 1 --2- 172.21.15.107:0/2564197283 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe468039670 0x7fe46803bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe478006fd0 tx=0x7fe478006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:00.811+0000 7fe471ffb640 1 -- 172.21.15.107:0/2564197283 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe46c033790 con 0x7fe47c1010e0 2024-09-10T09:57:01.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:01.032+0000 7fe483351640 1 -- 172.21.15.107:0/2564197283 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe4600054c0 con 0x7fe47c1010e0 2024-09-10T09:57:01.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:01.033+0000 7fe471ffb640 1 -- 172.21.15.107:0/2564197283 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fe46c045b80 con 0x7fe47c1010e0 2024-09-10T09:57:01.034 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:57:01.034 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:57:01.034 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:57:01.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:01.034+0000 7fe483351640 1 -- 172.21.15.107:0/2564197283 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe468039670 msgr2=0x7fe46803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:01.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:01.034+0000 7fe483351640 1 --2- 172.21.15.107:0/2564197283 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe468039670 0x7fe46803bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe478006fd0 tx=0x7fe478006db0 comp rx=0 tx=0).stop 2024-09-10T09:57:01.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:01.034+0000 7fe483351640 1 -- 172.21.15.107:0/2564197283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe47c1010e0 msgr2=0x7fe47c111700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:01.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:01.034+0000 7fe483351640 1 --2- 172.21.15.107:0/2564197283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe47c1010e0 0x7fe47c111700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe46c004820 tx=0x7fe46c009da0 comp rx=0 tx=0).stop 2024-09-10T09:57:01.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:01.035+0000 7fe483351640 1 -- 172.21.15.107:0/2564197283 shutdown_connections 2024-09-10T09:57:01.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:01.035+0000 7fe483351640 1 --2- 172.21.15.107:0/2564197283 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe468039670 0x7fe46803bb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:01.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:01.035+0000 7fe483351640 1 --2- 172.21.15.107:0/2564197283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe47c1010e0 0x7fe47c111700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:01.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:01.035+0000 7fe483351640 1 -- 172.21.15.107:0/2564197283 >> 172.21.15.107:0/2564197283 conn(0x7fe47c0710b0 msgr2=0x7fe47c102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:57:01.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:01.035+0000 7fe483351640 1 -- 172.21.15.107:0/2564197283 shutdown_connections 2024-09-10T09:57:01.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:01.035+0000 7fe483351640 1 -- 172.21.15.107:0/2564197283 wait complete. 2024-09-10T09:57:01.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:01 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/2564197283' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:57:03.050 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:57:03.050 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:57:03.362 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:57:04.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:04 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:04.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:04 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:04.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:04 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:04.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:04 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:04.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:04 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:57:04.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:04 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:04.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:04 smithi071 ceph-mon[27559]: Deploying daemon mon.smithi107 on smithi107 2024-09-10T09:57:04.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:04 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:04.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.837+0000 7f7a2a048640 1 -- 172.21.15.107:0/2292026116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241010e0 msgr2=0x7f7a241014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:04.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.837+0000 7f7a2a048640 1 --2- 172.21.15.107:0/2292026116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241010e0 0x7f7a241014b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a14004850 tx=0x7f7a14009da0 comp rx=0 tx=0).stop 2024-09-10T09:57:04.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.837+0000 7f7a2a048640 1 -- 172.21.15.107:0/2292026116 shutdown_connections 2024-09-10T09:57:04.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.837+0000 7f7a2a048640 1 --2- 172.21.15.107:0/2292026116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241010e0 0x7f7a241014b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:04.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.837+0000 7f7a2a048640 1 -- 172.21.15.107:0/2292026116 >> 172.21.15.107:0/2292026116 conn(0x7f7a240710b0 msgr2=0x7f7a240714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:57:04.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.837+0000 7f7a2a048640 1 -- 172.21.15.107:0/2292026116 shutdown_connections 2024-09-10T09:57:04.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.837+0000 7f7a2a048640 1 -- 172.21.15.107:0/2292026116 wait complete. 2024-09-10T09:57:04.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.837+0000 7f7a2a048640 1 Processor -- start 2024-09-10T09:57:04.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.837+0000 7f7a2a048640 1 -- start start 2024-09-10T09:57:04.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.838+0000 7f7a2a048640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241010e0 0x7f7a241127f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:04.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.838+0000 7f7a2a048640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24112d30 con 0x7f7a241010e0 2024-09-10T09:57:04.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.838+0000 7f7a237fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241010e0 0x7f7a241127f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:04.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.838+0000 7f7a237fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241010e0 0x7f7a241127f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:34772/0 (socket says 172.21.15.107:34772) 2024-09-10T09:57:04.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.838+0000 7f7a237fe640 1 -- 172.21.15.107:0/1224867441 learned_addr learned my addr 172.21.15.107:0/1224867441 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:57:04.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.838+0000 7f7a237fe640 1 -- 172.21.15.107:0/1224867441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a14005040 con 0x7f7a241010e0 2024-09-10T09:57:04.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.838+0000 7f7a237fe640 1 --2- 172.21.15.107:0/1224867441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241010e0 0x7f7a241127f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7a1402a6d0 tx=0x7f7a14009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:57:04.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.839+0000 7f7a0bfff640 1 -- 172.21.15.107:0/1224867441 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a1402cf10 con 0x7f7a241010e0 2024-09-10T09:57:04.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.839+0000 7f7a2a048640 1 -- 172.21.15.107:0/1224867441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a24112f30 con 0x7f7a241010e0 2024-09-10T09:57:04.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.839+0000 7f7a0bfff640 1 -- 172.21.15.107:0/1224867441 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7a14033ad0 con 0x7f7a241010e0 2024-09-10T09:57:04.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.839+0000 7f7a0bfff640 1 -- 172.21.15.107:0/1224867441 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a1403ebb0 con 0x7f7a241010e0 2024-09-10T09:57:04.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.839+0000 7f7a2a048640 1 -- 172.21.15.107:0/1224867441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a24113380 con 0x7f7a241010e0 2024-09-10T09:57:04.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.840+0000 7f7a2a048640 1 -- 172.21.15.107:0/1224867441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a240fc850 con 0x7f7a241010e0 2024-09-10T09:57:04.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.840+0000 7f7a0bfff640 1 -- 172.21.15.107:0/1224867441 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f7a14030020 con 0x7f7a241010e0 2024-09-10T09:57:04.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.840+0000 7f7a0bfff640 1 --2- 172.21.15.107:0/1224867441 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f7a0c039670 0x7f7a0c03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:04.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.840+0000 7f7a0bfff640 1 -- 172.21.15.107:0/1224867441 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f7a1406c7e0 con 0x7f7a241010e0 2024-09-10T09:57:04.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.840+0000 7f7a22ffd640 1 --2- 172.21.15.107:0/1224867441 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f7a0c039670 0x7f7a0c03bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:04.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.841+0000 7f7a22ffd640 1 --2- 172.21.15.107:0/1224867441 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f7a0c039670 0x7f7a0c03bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800ad90 tx=0x7f7a18009410 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:57:04.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:04.844+0000 7f7a0bfff640 1 -- 172.21.15.107:0/1224867441 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7a140473f0 con 0x7f7a241010e0 2024-09-10T09:57:05.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:05.094+0000 7f7a2a048640 1 -- 172.21.15.107:0/1224867441 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7a2405ed70 con 0x7f7a241010e0 2024-09-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:05.095+0000 7f7a0bfff640 1 -- 172.21.15.107:0/1224867441 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7a1403c330 con 0x7f7a241010e0 2024-09-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:05.097+0000 7f7a2a048640 1 -- 172.21.15.107:0/1224867441 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f7a0c039670 msgr2=0x7f7a0c03bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:05.097+0000 7f7a2a048640 1 --2- 172.21.15.107:0/1224867441 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f7a0c039670 0x7f7a0c03bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800ad90 tx=0x7f7a18009410 comp rx=0 tx=0).stop 2024-09-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:05.097+0000 7f7a2a048640 1 -- 172.21.15.107:0/1224867441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241010e0 msgr2=0x7f7a241127f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:05.097+0000 7f7a2a048640 1 --2- 172.21.15.107:0/1224867441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241010e0 0x7f7a241127f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7a1402a6d0 tx=0x7f7a14009da0 comp rx=0 tx=0).stop 2024-09-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:05.097+0000 7f7a2a048640 1 -- 172.21.15.107:0/1224867441 shutdown_connections 2024-09-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:05.097+0000 7f7a2a048640 1 --2- 172.21.15.107:0/1224867441 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f7a0c039670 0x7f7a0c03bb20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:05.097+0000 7f7a2a048640 1 --2- 172.21.15.107:0/1224867441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a241010e0 0x7f7a241127f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:05.097+0000 7f7a2a048640 1 -- 172.21.15.107:0/1224867441 >> 172.21.15.107:0/1224867441 conn(0x7f7a240710b0 msgr2=0x7f7a24102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:05.097+0000 7f7a2a048640 1 -- 172.21.15.107:0/1224867441 shutdown_connections 2024-09-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:05.097+0000 7f7a2a048640 1 -- 172.21.15.107:0/1224867441 wait complete. 2024-09-10T09:57:05.690 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:05 smithi071 ceph-mon[27559]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:05.690 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:05 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/1224867441' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:57:07.160 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:57:07.161 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:57:07.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:07 smithi071 ceph-mon[27559]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:07.752 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi107/config 2024-09-10T09:57:08.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:08 smithi071 ceph-mon[27559]: Standby manager daemon smithi107.qurtcs started 2024-09-10T09:57:08.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:08 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/2777345290' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/crt"}]: dispatch 2024-09-10T09:57:08.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:08 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/2777345290' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T09:57:08.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:08 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/2777345290' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/key"}]: dispatch 2024-09-10T09:57:08.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:08 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/2777345290' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T09:57:09.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.301+0000 7f377a324640 1 -- 172.21.15.107:0/202821772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37741022f0 msgr2=0x7f37741026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:09.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.301+0000 7f377a324640 1 --2- 172.21.15.107:0/202821772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37741022f0 0x7f37741026c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3764004850 tx=0x7f3764009da0 comp rx=0 tx=0).stop 2024-09-10T09:57:09.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.302+0000 7f377a324640 1 -- 172.21.15.107:0/202821772 shutdown_connections 2024-09-10T09:57:09.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.302+0000 7f377a324640 1 --2- 172.21.15.107:0/202821772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37741022f0 0x7f37741026c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:09.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.302+0000 7f377a324640 1 -- 172.21.15.107:0/202821772 >> 172.21.15.107:0/202821772 conn(0x7f37740f7ec0 msgr2=0x7f37740fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:57:09.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.302+0000 7f377a324640 1 -- 172.21.15.107:0/202821772 shutdown_connections 2024-09-10T09:57:09.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.302+0000 7f377a324640 1 -- 172.21.15.107:0/202821772 wait complete. 2024-09-10T09:57:09.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.302+0000 7f377a324640 1 Processor -- start 2024-09-10T09:57:09.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.302+0000 7f377a324640 1 -- start start 2024-09-10T09:57:09.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.302+0000 7f377a324640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37741022f0 0x7f377406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:09.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.302+0000 7f377a324640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377406ff50 con 0x7f37741022f0 2024-09-10T09:57:09.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.303+0000 7f3773fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37741022f0 0x7f377406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:09.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.303+0000 7f3773fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37741022f0 0x7f377406fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.107:34794/0 (socket says 172.21.15.107:34794) 2024-09-10T09:57:09.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.303+0000 7f3773fff640 1 -- 172.21.15.107:0/1769900934 learned_addr learned my addr 172.21.15.107:0/1769900934 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:57:09.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.303+0000 7f3773fff640 1 -- 172.21.15.107:0/1769900934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764005040 con 0x7f37741022f0 2024-09-10T09:57:09.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.303+0000 7f3773fff640 1 --2- 172.21.15.107:0/1769900934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37741022f0 0x7f377406fa10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f376402a6d0 tx=0x7f3764009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:57:09.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.303+0000 7f3770ff9640 1 -- 172.21.15.107:0/1769900934 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f376402cf10 con 0x7f37741022f0 2024-09-10T09:57:09.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.303+0000 7f377a324640 1 -- 172.21.15.107:0/1769900934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3774070150 con 0x7f37741022f0 2024-09-10T09:57:09.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.303+0000 7f3770ff9640 1 -- 172.21.15.107:0/1769900934 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3764033ad0 con 0x7f37741022f0 2024-09-10T09:57:09.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.303+0000 7f3770ff9640 1 -- 172.21.15.107:0/1769900934 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f376403ebb0 con 0x7f37741022f0 2024-09-10T09:57:09.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.303+0000 7f377a324640 1 -- 172.21.15.107:0/1769900934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3774070620 con 0x7f37741022f0 2024-09-10T09:57:09.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.304+0000 7f377a324640 1 -- 172.21.15.107:0/1769900934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3774070860 con 0x7f37741022f0 2024-09-10T09:57:09.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.305+0000 7f3770ff9640 1 -- 172.21.15.107:0/1769900934 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f3764030020 con 0x7f37741022f0 2024-09-10T09:57:09.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.306+0000 7f3770ff9640 1 --2- 172.21.15.107:0/1769900934 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f376006eca0 0x7f3760071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:09.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.306+0000 7f3770ff9640 1 -- 172.21.15.107:0/1769900934 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f37640ad830 con 0x7f37741022f0 2024-09-10T09:57:09.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.306+0000 7f37737fe640 1 --2- 172.21.15.107:0/1769900934 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f376006eca0 0x7f3760071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:09.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.306+0000 7f37737fe640 1 --2- 172.21.15.107:0/1769900934 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f376006eca0 0x7f3760071150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f375c006fd0 tx=0x7f375c006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:57:09.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.311+0000 7f3770ff9640 1 -- 172.21.15.107:0/1769900934 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f376407b9d0 con 0x7f37741022f0 2024-09-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.531+0000 7f377a324640 1 -- 172.21.15.107:0/1769900934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f37740fda60 con 0x7f37741022f0 2024-09-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.532+0000 7f3770ff9640 1 -- 172.21.15.107:0/1769900934 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f376407b370 con 0x7f37741022f0 2024-09-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:54:42.708407Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.534+0000 7f377a324640 1 -- 172.21.15.107:0/1769900934 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f376006eca0 msgr2=0x7f3760071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.534+0000 7f377a324640 1 --2- 172.21.15.107:0/1769900934 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f376006eca0 0x7f3760071150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f375c006fd0 tx=0x7f375c006db0 comp rx=0 tx=0).stop 2024-09-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.534+0000 7f377a324640 1 -- 172.21.15.107:0/1769900934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37741022f0 msgr2=0x7f377406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.534+0000 7f377a324640 1 --2- 172.21.15.107:0/1769900934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37741022f0 0x7f377406fa10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f376402a6d0 tx=0x7f3764009da0 comp rx=0 tx=0).stop 2024-09-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.534+0000 7f377a324640 1 -- 172.21.15.107:0/1769900934 shutdown_connections 2024-09-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.534+0000 7f377a324640 1 --2- 172.21.15.107:0/1769900934 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f376006eca0 0x7f3760071150 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.534+0000 7f377a324640 1 --2- 172.21.15.107:0/1769900934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37741022f0 0x7f377406fa10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.534+0000 7f377a324640 1 -- 172.21.15.107:0/1769900934 >> 172.21.15.107:0/1769900934 conn(0x7f37740f7ec0 msgr2=0x7f37740f9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.534+0000 7f377a324640 1 -- 172.21.15.107:0/1769900934 shutdown_connections 2024-09-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:09.534+0000 7f377a324640 1 -- 172.21.15.107:0/1769900934 wait complete. 2024-09-10T09:57:09.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:09 smithi071 ceph-mon[27559]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:09.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:09 smithi071 ceph-mon[27559]: mgrmap e18: smithi071.gtqytr(active, since 24s), standbys: smithi107.qurtcs 2024-09-10T09:57:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:09 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr metadata", "who": "smithi107.qurtcs", "id": "smithi107.qurtcs"}]: dispatch 2024-09-10T09:57:11.282 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:57:11.282 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:57:11.533 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi107/config 2024-09-10T09:57:15.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T09:57:15.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T09:57:15.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: mon.smithi071 calling monitor election 2024-09-10T09:57:15.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:15.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T09:57:15.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T09:57:15.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: mon.smithi107 calling monitor election 2024-09-10T09:57:15.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:15.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T09:57:15.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T09:57:15.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:57:15.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T09:57:15.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: mon.smithi071 is new leader, mons smithi071,smithi107 in quorum (ranks 0,1) 2024-09-10T09:57:15.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: monmap e2: 2 mons at {smithi071=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0],smithi107=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-10T09:57:15.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: fsmap 2024-09-10T09:57:15.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T09:57:15.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: mgrmap e18: smithi071.gtqytr(active, since 30s), standbys: smithi107.qurtcs 2024-09-10T09:57:15.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: overall HEALTH_OK 2024-09-10T09:57:15.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:15.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:15.041 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:15.041 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:15.041 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:15.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:15.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.824+0000 7f0df41ff640 1 -- 172.21.15.107:0/3327321015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dd40034f0 msgr2=0x7f0dd4005970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:15.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.824+0000 7f0df41ff640 1 --2- 172.21.15.107:0/3327321015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dd40034f0 0x7f0dd4005970 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0dec073200 tx=0x7f0ddc009040 comp rx=0 tx=0).stop 2024-09-10T09:57:15.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.824+0000 7f0df41ff640 1 -- 172.21.15.107:0/3327321015 shutdown_connections 2024-09-10T09:57:15.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.824+0000 7f0df41ff640 1 --2- 172.21.15.107:0/3327321015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dd40034f0 0x7f0dd4005970 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:15.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.825+0000 7f0df41ff640 1 -- 172.21.15.107:0/3327321015 >> 172.21.15.107:0/3327321015 conn(0x7f0dec0711c0 msgr2=0x7f0dec0715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:57:15.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.825+0000 7f0df41ff640 1 -- 172.21.15.107:0/3327321015 shutdown_connections 2024-09-10T09:57:15.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.825+0000 7f0df41ff640 1 -- 172.21.15.107:0/3327321015 wait complete. 2024-09-10T09:57:15.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.825+0000 7f0df41ff640 1 Processor -- start 2024-09-10T09:57:15.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.825+0000 7f0df41ff640 1 -- start start 2024-09-10T09:57:15.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.825+0000 7f0df41ff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40034f0 0x7f0dec112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:15.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df41ff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dec112f80 0x7f0dec10c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:15.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df41ff640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec113540 con 0x7f0dec112f80 2024-09-10T09:57:15.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df41ff640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec113680 con 0x7f0dd40034f0 2024-09-10T09:57:15.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df1f9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40034f0 0x7f0dec112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:15.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df1f9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40034f0 0x7f0dec112a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58524/0 (socket says 172.21.15.107:58524) 2024-09-10T09:57:15.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df1f9b640 1 -- 172.21.15.107:0/3211980205 learned_addr learned my addr 172.21.15.107:0/3211980205 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:57:15.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df1f9b640 1 -- 172.21.15.107:0/3211980205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40034f0 msgr2=0x7f0dec112a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T09:57:15.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df1f9b640 1 -- 172.21.15.107:0/3211980205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40034f0 msgr2=0x7f0dec112a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T09:57:15.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df1f9b640 1 --2- 172.21.15.107:0/3211980205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40034f0 0x7f0dec112a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-10T09:57:15.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df179a640 1 --2- 172.21.15.107:0/3211980205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dec112f80 0x7f0dec10c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:15.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df1f9b640 1 --2- 172.21.15.107:0/3211980205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40034f0 0x7f0dec112a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:57:15.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df179a640 1 -- 172.21.15.107:0/3211980205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40034f0 msgr2=0x7f0dec112a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:57:15.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df179a640 1 --2- 172.21.15.107:0/3211980205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40034f0 0x7f0dec112a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:15.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df179a640 1 -- 172.21.15.107:0/3211980205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc007950 con 0x7f0dec112f80 2024-09-10T09:57:15.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.826+0000 7f0df179a640 1 --2- 172.21.15.107:0/3211980205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dec112f80 0x7f0dec10c9e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0de000b580 tx=0x7f0de00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:57:15.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.827+0000 7f0dea7fc640 1 -- 172.21.15.107:0/3211980205 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de0011690 con 0x7f0dec112f80 2024-09-10T09:57:15.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.827+0000 7f0dea7fc640 1 -- 172.21.15.107:0/3211980205 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0de0011c90 con 0x7f0dec112f80 2024-09-10T09:57:15.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.827+0000 7f0dea7fc640 1 -- 172.21.15.107:0/3211980205 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de0010e10 con 0x7f0dec112f80 2024-09-10T09:57:15.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.827+0000 7f0df41ff640 1 -- 172.21.15.107:0/3211980205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dec10cfe0 con 0x7f0dec112f80 2024-09-10T09:57:15.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.827+0000 7f0df41ff640 1 -- 172.21.15.107:0/3211980205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dec10d500 con 0x7f0dec112f80 2024-09-10T09:57:15.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.828+0000 7f0df41ff640 1 -- 172.21.15.107:0/3211980205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dec10d7e0 con 0x7f0dec112f80 2024-09-10T09:57:15.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.828+0000 7f0dea7fc640 1 -- 172.21.15.107:0/3211980205 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f0de0010600 con 0x7f0dec112f80 2024-09-10T09:57:15.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.829+0000 7f0dea7fc640 1 --2- 172.21.15.107:0/3211980205 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0dd806edd0 0x7f0dd8071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:15.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.829+0000 7f0dea7fc640 1 -- 172.21.15.107:0/3211980205 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0de008d3d0 con 0x7f0dec112f80 2024-09-10T09:57:15.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.829+0000 7f0df1f9b640 1 --2- 172.21.15.107:0/3211980205 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0dd806edd0 0x7f0dd8071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:15.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.829+0000 7f0df1f9b640 1 --2- 172.21.15.107:0/3211980205 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0dd806edd0 0x7f0dd8071280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc001220 tx=0x7f0ddc009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:57:15.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:15.833+0000 7f0dea7fc640 1 -- 172.21.15.107:0/3211980205 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0de005b5d0 con 0x7f0dec112f80 2024-09-10T09:57:16.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:15 smithi071 ceph-mon[27559]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:16.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:15 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:57:16.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:15 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T09:57:16.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:15 smithi107 ceph-mon[34215]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:16.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:15 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:57:16.054 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:15 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T09:57:16.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:16.055+0000 7f0df41ff640 1 -- 172.21.15.107:0/3211980205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0dec0fdab0 con 0x7f0dec112f80 2024-09-10T09:57:16.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:16.056+0000 7f0dea7fc640 1 -- 172.21.15.107:0/3211980205 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f0de0015090 con 0x7f0dec112f80 2024-09-10T09:57:16.058 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:57:16.058 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":2,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","modified":"2024-09-10T09:57:09.648349Z","created":"2024-09-10T09:54:42.708407Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi071","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi107","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T09:57:16.058 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 2 2024-09-10T09:57:16.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:16.058+0000 7f0df41ff640 1 -- 172.21.15.107:0/3211980205 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0dd806edd0 msgr2=0x7f0dd8071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:16.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:16.058+0000 7f0df41ff640 1 --2- 172.21.15.107:0/3211980205 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0dd806edd0 0x7f0dd8071280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc001220 tx=0x7f0ddc009040 comp rx=0 tx=0).stop 2024-09-10T09:57:16.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:16.058+0000 7f0df41ff640 1 -- 172.21.15.107:0/3211980205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dec112f80 msgr2=0x7f0dec10c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:16.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:16.058+0000 7f0df41ff640 1 --2- 172.21.15.107:0/3211980205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dec112f80 0x7f0dec10c9e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0de000b580 tx=0x7f0de00090f0 comp rx=0 tx=0).stop 2024-09-10T09:57:16.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:16.058+0000 7f0df41ff640 1 -- 172.21.15.107:0/3211980205 shutdown_connections 2024-09-10T09:57:16.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:16.058+0000 7f0df41ff640 1 --2- 172.21.15.107:0/3211980205 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0dd806edd0 0x7f0dd8071280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:16.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:16.058+0000 7f0df41ff640 1 --2- 172.21.15.107:0/3211980205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dec112f80 0x7f0dec10c9e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:16.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:16.058+0000 7f0df41ff640 1 --2- 172.21.15.107:0/3211980205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dd40034f0 0x7f0dec112a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:16.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:16.058+0000 7f0df41ff640 1 -- 172.21.15.107:0/3211980205 >> 172.21.15.107:0/3211980205 conn(0x7f0dec0711c0 msgr2=0x7f0dec1016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:57:16.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:16.058+0000 7f0df41ff640 1 -- 172.21.15.107:0/3211980205 shutdown_connections 2024-09-10T09:57:16.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:57:16.058+0000 7f0df41ff640 1 -- 172.21.15.107:0/3211980205 wait complete. 2024-09-10T09:57:17.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:16 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/3211980205' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:57:17.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:16 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:17.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:16 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:17.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:16 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:17.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:16 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:57:17.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:16 smithi107 ceph-mon[34215]: from='client.? 172.21.15.107:0/3211980205' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:57:17.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:16 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:17.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:16 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:17.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:16 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:17.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:16 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:57:17.243 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T09:57:17.243 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T09:57:17.961 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:17.961 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T09:57:17.961 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-10T09:57:17.962 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:57:17.962 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:57:17.962 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:17.962 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:17.962 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:17.962 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:17.962 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:17.962 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: Reconfiguring mon.smithi071 (unknown last config time)... 2024-09-10T09:57:17.962 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:57:17.962 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:57:17.962 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:17.962 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:17 smithi071 ceph-mon[27559]: Reconfiguring daemon mon.smithi071 on smithi071 2024-09-10T09:57:18.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:18.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T09:57:18.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-10T09:57:18.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:57:18.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:57:18.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:18.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:18.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:18.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:18.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:18.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: Reconfiguring mon.smithi071 (unknown last config time)... 2024-09-10T09:57:18.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:57:18.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:57:18.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:18.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:17 smithi107 ceph-mon[34215]: Reconfiguring daemon mon.smithi071 on smithi071 2024-09-10T09:57:18.337 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T09:57:19.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:19 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:19.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:19 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:19.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:19 smithi071 ceph-mon[27559]: Reconfiguring mgr.smithi071.gtqytr (unknown last config time)... 2024-09-10T09:57:19.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:19 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi071.gtqytr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:57:19.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:19 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:57:19.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:19 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:19.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:19 smithi071 ceph-mon[27559]: Reconfiguring daemon mgr.smithi071.gtqytr on smithi071 2024-09-10T09:57:19.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:19 smithi071 ceph-mon[27559]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:19.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:19 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:19.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:19 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:19.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:19 smithi107 ceph-mon[34215]: Reconfiguring mgr.smithi071.gtqytr (unknown last config time)... 2024-09-10T09:57:19.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:19 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi071.gtqytr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:57:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:19 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:57:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:19 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:19 smithi107 ceph-mon[34215]: Reconfiguring daemon mgr.smithi071.gtqytr on smithi071 2024-09-10T09:57:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:19 smithi107 ceph-mon[34215]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:20.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:20 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:20.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.425+0000 7f14d2540640 1 -- 172.21.15.71:0/3575377354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc1025f0 msgr2=0x7f14cc1029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:20.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.425+0000 7f14d2540640 1 --2- 172.21.15.71:0/3575377354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc1025f0 0x7f14cc1029c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0048d0 tx=0x7f14bc009da0 comp rx=0 tx=0).stop 2024-09-10T09:57:20.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.425+0000 7f14d2540640 1 -- 172.21.15.71:0/3575377354 shutdown_connections 2024-09-10T09:57:20.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.425+0000 7f14d2540640 1 --2- 172.21.15.71:0/3575377354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0fac60 0x7f14cc0fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:20.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.425+0000 7f14d2540640 1 --2- 172.21.15.71:0/3575377354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc1025f0 0x7f14cc1029c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:20.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.425+0000 7f14d2540640 1 -- 172.21.15.71:0/3575377354 >> 172.21.15.71:0/3575377354 conn(0x7f14cc070c80 msgr2=0x7f14cc071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:57:20.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.425+0000 7f14d2540640 1 -- 172.21.15.71:0/3575377354 shutdown_connections 2024-09-10T09:57:20.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.425+0000 7f14d2540640 1 -- 172.21.15.71:0/3575377354 wait complete. 2024-09-10T09:57:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.426+0000 7f14d2540640 1 Processor -- start 2024-09-10T09:57:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.426+0000 7f14d2540640 1 -- start start 2024-09-10T09:57:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.426+0000 7f14d2540640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0fac60 0x7f14cc0fbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.426+0000 7f14d2540640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc1025f0 0x7f14cc0fc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.426+0000 7f14d2540640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc0fc950 con 0x7f14cc1025f0 2024-09-10T09:57:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.426+0000 7f14d2540640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc0fcac0 con 0x7f14cc0fac60 2024-09-10T09:57:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.426+0000 7f14cb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc1025f0 0x7f14cc0fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.426+0000 7f14cb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc1025f0 0x7f14cc0fc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46222/0 (socket says 172.21.15.71:46222) 2024-09-10T09:57:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.427+0000 7f14cb7fe640 1 -- 172.21.15.71:0/3110222520 learned_addr learned my addr 172.21.15.71:0/3110222520 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:57:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.427+0000 7f14cbfff640 1 --2- 172.21.15.71:0/3110222520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0fac60 0x7f14cc0fbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.427+0000 7f14cb7fe640 1 -- 172.21.15.71:0/3110222520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0fac60 msgr2=0x7f14cc0fbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.427+0000 7f14cb7fe640 1 --2- 172.21.15.71:0/3110222520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0fac60 0x7f14cc0fbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:20.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.427+0000 7f14cb7fe640 1 -- 172.21.15.71:0/3110222520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc005040 con 0x7f14cc1025f0 2024-09-10T09:57:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.427+0000 7f14cbfff640 1 --2- 172.21.15.71:0/3110222520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0fac60 0x7f14cc0fbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:57:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.427+0000 7f14cb7fe640 1 --2- 172.21.15.71:0/3110222520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc1025f0 0x7f14cc0fc380 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f14c000b790 tx=0x7f14c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:57:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.427+0000 7f14c8ff9640 1 -- 172.21.15.71:0/3110222520 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14c000c700 con 0x7f14cc1025f0 2024-09-10T09:57:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.427+0000 7f14c8ff9640 1 -- 172.21.15.71:0/3110222520 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f14c000cd00 con 0x7f14cc1025f0 2024-09-10T09:57:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.427+0000 7f14d2540640 1 -- 172.21.15.71:0/3110222520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14cc119590 con 0x7f14cc1025f0 2024-09-10T09:57:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.427+0000 7f14c8ff9640 1 -- 172.21.15.71:0/3110222520 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14c0015e70 con 0x7f14cc1025f0 2024-09-10T09:57:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.427+0000 7f14d2540640 1 -- 172.21.15.71:0/3110222520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14cc1199d0 con 0x7f14cc1025f0 2024-09-10T09:57:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.428+0000 7f14d2540640 1 -- 172.21.15.71:0/3110222520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14cc065810 con 0x7f14cc1025f0 2024-09-10T09:57:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.429+0000 7f14c8ff9640 1 -- 172.21.15.71:0/3110222520 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f14c0012070 con 0x7f14cc1025f0 2024-09-10T09:57:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.429+0000 7f14c8ff9640 1 --2- 172.21.15.71:0/3110222520 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f14b406ecc0 0x7f14b4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.429+0000 7f14cbfff640 1 --2- 172.21.15.71:0/3110222520 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f14b406ecc0 0x7f14b4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.429+0000 7f14c8ff9640 1 -- 172.21.15.71:0/3110222520 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f14c008cbe0 con 0x7f14cc1025f0 2024-09-10T09:57:20.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.430+0000 7f14cbfff640 1 --2- 172.21.15.71:0/3110222520 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f14b406ecc0 0x7f14b4071170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00b020 tx=0x7f14bc009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:57:20.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.433+0000 7f14c8ff9640 1 -- 172.21.15.71:0/3110222520 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f14c005ade0 con 0x7f14cc1025f0 2024-09-10T09:57:20.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.596+0000 7f14d2540640 1 -- 172.21.15.71:0/3110222520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f14cc074c20 con 0x7f14cc1025f0 2024-09-10T09:57:20.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.596+0000 7f14c8ff9640 1 -- 172.21.15.71:0/3110222520 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f14c008c390 con 0x7f14cc1025f0 2024-09-10T09:57:20.597 INFO:teuthology.orchestra.run.smithi071.stdout:# minimal ceph.conf for 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:57:20.597 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2024-09-10T09:57:20.597 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T09:57:20.597 INFO:teuthology.orchestra.run.smithi071.stdout: mon_host = [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-10T09:57:20.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.598+0000 7f14d2540640 1 -- 172.21.15.71:0/3110222520 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f14b406ecc0 msgr2=0x7f14b4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:20.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.598+0000 7f14d2540640 1 --2- 172.21.15.71:0/3110222520 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f14b406ecc0 0x7f14b4071170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00b020 tx=0x7f14bc009da0 comp rx=0 tx=0).stop 2024-09-10T09:57:20.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.598+0000 7f14d2540640 1 -- 172.21.15.71:0/3110222520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc1025f0 msgr2=0x7f14cc0fc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:20.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.598+0000 7f14d2540640 1 --2- 172.21.15.71:0/3110222520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc1025f0 0x7f14cc0fc380 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f14c000b790 tx=0x7f14c00091d0 comp rx=0 tx=0).stop 2024-09-10T09:57:20.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.598+0000 7f14d2540640 1 -- 172.21.15.71:0/3110222520 shutdown_connections 2024-09-10T09:57:20.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.598+0000 7f14d2540640 1 --2- 172.21.15.71:0/3110222520 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f14b406ecc0 0x7f14b4071170 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:20.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.598+0000 7f14d2540640 1 --2- 172.21.15.71:0/3110222520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14cc1025f0 0x7f14cc0fc380 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:20.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.598+0000 7f14d2540640 1 --2- 172.21.15.71:0/3110222520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0fac60 0x7f14cc0fbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:20.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.598+0000 7f14d2540640 1 -- 172.21.15.71:0/3110222520 >> 172.21.15.71:0/3110222520 conn(0x7f14cc070c80 msgr2=0x7f14cc0f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:57:20.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.598+0000 7f14d2540640 1 -- 172.21.15.71:0/3110222520 shutdown_connections 2024-09-10T09:57:20.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:20.599+0000 7f14d2540640 1 -- 172.21.15.71:0/3110222520 wait complete. 2024-09-10T09:57:20.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:20 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:21.471 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T09:57:21.471 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:57:21.471 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T09:57:21.498 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:57:21.498 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:57:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:21 smithi071 ceph-mon[27559]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:21 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3110222520' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:21 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:21 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:21 smithi071 ceph-mon[27559]: Reconfiguring crash.smithi071 (monmap changed)... 2024-09-10T09:57:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:21 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi071", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:57:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:21 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:21 smithi071 ceph-mon[27559]: Reconfiguring daemon crash.smithi071 on smithi071 2024-09-10T09:57:21.565 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-10T09:57:21.565 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T09:57:21.598 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-10T09:57:21.599 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:57:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:21 smithi107 ceph-mon[34215]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:21 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3110222520' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:21 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:21 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:21 smithi107 ceph-mon[34215]: Reconfiguring crash.smithi071 (monmap changed)... 2024-09-10T09:57:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:21 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi071", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:57:21.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:21 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:21.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:21 smithi107 ceph-mon[34215]: Reconfiguring daemon crash.smithi071 on smithi071 2024-09-10T09:57:21.666 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T09:57:21.666 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T09:57:21.666 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T09:57:21.681 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T09:57:21.682 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-09-10T09:57:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T09:57:21.737 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:57:21.737 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-10T09:57:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:57:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:57:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-10 09:56:38.338823688 +0000 2024-09-10T09:57:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-10 09:51:28.960042424 +0000 2024-09-10T09:57:21.738 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-10 09:51:28.960042424 +0000 2024-09-10T09:57:21.738 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-10 09:51:28.960042424 +0000 2024-09-10T09:57:21.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T09:57:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-10T09:57:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-10T09:57:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000193338 s, 2.6 MB/s 2024-09-10T09:57:21.803 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T09:57:21.859 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-09-10T09:57:21.914 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T09:57:21.914 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:57:21.915 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T09:57:21.915 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:57:21.915 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:57:21.915 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-10 09:56:38.339823670 +0000 2024-09-10T09:57:21.915 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-10 09:51:29.287036793 +0000 2024-09-10T09:57:21.915 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-10 09:51:29.287036793 +0000 2024-09-10T09:57:21.915 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-10 09:51:29.287036793 +0000 2024-09-10T09:57:21.915 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T09:57:21.979 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-10T09:57:21.980 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-10T09:57:21.980 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000164584 s, 3.1 MB/s 2024-09-10T09:57:21.981 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T09:57:22.037 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-09-10T09:57:22.092 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T09:57:22.092 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:57:22.092 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-10T09:57:22.092 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:57:22.092 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:57:22.092 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-10 09:56:38.339823670 +0000 2024-09-10T09:57:22.092 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-10 09:51:29.661030352 +0000 2024-09-10T09:57:22.092 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-10 09:51:29.661030352 +0000 2024-09-10T09:57:22.092 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-10 09:51:29.661030352 +0000 2024-09-10T09:57:22.093 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T09:57:22.155 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-10T09:57:22.155 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-10T09:57:22.155 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000198259 s, 2.6 MB/s 2024-09-10T09:57:22.156 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T09:57:22.212 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-09-10T09:57:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T09:57:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:57:22.268 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-10T09:57:22.268 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:57:22.268 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:57:22.268 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-10 09:56:38.340823653 +0000 2024-09-10T09:57:22.268 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-10 09:51:29.982024824 +0000 2024-09-10T09:57:22.268 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-10 09:51:29.982024824 +0000 2024-09-10T09:57:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-10 09:51:29.982024824 +0000 2024-09-10T09:57:22.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T09:57:22.332 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-10T09:57:22.332 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-10T09:57:22.333 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00017071 s, 3.0 MB/s 2024-09-10T09:57:22.334 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T09:57:22.390 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-10T09:57:22.390 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T09:57:22.406 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T09:57:22.406 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-09-10T09:57:22.461 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T09:57:22.461 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:57:22.461 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-10T09:57:22.461 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:57:22.461 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:57:22.461 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-10 09:57:07.990005760 +0000 2024-09-10T09:57:22.461 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-10 09:51:28.877761916 +0000 2024-09-10T09:57:22.461 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-10 09:51:28.877761916 +0000 2024-09-10T09:57:22.461 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-10 09:51:28.877761916 +0000 2024-09-10T09:57:22.461 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T09:57:22.525 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-10T09:57:22.525 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-10T09:57:22.525 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000217777 s, 2.4 MB/s 2024-09-10T09:57:22.526 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T09:57:22.583 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-09-10T09:57:22.639 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T09:57:22.639 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:57:22.639 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T09:57:22.639 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:57:22.639 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:57:22.639 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-10 09:57:07.990005760 +0000 2024-09-10T09:57:22.639 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-10 09:51:29.204756667 +0000 2024-09-10T09:57:22.640 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-10 09:51:29.204756667 +0000 2024-09-10T09:57:22.640 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-10 09:51:29.204756667 +0000 2024-09-10T09:57:22.640 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T09:57:22.702 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-10T09:57:22.702 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-10T09:57:22.702 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000235053 s, 2.2 MB/s 2024-09-10T09:57:22.703 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T09:57:22.760 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-09-10T09:57:22.815 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T09:57:22.815 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:57:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T09:57:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:57:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:57:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-10 09:57:07.991005743 +0000 2024-09-10T09:57:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-10 09:51:29.527751482 +0000 2024-09-10T09:57:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-10 09:51:29.527751482 +0000 2024-09-10T09:57:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-10 09:51:29.527751482 +0000 2024-09-10T09:57:22.816 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T09:57:22.878 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-10T09:57:22.879 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-10T09:57:22.879 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000189031 s, 2.7 MB/s 2024-09-10T09:57:22.880 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T09:57:22.935 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-09-10T09:57:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T09:57:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:57:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T09:57:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:57:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:57:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-10 09:57:07.991005743 +0000 2024-09-10T09:57:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-10 09:51:29.844746393 +0000 2024-09-10T09:57:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-10 09:51:29.844746393 +0000 2024-09-10T09:57:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-10 09:51:29.844746393 +0000 2024-09-10T09:57:22.991 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T09:57:23.054 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-10T09:57:23.054 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-10T09:57:23.054 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000195393 s, 2.6 MB/s 2024-09-10T09:57:23.055 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T09:57:23.111 INFO:tasks.cephadm:Deploying osd.0 on smithi071 with /dev/vg_nvme/lv_4... 2024-09-10T09:57:23.111 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T09:57:24.021 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:23 smithi071 ceph-mon[27559]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:24.021 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:23 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:24.021 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:23 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:24.021 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:23 smithi071 ceph-mon[27559]: Reconfiguring alertmanager.smithi071 (dependencies changed)... 2024-09-10T09:57:24.021 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:23 smithi071 ceph-mon[27559]: Reconfiguring daemon alertmanager.smithi071 on smithi071 2024-09-10T09:57:24.116 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T09:57:24.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:23 smithi107 ceph-mon[34215]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:24.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:23 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:24.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:23 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:24.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:23 smithi107 ceph-mon[34215]: Reconfiguring alertmanager.smithi071 (dependencies changed)... 2024-09-10T09:57:24.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:23 smithi107 ceph-mon[34215]: Reconfiguring daemon alertmanager.smithi071 on smithi071 2024-09-10T09:57:25.836 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:25 smithi071 ceph-mon[27559]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:26.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:25 smithi107 ceph-mon[34215]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:27.900 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:27 smithi071 ceph-mon[27559]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:28.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:27 smithi107 ceph-mon[34215]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:29.434 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:29 smithi071 ceph-mon[27559]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:29.434 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:29.435 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:29.435 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:29 smithi071 ceph-mon[27559]: Reconfiguring grafana.smithi071 (dependencies changed)... 2024-09-10T09:57:29.435 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:29 smithi071 ceph-mon[27559]: Reconfiguring daemon grafana.smithi071 on smithi071 2024-09-10T09:57:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:29 smithi107 ceph-mon[34215]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:29 smithi107 ceph-mon[34215]: Reconfiguring grafana.smithi071 (dependencies changed)... 2024-09-10T09:57:29.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:29 smithi107 ceph-mon[34215]: Reconfiguring daemon grafana.smithi071 on smithi071 2024-09-10T09:57:29.724 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:57:29.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_4 2024-09-10T09:57:30.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:30 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:57:30.690 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:30 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:57:31.612 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:31 smithi071 ceph-mon[27559]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:31.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:31 smithi107 ceph-mon[34215]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:31.695 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T09:57:33.598 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:33 smithi071 ceph-mon[27559]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:33.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:33 smithi107 ceph-mon[34215]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:34.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.054+0000 7f752c58f640 1 -- 172.21.15.71:0/4012790742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75240fe4f0 msgr2=0x7f75240fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:34.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.054+0000 7f752c58f640 1 --2- 172.21.15.71:0/4012790742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75240fe4f0 0x7f75240fa650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f75140048d0 tx=0x7f7514009da0 comp rx=0 tx=0).stop 2024-09-10T09:57:34.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.054+0000 7f752c58f640 1 -- 172.21.15.71:0/4012790742 shutdown_connections 2024-09-10T09:57:34.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.054+0000 7f752c58f640 1 --2- 172.21.15.71:0/4012790742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75240fe4f0 0x7f75240fa650 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:34.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.054+0000 7f752c58f640 1 --2- 172.21.15.71:0/4012790742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75240fdba0 0x7f75240fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:34.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.055+0000 7f752c58f640 1 -- 172.21.15.71:0/4012790742 >> 172.21.15.71:0/4012790742 conn(0x7f75240f63a0 msgr2=0x7f75240f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:57:34.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.055+0000 7f752c58f640 1 -- 172.21.15.71:0/4012790742 shutdown_connections 2024-09-10T09:57:34.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.055+0000 7f752c58f640 1 -- 172.21.15.71:0/4012790742 wait complete. 2024-09-10T09:57:34.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.055+0000 7f752c58f640 1 Processor -- start 2024-09-10T09:57:34.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.055+0000 7f752c58f640 1 -- start start 2024-09-10T09:57:34.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.055+0000 7f752c58f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75240fdba0 0x7f752410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.055+0000 7f752c58f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75240fe4f0 0x7f752410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.055+0000 7f752c58f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752410dc70 con 0x7f75240fdba0 2024-09-10T09:57:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.055+0000 7f752c58f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752410e440 con 0x7f75240fe4f0 2024-09-10T09:57:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.055+0000 7f752a32b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75240fdba0 0x7f752410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.055+0000 7f752a32b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75240fdba0 0x7f752410d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44408/0 (socket says 172.21.15.71:44408) 2024-09-10T09:57:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.055+0000 7f752a32b640 1 -- 172.21.15.71:0/3194886947 learned_addr learned my addr 172.21.15.71:0/3194886947 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:57:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.056+0000 7f752a32b640 1 -- 172.21.15.71:0/3194886947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75240fe4f0 msgr2=0x7f752410d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:57:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.056+0000 7f7529b2a640 1 --2- 172.21.15.71:0/3194886947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75240fe4f0 0x7f752410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.056+0000 7f752a32b640 1 --2- 172.21.15.71:0/3194886947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75240fe4f0 0x7f752410d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:57:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.056+0000 7f752a32b640 1 -- 172.21.15.71:0/3194886947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7514005040 con 0x7f75240fdba0 2024-09-10T09:57:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.056+0000 7f752a32b640 1 --2- 172.21.15.71:0/3194886947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75240fdba0 0x7f752410d0e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7520002a50 tx=0x7f7520004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:57:34.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.056+0000 7f751affd640 1 -- 172.21.15.71:0/3194886947 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7520007c30 con 0x7f75240fdba0 2024-09-10T09:57:34.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.056+0000 7f751affd640 1 -- 172.21.15.71:0/3194886947 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f752000f040 con 0x7f75240fdba0 2024-09-10T09:57:34.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.056+0000 7f752c58f640 1 -- 172.21.15.71:0/3194886947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752410e6d0 con 0x7f75240fdba0 2024-09-10T09:57:34.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.056+0000 7f751affd640 1 -- 172.21.15.71:0/3194886947 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f752000da90 con 0x7f75240fdba0 2024-09-10T09:57:34.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.056+0000 7f752c58f640 1 -- 172.21.15.71:0/3194886947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752410ec70 con 0x7f75240fdba0 2024-09-10T09:57:34.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.057+0000 7f752c58f640 1 -- 172.21.15.71:0/3194886947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75240fa040 con 0x7f75240fdba0 2024-09-10T09:57:34.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.058+0000 7f751affd640 1 -- 172.21.15.71:0/3194886947 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f752000dd00 con 0x7f75240fdba0 2024-09-10T09:57:34.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.058+0000 7f751affd640 1 --2- 172.21.15.71:0/3194886947 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f751006ecc0 0x7f7510071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:57:34.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.058+0000 7f751affd640 1 -- 172.21.15.71:0/3194886947 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f752008c920 con 0x7f75240fdba0 2024-09-10T09:57:34.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.058+0000 7f7529b2a640 1 --2- 172.21.15.71:0/3194886947 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f751006ecc0 0x7f7510071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:57:34.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.059+0000 7f7529b2a640 1 --2- 172.21.15.71:0/3194886947 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f751006ecc0 0x7f7510071170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7514000c00 tx=0x7f7514009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:57:34.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.062+0000 7f751affd640 1 -- 172.21.15.71:0/3194886947 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f752004d2a0 con 0x7f75240fdba0 2024-09-10T09:57:34.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:57:34.233+0000 7f752c58f640 1 -- 172.21.15.71:0/3194886947 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f752410f020 con 0x7f751006ecc0 2024-09-10T09:57:34.529 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:34 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:57:34.529 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:34 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:57:34.529 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:34 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:34.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:34 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:57:34.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:34 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:57:34.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:34 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:35.955 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:35 smithi071 ceph-mon[27559]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:57:35.956 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:35 smithi071 ceph-mon[27559]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:35.956 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:35 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:35.956 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:35 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:35.956 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:35 smithi071 ceph-mon[27559]: Reconfiguring prometheus.smithi071 (dependencies changed)... 2024-09-10T09:57:35.956 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:35 smithi071 ceph-mon[27559]: Reconfiguring daemon prometheus.smithi071 on smithi071 2024-09-10T09:57:36.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:35 smithi107 ceph-mon[34215]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:57:36.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:35 smithi107 ceph-mon[34215]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:36.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:35 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:36.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:35 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:36.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:35 smithi107 ceph-mon[34215]: Reconfiguring prometheus.smithi071 (dependencies changed)... 2024-09-10T09:57:36.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:35 smithi107 ceph-mon[34215]: Reconfiguring daemon prometheus.smithi071 on smithi071 2024-09-10T09:57:37.931 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:37 smithi071 ceph-mon[27559]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:38.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:37 smithi107 ceph-mon[34215]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:39 smithi071 ceph-mon[27559]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:40.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:39 smithi107 ceph-mon[34215]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:41.497 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:41.497 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:41.497 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:41 smithi107 ceph-mon[34215]: Reconfiguring crash.smithi107 (monmap changed)... 2024-09-10T09:57:41.497 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:57:41.497 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:41.497 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:41 smithi107 ceph-mon[34215]: Reconfiguring daemon crash.smithi107 on smithi107 2024-09-10T09:57:41.497 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:41 smithi107 ceph-mon[34215]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:41.497 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:41 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1054595847' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99e11191-662e-49c7-876a-9a902b3b506f"}]: dispatch 2024-09-10T09:57:41.498 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:41 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1054595847' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99e11191-662e-49c7-876a-9a902b3b506f"}]': finished 2024-09-10T09:57:41.498 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:41 smithi107 ceph-mon[34215]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T09:57:41.498 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:57:41.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:41.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:41.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:41 smithi071 ceph-mon[27559]: Reconfiguring crash.smithi107 (monmap changed)... 2024-09-10T09:57:41.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:57:41.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:41.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:41 smithi071 ceph-mon[27559]: Reconfiguring daemon crash.smithi107 on smithi107 2024-09-10T09:57:41.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:41 smithi071 ceph-mon[27559]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:41.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:41 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1054595847' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99e11191-662e-49c7-876a-9a902b3b506f"}]: dispatch 2024-09-10T09:57:41.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:41 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1054595847' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99e11191-662e-49c7-876a-9a902b3b506f"}]': finished 2024-09-10T09:57:41.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:41 smithi071 ceph-mon[27559]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T09:57:41.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:57:42.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:42 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:42.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:42 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:42.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:42 smithi107 ceph-mon[34215]: Reconfiguring mgr.smithi107.qurtcs (monmap changed)... 2024-09-10T09:57:42.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:42 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.qurtcs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:57:42.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:42 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:57:42.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:42 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:42.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:42 smithi107 ceph-mon[34215]: Reconfiguring daemon mgr.smithi107.qurtcs on smithi107 2024-09-10T09:57:42.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:42 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1908801068' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:57:43.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:42 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:43.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:42 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:43.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:42 smithi071 ceph-mon[27559]: Reconfiguring mgr.smithi107.qurtcs (monmap changed)... 2024-09-10T09:57:43.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:42 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.qurtcs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:57:43.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:42 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:57:43.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:42 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:43.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:42 smithi071 ceph-mon[27559]: Reconfiguring daemon mgr.smithi107.qurtcs on smithi107 2024-09-10T09:57:43.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:42 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1908801068' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:57:44.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:43 smithi107 ceph-mon[34215]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:44.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:43 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:44.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:43 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:44.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:43 smithi107 ceph-mon[34215]: Reconfiguring mon.smithi107 (monmap changed)... 2024-09-10T09:57:44.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:43 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:57:44.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:43 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:57:44.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:43 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:44.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:43 smithi107 ceph-mon[34215]: Reconfiguring daemon mon.smithi107 on smithi107 2024-09-10T09:57:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:43 smithi071 ceph-mon[27559]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:43 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:44.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:43 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:44.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:43 smithi071 ceph-mon[27559]: Reconfiguring mon.smithi107 (monmap changed)... 2024-09-10T09:57:44.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:43 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:57:44.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:43 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:57:44.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:43 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:44.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:43 smithi071 ceph-mon[27559]: Reconfiguring daemon mon.smithi107 on smithi107 2024-09-10T09:57:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T09:57:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T09:57:45.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi071.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T09:57:45.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi071.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T09:57:45.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:45.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T09:57:45.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T09:57:45.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi071.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T09:57:45.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi071.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T09:57:45.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:45.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:45.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:57:45.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:57:45.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi071.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T09:57:45.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi071.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T09:57:45.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:45.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:57:45.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:57:45.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:45.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:45.563 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi071.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi071.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi071.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi071.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi071.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T09:57:45.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi071.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T09:57:45.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:45.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:57:45.565 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:57:47.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:47 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:47.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:47 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:47.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:47 smithi071 ceph-mon[27559]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:47.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:47 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:47.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:47 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:47.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:47 smithi107 ceph-mon[34215]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:49.449 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:49 smithi071 ceph-mon[27559]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:49.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:49 smithi107 ceph-mon[34215]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:50.638 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T09:57:50.638 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:50 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:50.638 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:50 smithi071 ceph-mon[27559]: Deploying daemon osd.0 on smithi071 2024-09-10T09:57:50.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:50 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T09:57:50.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:50 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:50.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:50 smithi107 ceph-mon[34215]: Deploying daemon osd.0 on smithi071 2024-09-10T09:57:51.643 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:51 smithi071 ceph-mon[27559]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:51.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:51 smithi107 ceph-mon[34215]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:53.435 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:53 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:53.435 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:53 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:53.435 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:53 smithi071 ceph-mon[27559]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:53.435 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:53 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:53.435 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:53 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:57:53.435 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:53 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:53.435 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:53 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:57:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:53 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:53 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:53 smithi107 ceph-mon[34215]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:53 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:53 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:57:53.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:53 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:53.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:53 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:57:55.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:55 smithi071 ceph-mon[27559]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:55.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:55 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:55.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:55 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:55.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:55 smithi107 ceph-mon[34215]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:55.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:55 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:55.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:55 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:57.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:57 smithi071 ceph-mon[27559]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:57.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:57 smithi107 ceph-mon[34215]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:57:59.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:59.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:59.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:59.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:59.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:59.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:57:59.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:59.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:57:59.246 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:59.246 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:59.246 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:59.247 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:59.247 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:57:59.247 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:57:59.247 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:57:59.247 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:58:00.122 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:59 smithi071 ceph-mon[27559]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:58:00.122 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:57:59 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:58:00.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:59 smithi107 ceph-mon[34215]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:58:00.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:57:59 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:58:01.323 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 0 on host 'smithi071' 2024-09-10T09:58:01.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:01.322+0000 7f751affd640 1 -- 172.21.15.71:0/3194886947 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f752410f020 con 0x7f751006ecc0 2024-09-10T09:58:01.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:01.324+0000 7f752c58f640 1 -- 172.21.15.71:0/3194886947 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f751006ecc0 msgr2=0x7f7510071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:58:01.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:01.324+0000 7f752c58f640 1 --2- 172.21.15.71:0/3194886947 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f751006ecc0 0x7f7510071170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7514000c00 tx=0x7f7514009da0 comp rx=0 tx=0).stop 2024-09-10T09:58:01.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:01.324+0000 7f752c58f640 1 -- 172.21.15.71:0/3194886947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75240fdba0 msgr2=0x7f752410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:58:01.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:01.324+0000 7f752c58f640 1 --2- 172.21.15.71:0/3194886947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75240fdba0 0x7f752410d0e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7520002a50 tx=0x7f7520004600 comp rx=0 tx=0).stop 2024-09-10T09:58:01.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:01.324+0000 7f752c58f640 1 -- 172.21.15.71:0/3194886947 shutdown_connections 2024-09-10T09:58:01.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:01.324+0000 7f752c58f640 1 --2- 172.21.15.71:0/3194886947 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f751006ecc0 0x7f7510071170 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:01.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:01.324+0000 7f752c58f640 1 --2- 172.21.15.71:0/3194886947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75240fe4f0 0x7f752410d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:01.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:01.324+0000 7f752c58f640 1 --2- 172.21.15.71:0/3194886947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75240fdba0 0x7f752410d0e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:01.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:01.324+0000 7f752c58f640 1 -- 172.21.15.71:0/3194886947 >> 172.21.15.71:0/3194886947 conn(0x7f75240f63a0 msgr2=0x7f75240f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:58:01.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:01.324+0000 7f752c58f640 1 -- 172.21.15.71:0/3194886947 shutdown_connections 2024-09-10T09:58:01.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:01.324+0000 7f752c58f640 1 -- 172.21.15.71:0/3194886947 wait complete. 2024-09-10T09:58:01.640 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:01 smithi071 ceph-mon[27559]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:58:01.640 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:01 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:01.640 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:01 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:01.640 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:01 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:01.640 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:01 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:01.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:01 smithi107 ceph-mon[34215]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:58:01.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:01 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:01.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:01 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:01.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:01 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:01.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:01 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:01.964 DEBUG:teuthology.orchestra.run.smithi071:osd.0> sudo journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T09:58:01.966 INFO:tasks.cephadm:Deploying osd.1 on smithi071 with /dev/vg_nvme/lv_3... 2024-09-10T09:58:01.966 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T09:58:02.343 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T09:58:02.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:02 smithi107 ceph-mon[34215]: from='osd.0 [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T09:58:02.677 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:02 smithi071 ceph-mon[27559]: from='osd.0 [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T09:58:03.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:03 smithi107 ceph-mon[34215]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:58:03.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:03 smithi107 ceph-mon[34215]: from='osd.0 [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T09:58:03.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:03 smithi107 ceph-mon[34215]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T09:58:03.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:58:03.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:03 smithi107 ceph-mon[34215]: from='osd.0 [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-10T09:58:03.672 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:03 smithi071 ceph-mon[27559]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:58:03.673 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:03 smithi071 ceph-mon[27559]: from='osd.0 [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T09:58:03.673 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:03 smithi071 ceph-mon[27559]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T09:58:03.673 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:58:03.673 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:03 smithi071 ceph-mon[27559]: from='osd.0 [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-10T09:58:03.673 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 09:58:03 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0[46558]: 2024-09-10T09:58:03.366+0000 7f72334bb640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T09:58:03.673 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 09:58:03 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0[46558]: 2024-09-10T09:58:03.369+0000 7f722e2d0640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:58:04.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:04 smithi071 ceph-mon[27559]: from='osd.0 [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T09:58:04.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:04 smithi071 ceph-mon[27559]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T09:58:04.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:04 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:58:04.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:04 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:58:04.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:04 smithi107 ceph-mon[34215]: from='osd.0 [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T09:58:04.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:04 smithi107 ceph-mon[34215]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T09:58:04.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:04 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:58:04.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:04 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:58:05.512 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:05 smithi071 ceph-mon[27559]: purged_snaps scrub starts 2024-09-10T09:58:05.512 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:05 smithi071 ceph-mon[27559]: purged_snaps scrub ok 2024-09-10T09:58:05.512 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:05 smithi071 ceph-mon[27559]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:58:05.512 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:05 smithi071 ceph-mon[27559]: osd.0 [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359] boot 2024-09-10T09:58:05.512 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:05 smithi071 ceph-mon[27559]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T09:58:05.512 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:05 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:58:05.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:05 smithi107 ceph-mon[34215]: purged_snaps scrub starts 2024-09-10T09:58:05.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:05 smithi107 ceph-mon[34215]: purged_snaps scrub ok 2024-09-10T09:58:05.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:05 smithi107 ceph-mon[34215]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:58:05.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:05 smithi107 ceph-mon[34215]: osd.0 [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359] boot 2024-09-10T09:58:05.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:05 smithi107 ceph-mon[34215]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T09:58:05.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:05 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:58:05.786 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:58:05.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_3 2024-09-10T09:58:06.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:06 smithi071 ceph-mon[27559]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T09:58:06.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:06 smithi107 ceph-mon[34215]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T09:58:06.717 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T09:58:07.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:07 smithi107 ceph-mon[34215]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:07.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:07 smithi071 ceph-mon[27559]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:08.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.907+0000 7f5b99164640 1 -- 172.21.15.71:0/1660000381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b940fc570 msgr2=0x7f5b940fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:58:08.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.907+0000 7f5b99164640 1 --2- 172.21.15.71:0/1660000381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b940fc570 0x7f5b940fc980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b840048d0 tx=0x7f5b84009da0 comp rx=0 tx=0).stop 2024-09-10T09:58:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.907+0000 7f5b99164640 1 -- 172.21.15.71:0/1660000381 shutdown_connections 2024-09-10T09:58:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.907+0000 7f5b99164640 1 --2- 172.21.15.71:0/1660000381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b940fd840 0x7f5b940fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.907+0000 7f5b99164640 1 --2- 172.21.15.71:0/1660000381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b940fc570 0x7f5b940fc980 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.907+0000 7f5b99164640 1 -- 172.21.15.71:0/1660000381 >> 172.21.15.71:0/1660000381 conn(0x7f5b940f7d30 msgr2=0x7f5b940fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:58:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.907+0000 7f5b99164640 1 -- 172.21.15.71:0/1660000381 shutdown_connections 2024-09-10T09:58:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.907+0000 7f5b99164640 1 -- 172.21.15.71:0/1660000381 wait complete. 2024-09-10T09:58:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b99164640 1 Processor -- start 2024-09-10T09:58:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b99164640 1 -- start start 2024-09-10T09:58:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b99164640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b940fc570 0x7f5b9410d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:58:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b99164640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b940fd840 0x7f5b9410d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:58:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b99164640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9410dc60 con 0x7f5b940fc570 2024-09-10T09:58:08.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b99164640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9410e430 con 0x7f5b940fd840 2024-09-10T09:58:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b92d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b940fc570 0x7f5b9410d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:58:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b92d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b940fc570 0x7f5b9410d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44790/0 (socket says 172.21.15.71:44790) 2024-09-10T09:58:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b92d9d640 1 -- 172.21.15.71:0/3345302903 learned_addr learned my addr 172.21.15.71:0/3345302903 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:58:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b9259c640 1 --2- 172.21.15.71:0/3345302903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b940fd840 0x7f5b9410d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:58:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b92d9d640 1 -- 172.21.15.71:0/3345302903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b940fd840 msgr2=0x7f5b9410d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:58:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b92d9d640 1 --2- 172.21.15.71:0/3345302903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b940fd840 0x7f5b9410d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b92d9d640 1 -- 172.21.15.71:0/3345302903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b84005040 con 0x7f5b940fc570 2024-09-10T09:58:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.908+0000 7f5b92d9d640 1 --2- 172.21.15.71:0/3345302903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b940fc570 0x7f5b9410d0d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5b84003080 tx=0x7f5b84009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:58:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.909+0000 7f5b8b7fe640 1 -- 172.21.15.71:0/3345302903 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b84038070 con 0x7f5b940fc570 2024-09-10T09:58:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.909+0000 7f5b8b7fe640 1 -- 172.21.15.71:0/3345302903 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5b8402abd0 con 0x7f5b940fc570 2024-09-10T09:58:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.909+0000 7f5b99164640 1 -- 172.21.15.71:0/3345302903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9410e660 con 0x7f5b940fc570 2024-09-10T09:58:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.909+0000 7f5b8b7fe640 1 -- 172.21.15.71:0/3345302903 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b8403e670 con 0x7f5b940fc570 2024-09-10T09:58:08.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.909+0000 7f5b99164640 1 -- 172.21.15.71:0/3345302903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9410ec00 con 0x7f5b940fc570 2024-09-10T09:58:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.910+0000 7f5b99164640 1 -- 172.21.15.71:0/3345302903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b940fb9d0 con 0x7f5b940fc570 2024-09-10T09:58:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.910+0000 7f5b8b7fe640 1 -- 172.21.15.71:0/3345302903 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f5b84030020 con 0x7f5b940fc570 2024-09-10T09:58:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.911+0000 7f5b8b7fe640 1 --2- 172.21.15.71:0/3345302903 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f5b8006ecc0 0x7f5b80071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:58:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.911+0000 7f5b8b7fe640 1 -- 172.21.15.71:0/3345302903 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f5b840ad6d0 con 0x7f5b940fc570 2024-09-10T09:58:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.911+0000 7f5b9259c640 1 --2- 172.21.15.71:0/3345302903 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f5b8006ecc0 0x7f5b80071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:58:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.911+0000 7f5b9259c640 1 --2- 172.21.15.71:0/3345302903 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f5b8006ecc0 0x7f5b80071170 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5b9410ce80 tx=0x7f5b7c009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:58:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:08.915+0000 7f5b8b7fe640 1 -- 172.21.15.71:0/3345302903 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5b8407b670 con 0x7f5b940fc570 2024-09-10T09:58:09.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:09.097+0000 7f5b99164640 1 -- 172.21.15.71:0/3345302903 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b9410ef30 con 0x7f5b8006ecc0 2024-09-10T09:58:09.383 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:09 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:09.383 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:09 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:09.383 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:09 smithi071 ceph-mon[27559]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:09.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:09 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:09.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:09 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:09.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:09 smithi107 ceph-mon[34215]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:10.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:10 smithi071 ceph-mon[27559]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:58:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:10 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:58:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:10 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:58:10.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:10 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:10.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:10 smithi107 ceph-mon[34215]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:58:10.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:10 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:58:10.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:10 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:58:10.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:10 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:11.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:11 smithi107 ceph-mon[34215]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:11.412 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:11 smithi071 ceph-mon[27559]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:13.454 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: Detected new or changed devices on smithi071 2024-09-10T09:58:13.454 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:13.454 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:13.454 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:58:13.454 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: Adjusting osd_memory_target on smithi071 to 12864M 2024-09-10T09:58:13.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:13.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:13.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:58:13.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:13.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:58:13.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:13.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/636904367' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7cd2886d-ba4f-41a7-9d27-653496a4f060"}]: dispatch 2024-09-10T09:58:13.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/636904367' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7cd2886d-ba4f-41a7-9d27-653496a4f060"}]': finished 2024-09-10T09:58:13.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T09:58:13.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:13 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:58:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: Detected new or changed devices on smithi071 2024-09-10T09:58:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:58:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: Adjusting osd_memory_target on smithi071 to 12864M 2024-09-10T09:58:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:58:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:58:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:13.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/636904367' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7cd2886d-ba4f-41a7-9d27-653496a4f060"}]: dispatch 2024-09-10T09:58:13.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/636904367' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7cd2886d-ba4f-41a7-9d27-653496a4f060"}]': finished 2024-09-10T09:58:13.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T09:58:13.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:13 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:58:14.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:14 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/928477081' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:58:14.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:14 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/928477081' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:58:15.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:15 smithi071 ceph-mon[27559]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:15.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:15 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:58:15.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:15 smithi107 ceph-mon[34215]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:15.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:15 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:58:17.696 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:17 smithi071 ceph-mon[27559]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:17.697 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:17 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:17.697 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:17 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:17.697 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:17 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:17.697 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:17 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:58:17.697 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:17 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:17 smithi107 ceph-mon[34215]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:17 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:17 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:17.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:17 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:17.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:17 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:58:17.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:17 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:19.637 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:19 smithi071 ceph-mon[27559]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:19.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:19 smithi107 ceph-mon[34215]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:20.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:20 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T09:58:20.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:20 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:20.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:20 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T09:58:20.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:20 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:21.740 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:21 smithi071 ceph-mon[27559]: Deploying daemon osd.1 on smithi071 2024-09-10T09:58:21.740 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:21 smithi071 ceph-mon[27559]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:21.796 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:21 smithi107 ceph-mon[34215]: Deploying daemon osd.1 on smithi071 2024-09-10T09:58:21.797 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:21 smithi107 ceph-mon[34215]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:23.720 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:23 smithi071 ceph-mon[27559]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:23.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:23 smithi107 ceph-mon[34215]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:25.739 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:25 smithi071 ceph-mon[27559]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:25.739 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:25 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:58:25.739 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:25 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:25.739 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:25 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:25.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:25 smithi107 ceph-mon[34215]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:25.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:25 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:58:25.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:25 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:25.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:25 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:27.780 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:27 smithi071 ceph-mon[27559]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:27.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:27 smithi107 ceph-mon[34215]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:28.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:28.807+0000 7f5b8b7fe640 1 -- 172.21.15.71:0/3345302903 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5b9410ef30 con 0x7f5b8006ecc0 2024-09-10T09:58:28.809 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 1 on host 'smithi071' 2024-09-10T09:58:28.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:28.809+0000 7f5b99164640 1 -- 172.21.15.71:0/3345302903 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f5b8006ecc0 msgr2=0x7f5b80071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:58:28.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:28.809+0000 7f5b99164640 1 --2- 172.21.15.71:0/3345302903 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f5b8006ecc0 0x7f5b80071170 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5b9410ce80 tx=0x7f5b7c009040 comp rx=0 tx=0).stop 2024-09-10T09:58:28.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:28.809+0000 7f5b99164640 1 -- 172.21.15.71:0/3345302903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b940fc570 msgr2=0x7f5b9410d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:58:28.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:28.809+0000 7f5b99164640 1 --2- 172.21.15.71:0/3345302903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b940fc570 0x7f5b9410d0d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5b84003080 tx=0x7f5b84009da0 comp rx=0 tx=0).stop 2024-09-10T09:58:28.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:28.809+0000 7f5b99164640 1 -- 172.21.15.71:0/3345302903 shutdown_connections 2024-09-10T09:58:28.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:28.809+0000 7f5b99164640 1 --2- 172.21.15.71:0/3345302903 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f5b8006ecc0 0x7f5b80071170 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:28.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:28.809+0000 7f5b99164640 1 --2- 172.21.15.71:0/3345302903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b940fd840 0x7f5b9410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:28.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:28.809+0000 7f5b99164640 1 --2- 172.21.15.71:0/3345302903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b940fc570 0x7f5b9410d0d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:28.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:28.809+0000 7f5b99164640 1 -- 172.21.15.71:0/3345302903 >> 172.21.15.71:0/3345302903 conn(0x7f5b940f7d30 msgr2=0x7f5b940f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:58:28.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:28.809+0000 7f5b99164640 1 -- 172.21.15.71:0/3345302903 shutdown_connections 2024-09-10T09:58:28.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:28.809+0000 7f5b99164640 1 -- 172.21.15.71:0/3345302903 wait complete. 2024-09-10T09:58:29.498 DEBUG:teuthology.orchestra.run.smithi071:osd.1> sudo journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T09:58:29.501 INFO:tasks.cephadm:Deploying osd.2 on smithi071 with /dev/vg_nvme/lv_2... 2024-09-10T09:58:29.501 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T09:58:29.873 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T09:58:30.087 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:29 smithi071 ceph-mon[27559]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:30.087 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:30.087 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:30.087 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:29 smithi071 ceph-mon[27559]: from='osd.1 [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T09:58:30.087 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:58:30.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:29 smithi107 ceph-mon[34215]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:30.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:30.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:30.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:29 smithi107 ceph-mon[34215]: from='osd.1 [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T09:58:30.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:58:31.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:30 smithi107 ceph-mon[34215]: from='osd.1 [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T09:58:31.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:30 smithi107 ceph-mon[34215]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T09:58:31.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:30 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:58:31.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:30 smithi107 ceph-mon[34215]: from='osd.1 [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-10T09:58:31.285 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:30 smithi071 ceph-mon[27559]: from='osd.1 [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T09:58:31.285 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:30 smithi071 ceph-mon[27559]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T09:58:31.285 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:30 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:58:31.285 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:30 smithi071 ceph-mon[27559]: from='osd.1 [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-10T09:58:31.286 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 09:58:30 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1[53919]: 2024-09-10T09:58:30.818+0000 7ffbeece4640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T09:58:31.286 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 09:58:30 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1[53919]: 2024-09-10T09:58:30.822+0000 7ffbeb31e640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:58:31.973 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:31 smithi071 ceph-mon[27559]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:31.973 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:31 smithi071 ceph-mon[27559]: from='osd.1 [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T09:58:31.973 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:31 smithi071 ceph-mon[27559]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T09:58:31.973 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:31 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:58:31.973 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:31 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:58:32.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:31 smithi107 ceph-mon[34215]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:58:32.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:31 smithi107 ceph-mon[34215]: from='osd.1 [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T09:58:32.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:31 smithi107 ceph-mon[34215]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T09:58:32.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:31 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:58:32.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:31 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:58:33.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:32 smithi071 ceph-mon[27559]: purged_snaps scrub starts 2024-09-10T09:58:33.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:32 smithi071 ceph-mon[27559]: purged_snaps scrub ok 2024-09-10T09:58:33.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:32 smithi071 ceph-mon[27559]: osd.1 [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787] boot 2024-09-10T09:58:33.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:32 smithi071 ceph-mon[27559]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T09:58:33.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:32 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:58:33.084 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:32 smithi107 ceph-mon[34215]: purged_snaps scrub starts 2024-09-10T09:58:33.085 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:32 smithi107 ceph-mon[34215]: purged_snaps scrub ok 2024-09-10T09:58:33.085 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:32 smithi107 ceph-mon[34215]: osd.1 [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787] boot 2024-09-10T09:58:33.085 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:32 smithi107 ceph-mon[34215]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T09:58:33.085 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:32 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:58:33.957 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:33 smithi071 ceph-mon[27559]: pgmap v56: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:33.957 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:33 smithi071 ceph-mon[27559]: osdmap e15: 2 total, 2 up, 2 in 2024-09-10T09:58:33.957 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:33 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:33.957 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:33 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:34.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:33 smithi107 ceph-mon[34215]: pgmap v56: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:34.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:33 smithi107 ceph-mon[34215]: osdmap e15: 2 total, 2 up, 2 in 2024-09-10T09:58:34.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:33 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:34.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:33 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:34.246 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T09:58:34.265 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_2 2024-09-10T09:58:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T09:58:36.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:35 smithi107 ceph-mon[34215]: pgmap v58: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:36.205 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:35 smithi071 ceph-mon[27559]: pgmap v58: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:37.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.464+0000 7fa6326f2640 1 -- 172.21.15.71:0/2032424020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa62c0fb430 msgr2=0x7fa62c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:58:37.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.464+0000 7fa6326f2640 1 --2- 172.21.15.71:0/2032424020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa62c0fb430 0x7fa62c0fb840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0048d0 tx=0x7fa61c009da0 comp rx=0 tx=0).stop 2024-09-10T09:58:37.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.464+0000 7fa6326f2640 1 -- 172.21.15.71:0/2032424020 shutdown_connections 2024-09-10T09:58:37.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.464+0000 7fa6326f2640 1 --2- 172.21.15.71:0/2032424020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa62c0fc700 0x7fa62c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:37.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.464+0000 7fa6326f2640 1 --2- 172.21.15.71:0/2032424020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa62c0fb430 0x7fa62c0fb840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:37.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.464+0000 7fa6326f2640 1 -- 172.21.15.71:0/2032424020 >> 172.21.15.71:0/2032424020 conn(0x7fa62c0f6c10 msgr2=0x7fa62c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:58:37.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.464+0000 7fa6326f2640 1 -- 172.21.15.71:0/2032424020 shutdown_connections 2024-09-10T09:58:37.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.464+0000 7fa6326f2640 1 -- 172.21.15.71:0/2032424020 wait complete. 2024-09-10T09:58:37.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.465+0000 7fa6326f2640 1 Processor -- start 2024-09-10T09:58:37.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.465+0000 7fa6326f2640 1 -- start start 2024-09-10T09:58:37.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.465+0000 7fa6326f2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa62c0fb430 0x7fa62c0ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:58:37.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.465+0000 7fa6326f2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa62c0fc700 0x7fa62c0fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:58:37.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.465+0000 7fa6326f2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0fdfd0 con 0x7fa62c0fb430 2024-09-10T09:58:37.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa6326f2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0fe110 con 0x7fa62c0fc700 2024-09-10T09:58:37.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa62bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa62c0fb430 0x7fa62c0ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:58:37.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa62bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa62c0fb430 0x7fa62c0ff550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34178/0 (socket says 172.21.15.71:34178) 2024-09-10T09:58:37.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa62bfff640 1 -- 172.21.15.71:0/1857292533 learned_addr learned my addr 172.21.15.71:0/1857292533 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T09:58:37.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa62b7fe640 1 --2- 172.21.15.71:0/1857292533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa62c0fc700 0x7fa62c0fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:58:37.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa62bfff640 1 -- 172.21.15.71:0/1857292533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa62c0fc700 msgr2=0x7fa62c0fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:58:37.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa62bfff640 1 --2- 172.21.15.71:0/1857292533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa62c0fc700 0x7fa62c0fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:37.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa62bfff640 1 -- 172.21.15.71:0/1857292533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c005040 con 0x7fa62c0fb430 2024-09-10T09:58:37.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa62b7fe640 1 --2- 172.21.15.71:0/1857292533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa62c0fc700 0x7fa62c0fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:58:37.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa62bfff640 1 --2- 172.21.15.71:0/1857292533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa62c0fb430 0x7fa62c0ff550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa61c003080 tx=0x7fa61c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:58:37.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa628ff9640 1 -- 172.21.15.71:0/1857292533 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61c038070 con 0x7fa62c0fb430 2024-09-10T09:58:37.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa6326f2640 1 -- 172.21.15.71:0/1857292533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c0fe390 con 0x7fa62c0fb430 2024-09-10T09:58:37.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa628ff9640 1 -- 172.21.15.71:0/1857292533 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa61c02abd0 con 0x7fa62c0fb430 2024-09-10T09:58:37.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa628ff9640 1 -- 172.21.15.71:0/1857292533 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61c03e670 con 0x7fa62c0fb430 2024-09-10T09:58:37.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.466+0000 7fa6326f2640 1 -- 172.21.15.71:0/1857292533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c1150b0 con 0x7fa62c0fb430 2024-09-10T09:58:37.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.467+0000 7fa6326f2640 1 -- 172.21.15.71:0/1857292533 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c0fa890 con 0x7fa62c0fb430 2024-09-10T09:58:37.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.468+0000 7fa628ff9640 1 -- 172.21.15.71:0/1857292533 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7fa61c030020 con 0x7fa62c0fb430 2024-09-10T09:58:37.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.469+0000 7fa628ff9640 1 --2- 172.21.15.71:0/1857292533 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa61406ecc0 0x7fa614071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:58:37.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.469+0000 7fa62b7fe640 1 --2- 172.21.15.71:0/1857292533 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa61406ecc0 0x7fa614071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:58:37.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.469+0000 7fa628ff9640 1 -- 172.21.15.71:0/1857292533 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7fa61c0ad820 con 0x7fa62c0fb430 2024-09-10T09:58:37.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.469+0000 7fa62b7fe640 1 --2- 172.21.15.71:0/1857292533 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa61406ecc0 0x7fa614071170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa6200041d0 tx=0x7fa620009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:58:37.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.475+0000 7fa628ff9640 1 -- 172.21.15.71:0/1857292533 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa61c07b630 con 0x7fa62c0fb430 2024-09-10T09:58:37.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:37.672+0000 7fa6326f2640 1 -- 172.21.15.71:0/1857292533 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa62c103fb0 con 0x7fa61406ecc0 2024-09-10T09:58:38.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:37 smithi107 ceph-mon[34215]: pgmap v59: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:38.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:37 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:58:38.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:37 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:58:38.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:37 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:38.197 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:37 smithi071 ceph-mon[27559]: pgmap v59: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:38.197 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:37 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:58:38.197 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:37 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:58:38.197 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:37 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:39.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:38 smithi071 ceph-mon[27559]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:58:39.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:38 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:39.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:38 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:39.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:38 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:58:39.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:38 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:58:39.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:38 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:39.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:38 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:39.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:38 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:58:39.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:38 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:39.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:38 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:58:39.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:38 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:39.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:38 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:58:39.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:38 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:39.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:38 smithi107 ceph-mon[34215]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:58:39.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:38 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:39.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:38 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:39.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:38 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:58:39.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:38 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:58:39.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:38 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:39.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:38 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:39.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:38 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:58:39.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:38 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:39.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:38 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:58:39.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:38 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:39.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:38 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:58:39.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:38 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:40.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:39 smithi071 ceph-mon[27559]: Detected new or changed devices on smithi071 2024-09-10T09:58:40.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:39 smithi071 ceph-mon[27559]: Adjusting osd_memory_target on smithi071 to 6432M 2024-09-10T09:58:40.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:39 smithi071 ceph-mon[27559]: pgmap v60: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:40.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:39 smithi107 ceph-mon[34215]: Detected new or changed devices on smithi071 2024-09-10T09:58:40.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:39 smithi107 ceph-mon[34215]: Adjusting osd_memory_target on smithi071 to 6432M 2024-09-10T09:58:40.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:39 smithi107 ceph-mon[34215]: pgmap v60: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:40.908 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:40 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/4236649957' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c63bb54-035a-4c71-9544-8935c2c9ddfa"}]: dispatch 2024-09-10T09:58:40.908 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:40 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/4236649957' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c63bb54-035a-4c71-9544-8935c2c9ddfa"}]': finished 2024-09-10T09:58:40.908 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:40 smithi071 ceph-mon[27559]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T09:58:40.909 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:40 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:58:41.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:40 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/4236649957' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c63bb54-035a-4c71-9544-8935c2c9ddfa"}]: dispatch 2024-09-10T09:58:41.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:40 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/4236649957' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c63bb54-035a-4c71-9544-8935c2c9ddfa"}]': finished 2024-09-10T09:58:41.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:40 smithi107 ceph-mon[34215]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T09:58:41.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:40 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:58:42.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:41 smithi107 ceph-mon[34215]: pgmap v61: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:42.148 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:41 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/899449768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:58:42.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:41 smithi071 ceph-mon[27559]: pgmap v61: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:42.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:41 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/899449768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:58:44.131 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:43 smithi071 ceph-mon[27559]: pgmap v63: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:44.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:43 smithi107 ceph-mon[34215]: pgmap v63: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:45.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:44 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:58:45.239 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:58:46.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:45 smithi107 ceph-mon[34215]: pgmap v64: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:46.158 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:45 smithi071 ceph-mon[27559]: pgmap v64: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:47.975 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:47 smithi071 ceph-mon[27559]: pgmap v65: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:47.975 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:47 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T09:58:47.975 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:47 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:48.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:47 smithi107 ceph-mon[34215]: pgmap v65: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:48.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:47 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T09:58:48.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:47 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:58:49.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:48 smithi107 ceph-mon[34215]: Deploying daemon osd.2 on smithi071 2024-09-10T09:58:49.175 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:48 smithi071 ceph-mon[27559]: Deploying daemon osd.2 on smithi071 2024-09-10T09:58:50.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:49 smithi107 ceph-mon[34215]: pgmap v66: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:50.267 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:49 smithi071 ceph-mon[27559]: pgmap v66: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:51.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:51 smithi107 ceph-mon[34215]: pgmap v67: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:52.119 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:51 smithi071 ceph-mon[27559]: pgmap v67: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:53.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:52 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:58:53.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:52 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:53.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:52 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:53.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:52 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:58:53.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:52 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:53.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:52 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:54.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:53 smithi107 ceph-mon[34215]: pgmap v68: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:54.219 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:53 smithi071 ceph-mon[27559]: pgmap v68: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:56.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:55 smithi107 ceph-mon[34215]: pgmap v69: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:56.169 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:55 smithi071 ceph-mon[27559]: pgmap v69: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:56.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:56.202+0000 7fa628ff9640 1 -- 172.21.15.71:0/1857292533 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa62c103fb0 con 0x7fa61406ecc0 2024-09-10T09:58:56.203 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 2 on host 'smithi071' 2024-09-10T09:58:56.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:56.204+0000 7fa6326f2640 1 -- 172.21.15.71:0/1857292533 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa61406ecc0 msgr2=0x7fa614071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:58:56.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:56.204+0000 7fa6326f2640 1 --2- 172.21.15.71:0/1857292533 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa61406ecc0 0x7fa614071170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa6200041d0 tx=0x7fa620009040 comp rx=0 tx=0).stop 2024-09-10T09:58:56.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:56.204+0000 7fa6326f2640 1 -- 172.21.15.71:0/1857292533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa62c0fb430 msgr2=0x7fa62c0ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:58:56.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:56.204+0000 7fa6326f2640 1 --2- 172.21.15.71:0/1857292533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa62c0fb430 0x7fa62c0ff550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa61c003080 tx=0x7fa61c009da0 comp rx=0 tx=0).stop 2024-09-10T09:58:56.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:56.204+0000 7fa6326f2640 1 -- 172.21.15.71:0/1857292533 shutdown_connections 2024-09-10T09:58:56.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:56.204+0000 7fa6326f2640 1 --2- 172.21.15.71:0/1857292533 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa61406ecc0 0x7fa614071170 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:56.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:56.204+0000 7fa6326f2640 1 --2- 172.21.15.71:0/1857292533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa62c0fc700 0x7fa62c0fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:56.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:56.204+0000 7fa6326f2640 1 --2- 172.21.15.71:0/1857292533 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa62c0fb430 0x7fa62c0ff550 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:58:56.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:56.204+0000 7fa6326f2640 1 -- 172.21.15.71:0/1857292533 >> 172.21.15.71:0/1857292533 conn(0x7fa62c0f6c10 msgr2=0x7fa62c0655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:58:56.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:56.204+0000 7fa6326f2640 1 -- 172.21.15.71:0/1857292533 shutdown_connections 2024-09-10T09:58:56.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T09:58:56.204+0000 7fa6326f2640 1 -- 172.21.15.71:0/1857292533 wait complete. 2024-09-10T09:58:57.486 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:57 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:57.486 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:57 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:57.486 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:57 smithi071 ceph-mon[27559]: from='osd.2 [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T09:58:57.487 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:57 smithi071 ceph-mon[27559]: pgmap v70: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:57.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:57 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:57.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:57 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:57.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:57 smithi107 ceph-mon[34215]: from='osd.2 [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T09:58:57.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:57 smithi107 ceph-mon[34215]: pgmap v70: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:57.762 DEBUG:teuthology.orchestra.run.smithi071:osd.2> sudo journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T09:58:57.764 INFO:tasks.cephadm:Deploying osd.3 on smithi107 with /dev/vg_nvme/lv_4... 2024-09-10T09:58:57.765 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T09:58:58.015 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi107/config 2024-09-10T09:58:58.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:58 smithi107 ceph-mon[34215]: from='osd.2 [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T09:58:58.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:58 smithi107 ceph-mon[34215]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T09:58:58.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:58:58.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:58 smithi107 ceph-mon[34215]: from='osd.2 [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-10T09:58:58.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:58 smithi071 ceph-mon[27559]: from='osd.2 [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T09:58:58.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:58 smithi071 ceph-mon[27559]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T09:58:58.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:58:58.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:58 smithi071 ceph-mon[27559]: from='osd.2 [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-10T09:58:58.539 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 09:58:58 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2[60890]: 2024-09-10T09:58:58.213+0000 7f0abdb3d640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T09:58:58.539 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 09:58:58 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2[60890]: 2024-09-10T09:58:58.217+0000 7f0ab6970640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:58:59.280 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:59 smithi107 ceph-mon[34215]: from='osd.2 [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T09:58:59.280 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:59 smithi107 ceph-mon[34215]: osdmap e18: 3 total, 2 up, 3 in 2024-09-10T09:58:59.280 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:59 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:58:59.280 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:59 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:58:59.281 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:59 smithi107 ceph-mon[34215]: pgmap v73: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:59.281 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:59 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:59.281 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:59 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:59.281 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:58:59 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:58:59.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:59 smithi071 ceph-mon[27559]: from='osd.2 [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-10T09:58:59.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:59 smithi071 ceph-mon[27559]: osdmap e18: 3 total, 2 up, 3 in 2024-09-10T09:58:59.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:59 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:58:59.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:59 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:58:59.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:59 smithi071 ceph-mon[27559]: pgmap v73: 0 pgs: ; 0 B data, 585 MiB used, 178 GiB / 179 GiB avail 2024-09-10T09:58:59.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:59 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:59.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:59 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:58:59.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:58:59 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:59:00.261 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:59:00.281 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_4 2024-09-10T09:59:00.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:00 smithi107 ceph-mon[34215]: purged_snaps scrub starts 2024-09-10T09:59:00.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:00 smithi107 ceph-mon[34215]: purged_snaps scrub ok 2024-09-10T09:59:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:00 smithi107 ceph-mon[34215]: osd.2 [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444] boot 2024-09-10T09:59:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:00 smithi107 ceph-mon[34215]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T09:59:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:00 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:59:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:00 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:59:00.472 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:00 smithi071 ceph-mon[27559]: purged_snaps scrub starts 2024-09-10T09:59:00.473 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:00 smithi071 ceph-mon[27559]: purged_snaps scrub ok 2024-09-10T09:59:00.473 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:00 smithi071 ceph-mon[27559]: osd.2 [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444] boot 2024-09-10T09:59:00.473 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:00 smithi071 ceph-mon[27559]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T09:59:00.473 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:00 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:59:00.473 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:00 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:59:00.532 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi107/config 2024-09-10T09:59:01.494 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:01 smithi107 ceph-mon[34215]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T09:59:01.494 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:01 smithi107 ceph-mon[34215]: pgmap v76: 0 pgs: ; 0 B data, 876 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:01.495 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:01 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-10T09:59:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:01 smithi071 ceph-mon[27559]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T09:59:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:01 smithi071 ceph-mon[27559]: pgmap v76: 0 pgs: ; 0 B data, 876 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:01 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-10T09:59:01.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.975+0000 7f359cec7640 1 -- 172.21.15.107:0/3694772484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fb450 msgr2=0x7f35980fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:59:01.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.975+0000 7f359cec7640 1 --2- 172.21.15.107:0/3694772484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fb450 0x7f35980fb860 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3590009c50 tx=0x7f3590004d10 comp rx=0 tx=0).stop 2024-09-10T09:59:01.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.975+0000 7f359cec7640 1 -- 172.21.15.107:0/3694772484 shutdown_connections 2024-09-10T09:59:01.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.975+0000 7f359cec7640 1 --2- 172.21.15.107:0/3694772484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fc720 0x7f35980fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:01.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.975+0000 7f359cec7640 1 --2- 172.21.15.107:0/3694772484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fb450 0x7f35980fb860 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:01.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.975+0000 7f359cec7640 1 -- 172.21.15.107:0/3694772484 >> 172.21.15.107:0/3694772484 conn(0x7f35980f6c10 msgr2=0x7f35980f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:59:01.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.975+0000 7f359cec7640 1 -- 172.21.15.107:0/3694772484 shutdown_connections 2024-09-10T09:59:01.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.975+0000 7f359cec7640 1 -- 172.21.15.107:0/3694772484 wait complete. 2024-09-10T09:59:01.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f359cec7640 1 Processor -- start 2024-09-10T09:59:01.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f359cec7640 1 -- start start 2024-09-10T09:59:01.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f359cec7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fb450 0x7f359810bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:59:01.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f359cec7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fc720 0x7f359810c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:59:01.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f359cec7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359810cb80 con 0x7f35980fc720 2024-09-10T09:59:01.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f359cec7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359810d3a0 con 0x7f35980fb450 2024-09-10T09:59:01.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f359659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fb450 0x7f359810bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:59:01.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f359659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fb450 0x7f359810bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57840/0 (socket says 172.21.15.107:57840) 2024-09-10T09:59:01.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f359659c640 1 -- 172.21.15.107:0/2025822877 learned_addr learned my addr 172.21.15.107:0/2025822877 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:59:01.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f3595d9b640 1 --2- 172.21.15.107:0/2025822877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fc720 0x7f359810c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:59:01.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f359659c640 1 -- 172.21.15.107:0/2025822877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fc720 msgr2=0x7f359810c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:59:01.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f359659c640 1 --2- 172.21.15.107:0/2025822877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fc720 0x7f359810c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:01.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f359659c640 1 -- 172.21.15.107:0/2025822877 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35900098b0 con 0x7f35980fb450 2024-09-10T09:59:01.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f359659c640 1 --2- 172.21.15.107:0/2025822877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fb450 0x7f359810bff0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3590004750 tx=0x7f3590004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:59:01.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.976+0000 7f358effd640 1 -- 172.21.15.107:0/2025822877 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3590009710 con 0x7f35980fb450 2024-09-10T09:59:01.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.977+0000 7f359cec7640 1 -- 172.21.15.107:0/2025822877 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359810d5d0 con 0x7f35980fb450 2024-09-10T09:59:01.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.977+0000 7f358effd640 1 -- 172.21.15.107:0/2025822877 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3590032b10 con 0x7f35980fb450 2024-09-10T09:59:01.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.977+0000 7f358effd640 1 -- 172.21.15.107:0/2025822877 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f359003daa0 con 0x7f35980fb450 2024-09-10T09:59:01.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.977+0000 7f359cec7640 1 -- 172.21.15.107:0/2025822877 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359810db70 con 0x7f35980fb450 2024-09-10T09:59:01.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.978+0000 7f359cec7640 1 -- 172.21.15.107:0/2025822877 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35980fa8b0 con 0x7f35980fb450 2024-09-10T09:59:01.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.978+0000 7f358effd640 1 -- 172.21.15.107:0/2025822877 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f359002f030 con 0x7f35980fb450 2024-09-10T09:59:01.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.979+0000 7f358effd640 1 --2- 172.21.15.107:0/2025822877 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f358406ecc0 0x7f3584071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:59:01.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.979+0000 7f358effd640 1 -- 172.21.15.107:0/2025822877 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3217+0+0 (secure 0 0 0) 0x7f35900aed80 con 0x7f35980fb450 2024-09-10T09:59:01.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.979+0000 7f3595d9b640 1 --2- 172.21.15.107:0/2025822877 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f358406ecc0 0x7f3584071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:59:01.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.980+0000 7f3595d9b640 1 --2- 172.21.15.107:0/2025822877 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f358406ecc0 0x7f3584071170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f359810bda0 tx=0x7f358000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:59:01.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:01.983+0000 7f358effd640 1 -- 172.21.15.107:0/2025822877 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f359007c840 con 0x7f35980fb450 2024-09-10T09:59:02.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:02.142+0000 7f359cec7640 1 -- 172.21.15.107:0/2025822877 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f359810de40 con 0x7f358406ecc0 2024-09-10T09:59:02.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:02 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-10T09:59:02.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:02 smithi107 ceph-mon[34215]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T09:59:02.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:02 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T09:59:02.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:02 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:59:02.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:02 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:59:02.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:02 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:02.523 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:02 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-10T09:59:02.524 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:02 smithi071 ceph-mon[27559]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T09:59:02.524 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:02 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T09:59:02.524 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:02 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:59:02.524 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:02 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:59:02.524 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:02 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:03.455 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65130]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T09:59:03.455 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65130]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:59:03.455 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T09:59:03.455 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65130]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:59:03.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:59:03.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T09:59:03.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: osdmap e22: 3 total, 3 up, 3 in 2024-09-10T09:59:03.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 876 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:03.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: Detected new or changed devices on smithi071 2024-09-10T09:59:03.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:03.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:03.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:59:03.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:59:03.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:59:03.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: Adjusting osd_memory_target on smithi071 to 4288M 2024-09-10T09:59:03.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:03.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:03.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:59:03.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:03.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:59:03.457 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:03.457 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:59:03.457 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:03 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:03.551 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:59:03.551 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T09:59:03.551 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: osdmap e22: 3 total, 3 up, 3 in 2024-09-10T09:59:03.551 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 876 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:03.551 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: Detected new or changed devices on smithi071 2024-09-10T09:59:03.552 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:03.552 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:03.552 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:59:03.552 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:59:03.552 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:59:03.552 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: Adjusting osd_memory_target on smithi071 to 4288M 2024-09-10T09:59:03.552 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:03.552 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:03.552 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:59:03.552 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:03.552 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:59:03.552 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:03.552 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:59:03.553 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:03 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:03.724 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65133]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T09:59:03.724 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65133]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:59:03.724 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T09:59:03.725 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65133]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:59:03.974 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65136]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T09:59:03.974 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65136]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:59:03.974 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T09:59:03.975 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65136]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:59:04.233 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65139]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T09:59:04.233 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65139]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:59:04.233 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T09:59:04.234 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 09:59:03 smithi071 sudo[65139]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:59:04.495 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65142]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T09:59:04.495 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65142]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:59:04.495 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T09:59:04.495 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65142]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:59:04.496 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:04.496 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 ceph-mon[27559]: osdmap e23: 3 total, 3 up, 3 in 2024-09-10T09:59:04.496 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/4242489932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0ba4e43-2974-4d7e-a545-30b127c58318"}]: dispatch 2024-09-10T09:59:04.496 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 ceph-mon[27559]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0ba4e43-2974-4d7e-a545-30b127c58318"}]: dispatch 2024-09-10T09:59:04.496 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 ceph-mon[27559]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0ba4e43-2974-4d7e-a545-30b127c58318"}]': finished 2024-09-10T09:59:04.496 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 ceph-mon[27559]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T09:59:04.496 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:59:04.757 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:04 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:04.758 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:04 smithi107 ceph-mon[34215]: osdmap e23: 3 total, 3 up, 3 in 2024-09-10T09:59:04.758 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:04 smithi107 ceph-mon[34215]: from='client.? 172.21.15.107:0/4242489932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0ba4e43-2974-4d7e-a545-30b127c58318"}]: dispatch 2024-09-10T09:59:04.758 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:04 smithi107 ceph-mon[34215]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0ba4e43-2974-4d7e-a545-30b127c58318"}]: dispatch 2024-09-10T09:59:04.758 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:04 smithi107 ceph-mon[34215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0ba4e43-2974-4d7e-a545-30b127c58318"}]': finished 2024-09-10T09:59:04.758 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:04 smithi107 ceph-mon[34215]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T09:59:04.758 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:04 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:59:04.759 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65148]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T09:59:04.759 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65148]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:59:04.759 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T09:59:04.759 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65148]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:59:04.759 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65145]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T09:59:04.759 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65145]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:59:04.759 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T09:59:04.759 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65145]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:59:05.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65151]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T09:59:05.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65151]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:59:05.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:04 smithi071 sudo[65151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T09:59:05.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:05 smithi071 sudo[65151]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:59:05.260 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 sudo[37764]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T09:59:05.260 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 sudo[37764]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:59:05.260 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 sudo[37764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T09:59:05.260 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 sudo[37764]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:59:05.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:05.503+0000 7f358effd640 1 -- 172.21.15.107:0/2025822877 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f3590032c80 con 0x7f35980fb450 2024-09-10T09:59:05.568 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 sudo[37767]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T09:59:05.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 sudo[37767]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:59:05.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 sudo[37767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T09:59:05.569 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 sudo[37767]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:59:05.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:05 smithi071 ceph-mon[27559]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 876 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:05 smithi071 ceph-mon[27559]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T09:59:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:05 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/280817398' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:59:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:05 smithi071 ceph-mon[27559]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T09:59:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:05 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T09:59:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:05 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T09:59:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:05 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T09:59:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:05 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T09:59:05.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 ceph-mon[34215]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 876 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:05.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 ceph-mon[34215]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T09:59:05.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 ceph-mon[34215]: from='client.? 172.21.15.107:0/280817398' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:59:05.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 ceph-mon[34215]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T09:59:05.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T09:59:05.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T09:59:05.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T09:59:05.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:05 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T09:59:06.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:06 smithi071 ceph-mon[27559]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T09:59:06.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:06 smithi071 ceph-mon[27559]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T09:59:06.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:06 smithi071 ceph-mon[27559]: mgrmap e19: smithi071.gtqytr(active, since 2m), standbys: smithi107.qurtcs 2024-09-10T09:59:06.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:06 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:06.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:06 smithi107 ceph-mon[34215]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T09:59:06.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:06 smithi107 ceph-mon[34215]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T09:59:06.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:06 smithi107 ceph-mon[34215]: mgrmap e19: smithi071.gtqytr(active, since 2m), standbys: smithi107.qurtcs 2024-09-10T09:59:06.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:06 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:08.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:07 smithi071 ceph-mon[27559]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 877 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:08.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:07 smithi107 ceph-mon[34215]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 877 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:09.915 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:09 smithi107 ceph-mon[34215]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:10.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:09 smithi071 ceph-mon[27559]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:11.774 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:11 smithi107 ceph-mon[34215]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:12.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:11 smithi071 ceph-mon[27559]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:12.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:12 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T09:59:12.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:12 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:12.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:12 smithi107 ceph-mon[34215]: Deploying daemon osd.3 on smithi107 2024-09-10T09:59:13.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:12 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T09:59:13.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:12 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:13.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:12 smithi071 ceph-mon[27559]: Deploying daemon osd.3 on smithi107 2024-09-10T09:59:13.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:13 smithi107 ceph-mon[34215]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:14.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:13 smithi071 ceph-mon[27559]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:14.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:59:15.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:59:16.019 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:15 smithi107 ceph-mon[34215]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:16.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:15 smithi071 ceph-mon[27559]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:16.680 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:16 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:59:16.681 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:16 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:16.968 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:16 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:17.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:16 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:59:17.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:16 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:17.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:16 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:17 smithi107 ceph-mon[34215]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:18.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:17 smithi071 ceph-mon[27559]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:19.841 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:19 smithi107 ceph-mon[34215]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:20.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:19 smithi071 ceph-mon[27559]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:20.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:20.106+0000 7f358effd640 1 -- 172.21.15.107:0/2025822877 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f359810de40 con 0x7f358406ecc0 2024-09-10T09:59:20.108 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 3 on host 'smithi107' 2024-09-10T09:59:20.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:20.108+0000 7f359cec7640 1 -- 172.21.15.107:0/2025822877 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f358406ecc0 msgr2=0x7f3584071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:59:20.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:20.108+0000 7f359cec7640 1 --2- 172.21.15.107:0/2025822877 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f358406ecc0 0x7f3584071170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f359810bda0 tx=0x7f358000b040 comp rx=0 tx=0).stop 2024-09-10T09:59:20.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:20.108+0000 7f359cec7640 1 -- 172.21.15.107:0/2025822877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fb450 msgr2=0x7f359810bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:59:20.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:20.108+0000 7f359cec7640 1 --2- 172.21.15.107:0/2025822877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fb450 0x7f359810bff0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3590004750 tx=0x7f3590004d10 comp rx=0 tx=0).stop 2024-09-10T09:59:20.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:20.109+0000 7f359cec7640 1 -- 172.21.15.107:0/2025822877 shutdown_connections 2024-09-10T09:59:20.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:20.109+0000 7f359cec7640 1 --2- 172.21.15.107:0/2025822877 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f358406ecc0 0x7f3584071170 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:20.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:20.109+0000 7f359cec7640 1 --2- 172.21.15.107:0/2025822877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fc720 0x7f359810c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:20.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:20.109+0000 7f359cec7640 1 --2- 172.21.15.107:0/2025822877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fb450 0x7f359810bff0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:20.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:20.109+0000 7f359cec7640 1 -- 172.21.15.107:0/2025822877 >> 172.21.15.107:0/2025822877 conn(0x7f35980f6c10 msgr2=0x7f35980f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:59:20.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:20.109+0000 7f359cec7640 1 -- 172.21.15.107:0/2025822877 shutdown_connections 2024-09-10T09:59:20.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:20.109+0000 7f359cec7640 1 -- 172.21.15.107:0/2025822877 wait complete. 2024-09-10T09:59:20.669 DEBUG:teuthology.orchestra.run.smithi107:osd.3> sudo journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T09:59:20.671 INFO:tasks.cephadm:Deploying osd.4 on smithi107 with /dev/vg_nvme/lv_3... 2024-09-10T09:59:20.671 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T09:59:20.959 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi107/config 2024-09-10T09:59:21.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:21 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:21.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:21 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:21.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:21 smithi107 ceph-mon[34215]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:21.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:21 smithi107 ceph-mon[34215]: from='osd.3 [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T09:59:21.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:21 smithi107 ceph-mon[34215]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T09:59:21.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:21 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:21.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:21 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:21.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:21 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:21 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:21 smithi071 ceph-mon[27559]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:21 smithi071 ceph-mon[27559]: from='osd.3 [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T09:59:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:21 smithi071 ceph-mon[27559]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T09:59:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:21 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:21 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:22.387 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:22 smithi107 ceph-mon[34215]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T09:59:22.387 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:22 smithi107 ceph-mon[34215]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T09:59:22.387 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:22 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:59:22.387 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:22 smithi107 ceph-mon[34215]: from='osd.3 [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T09:59:22.387 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:22 smithi107 ceph-mon[34215]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T09:59:22.387 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 09:59:22 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[39755]: 2024-09-10T09:59:22.121+0000 7fde3df61640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T09:59:22.388 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 09:59:22 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[39755]: 2024-09-10T09:59:22.127+0000 7fde37d96640 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:59:22.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:22 smithi071 ceph-mon[27559]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T09:59:22.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:22 smithi071 ceph-mon[27559]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T09:59:22.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:22 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:59:22.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:22 smithi071 ceph-mon[27559]: from='osd.3 [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T09:59:22.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:22 smithi071 ceph-mon[27559]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T09:59:23.394 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:23 smithi107 ceph-mon[34215]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-10T09:59:23.394 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:23 smithi107 ceph-mon[34215]: osdmap e26: 4 total, 3 up, 4 in 2024-09-10T09:59:23.394 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:23 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:59:23.394 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:23 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:59:23.394 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:23 smithi107 ceph-mon[34215]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:23.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:23 smithi071 ceph-mon[27559]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-10T09:59:23.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:23 smithi071 ceph-mon[27559]: osdmap e26: 4 total, 3 up, 4 in 2024-09-10T09:59:23.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:23 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:59:23.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:23 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:59:23.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:23 smithi071 ceph-mon[27559]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 878 MiB used, 267 GiB / 268 GiB avail 2024-09-10T09:59:24.256 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:24 smithi107 ceph-mon[34215]: purged_snaps scrub starts 2024-09-10T09:59:24.256 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:24 smithi107 ceph-mon[34215]: purged_snaps scrub ok 2024-09-10T09:59:24.257 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:24 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:59:24.257 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:24 smithi107 ceph-mon[34215]: osd.3 [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623] boot 2024-09-10T09:59:24.257 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:24 smithi107 ceph-mon[34215]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T09:59:24.257 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:24 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:59:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:59:24.283 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_3 2024-09-10T09:59:24.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:24 smithi071 ceph-mon[27559]: purged_snaps scrub starts 2024-09-10T09:59:24.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:24 smithi071 ceph-mon[27559]: purged_snaps scrub ok 2024-09-10T09:59:24.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:24 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:59:24.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:24 smithi071 ceph-mon[27559]: osd.3 [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623] boot 2024-09-10T09:59:24.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:24 smithi071 ceph-mon[27559]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T09:59:24.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:24 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:59:24.818 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi107/config 2024-09-10T09:59:25.237 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:25 smithi107 ceph-mon[34215]: osdmap e28: 4 total, 4 up, 4 in 2024-09-10T09:59:25.237 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:25 smithi107 ceph-mon[34215]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:25.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:25 smithi071 ceph-mon[27559]: osdmap e28: 4 total, 4 up, 4 in 2024-09-10T09:59:25.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:25 smithi071 ceph-mon[27559]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:26.292 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:26 smithi107 ceph-mon[34215]: osdmap e29: 4 total, 4 up, 4 in 2024-09-10T09:59:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.472+0000 7f2326d78640 1 -- 172.21.15.107:0/3776531621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23200fdba0 msgr2=0x7f23200fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:59:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.472+0000 7f2326d78640 1 --2- 172.21.15.107:0/3776531621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23200fdba0 0x7f23200fdfb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f231c0048d0 tx=0x7f231c009da0 comp rx=0 tx=0).stop 2024-09-10T09:59:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.472+0000 7f2326d78640 1 -- 172.21.15.107:0/3776531621 shutdown_connections 2024-09-10T09:59:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.472+0000 7f2326d78640 1 --2- 172.21.15.107:0/3776531621 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23200fe4f0 0x7f23200fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.472+0000 7f2326d78640 1 --2- 172.21.15.107:0/3776531621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23200fdba0 0x7f23200fdfb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.472+0000 7f2326d78640 1 -- 172.21.15.107:0/3776531621 >> 172.21.15.107:0/3776531621 conn(0x7f23200f63a0 msgr2=0x7f23200f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:59:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.473+0000 7f2326d78640 1 -- 172.21.15.107:0/3776531621 shutdown_connections 2024-09-10T09:59:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.473+0000 7f2326d78640 1 -- 172.21.15.107:0/3776531621 wait complete. 2024-09-10T09:59:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.473+0000 7f2326d78640 1 Processor -- start 2024-09-10T09:59:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.473+0000 7f2326d78640 1 -- start start 2024-09-10T09:59:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.473+0000 7f2326d78640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23200fdba0 0x7f232010d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:59:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.473+0000 7f2326d78640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23200fe4f0 0x7f232010d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:59:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.473+0000 7f2326d78640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232010dc80 con 0x7f23200fdba0 2024-09-10T09:59:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.473+0000 7f2326d78640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232010e450 con 0x7f23200fe4f0 2024-09-10T09:59:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.474+0000 7f2317fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23200fe4f0 0x7f232010d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:59:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.474+0000 7f2317fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23200fe4f0 0x7f232010d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56048/0 (socket says 172.21.15.107:56048) 2024-09-10T09:59:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.474+0000 7f2317fff640 1 -- 172.21.15.107:0/4147556032 learned_addr learned my addr 172.21.15.107:0/4147556032 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:59:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.474+0000 7f2324b14640 1 --2- 172.21.15.107:0/4147556032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23200fdba0 0x7f232010d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:59:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.474+0000 7f2317fff640 1 -- 172.21.15.107:0/4147556032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23200fdba0 msgr2=0x7f232010d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:59:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.474+0000 7f2317fff640 1 --2- 172.21.15.107:0/4147556032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23200fdba0 0x7f232010d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.474+0000 7f2317fff640 1 -- 172.21.15.107:0/4147556032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c005040 con 0x7f23200fe4f0 2024-09-10T09:59:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.474+0000 7f2317fff640 1 --2- 172.21.15.107:0/4147556032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23200fe4f0 0x7f232010d630 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2310002f40 tx=0x7f231000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:59:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.474+0000 7f23157fa640 1 -- 172.21.15.107:0/4147556032 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2310007c30 con 0x7f23200fe4f0 2024-09-10T09:59:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.474+0000 7f2326d78640 1 -- 172.21.15.107:0/4147556032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232010e680 con 0x7f23200fe4f0 2024-09-10T09:59:26.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.474+0000 7f2326d78640 1 -- 172.21.15.107:0/4147556032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232010ec20 con 0x7f23200fe4f0 2024-09-10T09:59:26.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.474+0000 7f23157fa640 1 -- 172.21.15.107:0/4147556032 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f231000f040 con 0x7f23200fe4f0 2024-09-10T09:59:26.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.475+0000 7f23157fa640 1 -- 172.21.15.107:0/4147556032 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231000cb60 con 0x7f23200fe4f0 2024-09-10T09:59:26.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.475+0000 7f2326d78640 1 -- 172.21.15.107:0/4147556032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23200fa040 con 0x7f23200fe4f0 2024-09-10T09:59:26.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.476+0000 7f23157fa640 1 -- 172.21.15.107:0/4147556032 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f231000ccc0 con 0x7f23200fe4f0 2024-09-10T09:59:26.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.476+0000 7f23157fa640 1 --2- 172.21.15.107:0/4147556032 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f230806ed60 0x7f2308071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:59:26.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.477+0000 7f23157fa640 1 -- 172.21.15.107:0/4147556032 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f231008d6a0 con 0x7f23200fe4f0 2024-09-10T09:59:26.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.477+0000 7f2324b14640 1 --2- 172.21.15.107:0/4147556032 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f230806ed60 0x7f2308071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:59:26.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.477+0000 7f2324b14640 1 --2- 172.21.15.107:0/4147556032 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f230806ed60 0x7f2308071210 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f231c004540 tx=0x7f231c035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:59:26.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.481+0000 7f23157fa640 1 -- 172.21.15.107:0/4147556032 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f231005b050 con 0x7f23200fe4f0 2024-09-10T09:59:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:26 smithi071 ceph-mon[27559]: osdmap e29: 4 total, 4 up, 4 in 2024-09-10T09:59:26.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:26.646+0000 7f2326d78640 1 -- 172.21.15.107:0/4147556032 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f232010eff0 con 0x7f230806ed60 2024-09-10T09:59:27.266 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:27.266 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:59:27.266 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: Detected new or changed devices on smithi107 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: Adjusting osd_memory_target on smithi107 to 15935M 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:27.267 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:59:27.268 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:59:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:59:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:59:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: Detected new or changed devices on smithi107 2024-09-10T09:59:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:59:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: Adjusting osd_memory_target on smithi107 to 15935M 2024-09-10T09:59:27.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:27.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:27.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:59:27.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:27.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:59:27.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:27.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:59:27.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:29 smithi107 ceph-mon[34215]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T09:59:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:29 smithi107 ceph-mon[34215]: from='client.? 172.21.15.107:0/2708044554' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34a3b2a7-8678-4979-9c77-4d39ab3a4086"}]: dispatch 2024-09-10T09:59:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:29 smithi107 ceph-mon[34215]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34a3b2a7-8678-4979-9c77-4d39ab3a4086"}]: dispatch 2024-09-10T09:59:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:29 smithi107 ceph-mon[34215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34a3b2a7-8678-4979-9c77-4d39ab3a4086"}]': finished 2024-09-10T09:59:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:29 smithi107 ceph-mon[34215]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T09:59:29.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:59:29.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:59:29.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:29 smithi071 ceph-mon[27559]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T09:59:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:29 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/2708044554' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34a3b2a7-8678-4979-9c77-4d39ab3a4086"}]: dispatch 2024-09-10T09:59:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:29 smithi071 ceph-mon[27559]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34a3b2a7-8678-4979-9c77-4d39ab3a4086"}]: dispatch 2024-09-10T09:59:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:29 smithi071 ceph-mon[27559]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34a3b2a7-8678-4979-9c77-4d39ab3a4086"}]': finished 2024-09-10T09:59:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:29 smithi071 ceph-mon[27559]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T09:59:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:59:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:59:30.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:30 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/3566315157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:59:30.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:30 smithi107 ceph-mon[34215]: from='client.? 172.21.15.107:0/3566315157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:59:31.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:31 smithi107 ceph-mon[34215]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T09:59:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:31 smithi071 ceph-mon[27559]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T09:59:33.597 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:33 smithi107 ceph-mon[34215]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T09:59:33.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:33 smithi071 ceph-mon[27559]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T09:59:35.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:35 smithi071 ceph-mon[27559]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T09:59:35.844 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:35 smithi107 ceph-mon[34215]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T09:59:36.606 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:36 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T09:59:36.606 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:36 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:36.606 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:36 smithi107 ceph-mon[34215]: Deploying daemon osd.4 on smithi107 2024-09-10T09:59:36.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:36 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T09:59:36.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:36 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:36.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:36 smithi071 ceph-mon[27559]: Deploying daemon osd.4 on smithi107 2024-09-10T09:59:37.504 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:37 smithi107 ceph-mon[34215]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T09:59:37.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:37 smithi071 ceph-mon[27559]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T09:59:39.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:39 smithi107 ceph-mon[34215]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:39.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:39 smithi071 ceph-mon[27559]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:41.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:41 smithi107 ceph-mon[34215]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:41.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:59:41.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:41.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:41.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:41 smithi071 ceph-mon[27559]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:41.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:59:41.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:41.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:43.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:43 smithi071 ceph-mon[27559]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:43.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:43 smithi107 ceph-mon[34215]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:44.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:44.305+0000 7f23157fa640 1 -- 172.21.15.107:0/4147556032 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f232010eff0 con 0x7f230806ed60 2024-09-10T09:59:44.307 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 4 on host 'smithi107' 2024-09-10T09:59:44.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:44.308+0000 7f2326d78640 1 -- 172.21.15.107:0/4147556032 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f230806ed60 msgr2=0x7f2308071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:59:44.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:44.308+0000 7f2326d78640 1 --2- 172.21.15.107:0/4147556032 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f230806ed60 0x7f2308071210 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f231c004540 tx=0x7f231c035040 comp rx=0 tx=0).stop 2024-09-10T09:59:44.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:44.308+0000 7f2326d78640 1 -- 172.21.15.107:0/4147556032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23200fe4f0 msgr2=0x7f232010d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:59:44.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:44.308+0000 7f2326d78640 1 --2- 172.21.15.107:0/4147556032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23200fe4f0 0x7f232010d630 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2310002f40 tx=0x7f231000b040 comp rx=0 tx=0).stop 2024-09-10T09:59:44.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:44.308+0000 7f2326d78640 1 -- 172.21.15.107:0/4147556032 shutdown_connections 2024-09-10T09:59:44.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:44.308+0000 7f2326d78640 1 --2- 172.21.15.107:0/4147556032 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f230806ed60 0x7f2308071210 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:44.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:44.308+0000 7f2326d78640 1 --2- 172.21.15.107:0/4147556032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23200fe4f0 0x7f232010d630 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:44.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:44.308+0000 7f2326d78640 1 --2- 172.21.15.107:0/4147556032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23200fdba0 0x7f232010d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:44.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:44.308+0000 7f2326d78640 1 -- 172.21.15.107:0/4147556032 >> 172.21.15.107:0/4147556032 conn(0x7f23200f63a0 msgr2=0x7f23200f7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:59:44.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:44.308+0000 7f2326d78640 1 -- 172.21.15.107:0/4147556032 shutdown_connections 2024-09-10T09:59:44.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:44.308+0000 7f2326d78640 1 -- 172.21.15.107:0/4147556032 wait complete. 2024-09-10T09:59:44.949 DEBUG:teuthology.orchestra.run.smithi107:osd.4> sudo journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T09:59:44.951 INFO:tasks.cephadm:Deploying osd.5 on smithi107 with /dev/vg_nvme/lv_2... 2024-09-10T09:59:44.952 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T09:59:45.252 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi107/config 2024-09-10T09:59:45.637 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:45.637 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:45.638 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:45 smithi107 ceph-mon[34215]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:45.638 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:59:45.638 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:45 smithi107 ceph-mon[34215]: from='osd.4 [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T09:59:45.638 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:45 smithi107 ceph-mon[34215]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T09:59:45.638 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:45.638 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:45 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:45.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:45.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:45.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:45 smithi071 ceph-mon[27559]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:45.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:59:45.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:45 smithi071 ceph-mon[27559]: from='osd.4 [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T09:59:45.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:45 smithi071 ceph-mon[27559]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T09:59:45.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:45.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:45 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:46.600 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:46 smithi107 ceph-mon[34215]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T09:59:46.600 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:46 smithi107 ceph-mon[34215]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T09:59:46.600 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:46 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:59:46.600 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:46 smithi107 ceph-mon[34215]: from='osd.4 [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T09:59:46.601 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:46 smithi107 ceph-mon[34215]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T09:59:46.601 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 09:59:46 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[46171]: 2024-09-10T09:59:46.317+0000 7fe5a3f6a640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T09:59:46.601 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 09:59:46 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[46171]: 2024-09-10T09:59:46.323+0000 7fe59fda3640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:59:46.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:46 smithi071 ceph-mon[27559]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T09:59:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:46 smithi071 ceph-mon[27559]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T09:59:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:46 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:59:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:46 smithi071 ceph-mon[27559]: from='osd.4 [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T09:59:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:46 smithi071 ceph-mon[27559]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T09:59:47.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:47 smithi107 ceph-mon[34215]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-10T09:59:47.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:47 smithi107 ceph-mon[34215]: osdmap e32: 5 total, 4 up, 5 in 2024-09-10T09:59:47.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:47 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:59:47.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:47 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:59:47.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:47 smithi107 ceph-mon[34215]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:47.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:47 smithi071 ceph-mon[27559]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-10T09:59:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:47 smithi071 ceph-mon[27559]: osdmap e32: 5 total, 4 up, 5 in 2024-09-10T09:59:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:47 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:59:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:47 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:59:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:47 smithi071 ceph-mon[27559]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-10T09:59:48.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:48 smithi107 ceph-mon[34215]: purged_snaps scrub starts 2024-09-10T09:59:48.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:48 smithi107 ceph-mon[34215]: purged_snaps scrub ok 2024-09-10T09:59:48.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:48 smithi107 ceph-mon[34215]: osd.4 [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363] boot 2024-09-10T09:59:48.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:48 smithi107 ceph-mon[34215]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T09:59:48.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:48 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:59:48.734 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-10T09:59:48.753 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_2 2024-09-10T09:59:48.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:48 smithi071 ceph-mon[27559]: purged_snaps scrub starts 2024-09-10T09:59:48.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:48 smithi071 ceph-mon[27559]: purged_snaps scrub ok 2024-09-10T09:59:48.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:48 smithi071 ceph-mon[27559]: osd.4 [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363] boot 2024-09-10T09:59:48.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:48 smithi071 ceph-mon[27559]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T09:59:48.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:48 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:59:49.278 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi107/config 2024-09-10T09:59:49.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:49 smithi107 ceph-mon[34215]: osdmap e34: 5 total, 5 up, 5 in 2024-09-10T09:59:49.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:49 smithi107 ceph-mon[34215]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T09:59:49.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:49 smithi071 ceph-mon[27559]: osdmap e34: 5 total, 5 up, 5 in 2024-09-10T09:59:49.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:49 smithi071 ceph-mon[27559]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T09:59:51.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.445+0000 7f174d712640 1 -- 172.21.15.107:0/3270125608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17480fd820 msgr2=0x7f17480fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:59:51.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.445+0000 7f174d712640 1 --2- 172.21.15.107:0/3270125608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17480fd820 0x7f17480fdc90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f173c0048d0 tx=0x7f173c009da0 comp rx=0 tx=0).stop 2024-09-10T09:59:51.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.445+0000 7f174d712640 1 -- 172.21.15.107:0/3270125608 shutdown_connections 2024-09-10T09:59:51.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.445+0000 7f174d712640 1 --2- 172.21.15.107:0/3270125608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17480fd820 0x7f17480fdc90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:51.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.445+0000 7f174d712640 1 --2- 172.21.15.107:0/3270125608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17480fc550 0x7f17480fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:51.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.445+0000 7f174d712640 1 -- 172.21.15.107:0/3270125608 >> 172.21.15.107:0/3270125608 conn(0x7f17480f7d30 msgr2=0x7f17480fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:59:51.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.445+0000 7f174d712640 1 -- 172.21.15.107:0/3270125608 shutdown_connections 2024-09-10T09:59:51.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.445+0000 7f174d712640 1 -- 172.21.15.107:0/3270125608 wait complete. 2024-09-10T09:59:51.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f174d712640 1 Processor -- start 2024-09-10T09:59:51.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f174d712640 1 -- start start 2024-09-10T09:59:51.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f174d712640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17480fc550 0x7f174810d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:59:51.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f174d712640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17480fd820 0x7f174810d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:59:51.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f174d712640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174810e470 con 0x7f17480fc550 2024-09-10T09:59:51.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f174d712640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174810e5e0 con 0x7f17480fd820 2024-09-10T09:59:51.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f17467fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17480fd820 0x7f174810d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:59:51.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f17467fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17480fd820 0x7f174810d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58856/0 (socket says 172.21.15.107:58856) 2024-09-10T09:59:51.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f17467fc640 1 -- 172.21.15.107:0/680728900 learned_addr learned my addr 172.21.15.107:0/680728900 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T09:59:51.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f1746ffd640 1 --2- 172.21.15.107:0/680728900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17480fc550 0x7f174810d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:59:51.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f17467fc640 1 -- 172.21.15.107:0/680728900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17480fc550 msgr2=0x7f174810d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:59:51.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f17467fc640 1 --2- 172.21.15.107:0/680728900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17480fc550 0x7f174810d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:59:51.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f17467fc640 1 -- 172.21.15.107:0/680728900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c005040 con 0x7f17480fd820 2024-09-10T09:59:51.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.446+0000 7f17467fc640 1 --2- 172.21.15.107:0/680728900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17480fd820 0x7f174810d650 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f173c003080 tx=0x7f173c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:59:51.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.447+0000 7f172f7fe640 1 -- 172.21.15.107:0/680728900 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f173c038070 con 0x7f17480fd820 2024-09-10T09:59:51.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.447+0000 7f174d712640 1 -- 172.21.15.107:0/680728900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174810e860 con 0x7f17480fd820 2024-09-10T09:59:51.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.447+0000 7f172f7fe640 1 -- 172.21.15.107:0/680728900 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f173c02abd0 con 0x7f17480fd820 2024-09-10T09:59:51.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.447+0000 7f172f7fe640 1 -- 172.21.15.107:0/680728900 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f173c03e670 con 0x7f17480fd820 2024-09-10T09:59:51.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.447+0000 7f174d712640 1 -- 172.21.15.107:0/680728900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174810ed80 con 0x7f17480fd820 2024-09-10T09:59:51.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.448+0000 7f174d712640 1 -- 172.21.15.107:0/680728900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17480fb9b0 con 0x7f17480fd820 2024-09-10T09:59:51.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.448+0000 7f172f7fe640 1 -- 172.21.15.107:0/680728900 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f173c030020 con 0x7f17480fd820 2024-09-10T09:59:51.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.449+0000 7f172f7fe640 1 --2- 172.21.15.107:0/680728900 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f173006ed60 0x7f1730071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:59:51.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.449+0000 7f172f7fe640 1 -- 172.21.15.107:0/680728900 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f173c0ae0a0 con 0x7f17480fd820 2024-09-10T09:59:51.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.449+0000 7f1746ffd640 1 --2- 172.21.15.107:0/680728900 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f173006ed60 0x7f1730071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:59:51.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.449+0000 7f1746ffd640 1 --2- 172.21.15.107:0/680728900 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f173006ed60 0x7f1730071210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1738006fd0 tx=0x7f1738008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:59:51.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.453+0000 7f172f7fe640 1 -- 172.21.15.107:0/680728900 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f173c07b6b0 con 0x7f17480fd820 2024-09-10T09:59:51.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T09:59:51.621+0000 7f174d712640 1 -- 172.21.15.107:0/680728900 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1748105140 con 0x7f173006ed60 2024-09-10T09:59:51.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T09:59:51.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: Detected new or changed devices on smithi107 2024-09-10T09:59:51.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:51.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:51.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:59:51.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:59:51.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: Adjusting osd_memory_target on smithi107 to 7967M 2024-09-10T09:59:51.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:51.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:51.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:59:51.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:51.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:59:51.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:51.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:59:51.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:52.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T09:59:52.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: Detected new or changed devices on smithi107 2024-09-10T09:59:52.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:52.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:52.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:59:52.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:59:52.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: Adjusting osd_memory_target on smithi107 to 7967M 2024-09-10T09:59:52.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:52.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:52.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:59:52.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:52.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:59:52.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:52.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:59:52.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T09:59:52.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:52 smithi107 ceph-mon[34215]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:59:52.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:52 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:59:52.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:52 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:59:52.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:52 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:53.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:52 smithi071 ceph-mon[27559]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:59:53.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:52 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:59:53.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:52 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:59:53.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:52 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:59:53.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:53 smithi107 ceph-mon[34215]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T09:59:54.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:53 smithi071 ceph-mon[27559]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T09:59:54.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:54 smithi107 ceph-mon[34215]: from='client.? 172.21.15.107:0/2575606885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5985afbf-b098-4231-930e-677b1518f255"}]: dispatch 2024-09-10T09:59:54.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:54 smithi107 ceph-mon[34215]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5985afbf-b098-4231-930e-677b1518f255"}]: dispatch 2024-09-10T09:59:54.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:54 smithi107 ceph-mon[34215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5985afbf-b098-4231-930e-677b1518f255"}]': finished 2024-09-10T09:59:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:54 smithi107 ceph-mon[34215]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T09:59:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:54 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:59:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:54 smithi107 ceph-mon[34215]: from='client.? 172.21.15.107:0/2114901948' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:59:55.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:54 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/2575606885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5985afbf-b098-4231-930e-677b1518f255"}]: dispatch 2024-09-10T09:59:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:54 smithi071 ceph-mon[27559]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5985afbf-b098-4231-930e-677b1518f255"}]: dispatch 2024-09-10T09:59:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:54 smithi071 ceph-mon[27559]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5985afbf-b098-4231-930e-677b1518f255"}]': finished 2024-09-10T09:59:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:54 smithi071 ceph-mon[27559]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T09:59:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:54 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:59:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:54 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/2114901948' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:59:56.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:55 smithi107 ceph-mon[34215]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T09:59:56.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:55 smithi071 ceph-mon[27559]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T09:59:58.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:57 smithi107 ceph-mon[34215]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T09:59:58.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:57 smithi071 ceph-mon[27559]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:00.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:59 smithi107 ceph-mon[34215]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:00.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 09:59:59 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:00:00.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:59 smithi071 ceph-mon[27559]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:00.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 09:59:59 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:00:01.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:00 smithi107 ceph-mon[34215]: overall HEALTH_OK 2024-09-10T10:00:01.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:00 smithi071 ceph-mon[27559]: overall HEALTH_OK 2024-09-10T10:00:02.115 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:01 smithi107 ceph-mon[34215]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:02.115 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:01 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:00:02.115 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:01 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:00:02.115 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:01 smithi107 ceph-mon[34215]: Deploying daemon osd.5 on smithi107 2024-09-10T10:00:02.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:01 smithi071 ceph-mon[27559]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:02.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:01 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:00:02.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:01 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:00:02.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:01 smithi071 ceph-mon[27559]: Deploying daemon osd.5 on smithi107 2024-09-10T10:00:04.142 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:03 smithi107 ceph-mon[34215]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:04.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:03 smithi071 ceph-mon[27559]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:06.090 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:05 smithi071 ceph-mon[27559]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:06.091 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:05 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:00:06.091 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:05 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:06.091 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:05 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:06.113 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:05 smithi107 ceph-mon[34215]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:06.113 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:05 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:00:06.113 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:05 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:06.113 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:05 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:07.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:07 smithi107 ceph-mon[34215]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:08.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:07 smithi071 ceph-mon[27559]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:08.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:08.981+0000 7f172f7fe640 1 -- 172.21.15.107:0/680728900 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1748105140 con 0x7f173006ed60 2024-09-10T10:00:08.983 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 5 on host 'smithi107' 2024-09-10T10:00:08.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:08.983+0000 7f174d712640 1 -- 172.21.15.107:0/680728900 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f173006ed60 msgr2=0x7f1730071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:08.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:08.983+0000 7f174d712640 1 --2- 172.21.15.107:0/680728900 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f173006ed60 0x7f1730071210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1738006fd0 tx=0x7f1738008040 comp rx=0 tx=0).stop 2024-09-10T10:00:08.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:08.983+0000 7f174d712640 1 -- 172.21.15.107:0/680728900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17480fd820 msgr2=0x7f174810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:08.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:08.983+0000 7f174d712640 1 --2- 172.21.15.107:0/680728900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17480fd820 0x7f174810d650 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f173c003080 tx=0x7f173c009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:08.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:08.983+0000 7f174d712640 1 -- 172.21.15.107:0/680728900 shutdown_connections 2024-09-10T10:00:08.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:08.983+0000 7f174d712640 1 --2- 172.21.15.107:0/680728900 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f173006ed60 0x7f1730071210 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:08.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:08.983+0000 7f174d712640 1 --2- 172.21.15.107:0/680728900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17480fd820 0x7f174810d650 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:08.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:08.983+0000 7f174d712640 1 --2- 172.21.15.107:0/680728900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17480fc550 0x7f174810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:08.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:08.983+0000 7f174d712640 1 -- 172.21.15.107:0/680728900 >> 172.21.15.107:0/680728900 conn(0x7f17480f7d30 msgr2=0x7f17480f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:08.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:08.983+0000 7f174d712640 1 -- 172.21.15.107:0/680728900 shutdown_connections 2024-09-10T10:00:08.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:08.983+0000 7f174d712640 1 -- 172.21.15.107:0/680728900 wait complete. 2024-09-10T10:00:09.995 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:09 smithi107 ceph-mon[34215]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:09.996 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:09 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:09.996 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:09 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:09.996 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:09 smithi107 ceph-mon[34215]: from='osd.5 [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:00:09.996 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:09 smithi107 ceph-mon[34215]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:00:09.997 DEBUG:teuthology.orchestra.run.smithi107:osd.5> sudo journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T10:00:10.000 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-10T10:00:10.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T10:00:10.276 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:10.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:09 smithi071 ceph-mon[27559]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:10.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:09 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:10.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:09 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:10.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:09 smithi071 ceph-mon[27559]: from='osd.5 [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:00:10.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:09 smithi071 ceph-mon[27559]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:00:11.092 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:10 smithi107 ceph-mon[34215]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T10:00:11.093 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:10 smithi107 ceph-mon[34215]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T10:00:11.093 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:10 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:00:11.093 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:10 smithi107 ceph-mon[34215]: from='osd.5 [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:00:11.093 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:10 smithi107 ceph-mon[34215]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:00:11.093 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:10 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:11.093 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:10 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:11.093 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:00:10 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[52864]: 2024-09-10T10:00:10.989+0000 7f3fd3f92640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T10:00:11.093 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:00:11 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[52864]: 2024-09-10T10:00:10.997+0000 7f3fd0dcd640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:00:11.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:10 smithi071 ceph-mon[27559]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T10:00:11.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:10 smithi071 ceph-mon[27559]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T10:00:11.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:10 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:00:11.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:10 smithi071 ceph-mon[27559]: from='osd.5 [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:00:11.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:10 smithi071 ceph-mon[27559]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:00:11.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:10 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:11.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:10 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 -- 172.21.15.71:0/2401046738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc00fe760 msgr2=0x7f5cc00feb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 --2- 172.21.15.71:0/2401046738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc00fe760 0x7f5cc00feb70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0048d0 tx=0x7f5cbc009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 -- 172.21.15.71:0/2401046738 shutdown_connections 2024-09-10T10:00:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 --2- 172.21.15.71:0/2401046738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5cc00ffa30 0x7f5cc00ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 --2- 172.21.15.71:0/2401046738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc00fe760 0x7f5cc00feb70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 -- 172.21.15.71:0/2401046738 >> 172.21.15.71:0/2401046738 conn(0x7f5cc00fa060 msgr2=0x7f5cc00fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 -- 172.21.15.71:0/2401046738 shutdown_connections 2024-09-10T10:00:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 -- 172.21.15.71:0/2401046738 wait complete. 2024-09-10T10:00:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 Processor -- start 2024-09-10T10:00:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 -- start start 2024-09-10T10:00:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5cc00fe760 0x7f5cc010f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc00ffa30 0x7f5cc010f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc010fdf0 con 0x7f5cc00ffa30 2024-09-10T10:00:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.000+0000 7f5cc7312640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc0110610 con 0x7f5cc00fe760 2024-09-10T10:00:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.001+0000 7f5cc48ad640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc00ffa30 0x7f5cc010f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.001+0000 7f5cc48ad640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc00ffa30 0x7f5cc010f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59012/0 (socket says 172.21.15.71:59012) 2024-09-10T10:00:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.001+0000 7f5cc50ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5cc00fe760 0x7f5cc010f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.001+0000 7f5cc48ad640 1 -- 172.21.15.71:0/4236859631 learned_addr learned my addr 172.21.15.71:0/4236859631 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.001+0000 7f5cc48ad640 1 -- 172.21.15.71:0/4236859631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5cc00fe760 msgr2=0x7f5cc010f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.001+0000 7f5cc48ad640 1 --2- 172.21.15.71:0/4236859631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5cc00fe760 0x7f5cc010f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.001+0000 7f5cc48ad640 1 -- 172.21.15.71:0/4236859631 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc005040 con 0x7f5cc00ffa30 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.001+0000 7f5cc48ad640 1 --2- 172.21.15.71:0/4236859631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc00ffa30 0x7f5cc010f7a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0002a50 tx=0x7f5cb0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.004+0000 7f5cb5ffb640 1 -- 172.21.15.71:0/4236859631 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cb0007c30 con 0x7f5cc00ffa30 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.004+0000 7f5cb5ffb640 1 -- 172.21.15.71:0/4236859631 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5cb000f040 con 0x7f5cc00ffa30 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.005+0000 7f5cc7312640 1 -- 172.21.15.71:0/4236859631 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc01108a0 con 0x7f5cc00ffa30 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.005+0000 7f5cb5ffb640 1 -- 172.21.15.71:0/4236859631 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cb000da10 con 0x7f5cc00ffa30 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.005+0000 7f5cc7312640 1 -- 172.21.15.71:0/4236859631 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc0110e40 con 0x7f5cc00ffa30 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.006+0000 7f5cc7312640 1 -- 172.21.15.71:0/4236859631 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc00fdbc0 con 0x7f5cc00ffa30 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.006+0000 7f5cb5ffb640 1 -- 172.21.15.71:0/4236859631 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f5cb000dbb0 con 0x7f5cc00ffa30 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.006+0000 7f5cb5ffb640 1 --2- 172.21.15.71:0/4236859631 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f5cac06ed60 0x7f5cac071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.007+0000 7f5cb5ffb640 1 -- 172.21.15.71:0/4236859631 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5cb008d530 con 0x7f5cc00ffa30 2024-09-10T10:00:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.007+0000 7f5cc50ae640 1 --2- 172.21.15.71:0/4236859631 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f5cac06ed60 0x7f5cac071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.007+0000 7f5cc50ae640 1 --2- 172.21.15.71:0/4236859631 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f5cac06ed60 0x7f5cac071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00b020 tx=0x7f5cbc035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.011+0000 7f5cb5ffb640 1 -- 172.21.15.71:0/4236859631 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5cb004d2a0 con 0x7f5cc00ffa30 2024-09-10T10:00:12.026 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:12 smithi107 ceph-mon[34215]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:12.026 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:12 smithi107 ceph-mon[34215]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-10T10:00:12.026 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:12 smithi107 ceph-mon[34215]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T10:00:12.026 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:12 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:00:12.026 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:12 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:00:12.026 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:12 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:00:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.168+0000 7f5cc7312640 1 -- 172.21.15.71:0/4236859631 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f5cc0111150 con 0x7f5cc00ffa30 2024-09-10T10:00:12.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.169+0000 7f5cb5ffb640 1 -- 172.21.15.71:0/4236859631 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f5cb005ab30 con 0x7f5cc00ffa30 2024-09-10T10:00:12.170 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:00:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.170+0000 7f5cc7312640 1 -- 172.21.15.71:0/4236859631 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f5cac06ed60 msgr2=0x7f5cac071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.170+0000 7f5cc7312640 1 --2- 172.21.15.71:0/4236859631 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f5cac06ed60 0x7f5cac071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00b020 tx=0x7f5cbc035040 comp rx=0 tx=0).stop 2024-09-10T10:00:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.170+0000 7f5cc7312640 1 -- 172.21.15.71:0/4236859631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc00ffa30 msgr2=0x7f5cc010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.170+0000 7f5cc7312640 1 --2- 172.21.15.71:0/4236859631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc00ffa30 0x7f5cc010f7a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0002a50 tx=0x7f5cb0004600 comp rx=0 tx=0).stop 2024-09-10T10:00:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.171+0000 7f5cc7312640 1 -- 172.21.15.71:0/4236859631 shutdown_connections 2024-09-10T10:00:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.171+0000 7f5cc7312640 1 --2- 172.21.15.71:0/4236859631 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f5cac06ed60 0x7f5cac071210 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.171+0000 7f5cc7312640 1 --2- 172.21.15.71:0/4236859631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5cc00ffa30 0x7f5cc010f7a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.171+0000 7f5cc7312640 1 --2- 172.21.15.71:0/4236859631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5cc00fe760 0x7f5cc010f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.171+0000 7f5cc7312640 1 -- 172.21.15.71:0/4236859631 >> 172.21.15.71:0/4236859631 conn(0x7f5cc00fa060 msgr2=0x7f5cc00fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.171+0000 7f5cc7312640 1 -- 172.21.15.71:0/4236859631 shutdown_connections 2024-09-10T10:00:12.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:12.171+0000 7f5cc7312640 1 -- 172.21.15.71:0/4236859631 wait complete. 2024-09-10T10:00:12.181 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:12 smithi071 ceph-mon[27559]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:12.181 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:12 smithi071 ceph-mon[27559]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-10T10:00:12.181 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:12 smithi071 ceph-mon[27559]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T10:00:12.181 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:12 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:00:12.181 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:12 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:00:12.181 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:12 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:00:12.878 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1725962411,"num_in_osds":6,"osd_in_since":1725962393,"num_remapped_pgs":0} 2024-09-10T10:00:12.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:00:13.136 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:13.257 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:13 smithi071 ceph-mon[27559]: purged_snaps scrub starts 2024-09-10T10:00:13.257 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:13 smithi071 ceph-mon[27559]: purged_snaps scrub ok 2024-09-10T10:00:13.258 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:13 smithi071 ceph-mon[27559]: osd.5 [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792] boot 2024-09-10T10:00:13.258 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:13 smithi071 ceph-mon[27559]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T10:00:13.258 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:13 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:00:13.258 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:13 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/4236859631' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:00:13.311 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:13 smithi107 ceph-mon[34215]: purged_snaps scrub starts 2024-09-10T10:00:13.311 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:13 smithi107 ceph-mon[34215]: purged_snaps scrub ok 2024-09-10T10:00:13.311 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:13 smithi107 ceph-mon[34215]: osd.5 [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792] boot 2024-09-10T10:00:13.311 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:13 smithi107 ceph-mon[34215]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T10:00:13.311 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:13 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:00:13.311 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:13 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/4236859631' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:00:14.268 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:14.269 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T10:00:14.269 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:14.269 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:14.269 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:00:14.269 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:00:14.269 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:00:14.269 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:14.269 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:00:14.269 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:00:14.269 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:14.269 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:00:14.270 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:00:14.270 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:00:14.270 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:14.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-10T10:00:14.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T10:00:14.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:14.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:14.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:00:14.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:00:14.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:00:14.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:14.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:00:14.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:00:14.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:14.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:00:14.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:00:14.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:00:14.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:00:14.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.769+0000 7f2e3e07f640 1 -- 172.21.15.71:0/776988318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e380fd340 msgr2=0x7f2e380fd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:14.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.769+0000 7f2e3e07f640 1 --2- 172.21.15.71:0/776988318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e380fd340 0x7f2e380fd710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2e280048d0 tx=0x7f2e28009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:14.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.769+0000 7f2e3e07f640 1 -- 172.21.15.71:0/776988318 shutdown_connections 2024-09-10T10:00:14.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.769+0000 7f2e3e07f640 1 --2- 172.21.15.71:0/776988318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e380fac00 0x7f2e380fb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.769+0000 7f2e3e07f640 1 --2- 172.21.15.71:0/776988318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e380fd340 0x7f2e380fd710 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.769+0000 7f2e3e07f640 1 -- 172.21.15.71:0/776988318 >> 172.21.15.71:0/776988318 conn(0x7f2e38070c80 msgr2=0x7f2e38071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.769+0000 7f2e3e07f640 1 -- 172.21.15.71:0/776988318 shutdown_connections 2024-09-10T10:00:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.769+0000 7f2e3e07f640 1 -- 172.21.15.71:0/776988318 wait complete. 2024-09-10T10:00:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.770+0000 7f2e3e07f640 1 Processor -- start 2024-09-10T10:00:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.770+0000 7f2e3e07f640 1 -- start start 2024-09-10T10:00:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.770+0000 7f2e3e07f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e380fac00 0x7f2e381153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.770+0000 7f2e3e07f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e380fd340 0x7f2e381158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.770+0000 7f2e3e07f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e38115ef0 con 0x7f2e380fac00 2024-09-10T10:00:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.770+0000 7f2e3e07f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e38116060 con 0x7f2e380fd340 2024-09-10T10:00:14.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.770+0000 7f2e377fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e380fac00 0x7f2e381153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:14.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.770+0000 7f2e377fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e380fac00 0x7f2e381153b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54428/0 (socket says 172.21.15.71:54428) 2024-09-10T10:00:14.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.770+0000 7f2e377fe640 1 -- 172.21.15.71:0/2308393919 learned_addr learned my addr 172.21.15.71:0/2308393919 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:14.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.771+0000 7f2e36ffd640 1 --2- 172.21.15.71:0/2308393919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e380fd340 0x7f2e381158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:14.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.771+0000 7f2e377fe640 1 -- 172.21.15.71:0/2308393919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e380fd340 msgr2=0x7f2e381158f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:14.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.771+0000 7f2e377fe640 1 --2- 172.21.15.71:0/2308393919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e380fd340 0x7f2e381158f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:14.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.771+0000 7f2e377fe640 1 -- 172.21.15.71:0/2308393919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e28005040 con 0x7f2e380fac00 2024-09-10T10:00:14.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.771+0000 7f2e36ffd640 1 --2- 172.21.15.71:0/2308393919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e380fd340 0x7f2e381158f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:00:14.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.771+0000 7f2e377fe640 1 --2- 172.21.15.71:0/2308393919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e380fac00 0x7f2e381153b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2e28003080 tx=0x7f2e28009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:14.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.771+0000 7f2e1ffff640 1 -- 172.21.15.71:0/2308393919 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e28038070 con 0x7f2e380fac00 2024-09-10T10:00:14.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.771+0000 7f2e3e07f640 1 -- 172.21.15.71:0/2308393919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3810f480 con 0x7f2e380fac00 2024-09-10T10:00:14.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.771+0000 7f2e1ffff640 1 -- 172.21.15.71:0/2308393919 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2e280097e0 con 0x7f2e380fac00 2024-09-10T10:00:14.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.771+0000 7f2e1ffff640 1 -- 172.21.15.71:0/2308393919 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e2803d420 con 0x7f2e380fac00 2024-09-10T10:00:14.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.771+0000 7f2e3e07f640 1 -- 172.21.15.71:0/2308393919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3810f940 con 0x7f2e380fac00 2024-09-10T10:00:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.772+0000 7f2e3e07f640 1 -- 172.21.15.71:0/2308393919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e380fbc10 con 0x7f2e380fac00 2024-09-10T10:00:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.773+0000 7f2e1ffff640 1 -- 172.21.15.71:0/2308393919 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f2e28030020 con 0x7f2e380fac00 2024-09-10T10:00:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.773+0000 7f2e1ffff640 1 --2- 172.21.15.71:0/2308393919 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2e2006ed60 0x7f2e20071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.773+0000 7f2e1ffff640 1 -- 172.21.15.71:0/2308393919 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2e280ae470 con 0x7f2e380fac00 2024-09-10T10:00:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.773+0000 7f2e36ffd640 1 --2- 172.21.15.71:0/2308393919 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2e2006ed60 0x7f2e20071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.773+0000 7f2e36ffd640 1 --2- 172.21.15.71:0/2308393919 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2e2006ed60 0x7f2e20071210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2e38110cb0 tx=0x7f2e2c009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.777+0000 7f2e1ffff640 1 -- 172.21.15.71:0/2308393919 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2e2807b8d0 con 0x7f2e380fac00 2024-09-10T10:00:14.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.932+0000 7f2e3e07f640 1 -- 172.21.15.71:0/2308393919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e3804b750 con 0x7f2e380fac00 2024-09-10T10:00:14.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.933+0000 7f2e1ffff640 1 -- 172.21.15.71:0/2308393919 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11055 (secure 0 0 0) 0x7f2e2807b270 con 0x7f2e380fac00 2024-09-10T10:00:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:00:14.935 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":39,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","created":"2024-09-10T09:54:45.672879+0000","modified":"2024-09-10T10:00:13.000958+0000","last_up_change":"2024-09-10T10:00:11.991681+0000","last_in_change":"2024-09-10T09:59:53.813642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:59:00.614186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"99e11191-662e-49c7-876a-9a902b3b506f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":452097359},{"type":"v1","addr":"172.21.15.71:6803","nonce":452097359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":452097359},{"type":"v1","addr":"172.21.15.71:6805","nonce":452097359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":452097359},{"type":"v1","addr":"172.21.15.71:6809","nonce":452097359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":452097359},{"type":"v1","addr":"172.21.15.71:6807","nonce":452097359}]},"public_addr":"172.21.15.71:6803/452097359","cluster_addr":"172.21.15.71:6805/452097359","heartbeat_back_addr":"172.21.15.71:6809/452097359","heartbeat_front_addr":"172.21.15.71:6807/452097359","state":["exists","up"]},{"osd":1,"uuid":"7cd2886d-ba4f-41a7-9d27-653496a4f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":980842787},{"type":"v1","addr":"172.21.15.71:6811","nonce":980842787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":980842787},{"type":"v1","addr":"172.21.15.71:6813","nonce":980842787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":980842787},{"type":"v1","addr":"172.21.15.71:6817","nonce":980842787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":980842787},{"type":"v1","addr":"172.21.15.71:6815","nonce":980842787}]},"public_addr":"172.21.15.71:6811/980842787","cluster_addr":"172.21.15.71:6813/980842787","heartbeat_back_addr":"172.21.15.71:6817/980842787","heartbeat_front_addr":"172.21.15.71:6815/980842787","state":["exists","up"]},{"osd":2,"uuid":"8c63bb54-035a-4c71-9544-8935c2c9ddfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3227805444},{"type":"v1","addr":"172.21.15.71:6819","nonce":3227805444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3227805444},{"type":"v1","addr":"172.21.15.71:6821","nonce":3227805444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3227805444},{"type":"v1","addr":"172.21.15.71:6825","nonce":3227805444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3227805444},{"type":"v1","addr":"172.21.15.71:6823","nonce":3227805444}]},"public_addr":"172.21.15.71:6819/3227805444","cluster_addr":"172.21.15.71:6821/3227805444","heartbeat_back_addr":"172.21.15.71:6825/3227805444","heartbeat_front_addr":"172.21.15.71:6823/3227805444","state":["exists","up"]},{"osd":3,"uuid":"a0ba4e43-2974-4d7e-a545-30b127c58318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1012029623},{"type":"v1","addr":"172.21.15.107:6801","nonce":1012029623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1012029623},{"type":"v1","addr":"172.21.15.107:6803","nonce":1012029623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1012029623},{"type":"v1","addr":"172.21.15.107:6807","nonce":1012029623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1012029623},{"type":"v1","addr":"172.21.15.107:6805","nonce":1012029623}]},"public_addr":"172.21.15.107:6801/1012029623","cluster_addr":"172.21.15.107:6803/1012029623","heartbeat_back_addr":"172.21.15.107:6807/1012029623","heartbeat_front_addr":"172.21.15.107:6805/1012029623","state":["exists","up"]},{"osd":4,"uuid":"34a3b2a7-8678-4979-9c77-4d39ab3a4086","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":1831892363},{"type":"v1","addr":"172.21.15.107:6809","nonce":1831892363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1831892363},{"type":"v1","addr":"172.21.15.107:6811","nonce":1831892363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1831892363},{"type":"v1","addr":"172.21.15.107:6815","nonce":1831892363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1831892363},{"type":"v1","addr":"172.21.15.107:6813","nonce":1831892363}]},"public_addr":"172.21.15.107:6809/1831892363","cluster_addr":"172.21.15.107:6811/1831892363","heartbeat_back_addr":"172.21.15.107:6815/1831892363","heartbeat_front_addr":"172.21.15.107:6813/1831892363","state":["exists","up"]},{"osd":5,"uuid":"5985afbf-b098-4231-930e-677b1518f255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":421590792},{"type":"v1","addr":"172.21.15.107:6817","nonce":421590792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":421590792},{"type":"v1","addr":"172.21.15.107:6819","nonce":421590792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":421590792},{"type":"v1","addr":"172.21.15.107:6823","nonce":421590792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":421590792},{"type":"v1","addr":"172.21.15.107:6821","nonce":421590792}]},"public_addr":"172.21.15.107:6817/421590792","cluster_addr":"172.21.15.107:6819/421590792","heartbeat_back_addr":"172.21.15.107:6823/421590792","heartbeat_front_addr":"172.21.15.107:6821/421590792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:58:02.864477+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:58:30.186393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:58:57.311771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:59:21.438079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:59:45.527511+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:00:10.492658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:0/2738930401":"2024-09-11T09:56:44.302013+0000","172.21.15.71:0/2371616045":"2024-09-11T09:55:05.910028+0000","172.21.15.71:0/2038279395":"2024-09-11T09:55:42.210023+0000","172.21.15.71:0/3250999617":"2024-09-11T09:55:05.910028+0000","172.21.15.71:0/2519859872":"2024-09-11T09:55:05.910028+0000","172.21.15.71:6801/89381066":"2024-09-11T09:55:05.910028+0000","172.21.15.71:6800/89381066":"2024-09-11T09:55:05.910028+0000","172.21.15.71:6801/4098346293":"2024-09-11T09:55:42.210023+0000","172.21.15.71:0/3813664805":"2024-09-11T09:55:42.210023+0000","172.21.15.71:6800/4098346293":"2024-09-11T09:55:42.210023+0000","172.21.15.71:0/1970727630":"2024-09-11T09:55:42.210023+0000","172.21.15.71:0/1476291167":"2024-09-11T09:56:44.302013+0000","172.21.15.71:6800/404028021":"2024-09-11T09:56:44.302013+0000","172.21.15.71:0/3312099981":"2024-09-11T09:56:44.302013+0000","172.21.15.71:6801/404028021":"2024-09-11T09:56:44.302013+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:00:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.935+0000 7f2e3e07f640 1 -- 172.21.15.71:0/2308393919 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2e2006ed60 msgr2=0x7f2e20071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.935+0000 7f2e3e07f640 1 --2- 172.21.15.71:0/2308393919 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2e2006ed60 0x7f2e20071210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2e38110cb0 tx=0x7f2e2c009040 comp rx=0 tx=0).stop 2024-09-10T10:00:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.935+0000 7f2e3e07f640 1 -- 172.21.15.71:0/2308393919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e380fac00 msgr2=0x7f2e381153b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.935+0000 7f2e3e07f640 1 --2- 172.21.15.71:0/2308393919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e380fac00 0x7f2e381153b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2e28003080 tx=0x7f2e28009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.935+0000 7f2e3e07f640 1 -- 172.21.15.71:0/2308393919 shutdown_connections 2024-09-10T10:00:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.935+0000 7f2e3e07f640 1 --2- 172.21.15.71:0/2308393919 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2e2006ed60 0x7f2e20071210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.935+0000 7f2e3e07f640 1 --2- 172.21.15.71:0/2308393919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e380fd340 0x7f2e381158f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.935+0000 7f2e3e07f640 1 --2- 172.21.15.71:0/2308393919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e380fac00 0x7f2e381153b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.935+0000 7f2e3e07f640 1 -- 172.21.15.71:0/2308393919 >> 172.21.15.71:0/2308393919 conn(0x7f2e38070c80 msgr2=0x7f2e380f8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.936+0000 7f2e3e07f640 1 -- 172.21.15.71:0/2308393919 shutdown_connections 2024-09-10T10:00:14.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:14.936+0000 7f2e3e07f640 1 -- 172.21.15.71:0/2308393919 wait complete. 2024-09-10T10:00:15.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:15 smithi071 ceph-mon[27559]: Detected new or changed devices on smithi107 2024-09-10T10:00:15.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:15 smithi071 ceph-mon[27559]: Adjusting osd_memory_target on smithi107 to 5311M 2024-09-10T10:00:15.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:15 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:00:15.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:15 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/2308393919' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:00:15.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:15 smithi107 ceph-mon[34215]: Detected new or changed devices on smithi107 2024-09-10T10:00:15.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:15 smithi107 ceph-mon[34215]: Adjusting osd_memory_target on smithi107 to 5311M 2024-09-10T10:00:15.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:15 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:00:15.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:15 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/2308393919' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:00:15.730 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T09:59:00.614186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-10T10:00:15.730 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T10:00:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:16.273 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:16 smithi071 ceph-mon[27559]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:16.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:16 smithi107 ceph-mon[34215]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:17.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.793+0000 7efce1bea640 1 -- 172.21.15.71:0/1385903804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcdc0fac80 msgr2=0x7efcdc0fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:17.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.793+0000 7efce1bea640 1 --2- 172.21.15.71:0/1385903804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcdc0fac80 0x7efcdc0fb0f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efcd00048d0 tx=0x7efcd0009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:17.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.793+0000 7efce1bea640 1 -- 172.21.15.71:0/1385903804 shutdown_connections 2024-09-10T10:00:17.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.793+0000 7efce1bea640 1 --2- 172.21.15.71:0/1385903804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcdc0fac80 0x7efcdc0fb0f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:17.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.793+0000 7efce1bea640 1 --2- 172.21.15.71:0/1385903804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcdc102620 0x7efcdc1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:17.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.793+0000 7efce1bea640 1 -- 172.21.15.71:0/1385903804 >> 172.21.15.71:0/1385903804 conn(0x7efcdc070ce0 msgr2=0x7efcdc0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:17.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.794+0000 7efce1bea640 1 -- 172.21.15.71:0/1385903804 shutdown_connections 2024-09-10T10:00:17.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.794+0000 7efce1bea640 1 -- 172.21.15.71:0/1385903804 wait complete. 2024-09-10T10:00:17.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.794+0000 7efce1bea640 1 Processor -- start 2024-09-10T10:00:17.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.794+0000 7efce1bea640 1 -- start start 2024-09-10T10:00:17.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.794+0000 7efce1bea640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcdc0fac80 0x7efcdc1131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:17.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.794+0000 7efce1bea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcdc102620 0x7efcdc113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:17.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.794+0000 7efce1bea640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc113d20 con 0x7efcdc0fac80 2024-09-10T10:00:17.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.794+0000 7efce1bea640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc10d160 con 0x7efcdc102620 2024-09-10T10:00:17.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.795+0000 7efcdb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcdc0fac80 0x7efcdc1131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:17.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.795+0000 7efcdb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcdc0fac80 0x7efcdc1131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54440/0 (socket says 172.21.15.71:54440) 2024-09-10T10:00:17.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.795+0000 7efcdb7fe640 1 -- 172.21.15.71:0/1392480084 learned_addr learned my addr 172.21.15.71:0/1392480084 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:17.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.795+0000 7efcdaffd640 1 --2- 172.21.15.71:0/1392480084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcdc102620 0x7efcdc113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:17.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.795+0000 7efcdb7fe640 1 -- 172.21.15.71:0/1392480084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcdc102620 msgr2=0x7efcdc113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:17.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.795+0000 7efcdb7fe640 1 --2- 172.21.15.71:0/1392480084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcdc102620 0x7efcdc113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:17.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.795+0000 7efcdb7fe640 1 -- 172.21.15.71:0/1392480084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd0005040 con 0x7efcdc0fac80 2024-09-10T10:00:17.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.795+0000 7efcdaffd640 1 --2- 172.21.15.71:0/1392480084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcdc102620 0x7efcdc113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:00:17.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.795+0000 7efcdb7fe640 1 --2- 172.21.15.71:0/1392480084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcdc0fac80 0x7efcdc1131e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efccc00eb70 tx=0x7efccc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:17.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.796+0000 7efcc3fff640 1 -- 172.21.15.71:0/1392480084 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efccc007c30 con 0x7efcdc0fac80 2024-09-10T10:00:17.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.796+0000 7efce1bea640 1 -- 172.21.15.71:0/1392480084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc10d3e0 con 0x7efcdc0fac80 2024-09-10T10:00:17.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.796+0000 7efcc3fff640 1 -- 172.21.15.71:0/1392480084 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efccc00f040 con 0x7efcdc0fac80 2024-09-10T10:00:17.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.796+0000 7efcc3fff640 1 -- 172.21.15.71:0/1392480084 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efccc0094e0 con 0x7efcdc0fac80 2024-09-10T10:00:17.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.796+0000 7efce1bea640 1 -- 172.21.15.71:0/1392480084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc10d950 con 0x7efcdc0fac80 2024-09-10T10:00:17.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.797+0000 7efce1bea640 1 -- 172.21.15.71:0/1392480084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc8005210 con 0x7efcdc0fac80 2024-09-10T10:00:17.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.797+0000 7efcc3fff640 1 -- 172.21.15.71:0/1392480084 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7efccc00cbd0 con 0x7efcdc0fac80 2024-09-10T10:00:17.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.798+0000 7efcc3fff640 1 --2- 172.21.15.71:0/1392480084 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7efcc406ee20 0x7efcc40712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:17.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.798+0000 7efcc3fff640 1 -- 172.21.15.71:0/1392480084 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efccc08d890 con 0x7efcdc0fac80 2024-09-10T10:00:17.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.798+0000 7efcdaffd640 1 --2- 172.21.15.71:0/1392480084 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7efcc406ee20 0x7efcc40712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:17.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.798+0000 7efcdaffd640 1 --2- 172.21.15.71:0/1392480084 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7efcc406ee20 0x7efcc40712d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0f8f90 tx=0x7efcd0035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:17.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.802+0000 7efcc3fff640 1 -- 172.21.15.71:0/1392480084 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efccc05aed0 con 0x7efcdc0fac80 2024-09-10T10:00:17.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.954+0000 7efce1bea640 1 -- 172.21.15.71:0/1392480084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcc8005a40 con 0x7efcdc0fac80 2024-09-10T10:00:17.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.955+0000 7efcc3fff640 1 -- 172.21.15.71:0/1392480084 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7efccc0190a0 con 0x7efcdc0fac80 2024-09-10T10:00:17.957 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-09-10T10:00:17.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.956+0000 7efce1bea640 1 -- 172.21.15.71:0/1392480084 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7efcc406ee20 msgr2=0x7efcc40712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:17.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.956+0000 7efce1bea640 1 --2- 172.21.15.71:0/1392480084 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7efcc406ee20 0x7efcc40712d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0f8f90 tx=0x7efcd0035040 comp rx=0 tx=0).stop 2024-09-10T10:00:17.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.956+0000 7efce1bea640 1 -- 172.21.15.71:0/1392480084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcdc0fac80 msgr2=0x7efcdc1131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:17.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.956+0000 7efce1bea640 1 --2- 172.21.15.71:0/1392480084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcdc0fac80 0x7efcdc1131e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efccc00eb70 tx=0x7efccc00b040 comp rx=0 tx=0).stop 2024-09-10T10:00:17.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.956+0000 7efce1bea640 1 -- 172.21.15.71:0/1392480084 shutdown_connections 2024-09-10T10:00:17.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.956+0000 7efce1bea640 1 --2- 172.21.15.71:0/1392480084 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7efcc406ee20 0x7efcc40712d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:17.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.956+0000 7efce1bea640 1 --2- 172.21.15.71:0/1392480084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcdc102620 0x7efcdc113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:17.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.956+0000 7efce1bea640 1 --2- 172.21.15.71:0/1392480084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcdc0fac80 0x7efcdc1131e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:17.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.956+0000 7efce1bea640 1 -- 172.21.15.71:0/1392480084 >> 172.21.15.71:0/1392480084 conn(0x7efcdc070ce0 msgr2=0x7efcdc105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:17.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.957+0000 7efce1bea640 1 -- 172.21.15.71:0/1392480084 shutdown_connections 2024-09-10T10:00:17.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:17.957+0000 7efce1bea640 1 -- 172.21.15.71:0/1392480084 wait complete. 2024-09-10T10:00:18.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:18 smithi071 ceph-mon[27559]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:18.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:18 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1392480084' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:00:18.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:18 smithi107 ceph-mon[34215]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:18.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:18 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1392480084' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:00:18.745 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T10:00:18.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T10:00:18.990 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:20.278 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:20 smithi071 ceph-mon[27559]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:20.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:20 smithi107 ceph-mon[34215]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:20.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.696+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/46969489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6b4065ba0 msgr2=0x7fe6b40ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:20.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.696+0000 7fe6ba4b9640 1 --2- 172.21.15.71:0/46969489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6b4065ba0 0x7fe6b40ff1e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40048d0 tx=0x7fe6a4009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:20.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.696+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/46969489 shutdown_connections 2024-09-10T10:00:20.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.696+0000 7fe6ba4b9640 1 --2- 172.21.15.71:0/46969489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6b40ff720 0x7fe6b4101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:20.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.696+0000 7fe6ba4b9640 1 --2- 172.21.15.71:0/46969489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6b4065ba0 0x7fe6b40ff1e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:20.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.696+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/46969489 >> 172.21.15.71:0/46969489 conn(0x7fe6b40f6bf0 msgr2=0x7fe6b40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:20.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.696+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/46969489 shutdown_connections 2024-09-10T10:00:20.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.696+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/46969489 wait complete. 2024-09-10T10:00:20.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6ba4b9640 1 Processor -- start 2024-09-10T10:00:20.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6ba4b9640 1 -- start start 2024-09-10T10:00:20.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6ba4b9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6b4065ba0 0x7fe6b410d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:20.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6ba4b9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6b40ff720 0x7fe6b410d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6ba4b9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b410e4f0 con 0x7fe6b4065ba0 2024-09-10T10:00:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6ba4b9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b410e660 con 0x7fe6b40ff720 2024-09-10T10:00:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6b3fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6b4065ba0 0x7fe6b410d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6b3fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6b4065ba0 0x7fe6b410d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54466/0 (socket says 172.21.15.71:54466) 2024-09-10T10:00:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6b3fff640 1 -- 172.21.15.71:0/2087816926 learned_addr learned my addr 172.21.15.71:0/2087816926 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6abfff640 1 --2- 172.21.15.71:0/2087816926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6b40ff720 0x7fe6b410d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6b3fff640 1 -- 172.21.15.71:0/2087816926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6b40ff720 msgr2=0x7fe6b410d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6b3fff640 1 --2- 172.21.15.71:0/2087816926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6b40ff720 0x7fe6b410d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6b3fff640 1 -- 172.21.15.71:0/2087816926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a4005040 con 0x7fe6b4065ba0 2024-09-10T10:00:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.697+0000 7fe6abfff640 1 --2- 172.21.15.71:0/2087816926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6b40ff720 0x7fe6b410d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:00:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.698+0000 7fe6b3fff640 1 --2- 172.21.15.71:0/2087816926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6b4065ba0 0x7fe6b410d1e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40048a0 tx=0x7fe6a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.698+0000 7fe6b17fa640 1 -- 172.21.15.71:0/2087816926 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6a4038070 con 0x7fe6b4065ba0 2024-09-10T10:00:20.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.698+0000 7fe6b17fa640 1 -- 172.21.15.71:0/2087816926 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe6a402ae90 con 0x7fe6b4065ba0 2024-09-10T10:00:20.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.698+0000 7fe6b17fa640 1 -- 172.21.15.71:0/2087816926 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6a402c8b0 con 0x7fe6b4065ba0 2024-09-10T10:00:20.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.698+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/2087816926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b410e8e0 con 0x7fe6b4065ba0 2024-09-10T10:00:20.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.698+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/2087816926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b410eda0 con 0x7fe6b4065ba0 2024-09-10T10:00:20.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.699+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/2087816926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b41057f0 con 0x7fe6b4065ba0 2024-09-10T10:00:20.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.699+0000 7fe6b17fa640 1 -- 172.21.15.71:0/2087816926 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe6a4030020 con 0x7fe6b4065ba0 2024-09-10T10:00:20.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.700+0000 7fe6b17fa640 1 --2- 172.21.15.71:0/2087816926 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe6a006ed50 0x7fe6a0071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:20.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.700+0000 7fe6b17fa640 1 -- 172.21.15.71:0/2087816926 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe6a40ae550 con 0x7fe6b4065ba0 2024-09-10T10:00:20.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.700+0000 7fe6abfff640 1 --2- 172.21.15.71:0/2087816926 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe6a006ed50 0x7fe6a0071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:20.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.700+0000 7fe6abfff640 1 --2- 172.21.15.71:0/2087816926 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe6a006ed50 0x7fe6a0071200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe6b410cf90 tx=0x7fe69c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:20.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.704+0000 7fe6b17fa640 1 -- 172.21.15.71:0/2087816926 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe6a407b9b0 con 0x7fe6b4065ba0 2024-09-10T10:00:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.924+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/2087816926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fe6b40fa890 con 0x7fe6b4065ba0 2024-09-10T10:00:20.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.928+0000 7fe6b17fa640 1 -- 172.21.15.71:0/2087816926 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fe6a407b350 con 0x7fe6b4065ba0 2024-09-10T10:00:20.932 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-09-10T10:00:20.933 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQC0GOBmqGRFNxAAYqZLOn6giIgTsDpJUXjn/Q== 2024-09-10T10:00:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.930+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/2087816926 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe6a006ed50 msgr2=0x7fe6a0071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.930+0000 7fe6ba4b9640 1 --2- 172.21.15.71:0/2087816926 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe6a006ed50 0x7fe6a0071200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe6b410cf90 tx=0x7fe69c008040 comp rx=0 tx=0).stop 2024-09-10T10:00:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.930+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/2087816926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6b4065ba0 msgr2=0x7fe6b410d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.930+0000 7fe6ba4b9640 1 --2- 172.21.15.71:0/2087816926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6b4065ba0 0x7fe6b410d1e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40048a0 tx=0x7fe6a4009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.930+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/2087816926 shutdown_connections 2024-09-10T10:00:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.930+0000 7fe6ba4b9640 1 --2- 172.21.15.71:0/2087816926 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe6a006ed50 0x7fe6a0071200 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.930+0000 7fe6ba4b9640 1 --2- 172.21.15.71:0/2087816926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6b40ff720 0x7fe6b410d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.930+0000 7fe6ba4b9640 1 --2- 172.21.15.71:0/2087816926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6b4065ba0 0x7fe6b410d1e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.930+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/2087816926 >> 172.21.15.71:0/2087816926 conn(0x7fe6b40f6bf0 msgr2=0x7fe6b40f7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.931+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/2087816926 shutdown_connections 2024-09-10T10:00:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:20.931+0000 7fe6ba4b9640 1 -- 172.21.15.71:0/2087816926 wait complete. 2024-09-10T10:00:21.283 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:21 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/2087816926' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T10:00:21.283 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:21 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/2087816926' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T10:00:21.296 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:21 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/2087816926' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T10:00:21.296 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:21 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/2087816926' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T10:00:21.599 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T10:00:21.599 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T10:00:21.599 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T10:00:21.636 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T10:00:21.895 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi107/config 2024-09-10T10:00:22.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:22 smithi071 ceph-mon[27559]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:22.346 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:22 smithi107 ceph-mon[34215]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:23.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.428+0000 7fefefa8a640 1 -- 172.21.15.107:0/803836962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefe80fc730 msgr2=0x7fefe80fcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:23.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.428+0000 7fefefa8a640 1 --2- 172.21.15.107:0/803836962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefe80fc730 0x7fefe80fcba0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fefdc0048d0 tx=0x7fefdc009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:23.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.428+0000 7fefefa8a640 1 -- 172.21.15.107:0/803836962 shutdown_connections 2024-09-10T10:00:23.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.428+0000 7fefefa8a640 1 --2- 172.21.15.107:0/803836962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefe80fc730 0x7fefe80fcba0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:23.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.428+0000 7fefefa8a640 1 --2- 172.21.15.107:0/803836962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefe80fb460 0x7fefe80fb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:23.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.428+0000 7fefefa8a640 1 -- 172.21.15.107:0/803836962 >> 172.21.15.107:0/803836962 conn(0x7fefe80f6c20 msgr2=0x7fefe80f9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:23.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.428+0000 7fefefa8a640 1 -- 172.21.15.107:0/803836962 shutdown_connections 2024-09-10T10:00:23.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.428+0000 7fefefa8a640 1 -- 172.21.15.107:0/803836962 wait complete. 2024-09-10T10:00:23.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefefa8a640 1 Processor -- start 2024-09-10T10:00:23.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefefa8a640 1 -- start start 2024-09-10T10:00:23.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefefa8a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefe80fb460 0x7fefe810d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:23.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefefa8a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefe80fc730 0x7fefe810d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:23.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefefa8a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe810dc50 con 0x7fefe80fb460 2024-09-10T10:00:23.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefefa8a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe810e420 con 0x7fefe80fc730 2024-09-10T10:00:23.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefed025640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefe80fc730 0x7fefe810d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:23.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefed025640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefe80fc730 0x7fefe810d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55832/0 (socket says 172.21.15.107:55832) 2024-09-10T10:00:23.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefed025640 1 -- 172.21.15.107:0/3954413955 learned_addr learned my addr 172.21.15.107:0/3954413955 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-10T10:00:23.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefed826640 1 --2- 172.21.15.107:0/3954413955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefe80fb460 0x7fefe810d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:23.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefed025640 1 -- 172.21.15.107:0/3954413955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefe80fb460 msgr2=0x7fefe810d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:23.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefed025640 1 --2- 172.21.15.107:0/3954413955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefe80fb460 0x7fefe810d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:23.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefed025640 1 -- 172.21.15.107:0/3954413955 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc005040 con 0x7fefe80fc730 2024-09-10T10:00:23.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefed826640 1 --2- 172.21.15.107:0/3954413955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefe80fb460 0x7fefe810d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:00:23.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.429+0000 7fefed025640 1 --2- 172.21.15.107:0/3954413955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefe80fc730 0x7fefe810d600 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fefdc0043d0 tx=0x7fefdc009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:23.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.430+0000 7fefda7fc640 1 -- 172.21.15.107:0/3954413955 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefdc038070 con 0x7fefe80fc730 2024-09-10T10:00:23.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.430+0000 7fefda7fc640 1 -- 172.21.15.107:0/3954413955 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fefdc02ae90 con 0x7fefe80fc730 2024-09-10T10:00:23.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.430+0000 7fefefa8a640 1 -- 172.21.15.107:0/3954413955 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe810e650 con 0x7fefe80fc730 2024-09-10T10:00:23.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.430+0000 7fefda7fc640 1 -- 172.21.15.107:0/3954413955 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefdc03e670 con 0x7fefe80fc730 2024-09-10T10:00:23.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.430+0000 7fefefa8a640 1 -- 172.21.15.107:0/3954413955 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe810ebf0 con 0x7fefe80fc730 2024-09-10T10:00:23.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.431+0000 7fefefa8a640 1 -- 172.21.15.107:0/3954413955 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe80fa8c0 con 0x7fefe80fc730 2024-09-10T10:00:23.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.431+0000 7fefda7fc640 1 -- 172.21.15.107:0/3954413955 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fefdc030020 con 0x7fefe80fc730 2024-09-10T10:00:23.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.432+0000 7fefda7fc640 1 --2- 172.21.15.107:0/3954413955 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fefd406ed60 0x7fefd4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:23.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.432+0000 7fefda7fc640 1 -- 172.21.15.107:0/3954413955 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fefdc0adff0 con 0x7fefe80fc730 2024-09-10T10:00:23.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.432+0000 7fefed826640 1 --2- 172.21.15.107:0/3954413955 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fefd406ed60 0x7fefd4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:23.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.432+0000 7fefed826640 1 --2- 172.21.15.107:0/3954413955 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fefd406ed60 0x7fefd4071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fefe4007fd0 tx=0x7fefe4009e90 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:23.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.436+0000 7fefda7fc640 1 -- 172.21.15.107:0/3954413955 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fefdc07b4d0 con 0x7fefe80fc730 2024-09-10T10:00:23.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.647+0000 7fefefa8a640 1 -- 172.21.15.107:0/3954413955 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fefe8103f50 con 0x7fefe80fc730 2024-09-10T10:00:23.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.651+0000 7fefda7fc640 1 -- 172.21.15.107:0/3954413955 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fefdc07ae70 con 0x7fefe80fc730 2024-09-10T10:00:23.653 INFO:teuthology.orchestra.run.smithi107.stdout:[client.1] 2024-09-10T10:00:23.653 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQC3GOBmLS2wJhAAZDtPY0DfC/p+IG6ZNi1Y8A== 2024-09-10T10:00:23.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.653+0000 7fefefa8a640 1 -- 172.21.15.107:0/3954413955 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fefd406ed60 msgr2=0x7fefd4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:23.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.653+0000 7fefefa8a640 1 --2- 172.21.15.107:0/3954413955 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fefd406ed60 0x7fefd4071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fefe4007fd0 tx=0x7fefe4009e90 comp rx=0 tx=0).stop 2024-09-10T10:00:23.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.653+0000 7fefefa8a640 1 -- 172.21.15.107:0/3954413955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefe80fc730 msgr2=0x7fefe810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:23.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.653+0000 7fefefa8a640 1 --2- 172.21.15.107:0/3954413955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefe80fc730 0x7fefe810d600 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fefdc0043d0 tx=0x7fefdc009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:23.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.653+0000 7fefefa8a640 1 -- 172.21.15.107:0/3954413955 shutdown_connections 2024-09-10T10:00:23.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.653+0000 7fefefa8a640 1 --2- 172.21.15.107:0/3954413955 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fefd406ed60 0x7fefd4071210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:23.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.653+0000 7fefefa8a640 1 --2- 172.21.15.107:0/3954413955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefe80fc730 0x7fefe810d600 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:23.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.653+0000 7fefefa8a640 1 --2- 172.21.15.107:0/3954413955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefe80fb460 0x7fefe810d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:23.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.653+0000 7fefefa8a640 1 -- 172.21.15.107:0/3954413955 >> 172.21.15.107:0/3954413955 conn(0x7fefe80f6c20 msgr2=0x7fefe8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:23.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.653+0000 7fefefa8a640 1 -- 172.21.15.107:0/3954413955 shutdown_connections 2024-09-10T10:00:23.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:00:23.653+0000 7fefefa8a640 1 -- 172.21.15.107:0/3954413955 wait complete. 2024-09-10T10:00:24.282 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-10T10:00:24.282 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-10T10:00:24.282 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T10:00:24.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:24 smithi071 ceph-mon[27559]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:24.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:24 smithi071 ceph-mon[27559]: from='client.? 172.21.15.107:0/3954413955' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T10:00:24.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:24 smithi071 ceph-mon[27559]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T10:00:24.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:24 smithi071 ceph-mon[27559]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T10:00:24.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:24 smithi107 ceph-mon[34215]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:24.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:24 smithi107 ceph-mon[34215]: from='client.? 172.21.15.107:0/3954413955' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T10:00:24.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:24 smithi107 ceph-mon[34215]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T10:00:24.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:24 smithi107 ceph-mon[34215]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T10:00:24.320 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T10:00:24.320 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T10:00:24.320 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T10:00:24.578 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:26.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.210+0000 7f69919f5640 1 -- 172.21.15.71:0/3661603011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f698c102550 msgr2=0x7f698c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:26.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.210+0000 7f69919f5640 1 --2- 172.21.15.71:0/3661603011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f698c102550 0x7f698c102920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f697c0048d0 tx=0x7f697c009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:26.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.211+0000 7f69919f5640 1 -- 172.21.15.71:0/3661603011 shutdown_connections 2024-09-10T10:00:26.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.211+0000 7f69919f5640 1 --2- 172.21.15.71:0/3661603011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f698c102ef0 0x7f698c0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:26.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.211+0000 7f69919f5640 1 --2- 172.21.15.71:0/3661603011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f698c102550 0x7f698c102920 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:26.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.211+0000 7f69919f5640 1 -- 172.21.15.71:0/3661603011 >> 172.21.15.71:0/3661603011 conn(0x7f698c0f80f0 msgr2=0x7f698c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:26.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.211+0000 7f69919f5640 1 -- 172.21.15.71:0/3661603011 shutdown_connections 2024-09-10T10:00:26.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.211+0000 7f69919f5640 1 -- 172.21.15.71:0/3661603011 wait complete. 2024-09-10T10:00:26.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.211+0000 7f69919f5640 1 Processor -- start 2024-09-10T10:00:26.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.211+0000 7f69919f5640 1 -- start start 2024-09-10T10:00:26.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.211+0000 7f69919f5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f698c102550 0x7f698c113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:26.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.211+0000 7f69919f5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f698c102ef0 0x7f698c113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:26.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f69919f5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c114100 con 0x7f698c102550 2024-09-10T10:00:26.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f69919f5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c10d510 con 0x7f698c102ef0 2024-09-10T10:00:26.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f698affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f698c102550 0x7f698c113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:26.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f698affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f698c102550 0x7f698c113570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45494/0 (socket says 172.21.15.71:45494) 2024-09-10T10:00:26.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f698affd640 1 -- 172.21.15.71:0/3306011826 learned_addr learned my addr 172.21.15.71:0/3306011826 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:26.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f69827fc640 1 --2- 172.21.15.71:0/3306011826 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f698c102ef0 0x7f698c113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:26.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f698affd640 1 -- 172.21.15.71:0/3306011826 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f698c102ef0 msgr2=0x7f698c113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:26.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f698affd640 1 --2- 172.21.15.71:0/3306011826 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f698c102ef0 0x7f698c113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:26.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f698affd640 1 -- 172.21.15.71:0/3306011826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c005040 con 0x7f698c102550 2024-09-10T10:00:26.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f698affd640 1 --2- 172.21.15.71:0/3306011826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f698c102550 0x7f698c113570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f697c003080 tx=0x7f697c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:26.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f6983fff640 1 -- 172.21.15.71:0/3306011826 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f697c038070 con 0x7f698c102550 2024-09-10T10:00:26.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f69919f5640 1 -- 172.21.15.71:0/3306011826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698c10d790 con 0x7f698c102550 2024-09-10T10:00:26.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f6983fff640 1 -- 172.21.15.71:0/3306011826 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f697c0097e0 con 0x7f698c102550 2024-09-10T10:00:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f6983fff640 1 -- 172.21.15.71:0/3306011826 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f697c03d420 con 0x7f698c102550 2024-09-10T10:00:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.212+0000 7f69919f5640 1 -- 172.21.15.71:0/3306011826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c10dcd0 con 0x7f698c102550 2024-09-10T10:00:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.213+0000 7f69919f5640 1 -- 172.21.15.71:0/3306011826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698c0fdcd0 con 0x7f698c102550 2024-09-10T10:00:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.214+0000 7f6983fff640 1 -- 172.21.15.71:0/3306011826 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f697c030020 con 0x7f698c102550 2024-09-10T10:00:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.214+0000 7f6983fff640 1 --2- 172.21.15.71:0/3306011826 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f697806ed60 0x7f6978071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.214+0000 7f69827fc640 1 --2- 172.21.15.71:0/3306011826 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f697806ed60 0x7f6978071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.215+0000 7f6983fff640 1 -- 172.21.15.71:0/3306011826 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f697c0ae470 con 0x7f698c102550 2024-09-10T10:00:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.215+0000 7f69827fc640 1 --2- 172.21.15.71:0/3306011826 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f697806ed60 0x7f6978071210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f698c10e7f0 tx=0x7f6974009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.219+0000 7f6983fff640 1 -- 172.21.15.71:0/3306011826 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f697c07b8d0 con 0x7f698c102550 2024-09-10T10:00:26.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:26 smithi071 ceph-mon[27559]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:26.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:26 smithi107 ceph-mon[34215]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:26.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.416+0000 7f69919f5640 1 -- 172.21.15.71:0/3306011826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f698c04b720 con 0x7f698c102550 2024-09-10T10:00:26.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.419+0000 7f6983fff640 1 -- 172.21.15.71:0/3306011826 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+176713 (secure 0 0 0) 0x7f697c07b270 con 0x7f698c102550 2024-09-10T10:00:26.423 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.421+0000 7f69919f5640 1 -- 172.21.15.71:0/3306011826 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f697806ed60 msgr2=0x7f6978071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.421+0000 7f69919f5640 1 --2- 172.21.15.71:0/3306011826 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f697806ed60 0x7f6978071210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f698c10e7f0 tx=0x7f6974009040 comp rx=0 tx=0).stop 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.421+0000 7f69919f5640 1 -- 172.21.15.71:0/3306011826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f698c102550 msgr2=0x7f698c113570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.421+0000 7f69919f5640 1 --2- 172.21.15.71:0/3306011826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f698c102550 0x7f698c113570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f697c003080 tx=0x7f697c009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:26.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.422+0000 7f69919f5640 1 -- 172.21.15.71:0/3306011826 shutdown_connections 2024-09-10T10:00:26.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.422+0000 7f69919f5640 1 --2- 172.21.15.71:0/3306011826 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f697806ed60 0x7f6978071210 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:26.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.422+0000 7f69919f5640 1 --2- 172.21.15.71:0/3306011826 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f698c102ef0 0x7f698c113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:26.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.422+0000 7f69919f5640 1 --2- 172.21.15.71:0/3306011826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f698c102550 0x7f698c113570 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:26.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.422+0000 7f69919f5640 1 -- 172.21.15.71:0/3306011826 >> 172.21.15.71:0/3306011826 conn(0x7f698c0f80f0 msgr2=0x7f698c0f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:26.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.422+0000 7f69919f5640 1 -- 172.21.15.71:0/3306011826 shutdown_connections 2024-09-10T10:00:26.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:26.422+0000 7f69919f5640 1 -- 172.21.15.71:0/3306011826 wait complete. 2024-09-10T10:00:27.165 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":19,"flags":0,"active_gid":14208,"active_name":"smithi071.gtqytr","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1474777768},{"type":"v1","addr":"172.21.15.71:6801","nonce":1474777768}]},"active_addr":"172.21.15.71:6801/1474777768","active_change":"2024-09-10T09:56:44.302115+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14226,"name":"smithi107.qurtcs","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.71:8443/","prometheus":"http://172.21.15.71:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":3597519826}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1946576539}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1432096412}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":4274762125}]}]} 2024-09-10T10:00:27.171 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T10:00:27.172 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T10:00:27.173 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:00:27.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:27 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3306011826' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T10:00:27.417 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:27.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:27 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3306011826' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T10:00:28.184 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:28 smithi071 ceph-mon[27559]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:28.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:28 smithi107 ceph-mon[34215]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:29.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.993+0000 7f7935252640 1 -- 172.21.15.71:0/3562585263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7930102ea0 msgr2=0x7f79300fc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:29.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.993+0000 7f7935252640 1 --2- 172.21.15.71:0/3562585263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7930102ea0 0x7f79300fc560 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f79240048d0 tx=0x7f7924009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:29.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.993+0000 7f7935252640 1 -- 172.21.15.71:0/3562585263 shutdown_connections 2024-09-10T10:00:29.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.993+0000 7f7935252640 1 --2- 172.21.15.71:0/3562585263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7930102ea0 0x7f79300fc560 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:29.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.993+0000 7f7935252640 1 --2- 172.21.15.71:0/3562585263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7930102500 0x7f79301028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:29.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.993+0000 7f7935252640 1 -- 172.21.15.71:0/3562585263 >> 172.21.15.71:0/3562585263 conn(0x7f79300f8140 msgr2=0x7f79300fa550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:29.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.993+0000 7f7935252640 1 -- 172.21.15.71:0/3562585263 shutdown_connections 2024-09-10T10:00:29.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.993+0000 7f7935252640 1 -- 172.21.15.71:0/3562585263 wait complete. 2024-09-10T10:00:29.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.994+0000 7f7935252640 1 Processor -- start 2024-09-10T10:00:29.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.994+0000 7f7935252640 1 -- start start 2024-09-10T10:00:29.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.994+0000 7f7935252640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7930102500 0x7f7930113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:29.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.994+0000 7f7935252640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7930102ea0 0x7f7930113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:29.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.994+0000 7f7935252640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7930113df0 con 0x7f7930102500 2024-09-10T10:00:29.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.994+0000 7f7935252640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793010d1a0 con 0x7f7930102ea0 2024-09-10T10:00:29.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.994+0000 7f792ed9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7930102500 0x7f7930113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:29.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.994+0000 7f792ed9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7930102500 0x7f7930113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45506/0 (socket says 172.21.15.71:45506) 2024-09-10T10:00:29.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.994+0000 7f792ed9d640 1 -- 172.21.15.71:0/3165328408 learned_addr learned my addr 172.21.15.71:0/3165328408 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:29.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.994+0000 7f792e59c640 1 --2- 172.21.15.71:0/3165328408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7930102ea0 0x7f7930113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:29.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.994+0000 7f792ed9d640 1 -- 172.21.15.71:0/3165328408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7930102ea0 msgr2=0x7f7930113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:29.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.994+0000 7f792ed9d640 1 --2- 172.21.15.71:0/3165328408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7930102ea0 0x7f7930113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:29.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.994+0000 7f792ed9d640 1 -- 172.21.15.71:0/3165328408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7924005040 con 0x7f7930102500 2024-09-10T10:00:29.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.995+0000 7f792ed9d640 1 --2- 172.21.15.71:0/3165328408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7930102500 0x7f7930113220 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f792000b790 tx=0x7f79200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:29.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.995+0000 7f79177fe640 1 -- 172.21.15.71:0/3165328408 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f792000c700 con 0x7f7930102500 2024-09-10T10:00:29.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.995+0000 7f79177fe640 1 -- 172.21.15.71:0/3165328408 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f792000cd00 con 0x7f7930102500 2024-09-10T10:00:29.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.995+0000 7f7935252640 1 -- 172.21.15.71:0/3165328408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793010d480 con 0x7f7930102500 2024-09-10T10:00:29.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.995+0000 7f79177fe640 1 -- 172.21.15.71:0/3165328408 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7920015e80 con 0x7f7930102500 2024-09-10T10:00:29.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.995+0000 7f7935252640 1 -- 172.21.15.71:0/3165328408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793010d970 con 0x7f7930102500 2024-09-10T10:00:29.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.996+0000 7f7935252640 1 -- 172.21.15.71:0/3165328408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79300fdc80 con 0x7f7930102500 2024-09-10T10:00:29.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.996+0000 7f79177fe640 1 -- 172.21.15.71:0/3165328408 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7920012070 con 0x7f7930102500 2024-09-10T10:00:29.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.997+0000 7f79177fe640 1 --2- 172.21.15.71:0/3165328408 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f791806ed50 0x7f7918071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:29.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.997+0000 7f79177fe640 1 -- 172.21.15.71:0/3165328408 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f792008d6c0 con 0x7f7930102500 2024-09-10T10:00:29.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.997+0000 7f792e59c640 1 --2- 172.21.15.71:0/3165328408 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f791806ed50 0x7f7918071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:29.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:28.997+0000 7f792e59c640 1 --2- 172.21.15.71:0/3165328408 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f791806ed50 0x7f7918071200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f79240048a0 tx=0x7f7924035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:29.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.001+0000 7f79177fe640 1 -- 172.21.15.71:0/3165328408 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f792005ab20 con 0x7f7930102500 2024-09-10T10:00:29.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.157+0000 7f7935252640 1 -- 172.21.15.71:0/3165328408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f793005ed70 con 0x7f7930102500 2024-09-10T10:00:29.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.158+0000 7f79177fe640 1 -- 172.21.15.71:0/3165328408 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11055 (secure 0 0 0) 0x7f792005a4c0 con 0x7f7930102500 2024-09-10T10:00:29.159 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:00:29.159 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":39,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","created":"2024-09-10T09:54:45.672879+0000","modified":"2024-09-10T10:00:13.000958+0000","last_up_change":"2024-09-10T10:00:11.991681+0000","last_in_change":"2024-09-10T09:59:53.813642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:59:00.614186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"99e11191-662e-49c7-876a-9a902b3b506f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":452097359},{"type":"v1","addr":"172.21.15.71:6803","nonce":452097359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":452097359},{"type":"v1","addr":"172.21.15.71:6805","nonce":452097359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":452097359},{"type":"v1","addr":"172.21.15.71:6809","nonce":452097359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":452097359},{"type":"v1","addr":"172.21.15.71:6807","nonce":452097359}]},"public_addr":"172.21.15.71:6803/452097359","cluster_addr":"172.21.15.71:6805/452097359","heartbeat_back_addr":"172.21.15.71:6809/452097359","heartbeat_front_addr":"172.21.15.71:6807/452097359","state":["exists","up"]},{"osd":1,"uuid":"7cd2886d-ba4f-41a7-9d27-653496a4f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":980842787},{"type":"v1","addr":"172.21.15.71:6811","nonce":980842787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":980842787},{"type":"v1","addr":"172.21.15.71:6813","nonce":980842787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":980842787},{"type":"v1","addr":"172.21.15.71:6817","nonce":980842787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":980842787},{"type":"v1","addr":"172.21.15.71:6815","nonce":980842787}]},"public_addr":"172.21.15.71:6811/980842787","cluster_addr":"172.21.15.71:6813/980842787","heartbeat_back_addr":"172.21.15.71:6817/980842787","heartbeat_front_addr":"172.21.15.71:6815/980842787","state":["exists","up"]},{"osd":2,"uuid":"8c63bb54-035a-4c71-9544-8935c2c9ddfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3227805444},{"type":"v1","addr":"172.21.15.71:6819","nonce":3227805444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3227805444},{"type":"v1","addr":"172.21.15.71:6821","nonce":3227805444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3227805444},{"type":"v1","addr":"172.21.15.71:6825","nonce":3227805444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3227805444},{"type":"v1","addr":"172.21.15.71:6823","nonce":3227805444}]},"public_addr":"172.21.15.71:6819/3227805444","cluster_addr":"172.21.15.71:6821/3227805444","heartbeat_back_addr":"172.21.15.71:6825/3227805444","heartbeat_front_addr":"172.21.15.71:6823/3227805444","state":["exists","up"]},{"osd":3,"uuid":"a0ba4e43-2974-4d7e-a545-30b127c58318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1012029623},{"type":"v1","addr":"172.21.15.107:6801","nonce":1012029623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1012029623},{"type":"v1","addr":"172.21.15.107:6803","nonce":1012029623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1012029623},{"type":"v1","addr":"172.21.15.107:6807","nonce":1012029623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1012029623},{"type":"v1","addr":"172.21.15.107:6805","nonce":1012029623}]},"public_addr":"172.21.15.107:6801/1012029623","cluster_addr":"172.21.15.107:6803/1012029623","heartbeat_back_addr":"172.21.15.107:6807/1012029623","heartbeat_front_addr":"172.21.15.107:6805/1012029623","state":["exists","up"]},{"osd":4,"uuid":"34a3b2a7-8678-4979-9c77-4d39ab3a4086","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":1831892363},{"type":"v1","addr":"172.21.15.107:6809","nonce":1831892363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1831892363},{"type":"v1","addr":"172.21.15.107:6811","nonce":1831892363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1831892363},{"type":"v1","addr":"172.21.15.107:6815","nonce":1831892363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1831892363},{"type":"v1","addr":"172.21.15.107:6813","nonce":1831892363}]},"public_addr":"172.21.15.107:6809/1831892363","cluster_addr":"172.21.15.107:6811/1831892363","heartbeat_back_addr":"172.21.15.107:6815/1831892363","heartbeat_front_addr":"172.21.15.107:6813/1831892363","state":["exists","up"]},{"osd":5,"uuid":"5985afbf-b098-4231-930e-677b1518f255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":421590792},{"type":"v1","addr":"172.21.15.107:6817","nonce":421590792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":421590792},{"type":"v1","addr":"172.21.15.107:6819","nonce":421590792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":421590792},{"type":"v1","addr":"172.21.15.107:6823","nonce":421590792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":421590792},{"type":"v1","addr":"172.21.15.107:6821","nonce":421590792}]},"public_addr":"172.21.15.107:6817/421590792","cluster_addr":"172.21.15.107:6819/421590792","heartbeat_back_addr":"172.21.15.107:6823/421590792","heartbeat_front_addr":"172.21.15.107:6821/421590792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:58:02.864477+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:58:30.186393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:58:57.311771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:59:21.438079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:59:45.527511+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:00:10.492658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:0/2738930401":"2024-09-11T09:56:44.302013+0000","172.21.15.71:0/2371616045":"2024-09-11T09:55:05.910028+0000","172.21.15.71:0/2038279395":"2024-09-11T09:55:42.210023+0000","172.21.15.71:0/3250999617":"2024-09-11T09:55:05.910028+0000","172.21.15.71:0/2519859872":"2024-09-11T09:55:05.910028+0000","172.21.15.71:6801/89381066":"2024-09-11T09:55:05.910028+0000","172.21.15.71:6800/89381066":"2024-09-11T09:55:05.910028+0000","172.21.15.71:6801/4098346293":"2024-09-11T09:55:42.210023+0000","172.21.15.71:0/3813664805":"2024-09-11T09:55:42.210023+0000","172.21.15.71:6800/4098346293":"2024-09-11T09:55:42.210023+0000","172.21.15.71:0/1970727630":"2024-09-11T09:55:42.210023+0000","172.21.15.71:0/1476291167":"2024-09-11T09:56:44.302013+0000","172.21.15.71:6800/404028021":"2024-09-11T09:56:44.302013+0000","172.21.15.71:0/3312099981":"2024-09-11T09:56:44.302013+0000","172.21.15.71:6801/404028021":"2024-09-11T09:56:44.302013+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:00:29.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.160+0000 7f7935252640 1 -- 172.21.15.71:0/3165328408 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f791806ed50 msgr2=0x7f7918071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:29.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.160+0000 7f7935252640 1 --2- 172.21.15.71:0/3165328408 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f791806ed50 0x7f7918071200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f79240048a0 tx=0x7f7924035040 comp rx=0 tx=0).stop 2024-09-10T10:00:29.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.160+0000 7f7935252640 1 -- 172.21.15.71:0/3165328408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7930102500 msgr2=0x7f7930113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:29.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.160+0000 7f7935252640 1 --2- 172.21.15.71:0/3165328408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7930102500 0x7f7930113220 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f792000b790 tx=0x7f79200091d0 comp rx=0 tx=0).stop 2024-09-10T10:00:29.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.160+0000 7f7935252640 1 -- 172.21.15.71:0/3165328408 shutdown_connections 2024-09-10T10:00:29.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.160+0000 7f7935252640 1 --2- 172.21.15.71:0/3165328408 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f791806ed50 0x7f7918071200 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:29.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.160+0000 7f7935252640 1 --2- 172.21.15.71:0/3165328408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7930102ea0 0x7f7930113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:29.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.160+0000 7f7935252640 1 --2- 172.21.15.71:0/3165328408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7930102500 0x7f7930113220 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:29.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.160+0000 7f7935252640 1 -- 172.21.15.71:0/3165328408 >> 172.21.15.71:0/3165328408 conn(0x7f79300f8140 msgr2=0x7f79300f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:29.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.160+0000 7f7935252640 1 -- 172.21.15.71:0/3165328408 shutdown_connections 2024-09-10T10:00:29.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:29.160+0000 7f7935252640 1 -- 172.21.15.71:0/3165328408 wait complete. 2024-09-10T10:00:29.805 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T10:00:29.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:00:30.051 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:30.375 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:30 smithi071 ceph-mon[27559]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:30.375 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:30 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3165328408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:00:30.375 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:30 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:00:30.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:30 smithi107 ceph-mon[34215]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:30.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:30 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3165328408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:00:30.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:30 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:00:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.698+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/3374420233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ce40fac80 msgr2=0x7f6ce40fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.698+0000 7f6ceb6d5640 1 --2- 172.21.15.71:0/3374420233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ce40fac80 0x7f6ce40fb0f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40048d0 tx=0x7f6cd4009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.698+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/3374420233 shutdown_connections 2024-09-10T10:00:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.698+0000 7f6ceb6d5640 1 --2- 172.21.15.71:0/3374420233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ce40fac80 0x7f6ce40fb0f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.698+0000 7f6ceb6d5640 1 --2- 172.21.15.71:0/3374420233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce4102620 0x7f6ce41029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.698+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/3374420233 >> 172.21.15.71:0/3374420233 conn(0x7f6ce4070ce0 msgr2=0x7f6ce40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.698+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/3374420233 shutdown_connections 2024-09-10T10:00:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.698+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/3374420233 wait complete. 2024-09-10T10:00:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.698+0000 7f6ceb6d5640 1 Processor -- start 2024-09-10T10:00:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.698+0000 7f6ceb6d5640 1 -- start start 2024-09-10T10:00:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6ceb6d5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ce40fac80 0x7f6ce4113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6ceb6d5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce4102620 0x7f6ce4113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6ceb6d5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4113df0 con 0x7f6ce40fac80 2024-09-10T10:00:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6ceb6d5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce410d1a0 con 0x7f6ce4102620 2024-09-10T10:00:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6ce9471640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ce40fac80 0x7f6ce4113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6ce9471640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ce40fac80 0x7f6ce4113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45518/0 (socket says 172.21.15.71:45518) 2024-09-10T10:00:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6ce9471640 1 -- 172.21.15.71:0/141187495 learned_addr learned my addr 172.21.15.71:0/141187495 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6ce8c70640 1 --2- 172.21.15.71:0/141187495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce4102620 0x7f6ce4113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6ce9471640 1 -- 172.21.15.71:0/141187495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce4102620 msgr2=0x7f6ce4113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6ce9471640 1 --2- 172.21.15.71:0/141187495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce4102620 0x7f6ce4113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6ce9471640 1 -- 172.21.15.71:0/141187495 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4005040 con 0x7f6ce40fac80 2024-09-10T10:00:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6ce9471640 1 --2- 172.21.15.71:0/141187495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ce40fac80 0x7f6ce4113220 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000b790 tx=0x7f6ce00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6cd9ffb640 1 -- 172.21.15.71:0/141187495 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce000c700 con 0x7f6ce40fac80 2024-09-10T10:00:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6cd9ffb640 1 -- 172.21.15.71:0/141187495 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6ce000cd00 con 0x7f6ce40fac80 2024-09-10T10:00:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6cd9ffb640 1 -- 172.21.15.71:0/141187495 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce0015e80 con 0x7f6ce40fac80 2024-09-10T10:00:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.699+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/141187495 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce410d480 con 0x7f6ce40fac80 2024-09-10T10:00:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.700+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/141187495 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce410d920 con 0x7f6ce40fac80 2024-09-10T10:00:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.701+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/141187495 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce40657b0 con 0x7f6ce40fac80 2024-09-10T10:00:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.701+0000 7f6cd9ffb640 1 -- 172.21.15.71:0/141187495 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6ce0012070 con 0x7f6ce40fac80 2024-09-10T10:00:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.701+0000 7f6cd9ffb640 1 --2- 172.21.15.71:0/141187495 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f6cd006ed60 0x7f6cd0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.701+0000 7f6cd9ffb640 1 -- 172.21.15.71:0/141187495 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6ce008d6a0 con 0x7f6ce40fac80 2024-09-10T10:00:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.701+0000 7f6ce8c70640 1 --2- 172.21.15.71:0/141187495 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f6cd006ed60 0x7f6cd0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.702+0000 7f6ce8c70640 1 --2- 172.21.15.71:0/141187495 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f6cd006ed60 0x7f6cd0071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009ac0 tx=0x7f6cd4035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.705+0000 7f6cd9ffb640 1 -- 172.21.15.71:0/141187495 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6ce005ab00 con 0x7f6ce40fac80 2024-09-10T10:00:31.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.864+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/141187495 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ce4074c00 con 0x7f6ce40fac80 2024-09-10T10:00:31.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.864+0000 7f6cd9ffb640 1 -- 172.21.15.71:0/141187495 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11055 (secure 0 0 0) 0x7f6ce005a4a0 con 0x7f6ce40fac80 2024-09-10T10:00:31.866 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:00:31.866 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":39,"fsid":"9dae8622-6f5a-11ef-bcea-c7b262605968","created":"2024-09-10T09:54:45.672879+0000","modified":"2024-09-10T10:00:13.000958+0000","last_up_change":"2024-09-10T10:00:11.991681+0000","last_in_change":"2024-09-10T09:59:53.813642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:59:00.614186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"99e11191-662e-49c7-876a-9a902b3b506f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":452097359},{"type":"v1","addr":"172.21.15.71:6803","nonce":452097359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":452097359},{"type":"v1","addr":"172.21.15.71:6805","nonce":452097359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":452097359},{"type":"v1","addr":"172.21.15.71:6809","nonce":452097359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":452097359},{"type":"v1","addr":"172.21.15.71:6807","nonce":452097359}]},"public_addr":"172.21.15.71:6803/452097359","cluster_addr":"172.21.15.71:6805/452097359","heartbeat_back_addr":"172.21.15.71:6809/452097359","heartbeat_front_addr":"172.21.15.71:6807/452097359","state":["exists","up"]},{"osd":1,"uuid":"7cd2886d-ba4f-41a7-9d27-653496a4f060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":980842787},{"type":"v1","addr":"172.21.15.71:6811","nonce":980842787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":980842787},{"type":"v1","addr":"172.21.15.71:6813","nonce":980842787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":980842787},{"type":"v1","addr":"172.21.15.71:6817","nonce":980842787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":980842787},{"type":"v1","addr":"172.21.15.71:6815","nonce":980842787}]},"public_addr":"172.21.15.71:6811/980842787","cluster_addr":"172.21.15.71:6813/980842787","heartbeat_back_addr":"172.21.15.71:6817/980842787","heartbeat_front_addr":"172.21.15.71:6815/980842787","state":["exists","up"]},{"osd":2,"uuid":"8c63bb54-035a-4c71-9544-8935c2c9ddfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":3227805444},{"type":"v1","addr":"172.21.15.71:6819","nonce":3227805444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":3227805444},{"type":"v1","addr":"172.21.15.71:6821","nonce":3227805444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3227805444},{"type":"v1","addr":"172.21.15.71:6825","nonce":3227805444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3227805444},{"type":"v1","addr":"172.21.15.71:6823","nonce":3227805444}]},"public_addr":"172.21.15.71:6819/3227805444","cluster_addr":"172.21.15.71:6821/3227805444","heartbeat_back_addr":"172.21.15.71:6825/3227805444","heartbeat_front_addr":"172.21.15.71:6823/3227805444","state":["exists","up"]},{"osd":3,"uuid":"a0ba4e43-2974-4d7e-a545-30b127c58318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1012029623},{"type":"v1","addr":"172.21.15.107:6801","nonce":1012029623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1012029623},{"type":"v1","addr":"172.21.15.107:6803","nonce":1012029623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1012029623},{"type":"v1","addr":"172.21.15.107:6807","nonce":1012029623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1012029623},{"type":"v1","addr":"172.21.15.107:6805","nonce":1012029623}]},"public_addr":"172.21.15.107:6801/1012029623","cluster_addr":"172.21.15.107:6803/1012029623","heartbeat_back_addr":"172.21.15.107:6807/1012029623","heartbeat_front_addr":"172.21.15.107:6805/1012029623","state":["exists","up"]},{"osd":4,"uuid":"34a3b2a7-8678-4979-9c77-4d39ab3a4086","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":1831892363},{"type":"v1","addr":"172.21.15.107:6809","nonce":1831892363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1831892363},{"type":"v1","addr":"172.21.15.107:6811","nonce":1831892363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1831892363},{"type":"v1","addr":"172.21.15.107:6815","nonce":1831892363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1831892363},{"type":"v1","addr":"172.21.15.107:6813","nonce":1831892363}]},"public_addr":"172.21.15.107:6809/1831892363","cluster_addr":"172.21.15.107:6811/1831892363","heartbeat_back_addr":"172.21.15.107:6815/1831892363","heartbeat_front_addr":"172.21.15.107:6813/1831892363","state":["exists","up"]},{"osd":5,"uuid":"5985afbf-b098-4231-930e-677b1518f255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":421590792},{"type":"v1","addr":"172.21.15.107:6817","nonce":421590792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":421590792},{"type":"v1","addr":"172.21.15.107:6819","nonce":421590792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":421590792},{"type":"v1","addr":"172.21.15.107:6823","nonce":421590792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":421590792},{"type":"v1","addr":"172.21.15.107:6821","nonce":421590792}]},"public_addr":"172.21.15.107:6817/421590792","cluster_addr":"172.21.15.107:6819/421590792","heartbeat_back_addr":"172.21.15.107:6823/421590792","heartbeat_front_addr":"172.21.15.107:6821/421590792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:58:02.864477+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:58:30.186393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:58:57.311771+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:59:21.438079+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:59:45.527511+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:00:10.492658+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:0/2738930401":"2024-09-11T09:56:44.302013+0000","172.21.15.71:0/2371616045":"2024-09-11T09:55:05.910028+0000","172.21.15.71:0/2038279395":"2024-09-11T09:55:42.210023+0000","172.21.15.71:0/3250999617":"2024-09-11T09:55:05.910028+0000","172.21.15.71:0/2519859872":"2024-09-11T09:55:05.910028+0000","172.21.15.71:6801/89381066":"2024-09-11T09:55:05.910028+0000","172.21.15.71:6800/89381066":"2024-09-11T09:55:05.910028+0000","172.21.15.71:6801/4098346293":"2024-09-11T09:55:42.210023+0000","172.21.15.71:0/3813664805":"2024-09-11T09:55:42.210023+0000","172.21.15.71:6800/4098346293":"2024-09-11T09:55:42.210023+0000","172.21.15.71:0/1970727630":"2024-09-11T09:55:42.210023+0000","172.21.15.71:0/1476291167":"2024-09-11T09:56:44.302013+0000","172.21.15.71:6800/404028021":"2024-09-11T09:56:44.302013+0000","172.21.15.71:0/3312099981":"2024-09-11T09:56:44.302013+0000","172.21.15.71:6801/404028021":"2024-09-11T09:56:44.302013+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:00:31.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.867+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/141187495 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f6cd006ed60 msgr2=0x7f6cd0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:31.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.867+0000 7f6ceb6d5640 1 --2- 172.21.15.71:0/141187495 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f6cd006ed60 0x7f6cd0071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009ac0 tx=0x7f6cd4035040 comp rx=0 tx=0).stop 2024-09-10T10:00:31.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.867+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/141187495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ce40fac80 msgr2=0x7f6ce4113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:31.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.867+0000 7f6ceb6d5640 1 --2- 172.21.15.71:0/141187495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ce40fac80 0x7f6ce4113220 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000b790 tx=0x7f6ce00091d0 comp rx=0 tx=0).stop 2024-09-10T10:00:31.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.867+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/141187495 shutdown_connections 2024-09-10T10:00:31.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.867+0000 7f6ceb6d5640 1 --2- 172.21.15.71:0/141187495 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f6cd006ed60 0x7f6cd0071210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:31.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.867+0000 7f6ceb6d5640 1 --2- 172.21.15.71:0/141187495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ce4102620 0x7f6ce4113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:31.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.867+0000 7f6ceb6d5640 1 --2- 172.21.15.71:0/141187495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ce40fac80 0x7f6ce4113220 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:31.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.867+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/141187495 >> 172.21.15.71:0/141187495 conn(0x7f6ce4070ce0 msgr2=0x7f6ce4105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:31.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.867+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/141187495 shutdown_connections 2024-09-10T10:00:31.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:31.867+0000 7f6ceb6d5640 1 -- 172.21.15.71:0/141187495 wait complete. 2024-09-10T10:00:32.169 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:32 smithi071 ceph-mon[27559]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:32.169 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:32 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/141187495' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:00:32.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:32 smithi107 ceph-mon[34215]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:32.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:32 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/141187495' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:00:32.586 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T10:00:32.586 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T10:00:32.587 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T10:00:32.587 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T10:00:32.588 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T10:00:32.588 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T10:00:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:32.891 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:34.227 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:34.228 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:34.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:34 smithi071 ceph-mon[27559]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:34.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:34 smithi107 ceph-mon[34215]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:36.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:36 smithi107 ceph-mon[34215]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:36.537 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:36 smithi071 ceph-mon[27559]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:36.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.871+0000 7f463da38640 1 -- 172.21.15.71:0/1947393619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4638102680 msgr2=0x7f4638102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:36.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.871+0000 7f463da38640 1 --2- 172.21.15.71:0/1947393619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4638102680 0x7f4638102a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f46280048d0 tx=0x7f4628009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.871+0000 7f463da38640 1 -- 172.21.15.71:0/1947393619 shutdown_connections 2024-09-10T10:00:36.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.871+0000 7f463da38640 1 --2- 172.21.15.71:0/1947393619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46380facf0 0x7f46380fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.871+0000 7f463da38640 1 --2- 172.21.15.71:0/1947393619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4638102680 0x7f4638102a50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.871+0000 7f463da38640 1 -- 172.21.15.71:0/1947393619 >> 172.21.15.71:0/1947393619 conn(0x7f4638070d50 msgr2=0x7f4638071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:36.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.871+0000 7f463da38640 1 -- 172.21.15.71:0/1947393619 shutdown_connections 2024-09-10T10:00:36.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.871+0000 7f463da38640 1 -- 172.21.15.71:0/1947393619 wait complete. 2024-09-10T10:00:36.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.871+0000 7f463da38640 1 Processor -- start 2024-09-10T10:00:36.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f463da38640 1 -- start start 2024-09-10T10:00:36.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f463da38640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46380facf0 0x7f4638115520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:36.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f463da38640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638102680 0x7f4638115a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:36.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f463da38640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46381160b0 con 0x7f46380facf0 2024-09-10T10:00:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f463da38640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463810f4c0 con 0x7f4638102680 2024-09-10T10:00:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f4636ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46380facf0 0x7f4638115520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f4636ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46380facf0 0x7f4638115520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57108/0 (socket says 172.21.15.71:57108) 2024-09-10T10:00:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f4636ffd640 1 -- 172.21.15.71:0/3512874212 learned_addr learned my addr 172.21.15.71:0/3512874212 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f462ffff640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638102680 0x7f4638115a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f4636ffd640 1 -- 172.21.15.71:0/3512874212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638102680 msgr2=0x7f4638115a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f4636ffd640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638102680 0x7f4638115a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f4636ffd640 1 -- 172.21.15.71:0/3512874212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4628005040 con 0x7f46380facf0 2024-09-10T10:00:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f462ffff640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638102680 0x7f4638115a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:00:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f4636ffd640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46380facf0 0x7f4638115520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f46280043d0 tx=0x7f4628009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f462f7fe640 1 -- 172.21.15.71:0/3512874212 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4628038070 con 0x7f46380facf0 2024-09-10T10:00:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f462f7fe640 1 -- 172.21.15.71:0/3512874212 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f46280096e0 con 0x7f46380facf0 2024-09-10T10:00:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.872+0000 7f463da38640 1 -- 172.21.15.71:0/3512874212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463810f740 con 0x7f46380facf0 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.873+0000 7f462f7fe640 1 -- 172.21.15.71:0/3512874212 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f462803d420 con 0x7f46380facf0 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.873+0000 7f463da38640 1 -- 172.21.15.71:0/3512874212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463810fc60 con 0x7f46380facf0 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.873+0000 7f463da38640 1 -- 172.21.15.71:0/3512874212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4638110100 con 0x7f46380facf0 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.874+0000 7f462f7fe640 1 -- 172.21.15.71:0/3512874212 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4628030020 con 0x7f46380facf0 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.874+0000 7f462f7fe640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f462406ed50 0x7f4624071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.875+0000 7f462ffff640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f462406ed50 0x7f4624071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.875+0000 7f462f7fe640 1 -- 172.21.15.71:0/3512874212 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f46280ae350 con 0x7f46380facf0 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.875+0000 7f462f7fe640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363] conn(0x7f4624074ad0 0x7f4624076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.875+0000 7f462f7fe640 1 -- 172.21.15.71:0/3512874212 --> [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4624077590 con 0x7f4624074ad0 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.875+0000 7f462f7fe640 1 -- 172.21.15.71:0/3512874212 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46280b0940 con 0x7f46380facf0 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.875+0000 7f462ffff640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f462406ed50 0x7f4624071200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4620009fd0 tx=0x7f4620009e50 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.875+0000 7f46377fe640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363] conn(0x7f4624074ad0 0x7f4624076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.875+0000 7f46377fe640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363] conn(0x7f4624074ad0 0x7f4624076ee0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.876+0000 7f462f7fe640 1 -- 172.21.15.71:0/3512874212 <== osd.4 v2:172.21.15.107:6808/1831892363 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f4624077590 con 0x7f4624074ad0 2024-09-10T10:00:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 -- 172.21.15.71:0/3512874212 --> [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f46380657f0 con 0x7f4624074ad0 2024-09-10T10:00:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f462f7fe640 1 -- 172.21.15.71:0/3512874212 <== osd.4 v2:172.21.15.107:6808/1831892363 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f46380657f0 con 0x7f4624074ad0 2024-09-10T10:00:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 -- 172.21.15.71:0/3512874212 >> [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363] conn(0x7f4624074ad0 msgr2=0x7f4624076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363] conn(0x7f4624074ad0 0x7f4624076ee0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 -- 172.21.15.71:0/3512874212 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f462406ed50 msgr2=0x7f4624071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f462406ed50 0x7f4624071200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4620009fd0 tx=0x7f4620009e50 comp rx=0 tx=0).stop 2024-09-10T10:00:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 -- 172.21.15.71:0/3512874212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46380facf0 msgr2=0x7f4638115520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46380facf0 0x7f4638115520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f46280043d0 tx=0x7f4628009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 -- 172.21.15.71:0/3512874212 shutdown_connections 2024-09-10T10:00:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.107:6808/1831892363,v1:172.21.15.107:6809/1831892363] conn(0x7f4624074ad0 0x7f4624076ee0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f462406ed50 0x7f4624071200 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4638102680 0x7f4638115a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 --2- 172.21.15.71:0/3512874212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46380facf0 0x7f4638115520 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 -- 172.21.15.71:0/3512874212 >> 172.21.15.71:0/3512874212 conn(0x7f4638070d50 msgr2=0x7f46380fa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 -- 172.21.15.71:0/3512874212 shutdown_connections 2024-09-10T10:00:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:36.889+0000 7f463da38640 1 -- 172.21.15.71:0/3512874212 wait complete. 2024-09-10T10:00:37.680 INFO:teuthology.orchestra.run.smithi071.stdout:141733920780 2024-09-10T10:00:37.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T10:00:38.131 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:38.131 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:38.233 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:38 smithi071 ceph-mon[27559]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:38.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:38 smithi107 ceph-mon[34215]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:39.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:39 smithi107 ceph-mon[34215]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:39.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:39 smithi071 ceph-mon[27559]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:39.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 -- 172.21.15.71:0/1867059026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c0fb7a0 msgr2=0x7f979c10cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:39.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 --2- 172.21.15.71:0/1867059026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c0fb7a0 0x7f979c10cbb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f97900048d0 tx=0x7f9790009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:39.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 -- 172.21.15.71:0/1867059026 shutdown_connections 2024-09-10T10:00:39.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 --2- 172.21.15.71:0/1867059026 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c0fb7a0 0x7f979c10cbb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:39.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 --2- 172.21.15.71:0/1867059026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f979c0fae90 0x7f979c0fb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:39.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 -- 172.21.15.71:0/1867059026 >> 172.21.15.71:0/1867059026 conn(0x7f979c070c80 msgr2=0x7f979c071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:39.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 -- 172.21.15.71:0/1867059026 shutdown_connections 2024-09-10T10:00:39.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 -- 172.21.15.71:0/1867059026 wait complete. 2024-09-10T10:00:39.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 Processor -- start 2024-09-10T10:00:39.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 -- start start 2024-09-10T10:00:39.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f979c0fae90 0x7f979c119860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:39.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c0fb7a0 0x7f979c119da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:39.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c11a3f0 con 0x7f979c0fb7a0 2024-09-10T10:00:39.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.644+0000 7f97a3af0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c113800 con 0x7f979c0fae90 2024-09-10T10:00:39.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f97a108b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c0fb7a0 0x7f979c119da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f97a108b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c0fb7a0 0x7f979c119da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57130/0 (socket says 172.21.15.71:57130) 2024-09-10T10:00:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f97a108b640 1 -- 172.21.15.71:0/2977838865 learned_addr learned my addr 172.21.15.71:0/2977838865 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f97a188c640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f979c0fae90 0x7f979c119860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f97a108b640 1 -- 172.21.15.71:0/2977838865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f979c0fae90 msgr2=0x7f979c119860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f97a108b640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f979c0fae90 0x7f979c119860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f97a108b640 1 -- 172.21.15.71:0/2977838865 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790005040 con 0x7f979c0fb7a0 2024-09-10T10:00:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f97a188c640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f979c0fae90 0x7f979c119860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:00:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f97a108b640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c0fb7a0 0x7f979c119da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f97900043d0 tx=0x7f9790009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f979a7fc640 1 -- 172.21.15.71:0/2977838865 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9790038070 con 0x7f979c0fb7a0 2024-09-10T10:00:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f979a7fc640 1 -- 172.21.15.71:0/2977838865 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9790032b20 con 0x7f979c0fb7a0 2024-09-10T10:00:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f97a3af0640 1 -- 172.21.15.71:0/2977838865 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979c113a80 con 0x7f979c0fb7a0 2024-09-10T10:00:39.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f979a7fc640 1 -- 172.21.15.71:0/2977838865 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f979003d960 con 0x7f979c0fb7a0 2024-09-10T10:00:39.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.645+0000 7f97a3af0640 1 -- 172.21.15.71:0/2977838865 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979c113f40 con 0x7f979c0fb7a0 2024-09-10T10:00:39.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.646+0000 7f97a3af0640 1 -- 172.21.15.71:0/2977838865 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f979c1144b0 con 0x7f979c0fb7a0 2024-09-10T10:00:39.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.647+0000 7f979a7fc640 1 -- 172.21.15.71:0/2977838865 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f9790030020 con 0x7f979c0fb7a0 2024-09-10T10:00:39.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.647+0000 7f979a7fc640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f978406ed60 0x7f9784071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:39.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.647+0000 7f979a7fc640 1 -- 172.21.15.71:0/2977838865 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f97900ae680 con 0x7f979c0fb7a0 2024-09-10T10:00:39.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.647+0000 7f97a188c640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f978406ed60 0x7f9784071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:39.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.647+0000 7f979a7fc640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444] conn(0x7f9784074ae0 0x7f9784076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:39.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.647+0000 7f979a7fc640 1 -- 172.21.15.71:0/2977838865 --> [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97840775a0 con 0x7f9784074ae0 2024-09-10T10:00:39.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.647+0000 7f979a7fc640 1 -- 172.21.15.71:0/2977838865 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97900b0cd0 con 0x7f979c0fb7a0 2024-09-10T10:00:39.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.648+0000 7f97a208d640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444] conn(0x7f9784074ae0 0x7f9784076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:39.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.648+0000 7f97a188c640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f978406ed60 0x7f9784071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f978c007fd0 tx=0x7f978c009e90 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:39.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.648+0000 7f97a208d640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444] conn(0x7f9784074ae0 0x7f9784076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:39.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.649+0000 7f979a7fc640 1 -- 172.21.15.71:0/2977838865 <== osd.2 v2:172.21.15.71:6818/3227805444 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f97840775a0 con 0x7f9784074ae0 2024-09-10T10:00:39.653 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:39.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.661+0000 7f97a3af0640 1 -- 172.21.15.71:0/2977838865 --> [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f979c114670 con 0x7f9784074ae0 2024-09-10T10:00:39.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.661+0000 7f979a7fc640 1 -- 172.21.15.71:0/2977838865 <== osd.2 v2:172.21.15.71:6818/3227805444 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f979c114670 con 0x7f9784074ae0 2024-09-10T10:00:39.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 -- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444] conn(0x7f9784074ae0 msgr2=0x7f9784076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:39.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444] conn(0x7f9784074ae0 0x7f9784076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:39.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 -- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f978406ed60 msgr2=0x7f9784071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f978406ed60 0x7f9784071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f978c007fd0 tx=0x7f978c009e90 comp rx=0 tx=0).stop 2024-09-10T10:00:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 -- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c0fb7a0 msgr2=0x7f979c119da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c0fb7a0 0x7f979c119da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f97900043d0 tx=0x7f9790009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 -- 172.21.15.71:0/2977838865 shutdown_connections 2024-09-10T10:00:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:6818/3227805444,v1:172.21.15.71:6819/3227805444] conn(0x7f9784074ae0 0x7f9784076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f978406ed60 0x7f9784071210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c0fb7a0 0x7f979c119da0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 --2- 172.21.15.71:0/2977838865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f979c0fae90 0x7f979c119860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 -- 172.21.15.71:0/2977838865 >> 172.21.15.71:0/2977838865 conn(0x7f979c070c80 msgr2=0x7f979c0f9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 -- 172.21.15.71:0/2977838865 shutdown_connections 2024-09-10T10:00:39.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:39.662+0000 7f97a3af0640 1 -- 172.21.15.71:0/2977838865 wait complete. 2024-09-10T10:00:40.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.360+0000 7f140e6ea640 1 -- 172.21.15.71:0/4123150228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1408102530 msgr2=0x7f1408102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:40.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.360+0000 7f140e6ea640 1 --2- 172.21.15.71:0/4123150228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1408102530 0x7f1408102900 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f13f80048d0 tx=0x7f13f8009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:40.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.360+0000 7f140e6ea640 1 -- 172.21.15.71:0/4123150228 shutdown_connections 2024-09-10T10:00:40.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.360+0000 7f140e6ea640 1 --2- 172.21.15.71:0/4123150228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1408102ed0 0x7f14080fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:40.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.360+0000 7f140e6ea640 1 --2- 172.21.15.71:0/4123150228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1408102530 0x7f1408102900 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:40.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.360+0000 7f140e6ea640 1 -- 172.21.15.71:0/4123150228 >> 172.21.15.71:0/4123150228 conn(0x7f14080f80f0 msgr2=0x7f14080fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:40.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.360+0000 7f140e6ea640 1 -- 172.21.15.71:0/4123150228 shutdown_connections 2024-09-10T10:00:40.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.360+0000 7f140e6ea640 1 -- 172.21.15.71:0/4123150228 wait complete. 2024-09-10T10:00:40.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.360+0000 7f140e6ea640 1 Processor -- start 2024-09-10T10:00:40.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.360+0000 7f140e6ea640 1 -- start start 2024-09-10T10:00:40.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.360+0000 7f140e6ea640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1408102530 0x7f1408113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:40.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f140e6ea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1408102ed0 0x7f1408113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:40.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f140e6ea640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1408113d80 con 0x7f1408102530 2024-09-10T10:00:40.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f140e6ea640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140810d1c0 con 0x7f1408102ed0 2024-09-10T10:00:40.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f1407fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1408102530 0x7f1408113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:40.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f1407fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1408102530 0x7f1408113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57142/0 (socket says 172.21.15.71:57142) 2024-09-10T10:00:40.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f1407fff640 1 -- 172.21.15.71:0/784393589 learned_addr learned my addr 172.21.15.71:0/784393589 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:40.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f13fffff640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1408102ed0 0x7f1408113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:40.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f1407fff640 1 -- 172.21.15.71:0/784393589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1408102ed0 msgr2=0x7f1408113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:40.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f1407fff640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1408102ed0 0x7f1408113780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:40.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f1407fff640 1 -- 172.21.15.71:0/784393589 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f8005040 con 0x7f1408102530 2024-09-10T10:00:40.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f1407fff640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1408102530 0x7f1408113240 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13f8000c00 tx=0x7f13f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:40.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f14057fa640 1 -- 172.21.15.71:0/784393589 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f8038070 con 0x7f1408102530 2024-09-10T10:00:40.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f14057fa640 1 -- 172.21.15.71:0/784393589 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f13f802ade0 con 0x7f1408102530 2024-09-10T10:00:40.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f140e6ea640 1 -- 172.21.15.71:0/784393589 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140810d440 con 0x7f1408102530 2024-09-10T10:00:40.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f14057fa640 1 -- 172.21.15.71:0/784393589 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f802c7e0 con 0x7f1408102530 2024-09-10T10:00:40.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.361+0000 7f140e6ea640 1 -- 172.21.15.71:0/784393589 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140810d980 con 0x7f1408102530 2024-09-10T10:00:40.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.362+0000 7f140e6ea640 1 -- 172.21.15.71:0/784393589 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f140810deb0 con 0x7f1408102530 2024-09-10T10:00:40.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.363+0000 7f14057fa640 1 -- 172.21.15.71:0/784393589 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f13f8030020 con 0x7f1408102530 2024-09-10T10:00:40.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.363+0000 7f14057fa640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f13f406ed60 0x7f13f4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:40.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.363+0000 7f14057fa640 1 -- 172.21.15.71:0/784393589 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f13f80ada00 con 0x7f1408102530 2024-09-10T10:00:40.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.363+0000 7f13fffff640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f13f406ed60 0x7f13f4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:40.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.364+0000 7f14057fa640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792] conn(0x7f13f4074ae0 0x7f13f4076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:40.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.364+0000 7f14057fa640 1 -- 172.21.15.71:0/784393589 --> [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13f40775a0 con 0x7f13f4074ae0 2024-09-10T10:00:40.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.364+0000 7f14057fa640 1 -- 172.21.15.71:0/784393589 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13f80b2220 con 0x7f1408102530 2024-09-10T10:00:40.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.364+0000 7f13fffff640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f13f406ed60 0x7f13f4071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f140810eb00 tx=0x7f13f000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:40.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.364+0000 7f140cc87640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792] conn(0x7f13f4074ae0 0x7f13f4076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:40.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.364+0000 7f140cc87640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792] conn(0x7f13f4074ae0 0x7f13f4076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:40.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.365+0000 7f14057fa640 1 -- 172.21.15.71:0/784393589 <== osd.5 v2:172.21.15.107:6816/421590792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f13f40775a0 con 0x7f13f4074ae0 2024-09-10T10:00:40.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.377+0000 7f140e6ea640 1 -- 172.21.15.71:0/784393589 --> [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14080fdcb0 con 0x7f13f4074ae0 2024-09-10T10:00:40.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.378+0000 7f14057fa640 1 -- 172.21.15.71:0/784393589 <== osd.5 v2:172.21.15.107:6816/421590792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f14080fdcb0 con 0x7f13f4074ae0 2024-09-10T10:00:40.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.378+0000 7f140e6ea640 1 -- 172.21.15.71:0/784393589 >> [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792] conn(0x7f13f4074ae0 msgr2=0x7f13f4076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:40.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.378+0000 7f140e6ea640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792] conn(0x7f13f4074ae0 0x7f13f4076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:40.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.378+0000 7f140e6ea640 1 -- 172.21.15.71:0/784393589 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f13f406ed60 msgr2=0x7f13f4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:40.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.378+0000 7f140e6ea640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f13f406ed60 0x7f13f4071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f140810eb00 tx=0x7f13f000b040 comp rx=0 tx=0).stop 2024-09-10T10:00:40.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.378+0000 7f140e6ea640 1 -- 172.21.15.71:0/784393589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1408102530 msgr2=0x7f1408113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:40.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.378+0000 7f140e6ea640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1408102530 0x7f1408113240 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13f8000c00 tx=0x7f13f8009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:40.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.378+0000 7f140e6ea640 1 -- 172.21.15.71:0/784393589 shutdown_connections 2024-09-10T10:00:40.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.378+0000 7f140e6ea640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.107:6816/421590792,v1:172.21.15.107:6817/421590792] conn(0x7f13f4074ae0 0x7f13f4076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:40.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.378+0000 7f140e6ea640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f13f406ed60 0x7f13f4071210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:40.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.378+0000 7f140e6ea640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1408102ed0 0x7f1408113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:40.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.378+0000 7f140e6ea640 1 --2- 172.21.15.71:0/784393589 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1408102530 0x7f1408113240 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:40.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.378+0000 7f140e6ea640 1 -- 172.21.15.71:0/784393589 >> 172.21.15.71:0/784393589 conn(0x7f14080f80f0 msgr2=0x7f14080f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:40.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.379+0000 7f140e6ea640 1 -- 172.21.15.71:0/784393589 shutdown_connections 2024-09-10T10:00:40.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:40.379+0000 7f140e6ea640 1 -- 172.21.15.71:0/784393589 wait complete. 2024-09-10T10:00:41.560 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:41 smithi071 ceph-mon[27559]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:41.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:41 smithi107 ceph-mon[34215]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.259+0000 7f15e09a1640 1 -- 172.21.15.71:0/1863176153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc0fb810 msgr2=0x7f15dc0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.259+0000 7f15e09a1640 1 --2- 172.21.15.71:0/1863176153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc0fb810 0x7f15dc0fbbe0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f15cc0048d0 tx=0x7f15cc009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.259+0000 7f15e09a1640 1 -- 172.21.15.71:0/1863176153 shutdown_connections 2024-09-10T10:00:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.259+0000 7f15e09a1640 1 --2- 172.21.15.71:0/1863176153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15dc0fcf80 0x7f15dc0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.259+0000 7f15e09a1640 1 --2- 172.21.15.71:0/1863176153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc0fb810 0x7f15dc0fbbe0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.259+0000 7f15e09a1640 1 -- 172.21.15.71:0/1863176153 >> 172.21.15.71:0/1863176153 conn(0x7f15dc0723b0 msgr2=0x7f15dc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.259+0000 7f15e09a1640 1 -- 172.21.15.71:0/1863176153 shutdown_connections 2024-09-10T10:00:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.259+0000 7f15e09a1640 1 -- 172.21.15.71:0/1863176153 wait complete. 2024-09-10T10:00:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.260+0000 7f15e09a1640 1 Processor -- start 2024-09-10T10:00:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.260+0000 7f15e09a1640 1 -- start start 2024-09-10T10:00:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.260+0000 7f15e09a1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc0fb810 0x7f15dc1120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.260+0000 7f15e09a1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15dc0fcf80 0x7f15dc112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.260+0000 7f15e09a1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc112c30 con 0x7f15dc0fb810 2024-09-10T10:00:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.260+0000 7f15e09a1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc10c070 con 0x7f15dc0fcf80 2024-09-10T10:00:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.260+0000 7f15da59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc0fb810 0x7f15dc1120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.260+0000 7f15da59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc0fb810 0x7f15dc1120f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48560/0 (socket says 172.21.15.71:48560) 2024-09-10T10:00:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.260+0000 7f15da59c640 1 -- 172.21.15.71:0/4042545372 learned_addr learned my addr 172.21.15.71:0/4042545372 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.261+0000 7f15d1d9b640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15dc0fcf80 0x7f15dc112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.261+0000 7f15da59c640 1 -- 172.21.15.71:0/4042545372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15dc0fcf80 msgr2=0x7f15dc112630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.261+0000 7f15da59c640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15dc0fcf80 0x7f15dc112630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.261+0000 7f15da59c640 1 -- 172.21.15.71:0/4042545372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc005040 con 0x7f15dc0fb810 2024-09-10T10:00:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.261+0000 7f15d1d9b640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15dc0fcf80 0x7f15dc112630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:00:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.261+0000 7f15da59c640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc0fb810 0x7f15dc1120f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f15cc000c00 tx=0x7f15cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.261+0000 7f15d37fe640 1 -- 172.21.15.71:0/4042545372 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15cc038070 con 0x7f15dc0fb810 2024-09-10T10:00:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.261+0000 7f15d37fe640 1 -- 172.21.15.71:0/4042545372 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f15cc02ade0 con 0x7f15dc0fb810 2024-09-10T10:00:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.261+0000 7f15e09a1640 1 -- 172.21.15.71:0/4042545372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15dc10c2f0 con 0x7f15dc0fb810 2024-09-10T10:00:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.261+0000 7f15d37fe640 1 -- 172.21.15.71:0/4042545372 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15cc02c7e0 con 0x7f15dc0fb810 2024-09-10T10:00:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.261+0000 7f15e09a1640 1 -- 172.21.15.71:0/4042545372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15dc10c830 con 0x7f15dc0fb810 2024-09-10T10:00:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.262+0000 7f15e09a1640 1 -- 172.21.15.71:0/4042545372 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15dc10cd60 con 0x7f15dc0fb810 2024-09-10T10:00:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.263+0000 7f15d37fe640 1 -- 172.21.15.71:0/4042545372 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f15cc030020 con 0x7f15dc0fb810 2024-09-10T10:00:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.263+0000 7f15d37fe640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f15c806ed60 0x7f15c8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.263+0000 7f15d37fe640 1 -- 172.21.15.71:0/4042545372 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f15cc0ada00 con 0x7f15dc0fb810 2024-09-10T10:00:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.263+0000 7f15d1d9b640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f15c806ed60 0x7f15c8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.263+0000 7f15d37fe640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359] conn(0x7f15c8074ae0 0x7f15c8076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.263+0000 7f15d37fe640 1 -- 172.21.15.71:0/4042545372 --> [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15c80775a0 con 0x7f15c8074ae0 2024-09-10T10:00:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.263+0000 7f15d37fe640 1 -- 172.21.15.71:0/4042545372 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15cc0b2220 con 0x7f15dc0fb810 2024-09-10T10:00:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.264+0000 7f15dad9d640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359] conn(0x7f15c8074ae0 0x7f15c8076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.264+0000 7f15d1d9b640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f15c806ed60 0x7f15c8071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f15c4007fd0 tx=0x7f15c4009e90 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.264+0000 7f15dad9d640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359] conn(0x7f15c8074ae0 0x7f15c8076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.264+0000 7f15d37fe640 1 -- 172.21.15.71:0/4042545372 <== osd.0 v2:172.21.15.71:6802/452097359 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f15c80775a0 con 0x7f15c8074ae0 2024-09-10T10:00:43.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.277+0000 7f15e09a1640 1 -- 172.21.15.71:0/4042545372 --> [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f15dc0fcbc0 con 0x7f15c8074ae0 2024-09-10T10:00:43.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.277+0000 7f15d37fe640 1 -- 172.21.15.71:0/4042545372 <== osd.0 v2:172.21.15.71:6802/452097359 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f15dc0fcbc0 con 0x7f15c8074ae0 2024-09-10T10:00:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.277+0000 7f15e09a1640 1 -- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359] conn(0x7f15c8074ae0 msgr2=0x7f15c8076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.277+0000 7f15e09a1640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359] conn(0x7f15c8074ae0 0x7f15c8076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.277+0000 7f15e09a1640 1 -- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f15c806ed60 msgr2=0x7f15c8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.277+0000 7f15e09a1640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f15c806ed60 0x7f15c8071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f15c4007fd0 tx=0x7f15c4009e90 comp rx=0 tx=0).stop 2024-09-10T10:00:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.277+0000 7f15e09a1640 1 -- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc0fb810 msgr2=0x7f15dc1120f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.277+0000 7f15e09a1640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc0fb810 0x7f15dc1120f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f15cc000c00 tx=0x7f15cc009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.278+0000 7f15e09a1640 1 -- 172.21.15.71:0/4042545372 shutdown_connections 2024-09-10T10:00:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.278+0000 7f15e09a1640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f15c806ed60 0x7f15c8071210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.278+0000 7f15e09a1640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:6802/452097359,v1:172.21.15.71:6803/452097359] conn(0x7f15c8074ae0 0x7f15c8076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.278+0000 7f15e09a1640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15dc0fcf80 0x7f15dc112630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.278+0000 7f15e09a1640 1 --2- 172.21.15.71:0/4042545372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15dc0fb810 0x7f15dc1120f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.278+0000 7f15e09a1640 1 -- 172.21.15.71:0/4042545372 >> 172.21.15.71:0/4042545372 conn(0x7f15dc0723b0 msgr2=0x7f15dc0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.278+0000 7f15e09a1640 1 -- 172.21.15.71:0/4042545372 shutdown_connections 2024-09-10T10:00:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:43.278+0000 7f15e09a1640 1 -- 172.21.15.71:0/4042545372 wait complete. 2024-09-10T10:00:43.732 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:43 smithi071 ceph-mon[27559]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:43.756 INFO:teuthology.orchestra.run.smithi071.stdout:81604378647 2024-09-10T10:00:43.757 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T10:00:43.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:43 smithi107 ceph-mon[34215]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:44.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:00:44.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:44 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:00:44.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.934+0000 7fefa3063640 1 -- 172.21.15.71:0/2147371437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef9c102ef0 msgr2=0x7fef9c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:44.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.934+0000 7fefa3063640 1 --2- 172.21.15.71:0/2147371437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef9c102ef0 0x7fef9c0fc5b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef880048d0 tx=0x7fef88009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:44.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.934+0000 7fefa3063640 1 -- 172.21.15.71:0/2147371437 shutdown_connections 2024-09-10T10:00:44.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.934+0000 7fefa3063640 1 --2- 172.21.15.71:0/2147371437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef9c102ef0 0x7fef9c0fc5b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.934+0000 7fefa3063640 1 --2- 172.21.15.71:0/2147371437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef9c102550 0x7fef9c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.934+0000 7fefa3063640 1 -- 172.21.15.71:0/2147371437 >> 172.21.15.71:0/2147371437 conn(0x7fef9c0f80f0 msgr2=0x7fef9c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.934+0000 7fefa3063640 1 -- 172.21.15.71:0/2147371437 shutdown_connections 2024-09-10T10:00:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.934+0000 7fefa3063640 1 -- 172.21.15.71:0/2147371437 wait complete. 2024-09-10T10:00:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fefa3063640 1 Processor -- start 2024-09-10T10:00:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fefa3063640 1 -- start start 2024-09-10T10:00:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fefa3063640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef9c102550 0x7fef9c113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fefa3063640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef9c102ef0 0x7fef9c113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fefa3063640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c1140b0 con 0x7fef9c102ef0 2024-09-10T10:00:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fefa3063640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c10d4c0 con 0x7fef9c102550 2024-09-10T10:00:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fef9bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef9c102ef0 0x7fef9c113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fef9bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef9c102ef0 0x7fef9c113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48572/0 (socket says 172.21.15.71:48572) 2024-09-10T10:00:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fef9bfff640 1 -- 172.21.15.71:0/2036505969 learned_addr learned my addr 172.21.15.71:0/2036505969 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fefa0dff640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef9c102550 0x7fef9c113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fef9bfff640 1 -- 172.21.15.71:0/2036505969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef9c102550 msgr2=0x7fef9c113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fef9bfff640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef9c102550 0x7fef9c113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fef9bfff640 1 -- 172.21.15.71:0/2036505969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef88005040 con 0x7fef9c102ef0 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.935+0000 7fefa0dff640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef9c102550 0x7fef9c113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.936+0000 7fef9bfff640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef9c102ef0 0x7fef9c113a60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fef88003080 tx=0x7fef88009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.936+0000 7fef997fa640 1 -- 172.21.15.71:0/2036505969 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef88038070 con 0x7fef9c102ef0 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.936+0000 7fef997fa640 1 -- 172.21.15.71:0/2036505969 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fef88009760 con 0x7fef9c102ef0 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.936+0000 7fefa3063640 1 -- 172.21.15.71:0/2036505969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c10d740 con 0x7fef9c102ef0 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.936+0000 7fef997fa640 1 -- 172.21.15.71:0/2036505969 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef8803d420 con 0x7fef9c102ef0 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.936+0000 7fefa3063640 1 -- 172.21.15.71:0/2036505969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c10dc80 con 0x7fef9c102ef0 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.937+0000 7fefa3063640 1 -- 172.21.15.71:0/2036505969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef9c0fdcd0 con 0x7fef9c102ef0 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.937+0000 7fef997fa640 1 -- 172.21.15.71:0/2036505969 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fef88030020 con 0x7fef9c102ef0 2024-09-10T10:00:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.938+0000 7fef997fa640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fef8c06ed50 0x7fef8c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.938+0000 7fef997fa640 1 -- 172.21.15.71:0/2036505969 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fef880ae360 con 0x7fef9c102ef0 2024-09-10T10:00:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.938+0000 7fefa0dff640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fef8c06ed50 0x7fef8c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.938+0000 7fef997fa640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623] conn(0x7fef8c074ad0 0x7fef8c076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.938+0000 7fef997fa640 1 -- 172.21.15.71:0/2036505969 --> [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef8c077590 con 0x7fef8c074ad0 2024-09-10T10:00:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.938+0000 7fef997fa640 1 -- 172.21.15.71:0/2036505969 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef880b0950 con 0x7fef9c102ef0 2024-09-10T10:00:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.938+0000 7fefa1600640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623] conn(0x7fef8c074ad0 0x7fef8c076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.938+0000 7fefa0dff640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fef8c06ed50 0x7fef8c071200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fef900041d0 tx=0x7fef90009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.939+0000 7fefa1600640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623] conn(0x7fef8c074ad0 0x7fef8c076ee0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:44.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.939+0000 7fef997fa640 1 -- 172.21.15.71:0/2036505969 <== osd.3 v2:172.21.15.107:6800/1012029623 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fef8c077590 con 0x7fef8c074ad0 2024-09-10T10:00:44.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.952+0000 7fefa3063640 1 -- 172.21.15.71:0/2036505969 --> [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef9c10e160 con 0x7fef8c074ad0 2024-09-10T10:00:44.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.952+0000 7fef997fa640 1 -- 172.21.15.71:0/2036505969 <== osd.3 v2:172.21.15.107:6800/1012029623 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fef9c10e160 con 0x7fef8c074ad0 2024-09-10T10:00:44.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 -- 172.21.15.71:0/2036505969 >> [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623] conn(0x7fef8c074ad0 msgr2=0x7fef8c076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:44.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623] conn(0x7fef8c074ad0 0x7fef8c076ee0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:44.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 -- 172.21.15.71:0/2036505969 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fef8c06ed50 msgr2=0x7fef8c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:44.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fef8c06ed50 0x7fef8c071200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fef900041d0 tx=0x7fef90009040 comp rx=0 tx=0).stop 2024-09-10T10:00:44.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 -- 172.21.15.71:0/2036505969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef9c102ef0 msgr2=0x7fef9c113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:44.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef9c102ef0 0x7fef9c113a60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fef88003080 tx=0x7fef88009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:44.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 -- 172.21.15.71:0/2036505969 shutdown_connections 2024-09-10T10:00:44.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.107:6800/1012029623,v1:172.21.15.107:6801/1012029623] conn(0x7fef8c074ad0 0x7fef8c076ee0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:44.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fef8c06ed50 0x7fef8c071200 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:44.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef9c102ef0 0x7fef9c113a60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:44.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 --2- 172.21.15.71:0/2036505969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef9c102550 0x7fef9c113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:44.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 -- 172.21.15.71:0/2036505969 >> 172.21.15.71:0/2036505969 conn(0x7fef9c0f80f0 msgr2=0x7fef9c0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:44.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 -- 172.21.15.71:0/2036505969 shutdown_connections 2024-09-10T10:00:44.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:44.953+0000 7fefa3063640 1 -- 172.21.15.71:0/2036505969 wait complete. 2024-09-10T10:00:45.636 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:45 smithi071 ceph-mon[27559]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:45.662 INFO:teuthology.orchestra.run.smithi071.stdout:115964117012 2024-09-10T10:00:45.662 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T10:00:45.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.850+0000 7f983767b640 1 -- 172.21.15.71:0/2746190570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9830102ef0 msgr2=0x7f98300fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:45.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.850+0000 7f983767b640 1 --2- 172.21.15.71:0/2746190570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9830102ef0 0x7f98300fc5b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f98200048d0 tx=0x7f9820009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.850+0000 7f983767b640 1 -- 172.21.15.71:0/2746190570 shutdown_connections 2024-09-10T10:00:45.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.850+0000 7f983767b640 1 --2- 172.21.15.71:0/2746190570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9830102ef0 0x7f98300fc5b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.850+0000 7f983767b640 1 --2- 172.21.15.71:0/2746190570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9830102550 0x7f9830102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.850+0000 7f983767b640 1 -- 172.21.15.71:0/2746190570 >> 172.21.15.71:0/2746190570 conn(0x7f98300f80f0 msgr2=0x7f98300fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:45.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.850+0000 7f983767b640 1 -- 172.21.15.71:0/2746190570 shutdown_connections 2024-09-10T10:00:45.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.850+0000 7f983767b640 1 -- 172.21.15.71:0/2746190570 wait complete. 2024-09-10T10:00:45.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.850+0000 7f983767b640 1 Processor -- start 2024-09-10T10:00:45.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.850+0000 7f983767b640 1 -- start start 2024-09-10T10:00:45.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f983767b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9830102550 0x7f983006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:45.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f983767b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9830102ef0 0x7f983006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:45.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f983767b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9830070520 con 0x7f9830102550 2024-09-10T10:00:45.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f983767b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9830070690 con 0x7f9830102ef0 2024-09-10T10:00:45.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f9835417640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9830102550 0x7f983006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:45.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f9835417640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9830102550 0x7f983006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48598/0 (socket says 172.21.15.71:48598) 2024-09-10T10:00:45.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f9835417640 1 -- 172.21.15.71:0/4075405841 learned_addr learned my addr 172.21.15.71:0/4075405841 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:45.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f9834c16640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9830102ef0 0x7f983006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:45.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f9835417640 1 -- 172.21.15.71:0/4075405841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9830102ef0 msgr2=0x7f983006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:45.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f9835417640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9830102ef0 0x7f983006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f9835417640 1 -- 172.21.15.71:0/4075405841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9820005040 con 0x7f9830102550 2024-09-10T10:00:45.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f9835417640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9830102550 0x7f983006fa10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f982c00b790 tx=0x7f982c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:45.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f9825ffb640 1 -- 172.21.15.71:0/4075405841 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f982c00c700 con 0x7f9830102550 2024-09-10T10:00:45.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f9825ffb640 1 -- 172.21.15.71:0/4075405841 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f982c00cd00 con 0x7f9830102550 2024-09-10T10:00:45.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.851+0000 7f983767b640 1 -- 172.21.15.71:0/4075405841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98301198d0 con 0x7f9830102550 2024-09-10T10:00:45.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.852+0000 7f9825ffb640 1 -- 172.21.15.71:0/4075405841 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f982c015e80 con 0x7f9830102550 2024-09-10T10:00:45.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.852+0000 7f983767b640 1 -- 172.21.15.71:0/4075405841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9830119cc0 con 0x7f9830102550 2024-09-10T10:00:45.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.853+0000 7f983767b640 1 -- 172.21.15.71:0/4075405841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98300fdcd0 con 0x7f9830102550 2024-09-10T10:00:45.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.853+0000 7f9825ffb640 1 -- 172.21.15.71:0/4075405841 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f982c012070 con 0x7f9830102550 2024-09-10T10:00:45.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.853+0000 7f9825ffb640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f981c06ed50 0x7f981c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:45.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.854+0000 7f9825ffb640 1 -- 172.21.15.71:0/4075405841 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f982c08d6a0 con 0x7f9830102550 2024-09-10T10:00:45.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.854+0000 7f9834c16640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f981c06ed50 0x7f981c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:45.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.854+0000 7f9825ffb640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787] conn(0x7f981c074ad0 0x7f981c076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:45.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.854+0000 7f9825ffb640 1 -- 172.21.15.71:0/4075405841 --> [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f981c077590 con 0x7f981c074ad0 2024-09-10T10:00:45.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.854+0000 7f9825ffb640 1 -- 172.21.15.71:0/4075405841 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f982c08fcf0 con 0x7f9830102550 2024-09-10T10:00:45.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.854+0000 7f9835c18640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787] conn(0x7f981c074ad0 0x7f981c076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:45.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.854+0000 7f9834c16640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f981c06ed50 0x7f981c071200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9820000c00 tx=0x7f9820035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:45.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.854+0000 7f9835c18640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787] conn(0x7f981c074ad0 0x7f981c076ee0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:45.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.855+0000 7f9825ffb640 1 -- 172.21.15.71:0/4075405841 <== osd.1 v2:172.21.15.71:6810/980842787 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f981c077590 con 0x7f981c074ad0 2024-09-10T10:00:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.867+0000 7f983767b640 1 -- 172.21.15.71:0/4075405841 --> [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f98300fbd50 con 0x7f981c074ad0 2024-09-10T10:00:45.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.868+0000 7f9825ffb640 1 -- 172.21.15.71:0/4075405841 <== osd.1 v2:172.21.15.71:6810/980842787 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f98300fbd50 con 0x7f981c074ad0 2024-09-10T10:00:45.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.868+0000 7f983767b640 1 -- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787] conn(0x7f981c074ad0 msgr2=0x7f981c076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.868+0000 7f983767b640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787] conn(0x7f981c074ad0 0x7f981c076ee0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.868+0000 7f983767b640 1 -- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f981c06ed50 msgr2=0x7f981c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.868+0000 7f983767b640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f981c06ed50 0x7f981c071200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9820000c00 tx=0x7f9820035040 comp rx=0 tx=0).stop 2024-09-10T10:00:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.868+0000 7f983767b640 1 -- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9830102550 msgr2=0x7f983006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.868+0000 7f983767b640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9830102550 0x7f983006fa10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f982c00b790 tx=0x7f982c0091d0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.868+0000 7f983767b640 1 -- 172.21.15.71:0/4075405841 shutdown_connections 2024-09-10T10:00:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.868+0000 7f983767b640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:6810/980842787,v1:172.21.15.71:6811/980842787] conn(0x7f981c074ad0 0x7f981c076ee0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.868+0000 7f983767b640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f981c06ed50 0x7f981c071200 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.868+0000 7f983767b640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9830102ef0 0x7f983006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.868+0000 7f983767b640 1 --2- 172.21.15.71:0/4075405841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9830102550 0x7f983006fa10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.868+0000 7f983767b640 1 -- 172.21.15.71:0/4075405841 >> 172.21.15.71:0/4075405841 conn(0x7f98300f80f0 msgr2=0x7f98300f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:45.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.869+0000 7f983767b640 1 -- 172.21.15.71:0/4075405841 shutdown_connections 2024-09-10T10:00:45.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:45.869+0000 7f983767b640 1 -- 172.21.15.71:0/4075405841 wait complete. 2024-09-10T10:00:45.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:45 smithi107 ceph-mon[34215]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:46.569 INFO:teuthology.orchestra.run.smithi071.stdout:60129542173 2024-09-10T10:00:46.569 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T10:00:47.168 INFO:teuthology.orchestra.run.smithi071.stdout:38654705698 2024-09-10T10:00:47.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T10:00:47.629 INFO:teuthology.orchestra.run.smithi071.stdout:163208757257 2024-09-10T10:00:47.630 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T10:00:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:47.749 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:47 smithi071 ceph-mon[27559]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:47.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:47 smithi107 ceph-mon[34215]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:48.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.506+0000 7f9da8592640 1 -- 172.21.15.71:0/2052344116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da00fd560 msgr2=0x7f9da00fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.506+0000 7f9da8592640 1 --2- 172.21.15.71:0/2052344116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da00fd560 0x7f9da00fd930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c004900 tx=0x7f9d9c009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.506+0000 7f9da8592640 1 -- 172.21.15.71:0/2052344116 shutdown_connections 2024-09-10T10:00:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.506+0000 7f9da8592640 1 --2- 172.21.15.71:0/2052344116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9da00fdf00 0x7f9da01065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.506+0000 7f9da8592640 1 --2- 172.21.15.71:0/2052344116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da00fd560 0x7f9da00fd930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.506+0000 7f9da8592640 1 -- 172.21.15.71:0/2052344116 >> 172.21.15.71:0/2052344116 conn(0x7f9da00f7060 msgr2=0x7f9da00f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.507+0000 7f9da8592640 1 -- 172.21.15.71:0/2052344116 shutdown_connections 2024-09-10T10:00:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.507+0000 7f9da8592640 1 -- 172.21.15.71:0/2052344116 wait complete. 2024-09-10T10:00:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.507+0000 7f9da8592640 1 Processor -- start 2024-09-10T10:00:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.507+0000 7f9da8592640 1 -- start start 2024-09-10T10:00:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.507+0000 7f9da8592640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da00fd560 0x7f9da0113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.507+0000 7f9da8592640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9da00fdf00 0x7f9da0113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:48.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.507+0000 7f9da8592640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0113e50 con 0x7f9da00fd560 2024-09-10T10:00:48.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.507+0000 7f9da8592640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da010d290 con 0x7f9da00fdf00 2024-09-10T10:00:48.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.507+0000 7f9da632e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da00fd560 0x7f9da0113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:48.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.507+0000 7f9da632e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da00fd560 0x7f9da0113310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48628/0 (socket says 172.21.15.71:48628) 2024-09-10T10:00:48.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.507+0000 7f9da632e640 1 -- 172.21.15.71:0/1484299513 learned_addr learned my addr 172.21.15.71:0/1484299513 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:48.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.508+0000 7f9da5b2d640 1 --2- 172.21.15.71:0/1484299513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9da00fdf00 0x7f9da0113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:48.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.508+0000 7f9da632e640 1 -- 172.21.15.71:0/1484299513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9da00fdf00 msgr2=0x7f9da0113850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:48.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.508+0000 7f9da632e640 1 --2- 172.21.15.71:0/1484299513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9da00fdf00 0x7f9da0113850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:48.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.508+0000 7f9da632e640 1 -- 172.21.15.71:0/1484299513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c005040 con 0x7f9da00fd560 2024-09-10T10:00:48.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.508+0000 7f9da632e640 1 --2- 172.21.15.71:0/1484299513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da00fd560 0x7f9da0113310 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c004960 tx=0x7f9d9c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:48.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.508+0000 7f9d96ffd640 1 -- 172.21.15.71:0/1484299513 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d9c038070 con 0x7f9da00fd560 2024-09-10T10:00:48.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.508+0000 7f9da8592640 1 -- 172.21.15.71:0/1484299513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da010d510 con 0x7f9da00fd560 2024-09-10T10:00:48.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.508+0000 7f9d96ffd640 1 -- 172.21.15.71:0/1484299513 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9d9c008ed0 con 0x7f9da00fd560 2024-09-10T10:00:48.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.508+0000 7f9d96ffd640 1 -- 172.21.15.71:0/1484299513 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d9c0095a0 con 0x7f9da00fd560 2024-09-10T10:00:48.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.508+0000 7f9da8592640 1 -- 172.21.15.71:0/1484299513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da010d9d0 con 0x7f9da00fd560 2024-09-10T10:00:48.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.509+0000 7f9da8592640 1 -- 172.21.15.71:0/1484299513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da00662f0 con 0x7f9da00fd560 2024-09-10T10:00:48.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.510+0000 7f9d96ffd640 1 -- 172.21.15.71:0/1484299513 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f9d9c030020 con 0x7f9da00fd560 2024-09-10T10:00:48.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.510+0000 7f9d96ffd640 1 --2- 172.21.15.71:0/1484299513 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f9d8c06ed60 0x7f9d8c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:48.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.510+0000 7f9d96ffd640 1 -- 172.21.15.71:0/1484299513 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9d9c0addb0 con 0x7f9da00fd560 2024-09-10T10:00:48.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.510+0000 7f9da5b2d640 1 --2- 172.21.15.71:0/1484299513 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f9d8c06ed60 0x7f9d8c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:48.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.511+0000 7f9da5b2d640 1 --2- 172.21.15.71:0/1484299513 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f9d8c06ed60 0x7f9d8c071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9da010ebd0 tx=0x7f9d90009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:48.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.515+0000 7f9d96ffd640 1 -- 172.21.15.71:0/1484299513 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9d9c07b210 con 0x7f9da00fd560 2024-09-10T10:00:48.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.679+0000 7f9da8592640 1 -- 172.21.15.71:0/1484299513 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9da004b720 con 0x7f9da00fd560 2024-09-10T10:00:48.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.680+0000 7f9d96ffd640 1 -- 172.21.15.71:0/1484299513 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d9c07abb0 con 0x7f9da00fd560 2024-09-10T10:00:48.681 INFO:teuthology.orchestra.run.smithi071.stdout:141733920783 2024-09-10T10:00:48.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.682+0000 7f9da8592640 1 -- 172.21.15.71:0/1484299513 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f9d8c06ed60 msgr2=0x7f9d8c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:48.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.682+0000 7f9da8592640 1 --2- 172.21.15.71:0/1484299513 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f9d8c06ed60 0x7f9d8c071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9da010ebd0 tx=0x7f9d90009040 comp rx=0 tx=0).stop 2024-09-10T10:00:48.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.682+0000 7f9da8592640 1 -- 172.21.15.71:0/1484299513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da00fd560 msgr2=0x7f9da0113310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:48.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.682+0000 7f9da8592640 1 --2- 172.21.15.71:0/1484299513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da00fd560 0x7f9da0113310 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c004960 tx=0x7f9d9c009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:48.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.682+0000 7f9da8592640 1 -- 172.21.15.71:0/1484299513 shutdown_connections 2024-09-10T10:00:48.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.682+0000 7f9da8592640 1 --2- 172.21.15.71:0/1484299513 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f9d8c06ed60 0x7f9d8c071210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:48.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.682+0000 7f9da8592640 1 --2- 172.21.15.71:0/1484299513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9da00fdf00 0x7f9da0113850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:48.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.682+0000 7f9da8592640 1 --2- 172.21.15.71:0/1484299513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9da00fd560 0x7f9da0113310 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:48.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.682+0000 7f9da8592640 1 -- 172.21.15.71:0/1484299513 >> 172.21.15.71:0/1484299513 conn(0x7f9da00f7060 msgr2=0x7f9da00f85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:48.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.683+0000 7f9da8592640 1 -- 172.21.15.71:0/1484299513 shutdown_connections 2024-09-10T10:00:48.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:48.683+0000 7f9da8592640 1 -- 172.21.15.71:0/1484299513 wait complete. 2024-09-10T10:00:49.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:49 smithi071 ceph-mon[27559]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:49.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:49 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1484299513' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T10:00:49.658 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920780 got 141733920783 for osd.4 2024-09-10T10:00:49.658 DEBUG:teuthology.parallel:result is None 2024-09-10T10:00:49.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:49 smithi107 ceph-mon[34215]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:49.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:49 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1484299513' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T10:00:50.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.948+0000 7fb6230e0640 1 -- 172.21.15.71:0/900386465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c1047c0 msgr2=0x7fb61c104b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:50.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.948+0000 7fb6230e0640 1 --2- 172.21.15.71:0/900386465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c1047c0 0x7fb61c104b90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb6100048d0 tx=0x7fb610009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:50.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.948+0000 7fb6230e0640 1 -- 172.21.15.71:0/900386465 shutdown_connections 2024-09-10T10:00:50.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.948+0000 7fb6230e0640 1 --2- 172.21.15.71:0/900386465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb61c0fe7a0 0x7fb61c0fec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:50.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.948+0000 7fb6230e0640 1 --2- 172.21.15.71:0/900386465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c1047c0 0x7fb61c104b90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:50.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.948+0000 7fb6230e0640 1 -- 172.21.15.71:0/900386465 >> 172.21.15.71:0/900386465 conn(0x7fb61c0fa340 msgr2=0x7fb61c0fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:50.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.948+0000 7fb6230e0640 1 -- 172.21.15.71:0/900386465 shutdown_connections 2024-09-10T10:00:50.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.948+0000 7fb6230e0640 1 -- 172.21.15.71:0/900386465 wait complete. 2024-09-10T10:00:50.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.949+0000 7fb6230e0640 1 Processor -- start 2024-09-10T10:00:50.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.949+0000 7fb6230e0640 1 -- start start 2024-09-10T10:00:50.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.949+0000 7fb6230e0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb61c0fe7a0 0x7fb61c115370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:50.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.949+0000 7fb6230e0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c1047c0 0x7fb61c1158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:50.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.949+0000 7fb6230e0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c115eb0 con 0x7fb61c1047c0 2024-09-10T10:00:50.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.949+0000 7fb6230e0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c10f2f0 con 0x7fb61c0fe7a0 2024-09-10T10:00:50.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.949+0000 7fb61bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c1047c0 0x7fb61c1158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:50.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.949+0000 7fb61bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c1047c0 0x7fb61c1158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48644/0 (socket says 172.21.15.71:48644) 2024-09-10T10:00:50.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.949+0000 7fb61bfff640 1 -- 172.21.15.71:0/3167884919 learned_addr learned my addr 172.21.15.71:0/3167884919 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:50.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.950+0000 7fb61bfff640 1 -- 172.21.15.71:0/3167884919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb61c0fe7a0 msgr2=0x7fb61c115370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:50.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.950+0000 7fb61bfff640 1 --2- 172.21.15.71:0/3167884919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb61c0fe7a0 0x7fb61c115370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:50.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.950+0000 7fb61bfff640 1 -- 172.21.15.71:0/3167884919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610005040 con 0x7fb61c1047c0 2024-09-10T10:00:50.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.950+0000 7fb61bfff640 1 --2- 172.21.15.71:0/3167884919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c1047c0 0x7fb61c1158b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb60800c830 tx=0x7fb608004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:50.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.950+0000 7fb6197fa640 1 -- 172.21.15.71:0/3167884919 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb60800a850 con 0x7fb61c1047c0 2024-09-10T10:00:50.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.950+0000 7fb6230e0640 1 -- 172.21.15.71:0/3167884919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61c10f5d0 con 0x7fb61c1047c0 2024-09-10T10:00:50.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.950+0000 7fb6197fa640 1 -- 172.21.15.71:0/3167884919 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb60800ae50 con 0x7fb61c1047c0 2024-09-10T10:00:50.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.950+0000 7fb6197fa640 1 -- 172.21.15.71:0/3167884919 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6080113a0 con 0x7fb61c1047c0 2024-09-10T10:00:50.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.950+0000 7fb6230e0640 1 -- 172.21.15.71:0/3167884919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61c10fb70 con 0x7fb61c1047c0 2024-09-10T10:00:50.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.951+0000 7fb6230e0640 1 -- 172.21.15.71:0/3167884919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61c0ffee0 con 0x7fb61c1047c0 2024-09-10T10:00:50.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.952+0000 7fb6197fa640 1 -- 172.21.15.71:0/3167884919 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb608012400 con 0x7fb61c1047c0 2024-09-10T10:00:50.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.952+0000 7fb6197fa640 1 --2- 172.21.15.71:0/3167884919 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb60c06ed60 0x7fb60c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:50.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.952+0000 7fb6197fa640 1 -- 172.21.15.71:0/3167884919 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb60808df50 con 0x7fb61c1047c0 2024-09-10T10:00:50.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.952+0000 7fb620e7c640 1 --2- 172.21.15.71:0/3167884919 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb60c06ed60 0x7fb60c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:50.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.952+0000 7fb620e7c640 1 --2- 172.21.15.71:0/3167884919 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb60c06ed60 0x7fb60c071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb6100043d0 tx=0x7fb610009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:50.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:50.956+0000 7fb6197fa640 1 -- 172.21.15.71:0/3167884919 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb60805b590 con 0x7fb61c1047c0 2024-09-10T10:00:51.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:51.119+0000 7fb6230e0640 1 -- 172.21.15.71:0/3167884919 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb61c0fdf60 con 0x7fb61c1047c0 2024-09-10T10:00:51.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:51.119+0000 7fb6197fa640 1 -- 172.21.15.71:0/3167884919 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb60805af30 con 0x7fb61c1047c0 2024-09-10T10:00:51.120 INFO:teuthology.orchestra.run.smithi071.stdout:81604378650 2024-09-10T10:00:51.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:51.121+0000 7fb6230e0640 1 -- 172.21.15.71:0/3167884919 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb60c06ed60 msgr2=0x7fb60c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:51.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:51.121+0000 7fb6230e0640 1 --2- 172.21.15.71:0/3167884919 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb60c06ed60 0x7fb60c071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb6100043d0 tx=0x7fb610009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:51.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:51.121+0000 7fb6230e0640 1 -- 172.21.15.71:0/3167884919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c1047c0 msgr2=0x7fb61c1158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:51.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:51.121+0000 7fb6230e0640 1 --2- 172.21.15.71:0/3167884919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c1047c0 0x7fb61c1158b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb60800c830 tx=0x7fb608004430 comp rx=0 tx=0).stop 2024-09-10T10:00:51.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:51.121+0000 7fb6230e0640 1 -- 172.21.15.71:0/3167884919 shutdown_connections 2024-09-10T10:00:51.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:51.121+0000 7fb6230e0640 1 --2- 172.21.15.71:0/3167884919 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb60c06ed60 0x7fb60c071210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:51.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:51.121+0000 7fb6230e0640 1 --2- 172.21.15.71:0/3167884919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb61c1047c0 0x7fb61c1158b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:51.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:51.121+0000 7fb6230e0640 1 --2- 172.21.15.71:0/3167884919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb61c0fe7a0 0x7fb61c115370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:51.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:51.121+0000 7fb6230e0640 1 -- 172.21.15.71:0/3167884919 >> 172.21.15.71:0/3167884919 conn(0x7fb61c0fa340 msgr2=0x7fb61c0fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:51.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:51.121+0000 7fb6230e0640 1 -- 172.21.15.71:0/3167884919 shutdown_connections 2024-09-10T10:00:51.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:51.121+0000 7fb6230e0640 1 -- 172.21.15.71:0/3167884919 wait complete. 2024-09-10T10:00:51.697 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:51 smithi107 ceph-mon[34215]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:51.698 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:51 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3167884919' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T10:00:51.748 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:51 smithi071 ceph-mon[27559]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:51.748 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:51 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3167884919' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T10:00:52.255 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378650 for osd.2 2024-09-10T10:00:52.255 DEBUG:teuthology.parallel:result is None 2024-09-10T10:00:52.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.424+0000 7fae9b092640 1 -- 172.21.15.71:0/154203629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae940fd530 msgr2=0x7fae940fd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:52.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.424+0000 7fae9b092640 1 --2- 172.21.15.71:0/154203629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae940fd530 0x7fae940fd900 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fae88004900 tx=0x7fae88009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:52.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.424+0000 7fae9b092640 1 -- 172.21.15.71:0/154203629 shutdown_connections 2024-09-10T10:00:52.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.424+0000 7fae9b092640 1 --2- 172.21.15.71:0/154203629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae940fded0 0x7fae941065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:52.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.424+0000 7fae9b092640 1 --2- 172.21.15.71:0/154203629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae940fd530 0x7fae940fd900 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:52.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.424+0000 7fae9b092640 1 -- 172.21.15.71:0/154203629 >> 172.21.15.71:0/154203629 conn(0x7fae940f7030 msgr2=0x7fae940f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:52.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.424+0000 7fae9b092640 1 -- 172.21.15.71:0/154203629 shutdown_connections 2024-09-10T10:00:52.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.424+0000 7fae9b092640 1 -- 172.21.15.71:0/154203629 wait complete. 2024-09-10T10:00:52.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.425+0000 7fae9b092640 1 Processor -- start 2024-09-10T10:00:52.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.425+0000 7fae9b092640 1 -- start start 2024-09-10T10:00:52.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.425+0000 7fae9b092640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae940fd530 0x7fae940fb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:52.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.425+0000 7fae9b092640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae940fded0 0x7fae940fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:52.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.425+0000 7fae9b092640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae940fbe70 con 0x7fae940fded0 2024-09-10T10:00:52.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.425+0000 7fae9b092640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae940fbfe0 con 0x7fae940fd530 2024-09-10T10:00:52.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.425+0000 7fae93fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae940fded0 0x7fae940fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:52.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.425+0000 7fae93fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae940fded0 0x7fae940fb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48658/0 (socket says 172.21.15.71:48658) 2024-09-10T10:00:52.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.425+0000 7fae93fff640 1 -- 172.21.15.71:0/2091091742 learned_addr learned my addr 172.21.15.71:0/2091091742 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:52.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.426+0000 7fae98e2e640 1 --2- 172.21.15.71:0/2091091742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae940fd530 0x7fae940fb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:52.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.426+0000 7fae93fff640 1 -- 172.21.15.71:0/2091091742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae940fd530 msgr2=0x7fae940fb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:52.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.426+0000 7fae93fff640 1 --2- 172.21.15.71:0/2091091742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae940fd530 0x7fae940fb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:52.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.426+0000 7fae93fff640 1 -- 172.21.15.71:0/2091091742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae88005040 con 0x7fae940fded0 2024-09-10T10:00:52.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.426+0000 7fae93fff640 1 --2- 172.21.15.71:0/2091091742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae940fded0 0x7fae940fb930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fae80002a50 tx=0x7fae80004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:52.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.426+0000 7fae917fa640 1 -- 172.21.15.71:0/2091091742 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae80007c30 con 0x7fae940fded0 2024-09-10T10:00:52.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.426+0000 7fae917fa640 1 -- 172.21.15.71:0/2091091742 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fae8000f040 con 0x7fae940fded0 2024-09-10T10:00:52.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.426+0000 7fae9b092640 1 -- 172.21.15.71:0/2091091742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae940fc270 con 0x7fae940fded0 2024-09-10T10:00:52.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.426+0000 7fae917fa640 1 -- 172.21.15.71:0/2091091742 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae8000da10 con 0x7fae940fded0 2024-09-10T10:00:52.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.426+0000 7fae9b092640 1 -- 172.21.15.71:0/2091091742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae941198f0 con 0x7fae940fded0 2024-09-10T10:00:52.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.427+0000 7fae9b092640 1 -- 172.21.15.71:0/2091091742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae94066090 con 0x7fae940fded0 2024-09-10T10:00:52.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.428+0000 7fae917fa640 1 -- 172.21.15.71:0/2091091742 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fae8000dbb0 con 0x7fae940fded0 2024-09-10T10:00:52.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.428+0000 7fae917fa640 1 --2- 172.21.15.71:0/2091091742 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fae8406ed60 0x7fae84071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:52.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.428+0000 7fae98e2e640 1 --2- 172.21.15.71:0/2091091742 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fae8406ed60 0x7fae84071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:52.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.428+0000 7fae917fa640 1 -- 172.21.15.71:0/2091091742 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fae8008d530 con 0x7fae940fded0 2024-09-10T10:00:52.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.429+0000 7fae98e2e640 1 --2- 172.21.15.71:0/2091091742 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fae8406ed60 0x7fae84071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae88007ac0 tx=0x7fae88035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:52.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.432+0000 7fae917fa640 1 -- 172.21.15.71:0/2091091742 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fae8004d2a0 con 0x7fae940fded0 2024-09-10T10:00:52.503 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:52.504 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:52.549 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:00:52.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.603+0000 7fae9b092640 1 -- 172.21.15.71:0/2091091742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae940fac30 con 0x7fae940fded0 2024-09-10T10:00:52.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.603+0000 7fae917fa640 1 -- 172.21.15.71:0/2091091742 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae940fac30 con 0x7fae940fded0 2024-09-10T10:00:52.604 INFO:teuthology.orchestra.run.smithi071.stdout:115964117013 2024-09-10T10:00:52.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.605+0000 7fae9b092640 1 -- 172.21.15.71:0/2091091742 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fae8406ed60 msgr2=0x7fae84071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:52.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.605+0000 7fae9b092640 1 --2- 172.21.15.71:0/2091091742 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fae8406ed60 0x7fae84071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae88007ac0 tx=0x7fae88035040 comp rx=0 tx=0).stop 2024-09-10T10:00:52.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.605+0000 7fae9b092640 1 -- 172.21.15.71:0/2091091742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae940fded0 msgr2=0x7fae940fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:52.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.605+0000 7fae9b092640 1 --2- 172.21.15.71:0/2091091742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae940fded0 0x7fae940fb930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fae80002a50 tx=0x7fae80004600 comp rx=0 tx=0).stop 2024-09-10T10:00:52.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.605+0000 7fae9b092640 1 -- 172.21.15.71:0/2091091742 shutdown_connections 2024-09-10T10:00:52.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.605+0000 7fae9b092640 1 --2- 172.21.15.71:0/2091091742 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fae8406ed60 0x7fae84071210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:52.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.605+0000 7fae9b092640 1 --2- 172.21.15.71:0/2091091742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae940fded0 0x7fae940fb930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:52.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.605+0000 7fae9b092640 1 --2- 172.21.15.71:0/2091091742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae940fd530 0x7fae940fb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:52.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.605+0000 7fae9b092640 1 -- 172.21.15.71:0/2091091742 >> 172.21.15.71:0/2091091742 conn(0x7fae940f7030 msgr2=0x7fae940f8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:52.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.605+0000 7fae9b092640 1 -- 172.21.15.71:0/2091091742 shutdown_connections 2024-09-10T10:00:52.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:52.605+0000 7fae9b092640 1 -- 172.21.15.71:0/2091091742 wait complete. 2024-09-10T10:00:53.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:53 smithi071 ceph-mon[27559]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:53.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:53 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/2091091742' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T10:00:53.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:53 smithi107 ceph-mon[34215]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:53.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:53 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/2091091742' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T10:00:54.535 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117012 got 115964117013 for osd.3 2024-09-10T10:00:54.536 DEBUG:teuthology.parallel:result is None 2024-09-10T10:00:55.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.519+0000 7f49834ee640 1 -- 172.21.15.71:0/934599259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c102530 msgr2=0x7f497c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:55.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.519+0000 7f49834ee640 1 --2- 172.21.15.71:0/934599259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c102530 0x7f497c102900 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4974009c50 tx=0x7f4974004d10 comp rx=0 tx=0).stop 2024-09-10T10:00:55.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.519+0000 7f49834ee640 1 -- 172.21.15.71:0/934599259 shutdown_connections 2024-09-10T10:00:55.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.519+0000 7f49834ee640 1 --2- 172.21.15.71:0/934599259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f497c102ed0 0x7f497c0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:55.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.519+0000 7f49834ee640 1 --2- 172.21.15.71:0/934599259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c102530 0x7f497c102900 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:55.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.519+0000 7f49834ee640 1 -- 172.21.15.71:0/934599259 >> 172.21.15.71:0/934599259 conn(0x7f497c0f80f0 msgr2=0x7f497c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:55.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.520+0000 7f49834ee640 1 -- 172.21.15.71:0/934599259 shutdown_connections 2024-09-10T10:00:55.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.520+0000 7f49834ee640 1 -- 172.21.15.71:0/934599259 wait complete. 2024-09-10T10:00:55.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.520+0000 7f49834ee640 1 Processor -- start 2024-09-10T10:00:55.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.520+0000 7f49834ee640 1 -- start start 2024-09-10T10:00:55.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.520+0000 7f49834ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f497c102530 0x7f497c113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:55.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.520+0000 7f49834ee640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c102ed0 0x7f497c113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:55.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.520+0000 7f49834ee640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c113e20 con 0x7f497c102ed0 2024-09-10T10:00:55.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.520+0000 7f49834ee640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c10d1d0 con 0x7f497c102530 2024-09-10T10:00:55.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.520+0000 7f4980a89640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c102ed0 0x7f497c113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:55.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.520+0000 7f4980a89640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c102ed0 0x7f497c113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34072/0 (socket says 172.21.15.71:34072) 2024-09-10T10:00:55.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.520+0000 7f4980a89640 1 -- 172.21.15.71:0/3669456132 learned_addr learned my addr 172.21.15.71:0/3669456132 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:55.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.521+0000 7f4980a89640 1 -- 172.21.15.71:0/3669456132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f497c102530 msgr2=0x7f497c113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:55.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.521+0000 7f4980a89640 1 --2- 172.21.15.71:0/3669456132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f497c102530 0x7f497c113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:55.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.521+0000 7f4980a89640 1 -- 172.21.15.71:0/3669456132 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49740098b0 con 0x7f497c102ed0 2024-09-10T10:00:55.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.521+0000 7f4980a89640 1 --2- 172.21.15.71:0/3669456132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c102ed0 0x7f497c113790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f497000b540 tx=0x7f49700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:55.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.521+0000 7f4979ffb640 1 -- 172.21.15.71:0/3669456132 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f497000f6f0 con 0x7f497c102ed0 2024-09-10T10:00:55.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.521+0000 7f49834ee640 1 -- 172.21.15.71:0/3669456132 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c10d4b0 con 0x7f497c102ed0 2024-09-10T10:00:55.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.521+0000 7f4979ffb640 1 -- 172.21.15.71:0/3669456132 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f497000fcf0 con 0x7f497c102ed0 2024-09-10T10:00:55.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.521+0000 7f4979ffb640 1 -- 172.21.15.71:0/3669456132 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49700103a0 con 0x7f497c102ed0 2024-09-10T10:00:55.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.521+0000 7f49834ee640 1 -- 172.21.15.71:0/3669456132 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c10d9d0 con 0x7f497c102ed0 2024-09-10T10:00:55.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.522+0000 7f49834ee640 1 -- 172.21.15.71:0/3669456132 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c0fdcb0 con 0x7f497c102ed0 2024-09-10T10:00:55.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.522+0000 7f4979ffb640 1 -- 172.21.15.71:0/3669456132 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f497000f850 con 0x7f497c102ed0 2024-09-10T10:00:55.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.523+0000 7f4979ffb640 1 --2- 172.21.15.71:0/3669456132 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f496406ed60 0x7f4964071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:55.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.523+0000 7f498128a640 1 --2- 172.21.15.71:0/3669456132 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f496406ed60 0x7f4964071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:55.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.523+0000 7f4979ffb640 1 -- 172.21.15.71:0/3669456132 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f497008dd80 con 0x7f497c102ed0 2024-09-10T10:00:55.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.523+0000 7f498128a640 1 --2- 172.21.15.71:0/3669456132 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f496406ed60 0x7f4964071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4974004750 tx=0x7f4974004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:55.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.527+0000 7f4979ffb640 1 -- 172.21.15.71:0/3669456132 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f497005b260 con 0x7f497c102ed0 2024-09-10T10:00:55.612 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:55 smithi071 ceph-mon[27559]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:55.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.687+0000 7f49834ee640 1 -- 172.21.15.71:0/3669456132 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f497c109640 con 0x7f497c102ed0 2024-09-10T10:00:55.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.687+0000 7f4979ffb640 1 -- 172.21.15.71:0/3669456132 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f497005ac00 con 0x7f497c102ed0 2024-09-10T10:00:55.688 INFO:teuthology.orchestra.run.smithi071.stdout:38654705700 2024-09-10T10:00:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.689+0000 7f49834ee640 1 -- 172.21.15.71:0/3669456132 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f496406ed60 msgr2=0x7f4964071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.689+0000 7f49834ee640 1 --2- 172.21.15.71:0/3669456132 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f496406ed60 0x7f4964071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4974004750 tx=0x7f4974004d10 comp rx=0 tx=0).stop 2024-09-10T10:00:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.689+0000 7f49834ee640 1 -- 172.21.15.71:0/3669456132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c102ed0 msgr2=0x7f497c113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.689+0000 7f49834ee640 1 --2- 172.21.15.71:0/3669456132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c102ed0 0x7f497c113790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f497000b540 tx=0x7f49700091a0 comp rx=0 tx=0).stop 2024-09-10T10:00:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.689+0000 7f49834ee640 1 -- 172.21.15.71:0/3669456132 shutdown_connections 2024-09-10T10:00:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.689+0000 7f49834ee640 1 --2- 172.21.15.71:0/3669456132 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f496406ed60 0x7f4964071210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.689+0000 7f49834ee640 1 --2- 172.21.15.71:0/3669456132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c102ed0 0x7f497c113790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.689+0000 7f49834ee640 1 --2- 172.21.15.71:0/3669456132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f497c102530 0x7f497c113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.689+0000 7f49834ee640 1 -- 172.21.15.71:0/3669456132 >> 172.21.15.71:0/3669456132 conn(0x7f497c0f80f0 msgr2=0x7f497c0f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.689+0000 7f49834ee640 1 -- 172.21.15.71:0/3669456132 shutdown_connections 2024-09-10T10:00:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:55.689+0000 7f49834ee640 1 -- 172.21.15.71:0/3669456132 wait complete. 2024-09-10T10:00:55.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:55 smithi107 ceph-mon[34215]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:56.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:56 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3669456132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T10:00:56.649 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705700 for osd.0 2024-09-10T10:00:56.650 DEBUG:teuthology.parallel:result is None 2024-09-10T10:00:56.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:56 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3669456132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T10:00:57.719 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:57 smithi071 ceph-mon[27559]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:57.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:57 smithi107 ceph-mon[34215]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:58.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.371+0000 7f4733488640 1 -- 172.21.15.71:0/1264917246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472c0fb480 msgr2=0x7f472c0fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:58.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.371+0000 7f4733488640 1 --2- 172.21.15.71:0/1264917246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472c0fb480 0x7f472c0fb8f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f47200048d0 tx=0x7f4720009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.371+0000 7f4733488640 1 -- 172.21.15.71:0/1264917246 shutdown_connections 2024-09-10T10:00:58.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.371+0000 7f4733488640 1 --2- 172.21.15.71:0/1264917246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472c0fb480 0x7f472c0fb8f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.371+0000 7f4733488640 1 --2- 172.21.15.71:0/1264917246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f472c1014c0 0x7f472c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.371+0000 7f4733488640 1 -- 172.21.15.71:0/1264917246 >> 172.21.15.71:0/1264917246 conn(0x7f472c0f7000 msgr2=0x7f472c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:58.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.371+0000 7f4733488640 1 -- 172.21.15.71:0/1264917246 shutdown_connections 2024-09-10T10:00:58.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.371+0000 7f4733488640 1 -- 172.21.15.71:0/1264917246 wait complete. 2024-09-10T10:00:58.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.372+0000 7f4733488640 1 Processor -- start 2024-09-10T10:00:58.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.372+0000 7f4733488640 1 -- start start 2024-09-10T10:00:58.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.372+0000 7f4733488640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f472c0fb480 0x7f472c112120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:58.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.372+0000 7f4733488640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472c1014c0 0x7f472c112660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:58.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.372+0000 7f4733488640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c112cf0 con 0x7f472c1014c0 2024-09-10T10:00:58.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.372+0000 7f4733488640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c10c0a0 con 0x7f472c0fb480 2024-09-10T10:00:58.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.372+0000 7f4730a23640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472c1014c0 0x7f472c112660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:58.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.372+0000 7f4730a23640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472c1014c0 0x7f472c112660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34080/0 (socket says 172.21.15.71:34080) 2024-09-10T10:00:58.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.372+0000 7f4730a23640 1 -- 172.21.15.71:0/839698151 learned_addr learned my addr 172.21.15.71:0/839698151 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:58.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.372+0000 7f4730a23640 1 -- 172.21.15.71:0/839698151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f472c0fb480 msgr2=0x7f472c112120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:58.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.372+0000 7f4731224640 1 --2- 172.21.15.71:0/839698151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f472c0fb480 0x7f472c112120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:58.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.372+0000 7f4730a23640 1 --2- 172.21.15.71:0/839698151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f472c0fb480 0x7f472c112120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.372+0000 7f4730a23640 1 -- 172.21.15.71:0/839698151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4720005040 con 0x7f472c1014c0 2024-09-10T10:00:58.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.373+0000 7f4730a23640 1 --2- 172.21.15.71:0/839698151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472c1014c0 0x7f472c112660 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4720003080 tx=0x7f4720009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:58.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.373+0000 7f471dffb640 1 -- 172.21.15.71:0/839698151 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4720038070 con 0x7f472c1014c0 2024-09-10T10:00:58.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.373+0000 7f471dffb640 1 -- 172.21.15.71:0/839698151 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f47200097e0 con 0x7f472c1014c0 2024-09-10T10:00:58.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.373+0000 7f4733488640 1 -- 172.21.15.71:0/839698151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472c10c320 con 0x7f472c1014c0 2024-09-10T10:00:58.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.373+0000 7f471dffb640 1 -- 172.21.15.71:0/839698151 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f472003d420 con 0x7f472c1014c0 2024-09-10T10:00:58.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.373+0000 7f4733488640 1 -- 172.21.15.71:0/839698151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472c10c7e0 con 0x7f472c1014c0 2024-09-10T10:00:58.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.374+0000 7f4733488640 1 -- 172.21.15.71:0/839698151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472c0fcbc0 con 0x7f472c1014c0 2024-09-10T10:00:58.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.374+0000 7f471dffb640 1 -- 172.21.15.71:0/839698151 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4720030020 con 0x7f472c1014c0 2024-09-10T10:00:58.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.375+0000 7f471dffb640 1 --2- 172.21.15.71:0/839698151 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f471806ed60 0x7f4718071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:58.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.375+0000 7f471dffb640 1 -- 172.21.15.71:0/839698151 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f47200ae470 con 0x7f472c1014c0 2024-09-10T10:00:58.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.375+0000 7f4731224640 1 --2- 172.21.15.71:0/839698151 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f471806ed60 0x7f4718071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:58.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.375+0000 7f4731224640 1 --2- 172.21.15.71:0/839698151 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f471806ed60 0x7f4718071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f472800a900 tx=0x7f4728008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:58.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.379+0000 7f471dffb640 1 -- 172.21.15.71:0/839698151 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f472007b8d0 con 0x7f472c1014c0 2024-09-10T10:00:58.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.539+0000 7f4733488640 1 -- 172.21.15.71:0/839698151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f472c108520 con 0x7f472c1014c0 2024-09-10T10:00:58.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.540+0000 7f471dffb640 1 -- 172.21.15.71:0/839698151 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f472007b270 con 0x7f472c1014c0 2024-09-10T10:00:58.541 INFO:teuthology.orchestra.run.smithi071.stdout:163208757261 2024-09-10T10:00:58.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.542+0000 7f4733488640 1 -- 172.21.15.71:0/839698151 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f471806ed60 msgr2=0x7f4718071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:58.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.542+0000 7f4733488640 1 --2- 172.21.15.71:0/839698151 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f471806ed60 0x7f4718071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f472800a900 tx=0x7f4728008040 comp rx=0 tx=0).stop 2024-09-10T10:00:58.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.542+0000 7f4733488640 1 -- 172.21.15.71:0/839698151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472c1014c0 msgr2=0x7f472c112660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:58.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.542+0000 7f4733488640 1 --2- 172.21.15.71:0/839698151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472c1014c0 0x7f472c112660 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4720003080 tx=0x7f4720009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.542+0000 7f4733488640 1 -- 172.21.15.71:0/839698151 shutdown_connections 2024-09-10T10:00:58.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.542+0000 7f4733488640 1 --2- 172.21.15.71:0/839698151 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f471806ed60 0x7f4718071210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.542+0000 7f4733488640 1 --2- 172.21.15.71:0/839698151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472c1014c0 0x7f472c112660 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.542+0000 7f4733488640 1 --2- 172.21.15.71:0/839698151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f472c0fb480 0x7f472c112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.542+0000 7f4733488640 1 -- 172.21.15.71:0/839698151 >> 172.21.15.71:0/839698151 conn(0x7f472c0f7000 msgr2=0x7f472c0f88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:58.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.542+0000 7f4733488640 1 -- 172.21.15.71:0/839698151 shutdown_connections 2024-09-10T10:00:58.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.542+0000 7f4733488640 1 -- 172.21.15.71:0/839698151 wait complete. 2024-09-10T10:00:58.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.591+0000 7fd87363d640 1 -- 172.21.15.71:0/2451544064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd86c0fe460 msgr2=0x7fd86c0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:58.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.591+0000 7fd87363d640 1 --2- 172.21.15.71:0/2451544064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd86c0fe460 0x7fd86c0fe830 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd8680048d0 tx=0x7fd868009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.591+0000 7fd87363d640 1 -- 172.21.15.71:0/2451544064 shutdown_connections 2024-09-10T10:00:58.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.591+0000 7fd87363d640 1 --2- 172.21.15.71:0/2451544064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd86c064fc0 0x7fd86c065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.591+0000 7fd87363d640 1 --2- 172.21.15.71:0/2451544064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd86c0fe460 0x7fd86c0fe830 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.591+0000 7fd87363d640 1 -- 172.21.15.71:0/2451544064 >> 172.21.15.71:0/2451544064 conn(0x7fd86c0723b0 msgr2=0x7fd86c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:58.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.591+0000 7fd87363d640 1 -- 172.21.15.71:0/2451544064 shutdown_connections 2024-09-10T10:00:58.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.591+0000 7fd87363d640 1 -- 172.21.15.71:0/2451544064 wait complete. 2024-09-10T10:00:58.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.592+0000 7fd87363d640 1 Processor -- start 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.592+0000 7fd87363d640 1 -- start start 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.592+0000 7fd87363d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd86c064fc0 0x7fd86c1153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.592+0000 7fd87363d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd86c0fe460 0x7fd86c1158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.592+0000 7fd87363d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c115f80 con 0x7fd86c064fc0 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.592+0000 7fd87363d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c10f3c0 con 0x7fd86c0fe460 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.592+0000 7fd8713d9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd86c064fc0 0x7fd86c1153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.592+0000 7fd8713d9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd86c064fc0 0x7fd86c1153b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34104/0 (socket says 172.21.15.71:34104) 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.592+0000 7fd8713d9640 1 -- 172.21.15.71:0/1809964749 learned_addr learned my addr 172.21.15.71:0/1809964749 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.592+0000 7fd870bd8640 1 --2- 172.21.15.71:0/1809964749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd86c0fe460 0x7fd86c1158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.592+0000 7fd8713d9640 1 -- 172.21.15.71:0/1809964749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd86c0fe460 msgr2=0x7fd86c1158f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.592+0000 7fd8713d9640 1 --2- 172.21.15.71:0/1809964749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd86c0fe460 0x7fd86c1158f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.592+0000 7fd8713d9640 1 -- 172.21.15.71:0/1809964749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd868005040 con 0x7fd86c064fc0 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.593+0000 7fd8713d9640 1 --2- 172.21.15.71:0/1809964749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd86c064fc0 0x7fd86c1153b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd868003080 tx=0x7fd868009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.593+0000 7fd861ffb640 1 -- 172.21.15.71:0/1809964749 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd868038070 con 0x7fd86c064fc0 2024-09-10T10:00:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.593+0000 7fd861ffb640 1 -- 172.21.15.71:0/1809964749 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd8680097e0 con 0x7fd86c064fc0 2024-09-10T10:00:58.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.593+0000 7fd87363d640 1 -- 172.21.15.71:0/1809964749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86c10f640 con 0x7fd86c064fc0 2024-09-10T10:00:58.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.593+0000 7fd861ffb640 1 -- 172.21.15.71:0/1809964749 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd86803d420 con 0x7fd86c064fc0 2024-09-10T10:00:58.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.593+0000 7fd87363d640 1 -- 172.21.15.71:0/1809964749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86c10fb00 con 0x7fd86c064fc0 2024-09-10T10:00:58.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.594+0000 7fd87363d640 1 -- 172.21.15.71:0/1809964749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86c0fdcf0 con 0x7fd86c064fc0 2024-09-10T10:00:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.594+0000 7fd861ffb640 1 -- 172.21.15.71:0/1809964749 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fd868030020 con 0x7fd86c064fc0 2024-09-10T10:00:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.595+0000 7fd861ffb640 1 --2- 172.21.15.71:0/1809964749 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd85806ed60 0x7fd858071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.595+0000 7fd861ffb640 1 -- 172.21.15.71:0/1809964749 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd8680ae3e0 con 0x7fd86c064fc0 2024-09-10T10:00:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.595+0000 7fd870bd8640 1 --2- 172.21.15.71:0/1809964749 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd85806ed60 0x7fd858071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.595+0000 7fd870bd8640 1 --2- 172.21.15.71:0/1809964749 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd85806ed60 0x7fd858071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd85c006fd0 tx=0x7fd85c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:58.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.599+0000 7fd861ffb640 1 -- 172.21.15.71:0/1809964749 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd86807b8c0 con 0x7fd86c064fc0 2024-09-10T10:00:58.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.756+0000 7fd87363d640 1 -- 172.21.15.71:0/1809964749 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd86c04b750 con 0x7fd86c064fc0 2024-09-10T10:00:58.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.757+0000 7fd861ffb640 1 -- 172.21.15.71:0/1809964749 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd86807b260 con 0x7fd86c064fc0 2024-09-10T10:00:58.758 INFO:teuthology.orchestra.run.smithi071.stdout:60129542176 2024-09-10T10:00:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.759+0000 7fd87363d640 1 -- 172.21.15.71:0/1809964749 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd85806ed60 msgr2=0x7fd858071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.759+0000 7fd87363d640 1 --2- 172.21.15.71:0/1809964749 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd85806ed60 0x7fd858071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd85c006fd0 tx=0x7fd85c008040 comp rx=0 tx=0).stop 2024-09-10T10:00:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.759+0000 7fd87363d640 1 -- 172.21.15.71:0/1809964749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd86c064fc0 msgr2=0x7fd86c1153b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.759+0000 7fd87363d640 1 --2- 172.21.15.71:0/1809964749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd86c064fc0 0x7fd86c1153b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd868003080 tx=0x7fd868009da0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.759+0000 7fd87363d640 1 -- 172.21.15.71:0/1809964749 shutdown_connections 2024-09-10T10:00:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.759+0000 7fd87363d640 1 --2- 172.21.15.71:0/1809964749 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd85806ed60 0x7fd858071210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.759+0000 7fd87363d640 1 --2- 172.21.15.71:0/1809964749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd86c0fe460 0x7fd86c1158f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.759+0000 7fd87363d640 1 --2- 172.21.15.71:0/1809964749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd86c064fc0 0x7fd86c1153b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.759+0000 7fd87363d640 1 -- 172.21.15.71:0/1809964749 >> 172.21.15.71:0/1809964749 conn(0x7fd86c0723b0 msgr2=0x7fd86c103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.759+0000 7fd87363d640 1 -- 172.21.15.71:0/1809964749 shutdown_connections 2024-09-10T10:00:58.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:00:58.759+0000 7fd87363d640 1 -- 172.21.15.71:0/1809964749 wait complete. 2024-09-10T10:00:59.460 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757257 got 163208757261 for osd.5 2024-09-10T10:00:59.460 DEBUG:teuthology.parallel:result is None 2024-09-10T10:00:59.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:59 smithi071 ceph-mon[27559]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:59.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:59 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/839698151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T10:00:59.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:59 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1809964749' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T10:00:59.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:00:59 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:00:59.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:59 smithi107 ceph-mon[34215]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:00:59.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:59 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/839698151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T10:00:59.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:59 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1809964749' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T10:00:59.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:00:59 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:00:59.938 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542176 for osd.1 2024-09-10T10:00:59.938 DEBUG:teuthology.parallel:result is None 2024-09-10T10:00:59.938 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T10:00:59.939 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:01:00.184 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:01.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:01 smithi071 ceph-mon[27559]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:01.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.742+0000 7f9c90f5b640 1 -- 172.21.15.71:0/2129759394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c8c0fb480 msgr2=0x7f9c8c0fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:01.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.742+0000 7f9c90f5b640 1 --2- 172.21.15.71:0/2129759394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c8c0fb480 0x7f9c8c0fb8f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9c740048d0 tx=0x7f9c74009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:01.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.742+0000 7f9c90f5b640 1 -- 172.21.15.71:0/2129759394 shutdown_connections 2024-09-10T10:01:01.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.742+0000 7f9c90f5b640 1 --2- 172.21.15.71:0/2129759394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c8c0fb480 0x7f9c8c0fb8f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:01.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.742+0000 7f9c90f5b640 1 --2- 172.21.15.71:0/2129759394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c8c1014c0 0x7f9c8c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:01.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.742+0000 7f9c90f5b640 1 -- 172.21.15.71:0/2129759394 >> 172.21.15.71:0/2129759394 conn(0x7f9c8c0f7000 msgr2=0x7f9c8c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:01.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.742+0000 7f9c90f5b640 1 -- 172.21.15.71:0/2129759394 shutdown_connections 2024-09-10T10:01:01.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.742+0000 7f9c90f5b640 1 -- 172.21.15.71:0/2129759394 wait complete. 2024-09-10T10:01:01.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.742+0000 7f9c90f5b640 1 Processor -- start 2024-09-10T10:01:01.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c90f5b640 1 -- start start 2024-09-10T10:01:01.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c90f5b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c8c0fb480 0x7f9c8c1120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:01.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c90f5b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c8c1014c0 0x7f9c8c112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:01.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c90f5b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c112c30 con 0x7f9c8c1014c0 2024-09-10T10:01:01.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c90f5b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c10c070 con 0x7f9c8c0fb480 2024-09-10T10:01:01.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c83fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c8c1014c0 0x7f9c8c112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:01.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c83fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c8c1014c0 0x7f9c8c112630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34124/0 (socket says 172.21.15.71:34124) 2024-09-10T10:01:01.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c83fff640 1 -- 172.21.15.71:0/3795009234 learned_addr learned my addr 172.21.15.71:0/3795009234 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:01.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c8a59c640 1 --2- 172.21.15.71:0/3795009234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c8c0fb480 0x7f9c8c1120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:01.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c83fff640 1 -- 172.21.15.71:0/3795009234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c8c0fb480 msgr2=0x7f9c8c1120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:01.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c83fff640 1 --2- 172.21.15.71:0/3795009234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c8c0fb480 0x7f9c8c1120f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:01.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c83fff640 1 -- 172.21.15.71:0/3795009234 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74005040 con 0x7f9c8c1014c0 2024-09-10T10:01:01.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c83fff640 1 --2- 172.21.15.71:0/3795009234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c8c1014c0 0x7f9c8c112630 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9c74000c00 tx=0x7f9c74009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:01.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c82ffd640 1 -- 172.21.15.71:0/3795009234 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c74038070 con 0x7f9c8c1014c0 2024-09-10T10:01:01.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c90f5b640 1 -- 172.21.15.71:0/3795009234 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c10c2f0 con 0x7f9c8c1014c0 2024-09-10T10:01:01.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c82ffd640 1 -- 172.21.15.71:0/3795009234 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9c7402ade0 con 0x7f9c8c1014c0 2024-09-10T10:01:01.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c82ffd640 1 -- 172.21.15.71:0/3795009234 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c7402c7e0 con 0x7f9c8c1014c0 2024-09-10T10:01:01.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.743+0000 7f9c90f5b640 1 -- 172.21.15.71:0/3795009234 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c10c830 con 0x7f9c8c1014c0 2024-09-10T10:01:01.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.744+0000 7f9c90f5b640 1 -- 172.21.15.71:0/3795009234 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c0fcbc0 con 0x7f9c8c1014c0 2024-09-10T10:01:01.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.745+0000 7f9c82ffd640 1 -- 172.21.15.71:0/3795009234 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f9c74030020 con 0x7f9c8c1014c0 2024-09-10T10:01:01.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.745+0000 7f9c82ffd640 1 --2- 172.21.15.71:0/3795009234 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f9c7806ed60 0x7f9c78071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:01.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.745+0000 7f9c82ffd640 1 -- 172.21.15.71:0/3795009234 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9c740adad0 con 0x7f9c8c1014c0 2024-09-10T10:01:01.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.745+0000 7f9c8a59c640 1 --2- 172.21.15.71:0/3795009234 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f9c7806ed60 0x7f9c78071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:01.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.746+0000 7f9c8a59c640 1 --2- 172.21.15.71:0/3795009234 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f9c7806ed60 0x7f9c78071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c004ed0 tx=0x7f9c7c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:01.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.749+0000 7f9c82ffd640 1 -- 172.21.15.71:0/3795009234 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9c7407afe0 con 0x7f9c8c1014c0 2024-09-10T10:01:01.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:01 smithi107 ceph-mon[34215]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:01.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.901+0000 7f9c90f5b640 1 -- 172.21.15.71:0/3795009234 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c8c108460 con 0x7f9c7806ed60 2024-09-10T10:01:01.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.902+0000 7f9c82ffd640 1 -- 172.21.15.71:0/3795009234 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27780 (secure 0 0 0) 0x7f9c8c108460 con 0x7f9c7806ed60 2024-09-10T10:01:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:01:01.904 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-10T10:01:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.904+0000 7f9c90f5b640 1 -- 172.21.15.71:0/3795009234 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f9c7806ed60 msgr2=0x7f9c78071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.904+0000 7f9c90f5b640 1 --2- 172.21.15.71:0/3795009234 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f9c7806ed60 0x7f9c78071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c004ed0 tx=0x7f9c7c00b040 comp rx=0 tx=0).stop 2024-09-10T10:01:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.904+0000 7f9c90f5b640 1 -- 172.21.15.71:0/3795009234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c8c1014c0 msgr2=0x7f9c8c112630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.904+0000 7f9c90f5b640 1 --2- 172.21.15.71:0/3795009234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c8c1014c0 0x7f9c8c112630 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9c74000c00 tx=0x7f9c74009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.904+0000 7f9c90f5b640 1 -- 172.21.15.71:0/3795009234 shutdown_connections 2024-09-10T10:01:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.904+0000 7f9c90f5b640 1 --2- 172.21.15.71:0/3795009234 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f9c7806ed60 0x7f9c78071210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.904+0000 7f9c90f5b640 1 --2- 172.21.15.71:0/3795009234 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c8c1014c0 0x7f9c8c112630 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.904+0000 7f9c90f5b640 1 --2- 172.21.15.71:0/3795009234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c8c0fb480 0x7f9c8c1120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.904+0000 7f9c90f5b640 1 -- 172.21.15.71:0/3795009234 >> 172.21.15.71:0/3795009234 conn(0x7f9c8c0f7000 msgr2=0x7f9c8c0f8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.905+0000 7f9c90f5b640 1 -- 172.21.15.71:0/3795009234 shutdown_connections 2024-09-10T10:01:01.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:01.905+0000 7f9c90f5b640 1 -- 172.21.15.71:0/3795009234 wait complete. 2024-09-10T10:01:02.577 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:02 smithi071 ceph-mon[27559]: from='client.14408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:01:02.578 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-10T10:01:00.350150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1792072,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560678840,"statfs":{"total":575970213888,"available":574135132160,"internally_reserved":0,"allocated":3919872,"data_stored":2576304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001838"},"pg_stats":[{"pgid":"1.0","version":"24'72","reported_seq":128,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-10T10:00:12.132989+0000","last_change":"2024-09-10T09:59:47.315301+0000","last_active":"2024-09-10T10:00:12.132989+0000","last_peered":"2024-09-10T10:00:12.132989+0000","last_clean":"2024-09-10T10:00:12.132989+0000","last_became_active":"2024-09-10T09:59:47.315029+0000","last_became_peered":"2024-09-10T09:59:47.315029+0000","last_unstale":"2024-09-10T10:00:12.132989+0000","last_undegraded":"2024-09-10T10:00:12.132989+0000","last_fullsized":"2024-09-10T10:00:12.132989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:59:01.234011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:59:01.234011+0000","last_clean_scrub_stamp":"2024-09-10T09:59:01.234011+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:51.572175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447444,"statfs":{"total":95995035648,"available":95690182656,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 10:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.315}]},{"osd":1,"last update":"Tue Sep 10 10:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.52400000000000002}]},{"osd":2,"last update":"Tue Sep 10 10:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.41999999999999998}]},{"osd":3,"last update":"Tue Sep 10 10:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 10:00:23 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.377},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.40799999999999997}]},{"osd":1,"last update":"Tue Sep 10 10:00:23 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.435}]},{"osd":2,"last update":"Tue Sep 10 10:00:23 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45500000000000002}]},{"osd":4,"last update":"Tue Sep 10 10:00:48 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.34599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447444,"statfs":{"total":95995035648,"available":95690182656,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 10:00:00 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.30399999999999999}]},{"osd":1,"last update":"Tue Sep 10 10:00:00 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.318}]},{"osd":3,"last update":"Tue Sep 10 10:00:23 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Tue Sep 10 10:00:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":302380,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442772,"statfs":{"total":95995035648,"available":95685398528,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 10:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.31,"15min":0.308},"min":{"1min":0.22800000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32200000000000001},"min":{"1min":0.24099999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.39400000000000002,"5min":0.437,"15min":0.437},"last":0.247}]},{"osd":2,"last update":"Tue Sep 10 10:00:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.27600000000000002}]},{"osd":3,"last update":"Tue Sep 10 10:00:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Sep 10 10:00:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298284,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446868,"statfs":{"total":95995035648,"available":95689592832,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 10 10:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.309,"15min":0.309},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.42999999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.222},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.22,"5min":0.19,"15min":0.19},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.23400000000000001}]},{"osd":2,"last update":"Tue Sep 10 10:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.252},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.26200000000000001}]},{"osd":3,"last update":"Tue Sep 10 10:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.46600000000000003}]},{"osd":4,"last update":"Tue Sep 10 10:00:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.504},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:01:02.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:01:02.826 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:02.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:02 smithi107 ceph-mon[34215]: from='client.14408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:01:03.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:03 smithi071 ceph-mon[27559]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:03.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:03 smithi107 ceph-mon[34215]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.452+0000 7fe24559e640 1 -- 172.21.15.71:0/864335634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2400fb470 msgr2=0x7fe2400fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.452+0000 7fe24559e640 1 --2- 172.21.15.71:0/864335634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2400fb470 0x7fe2400fb8e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe2280048d0 tx=0x7fe228009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.452+0000 7fe24559e640 1 -- 172.21.15.71:0/864335634 shutdown_connections 2024-09-10T10:01:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.452+0000 7fe24559e640 1 --2- 172.21.15.71:0/864335634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2400fb470 0x7fe2400fb8e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.452+0000 7fe24559e640 1 --2- 172.21.15.71:0/864335634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2401014b0 0x7fe240101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.452+0000 7fe24559e640 1 -- 172.21.15.71:0/864335634 >> 172.21.15.71:0/864335634 conn(0x7fe2400f7030 msgr2=0x7fe2400f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.453+0000 7fe24559e640 1 -- 172.21.15.71:0/864335634 shutdown_connections 2024-09-10T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.453+0000 7fe24559e640 1 -- 172.21.15.71:0/864335634 wait complete. 2024-09-10T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.453+0000 7fe24559e640 1 Processor -- start 2024-09-10T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.453+0000 7fe24559e640 1 -- start start 2024-09-10T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.453+0000 7fe24559e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2400fb470 0x7fe2401120e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.453+0000 7fe24559e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2401014b0 0x7fe240112620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.453+0000 7fe24559e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe240112c20 con 0x7fe2400fb470 2024-09-10T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.453+0000 7fe24559e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24010c060 con 0x7fe2401014b0 2024-09-10T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.453+0000 7fe23effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2400fb470 0x7fe2401120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.454+0000 7fe23effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2400fb470 0x7fe2401120e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43064/0 (socket says 172.21.15.71:43064) 2024-09-10T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.454+0000 7fe23effd640 1 -- 172.21.15.71:0/87833583 learned_addr learned my addr 172.21.15.71:0/87833583 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.454+0000 7fe2367fc640 1 --2- 172.21.15.71:0/87833583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2401014b0 0x7fe240112620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.454+0000 7fe23effd640 1 -- 172.21.15.71:0/87833583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2401014b0 msgr2=0x7fe240112620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.454+0000 7fe23effd640 1 --2- 172.21.15.71:0/87833583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2401014b0 0x7fe240112620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.454+0000 7fe23effd640 1 -- 172.21.15.71:0/87833583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe228005040 con 0x7fe2400fb470 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.454+0000 7fe23effd640 1 --2- 172.21.15.71:0/87833583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2400fb470 0x7fe2401120e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe23000ea20 tx=0x7fe230004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.454+0000 7fe237fff640 1 -- 172.21.15.71:0/87833583 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe23000cc90 con 0x7fe2400fb470 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.454+0000 7fe237fff640 1 -- 172.21.15.71:0/87833583 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe23000cdf0 con 0x7fe2400fb470 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.454+0000 7fe24559e640 1 -- 172.21.15.71:0/87833583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24010c2e0 con 0x7fe2400fb470 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.454+0000 7fe237fff640 1 -- 172.21.15.71:0/87833583 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe230019880 con 0x7fe2400fb470 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.454+0000 7fe24559e640 1 -- 172.21.15.71:0/87833583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24010c850 con 0x7fe2400fb470 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.455+0000 7fe24559e640 1 -- 172.21.15.71:0/87833583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2400fcbb0 con 0x7fe2400fb470 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.456+0000 7fe237fff640 1 -- 172.21.15.71:0/87833583 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe230011c30 con 0x7fe2400fb470 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.456+0000 7fe237fff640 1 --2- 172.21.15.71:0/87833583 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe22c06ed50 0x7fe22c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.456+0000 7fe237fff640 1 -- 172.21.15.71:0/87833583 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe230015070 con 0x7fe2400fb470 2024-09-10T10:01:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.456+0000 7fe2367fc640 1 --2- 172.21.15.71:0/87833583 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe22c06ed50 0x7fe22c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.457+0000 7fe2367fc640 1 --2- 172.21.15.71:0/87833583 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe22c06ed50 0x7fe22c071200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe2400f7470 tx=0x7fe228035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.460+0000 7fe237fff640 1 -- 172.21.15.71:0/87833583 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe23005db30 con 0x7fe2400fb470 2024-09-10T10:01:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.615+0000 7fe24559e640 1 -- 172.21.15.71:0/87833583 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe24004b720 con 0x7fe22c06ed50 2024-09-10T10:01:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.617+0000 7fe237fff640 1 -- 172.21.15.71:0/87833583 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27834 (secure 0 0 0) 0x7fe24004b720 con 0x7fe22c06ed50 2024-09-10T10:01:04.618 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:01:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-10T10:01:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.619+0000 7fe24559e640 1 -- 172.21.15.71:0/87833583 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe22c06ed50 msgr2=0x7fe22c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.619+0000 7fe24559e640 1 --2- 172.21.15.71:0/87833583 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe22c06ed50 0x7fe22c071200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe2400f7470 tx=0x7fe228035040 comp rx=0 tx=0).stop 2024-09-10T10:01:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.619+0000 7fe24559e640 1 -- 172.21.15.71:0/87833583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2400fb470 msgr2=0x7fe2401120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.619+0000 7fe24559e640 1 --2- 172.21.15.71:0/87833583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2400fb470 0x7fe2401120e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe23000ea20 tx=0x7fe230004470 comp rx=0 tx=0).stop 2024-09-10T10:01:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.619+0000 7fe24559e640 1 -- 172.21.15.71:0/87833583 shutdown_connections 2024-09-10T10:01:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.619+0000 7fe24559e640 1 --2- 172.21.15.71:0/87833583 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe22c06ed50 0x7fe22c071200 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.619+0000 7fe24559e640 1 --2- 172.21.15.71:0/87833583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2401014b0 0x7fe240112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.619+0000 7fe24559e640 1 --2- 172.21.15.71:0/87833583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2400fb470 0x7fe2401120e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.619+0000 7fe24559e640 1 -- 172.21.15.71:0/87833583 >> 172.21.15.71:0/87833583 conn(0x7fe2400f7030 msgr2=0x7fe2400f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.619+0000 7fe24559e640 1 -- 172.21.15.71:0/87833583 shutdown_connections 2024-09-10T10:01:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:04.619+0000 7fe24559e640 1 -- 172.21.15.71:0/87833583 wait complete. 2024-09-10T10:01:05.357 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-10T10:01:04.350707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1792072,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560678840,"statfs":{"total":575970213888,"available":574135132160,"internally_reserved":0,"allocated":3919872,"data_stored":2576304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001865"},"pg_stats":[{"pgid":"1.0","version":"24'72","reported_seq":128,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-10T10:00:12.132989+0000","last_change":"2024-09-10T09:59:47.315301+0000","last_active":"2024-09-10T10:00:12.132989+0000","last_peered":"2024-09-10T10:00:12.132989+0000","last_clean":"2024-09-10T10:00:12.132989+0000","last_became_active":"2024-09-10T09:59:47.315029+0000","last_became_peered":"2024-09-10T09:59:47.315029+0000","last_unstale":"2024-09-10T10:00:12.132989+0000","last_undegraded":"2024-09-10T10:00:12.132989+0000","last_fullsized":"2024-09-10T10:00:12.132989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:59:01.234011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:59:01.234011+0000","last_clean_scrub_stamp":"2024-09-10T09:59:01.234011+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:51.572175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447444,"statfs":{"total":95995035648,"available":95690182656,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 10:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.48099999999999998}]},{"osd":1,"last update":"Tue Sep 10 10:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":19.077999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.44900000000000001}]},{"osd":2,"last update":"Tue Sep 10 10:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.495},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.435}]},{"osd":3,"last update":"Tue Sep 10 10:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 10:00:23 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.44800000000000001}]},{"osd":1,"last update":"Tue Sep 10 10:00:23 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.53900000000000003}]},{"osd":2,"last update":"Tue Sep 10 10:00:23 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Tue Sep 10 10:00:48 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.36099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447444,"statfs":{"total":95995035648,"available":95690182656,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 10:00:00 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.30399999999999999}]},{"osd":1,"last update":"Tue Sep 10 10:00:00 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.318}]},{"osd":3,"last update":"Tue Sep 10 10:00:23 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Tue Sep 10 10:00:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":302380,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442772,"statfs":{"total":95995035648,"available":95685398528,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 10:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.31,"15min":0.308},"min":{"1min":0.22800000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32200000000000001},"min":{"1min":0.24099999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.39400000000000002,"5min":0.437,"15min":0.437},"last":0.32300000000000001}]},{"osd":2,"last update":"Tue Sep 10 10:00:00 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.309}]},{"osd":3,"last update":"Tue Sep 10 10:00:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Tue Sep 10 10:00:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298284,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446868,"statfs":{"total":95995035648,"available":95689592832,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 10 10:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.309,"15min":0.309},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.42999999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.22,"5min":0.19,"15min":0.19},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Sep 10 10:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.27200000000000002}]},{"osd":3,"last update":"Tue Sep 10 10:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.44}]},{"osd":4,"last update":"Tue Sep 10 10:00:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:01:05.358 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T10:01:05.358 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T10:01:05.359 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T10:01:05.359 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T10:01:05.606 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:05.724 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:05 smithi071 ceph-mon[27559]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:05.724 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:05 smithi071 ceph-mon[27559]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:01:05.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:05 smithi107 ceph-mon[34215]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:05.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:05 smithi107 ceph-mon[34215]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:01:07.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.141+0000 7fb2fe82a640 1 -- 172.21.15.71:0/1504313499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f80fcf80 msgr2=0x7fb2f80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:07.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.141+0000 7fb2fe82a640 1 --2- 172.21.15.71:0/1504313499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f80fcf80 0x7fb2f80fd3d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0048d0 tx=0x7fb2ec009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:07.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.141+0000 7fb2fe82a640 1 -- 172.21.15.71:0/1504313499 shutdown_connections 2024-09-10T10:01:07.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.141+0000 7fb2fe82a640 1 --2- 172.21.15.71:0/1504313499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f80fcf80 0x7fb2f80fd3d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:07.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.141+0000 7fb2fe82a640 1 --2- 172.21.15.71:0/1504313499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f80fb810 0x7fb2f80fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:07.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.141+0000 7fb2fe82a640 1 -- 172.21.15.71:0/1504313499 >> 172.21.15.71:0/1504313499 conn(0x7fb2f80723b0 msgr2=0x7fb2f80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:07.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.141+0000 7fb2fe82a640 1 -- 172.21.15.71:0/1504313499 shutdown_connections 2024-09-10T10:01:07.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.141+0000 7fb2fe82a640 1 -- 172.21.15.71:0/1504313499 wait complete. 2024-09-10T10:01:07.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.141+0000 7fb2fe82a640 1 Processor -- start 2024-09-10T10:01:07.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.141+0000 7fb2fe82a640 1 -- start start 2024-09-10T10:01:07.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2fe82a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f80fb810 0x7fb2f8113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:07.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2fe82a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f80fcf80 0x7fb2f81136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:07.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2fe82a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f8113cc0 con 0x7fb2f80fb810 2024-09-10T10:01:07.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2fe82a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f810d100 con 0x7fb2f80fcf80 2024-09-10T10:01:07.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2f7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f80fb810 0x7fb2f8113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2f7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f80fb810 0x7fb2f8113180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43086/0 (socket says 172.21.15.71:43086) 2024-09-10T10:01:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2f7fff640 1 -- 172.21.15.71:0/3303215493 learned_addr learned my addr 172.21.15.71:0/3303215493 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2f77fe640 1 --2- 172.21.15.71:0/3303215493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f80fcf80 0x7fb2f81136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2f7fff640 1 -- 172.21.15.71:0/3303215493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f80fcf80 msgr2=0x7fb2f81136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2f7fff640 1 --2- 172.21.15.71:0/3303215493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f80fcf80 0x7fb2f81136c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2f7fff640 1 -- 172.21.15.71:0/3303215493 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec005040 con 0x7fb2f80fb810 2024-09-10T10:01:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2f7fff640 1 --2- 172.21.15.71:0/3303215493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f80fb810 0x7fb2f8113180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800c790 tx=0x7fb2e80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2f4ff9640 1 -- 172.21.15.71:0/3303215493 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e800a7a0 con 0x7fb2f80fb810 2024-09-10T10:01:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2fe82a640 1 -- 172.21.15.71:0/3303215493 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f810d3e0 con 0x7fb2f80fb810 2024-09-10T10:01:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2f4ff9640 1 -- 172.21.15.71:0/3303215493 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb2e800ada0 con 0x7fb2f80fb810 2024-09-10T10:01:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.142+0000 7fb2f4ff9640 1 -- 172.21.15.71:0/3303215493 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e80113a0 con 0x7fb2f80fb810 2024-09-10T10:01:07.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.143+0000 7fb2fe82a640 1 -- 172.21.15.71:0/3303215493 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f810d950 con 0x7fb2f80fb810 2024-09-10T10:01:07.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.144+0000 7fb2fe82a640 1 -- 172.21.15.71:0/3303215493 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f80fcbc0 con 0x7fb2f80fb810 2024-09-10T10:01:07.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.144+0000 7fb2f4ff9640 1 -- 172.21.15.71:0/3303215493 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb2e800a900 con 0x7fb2f80fb810 2024-09-10T10:01:07.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.145+0000 7fb2f4ff9640 1 --2- 172.21.15.71:0/3303215493 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb2e006ed60 0x7fb2e0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:07.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.145+0000 7fb2f4ff9640 1 -- 172.21.15.71:0/3303215493 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb2e808df00 con 0x7fb2f80fb810 2024-09-10T10:01:07.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.145+0000 7fb2f77fe640 1 --2- 172.21.15.71:0/3303215493 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb2e006ed60 0x7fb2e0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:07.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.145+0000 7fb2f77fe640 1 --2- 172.21.15.71:0/3303215493 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb2e006ed60 0x7fb2e0071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009ac0 tx=0x7fb2ec035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:07.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.149+0000 7fb2f4ff9640 1 -- 172.21.15.71:0/3303215493 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb2e805b3e0 con 0x7fb2f80fb810 2024-09-10T10:01:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.339+0000 7fb2fe82a640 1 -- 172.21.15.71:0/3303215493 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb2f8072ec0 con 0x7fb2f80fb810 2024-09-10T10:01:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.339+0000 7fb2f4ff9640 1 -- 172.21.15.71:0/3303215493 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb2e805ad80 con 0x7fb2f80fb810 2024-09-10T10:01:07.340 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:01:07.340 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T10:01:07.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.341+0000 7fb2fe82a640 1 -- 172.21.15.71:0/3303215493 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb2e006ed60 msgr2=0x7fb2e0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:07.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.341+0000 7fb2fe82a640 1 --2- 172.21.15.71:0/3303215493 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb2e006ed60 0x7fb2e0071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009ac0 tx=0x7fb2ec035040 comp rx=0 tx=0).stop 2024-09-10T10:01:07.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.341+0000 7fb2fe82a640 1 -- 172.21.15.71:0/3303215493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f80fb810 msgr2=0x7fb2f8113180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:07.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.341+0000 7fb2fe82a640 1 --2- 172.21.15.71:0/3303215493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f80fb810 0x7fb2f8113180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800c790 tx=0x7fb2e80043c0 comp rx=0 tx=0).stop 2024-09-10T10:01:07.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.341+0000 7fb2fe82a640 1 -- 172.21.15.71:0/3303215493 shutdown_connections 2024-09-10T10:01:07.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.341+0000 7fb2fe82a640 1 --2- 172.21.15.71:0/3303215493 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb2e006ed60 0x7fb2e0071210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:07.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.341+0000 7fb2fe82a640 1 --2- 172.21.15.71:0/3303215493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f80fcf80 0x7fb2f81136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:07.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.341+0000 7fb2fe82a640 1 --2- 172.21.15.71:0/3303215493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2f80fb810 0x7fb2f8113180 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:07.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.341+0000 7fb2fe82a640 1 -- 172.21.15.71:0/3303215493 >> 172.21.15.71:0/3303215493 conn(0x7fb2f80723b0 msgr2=0x7fb2f8065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:07.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.341+0000 7fb2fe82a640 1 -- 172.21.15.71:0/3303215493 shutdown_connections 2024-09-10T10:01:07.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:07.341+0000 7fb2fe82a640 1 -- 172.21.15.71:0/3303215493 wait complete. 2024-09-10T10:01:07.622 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:07 smithi071 ceph-mon[27559]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:07.623 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:07 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3303215493' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T10:01:07.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:07 smithi107 ceph-mon[34215]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:07.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:07 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3303215493' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T10:01:08.077 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T10:01:08.077 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T10:01:08.077 INFO:teuthology.run_tasks:Running task print... 2024-09-10T10:01:08.087 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-09-10T10:01:08.087 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T10:01:08.098 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T10:01:08.099 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-10T10:01:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:09.731 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:09 smithi071 ceph-mon[27559]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:09.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:09 smithi107 ceph-mon[34215]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.953+0000 7f1691d15640 1 -- 172.21.15.71:0/3871449971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f168c0fb450 msgr2=0x7f168c0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.953+0000 7f1691d15640 1 --2- 172.21.15.71:0/3871449971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f168c0fb450 0x7f168c0fb860 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f167c009c50 tx=0x7f167c004d10 comp rx=0 tx=0).stop 2024-09-10T10:01:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.953+0000 7f1691d15640 1 -- 172.21.15.71:0/3871449971 shutdown_connections 2024-09-10T10:01:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.953+0000 7f1691d15640 1 --2- 172.21.15.71:0/3871449971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f168c0fc720 0x7f168c0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.953+0000 7f1691d15640 1 --2- 172.21.15.71:0/3871449971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f168c0fb450 0x7f168c0fb860 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.953+0000 7f1691d15640 1 -- 172.21.15.71:0/3871449971 >> 172.21.15.71:0/3871449971 conn(0x7f168c0f6c10 msgr2=0x7f168c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.953+0000 7f1691d15640 1 -- 172.21.15.71:0/3871449971 shutdown_connections 2024-09-10T10:01:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.954+0000 7f1691d15640 1 -- 172.21.15.71:0/3871449971 wait complete. 2024-09-10T10:01:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.954+0000 7f1691d15640 1 Processor -- start 2024-09-10T10:01:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f1691d15640 1 -- start start 2024-09-10T10:01:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f1691d15640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f168c0fb450 0x7f168c10fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f1691d15640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f168c0fc720 0x7f168c1122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f1691d15640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c066750 con 0x7f168c0fc720 2024-09-10T10:01:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f1691d15640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0668c0 con 0x7f168c0fb450 2024-09-10T10:01:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f168affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f168c0fc720 0x7f168c1122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f168affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f168c0fc720 0x7f168c1122f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43102/0 (socket says 172.21.15.71:43102) 2024-09-10T10:01:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f168affd640 1 -- 172.21.15.71:0/3601299499 learned_addr learned my addr 172.21.15.71:0/3601299499 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f168b7fe640 1 --2- 172.21.15.71:0/3601299499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f168c0fb450 0x7f168c10fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f168affd640 1 -- 172.21.15.71:0/3601299499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f168c0fb450 msgr2=0x7f168c10fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f168affd640 1 --2- 172.21.15.71:0/3601299499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f168c0fb450 0x7f168c10fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f168affd640 1 -- 172.21.15.71:0/3601299499 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c0098b0 con 0x7f168c0fc720 2024-09-10T10:01:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f168b7fe640 1 --2- 172.21.15.71:0/3601299499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f168c0fb450 0x7f168c10fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:01:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f168affd640 1 --2- 172.21.15.71:0/3601299499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f168c0fc720 0x7f168c1122f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f168000c810 tx=0x7f16800043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f1673fff640 1 -- 172.21.15.71:0/3601299499 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f168000a820 con 0x7f168c0fc720 2024-09-10T10:01:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f1673fff640 1 -- 172.21.15.71:0/3601299499 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f168000ae20 con 0x7f168c0fc720 2024-09-10T10:01:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f1691d15640 1 -- 172.21.15.71:0/3601299499 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c112890 con 0x7f168c0fc720 2024-09-10T10:01:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.955+0000 7f1673fff640 1 -- 172.21.15.71:0/3601299499 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16800115c0 con 0x7f168c0fc720 2024-09-10T10:01:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.956+0000 7f1691d15640 1 -- 172.21.15.71:0/3601299499 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c112e00 con 0x7f168c0fc720 2024-09-10T10:01:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.957+0000 7f1691d15640 1 -- 172.21.15.71:0/3601299499 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c0fa8b0 con 0x7f168c0fc720 2024-09-10T10:01:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.957+0000 7f1673fff640 1 -- 172.21.15.71:0/3601299499 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1680012840 con 0x7f168c0fc720 2024-09-10T10:01:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.957+0000 7f1673fff640 1 --2- 172.21.15.71:0/3601299499 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f167406ed60 0x7f1674071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.958+0000 7f1673fff640 1 -- 172.21.15.71:0/3601299499 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f168008e380 con 0x7f168c0fc720 2024-09-10T10:01:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.958+0000 7f168b7fe640 1 --2- 172.21.15.71:0/3601299499 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f167406ed60 0x7f1674071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.958+0000 7f168b7fe640 1 --2- 172.21.15.71:0/3601299499 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f167406ed60 0x7f1674071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f167c000f80 tx=0x7f167c004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:09.961+0000 7f1673fff640 1 -- 172.21.15.71:0/3601299499 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f168005b360 con 0x7f168c0fc720 2024-09-10T10:01:10.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:10.116+0000 7f1691d15640 1 -- 172.21.15.71:0/3601299499 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f168c103fc0 con 0x7f168c0fc720 2024-09-10T10:01:10.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:10.120+0000 7f1673fff640 1 -- 172.21.15.71:0/3601299499 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f1680012e50 con 0x7f168c0fc720 2024-09-10T10:01:10.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:10.123+0000 7f1691d15640 1 -- 172.21.15.71:0/3601299499 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f167406ed60 msgr2=0x7f1674071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:10.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:10.123+0000 7f1691d15640 1 --2- 172.21.15.71:0/3601299499 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f167406ed60 0x7f1674071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f167c000f80 tx=0x7f167c004d10 comp rx=0 tx=0).stop 2024-09-10T10:01:10.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:10.123+0000 7f1691d15640 1 -- 172.21.15.71:0/3601299499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f168c0fc720 msgr2=0x7f168c1122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:10.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:10.123+0000 7f1691d15640 1 --2- 172.21.15.71:0/3601299499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f168c0fc720 0x7f168c1122f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f168000c810 tx=0x7f16800043c0 comp rx=0 tx=0).stop 2024-09-10T10:01:10.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:10.123+0000 7f1691d15640 1 -- 172.21.15.71:0/3601299499 shutdown_connections 2024-09-10T10:01:10.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:10.123+0000 7f1691d15640 1 --2- 172.21.15.71:0/3601299499 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f167406ed60 0x7f1674071210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:10.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:10.123+0000 7f1691d15640 1 --2- 172.21.15.71:0/3601299499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f168c0fc720 0x7f168c1122f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:10.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:10.123+0000 7f1691d15640 1 --2- 172.21.15.71:0/3601299499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f168c0fb450 0x7f168c10fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:10.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:10.123+0000 7f1691d15640 1 -- 172.21.15.71:0/3601299499 >> 172.21.15.71:0/3601299499 conn(0x7f168c0f6c10 msgr2=0x7f168c0f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:10.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:10.123+0000 7f1691d15640 1 -- 172.21.15.71:0/3601299499 shutdown_connections 2024-09-10T10:01:10.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:10.123+0000 7f1691d15640 1 -- 172.21.15.71:0/3601299499 wait complete. 2024-09-10T10:01:10.862 INFO:teuthology.run_tasks:Running task print... 2024-09-10T10:01:10.870 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-10T10:01:10.871 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T10:01:10.878 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T10:01:10.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T10:01:11.122 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:11.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:11 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3601299499' entity='client.admin' 2024-09-10T10:01:11.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:11 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:11.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:11 smithi107 ceph-mon[34215]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:11.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:11 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:11.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:11 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:11.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:11 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:11.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:11 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3601299499' entity='client.admin' 2024-09-10T10:01:11.456 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:11 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:11.457 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:11 smithi071 ceph-mon[27559]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:11.457 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:11 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:11.457 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:11 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:11.457 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:11 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.693+0000 7f79df144640 1 -- 172.21.15.71:0/738551384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d80fd820 msgr2=0x7f79d80fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.693+0000 7f79df144640 1 --2- 172.21.15.71:0/738551384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d80fd820 0x7f79d80fdc90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f79c40048d0 tx=0x7f79c4009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.693+0000 7f79df144640 1 -- 172.21.15.71:0/738551384 shutdown_connections 2024-09-10T10:01:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.693+0000 7f79df144640 1 --2- 172.21.15.71:0/738551384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d80fd820 0x7f79d80fdc90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.693+0000 7f79df144640 1 --2- 172.21.15.71:0/738551384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d80fc550 0x7f79d80fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.693+0000 7f79df144640 1 -- 172.21.15.71:0/738551384 >> 172.21.15.71:0/738551384 conn(0x7f79d80f7d30 msgr2=0x7f79d80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.693+0000 7f79df144640 1 -- 172.21.15.71:0/738551384 shutdown_connections 2024-09-10T10:01:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.693+0000 7f79df144640 1 -- 172.21.15.71:0/738551384 wait complete. 2024-09-10T10:01:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.693+0000 7f79df144640 1 Processor -- start 2024-09-10T10:01:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.694+0000 7f79df144640 1 -- start start 2024-09-10T10:01:12.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.694+0000 7f79df144640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d80fc550 0x7f79d810d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:12.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.694+0000 7f79df144640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d80fd820 0x7f79d810d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:12.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.694+0000 7f79df144640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d810e490 con 0x7f79d80fc550 2024-09-10T10:01:12.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.694+0000 7f79df144640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d810e600 con 0x7f79d80fd820 2024-09-10T10:01:12.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.694+0000 7f79dcee0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d80fc550 0x7f79d810d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:12.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.694+0000 7f79dcee0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d80fc550 0x7f79d810d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43116/0 (socket says 172.21.15.71:43116) 2024-09-10T10:01:12.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.694+0000 7f79dcee0640 1 -- 172.21.15.71:0/2048048851 learned_addr learned my addr 172.21.15.71:0/2048048851 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:12.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.694+0000 7f79d7fff640 1 --2- 172.21.15.71:0/2048048851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d80fd820 0x7f79d810d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:12.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.694+0000 7f79dcee0640 1 -- 172.21.15.71:0/2048048851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d80fd820 msgr2=0x7f79d810d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:12.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.694+0000 7f79dcee0640 1 --2- 172.21.15.71:0/2048048851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d80fd820 0x7f79d810d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:12.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.694+0000 7f79dcee0640 1 -- 172.21.15.71:0/2048048851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4005040 con 0x7f79d80fc550 2024-09-10T10:01:12.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.694+0000 7f79dcee0640 1 --2- 172.21.15.71:0/2048048851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d80fc550 0x7f79d810d0e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00b790 tx=0x7f79cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:12.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.695+0000 7f79d57fa640 1 -- 172.21.15.71:0/2048048851 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79cc00c700 con 0x7f79d80fc550 2024-09-10T10:01:12.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.695+0000 7f79d57fa640 1 -- 172.21.15.71:0/2048048851 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f79cc00cd00 con 0x7f79d80fc550 2024-09-10T10:01:12.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.695+0000 7f79df144640 1 -- 172.21.15.71:0/2048048851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d810e8e0 con 0x7f79d80fc550 2024-09-10T10:01:12.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.695+0000 7f79d57fa640 1 -- 172.21.15.71:0/2048048851 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79cc015e70 con 0x7f79d80fc550 2024-09-10T10:01:12.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.695+0000 7f79df144640 1 -- 172.21.15.71:0/2048048851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d810ee00 con 0x7f79d80fc550 2024-09-10T10:01:12.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.696+0000 7f79df144640 1 -- 172.21.15.71:0/2048048851 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d81057e0 con 0x7f79d80fc550 2024-09-10T10:01:12.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.696+0000 7f79d57fa640 1 -- 172.21.15.71:0/2048048851 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f79cc012070 con 0x7f79d80fc550 2024-09-10T10:01:12.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.697+0000 7f79d57fa640 1 --2- 172.21.15.71:0/2048048851 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f79c806ed60 0x7f79c8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:12.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.697+0000 7f79d57fa640 1 -- 172.21.15.71:0/2048048851 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f79cc08d9c0 con 0x7f79d80fc550 2024-09-10T10:01:12.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.697+0000 7f79d7fff640 1 --2- 172.21.15.71:0/2048048851 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f79c806ed60 0x7f79c8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:12.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.697+0000 7f79d7fff640 1 --2- 172.21.15.71:0/2048048851 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f79c806ed60 0x7f79c8071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f79c4007ac0 tx=0x7f79c4035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:12.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.701+0000 7f79d57fa640 1 -- 172.21.15.71:0/2048048851 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f79cc05ae20 con 0x7f79d80fc550 2024-09-10T10:01:12.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.867+0000 7f79df144640 1 -- 172.21.15.71:0/2048048851 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79d810f080 con 0x7f79c806ed60 2024-09-10T10:01:12.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.868+0000 7f79d57fa640 1 -- 172.21.15.71:0/2048048851 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f79d810f080 con 0x7f79c806ed60 2024-09-10T10:01:12.869 INFO:teuthology.orchestra.run.smithi071.stdout:Backend: cephadm 2024-09-10T10:01:12.869 INFO:teuthology.orchestra.run.smithi071.stdout:Available: Yes 2024-09-10T10:01:12.869 INFO:teuthology.orchestra.run.smithi071.stdout:Paused: No 2024-09-10T10:01:12.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.870+0000 7f79df144640 1 -- 172.21.15.71:0/2048048851 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f79c806ed60 msgr2=0x7f79c8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:12.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.870+0000 7f79df144640 1 --2- 172.21.15.71:0/2048048851 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f79c806ed60 0x7f79c8071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f79c4007ac0 tx=0x7f79c4035040 comp rx=0 tx=0).stop 2024-09-10T10:01:12.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.870+0000 7f79df144640 1 -- 172.21.15.71:0/2048048851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d80fc550 msgr2=0x7f79d810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:12.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.870+0000 7f79df144640 1 --2- 172.21.15.71:0/2048048851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d80fc550 0x7f79d810d0e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00b790 tx=0x7f79cc0091d0 comp rx=0 tx=0).stop 2024-09-10T10:01:12.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.870+0000 7f79df144640 1 -- 172.21.15.71:0/2048048851 shutdown_connections 2024-09-10T10:01:12.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.870+0000 7f79df144640 1 --2- 172.21.15.71:0/2048048851 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f79c806ed60 0x7f79c8071210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:12.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.870+0000 7f79df144640 1 --2- 172.21.15.71:0/2048048851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d80fd820 0x7f79d810d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:12.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.870+0000 7f79df144640 1 --2- 172.21.15.71:0/2048048851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79d80fc550 0x7f79d810d0e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:12.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.870+0000 7f79df144640 1 -- 172.21.15.71:0/2048048851 >> 172.21.15.71:0/2048048851 conn(0x7f79d80f7d30 msgr2=0x7f79d80f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:12.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.870+0000 7f79df144640 1 -- 172.21.15.71:0/2048048851 shutdown_connections 2024-09-10T10:01:12.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:12.870+0000 7f79df144640 1 -- 172.21.15.71:0/2048048851 wait complete. 2024-09-10T10:01:13.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:13 smithi071 ceph-mon[27559]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:13.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:13 smithi071 ceph-mon[27559]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:13.597 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T10:01:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:13.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:13 smithi107 ceph-mon[34215]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:13.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:13 smithi107 ceph-mon[34215]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:14.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:01:14.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:01:15.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.402+0000 7f3ceaf01640 1 -- 172.21.15.71:0/4138532723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ce40fc520 msgr2=0x7f3ce40fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:15.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.402+0000 7f3ceaf01640 1 --2- 172.21.15.71:0/4138532723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ce40fc520 0x7f3ce40fc930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80048d0 tx=0x7f3cd8009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:15.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.402+0000 7f3ceaf01640 1 -- 172.21.15.71:0/4138532723 shutdown_connections 2024-09-10T10:01:15.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.402+0000 7f3ceaf01640 1 --2- 172.21.15.71:0/4138532723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ce40fd7f0 0x7f3ce40fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:15.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.402+0000 7f3ceaf01640 1 --2- 172.21.15.71:0/4138532723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ce40fc520 0x7f3ce40fc930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:15.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.402+0000 7f3ceaf01640 1 -- 172.21.15.71:0/4138532723 >> 172.21.15.71:0/4138532723 conn(0x7f3ce40f7ce0 msgr2=0x7f3ce40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:15.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.402+0000 7f3ceaf01640 1 -- 172.21.15.71:0/4138532723 shutdown_connections 2024-09-10T10:01:15.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.402+0000 7f3ceaf01640 1 -- 172.21.15.71:0/4138532723 wait complete. 2024-09-10T10:01:15.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.402+0000 7f3ceaf01640 1 Processor -- start 2024-09-10T10:01:15.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.402+0000 7f3ceaf01640 1 -- start start 2024-09-10T10:01:15.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.403+0000 7f3ceaf01640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ce40fc520 0x7f3ce410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:15.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.403+0000 7f3ceaf01640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ce40fd7f0 0x7f3ce410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:15.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.403+0000 7f3ceaf01640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce410dc10 con 0x7f3ce40fd7f0 2024-09-10T10:01:15.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.403+0000 7f3ceaf01640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce410e430 con 0x7f3ce40fc520 2024-09-10T10:01:15.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.403+0000 7f3ce3fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ce40fd7f0 0x7f3ce410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:15.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.403+0000 7f3ce3fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ce40fd7f0 0x7f3ce410d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54970/0 (socket says 172.21.15.71:54970) 2024-09-10T10:01:15.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.403+0000 7f3ce3fff640 1 -- 172.21.15.71:0/273023428 learned_addr learned my addr 172.21.15.71:0/273023428 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:15.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.403+0000 7f3ce8c9d640 1 --2- 172.21.15.71:0/273023428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ce40fc520 0x7f3ce410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:15.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.403+0000 7f3ce3fff640 1 -- 172.21.15.71:0/273023428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ce40fc520 msgr2=0x7f3ce410d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:15.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.403+0000 7f3ce3fff640 1 --2- 172.21.15.71:0/273023428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ce40fc520 0x7f3ce410d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:15.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.403+0000 7f3ce3fff640 1 -- 172.21.15.71:0/273023428 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd8005040 con 0x7f3ce40fd7f0 2024-09-10T10:01:15.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.403+0000 7f3ce3fff640 1 --2- 172.21.15.71:0/273023428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ce40fd7f0 0x7f3ce410d5c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000c810 tx=0x7f3cd00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:15.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.404+0000 7f3ce17fa640 1 -- 172.21.15.71:0/273023428 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd000a7a0 con 0x7f3ce40fd7f0 2024-09-10T10:01:15.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.404+0000 7f3ceaf01640 1 -- 172.21.15.71:0/273023428 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce410e6c0 con 0x7f3ce40fd7f0 2024-09-10T10:01:15.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.404+0000 7f3ce17fa640 1 -- 172.21.15.71:0/273023428 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3cd000ada0 con 0x7f3ce40fd7f0 2024-09-10T10:01:15.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.404+0000 7f3ce17fa640 1 -- 172.21.15.71:0/273023428 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd0011380 con 0x7f3ce40fd7f0 2024-09-10T10:01:15.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.404+0000 7f3ceaf01640 1 -- 172.21.15.71:0/273023428 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce410ec60 con 0x7f3ce40fd7f0 2024-09-10T10:01:15.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.405+0000 7f3ceaf01640 1 -- 172.21.15.71:0/273023428 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce40fb980 con 0x7f3ce40fd7f0 2024-09-10T10:01:15.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.405+0000 7f3ce17fa640 1 -- 172.21.15.71:0/273023428 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f3cd00127d0 con 0x7f3ce40fd7f0 2024-09-10T10:01:15.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.405+0000 7f3ce17fa640 1 --2- 172.21.15.71:0/273023428 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f3cd406ed60 0x7f3cd4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:15.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.405+0000 7f3ce17fa640 1 -- 172.21.15.71:0/273023428 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3cd008e300 con 0x7f3ce40fd7f0 2024-09-10T10:01:15.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.406+0000 7f3ce8c9d640 1 --2- 172.21.15.71:0/273023428 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f3cd406ed60 0x7f3cd4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:15.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.406+0000 7f3ce8c9d640 1 --2- 172.21.15.71:0/273023428 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f3cd406ed60 0x7f3cd4071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8000c00 tx=0x7f3cd8035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:15.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.410+0000 7f3ce17fa640 1 -- 172.21.15.71:0/273023428 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3cd005b2e0 con 0x7f3ce40fd7f0 2024-09-10T10:01:15.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:15 smithi071 ceph-mon[27559]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:15.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.573+0000 7f3ceaf01640 1 -- 172.21.15.71:0/273023428 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ce410eff0 con 0x7f3cd406ed60 2024-09-10T10:01:15.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.581+0000 7f3ce17fa640 1 -- 172.21.15.71:0/273023428 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2826 (secure 0 0 0) 0x7f3ce410eff0 con 0x7f3cd406ed60 2024-09-10T10:01:15.583 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:01:15.583 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (3m) 2m ago 5m 26.5M - 0.25.0 c8568f914cd2 b3a4270190ef 2024-09-10T10:01:15.583 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (5m) 2m ago 5m 6891k - 17.2.7-1597-g96d63e75 f3fc7d52e233 f70481a4c3c7 2024-09-10T10:01:15.583 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (4m) 65s ago 4m 6895k - 17.2.7-1597-g96d63e75 f3fc7d52e233 cf27ebcc0f98 2024-09-10T10:01:15.583 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (3m) 2m ago 4m 77.1M - 9.4.7 954c08fa6188 1998c9de2d92 2024-09-10T10:01:15.583 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:9283,8765,8443 running (6m) 2m ago 6m 438M - 17.2.7-1597-g96d63e75 f3fc7d52e233 dc0e497fa11e 2024-09-10T10:01:15.583 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283 running (4m) 65s ago 4m 400M - 17.2.7-1597-g96d63e75 f3fc7d52e233 d93840908437 2024-09-10T10:01:15.583 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (6m) 2m ago 6m 44.8M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 35e491e574a3 2024-09-10T10:01:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (4m) 65s ago 4m 38.4M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 682e2b6e311f 2024-09-10T10:01:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (5m) 2m ago 5m 15.4M - 1.5.0 0da6a335fe13 acc088fb47d4 2024-09-10T10:01:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (4m) 65s ago 4m 15.7M - 1.5.0 0da6a335fe13 12be03d3d11f 2024-09-10T10:01:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (3m) 2m ago 3m 36.9M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 a79e69c9b514 2024-09-10T10:01:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (2m) 2m ago 2m 35.6M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 44a84bf577da 2024-09-10T10:01:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (2m) 2m ago 2m 12.5M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 4fae52756a24 2024-09-10T10:01:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (119s) 65s ago 119s 41.0M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:01:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (95s) 65s ago 94s 37.1M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:01:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (70s) 65s ago 70s 11.3M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:01:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (3m) 2m ago 4m 36.0M - 2.43.0 a07b618ecd1d 1a619aeb5698 2024-09-10T10:01:15.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.582+0000 7f3ceaf01640 1 -- 172.21.15.71:0/273023428 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f3cd406ed60 msgr2=0x7f3cd4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:15.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.582+0000 7f3ceaf01640 1 --2- 172.21.15.71:0/273023428 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f3cd406ed60 0x7f3cd4071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8000c00 tx=0x7f3cd8035040 comp rx=0 tx=0).stop 2024-09-10T10:01:15.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.582+0000 7f3ceaf01640 1 -- 172.21.15.71:0/273023428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ce40fd7f0 msgr2=0x7f3ce410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:15.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.582+0000 7f3ceaf01640 1 --2- 172.21.15.71:0/273023428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ce40fd7f0 0x7f3ce410d5c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000c810 tx=0x7f3cd00043c0 comp rx=0 tx=0).stop 2024-09-10T10:01:15.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.583+0000 7f3ceaf01640 1 -- 172.21.15.71:0/273023428 shutdown_connections 2024-09-10T10:01:15.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.583+0000 7f3ceaf01640 1 --2- 172.21.15.71:0/273023428 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f3cd406ed60 0x7f3cd4071210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:15.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.583+0000 7f3ceaf01640 1 --2- 172.21.15.71:0/273023428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ce40fd7f0 0x7f3ce410d5c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:15.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.583+0000 7f3ceaf01640 1 --2- 172.21.15.71:0/273023428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ce40fc520 0x7f3ce410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:15.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.583+0000 7f3ceaf01640 1 -- 172.21.15.71:0/273023428 >> 172.21.15.71:0/273023428 conn(0x7f3ce40f7ce0 msgr2=0x7f3ce40f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:15.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.583+0000 7f3ceaf01640 1 -- 172.21.15.71:0/273023428 shutdown_connections 2024-09-10T10:01:15.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:15.583+0000 7f3ceaf01640 1 -- 172.21.15.71:0/273023428 wait complete. 2024-09-10T10:01:15.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:15 smithi107 ceph-mon[34215]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:16.241 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T10:01:16.488 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:16.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:16 smithi071 ceph-mon[27559]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:16.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:16 smithi107 ceph-mon[34215]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:17.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:17 smithi071 ceph-mon[27559]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:17 smithi107 ceph-mon[34215]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.002+0000 7fef708e4640 1 -- 172.21.15.71:0/2513379213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c0fc700 msgr2=0x7fef6c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.002+0000 7fef708e4640 1 --2- 172.21.15.71:0/2513379213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c0fc700 0x7fef6c0fcb70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef600048d0 tx=0x7fef60009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.002+0000 7fef708e4640 1 -- 172.21.15.71:0/2513379213 shutdown_connections 2024-09-10T10:01:18.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.002+0000 7fef708e4640 1 --2- 172.21.15.71:0/2513379213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c0fc700 0x7fef6c0fcb70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:18.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.002+0000 7fef708e4640 1 --2- 172.21.15.71:0/2513379213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef6c0fb430 0x7fef6c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:18.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.002+0000 7fef708e4640 1 -- 172.21.15.71:0/2513379213 >> 172.21.15.71:0/2513379213 conn(0x7fef6c0f6c10 msgr2=0x7fef6c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:18.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.002+0000 7fef708e4640 1 -- 172.21.15.71:0/2513379213 shutdown_connections 2024-09-10T10:01:18.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.002+0000 7fef708e4640 1 -- 172.21.15.71:0/2513379213 wait complete. 2024-09-10T10:01:18.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.003+0000 7fef708e4640 1 Processor -- start 2024-09-10T10:01:18.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.003+0000 7fef708e4640 1 -- start start 2024-09-10T10:01:18.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.003+0000 7fef708e4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c0fb430 0x7fef6c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:18.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.003+0000 7fef708e4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef6c0fc700 0x7fef6c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:18.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.003+0000 7fef708e4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c10e460 con 0x7fef6c0fb430 2024-09-10T10:01:18.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.003+0000 7fef708e4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c10e5d0 con 0x7fef6c0fc700 2024-09-10T10:01:18.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.003+0000 7fef6a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c0fb430 0x7fef6c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:18.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.003+0000 7fef6a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c0fb430 0x7fef6c10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54982/0 (socket says 172.21.15.71:54982) 2024-09-10T10:01:18.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.003+0000 7fef6a59c640 1 -- 172.21.15.71:0/1558011213 learned_addr learned my addr 172.21.15.71:0/1558011213 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:18.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.003+0000 7fef69d9b640 1 --2- 172.21.15.71:0/1558011213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef6c0fc700 0x7fef6c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:18.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.004+0000 7fef6a59c640 1 -- 172.21.15.71:0/1558011213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef6c0fc700 msgr2=0x7fef6c10d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:18.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.004+0000 7fef6a59c640 1 --2- 172.21.15.71:0/1558011213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef6c0fc700 0x7fef6c10d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:18.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.004+0000 7fef6a59c640 1 -- 172.21.15.71:0/1558011213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef60005040 con 0x7fef6c0fb430 2024-09-10T10:01:18.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.004+0000 7fef6a59c640 1 --2- 172.21.15.71:0/1558011213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c0fb430 0x7fef6c10d0b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00b790 tx=0x7fef5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:18.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.004+0000 7fef5affd640 1 -- 172.21.15.71:0/1558011213 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef5c00c700 con 0x7fef6c0fb430 2024-09-10T10:01:18.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.004+0000 7fef708e4640 1 -- 172.21.15.71:0/1558011213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c10e8b0 con 0x7fef6c0fb430 2024-09-10T10:01:18.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.004+0000 7fef5affd640 1 -- 172.21.15.71:0/1558011213 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fef5c00cd00 con 0x7fef6c0fb430 2024-09-10T10:01:18.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.004+0000 7fef5affd640 1 -- 172.21.15.71:0/1558011213 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef5c015e80 con 0x7fef6c0fb430 2024-09-10T10:01:18.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.004+0000 7fef708e4640 1 -- 172.21.15.71:0/1558011213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c10edd0 con 0x7fef6c0fb430 2024-09-10T10:01:18.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.005+0000 7fef708e4640 1 -- 172.21.15.71:0/1558011213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c1046c0 con 0x7fef6c0fb430 2024-09-10T10:01:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.006+0000 7fef5affd640 1 -- 172.21.15.71:0/1558011213 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fef5c012070 con 0x7fef6c0fb430 2024-09-10T10:01:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.006+0000 7fef5affd640 1 --2- 172.21.15.71:0/1558011213 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fef5406ed60 0x7fef54071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.006+0000 7fef69d9b640 1 --2- 172.21.15.71:0/1558011213 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fef5406ed60 0x7fef54071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.006+0000 7fef5affd640 1 -- 172.21.15.71:0/1558011213 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fef5c08d6c0 con 0x7fef6c0fb430 2024-09-10T10:01:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.007+0000 7fef69d9b640 1 --2- 172.21.15.71:0/1558011213 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fef5406ed60 0x7fef54071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fef6c10ce60 tx=0x7fef60035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:18.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.010+0000 7fef5affd640 1 -- 172.21.15.71:0/1558011213 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fef5c05ab20 con 0x7fef6c0fb430 2024-09-10T10:01:18.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.172+0000 7fef708e4640 1 -- 172.21.15.71:0/1558011213 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fef6c103eb0 con 0x7fef5406ed60 2024-09-10T10:01:18.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.177+0000 7fef5affd640 1 -- 172.21.15.71:0/1558011213 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7fef6c103eb0 con 0x7fef5406ed60 2024-09-10T10:01:18.179 INFO:teuthology.orchestra.run.smithi071.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T10:01:18.179 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-10T10:01:18.179 INFO:teuthology.orchestra.run.smithi071.stdout:crash 2/2 2m ago 5m * 2024-09-10T10:01:18.179 INFO:teuthology.orchestra.run.smithi071.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-10T10:01:18.179 INFO:teuthology.orchestra.run.smithi071.stdout:mgr 2/2 2m ago 5m count:2 2024-09-10T10:01:18.180 INFO:teuthology.orchestra.run.smithi071.stdout:mon 2/2 2m ago 5m smithi071:172.21.15.71=smithi071;smithi107:172.21.15.107=smithi107;count:2 2024-09-10T10:01:18.180 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-10T10:01:18.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd 6 2m ago - 2024-09-10T10:01:18.180 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-10T10:01:18.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.179+0000 7fef708e4640 1 -- 172.21.15.71:0/1558011213 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fef5406ed60 msgr2=0x7fef54071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:18.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.179+0000 7fef708e4640 1 --2- 172.21.15.71:0/1558011213 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fef5406ed60 0x7fef54071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fef6c10ce60 tx=0x7fef60035040 comp rx=0 tx=0).stop 2024-09-10T10:01:18.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.179+0000 7fef708e4640 1 -- 172.21.15.71:0/1558011213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c0fb430 msgr2=0x7fef6c10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:18.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.179+0000 7fef708e4640 1 --2- 172.21.15.71:0/1558011213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c0fb430 0x7fef6c10d0b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00b790 tx=0x7fef5c0091d0 comp rx=0 tx=0).stop 2024-09-10T10:01:18.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.179+0000 7fef708e4640 1 -- 172.21.15.71:0/1558011213 shutdown_connections 2024-09-10T10:01:18.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.179+0000 7fef708e4640 1 --2- 172.21.15.71:0/1558011213 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fef5406ed60 0x7fef54071210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:18.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.179+0000 7fef708e4640 1 --2- 172.21.15.71:0/1558011213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef6c0fc700 0x7fef6c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:18.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.179+0000 7fef708e4640 1 --2- 172.21.15.71:0/1558011213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c0fb430 0x7fef6c10d0b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:18.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.179+0000 7fef708e4640 1 -- 172.21.15.71:0/1558011213 >> 172.21.15.71:0/1558011213 conn(0x7fef6c0f6c10 msgr2=0x7fef6c065530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:18.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.180+0000 7fef708e4640 1 -- 172.21.15.71:0/1558011213 shutdown_connections 2024-09-10T10:01:18.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:18.180+0000 7fef708e4640 1 -- 172.21.15.71:0/1558011213 wait complete. 2024-09-10T10:01:18.831 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T10:01:19.074 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:19.494 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:19 smithi071 ceph-mon[27559]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:19.494 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:19 smithi071 ceph-mon[27559]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:19.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:19 smithi107 ceph-mon[34215]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:19.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:19 smithi107 ceph-mon[34215]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:20.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.635+0000 7fb87ac6c640 1 -- 172.21.15.71:0/1592737477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8740fb430 msgr2=0x7fb8740fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:20.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.635+0000 7fb87ac6c640 1 --2- 172.21.15.71:0/1592737477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8740fb430 0x7fb8740fb840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb8680048d0 tx=0x7fb868009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:20.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.635+0000 7fb87ac6c640 1 -- 172.21.15.71:0/1592737477 shutdown_connections 2024-09-10T10:01:20.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.635+0000 7fb87ac6c640 1 --2- 172.21.15.71:0/1592737477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8740fc700 0x7fb8740fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:20.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.635+0000 7fb87ac6c640 1 --2- 172.21.15.71:0/1592737477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8740fb430 0x7fb8740fb840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:20.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.635+0000 7fb87ac6c640 1 -- 172.21.15.71:0/1592737477 >> 172.21.15.71:0/1592737477 conn(0x7fb8740f6c10 msgr2=0x7fb8740f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:20.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.635+0000 7fb87ac6c640 1 -- 172.21.15.71:0/1592737477 shutdown_connections 2024-09-10T10:01:20.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.635+0000 7fb87ac6c640 1 -- 172.21.15.71:0/1592737477 wait complete. 2024-09-10T10:01:20.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.635+0000 7fb87ac6c640 1 Processor -- start 2024-09-10T10:01:20.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.635+0000 7fb87ac6c640 1 -- start start 2024-09-10T10:01:20.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb87ac6c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8740fb430 0x7fb87410bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:20.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb87ac6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8740fc700 0x7fb87410c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:20.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb87ac6c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87410cb10 con 0x7fb8740fb430 2024-09-10T10:01:20.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb87ac6c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87410d330 con 0x7fb8740fc700 2024-09-10T10:01:20.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb878a08640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8740fb430 0x7fb87410bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:20.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb878a08640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8740fb430 0x7fb87410bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54996/0 (socket says 172.21.15.71:54996) 2024-09-10T10:01:20.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb878a08640 1 -- 172.21.15.71:0/4084975207 learned_addr learned my addr 172.21.15.71:0/4084975207 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:20.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb873fff640 1 --2- 172.21.15.71:0/4084975207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8740fc700 0x7fb87410c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:20.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb878a08640 1 -- 172.21.15.71:0/4084975207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8740fc700 msgr2=0x7fb87410c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:20.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb878a08640 1 --2- 172.21.15.71:0/4084975207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8740fc700 0x7fb87410c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:20.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb878a08640 1 -- 172.21.15.71:0/4084975207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb868005040 con 0x7fb8740fb430 2024-09-10T10:01:20.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb878a08640 1 --2- 172.21.15.71:0/4084975207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8740fb430 0x7fb87410bf80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb8680043d0 tx=0x7fb868009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:20.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb8717fa640 1 -- 172.21.15.71:0/4084975207 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb868038070 con 0x7fb8740fb430 2024-09-10T10:01:20.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb8717fa640 1 -- 172.21.15.71:0/4084975207 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb86802ae90 con 0x7fb8740fb430 2024-09-10T10:01:20.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb87ac6c640 1 -- 172.21.15.71:0/4084975207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87410d560 con 0x7fb8740fb430 2024-09-10T10:01:20.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb8717fa640 1 -- 172.21.15.71:0/4084975207 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb86803e670 con 0x7fb8740fb430 2024-09-10T10:01:20.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.636+0000 7fb87ac6c640 1 -- 172.21.15.71:0/4084975207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87410db00 con 0x7fb8740fb430 2024-09-10T10:01:20.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.637+0000 7fb87ac6c640 1 -- 172.21.15.71:0/4084975207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8740fa890 con 0x7fb8740fb430 2024-09-10T10:01:20.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.638+0000 7fb8717fa640 1 -- 172.21.15.71:0/4084975207 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb868030020 con 0x7fb8740fb430 2024-09-10T10:01:20.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.638+0000 7fb8717fa640 1 --2- 172.21.15.71:0/4084975207 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb86406ed60 0x7fb864071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:20.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.639+0000 7fb873fff640 1 --2- 172.21.15.71:0/4084975207 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb86406ed60 0x7fb864071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:20.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.639+0000 7fb8717fa640 1 -- 172.21.15.71:0/4084975207 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb8680ae0e0 con 0x7fb8740fb430 2024-09-10T10:01:20.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.639+0000 7fb873fff640 1 --2- 172.21.15.71:0/4084975207 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb86406ed60 0x7fb864071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb860007fd0 tx=0x7fb860009e90 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:20.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.643+0000 7fb8717fa640 1 -- 172.21.15.71:0/4084975207 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb86807b540 con 0x7fb8740fb430 2024-09-10T10:01:20.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.808+0000 7fb87ac6c640 1 -- 172.21.15.71:0/4084975207 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb87410de30 con 0x7fb86406ed60 2024-09-10T10:01:20.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.810+0000 7fb8717fa640 1 -- 172.21.15.71:0/4084975207 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fb87410de30 con 0x7fb86406ed60 2024-09-10T10:01:20.812 INFO:teuthology.orchestra.run.smithi071.stdout:HOST ADDR LABELS STATUS 2024-09-10T10:01:20.812 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071 172.21.15.71 2024-09-10T10:01:20.812 INFO:teuthology.orchestra.run.smithi071.stdout:smithi107 172.21.15.107 2024-09-10T10:01:20.812 INFO:teuthology.orchestra.run.smithi071.stdout:2 hosts in cluster 2024-09-10T10:01:20.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.811+0000 7fb87ac6c640 1 -- 172.21.15.71:0/4084975207 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb86406ed60 msgr2=0x7fb864071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:20.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.811+0000 7fb87ac6c640 1 --2- 172.21.15.71:0/4084975207 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb86406ed60 0x7fb864071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb860007fd0 tx=0x7fb860009e90 comp rx=0 tx=0).stop 2024-09-10T10:01:20.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.812+0000 7fb87ac6c640 1 -- 172.21.15.71:0/4084975207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8740fb430 msgr2=0x7fb87410bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:20.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.812+0000 7fb87ac6c640 1 --2- 172.21.15.71:0/4084975207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8740fb430 0x7fb87410bf80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb8680043d0 tx=0x7fb868009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:20.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.812+0000 7fb87ac6c640 1 -- 172.21.15.71:0/4084975207 shutdown_connections 2024-09-10T10:01:20.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.812+0000 7fb87ac6c640 1 --2- 172.21.15.71:0/4084975207 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb86406ed60 0x7fb864071210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:20.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.812+0000 7fb87ac6c640 1 --2- 172.21.15.71:0/4084975207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8740fc700 0x7fb87410c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:20.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.812+0000 7fb87ac6c640 1 --2- 172.21.15.71:0/4084975207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8740fb430 0x7fb87410bf80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:20.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.812+0000 7fb87ac6c640 1 -- 172.21.15.71:0/4084975207 >> 172.21.15.71:0/4084975207 conn(0x7fb8740f6c10 msgr2=0x7fb8740f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:20.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.812+0000 7fb87ac6c640 1 -- 172.21.15.71:0/4084975207 shutdown_connections 2024-09-10T10:01:20.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:20.812+0000 7fb87ac6c640 1 -- 172.21.15.71:0/4084975207 wait complete. 2024-09-10T10:01:21.506 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T10:01:21.697 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:21 smithi107 ceph-mon[34215]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:21.698 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:21 smithi107 ceph-mon[34215]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:21.751 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:21.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:21 smithi071 ceph-mon[27559]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:21.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:21 smithi071 ceph-mon[27559]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.301+0000 7f4e7e06d640 1 -- 172.21.15.71:0/269373819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e780fe500 msgr2=0x7f4e780fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.301+0000 7f4e7e06d640 1 --2- 172.21.15.71:0/269373819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e780fe500 0x7f4e780fa660 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0048d0 tx=0x7f4e6c009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.301+0000 7f4e7e06d640 1 -- 172.21.15.71:0/269373819 shutdown_connections 2024-09-10T10:01:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.301+0000 7f4e7e06d640 1 --2- 172.21.15.71:0/269373819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e780fe500 0x7f4e780fa660 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.301+0000 7f4e7e06d640 1 --2- 172.21.15.71:0/269373819 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e780fdbb0 0x7f4e780fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.301+0000 7f4e7e06d640 1 -- 172.21.15.71:0/269373819 >> 172.21.15.71:0/269373819 conn(0x7f4e780f63b0 msgr2=0x7f4e780f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.301+0000 7f4e7e06d640 1 -- 172.21.15.71:0/269373819 shutdown_connections 2024-09-10T10:01:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.301+0000 7f4e7e06d640 1 -- 172.21.15.71:0/269373819 wait complete. 2024-09-10T10:01:23.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.302+0000 7f4e7e06d640 1 Processor -- start 2024-09-10T10:01:23.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.302+0000 7f4e7e06d640 1 -- start start 2024-09-10T10:01:23.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.302+0000 7f4e7e06d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e780fdbb0 0x7f4e7810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:23.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.302+0000 7f4e7e06d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e780fe500 0x7f4e7810d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:23.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.302+0000 7f4e7e06d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7810dc20 con 0x7f4e780fe500 2024-09-10T10:01:23.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.302+0000 7f4e7e06d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7810e440 con 0x7f4e780fdbb0 2024-09-10T10:01:23.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.302+0000 7f4e76ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e780fe500 0x7f4e7810d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:23.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.302+0000 7f4e76ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e780fe500 0x7f4e7810d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40840/0 (socket says 172.21.15.71:40840) 2024-09-10T10:01:23.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.302+0000 7f4e76ffd640 1 -- 172.21.15.71:0/1541736618 learned_addr learned my addr 172.21.15.71:0/1541736618 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:23.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.303+0000 7f4e777fe640 1 --2- 172.21.15.71:0/1541736618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e780fdbb0 0x7f4e7810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:23.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.303+0000 7f4e76ffd640 1 -- 172.21.15.71:0/1541736618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e780fdbb0 msgr2=0x7f4e7810d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:23.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.303+0000 7f4e76ffd640 1 --2- 172.21.15.71:0/1541736618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e780fdbb0 0x7f4e7810d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:23.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.303+0000 7f4e76ffd640 1 -- 172.21.15.71:0/1541736618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c005040 con 0x7f4e780fe500 2024-09-10T10:01:23.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.303+0000 7f4e76ffd640 1 --2- 172.21.15.71:0/1541736618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e780fe500 0x7f4e7810d5d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0048a0 tx=0x7f4e6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:23.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.303+0000 7f4e5ffff640 1 -- 172.21.15.71:0/1541736618 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e6c038070 con 0x7f4e780fe500 2024-09-10T10:01:23.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.303+0000 7f4e7e06d640 1 -- 172.21.15.71:0/1541736618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7810e670 con 0x7f4e780fe500 2024-09-10T10:01:23.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.303+0000 7f4e5ffff640 1 -- 172.21.15.71:0/1541736618 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4e6c02abd0 con 0x7f4e780fe500 2024-09-10T10:01:23.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.303+0000 7f4e5ffff640 1 -- 172.21.15.71:0/1541736618 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e6c033640 con 0x7f4e780fe500 2024-09-10T10:01:23.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.303+0000 7f4e7e06d640 1 -- 172.21.15.71:0/1541736618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7810ec10 con 0x7f4e780fe500 2024-09-10T10:01:23.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.304+0000 7f4e7e06d640 1 -- 172.21.15.71:0/1541736618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e780fa050 con 0x7f4e780fe500 2024-09-10T10:01:23.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.305+0000 7f4e5ffff640 1 -- 172.21.15.71:0/1541736618 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4e6c030020 con 0x7f4e780fe500 2024-09-10T10:01:23.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.305+0000 7f4e5ffff640 1 --2- 172.21.15.71:0/1541736618 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f4e6006ed60 0x7f4e60071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:23.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.305+0000 7f4e5ffff640 1 -- 172.21.15.71:0/1541736618 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4e6c0ae100 con 0x7f4e780fe500 2024-09-10T10:01:23.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.305+0000 7f4e777fe640 1 --2- 172.21.15.71:0/1541736618 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f4e6006ed60 0x7f4e60071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:23.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.305+0000 7f4e777fe640 1 --2- 172.21.15.71:0/1541736618 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f4e6006ed60 0x7f4e60071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4e68007fd0 tx=0x7f4e68009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:23.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.309+0000 7f4e5ffff640 1 -- 172.21.15.71:0/1541736618 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4e6c07b610 con 0x7f4e780fe500 2024-09-10T10:01:23.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.473+0000 7f4e7e06d640 1 -- 172.21.15.71:0/1541736618 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e7810ee30 con 0x7f4e6006ed60 2024-09-10T10:01:23.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.475+0000 7f4e5ffff640 1 -- 172.21.15.71:0/1541736618 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f4e7810ee30 con 0x7f4e6006ed60 2024-09-10T10:01:23.476 INFO:teuthology.orchestra.run.smithi071.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T10:01:23.476 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040172400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T10:01:23.476 INFO:teuthology.orchestra.run.smithi071.stdout:smithi107 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NK400BGN 372G No 70s ago Has a FileSystem, LVM detected 2024-09-10T10:01:23.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.477+0000 7f4e7e06d640 1 -- 172.21.15.71:0/1541736618 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f4e6006ed60 msgr2=0x7f4e60071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:23.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.477+0000 7f4e7e06d640 1 --2- 172.21.15.71:0/1541736618 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f4e6006ed60 0x7f4e60071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4e68007fd0 tx=0x7f4e68009040 comp rx=0 tx=0).stop 2024-09-10T10:01:23.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.477+0000 7f4e7e06d640 1 -- 172.21.15.71:0/1541736618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e780fe500 msgr2=0x7f4e7810d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:23.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.477+0000 7f4e7e06d640 1 --2- 172.21.15.71:0/1541736618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e780fe500 0x7f4e7810d5d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0048a0 tx=0x7f4e6c009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:23.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.477+0000 7f4e7e06d640 1 -- 172.21.15.71:0/1541736618 shutdown_connections 2024-09-10T10:01:23.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.477+0000 7f4e7e06d640 1 --2- 172.21.15.71:0/1541736618 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f4e6006ed60 0x7f4e60071210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:23.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.477+0000 7f4e7e06d640 1 --2- 172.21.15.71:0/1541736618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e780fe500 0x7f4e7810d5d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:23.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.477+0000 7f4e7e06d640 1 --2- 172.21.15.71:0/1541736618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e780fdbb0 0x7f4e7810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:23.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.477+0000 7f4e7e06d640 1 -- 172.21.15.71:0/1541736618 >> 172.21.15.71:0/1541736618 conn(0x7f4e780f63b0 msgr2=0x7f4e780f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:23.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.477+0000 7f4e7e06d640 1 -- 172.21.15.71:0/1541736618 shutdown_connections 2024-09-10T10:01:23.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:23.477+0000 7f4e7e06d640 1 -- 172.21.15.71:0/1541736618 wait complete. 2024-09-10T10:01:23.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:23 smithi071 ceph-mon[27559]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:23.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:23 smithi107 ceph-mon[34215]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:24.144 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T10:01:24.157 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T10:01:24.158 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-10T10:01:24.405 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:24.691 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:24 smithi071 ceph-mon[27559]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:24.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:24 smithi107 ceph-mon[34215]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:25.602 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:25 smithi071 ceph-mon[27559]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:25.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.810+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/1233525034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a540fc6f0 msgr2=0x7f0a540fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:25.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.810+0000 7f0a5c0c6640 1 --2- 172.21.15.71:0/1233525034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a540fc6f0 0x7f0a540fcb60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a440048d0 tx=0x7f0a44009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:25.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.810+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/1233525034 shutdown_connections 2024-09-10T10:01:25.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.810+0000 7f0a5c0c6640 1 --2- 172.21.15.71:0/1233525034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a540fc6f0 0x7f0a540fcb60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:25.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.810+0000 7f0a5c0c6640 1 --2- 172.21.15.71:0/1233525034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a540fb420 0x7f0a540fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:25.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.810+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/1233525034 >> 172.21.15.71:0/1233525034 conn(0x7f0a540f6c00 msgr2=0x7f0a540f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:25.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.810+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/1233525034 shutdown_connections 2024-09-10T10:01:25.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.810+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/1233525034 wait complete. 2024-09-10T10:01:25.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.811+0000 7f0a5c0c6640 1 Processor -- start 2024-09-10T10:01:25.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.811+0000 7f0a5c0c6640 1 -- start start 2024-09-10T10:01:25.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.811+0000 7f0a5c0c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a540fb420 0x7f0a5410bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:25.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.811+0000 7f0a5c0c6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a540fc6f0 0x7f0a5410c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.811+0000 7f0a5c0c6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5410d380 con 0x7f0a540fb420 2024-09-10T10:01:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.811+0000 7f0a5c0c6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5410d4f0 con 0x7f0a540fc6f0 2024-09-10T10:01:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.811+0000 7f0a59e62640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a540fb420 0x7f0a5410bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.811+0000 7f0a59e62640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a540fb420 0x7f0a5410bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40846/0 (socket says 172.21.15.71:40846) 2024-09-10T10:01:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.811+0000 7f0a59e62640 1 -- 172.21.15.71:0/992077451 learned_addr learned my addr 172.21.15.71:0/992077451 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.812+0000 7f0a59661640 1 --2- 172.21.15.71:0/992077451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a540fc6f0 0x7f0a5410c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.812+0000 7f0a59e62640 1 -- 172.21.15.71:0/992077451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a540fc6f0 msgr2=0x7f0a5410c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.812+0000 7f0a59e62640 1 --2- 172.21.15.71:0/992077451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a540fc6f0 0x7f0a5410c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.812+0000 7f0a59e62640 1 -- 172.21.15.71:0/992077451 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a44005040 con 0x7f0a540fb420 2024-09-10T10:01:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.812+0000 7f0a59661640 1 --2- 172.21.15.71:0/992077451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a540fc6f0 0x7f0a5410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:01:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.812+0000 7f0a59e62640 1 --2- 172.21.15.71:0/992077451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a540fb420 0x7f0a5410bfd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000b790 tx=0x7f0a500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.812+0000 7f0a4a7fc640 1 -- 172.21.15.71:0/992077451 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a5000c700 con 0x7f0a540fb420 2024-09-10T10:01:25.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.812+0000 7f0a4a7fc640 1 -- 172.21.15.71:0/992077451 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0a5000cd00 con 0x7f0a540fb420 2024-09-10T10:01:25.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.812+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/992077451 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5410d7d0 con 0x7f0a540fb420 2024-09-10T10:01:25.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.812+0000 7f0a4a7fc640 1 -- 172.21.15.71:0/992077451 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a50015e40 con 0x7f0a540fb420 2024-09-10T10:01:25.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.812+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/992077451 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5410dcf0 con 0x7f0a540fb420 2024-09-10T10:01:25.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.813+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/992077451 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a541046b0 con 0x7f0a540fb420 2024-09-10T10:01:25.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.814+0000 7f0a4a7fc640 1 -- 172.21.15.71:0/992077451 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f0a50012070 con 0x7f0a540fb420 2024-09-10T10:01:25.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.814+0000 7f0a4a7fc640 1 --2- 172.21.15.71:0/992077451 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0a4006ed50 0x7f0a40071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:25.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.814+0000 7f0a4a7fc640 1 -- 172.21.15.71:0/992077451 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0a5008d730 con 0x7f0a540fb420 2024-09-10T10:01:25.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.814+0000 7f0a59661640 1 --2- 172.21.15.71:0/992077451 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0a4006ed50 0x7f0a40071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:25.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.814+0000 7f0a59661640 1 --2- 172.21.15.71:0/992077451 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0a4006ed50 0x7f0a40071200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400b020 tx=0x7f0a44009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:25.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.818+0000 7f0a4a7fc640 1 -- 172.21.15.71:0/992077451 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0a5005ab90 con 0x7f0a540fb420 2024-09-10T10:01:25.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:25 smithi107 ceph-mon[34215]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:25.997+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/992077451 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a5410df70 con 0x7f0a4006ed50 2024-09-10T10:01:26.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:26 smithi071 ceph-mon[27559]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:26.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:26 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-10T10:01:26.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:26 smithi107 ceph-mon[34215]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:26.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:26 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-10T10:01:27.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:27.474+0000 7f0a4a7fc640 1 -- 172.21.15.71:0/992077451 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0a5410df70 con 0x7f0a4006ed50 2024-09-10T10:01:27.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:27.477+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/992077451 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0a4006ed50 msgr2=0x7f0a40071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:27.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:27.477+0000 7f0a5c0c6640 1 --2- 172.21.15.71:0/992077451 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0a4006ed50 0x7f0a40071200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400b020 tx=0x7f0a44009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:27.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:27.477+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/992077451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a540fb420 msgr2=0x7f0a5410bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:27.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:27.477+0000 7f0a5c0c6640 1 --2- 172.21.15.71:0/992077451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a540fb420 0x7f0a5410bfd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000b790 tx=0x7f0a500091d0 comp rx=0 tx=0).stop 2024-09-10T10:01:27.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:27.477+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/992077451 shutdown_connections 2024-09-10T10:01:27.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:27.477+0000 7f0a5c0c6640 1 --2- 172.21.15.71:0/992077451 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0a4006ed50 0x7f0a40071200 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:27.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:27.477+0000 7f0a5c0c6640 1 --2- 172.21.15.71:0/992077451 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a540fc6f0 0x7f0a5410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:27.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:27.477+0000 7f0a5c0c6640 1 --2- 172.21.15.71:0/992077451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a540fb420 0x7f0a5410bfd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:27.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:27.477+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/992077451 >> 172.21.15.71:0/992077451 conn(0x7f0a540f6c00 msgr2=0x7f0a540f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:27.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:27.477+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/992077451 shutdown_connections 2024-09-10T10:01:27.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:27.477+0000 7f0a5c0c6640 1 -- 172.21.15.71:0/992077451 wait complete. 2024-09-10T10:01:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:27 smithi071 ceph-mon[27559]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-10T10:01:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:27 smithi071 ceph-mon[27559]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T10:01:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:27 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-10T10:01:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:27 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071[27555]: 2024-09-10T10:01:27.451+0000 7f616948f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:01:27.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:27 smithi107 ceph-mon[34215]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:27.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-10T10:01:27.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:27 smithi107 ceph-mon[34215]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T10:01:27.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:27 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-10T10:01:28.186 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T10:01:28.698 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-10T10:01:28.698 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: osdmap e41: 6 total, 6 up, 6 in 2024-09-10T10:01:28.698 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-10T10:01:28.698 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:01:28.698 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:01:28.698 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: osdmap e42: 6 total, 6 up, 6 in 2024-09-10T10:01:28.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-10T10:01:28.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: fsmap cephfs:0 2024-09-10T10:01:28.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: Saving service mds.cephfs spec with placement count:4 2024-09-10T10:01:28.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:28.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:28.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:28.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:28.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:28.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.toijsg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:01:28.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.toijsg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:01:28.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:28.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:28 smithi071 ceph-mon[27559]: Deploying daemon mds.cephfs.smithi071.toijsg on smithi071 2024-09-10T10:01:28.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-10T10:01:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: osdmap e41: 6 total, 6 up, 6 in 2024-09-10T10:01:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-10T10:01:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:01:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:01:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: osdmap e42: 6 total, 6 up, 6 in 2024-09-10T10:01:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-10T10:01:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: fsmap cephfs:0 2024-09-10T10:01:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: Saving service mds.cephfs spec with placement count:4 2024-09-10T10:01:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.toijsg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:01:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.toijsg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:01:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:28 smithi107 ceph-mon[34215]: Deploying daemon mds.cephfs.smithi071.toijsg on smithi071 2024-09-10T10:01:28.957 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:29.739 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:29 smithi071 ceph-mon[27559]: pgmap v172: 65 pgs: 18 creating+peering, 41 unknown, 6 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:29.739 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:29 smithi071 ceph-mon[27559]: osdmap e43: 6 total, 6 up, 6 in 2024-09-10T10:01:29.739 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:29.739 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:01:29.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:29 smithi107 ceph-mon[34215]: pgmap v172: 65 pgs: 18 creating+peering, 41 unknown, 6 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:29.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:29 smithi107 ceph-mon[34215]: osdmap e43: 6 total, 6 up, 6 in 2024-09-10T10:01:29.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:29.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:01:30.660 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:30 smithi071 ceph-mon[27559]: osdmap e44: 6 total, 6 up, 6 in 2024-09-10T10:01:30.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:30 smithi107 ceph-mon[34215]: osdmap e44: 6 total, 6 up, 6 in 2024-09-10T10:01:31.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.124+0000 7fb44d358640 1 -- 172.21.15.71:0/2087648613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4480fc520 msgr2=0x7fb4480fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:31.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.124+0000 7fb44d358640 1 --2- 172.21.15.71:0/2087648613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4480fc520 0x7fb4480fc930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb438009c50 tx=0x7fb438004d10 comp rx=0 tx=0).stop 2024-09-10T10:01:31.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.124+0000 7fb44d358640 1 -- 172.21.15.71:0/2087648613 shutdown_connections 2024-09-10T10:01:31.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.124+0000 7fb44d358640 1 --2- 172.21.15.71:0/2087648613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4480fd7f0 0x7fb4480fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:31.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.124+0000 7fb44d358640 1 --2- 172.21.15.71:0/2087648613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4480fc520 0x7fb4480fc930 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:31.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.124+0000 7fb44d358640 1 -- 172.21.15.71:0/2087648613 >> 172.21.15.71:0/2087648613 conn(0x7fb4480f7ce0 msgr2=0x7fb4480fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:31.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.124+0000 7fb44d358640 1 -- 172.21.15.71:0/2087648613 shutdown_connections 2024-09-10T10:01:31.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.124+0000 7fb44d358640 1 -- 172.21.15.71:0/2087648613 wait complete. 2024-09-10T10:01:31.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.124+0000 7fb44d358640 1 Processor -- start 2024-09-10T10:01:31.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.124+0000 7fb44d358640 1 -- start start 2024-09-10T10:01:31.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb44d358640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4480fc520 0x7fb44810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:31.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb44d358640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4480fd7f0 0x7fb44810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb44d358640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44810dc10 con 0x7fb4480fc520 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb44d358640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44810e430 con 0x7fb4480fd7f0 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4480fc520 0x7fb44810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4480fc520 0x7fb44810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40870/0 (socket says 172.21.15.71:40870) 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb446ffd640 1 -- 172.21.15.71:0/1168705035 learned_addr learned my addr 172.21.15.71:0/1168705035 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb4467fc640 1 --2- 172.21.15.71:0/1168705035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4480fd7f0 0x7fb44810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb446ffd640 1 -- 172.21.15.71:0/1168705035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4480fd7f0 msgr2=0x7fb44810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb446ffd640 1 --2- 172.21.15.71:0/1168705035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4480fd7f0 0x7fb44810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb446ffd640 1 -- 172.21.15.71:0/1168705035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4380098b0 con 0x7fb4480fc520 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb446ffd640 1 --2- 172.21.15.71:0/1168705035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4480fc520 0x7fb44810d080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb438004a30 tx=0x7fb438004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb42f7fe640 1 -- 172.21.15.71:0/1168705035 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb438032670 con 0x7fb4480fc520 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb42f7fe640 1 -- 172.21.15.71:0/1168705035 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb438032c70 con 0x7fb4480fc520 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb44d358640 1 -- 172.21.15.71:0/1168705035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44810e660 con 0x7fb4480fc520 2024-09-10T10:01:31.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb44d358640 1 -- 172.21.15.71:0/1168705035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44810ec00 con 0x7fb4480fc520 2024-09-10T10:01:31.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.125+0000 7fb42f7fe640 1 -- 172.21.15.71:0/1168705035 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43803dbc0 con 0x7fb4480fc520 2024-09-10T10:01:31.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.126+0000 7fb44d358640 1 -- 172.21.15.71:0/1168705035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4480fb980 con 0x7fb4480fc520 2024-09-10T10:01:31.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.127+0000 7fb42f7fe640 1 -- 172.21.15.71:0/1168705035 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb43802f030 con 0x7fb4480fc520 2024-09-10T10:01:31.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.127+0000 7fb42f7fe640 1 --2- 172.21.15.71:0/1168705035 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb43006ed50 0x7fb430071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:31.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.127+0000 7fb42f7fe640 1 -- 172.21.15.71:0/1168705035 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb4380af870 con 0x7fb4480fc520 2024-09-10T10:01:31.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.127+0000 7fb4467fc640 1 --2- 172.21.15.71:0/1168705035 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb43006ed50 0x7fb430071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:31.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.128+0000 7fb4467fc640 1 --2- 172.21.15.71:0/1168705035 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb43006ed50 0x7fb430071200 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb44810ce30 tx=0x7fb43c009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:31.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.132+0000 7fb42f7fe640 1 -- 172.21.15.71:0/1168705035 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb43807c990 con 0x7fb4480fc520 2024-09-10T10:01:31.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.348+0000 7fb44d358640 1 -- 172.21.15.71:0/1168705035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb448104f20 con 0x7fb4480fc520 2024-09-10T10:01:31.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.349+0000 7fb42f7fe640 1 -- 172.21.15.71:0/1168705035 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fb43807c330 con 0x7fb4480fc520 2024-09-10T10:01:31.350 INFO:teuthology.orchestra.run.smithi071.stdout:e2 2024-09-10T10:01:31.351 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:01:31.351 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:01:31.351 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:01:31.351 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:01:31.351 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:01:31.351 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:01:31.351 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 2 2024-09-10T10:01:31.351 INFO:teuthology.orchestra.run.smithi071.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-10T10:01:31.351 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:01:31.351 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:01:27.452488+0000 2024-09-10T10:01:31.351 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:01:31.351 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:01:31.351 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 0 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 1 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:in 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:up {} 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:01:31.352 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:01:31.353 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:01:31.353 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:01:31.353 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 0 2024-09-10T10:01:31.353 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:01:31.353 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:01:31.354 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 2 2024-09-10T10:01:31.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.351+0000 7fb44d358640 1 -- 172.21.15.71:0/1168705035 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb43006ed50 msgr2=0x7fb430071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:31.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.351+0000 7fb44d358640 1 --2- 172.21.15.71:0/1168705035 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb43006ed50 0x7fb430071200 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb44810ce30 tx=0x7fb43c009040 comp rx=0 tx=0).stop 2024-09-10T10:01:31.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.351+0000 7fb44d358640 1 -- 172.21.15.71:0/1168705035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4480fc520 msgr2=0x7fb44810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:31.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.351+0000 7fb44d358640 1 --2- 172.21.15.71:0/1168705035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4480fc520 0x7fb44810d080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb438004a30 tx=0x7fb438004d10 comp rx=0 tx=0).stop 2024-09-10T10:01:31.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.351+0000 7fb44d358640 1 -- 172.21.15.71:0/1168705035 shutdown_connections 2024-09-10T10:01:31.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.351+0000 7fb44d358640 1 --2- 172.21.15.71:0/1168705035 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb43006ed50 0x7fb430071200 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:31.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.351+0000 7fb44d358640 1 --2- 172.21.15.71:0/1168705035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4480fd7f0 0x7fb44810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:31.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.351+0000 7fb44d358640 1 --2- 172.21.15.71:0/1168705035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4480fc520 0x7fb44810d080 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:31.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.351+0000 7fb44d358640 1 -- 172.21.15.71:0/1168705035 >> 172.21.15.71:0/1168705035 conn(0x7fb4480f7ce0 msgr2=0x7fb4480f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:31.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.351+0000 7fb44d358640 1 -- 172.21.15.71:0/1168705035 shutdown_connections 2024-09-10T10:01:31.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:31.351+0000 7fb44d358640 1 -- 172.21.15.71:0/1168705035 wait complete. 2024-09-10T10:01:31.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:31 smithi071 ceph-mon[27559]: pgmap v175: 65 pgs: 18 creating+peering, 17 unknown, 30 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:31 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1168705035' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:01:31.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:31 smithi107 ceph-mon[34215]: pgmap v175: 65 pgs: 18 creating+peering, 17 unknown, 30 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:31.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:31 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1168705035' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:01:32.061 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T10:01:32.070 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T10:01:32.071 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-10T10:01:32.431 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:33.504 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: pgmap v176: 65 pgs: 8 creating+peering, 57 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:33.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:33.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:33.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:33.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.nycoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:01:33.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.nycoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:01:33.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:33.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: Deploying daemon mds.cephfs.smithi107.nycoxn on smithi107 2024-09-10T10:01:33.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.71:6826/652614206,v1:172.21.15.71:6827/652614206] up:boot 2024-09-10T10:01:33.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: daemon mds.cephfs.smithi071.toijsg assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-10T10:01:33.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T10:01:33.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:01:33.505 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: Cluster is now healthy 2024-09-10T10:01:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: fsmap cephfs:0 1 up:standby 2024-09-10T10:01:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:01:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:creating} 2024-09-10T10:01:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:33 smithi071 ceph-mon[27559]: daemon mds.cephfs.smithi071.toijsg is now active in filesystem cephfs as rank 0 2024-09-10T10:01:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: pgmap v176: 65 pgs: 8 creating+peering, 57 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-10T10:01:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.nycoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:01:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.nycoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:01:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: Deploying daemon mds.cephfs.smithi107.nycoxn on smithi107 2024-09-10T10:01:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.71:6826/652614206,v1:172.21.15.71:6827/652614206] up:boot 2024-09-10T10:01:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: daemon mds.cephfs.smithi071.toijsg assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-10T10:01:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T10:01:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:01:33.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: Cluster is now healthy 2024-09-10T10:01:33.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: fsmap cephfs:0 1 up:standby 2024-09-10T10:01:33.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:01:33.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:creating} 2024-09-10T10:01:33.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:33 smithi107 ceph-mon[34215]: daemon mds.cephfs.smithi071.toijsg is now active in filesystem cephfs as rank 0 2024-09-10T10:01:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.021+0000 7f2b10c91640 1 -- 172.21.15.71:0/3868917493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b0c0fc720 msgr2=0x7f2b0c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.021+0000 7f2b10c91640 1 --2- 172.21.15.71:0/3868917493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b0c0fc720 0x7f2b0c0fcb90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2af40048d0 tx=0x7f2af4009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.021+0000 7f2b10c91640 1 -- 172.21.15.71:0/3868917493 shutdown_connections 2024-09-10T10:01:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.021+0000 7f2b10c91640 1 --2- 172.21.15.71:0/3868917493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b0c0fc720 0x7f2b0c0fcb90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.021+0000 7f2b10c91640 1 --2- 172.21.15.71:0/3868917493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b0c0fb450 0x7f2b0c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.021+0000 7f2b10c91640 1 -- 172.21.15.71:0/3868917493 >> 172.21.15.71:0/3868917493 conn(0x7f2b0c0f6c10 msgr2=0x7f2b0c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.021+0000 7f2b10c91640 1 -- 172.21.15.71:0/3868917493 shutdown_connections 2024-09-10T10:01:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.021+0000 7f2b10c91640 1 -- 172.21.15.71:0/3868917493 wait complete. 2024-09-10T10:01:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.022+0000 7f2b10c91640 1 Processor -- start 2024-09-10T10:01:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.022+0000 7f2b10c91640 1 -- start start 2024-09-10T10:01:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.022+0000 7f2b10c91640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b0c0fb450 0x7f2b0c10bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.022+0000 7f2b10c91640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b0c0fc720 0x7f2b0c10c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.022+0000 7f2b10c91640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c10cb30 con 0x7f2b0c0fb450 2024-09-10T10:01:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.022+0000 7f2b10c91640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c10d350 con 0x7f2b0c0fc720 2024-09-10T10:01:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.022+0000 7f2b0a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b0c0fb450 0x7f2b0c10bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.022+0000 7f2b0a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b0c0fb450 0x7f2b0c10bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44982/0 (socket says 172.21.15.71:44982) 2024-09-10T10:01:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.022+0000 7f2b0a59c640 1 -- 172.21.15.71:0/3243098408 learned_addr learned my addr 172.21.15.71:0/3243098408 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.022+0000 7f2b03fff640 1 --2- 172.21.15.71:0/3243098408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b0c0fc720 0x7f2b0c10c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:34.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.022+0000 7f2b0a59c640 1 -- 172.21.15.71:0/3243098408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b0c0fc720 msgr2=0x7f2b0c10c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:34.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.022+0000 7f2b0a59c640 1 --2- 172.21.15.71:0/3243098408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b0c0fc720 0x7f2b0c10c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:34.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.022+0000 7f2b0a59c640 1 -- 172.21.15.71:0/3243098408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af4005040 con 0x7f2b0c0fb450 2024-09-10T10:01:34.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.023+0000 7f2b0a59c640 1 --2- 172.21.15.71:0/3243098408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b0c0fb450 0x7f2b0c10bfa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00eb70 tx=0x7f2afc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:34.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.023+0000 7f2b02ffd640 1 -- 172.21.15.71:0/3243098408 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2afc007c30 con 0x7f2b0c0fb450 2024-09-10T10:01:34.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.023+0000 7f2b02ffd640 1 -- 172.21.15.71:0/3243098408 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2afc00f040 con 0x7f2b0c0fb450 2024-09-10T10:01:34.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.023+0000 7f2b10c91640 1 -- 172.21.15.71:0/3243098408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0c10d580 con 0x7f2b0c0fb450 2024-09-10T10:01:34.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.023+0000 7f2b02ffd640 1 -- 172.21.15.71:0/3243098408 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2afc00ca60 con 0x7f2b0c0fb450 2024-09-10T10:01:34.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.023+0000 7f2b10c91640 1 -- 172.21.15.71:0/3243098408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0c10db20 con 0x7f2b0c0fb450 2024-09-10T10:01:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.024+0000 7f2b10c91640 1 -- 172.21.15.71:0/3243098408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0c0fa8b0 con 0x7f2b0c0fb450 2024-09-10T10:01:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.024+0000 7f2b02ffd640 1 -- 172.21.15.71:0/3243098408 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f2afc00cbc0 con 0x7f2b0c0fb450 2024-09-10T10:01:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.025+0000 7f2b02ffd640 1 --2- 172.21.15.71:0/3243098408 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2af806ed60 0x7f2af8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.025+0000 7f2b02ffd640 1 -- 172.21.15.71:0/3243098408 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2afc08dd80 con 0x7f2b0c0fb450 2024-09-10T10:01:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.025+0000 7f2b03fff640 1 --2- 172.21.15.71:0/3243098408 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2af806ed60 0x7f2af8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.025+0000 7f2b03fff640 1 --2- 172.21.15.71:0/3243098408 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2af806ed60 0x7f2af8071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2af4007ac0 tx=0x7f2af4035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:34.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.029+0000 7f2b02ffd640 1 -- 172.21.15.71:0/3243098408 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2afc05b090 con 0x7f2b0c0fb450 2024-09-10T10:01:34.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.217+0000 7f2b10c91640 1 -- 172.21.15.71:0/3243098408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f2b0c103f90 con 0x7f2b0c0fb450 2024-09-10T10:01:34.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.499+0000 7f2b02ffd640 1 -- 172.21.15.71:0/3243098408 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f2afc05aa30 con 0x7f2b0c0fb450 2024-09-10T10:01:34.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.501+0000 7f2b10c91640 1 -- 172.21.15.71:0/3243098408 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2af806ed60 msgr2=0x7f2af8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:34.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.501+0000 7f2b10c91640 1 --2- 172.21.15.71:0/3243098408 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2af806ed60 0x7f2af8071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2af4007ac0 tx=0x7f2af4035040 comp rx=0 tx=0).stop 2024-09-10T10:01:34.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.501+0000 7f2b10c91640 1 -- 172.21.15.71:0/3243098408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b0c0fb450 msgr2=0x7f2b0c10bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:34.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.501+0000 7f2b10c91640 1 --2- 172.21.15.71:0/3243098408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b0c0fb450 0x7f2b0c10bfa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00eb70 tx=0x7f2afc00b040 comp rx=0 tx=0).stop 2024-09-10T10:01:34.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.501+0000 7f2b10c91640 1 -- 172.21.15.71:0/3243098408 shutdown_connections 2024-09-10T10:01:34.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.501+0000 7f2b10c91640 1 --2- 172.21.15.71:0/3243098408 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2af806ed60 0x7f2af8071210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:34.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.501+0000 7f2b10c91640 1 --2- 172.21.15.71:0/3243098408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b0c0fc720 0x7f2b0c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:34.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.501+0000 7f2b10c91640 1 --2- 172.21.15.71:0/3243098408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b0c0fb450 0x7f2b0c10bfa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:34.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.501+0000 7f2b10c91640 1 -- 172.21.15.71:0/3243098408 >> 172.21.15.71:0/3243098408 conn(0x7f2b0c0f6c10 msgr2=0x7f2b0c0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:34.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.501+0000 7f2b10c91640 1 -- 172.21.15.71:0/3243098408 shutdown_connections 2024-09-10T10:01:34.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:34.501+0000 7f2b10c91640 1 -- 172.21.15.71:0/3243098408 wait complete. 2024-09-10T10:01:34.776 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:34 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.71:6826/652614206,v1:172.21.15.71:6827/652614206] up:active 2024-09-10T10:01:34.777 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:34 smithi107 ceph-mon[34215]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 2024-09-10T10:01:34.777 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:34 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3243098408' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-10T10:01:34.786 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:34 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.71:6826/652614206,v1:172.21.15.71:6827/652614206] up:active 2024-09-10T10:01:34.801 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:34 smithi071 ceph-mon[27559]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 2024-09-10T10:01:34.802 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:34 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3243098408' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-10T10:01:35.076 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T10:01:35.085 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T10:01:35.085 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-10T10:01:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: pgmap v177: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 445 B/s wr, 1 op/s 2024-09-10T10:01:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:01:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3243098408' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-10T10:01:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 2024-09-10T10:01:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:35.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:35.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:35.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.omoqqq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:01:35.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.omoqqq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:01:35.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:35.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: Deploying daemon mds.cephfs.smithi071.omoqqq on smithi071 2024-09-10T10:01:35.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: daemon mds.cephfs.smithi107.nycoxn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T10:01:35.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-10T10:01:35.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:01:35.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] up:boot 2024-09-10T10:01:35.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:creating} 2024-09-10T10:01:35.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:01:35.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:35 smithi071 ceph-mon[27559]: daemon mds.cephfs.smithi107.nycoxn is now active in filesystem cephfs as rank 1 2024-09-10T10:01:35.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: pgmap v177: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 445 B/s wr, 1 op/s 2024-09-10T10:01:35.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:01:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3243098408' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-10T10:01:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 2024-09-10T10:01:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.omoqqq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:01:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.omoqqq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:01:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: Deploying daemon mds.cephfs.smithi071.omoqqq on smithi071 2024-09-10T10:01:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: daemon mds.cephfs.smithi107.nycoxn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T10:01:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-10T10:01:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:01:35.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] up:boot 2024-09-10T10:01:35.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:creating} 2024-09-10T10:01:35.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:01:35.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:35 smithi107 ceph-mon[34215]: daemon mds.cephfs.smithi107.nycoxn is now active in filesystem cephfs as rank 1 2024-09-10T10:01:36.310 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:37.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:37 smithi071 ceph-mon[27559]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-09-10T10:01:37.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:37 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] up:active 2024-09-10T10:01:37.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:37 smithi071 ceph-mon[27559]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 2024-09-10T10:01:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:37 smithi107 ceph-mon[34215]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-09-10T10:01:37.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:37 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] up:active 2024-09-10T10:01:37.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:37 smithi107 ceph-mon[34215]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 2024-09-10T10:01:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.553+0000 7fcaa2791640 1 -- 172.21.15.71:0/2062518005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c0fb420 msgr2=0x7fca9c0fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.553+0000 7fcaa2791640 1 --2- 172.21.15.71:0/2062518005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c0fb420 0x7fca9c0fb830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0048d0 tx=0x7fca8c009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.553+0000 7fcaa2791640 1 -- 172.21.15.71:0/2062518005 shutdown_connections 2024-09-10T10:01:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.553+0000 7fcaa2791640 1 --2- 172.21.15.71:0/2062518005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca9c0fc6f0 0x7fca9c0fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.553+0000 7fcaa2791640 1 --2- 172.21.15.71:0/2062518005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c0fb420 0x7fca9c0fb830 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.553+0000 7fcaa2791640 1 -- 172.21.15.71:0/2062518005 >> 172.21.15.71:0/2062518005 conn(0x7fca9c0f6c00 msgr2=0x7fca9c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.553+0000 7fcaa2791640 1 -- 172.21.15.71:0/2062518005 shutdown_connections 2024-09-10T10:01:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.553+0000 7fcaa2791640 1 -- 172.21.15.71:0/2062518005 wait complete. 2024-09-10T10:01:38.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.553+0000 7fcaa2791640 1 Processor -- start 2024-09-10T10:01:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.554+0000 7fcaa2791640 1 -- start start 2024-09-10T10:01:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.554+0000 7fcaa2791640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c0fb420 0x7fca9c10d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.554+0000 7fcaa2791640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca9c0fc6f0 0x7fca9c10d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.554+0000 7fcaa2791640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c10dbe0 con 0x7fca9c0fb420 2024-09-10T10:01:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.554+0000 7fcaa2791640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c10e400 con 0x7fca9c0fc6f0 2024-09-10T10:01:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.554+0000 7fca9bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c0fb420 0x7fca9c10d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.554+0000 7fca9bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c0fb420 0x7fca9c10d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45030/0 (socket says 172.21.15.71:45030) 2024-09-10T10:01:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.554+0000 7fca9bfff640 1 -- 172.21.15.71:0/359596613 learned_addr learned my addr 172.21.15.71:0/359596613 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.554+0000 7fca9b7fe640 1 --2- 172.21.15.71:0/359596613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca9c0fc6f0 0x7fca9c10d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.554+0000 7fca9bfff640 1 -- 172.21.15.71:0/359596613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca9c0fc6f0 msgr2=0x7fca9c10d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.554+0000 7fca9bfff640 1 --2- 172.21.15.71:0/359596613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca9c0fc6f0 0x7fca9c10d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:38.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.554+0000 7fca9bfff640 1 -- 172.21.15.71:0/359596613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c005040 con 0x7fca9c0fb420 2024-09-10T10:01:38.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.554+0000 7fca9bfff640 1 --2- 172.21.15.71:0/359596613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c0fb420 0x7fca9c10d050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0043d0 tx=0x7fca8c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:38.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.555+0000 7fca98ff9640 1 -- 172.21.15.71:0/359596613 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca8c038070 con 0x7fca9c0fb420 2024-09-10T10:01:38.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.555+0000 7fcaa2791640 1 -- 172.21.15.71:0/359596613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c10e630 con 0x7fca9c0fb420 2024-09-10T10:01:38.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.555+0000 7fca98ff9640 1 -- 172.21.15.71:0/359596613 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fca8c02ae90 con 0x7fca9c0fb420 2024-09-10T10:01:38.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.555+0000 7fca98ff9640 1 -- 172.21.15.71:0/359596613 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca8c03e670 con 0x7fca9c0fb420 2024-09-10T10:01:38.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.555+0000 7fcaa2791640 1 -- 172.21.15.71:0/359596613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c10eb50 con 0x7fca9c0fb420 2024-09-10T10:01:38.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.556+0000 7fcaa2791640 1 -- 172.21.15.71:0/359596613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c0fa880 con 0x7fca9c0fb420 2024-09-10T10:01:38.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.557+0000 7fca98ff9640 1 -- 172.21.15.71:0/359596613 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fca8c030020 con 0x7fca9c0fb420 2024-09-10T10:01:38.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.557+0000 7fca98ff9640 1 --2- 172.21.15.71:0/359596613 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fca8406ed60 0x7fca84071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:38.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.557+0000 7fca98ff9640 1 -- 172.21.15.71:0/359596613 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fca8c0ae400 con 0x7fca9c0fb420 2024-09-10T10:01:38.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.557+0000 7fca9b7fe640 1 --2- 172.21.15.71:0/359596613 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fca8406ed60 0x7fca84071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:38.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.558+0000 7fca9b7fe640 1 --2- 172.21.15.71:0/359596613 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fca8406ed60 0x7fca84071210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fca9c10ce00 tx=0x7fca90009ed0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:38.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.562+0000 7fca98ff9640 1 -- 172.21.15.71:0/359596613 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fca8c07b650 con 0x7fca9c0fb420 2024-09-10T10:01:38.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:38.763+0000 7fcaa2791640 1 -- 172.21.15.71:0/359596613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fca9c103f60 con 0x7fca9c0fb420 2024-09-10T10:01:39.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:39.392+0000 7fca98ff9640 1 -- 172.21.15.71:0/359596613 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v10) v1 ==== 121+0+0 (secure 0 0 0) 0x7fca8c07aff0 con 0x7fca9c0fb420 2024-09-10T10:01:39.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:39.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:39.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:39.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.rvgklu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:01:39.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.rvgklu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:01:39.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:39.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: Deploying daemon mds.cephfs.smithi107.rvgklu on smithi107 2024-09-10T10:01:39.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-10T10:01:39.394 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-10T10:01:39.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: Cluster is now healthy 2024-09-10T10:01:39.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] up:boot 2024-09-10T10:01:39.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby 2024-09-10T10:01:39.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.omoqqq"}]: dispatch 2024-09-10T10:01:39.395 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:39 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/359596613' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T10:01:39.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:39.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:39.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:39.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.rvgklu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:01:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.rvgklu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:01:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: Deploying daemon mds.cephfs.smithi107.rvgklu on smithi107 2024-09-10T10:01:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-10T10:01:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-10T10:01:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: Cluster is now healthy 2024-09-10T10:01:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] up:boot 2024-09-10T10:01:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby 2024-09-10T10:01:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.omoqqq"}]: dispatch 2024-09-10T10:01:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:39 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/359596613' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T10:01:39.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:39.395+0000 7fcaa2791640 1 -- 172.21.15.71:0/359596613 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fca8406ed60 msgr2=0x7fca84071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:39.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:39.395+0000 7fcaa2791640 1 --2- 172.21.15.71:0/359596613 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fca8406ed60 0x7fca84071210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fca9c10ce00 tx=0x7fca90009ed0 comp rx=0 tx=0).stop 2024-09-10T10:01:39.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:39.395+0000 7fcaa2791640 1 -- 172.21.15.71:0/359596613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c0fb420 msgr2=0x7fca9c10d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:39.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:39.395+0000 7fcaa2791640 1 --2- 172.21.15.71:0/359596613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c0fb420 0x7fca9c10d050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0043d0 tx=0x7fca8c009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:39.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:39.395+0000 7fcaa2791640 1 -- 172.21.15.71:0/359596613 shutdown_connections 2024-09-10T10:01:39.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:39.395+0000 7fcaa2791640 1 --2- 172.21.15.71:0/359596613 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fca8406ed60 0x7fca84071210 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:39.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:39.395+0000 7fcaa2791640 1 --2- 172.21.15.71:0/359596613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca9c0fc6f0 0x7fca9c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:39.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:39.395+0000 7fcaa2791640 1 --2- 172.21.15.71:0/359596613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca9c0fb420 0x7fca9c10d050 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:39.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:39.395+0000 7fcaa2791640 1 -- 172.21.15.71:0/359596613 >> 172.21.15.71:0/359596613 conn(0x7fca9c0f6c00 msgr2=0x7fca9c065f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:39.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:39.395+0000 7fcaa2791640 1 -- 172.21.15.71:0/359596613 shutdown_connections 2024-09-10T10:01:39.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:39.395+0000 7fcaa2791640 1 -- 172.21.15.71:0/359596613 wait complete. 2024-09-10T10:01:40.117 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T10:01:40.126 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T10:01:40.127 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-10T10:01:40.375 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:40.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:40 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:40.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:40 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/359596613' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T10:01:40.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:40 smithi107 ceph-mon[34215]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby 2024-09-10T10:01:40.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:40 smithi107 ceph-mon[34215]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 2024-09-10T10:01:40.702 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:40 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:40.702 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:40 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/359596613' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T10:01:40.703 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:40 smithi071 ceph-mon[27559]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby 2024-09-10T10:01:40.703 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:40 smithi071 ceph-mon[27559]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 2024-09-10T10:01:41.692 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:41 smithi071 ceph-mon[27559]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-10T10:01:41.692 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:41.692 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:41.692 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:41.692 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:41.692 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:41.693 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:41.693 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:41 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] up:boot 2024-09-10T10:01:41.693 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:41 smithi071 ceph-mon[27559]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 1 up:standby 2024-09-10T10:01:41.693 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:41 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:01:41.693 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:41 smithi071 ceph-mon[27559]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:01:41.968 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:41 smithi107 ceph-mon[34215]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-10T10:01:41.968 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:41.968 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:41.968 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:41.969 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:41.969 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:41.969 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:41.969 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:41 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] up:boot 2024-09-10T10:01:41.969 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:41 smithi107 ceph-mon[34215]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 1 up:standby 2024-09-10T10:01:41.969 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:41 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:01:41.969 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:41 smithi107 ceph-mon[34215]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:01:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.964+0000 7f4562a0c640 1 -- 172.21.15.71:0/361248820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0fc720 msgr2=0x7f455c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.964+0000 7f4562a0c640 1 --2- 172.21.15.71:0/361248820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0fc720 0x7f455c0fcb90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f45500048d0 tx=0x7f4550009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.964+0000 7f4562a0c640 1 -- 172.21.15.71:0/361248820 shutdown_connections 2024-09-10T10:01:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.964+0000 7f4562a0c640 1 --2- 172.21.15.71:0/361248820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0fc720 0x7f455c0fcb90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.964+0000 7f4562a0c640 1 --2- 172.21.15.71:0/361248820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f455c0fb450 0x7f455c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.964+0000 7f4562a0c640 1 -- 172.21.15.71:0/361248820 >> 172.21.15.71:0/361248820 conn(0x7f455c0f6c10 msgr2=0x7f455c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.964+0000 7f4562a0c640 1 -- 172.21.15.71:0/361248820 shutdown_connections 2024-09-10T10:01:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.964+0000 7f4562a0c640 1 -- 172.21.15.71:0/361248820 wait complete. 2024-09-10T10:01:41.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.965+0000 7f4562a0c640 1 Processor -- start 2024-09-10T10:01:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.965+0000 7f4562a0c640 1 -- start start 2024-09-10T10:01:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.965+0000 7f4562a0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f455c0fb450 0x7f455c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.965+0000 7f4562a0c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0fc720 0x7f455c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.965+0000 7f4562a0c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c10dc40 con 0x7f455c0fc720 2024-09-10T10:01:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.965+0000 7f4562a0c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c10e460 con 0x7f455c0fb450 2024-09-10T10:01:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.965+0000 7f455b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0fc720 0x7f455c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.965+0000 7f455b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0fc720 0x7f455c10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45042/0 (socket says 172.21.15.71:45042) 2024-09-10T10:01:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.965+0000 7f455b7fe640 1 -- 172.21.15.71:0/966799412 learned_addr learned my addr 172.21.15.71:0/966799412 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.966+0000 7f455b7fe640 1 -- 172.21.15.71:0/966799412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f455c0fb450 msgr2=0x7f455c10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.966+0000 7f455b7fe640 1 --2- 172.21.15.71:0/966799412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f455c0fb450 0x7f455c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.966+0000 7f455b7fe640 1 -- 172.21.15.71:0/966799412 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4550005040 con 0x7f455c0fc720 2024-09-10T10:01:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.966+0000 7f455b7fe640 1 --2- 172.21.15.71:0/966799412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0fc720 0x7f455c10d5f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f45500043d0 tx=0x7f4550009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.966+0000 7f4558ff9640 1 -- 172.21.15.71:0/966799412 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4550038070 con 0x7f455c0fc720 2024-09-10T10:01:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.966+0000 7f4558ff9640 1 -- 172.21.15.71:0/966799412 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f455002ae90 con 0x7f455c0fc720 2024-09-10T10:01:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.966+0000 7f4562a0c640 1 -- 172.21.15.71:0/966799412 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455c10e690 con 0x7f455c0fc720 2024-09-10T10:01:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.966+0000 7f4558ff9640 1 -- 172.21.15.71:0/966799412 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f455003e670 con 0x7f455c0fc720 2024-09-10T10:01:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.966+0000 7f4562a0c640 1 -- 172.21.15.71:0/966799412 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455c10ec30 con 0x7f455c0fc720 2024-09-10T10:01:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.967+0000 7f4562a0c640 1 -- 172.21.15.71:0/966799412 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455c0fa8b0 con 0x7f455c0fc720 2024-09-10T10:01:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.968+0000 7f4558ff9640 1 -- 172.21.15.71:0/966799412 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4550030020 con 0x7f455c0fc720 2024-09-10T10:01:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.968+0000 7f4558ff9640 1 --2- 172.21.15.71:0/966799412 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f454406ed60 0x7f4544071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.968+0000 7f4558ff9640 1 -- 172.21.15.71:0/966799412 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f45500ae3c0 con 0x7f455c0fc720 2024-09-10T10:01:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.968+0000 7f455bfff640 1 --2- 172.21.15.71:0/966799412 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f454406ed60 0x7f4544071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.968+0000 7f455bfff640 1 --2- 172.21.15.71:0/966799412 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f454406ed60 0x7f4544071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f454c004c80 tx=0x7f454c009c50 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:41.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:41.972+0000 7f4558ff9640 1 -- 172.21.15.71:0/966799412 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f455007b4e0 con 0x7f455c0fc720 2024-09-10T10:01:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:42.166+0000 7f4562a0c640 1 -- 172.21.15.71:0/966799412 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f455c103f30 con 0x7f455c0fc720 2024-09-10T10:01:42.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:42.664+0000 7f4558ff9640 1 -- 172.21.15.71:0/966799412 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v14) v1 ==== 133+0+0 (secure 0 0 0) 0x7f455007ae80 con 0x7f455c0fc720 2024-09-10T10:01:42.665 INFO:teuthology.orchestra.run.smithi071.stderr:inline data disabled 2024-09-10T10:01:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:42.666+0000 7f4562a0c640 1 -- 172.21.15.71:0/966799412 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f454406ed60 msgr2=0x7f4544071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:42.666+0000 7f4562a0c640 1 --2- 172.21.15.71:0/966799412 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f454406ed60 0x7f4544071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f454c004c80 tx=0x7f454c009c50 comp rx=0 tx=0).stop 2024-09-10T10:01:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:42.667+0000 7f4562a0c640 1 -- 172.21.15.71:0/966799412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0fc720 msgr2=0x7f455c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:42.667+0000 7f4562a0c640 1 --2- 172.21.15.71:0/966799412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0fc720 0x7f455c10d5f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f45500043d0 tx=0x7f4550009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:42.667+0000 7f4562a0c640 1 -- 172.21.15.71:0/966799412 shutdown_connections 2024-09-10T10:01:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:42.667+0000 7f4562a0c640 1 --2- 172.21.15.71:0/966799412 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f454406ed60 0x7f4544071210 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:42.667+0000 7f4562a0c640 1 --2- 172.21.15.71:0/966799412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0fc720 0x7f455c10d5f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:42.667+0000 7f4562a0c640 1 --2- 172.21.15.71:0/966799412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f455c0fb450 0x7f455c10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:42.667+0000 7f4562a0c640 1 -- 172.21.15.71:0/966799412 >> 172.21.15.71:0/966799412 conn(0x7f455c0f6c10 msgr2=0x7f455c066080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:42.667+0000 7f4562a0c640 1 -- 172.21.15.71:0/966799412 shutdown_connections 2024-09-10T10:01:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:42.667+0000 7f4562a0c640 1 -- 172.21.15.71:0/966799412 wait complete. 2024-09-10T10:01:42.959 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:42 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/966799412' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-10T10:01:43.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:42 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/966799412' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-10T10:01:43.275 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T10:01:43.286 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T10:01:43.286 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T10:01:43.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:43 smithi071 ceph-mon[27559]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-10T10:01:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:43 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] up:standby-replay 2024-09-10T10:01:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:43 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/966799412' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-10T10:01:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:43 smithi071 ceph-mon[27559]: Dropping low affinity active daemon mds.cephfs.smithi071.toijsg in favor of higher affinity standby. 2024-09-10T10:01:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:43 smithi071 ceph-mon[27559]: Replacing daemon mds.cephfs.smithi071.toijsg as rank 0 with standby daemon mds.cephfs.smithi071.omoqqq 2024-09-10T10:01:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:43 smithi071 ceph-mon[27559]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T10:01:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:43 smithi071 ceph-mon[27559]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:01:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:43 smithi071 ceph-mon[27559]: osdmap e45: 6 total, 6 up, 6 in 2024-09-10T10:01:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:43 smithi071 ceph-mon[27559]: fsmap cephfs:2/2 {0=cephfs.smithi071.omoqqq=up:replay,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 2024-09-10T10:01:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:43 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:43 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:43.973 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:44.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:43 smithi107 ceph-mon[34215]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-10T10:01:44.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:43 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] up:standby-replay 2024-09-10T10:01:44.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:43 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/966799412' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-10T10:01:44.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:43 smithi107 ceph-mon[34215]: Dropping low affinity active daemon mds.cephfs.smithi071.toijsg in favor of higher affinity standby. 2024-09-10T10:01:44.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:43 smithi107 ceph-mon[34215]: Replacing daemon mds.cephfs.smithi071.toijsg as rank 0 with standby daemon mds.cephfs.smithi071.omoqqq 2024-09-10T10:01:44.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:43 smithi107 ceph-mon[34215]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T10:01:44.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:43 smithi107 ceph-mon[34215]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:01:44.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:43 smithi107 ceph-mon[34215]: osdmap e45: 6 total, 6 up, 6 in 2024-09-10T10:01:44.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:43 smithi107 ceph-mon[34215]: fsmap cephfs:2/2 {0=cephfs.smithi071.omoqqq=up:replay,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 2024-09-10T10:01:44.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:43 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:44.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:43 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:44.938 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:44 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] up:boot 2024-09-10T10:01:44.938 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:44 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] up:active 2024-09-10T10:01:44.938 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:44 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] up:resolve 2024-09-10T10:01:44.938 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:44 smithi071 ceph-mon[27559]: fsmap cephfs:2/2 {0=cephfs.smithi071.omoqqq=up:resolve,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 1 up:standby 2024-09-10T10:01:44.938 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:01:44.938 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:44.938 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:01:44.938 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:45.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:44 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] up:boot 2024-09-10T10:01:45.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:44 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] up:active 2024-09-10T10:01:45.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:44 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] up:resolve 2024-09-10T10:01:45.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:44 smithi107 ceph-mon[34215]: fsmap cephfs:2/2 {0=cephfs.smithi071.omoqqq=up:resolve,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 1 up:standby 2024-09-10T10:01:45.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:44 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:01:45.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:44 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:45.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:44 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:01:45.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:44 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:45.767 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:45 smithi071 ceph-mon[27559]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-10T10:01:45.767 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:45 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] up:reconnect 2024-09-10T10:01:45.767 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:45 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] up:standby-replay 2024-09-10T10:01:45.767 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:45 smithi071 ceph-mon[27559]: fsmap cephfs:2/2 {0=cephfs.smithi071.omoqqq=up:reconnect,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 1 up:standby 2024-09-10T10:01:46.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:45 smithi107 ceph-mon[34215]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-10T10:01:46.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:45 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] up:reconnect 2024-09-10T10:01:46.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:45 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] up:standby-replay 2024-09-10T10:01:46.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:45 smithi107 ceph-mon[34215]: fsmap cephfs:2/2 {0=cephfs.smithi071.omoqqq=up:reconnect,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 1 up:standby 2024-09-10T10:01:46.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:46 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] up:rejoin 2024-09-10T10:01:46.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:46 smithi071 ceph-mon[27559]: fsmap cephfs:2/2 {0=cephfs.smithi071.omoqqq=up:rejoin,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 1 up:standby 2024-09-10T10:01:46.699 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:46 smithi071 ceph-mon[27559]: daemon mds.cephfs.smithi071.omoqqq is now active in filesystem cephfs as rank 0 2024-09-10T10:01:46.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.875+0000 7f27664dc640 1 -- 172.21.15.71:0/2235033365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27600fb470 msgr2=0x7f27600fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:46.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.875+0000 7f27664dc640 1 --2- 172.21.15.71:0/2235033365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27600fb470 0x7f27600fb880 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f27500048d0 tx=0x7f2750009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:46.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.875+0000 7f27664dc640 1 -- 172.21.15.71:0/2235033365 shutdown_connections 2024-09-10T10:01:46.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.875+0000 7f27664dc640 1 --2- 172.21.15.71:0/2235033365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27600fc740 0x7f27600fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:46.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.875+0000 7f27664dc640 1 --2- 172.21.15.71:0/2235033365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27600fb470 0x7f27600fb880 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.875+0000 7f27664dc640 1 -- 172.21.15.71:0/2235033365 >> 172.21.15.71:0/2235033365 conn(0x7f27600f6c30 msgr2=0x7f27600f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.875+0000 7f27664dc640 1 -- 172.21.15.71:0/2235033365 shutdown_connections 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.875+0000 7f27664dc640 1 -- 172.21.15.71:0/2235033365 wait complete. 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.876+0000 7f27664dc640 1 Processor -- start 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.876+0000 7f27664dc640 1 -- start start 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.876+0000 7f27664dc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27600fb470 0x7f276010bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.876+0000 7f27664dc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27600fc740 0x7f276010c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.876+0000 7f27664dc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276010cb50 con 0x7f27600fb470 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.876+0000 7f27664dc640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276010d370 con 0x7f27600fc740 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.876+0000 7f275ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27600fb470 0x7f276010bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.876+0000 7f275ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27600fb470 0x7f276010bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45128/0 (socket says 172.21.15.71:45128) 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.876+0000 7f275ffff640 1 -- 172.21.15.71:0/1166930739 learned_addr learned my addr 172.21.15.71:0/1166930739 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.877+0000 7f275f7fe640 1 --2- 172.21.15.71:0/1166930739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27600fc740 0x7f276010c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.877+0000 7f275ffff640 1 -- 172.21.15.71:0/1166930739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27600fc740 msgr2=0x7f276010c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:46.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.877+0000 7f275ffff640 1 --2- 172.21.15.71:0/1166930739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27600fc740 0x7f276010c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:46.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.877+0000 7f275ffff640 1 -- 172.21.15.71:0/1166930739 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2750005040 con 0x7f27600fb470 2024-09-10T10:01:46.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.877+0000 7f275f7fe640 1 --2- 172.21.15.71:0/1166930739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27600fc740 0x7f276010c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:01:46.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.877+0000 7f275ffff640 1 --2- 172.21.15.71:0/1166930739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27600fb470 0x7f276010bfc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2750000c00 tx=0x7f2750009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:46.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.877+0000 7f275cff9640 1 -- 172.21.15.71:0/1166930739 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2750038070 con 0x7f27600fb470 2024-09-10T10:01:46.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.877+0000 7f27664dc640 1 -- 172.21.15.71:0/1166930739 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276010d5a0 con 0x7f27600fb470 2024-09-10T10:01:46.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.877+0000 7f275cff9640 1 -- 172.21.15.71:0/1166930739 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f275002ae90 con 0x7f27600fb470 2024-09-10T10:01:46.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.877+0000 7f275cff9640 1 -- 172.21.15.71:0/1166930739 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f275003d440 con 0x7f27600fb470 2024-09-10T10:01:46.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.877+0000 7f27664dc640 1 -- 172.21.15.71:0/1166930739 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276010dae0 con 0x7f27600fb470 2024-09-10T10:01:46.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.878+0000 7f27664dc640 1 -- 172.21.15.71:0/1166930739 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27600fa8d0 con 0x7f27600fb470 2024-09-10T10:01:46.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.879+0000 7f275cff9640 1 -- 172.21.15.71:0/1166930739 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f2750030020 con 0x7f27600fb470 2024-09-10T10:01:46.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.879+0000 7f275cff9640 1 --2- 172.21.15.71:0/1166930739 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f274806ed50 0x7f2748071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:46.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.879+0000 7f275f7fe640 1 --2- 172.21.15.71:0/1166930739 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f274806ed50 0x7f2748071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:46.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.879+0000 7f275cff9640 1 -- 172.21.15.71:0/1166930739 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f27500ae8b0 con 0x7f27600fb470 2024-09-10T10:01:46.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.880+0000 7f275f7fe640 1 --2- 172.21.15.71:0/1166930739 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f274806ed50 0x7f2748071200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f276010bd70 tx=0x7f2754009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:46.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:46.883+0000 7f275cff9640 1 -- 172.21.15.71:0/1166930739 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f275007ba40 con 0x7f27600fb470 2024-09-10T10:01:47.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:47.076+0000 7f27664dc640 1 -- 172.21.15.71:0/1166930739 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f276010dda0 con 0x7f27600fb470 2024-09-10T10:01:47.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:47.076+0000 7f275cff9640 1 -- 172.21.15.71:0/1166930739 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1832 (secure 0 0 0) 0x7f275007b3e0 con 0x7f27600fb470 2024-09-10T10:01:47.077 INFO:teuthology.orchestra.run.smithi071.stdout:e20 2024-09-10T10:01:47.078 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:01:47.078 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:01:47.078 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:01:47.078 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:01:47.078 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:01:47.078 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:01:47.078 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 20 2024-09-10T10:01:47.078 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:01:47.078 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:01:47.078 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:01:46.701856+0000 2024-09-10T10:01:47.078 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:01:47.078 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:01:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:01:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:01:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:01:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:01:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:01:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:01:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:01:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:01:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:01:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:01:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:01:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:01:47.079 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:01:47.080 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:01:47.080 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:01:47.080 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:01:47.080 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:01:47.080 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:01:47.080 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:01:47.080 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:01:47.080 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:01:47.080 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:01:47.080 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:01:47.080 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:01:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 20 2024-09-10T10:01:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:47.078+0000 7f27664dc640 1 -- 172.21.15.71:0/1166930739 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f274806ed50 msgr2=0x7f2748071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:47.078+0000 7f27664dc640 1 --2- 172.21.15.71:0/1166930739 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f274806ed50 0x7f2748071200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f276010bd70 tx=0x7f2754009040 comp rx=0 tx=0).stop 2024-09-10T10:01:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:47.078+0000 7f27664dc640 1 -- 172.21.15.71:0/1166930739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27600fb470 msgr2=0x7f276010bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:47.078+0000 7f27664dc640 1 --2- 172.21.15.71:0/1166930739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27600fb470 0x7f276010bfc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2750000c00 tx=0x7f2750009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:47.078+0000 7f27664dc640 1 -- 172.21.15.71:0/1166930739 shutdown_connections 2024-09-10T10:01:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:47.078+0000 7f27664dc640 1 --2- 172.21.15.71:0/1166930739 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f274806ed50 0x7f2748071200 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:47.078+0000 7f27664dc640 1 --2- 172.21.15.71:0/1166930739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27600fc740 0x7f276010c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:47.078+0000 7f27664dc640 1 --2- 172.21.15.71:0/1166930739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27600fb470 0x7f276010bfc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:47.078+0000 7f27664dc640 1 -- 172.21.15.71:0/1166930739 >> 172.21.15.71:0/1166930739 conn(0x7f27600f6c30 msgr2=0x7f27600f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:47.078+0000 7f27664dc640 1 -- 172.21.15.71:0/1166930739 shutdown_connections 2024-09-10T10:01:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:47.078+0000 7f27664dc640 1 -- 172.21.15.71:0/1166930739 wait complete. 2024-09-10T10:01:47.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:46 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] up:rejoin 2024-09-10T10:01:47.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:46 smithi107 ceph-mon[34215]: fsmap cephfs:2/2 {0=cephfs.smithi071.omoqqq=up:rejoin,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 1 up:standby 2024-09-10T10:01:47.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:46 smithi107 ceph-mon[34215]: daemon mds.cephfs.smithi071.omoqqq is now active in filesystem cephfs as rank 0 2024-09-10T10:01:47.671 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-10T10:01:47.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:47 smithi107 ceph-mon[34215]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-10T10:01:47.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:47 smithi107 ceph-mon[34215]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T10:01:47.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:47 smithi107 ceph-mon[34215]: Cluster is now healthy 2024-09-10T10:01:47.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:47 smithi107 ceph-mon[34215]: mds.? [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] up:active 2024-09-10T10:01:47.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:47 smithi107 ceph-mon[34215]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 1 up:standby 2024-09-10T10:01:47.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:47 smithi107 ceph-mon[34215]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:01:47.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:47 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1166930739' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:01:48.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:47 smithi071 ceph-mon[27559]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-10T10:01:48.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:47 smithi071 ceph-mon[27559]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T10:01:48.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:47 smithi071 ceph-mon[27559]: Cluster is now healthy 2024-09-10T10:01:48.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:47 smithi071 ceph-mon[27559]: mds.? [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] up:active 2024-09-10T10:01:48.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:47 smithi071 ceph-mon[27559]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 1 up:standby-replay 1 up:standby 2024-09-10T10:01:48.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:47 smithi071 ceph-mon[27559]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:01:48.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:47 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1166930739' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:01:48.112 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:49.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.695+0000 7fe08457b640 1 -- 172.21.15.71:0/493347085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe07c0ffa20 msgr2=0x7fe07c0ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:49.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.695+0000 7fe08457b640 1 --2- 172.21.15.71:0/493347085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe07c0ffa20 0x7fe07c0ffe90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe070009c50 tx=0x7fe070004d10 comp rx=0 tx=0).stop 2024-09-10T10:01:49.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.695+0000 7fe08457b640 1 -- 172.21.15.71:0/493347085 shutdown_connections 2024-09-10T10:01:49.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.695+0000 7fe08457b640 1 --2- 172.21.15.71:0/493347085 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe07c0ffa20 0x7fe07c0ffe90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:49.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.695+0000 7fe08457b640 1 --2- 172.21.15.71:0/493347085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe07c0fe750 0x7fe07c0feb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:49.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.695+0000 7fe08457b640 1 -- 172.21.15.71:0/493347085 >> 172.21.15.71:0/493347085 conn(0x7fe07c0fa200 msgr2=0x7fe07c0fc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:49.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.695+0000 7fe08457b640 1 -- 172.21.15.71:0/493347085 shutdown_connections 2024-09-10T10:01:49.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.695+0000 7fe08457b640 1 -- 172.21.15.71:0/493347085 wait complete. 2024-09-10T10:01:49.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe08457b640 1 Processor -- start 2024-09-10T10:01:49.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe08457b640 1 -- start start 2024-09-10T10:01:49.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe08457b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe07c0fe750 0x7fe07c10f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:49.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe08457b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe07c0ffa20 0x7fe07c10f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:49.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe08457b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c110670 con 0x7fe07c0fe750 2024-09-10T10:01:49.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe08457b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c1107e0 con 0x7fe07c0ffa20 2024-09-10T10:01:49.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe082317640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe07c0fe750 0x7fe07c10f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:49.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe082317640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe07c0fe750 0x7fe07c10f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45152/0 (socket says 172.21.15.71:45152) 2024-09-10T10:01:49.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe082317640 1 -- 172.21.15.71:0/3444982109 learned_addr learned my addr 172.21.15.71:0/3444982109 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:49.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe081b16640 1 --2- 172.21.15.71:0/3444982109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe07c0ffa20 0x7fe07c10f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:49.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe082317640 1 -- 172.21.15.71:0/3444982109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe07c0ffa20 msgr2=0x7fe07c10f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:49.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe082317640 1 --2- 172.21.15.71:0/3444982109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe07c0ffa20 0x7fe07c10f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:49.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe082317640 1 -- 172.21.15.71:0/3444982109 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0700098b0 con 0x7fe07c0fe750 2024-09-10T10:01:49.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe081b16640 1 --2- 172.21.15.71:0/3444982109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe07c0ffa20 0x7fe07c10f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:01:49.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.696+0000 7fe082317640 1 --2- 172.21.15.71:0/3444982109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe07c0fe750 0x7fe07c10f310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe07400b790 tx=0x7fe0740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:49.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.697+0000 7fe07affd640 1 -- 172.21.15.71:0/3444982109 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe07400c700 con 0x7fe07c0fe750 2024-09-10T10:01:49.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.697+0000 7fe07affd640 1 -- 172.21.15.71:0/3444982109 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe07400cd00 con 0x7fe07c0fe750 2024-09-10T10:01:49.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.697+0000 7fe08457b640 1 -- 172.21.15.71:0/3444982109 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c110ac0 con 0x7fe07c0fe750 2024-09-10T10:01:49.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.697+0000 7fe07affd640 1 -- 172.21.15.71:0/3444982109 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe074015e70 con 0x7fe07c0fe750 2024-09-10T10:01:49.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.697+0000 7fe08457b640 1 -- 172.21.15.71:0/3444982109 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c110fe0 con 0x7fe07c0fe750 2024-09-10T10:01:49.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.698+0000 7fe08457b640 1 -- 172.21.15.71:0/3444982109 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07c1079e0 con 0x7fe07c0fe750 2024-09-10T10:01:49.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.698+0000 7fe07affd640 1 -- 172.21.15.71:0/3444982109 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe074012070 con 0x7fe07c0fe750 2024-09-10T10:01:49.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.699+0000 7fe07affd640 1 --2- 172.21.15.71:0/3444982109 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe06406ed60 0x7fe064071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:49.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.699+0000 7fe081b16640 1 --2- 172.21.15.71:0/3444982109 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe06406ed60 0x7fe064071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:49.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.699+0000 7fe07affd640 1 -- 172.21.15.71:0/3444982109 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe07408dd50 con 0x7fe07c0fe750 2024-09-10T10:01:49.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.699+0000 7fe081b16640 1 --2- 172.21.15.71:0/3444982109 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe06406ed60 0x7fe064071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe070004a30 tx=0x7fe070004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:49.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.703+0000 7fe07affd640 1 -- 172.21.15.71:0/3444982109 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe07405ae20 con 0x7fe07c0fe750 2024-09-10T10:01:49.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:49 smithi071 ceph-mon[27559]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-10T10:01:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:49 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:49 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:49 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:49 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:49 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:49 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:49.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.946+0000 7fe08457b640 1 -- 172.21.15.71:0/3444982109 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe07c0fdd00 con 0x7fe07c0fe750 2024-09-10T10:01:49.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.946+0000 7fe07affd640 1 -- 172.21.15.71:0/3444982109 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4722 (secure 0 0 0) 0x7fe07405a7c0 con 0x7fe07c0fe750 2024-09-10T10:01:49.948 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 20 2024-09-10T10:01:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.949+0000 7fe08457b640 1 -- 172.21.15.71:0/3444982109 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe06406ed60 msgr2=0x7fe064071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.949+0000 7fe08457b640 1 --2- 172.21.15.71:0/3444982109 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe06406ed60 0x7fe064071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe070004a30 tx=0x7fe070004d10 comp rx=0 tx=0).stop 2024-09-10T10:01:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.949+0000 7fe08457b640 1 -- 172.21.15.71:0/3444982109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe07c0fe750 msgr2=0x7fe07c10f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.949+0000 7fe08457b640 1 --2- 172.21.15.71:0/3444982109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe07c0fe750 0x7fe07c10f310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe07400b790 tx=0x7fe0740091d0 comp rx=0 tx=0).stop 2024-09-10T10:01:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.949+0000 7fe08457b640 1 -- 172.21.15.71:0/3444982109 shutdown_connections 2024-09-10T10:01:49.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.949+0000 7fe08457b640 1 --2- 172.21.15.71:0/3444982109 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe06406ed60 0x7fe064071210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:49.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.949+0000 7fe08457b640 1 --2- 172.21.15.71:0/3444982109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe07c0ffa20 0x7fe07c10f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:49.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.949+0000 7fe08457b640 1 --2- 172.21.15.71:0/3444982109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe07c0fe750 0x7fe07c10f310 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:49.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.949+0000 7fe08457b640 1 -- 172.21.15.71:0/3444982109 >> 172.21.15.71:0/3444982109 conn(0x7fe07c0fa200 msgr2=0x7fe07c0fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:49.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.949+0000 7fe08457b640 1 -- 172.21.15.71:0/3444982109 shutdown_connections 2024-09-10T10:01:49.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:49.949+0000 7fe08457b640 1 -- 172.21.15.71:0/3444982109 wait complete. 2024-09-10T10:01:49.958 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:01:50.105 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:49 smithi107 ceph-mon[34215]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-10T10:01:50.106 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:49 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:50.106 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:49 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:50.106 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:49 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:50.106 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:49 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:50.106 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:49 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:50.106 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:49 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:50.971 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:50 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3444982109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:01:51.026 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:50 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3444982109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:01:51.049 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-10T10:01:51.745 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:51.972 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:51 smithi071 ceph-mon[27559]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T10:01:51.972 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:51.972 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:51 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:52.029 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:51 smithi107 ceph-mon[34215]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T10:01:52.029 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:52.029 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:51 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:53.888 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:53 smithi071 ceph-mon[27559]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T10:01:53.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.887+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1661150879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d8065c40 msgr2=0x7f04d80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:53.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.887+0000 7f04ddd1e640 1 --2- 172.21.15.71:0/1661150879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d8065c40 0x7f04d80ff140 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f04c80048d0 tx=0x7f04c8009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:53.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.887+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1661150879 shutdown_connections 2024-09-10T10:01:53.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.887+0000 7f04ddd1e640 1 --2- 172.21.15.71:0/1661150879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d80ff680 0x7f04d8101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:53.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.887+0000 7f04ddd1e640 1 --2- 172.21.15.71:0/1661150879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d8065c40 0x7f04d80ff140 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:53.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.887+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1661150879 >> 172.21.15.71:0/1661150879 conn(0x7f04d80f6c10 msgr2=0x7f04d80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:53.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.887+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1661150879 shutdown_connections 2024-09-10T10:01:53.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.887+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1661150879 wait complete. 2024-09-10T10:01:53.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.887+0000 7f04ddd1e640 1 Processor -- start 2024-09-10T10:01:53.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.888+0000 7f04ddd1e640 1 -- start start 2024-09-10T10:01:53.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.888+0000 7f04ddd1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d8065c40 0x7f04d80fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:53.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.888+0000 7f04ddd1e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d80ff680 0x7f04d80fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:53.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.888+0000 7f04ddd1e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d8110d50 con 0x7f04d80ff680 2024-09-10T10:01:53.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.888+0000 7f04ddd1e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d8110e90 con 0x7f04d8065c40 2024-09-10T10:01:53.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.888+0000 7f04cffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d80ff680 0x7f04d80fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:53.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.888+0000 7f04cffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d80ff680 0x7f04d80fb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58628/0 (socket says 172.21.15.71:58628) 2024-09-10T10:01:53.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.888+0000 7f04cffff640 1 -- 172.21.15.71:0/1353230414 learned_addr learned my addr 172.21.15.71:0/1353230414 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:53.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.888+0000 7f04d77fe640 1 --2- 172.21.15.71:0/1353230414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d8065c40 0x7f04d80fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:53.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.888+0000 7f04cffff640 1 -- 172.21.15.71:0/1353230414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d8065c40 msgr2=0x7f04d80fcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:53.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.888+0000 7f04cffff640 1 --2- 172.21.15.71:0/1353230414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d8065c40 0x7f04d80fcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:53.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.888+0000 7f04cffff640 1 -- 172.21.15.71:0/1353230414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c8005040 con 0x7f04d80ff680 2024-09-10T10:01:53.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.888+0000 7f04cffff640 1 --2- 172.21.15.71:0/1353230414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d80ff680 0x7f04d80fb040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f04c0002a50 tx=0x7f04c0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:53.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.889+0000 7f04d4ff9640 1 -- 172.21.15.71:0/1353230414 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04c0007c30 con 0x7f04d80ff680 2024-09-10T10:01:53.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.889+0000 7f04d4ff9640 1 -- 172.21.15.71:0/1353230414 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f04c000f040 con 0x7f04d80ff680 2024-09-10T10:01:53.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.889+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1353230414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d80fb5e0 con 0x7f04d80ff680 2024-09-10T10:01:53.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.889+0000 7f04d4ff9640 1 -- 172.21.15.71:0/1353230414 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04c000da10 con 0x7f04d80ff680 2024-09-10T10:01:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.889+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1353230414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d80fbb50 con 0x7f04d80ff680 2024-09-10T10:01:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.890+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1353230414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d80fa890 con 0x7f04d80ff680 2024-09-10T10:01:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.890+0000 7f04d4ff9640 1 -- 172.21.15.71:0/1353230414 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f04c000dbb0 con 0x7f04d80ff680 2024-09-10T10:01:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.891+0000 7f04d4ff9640 1 --2- 172.21.15.71:0/1353230414 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f04c406ed60 0x7f04c4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.891+0000 7f04d77fe640 1 --2- 172.21.15.71:0/1353230414 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f04c406ed60 0x7f04c4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.891+0000 7f04d4ff9640 1 -- 172.21.15.71:0/1353230414 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f04c008d8c0 con 0x7f04d80ff680 2024-09-10T10:01:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.891+0000 7f04d77fe640 1 --2- 172.21.15.71:0/1353230414 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f04c406ed60 0x7f04c4071210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04d80fc8b0 tx=0x7f04c8035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:53.895+0000 7f04d4ff9640 1 -- 172.21.15.71:0/1353230414 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f04c004d2a0 con 0x7f04d80ff680 2024-09-10T10:01:54.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:54.118+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1353230414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f04d804b720 con 0x7f04d80ff680 2024-09-10T10:01:54.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:54.118+0000 7f04d4ff9640 1 -- 172.21.15.71:0/1353230414 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v20) v1 ==== 78+0+100 (secure 0 0 0) 0x7f04c005ab80 con 0x7f04d80ff680 2024-09-10T10:01:54.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:54.120+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1353230414 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f04c406ed60 msgr2=0x7f04c4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:54.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:54.120+0000 7f04ddd1e640 1 --2- 172.21.15.71:0/1353230414 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f04c406ed60 0x7f04c4071210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04d80fc8b0 tx=0x7f04c8035040 comp rx=0 tx=0).stop 2024-09-10T10:01:54.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:54.120+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1353230414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d80ff680 msgr2=0x7f04d80fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:54.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:54.120+0000 7f04ddd1e640 1 --2- 172.21.15.71:0/1353230414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d80ff680 0x7f04d80fb040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f04c0002a50 tx=0x7f04c0004600 comp rx=0 tx=0).stop 2024-09-10T10:01:54.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:54.120+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1353230414 shutdown_connections 2024-09-10T10:01:54.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:54.120+0000 7f04ddd1e640 1 --2- 172.21.15.71:0/1353230414 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f04c406ed60 0x7f04c4071210 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:54.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:54.120+0000 7f04ddd1e640 1 --2- 172.21.15.71:0/1353230414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d80ff680 0x7f04d80fb040 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:54.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:54.120+0000 7f04ddd1e640 1 --2- 172.21.15.71:0/1353230414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d8065c40 0x7f04d80fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:54.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:54.120+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1353230414 >> 172.21.15.71:0/1353230414 conn(0x7f04d80f6c10 msgr2=0x7f04d80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:54.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:54.120+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1353230414 shutdown_connections 2024-09-10T10:01:54.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:54.120+0000 7f04ddd1e640 1 -- 172.21.15.71:0/1353230414 wait complete. 2024-09-10T10:01:54.130 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:01:54.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:53 smithi107 ceph-mon[34215]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T10:01:54.978 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:54 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1353230414' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-10T10:01:55.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:54 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1353230414' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-10T10:01:55.289 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-10T10:01:55.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:01:55.953 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:56.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:55 smithi071 ceph-mon[27559]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T10:01:56.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:55 smithi107 ceph-mon[34215]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-10T10:01:57.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.478+0000 7fdfea1cf640 1 -- 172.21.15.71:0/904927370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfe40fdf20 msgr2=0x7fdfe4106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:57.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.478+0000 7fdfea1cf640 1 --2- 172.21.15.71:0/904927370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfe40fdf20 0x7fdfe4106560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80048d0 tx=0x7fdfd8009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.478+0000 7fdfea1cf640 1 -- 172.21.15.71:0/904927370 shutdown_connections 2024-09-10T10:01:57.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.478+0000 7fdfea1cf640 1 --2- 172.21.15.71:0/904927370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfe40fdf20 0x7fdfe4106560 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.478+0000 7fdfea1cf640 1 --2- 172.21.15.71:0/904927370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfe40fd580 0x7fdfe40fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.478+0000 7fdfea1cf640 1 -- 172.21.15.71:0/904927370 >> 172.21.15.71:0/904927370 conn(0x7fdfe40f7010 msgr2=0x7fdfe40f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:57.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.478+0000 7fdfea1cf640 1 -- 172.21.15.71:0/904927370 shutdown_connections 2024-09-10T10:01:57.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.478+0000 7fdfea1cf640 1 -- 172.21.15.71:0/904927370 wait complete. 2024-09-10T10:01:57.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.478+0000 7fdfea1cf640 1 Processor -- start 2024-09-10T10:01:57.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.478+0000 7fdfea1cf640 1 -- start start 2024-09-10T10:01:57.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfea1cf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfe40fd580 0x7fdfe4113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:57.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfea1cf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfe40fdf20 0x7fdfe4113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:57.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfea1cf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe4113d90 con 0x7fdfe40fdf20 2024-09-10T10:01:57.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfea1cf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe410d1d0 con 0x7fdfe40fd580 2024-09-10T10:01:57.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfe2ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfe40fdf20 0x7fdfe4113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:57.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfe2ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfe40fdf20 0x7fdfe4113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58644/0 (socket says 172.21.15.71:58644) 2024-09-10T10:01:57.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfe2ffd640 1 -- 172.21.15.71:0/3040623867 learned_addr learned my addr 172.21.15.71:0/3040623867 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:01:57.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfe37fe640 1 --2- 172.21.15.71:0/3040623867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfe40fd580 0x7fdfe4113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:57.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfe2ffd640 1 -- 172.21.15.71:0/3040623867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfe40fd580 msgr2=0x7fdfe4113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:57.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfe2ffd640 1 --2- 172.21.15.71:0/3040623867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfe40fd580 0x7fdfe4113250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfe2ffd640 1 -- 172.21.15.71:0/3040623867 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd8005040 con 0x7fdfe40fdf20 2024-09-10T10:01:57.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfe37fe640 1 --2- 172.21.15.71:0/3040623867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfe40fd580 0x7fdfe4113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:01:57.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfe2ffd640 1 --2- 172.21.15.71:0/3040623867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfe40fdf20 0x7fdfe4113790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8000c00 tx=0x7fdfd8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:57.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfcbfff640 1 -- 172.21.15.71:0/3040623867 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfd8038070 con 0x7fdfe40fdf20 2024-09-10T10:01:57.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfcbfff640 1 -- 172.21.15.71:0/3040623867 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdfd802ade0 con 0x7fdfe40fdf20 2024-09-10T10:01:57.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfea1cf640 1 -- 172.21.15.71:0/3040623867 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe410d450 con 0x7fdfe40fdf20 2024-09-10T10:01:57.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfcbfff640 1 -- 172.21.15.71:0/3040623867 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfd802c7e0 con 0x7fdfe40fdf20 2024-09-10T10:01:57.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.479+0000 7fdfea1cf640 1 -- 172.21.15.71:0/3040623867 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe410d910 con 0x7fdfe40fdf20 2024-09-10T10:01:57.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.480+0000 7fdfea1cf640 1 -- 172.21.15.71:0/3040623867 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe4066330 con 0x7fdfe40fdf20 2024-09-10T10:01:57.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.481+0000 7fdfcbfff640 1 -- 172.21.15.71:0/3040623867 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fdfd8030020 con 0x7fdfe40fdf20 2024-09-10T10:01:57.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.481+0000 7fdfcbfff640 1 --2- 172.21.15.71:0/3040623867 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdfcc06ed60 0x7fdfcc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:57.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.481+0000 7fdfcbfff640 1 -- 172.21.15.71:0/3040623867 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdfd80ade60 con 0x7fdfe40fdf20 2024-09-10T10:01:57.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.481+0000 7fdfe37fe640 1 --2- 172.21.15.71:0/3040623867 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdfcc06ed60 0x7fdfcc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:57.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.482+0000 7fdfe37fe640 1 --2- 172.21.15.71:0/3040623867 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdfcc06ed60 0x7fdfcc071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009fd0 tx=0x7fdfd4009e50 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:57.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.485+0000 7fdfcbfff640 1 -- 172.21.15.71:0/3040623867 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdfd807afe0 con 0x7fdfe40fdf20 2024-09-10T10:01:57.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.699+0000 7fdfea1cf640 1 -- 172.21.15.71:0/3040623867 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfe410e8c0 con 0x7fdfe40fdf20 2024-09-10T10:01:57.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.699+0000 7fdfcbfff640 1 -- 172.21.15.71:0/3040623867 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4722 (secure 0 0 0) 0x7fdfd807a980 con 0x7fdfe40fdf20 2024-09-10T10:01:57.701 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:01:57.701 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:01:46.701856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi071.omoqqq","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.71:6829/3739086646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3739086646},{"type":"v1","addr":"172.21.15.71:6829","nonce":3739086646}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14478":{"gid":14478,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6827/1596759135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1596759135},{"type":"v1","addr":"172.21.15.71:6827","nonce":1596759135}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi107.nycoxn","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6825/2124995551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2124995551},{"type":"v1","addr":"172.21.15.107:6825","nonce":2124995551}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24279":{"gid":24279,"name":"cephfs.smithi107.rvgklu","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.107:6827/132718485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":132718485},{"type":"v1","addr":"172.21.15.107:6827","nonce":132718485}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-09-10T10:01:57.701 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 20 2024-09-10T10:01:57.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.701+0000 7fdfea1cf640 1 -- 172.21.15.71:0/3040623867 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdfcc06ed60 msgr2=0x7fdfcc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:57.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.701+0000 7fdfea1cf640 1 --2- 172.21.15.71:0/3040623867 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdfcc06ed60 0x7fdfcc071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009fd0 tx=0x7fdfd4009e50 comp rx=0 tx=0).stop 2024-09-10T10:01:57.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.701+0000 7fdfea1cf640 1 -- 172.21.15.71:0/3040623867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfe40fdf20 msgr2=0x7fdfe4113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:57.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.701+0000 7fdfea1cf640 1 --2- 172.21.15.71:0/3040623867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfe40fdf20 0x7fdfe4113790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8000c00 tx=0x7fdfd8009da0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.701+0000 7fdfea1cf640 1 -- 172.21.15.71:0/3040623867 shutdown_connections 2024-09-10T10:01:57.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.701+0000 7fdfea1cf640 1 --2- 172.21.15.71:0/3040623867 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdfcc06ed60 0x7fdfcc071210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.701+0000 7fdfea1cf640 1 --2- 172.21.15.71:0/3040623867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfe40fdf20 0x7fdfe4113790 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.701+0000 7fdfea1cf640 1 --2- 172.21.15.71:0/3040623867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfe40fd580 0x7fdfe4113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.701+0000 7fdfea1cf640 1 -- 172.21.15.71:0/3040623867 >> 172.21.15.71:0/3040623867 conn(0x7fdfe40f7010 msgr2=0x7fdfe40f8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:57.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.701+0000 7fdfea1cf640 1 -- 172.21.15.71:0/3040623867 shutdown_connections 2024-09-10T10:01:57.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:01:57.701+0000 7fdfea1cf640 1 -- 172.21.15.71:0/3040623867 wait complete. 2024-09-10T10:01:58.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:57 smithi071 ceph-mon[27559]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T10:01:58.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:57 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:58.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:57 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:58.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:57 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:58.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:57 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:58.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:57 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:58.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:57 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3040623867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:01:58.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:57 smithi107 ceph-mon[34215]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T10:01:58.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:57 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:58.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:57 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:58.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:57 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:58.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:57 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:58.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:57 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:58.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:57 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3040623867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:01:58.371 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 20, 'max_mds': 2, 'flags': 50} 2024-09-10T10:01:58.371 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-10T10:01:58.400 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-10T10:01:58.400 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-10T10:01:58.400 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-10T10:01:58.400 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T10:01:58.400 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T10:01:58.400 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-10T10:01:58.400 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T10:01:58.401 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T10:01:58.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:01:58.401 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-10T10:01:58.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:01:58.422 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-09-10T10:01:58.496 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-09-10T10:01:58.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:01:58.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:01:58.498 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-09-10T10:01:58.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:01:58.516 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2024-09-10T10:01:58.588 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2024-09-10T10:01:58.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:01:58.589 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-10T10:01:58.590 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T10:01:58.590 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T10:01:58.882 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:01:59.977 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:59 smithi071 ceph-mon[27559]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T10:01:59.977 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:59 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:01:59.977 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:01:59 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:02:00.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:59 smithi107 ceph-mon[34215]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T10:02:00.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:59 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:02:00.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:01:59 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:02:00.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.302+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3677156595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1a01014c0 msgr2=0x7fa1a0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.302+0000 7fa1a55c2640 1 --2- 172.21.15.71:0/3677156595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1a01014c0 0x7fa1a0101890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa190009c50 tx=0x7fa190004d10 comp rx=0 tx=0).stop 2024-09-10T10:02:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.302+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3677156595 shutdown_connections 2024-09-10T10:02:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.302+0000 7fa1a55c2640 1 --2- 172.21.15.71:0/3677156595 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1a00fb480 0x7fa1a00fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.302+0000 7fa1a55c2640 1 --2- 172.21.15.71:0/3677156595 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1a01014c0 0x7fa1a0101890 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.302+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3677156595 >> 172.21.15.71:0/3677156595 conn(0x7fa1a00f7000 msgr2=0x7fa1a00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.302+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3677156595 shutdown_connections 2024-09-10T10:02:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.302+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3677156595 wait complete. 2024-09-10T10:02:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.303+0000 7fa1a55c2640 1 Processor -- start 2024-09-10T10:02:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.303+0000 7fa1a55c2640 1 -- start start 2024-09-10T10:02:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.303+0000 7fa1a55c2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1a00fb480 0x7fa1a010e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:00.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.303+0000 7fa1a55c2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1a01014c0 0x7fa1a010e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:00.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.303+0000 7fa1a55c2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a010ed00 con 0x7fa1a01014c0 2024-09-10T10:02:00.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.303+0000 7fa1a55c2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a010ee70 con 0x7fa1a00fb480 2024-09-10T10:02:00.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.304+0000 7fa19e7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1a01014c0 0x7fa1a010e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:00.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.304+0000 7fa19e7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1a01014c0 0x7fa1a010e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58660/0 (socket says 172.21.15.71:58660) 2024-09-10T10:02:00.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.304+0000 7fa19e7fc640 1 -- 172.21.15.71:0/3515175519 learned_addr learned my addr 172.21.15.71:0/3515175519 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:00.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.304+0000 7fa19effd640 1 --2- 172.21.15.71:0/3515175519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1a00fb480 0x7fa1a010e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:00.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.304+0000 7fa19e7fc640 1 -- 172.21.15.71:0/3515175519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1a00fb480 msgr2=0x7fa1a010e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:00.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.304+0000 7fa19e7fc640 1 --2- 172.21.15.71:0/3515175519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1a00fb480 0x7fa1a010e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:00.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.304+0000 7fa19e7fc640 1 -- 172.21.15.71:0/3515175519 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900098b0 con 0x7fa1a01014c0 2024-09-10T10:02:00.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.304+0000 7fa19e7fc640 1 --2- 172.21.15.71:0/3515175519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1a01014c0 0x7fa1a010e6b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa194002a80 tx=0x7fa194004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:00.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.304+0000 7fa1877fe640 1 -- 172.21.15.71:0/3515175519 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa194007c30 con 0x7fa1a01014c0 2024-09-10T10:02:00.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.304+0000 7fa1877fe640 1 -- 172.21.15.71:0/3515175519 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa19400f040 con 0x7fa1a01014c0 2024-09-10T10:02:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.304+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3515175519 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a01171e0 con 0x7fa1a01014c0 2024-09-10T10:02:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.304+0000 7fa1877fe640 1 -- 172.21.15.71:0/3515175519 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa194009530 con 0x7fa1a01014c0 2024-09-10T10:02:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.304+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3515175519 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a0117670 con 0x7fa1a01014c0 2024-09-10T10:02:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.305+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3515175519 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a00fcbc0 con 0x7fa1a01014c0 2024-09-10T10:02:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.306+0000 7fa1877fe640 1 -- 172.21.15.71:0/3515175519 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fa1940097a0 con 0x7fa1a01014c0 2024-09-10T10:02:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.306+0000 7fa1877fe640 1 --2- 172.21.15.71:0/3515175519 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa18806ed60 0x7fa188071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.306+0000 7fa19effd640 1 --2- 172.21.15.71:0/3515175519 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa18806ed60 0x7fa188071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.306+0000 7fa1877fe640 1 -- 172.21.15.71:0/3515175519 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa19408daf0 con 0x7fa1a01014c0 2024-09-10T10:02:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.307+0000 7fa19effd640 1 --2- 172.21.15.71:0/3515175519 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa18806ed60 0x7fa188071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa190004a30 tx=0x7fa190004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:00.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.310+0000 7fa1877fe640 1 -- 172.21.15.71:0/3515175519 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa19404d2a0 con 0x7fa1a01014c0 2024-09-10T10:02:00.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.505+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3515175519 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa1a00fac40 con 0x7fa1a01014c0 2024-09-10T10:02:00.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.505+0000 7fa1877fe640 1 -- 172.21.15.71:0/3515175519 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+83 (secure 0 0 0) 0x7fa19405abc0 con 0x7fa1a01014c0 2024-09-10T10:02:00.506 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-10T10:02:00.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.507+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3515175519 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa18806ed60 msgr2=0x7fa188071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:00.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.507+0000 7fa1a55c2640 1 --2- 172.21.15.71:0/3515175519 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa18806ed60 0x7fa188071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa190004a30 tx=0x7fa190004d10 comp rx=0 tx=0).stop 2024-09-10T10:02:00.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.507+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3515175519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1a01014c0 msgr2=0x7fa1a010e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:00.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.507+0000 7fa1a55c2640 1 --2- 172.21.15.71:0/3515175519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1a01014c0 0x7fa1a010e6b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa194002a80 tx=0x7fa194004600 comp rx=0 tx=0).stop 2024-09-10T10:02:00.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.507+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3515175519 shutdown_connections 2024-09-10T10:02:00.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.507+0000 7fa1a55c2640 1 --2- 172.21.15.71:0/3515175519 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa18806ed60 0x7fa188071210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:00.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.507+0000 7fa1a55c2640 1 --2- 172.21.15.71:0/3515175519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1a01014c0 0x7fa1a010e6b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:00.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.507+0000 7fa1a55c2640 1 --2- 172.21.15.71:0/3515175519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1a00fb480 0x7fa1a010e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:00.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.507+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3515175519 >> 172.21.15.71:0/3515175519 conn(0x7fa1a00f7000 msgr2=0x7fa1a00f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:00.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.507+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3515175519 shutdown_connections 2024-09-10T10:02:00.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:00.507+0000 7fa1a55c2640 1 -- 172.21.15.71:0/3515175519 wait complete. 2024-09-10T10:02:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:00 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3515175519' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T10:02:01.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:00 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3515175519' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T10:02:01.173 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T10:02:01.173 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T10:02:01.173 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2024-09-10T10:02:01.173 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T10:02:01.173 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T10:02:01.173 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T10:02:01.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T10:02:01.173 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T10:02:01.173 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T10:02:01.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:01.174 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2024-09-10T10:02:01.191 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T10:02:01.191 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T10:02:01.191 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T10:02:01.191 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:02:01.191 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-09-10T10:02:01.192 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:02:01.192 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:02:01.192 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2024-09-10T10:02:01.192 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2024-09-10T10:02:01.192 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:02:01.192 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2024-09-10T10:02:01.193 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2024-09-10T10:02:01.193 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:02:01.193 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:02:01.193 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T10:02:01.193 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:02:01.194 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T10:02:01.194 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42349sec preferred_lft 42349sec 2024-09-10T10:02:01.194 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link noprefixroute 2024-09-10T10:02:01.194 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:02:01.195 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T10:02:01.195 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:02:01.195 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-10T10:02:01.195 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add name ceph-brx type bridge 2024-09-10T10:02:01.195 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr flush dev ceph-brx 2024-09-10T10:02:01.196 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set ceph-brx up 2024-09-10T10:02:01.196 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T10:02:01.196 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-10T10:02:01.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:02:01.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:02:01.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:01.399 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T10:02:01.423 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-09-10T10:02:01.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:01.425 DEBUG:teuthology.orchestra.run.smithi071:> route 2024-09-10T10:02:01.495 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2024-09-10T10:02:01.495 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T10:02:01.496 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T10:02:01.496 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T10:02:01.496 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T10:02:01.496 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:02:01.496 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-10T10:02:01.496 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T10:02:01.497 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T10:02:01.497 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T10:02:01.497 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-10T10:02:01.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:02:01.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:02:01.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:01.776 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-09-10T10:02:01.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:01.793 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2024-09-10T10:02:01.849 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:02:01.849 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-10T10:02:01.849 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T10:02:01.849 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T10:02:01.849 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-10T10:02:01.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:02:01.944 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:01 smithi071 ceph-mon[27559]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T10:02:01.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:02:01.966 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T10:02:01.966 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:02:01.966 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-10T10:02:01.966 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T10:02:01.966 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T10:02:01.966 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T10:02:01.966 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T10:02:01.966 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T10:02:01.967 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-10T10:02:02.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:02:02.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:02:02.086 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:02:02.086 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-10T10:02:02.086 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2024-09-10T10:02:02.087 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T10:02:02.087 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-10T10:02:02.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:02:02.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:01 smithi107 ceph-mon[34215]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T10:02:02.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:02:02.163 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T10:02:02.163 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T10:02:02.163 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T10:02:02.178 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T10:02:02.178 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T10:02:02.178 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T10:02:02.234 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2024-09-10T10:02:02.299 DEBUG:teuthology.orchestra.run.smithi071:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T10:02:02.356 INFO:teuthology.orchestra.run.smithi071.stdout:/proc 2024-09-10T10:02:02.357 INFO:teuthology.orchestra.run.smithi071.stdout:/sys 2024-09-10T10:02:02.357 INFO:teuthology.orchestra.run.smithi071.stdout:/dev 2024-09-10T10:02:02.357 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/security 2024-09-10T10:02:02.357 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/shm 2024-09-10T10:02:02.357 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/pts 2024-09-10T10:02:02.357 INFO:teuthology.orchestra.run.smithi071.stdout:/run 2024-09-10T10:02:02.357 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/cgroup 2024-09-10T10:02:02.357 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/pstore 2024-09-10T10:02:02.357 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/bpf 2024-09-10T10:02:02.357 INFO:teuthology.orchestra.run.smithi071.stdout:/ 2024-09-10T10:02:02.357 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/selinux 2024-09-10T10:02:02.357 INFO:teuthology.orchestra.run.smithi071.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T10:02:02.357 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/mqueue 2024-09-10T10:02:02.358 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/hugepages 2024-09-10T10:02:02.358 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/debug 2024-09-10T10:02:02.358 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/tracing 2024-09-10T10:02:02.358 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/fuse/connections 2024-09-10T10:02:02.358 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T10:02:02.358 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/config 2024-09-10T10:02:02.358 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T10:02:02.358 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T10:02:02.358 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T10:02:02.358 INFO:teuthology.orchestra.run.smithi071.stdout:/run/user/1000 2024-09-10T10:02:02.358 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph 2024-09-10T10:02:02.358 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay 2024-09-10T10:02:02.358 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/14409d452a48669d4bc237c6a8ee6fca73ddbe25f68a775ddd71b379ff67bea0/merged 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/192b3179b0cb70c464faeabd29ecdb39db184bbc29cfde8f651002a4137c3f5a/merged 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/run/user/0 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/732c489ae4273dd37132b5576e65a652a62e95273ac66b7c151d13da462f40c3/merged 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/927d5b983f19eaf20514cb4fe07766435824ba0237207f6c5eb55cf90d81cc73/merged 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/1b8b6e9dd890b2405deb075700a57cd374c7b6dcbd6bb7beb950fc1ed18b96cd/merged 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/e8643241a8cdf0c0a0121519873dda4694c15fced6402df9681e7c5df2895457/merged 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/a1e0c24d958002614460ace70d7b15b7a1bfa9a4df0575734028ea8185ef2eb8/merged 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/9de9c418340322301b757710b60e1b5efb214dc3952625ef9b7d4e8cf14d3dad/merged 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/935e74ae036656a84d72c90748c9d11c17f256413f1732fbe1da9344102c290d/merged 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/e3ba339292b1adea78904dfe8d07bcf394da3de0ecc639fbf964260709bd67db/merged 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/c005b66b34282b11f36ed89bb563b51feb0256d167c44095a838ff4a0f439682/merged 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/fc5547fd2af306a2e1098f95a48afa5db322446f2d0dd35d5084949141d8dd0c/merged 2024-09-10T10:02:02.359 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns 2024-09-10T10:02:02.360 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T10:02:02.360 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T10:02:02.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:02.360 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2024-09-10T10:02:02.413 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T10:02:02.413 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T10:02:02.457 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2024-09-10T10:02:02.481 DEBUG:teuthology.orchestra.run.smithi071:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T10:02:02.538 INFO:teuthology.orchestra.run.smithi071.stdout:/proc 2024-09-10T10:02:02.538 INFO:teuthology.orchestra.run.smithi071.stdout:/sys 2024-09-10T10:02:02.538 INFO:teuthology.orchestra.run.smithi071.stdout:/dev 2024-09-10T10:02:02.538 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/security 2024-09-10T10:02:02.538 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/shm 2024-09-10T10:02:02.538 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/pts 2024-09-10T10:02:02.538 INFO:teuthology.orchestra.run.smithi071.stdout:/run 2024-09-10T10:02:02.538 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/cgroup 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/pstore 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/bpf 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/ 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/selinux 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/mqueue 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/dev/hugepages 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/debug 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/tracing 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/fs/fuse/connections 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/sys/kernel/config 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T10:02:02.539 INFO:teuthology.orchestra.run.smithi071.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T10:02:02.540 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T10:02:02.540 INFO:teuthology.orchestra.run.smithi071.stdout:/run/user/1000 2024-09-10T10:02:02.540 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/ceph 2024-09-10T10:02:02.540 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay 2024-09-10T10:02:02.540 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/14409d452a48669d4bc237c6a8ee6fca73ddbe25f68a775ddd71b379ff67bea0/merged 2024-09-10T10:02:02.540 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/192b3179b0cb70c464faeabd29ecdb39db184bbc29cfde8f651002a4137c3f5a/merged 2024-09-10T10:02:02.540 INFO:teuthology.orchestra.run.smithi071.stdout:/run/user/0 2024-09-10T10:02:02.540 INFO:teuthology.orchestra.run.smithi071.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T10:02:02.540 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/732c489ae4273dd37132b5576e65a652a62e95273ac66b7c151d13da462f40c3/merged 2024-09-10T10:02:02.540 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/927d5b983f19eaf20514cb4fe07766435824ba0237207f6c5eb55cf90d81cc73/merged 2024-09-10T10:02:02.540 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/1b8b6e9dd890b2405deb075700a57cd374c7b6dcbd6bb7beb950fc1ed18b96cd/merged 2024-09-10T10:02:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/e8643241a8cdf0c0a0121519873dda4694c15fced6402df9681e7c5df2895457/merged 2024-09-10T10:02:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/a1e0c24d958002614460ace70d7b15b7a1bfa9a4df0575734028ea8185ef2eb8/merged 2024-09-10T10:02:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/9de9c418340322301b757710b60e1b5efb214dc3952625ef9b7d4e8cf14d3dad/merged 2024-09-10T10:02:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/935e74ae036656a84d72c90748c9d11c17f256413f1732fbe1da9344102c290d/merged 2024-09-10T10:02:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/e3ba339292b1adea78904dfe8d07bcf394da3de0ecc639fbf964260709bd67db/merged 2024-09-10T10:02:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/c005b66b34282b11f36ed89bb563b51feb0256d167c44095a838ff4a0f439682/merged 2024-09-10T10:02:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:/var/lib/containers/storage/overlay/fc5547fd2af306a2e1098f95a48afa5db322446f2d0dd35d5084949141d8dd0c/merged 2024-09-10T10:02:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns 2024-09-10T10:02:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T10:02:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T10:02:02.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:02.542 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2024-09-10T10:02:02.565 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2024-09-10T10:02:02.564+0000 7fbc94a9f300 -1 init, newargv = 0x563ec83927a0 newargc=15 2024-09-10T10:02:02.565 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[73967]: starting ceph client 2024-09-10T10:02:02.573 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[73967]: starting fuse 2024-09-10T10:02:02.581 INFO:teuthology.orchestra.run.smithi071.stdout:153 2024-09-10T10:02:02.581 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [153] 2024-09-10T10:02:02.582 DEBUG:teuthology.orchestra.run.smithi071:> sudo stdin-killer -- python3 -c ' 2024-09-10T10:02:02.582 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2024-09-10T10:02:02.582 DEBUG:teuthology.orchestra.run.smithi071:> import re 2024-09-10T10:02:02.582 DEBUG:teuthology.orchestra.run.smithi071:> import os 2024-09-10T10:02:02.582 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2024-09-10T10:02:02.582 DEBUG:teuthology.orchestra.run.smithi071:> 2024-09-10T10:02:02.582 DEBUG:teuthology.orchestra.run.smithi071:> def _find_admin_socket(client_name): 2024-09-10T10:02:02.582 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T10:02:02.582 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2024-09-10T10:02:02.582 DEBUG:teuthology.orchestra.run.smithi071:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T10:02:02.583 DEBUG:teuthology.orchestra.run.smithi071:> 2024-09-10T10:02:02.583 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2024-09-10T10:02:02.583 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2024-09-10T10:02:02.583 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2024-09-10T10:02:02.583 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2024-09-10T10:02:02.583 DEBUG:teuthology.orchestra.run.smithi071:> 2024-09-10T10:02:02.583 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2024-09-10T10:02:02.583 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T10:02:02.583 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T10:02:02.583 DEBUG:teuthology.orchestra.run.smithi071:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T10:02:02.583 DEBUG:teuthology.orchestra.run.smithi071:> contents = proc_f.read() 2024-09-10T10:02:02.583 DEBUG:teuthology.orchestra.run.smithi071:> if mountpoint in contents: 2024-09-10T10:02:02.584 DEBUG:teuthology.orchestra.run.smithi071:> return f 2024-09-10T10:02:02.584 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T10:02:02.584 DEBUG:teuthology.orchestra.run.smithi071:> 2024-09-10T10:02:02.584 DEBUG:teuthology.orchestra.run.smithi071:> print(_find_admin_socket("client.0")) 2024-09-10T10:02:02.584 DEBUG:teuthology.orchestra.run.smithi071:> ' 2024-09-10T10:02:02.699 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.73967.asok 2024-09-10T10:02:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:02:02.710 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.73967.asok 2024-09-10T10:02:02.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:02.710 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.73967.asok status 2024-09-10T10:02:02.839 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:02:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2024-09-10T10:02:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "96d63e75d310869e716ce7c8655577b0e88a04aa", 2024-09-10T10:02:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)", 2024-09-10T10:02:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2024-09-10T10:02:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2024-09-10T10:02:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T10:02:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "73967", 2024-09-10T10:02:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2024-09-10T10:02:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:02:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2024-09-10T10:02:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2024-09-10T10:02:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 14502, 2024-09-10T10:02:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2024-09-10T10:02:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2024-09-10T10:02:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2024-09-10T10:02:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 14502 2024-09-10T10:02:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:02:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2024-09-10T10:02:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-10T10:02:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1640522611 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1640522611 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.14502 192.168.0.1:0/1640522611", 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "192.168.0.1:0/1640522611", 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 20, 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 45, 2024-09-10T10:02:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2024-09-10T10:02:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklisted": false, 2024-09-10T10:02:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2024-09-10T10:02:02.842 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:02:02.847 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T10:02:02.847 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T10:02:03.092 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:02:03.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:03 smithi071 ceph-mon[27559]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-10T10:02:04.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:03 smithi107 ceph-mon[34215]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-10T10:02:04.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.636+0000 7ff72e372640 1 -- 172.21.15.71:0/215504023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7280fd550 msgr2=0x7ff7280fd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:04.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.636+0000 7ff72e372640 1 --2- 172.21.15.71:0/215504023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7280fd550 0x7ff7280fd920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff718004900 tx=0x7ff718009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:04.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.636+0000 7ff72e372640 1 -- 172.21.15.71:0/215504023 shutdown_connections 2024-09-10T10:02:04.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.636+0000 7ff72e372640 1 --2- 172.21.15.71:0/215504023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7280fdef0 0x7ff7281065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:04.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.636+0000 7ff72e372640 1 --2- 172.21.15.71:0/215504023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7280fd550 0x7ff7280fd920 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:04.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.636+0000 7ff72e372640 1 -- 172.21.15.71:0/215504023 >> 172.21.15.71:0/215504023 conn(0x7ff7280f7030 msgr2=0x7ff7280f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:04.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.636+0000 7ff72e372640 1 -- 172.21.15.71:0/215504023 shutdown_connections 2024-09-10T10:02:04.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.636+0000 7ff72e372640 1 -- 172.21.15.71:0/215504023 wait complete. 2024-09-10T10:02:04.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.637+0000 7ff72e372640 1 Processor -- start 2024-09-10T10:02:04.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.637+0000 7ff72e372640 1 -- start start 2024-09-10T10:02:04.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.637+0000 7ff72e372640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7280fd550 0x7ff728113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:04.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.637+0000 7ff72e372640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7280fdef0 0x7ff728113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:04.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.637+0000 7ff72e372640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff728113d50 con 0x7ff7280fdef0 2024-09-10T10:02:04.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.637+0000 7ff72e372640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72810d190 con 0x7ff7280fd550 2024-09-10T10:02:04.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.637+0000 7ff71ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7280fdef0 0x7ff728113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:04.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.637+0000 7ff71ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7280fdef0 0x7ff728113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36224/0 (socket says 172.21.15.71:36224) 2024-09-10T10:02:04.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.637+0000 7ff71ffff640 1 -- 172.21.15.71:0/2527991191 learned_addr learned my addr 172.21.15.71:0/2527991191 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:04.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.637+0000 7ff727fff640 1 --2- 172.21.15.71:0/2527991191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7280fd550 0x7ff728113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:04.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.637+0000 7ff71ffff640 1 -- 172.21.15.71:0/2527991191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7280fd550 msgr2=0x7ff728113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:04.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.637+0000 7ff71ffff640 1 --2- 172.21.15.71:0/2527991191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7280fd550 0x7ff728113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:04.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.638+0000 7ff71ffff640 1 -- 172.21.15.71:0/2527991191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718005040 con 0x7ff7280fdef0 2024-09-10T10:02:04.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.638+0000 7ff71ffff640 1 --2- 172.21.15.71:0/2527991191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7280fdef0 0x7ff728113750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff71000c830 tx=0x7ff710004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:04.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.638+0000 7ff7257fa640 1 -- 172.21.15.71:0/2527991191 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff71000a850 con 0x7ff7280fdef0 2024-09-10T10:02:04.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.638+0000 7ff7257fa640 1 -- 172.21.15.71:0/2527991191 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff71000ae50 con 0x7ff7280fdef0 2024-09-10T10:02:04.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.638+0000 7ff72e372640 1 -- 172.21.15.71:0/2527991191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72810d470 con 0x7ff7280fdef0 2024-09-10T10:02:04.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.638+0000 7ff7257fa640 1 -- 172.21.15.71:0/2527991191 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7100113a0 con 0x7ff7280fdef0 2024-09-10T10:02:04.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.638+0000 7ff72e372640 1 -- 172.21.15.71:0/2527991191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72810d990 con 0x7ff7280fdef0 2024-09-10T10:02:04.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.639+0000 7ff72e372640 1 -- 172.21.15.71:0/2527991191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff728066070 con 0x7ff7280fdef0 2024-09-10T10:02:04.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.639+0000 7ff7257fa640 1 -- 172.21.15.71:0/2527991191 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff710012400 con 0x7ff7280fdef0 2024-09-10T10:02:04.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.640+0000 7ff7257fa640 1 --2- 172.21.15.71:0/2527991191 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff71406ed60 0x7ff714071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:04.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.640+0000 7ff727fff640 1 --2- 172.21.15.71:0/2527991191 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff71406ed60 0x7ff714071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:04.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.640+0000 7ff7257fa640 1 -- 172.21.15.71:0/2527991191 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff71008e410 con 0x7ff7280fdef0 2024-09-10T10:02:04.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.640+0000 7ff727fff640 1 --2- 172.21.15.71:0/2527991191 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff71406ed60 0x7ff714071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff718007ac0 tx=0x7ff718035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:04.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.644+0000 7ff7257fa640 1 -- 172.21.15.71:0/2527991191 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff71005b560 con 0x7ff7280fdef0 2024-09-10T10:02:04.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.836+0000 7ff72e372640 1 -- 172.21.15.71:0/2527991191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff7280fac30 con 0x7ff7280fdef0 2024-09-10T10:02:04.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.836+0000 7ff7257fa640 1 -- 172.21.15.71:0/2527991191 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+83 (secure 0 0 0) 0x7ff71005af00 con 0x7ff7280fdef0 2024-09-10T10:02:04.838 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-10T10:02:04.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.838+0000 7ff72e372640 1 -- 172.21.15.71:0/2527991191 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff71406ed60 msgr2=0x7ff714071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:04.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.838+0000 7ff72e372640 1 --2- 172.21.15.71:0/2527991191 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff71406ed60 0x7ff714071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff718007ac0 tx=0x7ff718035040 comp rx=0 tx=0).stop 2024-09-10T10:02:04.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.838+0000 7ff72e372640 1 -- 172.21.15.71:0/2527991191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7280fdef0 msgr2=0x7ff728113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:04.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.838+0000 7ff72e372640 1 --2- 172.21.15.71:0/2527991191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7280fdef0 0x7ff728113750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff71000c830 tx=0x7ff710004430 comp rx=0 tx=0).stop 2024-09-10T10:02:04.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.838+0000 7ff72e372640 1 -- 172.21.15.71:0/2527991191 shutdown_connections 2024-09-10T10:02:04.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.838+0000 7ff72e372640 1 --2- 172.21.15.71:0/2527991191 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff71406ed60 0x7ff714071210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:04.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.838+0000 7ff72e372640 1 --2- 172.21.15.71:0/2527991191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7280fdef0 0x7ff728113750 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:04.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.838+0000 7ff72e372640 1 --2- 172.21.15.71:0/2527991191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7280fd550 0x7ff728113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:04.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.838+0000 7ff72e372640 1 -- 172.21.15.71:0/2527991191 >> 172.21.15.71:0/2527991191 conn(0x7ff7280f7030 msgr2=0x7ff7280f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:04.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.839+0000 7ff72e372640 1 -- 172.21.15.71:0/2527991191 shutdown_connections 2024-09-10T10:02:04.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:04.839+0000 7ff72e372640 1 -- 172.21.15.71:0/2527991191 wait complete. 2024-09-10T10:02:05.556 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T10:02:05.567 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T10:02:05.567 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-09-10T10:02:05.568 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T10:02:05.568 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T10:02:05.568 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T10:02:05.568 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T10:02:05.568 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T10:02:05.568 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T10:02:05.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:05.568 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-09-10T10:02:05.589 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T10:02:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T10:02:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T10:02:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:02:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-09-10T10:02:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:02:05.590 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:02:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-09-10T10:02:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-09-10T10:02:05.590 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:02:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-09-10T10:02:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-09-10T10:02:05.591 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:02:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-09-10T10:02:05.591 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T10:02:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-09-10T10:02:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T10:02:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42353sec preferred_lft 42353sec 2024-09-10T10:02:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link noprefixroute 2024-09-10T10:02:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:02:05.591 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T10:02:05.592 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:02:05.592 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-10T10:02:05.592 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2024-09-10T10:02:05.592 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2024-09-10T10:02:05.592 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2024-09-10T10:02:05.592 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T10:02:05.592 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-10T10:02:05.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:02:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:02:05.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:05 smithi071 ceph-mon[27559]: pgmap v193: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-10T10:02:05.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:05 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/2527991191' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T10:02:05.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:02:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:02:05.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:05.965 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T10:02:05.966 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:05 smithi107 ceph-mon[34215]: pgmap v193: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-10T10:02:05.966 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:05 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/2527991191' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T10:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-09-10T10:02:05.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:05.994 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-09-10T10:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-09-10T10:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T10:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T10:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T10:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T10:02:06.072 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:02:06.072 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-10T10:02:06.073 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T10:02:06.073 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T10:02:06.073 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T10:02:06.073 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-10T10:02:06.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:02:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:02:06.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:02:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:02:06.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:06.364 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-10T10:02:06.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:06.379 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-09-10T10:02:06.436 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:02:06.436 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-10T10:02:06.436 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T10:02:06.436 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T10:02:06.436 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-10T10:02:06.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:02:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:02:06.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:02:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:02:06.554 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T10:02:06.555 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:02:06.555 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-10T10:02:06.555 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T10:02:06.555 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T10:02:06.555 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T10:02:06.555 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T10:02:06.555 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T10:02:06.555 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-10T10:02:06.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:02:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:02:06.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:02:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:02:06.678 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:02:06.678 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-10T10:02:06.678 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2024-09-10T10:02:06.678 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T10:02:06.678 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-10T10:02:06.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:02:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:02:06.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:02:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:02:06.756 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-10T10:02:06.756 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T10:02:06.756 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T10:02:06.771 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T10:02:06.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T10:02:06.771 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T10:02:06.831 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-09-10T10:02:06.896 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T10:02:06.952 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2024-09-10T10:02:06.952 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2024-09-10T10:02:06.952 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2024-09-10T10:02:06.952 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2024-09-10T10:02:06.952 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2024-09-10T10:02:06.952 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2024-09-10T10:02:06.952 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2024-09-10T10:02:06.952 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2024-09-10T10:02:06.952 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T10:02:06.953 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/0 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/5c617965cec5c01774099f9ded0c306d14a5fe903f8ee679fbf54c16cdcf1671/merged 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/8a0cf99d0db0a019b6ae8541052bed254526371f33ffa747528d676674339981/merged 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/ab1c2ce22bfd3969bd9400fd4132eb83454a8a778d1b767ad28664f4295d6c19/merged 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/4a39693769c255dc920f7ccb21c9f4df8a3cb9b927dffbdbc60ba6aa0d24a922/merged 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/cc6079d39cb9b2942871de2250606b96b6e79fc4d25d153de4715250fdf2e9d8/merged 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/2746e30f5a938a76538f9487c8a1b54b5a14c9f911db8deccc0ef51a665dc0ad/merged 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/dbbf7a03f837c048c4bf8cda6d65d4d54c588771bfeba0b5d35106981043599e/merged 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/6d599d52f805553e9312bdc520f3c3827146b6d7b2d8a9d8d1d6d2b5c7599dae/merged 2024-09-10T10:02:06.954 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/2a4185e387a8897024c6bf8db60361d3e167ae8a0f1c879f2b030e148ae50a3a/merged 2024-09-10T10:02:06.955 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2024-09-10T10:02:06.955 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T10:02:06.955 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T10:02:06.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:06.955 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-09-10T10:02:07.006 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T10:02:07.007 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-10T10:02:07.049 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-09-10T10:02:07.073 DEBUG:teuthology.orchestra.run.smithi107:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T10:02:07.130 INFO:teuthology.orchestra.run.smithi107.stdout:/proc 2024-09-10T10:02:07.130 INFO:teuthology.orchestra.run.smithi107.stdout:/sys 2024-09-10T10:02:07.130 INFO:teuthology.orchestra.run.smithi107.stdout:/dev 2024-09-10T10:02:07.130 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/security 2024-09-10T10:02:07.130 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/shm 2024-09-10T10:02:07.130 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/pts 2024-09-10T10:02:07.130 INFO:teuthology.orchestra.run.smithi107.stdout:/run 2024-09-10T10:02:07.130 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/cgroup 2024-09-10T10:02:07.130 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/pstore 2024-09-10T10:02:07.130 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/bpf 2024-09-10T10:02:07.131 INFO:teuthology.orchestra.run.smithi107.stdout:/ 2024-09-10T10:02:07.131 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/selinux 2024-09-10T10:02:07.131 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T10:02:07.131 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/mqueue 2024-09-10T10:02:07.131 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/debug 2024-09-10T10:02:07.131 INFO:teuthology.orchestra.run.smithi107.stdout:/dev/hugepages 2024-09-10T10:02:07.131 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/tracing 2024-09-10T10:02:07.131 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/fs/fuse/connections 2024-09-10T10:02:07.131 INFO:teuthology.orchestra.run.smithi107.stdout:/sys/kernel/config 2024-09-10T10:02:07.131 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T10:02:07.132 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T10:02:07.132 INFO:teuthology.orchestra.run.smithi107.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T10:02:07.132 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T10:02:07.132 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/1000 2024-09-10T10:02:07.132 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/ceph 2024-09-10T10:02:07.132 INFO:teuthology.orchestra.run.smithi107.stdout:/run/user/0 2024-09-10T10:02:07.132 INFO:teuthology.orchestra.run.smithi107.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T10:02:07.133 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay 2024-09-10T10:02:07.133 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/5c617965cec5c01774099f9ded0c306d14a5fe903f8ee679fbf54c16cdcf1671/merged 2024-09-10T10:02:07.133 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/8a0cf99d0db0a019b6ae8541052bed254526371f33ffa747528d676674339981/merged 2024-09-10T10:02:07.133 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/ab1c2ce22bfd3969bd9400fd4132eb83454a8a778d1b767ad28664f4295d6c19/merged 2024-09-10T10:02:07.133 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/4a39693769c255dc920f7ccb21c9f4df8a3cb9b927dffbdbc60ba6aa0d24a922/merged 2024-09-10T10:02:07.133 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/cc6079d39cb9b2942871de2250606b96b6e79fc4d25d153de4715250fdf2e9d8/merged 2024-09-10T10:02:07.133 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/2746e30f5a938a76538f9487c8a1b54b5a14c9f911db8deccc0ef51a665dc0ad/merged 2024-09-10T10:02:07.133 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/dbbf7a03f837c048c4bf8cda6d65d4d54c588771bfeba0b5d35106981043599e/merged 2024-09-10T10:02:07.133 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/6d599d52f805553e9312bdc520f3c3827146b6d7b2d8a9d8d1d6d2b5c7599dae/merged 2024-09-10T10:02:07.133 INFO:teuthology.orchestra.run.smithi107.stdout:/var/lib/containers/storage/overlay/2a4185e387a8897024c6bf8db60361d3e167ae8a0f1c879f2b030e148ae50a3a/merged 2024-09-10T10:02:07.133 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns 2024-09-10T10:02:07.133 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T10:02:07.133 INFO:teuthology.orchestra.run.smithi107.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T10:02:07.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:07.134 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-09-10T10:02:07.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi107.stderr:2024-09-10T10:02:07.141+0000 7f7a7aa32300 -1 init, newargv = 0x5610208085c0 newargc=15 2024-09-10T10:02:07.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi107.stderr:ceph-fuse[59040]: starting ceph client 2024-09-10T10:02:07.150 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi107.stderr:ceph-fuse[59040]: starting fuse 2024-09-10T10:02:07.161 INFO:teuthology.orchestra.run.smithi107.stdout:117 2024-09-10T10:02:07.161 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [117] 2024-09-10T10:02:07.161 DEBUG:teuthology.orchestra.run.smithi107:> sudo stdin-killer -- python3 -c ' 2024-09-10T10:02:07.161 DEBUG:teuthology.orchestra.run.smithi107:> import glob 2024-09-10T10:02:07.161 DEBUG:teuthology.orchestra.run.smithi107:> import re 2024-09-10T10:02:07.161 DEBUG:teuthology.orchestra.run.smithi107:> import os 2024-09-10T10:02:07.162 DEBUG:teuthology.orchestra.run.smithi107:> import subprocess 2024-09-10T10:02:07.162 DEBUG:teuthology.orchestra.run.smithi107:> 2024-09-10T10:02:07.162 DEBUG:teuthology.orchestra.run.smithi107:> def _find_admin_socket(client_name): 2024-09-10T10:02:07.162 DEBUG:teuthology.orchestra.run.smithi107:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-10T10:02:07.162 DEBUG:teuthology.orchestra.run.smithi107:> files = glob.glob(asok_path) 2024-09-10T10:02:07.162 DEBUG:teuthology.orchestra.run.smithi107:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-10T10:02:07.162 DEBUG:teuthology.orchestra.run.smithi107:> 2024-09-10T10:02:07.162 DEBUG:teuthology.orchestra.run.smithi107:> # Given a non-glob path, it better be there 2024-09-10T10:02:07.162 DEBUG:teuthology.orchestra.run.smithi107:> if "*" not in asok_path: 2024-09-10T10:02:07.162 DEBUG:teuthology.orchestra.run.smithi107:> assert(len(files) == 1) 2024-09-10T10:02:07.162 DEBUG:teuthology.orchestra.run.smithi107:> return files[0] 2024-09-10T10:02:07.162 DEBUG:teuthology.orchestra.run.smithi107:> 2024-09-10T10:02:07.162 DEBUG:teuthology.orchestra.run.smithi107:> for f in files: 2024-09-10T10:02:07.163 DEBUG:teuthology.orchestra.run.smithi107:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T10:02:07.163 DEBUG:teuthology.orchestra.run.smithi107:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T10:02:07.163 DEBUG:teuthology.orchestra.run.smithi107:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T10:02:07.163 DEBUG:teuthology.orchestra.run.smithi107:> contents = proc_f.read() 2024-09-10T10:02:07.163 DEBUG:teuthology.orchestra.run.smithi107:> if mountpoint in contents: 2024-09-10T10:02:07.163 DEBUG:teuthology.orchestra.run.smithi107:> return f 2024-09-10T10:02:07.163 DEBUG:teuthology.orchestra.run.smithi107:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T10:02:07.163 DEBUG:teuthology.orchestra.run.smithi107:> 2024-09-10T10:02:07.163 DEBUG:teuthology.orchestra.run.smithi107:> print(_find_admin_socket("client.1")) 2024-09-10T10:02:07.163 DEBUG:teuthology.orchestra.run.smithi107:> ' 2024-09-10T10:02:07.279 INFO:teuthology.orchestra.run.smithi107.stdout:/var/run/ceph/ceph-client.1.59040.asok 2024-09-10T10:02:07.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-10T10:02:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:02:07.290 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.59040.asok 2024-09-10T10:02:07.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:07.290 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.59040.asok status 2024-09-10T10:02:07.419 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-10T10:02:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "metadata": { 2024-09-10T10:02:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_sha1": "96d63e75d310869e716ce7c8655577b0e88a04aa", 2024-09-10T10:02:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)", 2024-09-10T10:02:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "entity_id": "1", 2024-09-10T10:02:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": "smithi107", 2024-09-10T10:02:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-10T10:02:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "pid": "59040", 2024-09-10T10:02:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "root": "/" 2024-09-10T10:02:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-10T10:02:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_count": 0, 2024-09-10T10:02:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_pinned_count": 0, 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24307, 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "inst": { 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "name": { 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "client", 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "num": 24307 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.1:0", 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 117341327 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2024-09-10T10:02:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2024-09-10T10:02:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.1:0", 2024-09-10T10:02:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 117341327 2024-09-10T10:02:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-10T10:02:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "inst_str": "client.24307 192.168.0.1:0/117341327", 2024-09-10T10:02:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "addr_str": "192.168.0.1:0/117341327", 2024-09-10T10:02:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "inode_count": 1, 2024-09-10T10:02:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_epoch": 20, 2024-09-10T10:02:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch": 45, 2024-09-10T10:02:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch_barrier": 0, 2024-09-10T10:02:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "blocklisted": false, 2024-09-10T10:02:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs" 2024-09-10T10:02:07.422 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-10T10:02:07.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:07.428 DEBUG:teuthology.orchestra.run.smithi071:> stat --file-system '--printf=%T 2024-09-10T10:02:07.428 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T10:02:07.449 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2024-09-10T10:02:07.449 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T10:02:07.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:07.450 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T10:02:07.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:07.524 DEBUG:teuthology.orchestra.run.smithi107:> stat --file-system '--printf=%T 2024-09-10T10:02:07.524 DEBUG:teuthology.orchestra.run.smithi107:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-10T10:02:07.540 INFO:teuthology.orchestra.run.smithi107.stdout:fuseblk 2024-09-10T10:02:07.540 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-10T10:02:07.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:02:07.541 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T10:02:07.771 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:07 smithi071 ceph-mon[27559]: pgmap v194: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-10T10:02:07.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:07 smithi107 ceph-mon[34215]: pgmap v194: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-10T10:02:08.029 INFO:teuthology.run_tasks:Running task print... 2024-09-10T10:02:08.040 INFO:teuthology.task.print:**** done client 2024-09-10T10:02:08.041 INFO:teuthology.run_tasks:Running task parallel... 2024-09-10T10:02:08.111 INFO:teuthology.task.parallel:starting parallel... 2024-09-10T10:02:08.111 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-10T10:02:08.112 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-10T10:02:08.112 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T10:02:08.112 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-10T10:02:08.113 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-10T10:02:08.113 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-10T10:02:08.117 INFO:tasks.workunit:Pulling workunits from ref 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:02:08.118 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T10:02:08.118 INFO:tasks.workunit:timeout=3h 2024-09-10T10:02:08.118 INFO:tasks.workunit:cleanup=True 2024-09-10T10:02:08.118 DEBUG:teuthology.orchestra.run.smithi071:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T10:02:08.135 INFO:teuthology.orchestra.run.smithi071.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T10:02:08.135 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-10T10:02:08.135 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 99h/153d Inode: 1 Links: 2 2024-09-10T10:02:08.135 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:02:08.135 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-10T10:02:08.135 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-10T10:02:08.135 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-10 10:01:32.485311978 +0000 2024-09-10T10:02:08.135 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-10 10:02:07.520991485 +0000 2024-09-10T10:02:08.135 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-09-10T10:02:08.136 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T10:02:08.136 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T10:02:08.206 DEBUG:teuthology.orchestra.run.smithi107:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-10T10:02:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-10T10:02:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-10T10:02:08.224 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 75h/117d Inode: 1 Links: 3 2024-09-10T10:02:08.224 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:02:08.224 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-10T10:02:08.224 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-10T10:02:08.224 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-10 10:02:08.200048555 +0000 2024-09-10T10:02:08.224 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-10 10:02:08.200048555 +0000 2024-09-10T10:02:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-09-10T10:02:08.224 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-10T10:02:08.224 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-10T10:02:08.295 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:02:08.295 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:02:08.311 INFO:tasks.workunit.client.0.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T10:02:08.351 INFO:tasks.workunit.client.1.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-10T10:02:08.383 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:02:09.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:09 smithi071 ceph-mon[27559]: pgmap v195: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-10T10:02:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.022+0000 7f78bb718640 1 -- 172.21.15.71:0/2417128454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78b40fc6f0 msgr2=0x7f78b40fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.022+0000 7f78bb718640 1 --2- 172.21.15.71:0/2417128454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78b40fc6f0 0x7f78b40fcb60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f78b00048d0 tx=0x7f78b0009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.022+0000 7f78bb718640 1 -- 172.21.15.71:0/2417128454 shutdown_connections 2024-09-10T10:02:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.022+0000 7f78bb718640 1 --2- 172.21.15.71:0/2417128454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78b40fc6f0 0x7f78b40fcb60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.022+0000 7f78bb718640 1 --2- 172.21.15.71:0/2417128454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b40fb420 0x7f78b40fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.022+0000 7f78bb718640 1 -- 172.21.15.71:0/2417128454 >> 172.21.15.71:0/2417128454 conn(0x7f78b40f6c00 msgr2=0x7f78b40f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.022+0000 7f78bb718640 1 -- 172.21.15.71:0/2417128454 shutdown_connections 2024-09-10T10:02:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.022+0000 7f78bb718640 1 -- 172.21.15.71:0/2417128454 wait complete. 2024-09-10T10:02:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.022+0000 7f78bb718640 1 Processor -- start 2024-09-10T10:02:10.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.022+0000 7f78bb718640 1 -- start start 2024-09-10T10:02:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78bb718640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78b40fb420 0x7f78b410fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78bb718640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b40fc6f0 0x7f78b4112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78bb718640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40664f0 con 0x7f78b40fb420 2024-09-10T10:02:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78bb718640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b4066660 con 0x7f78b40fc6f0 2024-09-10T10:02:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78b94b4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78b40fb420 0x7f78b410fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78b94b4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78b40fb420 0x7f78b410fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36240/0 (socket says 172.21.15.71:36240) 2024-09-10T10:02:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78b94b4640 1 -- 172.21.15.71:0/534790569 learned_addr learned my addr 172.21.15.71:0/534790569 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78b8cb3640 1 --2- 172.21.15.71:0/534790569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b40fc6f0 0x7f78b4112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78b94b4640 1 -- 172.21.15.71:0/534790569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b40fc6f0 msgr2=0x7f78b4112300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78b94b4640 1 --2- 172.21.15.71:0/534790569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b40fc6f0 0x7f78b4112300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78b94b4640 1 -- 172.21.15.71:0/534790569 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b0005040 con 0x7f78b40fb420 2024-09-10T10:02:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78b94b4640 1 --2- 172.21.15.71:0/534790569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78b40fb420 0x7f78b410fdb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f78a400c790 tx=0x7f78a40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:10.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78a9ffb640 1 -- 172.21.15.71:0/534790569 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78a400a820 con 0x7f78b40fb420 2024-09-10T10:02:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78bb718640 1 -- 172.21.15.71:0/534790569 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b41128a0 con 0x7f78b40fb420 2024-09-10T10:02:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78a9ffb640 1 -- 172.21.15.71:0/534790569 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f78a400ae20 con 0x7f78b40fb420 2024-09-10T10:02:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.023+0000 7f78a9ffb640 1 -- 172.21.15.71:0/534790569 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78a40113a0 con 0x7f78b40fb420 2024-09-10T10:02:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.024+0000 7f78bb718640 1 -- 172.21.15.71:0/534790569 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b4112e10 con 0x7f78b40fb420 2024-09-10T10:02:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.024+0000 7f78bb718640 1 -- 172.21.15.71:0/534790569 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b40fa880 con 0x7f78b40fb420 2024-09-10T10:02:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.025+0000 7f78a9ffb640 1 -- 172.21.15.71:0/534790569 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f78a4012400 con 0x7f78b40fb420 2024-09-10T10:02:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.025+0000 7f78a9ffb640 1 --2- 172.21.15.71:0/534790569 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f78a006ed60 0x7f78a0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.025+0000 7f78a9ffb640 1 -- 172.21.15.71:0/534790569 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f78a408e320 con 0x7f78b40fb420 2024-09-10T10:02:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.025+0000 7f78b8cb3640 1 --2- 172.21.15.71:0/534790569 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f78a006ed60 0x7f78a0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.026+0000 7f78b8cb3640 1 --2- 172.21.15.71:0/534790569 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f78a006ed60 0x7f78a0071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f78b0000c00 tx=0x7f78b0009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:10.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.029+0000 7f78a9ffb640 1 -- 172.21.15.71:0/534790569 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f78a405b470 con 0x7f78b40fb420 2024-09-10T10:02:10.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:09 smithi107 ceph-mon[34215]: pgmap v195: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-10T10:02:10.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.185+0000 7f78bb718640 1 -- 172.21.15.71:0/534790569 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f78b404b720 con 0x7f78b40fb420 2024-09-10T10:02:10.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:10.186+0000 7f78a9ffb640 1 -- 172.21.15.71:0/534790569 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f78a405ae10 con 0x7f78b40fb420 2024-09-10T10:02:10.187 INFO:teuthology.orchestra.run.smithi071.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-09-10T10:02:10.806 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-10T10:02:10.807 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T10:02:10.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-10T10:02:11.102 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:02:12.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:11 smithi071 ceph-mon[27559]: pgmap v196: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-10T10:02:12.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:11 smithi107 ceph-mon[34215]: pgmap v196: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-10T10:02:12.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.587+0000 7fa6c30db640 1 -- 172.21.15.71:0/1728826149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6bc0fd7f0 msgr2=0x7fa6bc0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:12.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.587+0000 7fa6c30db640 1 --2- 172.21.15.71:0/1728826149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6bc0fd7f0 0x7fa6bc0fdc60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00048d0 tx=0x7fa6b0009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:12.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.587+0000 7fa6c30db640 1 -- 172.21.15.71:0/1728826149 shutdown_connections 2024-09-10T10:02:12.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.587+0000 7fa6c30db640 1 --2- 172.21.15.71:0/1728826149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6bc0fd7f0 0x7fa6bc0fdc60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:12.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.587+0000 7fa6c30db640 1 --2- 172.21.15.71:0/1728826149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6bc0fc520 0x7fa6bc0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:12.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.587+0000 7fa6c30db640 1 -- 172.21.15.71:0/1728826149 >> 172.21.15.71:0/1728826149 conn(0x7fa6bc0f7ce0 msgr2=0x7fa6bc0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:12.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.587+0000 7fa6c30db640 1 -- 172.21.15.71:0/1728826149 shutdown_connections 2024-09-10T10:02:12.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.587+0000 7fa6c30db640 1 -- 172.21.15.71:0/1728826149 wait complete. 2024-09-10T10:02:12.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.587+0000 7fa6c30db640 1 Processor -- start 2024-09-10T10:02:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.587+0000 7fa6c30db640 1 -- start start 2024-09-10T10:02:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6c30db640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6bc0fc520 0x7fa6bc10d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6c30db640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6bc0fd7f0 0x7fa6bc10d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6c30db640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc10dbe0 con 0x7fa6bc0fc520 2024-09-10T10:02:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6c30db640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc10e400 con 0x7fa6bc0fd7f0 2024-09-10T10:02:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6c0e77640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6bc0fc520 0x7fa6bc10d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6c0e77640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6bc0fc520 0x7fa6bc10d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36254/0 (socket says 172.21.15.71:36254) 2024-09-10T10:02:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6c0e77640 1 -- 172.21.15.71:0/3818849353 learned_addr learned my addr 172.21.15.71:0/3818849353 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6bbfff640 1 --2- 172.21.15.71:0/3818849353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6bc0fd7f0 0x7fa6bc10d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6c0e77640 1 -- 172.21.15.71:0/3818849353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6bc0fd7f0 msgr2=0x7fa6bc10d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6c0e77640 1 --2- 172.21.15.71:0/3818849353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6bc0fd7f0 0x7fa6bc10d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6c0e77640 1 -- 172.21.15.71:0/3818849353 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b0005040 con 0x7fa6bc0fc520 2024-09-10T10:02:12.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6c0e77640 1 --2- 172.21.15.71:0/3818849353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6bc0fc520 0x7fa6bc10d050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00db00 tx=0x7fa6ac004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:12.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6b97fa640 1 -- 172.21.15.71:0/3818849353 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6ac017070 con 0x7fa6bc0fc520 2024-09-10T10:02:12.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6b97fa640 1 -- 172.21.15.71:0/3818849353 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa6ac00f040 con 0x7fa6bc0fc520 2024-09-10T10:02:12.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6c30db640 1 -- 172.21.15.71:0/3818849353 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6bc10e690 con 0x7fa6bc0fc520 2024-09-10T10:02:12.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6b97fa640 1 -- 172.21.15.71:0/3818849353 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6ac003960 con 0x7fa6bc0fc520 2024-09-10T10:02:12.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.588+0000 7fa6c30db640 1 -- 172.21.15.71:0/3818849353 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6bc10ec30 con 0x7fa6bc0fc520 2024-09-10T10:02:12.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.590+0000 7fa6c30db640 1 -- 172.21.15.71:0/3818849353 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6bc0fb980 con 0x7fa6bc0fc520 2024-09-10T10:02:12.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.590+0000 7fa6b97fa640 1 -- 172.21.15.71:0/3818849353 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fa6ac00b890 con 0x7fa6bc0fc520 2024-09-10T10:02:12.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.590+0000 7fa6b97fa640 1 --2- 172.21.15.71:0/3818849353 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa6a406ed60 0x7fa6a4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:12.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.590+0000 7fa6b97fa640 1 -- 172.21.15.71:0/3818849353 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa6ac08e1e0 con 0x7fa6bc0fc520 2024-09-10T10:02:12.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.590+0000 7fa6bbfff640 1 --2- 172.21.15.71:0/3818849353 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa6a406ed60 0x7fa6a4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:12.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.591+0000 7fa6bbfff640 1 --2- 172.21.15.71:0/3818849353 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa6a406ed60 0x7fa6a4071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc10ce00 tx=0x7fa6b0035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:12.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.595+0000 7fa6b97fa640 1 -- 172.21.15.71:0/3818849353 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa6ac05b2b0 con 0x7fa6bc0fc520 2024-09-10T10:02:12.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.748+0000 7fa6c30db640 1 -- 172.21.15.71:0/3818849353 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fa6bc04b720 con 0x7fa6bc0fc520 2024-09-10T10:02:12.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.748+0000 7fa6b97fa640 1 -- 172.21.15.71:0/3818849353 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fa6ac05ac50 con 0x7fa6bc0fc520 2024-09-10T10:02:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.751+0000 7fa6c30db640 1 -- 172.21.15.71:0/3818849353 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa6a406ed60 msgr2=0x7fa6a4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.751+0000 7fa6c30db640 1 --2- 172.21.15.71:0/3818849353 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa6a406ed60 0x7fa6a4071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc10ce00 tx=0x7fa6b0035040 comp rx=0 tx=0).stop 2024-09-10T10:02:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.751+0000 7fa6c30db640 1 -- 172.21.15.71:0/3818849353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6bc0fc520 msgr2=0x7fa6bc10d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.751+0000 7fa6c30db640 1 --2- 172.21.15.71:0/3818849353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6bc0fc520 0x7fa6bc10d050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00db00 tx=0x7fa6ac004e60 comp rx=0 tx=0).stop 2024-09-10T10:02:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.751+0000 7fa6c30db640 1 -- 172.21.15.71:0/3818849353 shutdown_connections 2024-09-10T10:02:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.751+0000 7fa6c30db640 1 --2- 172.21.15.71:0/3818849353 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa6a406ed60 0x7fa6a4071210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.751+0000 7fa6c30db640 1 --2- 172.21.15.71:0/3818849353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6bc0fd7f0 0x7fa6bc10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.751+0000 7fa6c30db640 1 --2- 172.21.15.71:0/3818849353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6bc0fc520 0x7fa6bc10d050 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.751+0000 7fa6c30db640 1 -- 172.21.15.71:0/3818849353 >> 172.21.15.71:0/3818849353 conn(0x7fa6bc0f7ce0 msgr2=0x7fa6bc0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.751+0000 7fa6c30db640 1 -- 172.21.15.71:0/3818849353 shutdown_connections 2024-09-10T10:02:12.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:12.751+0000 7fa6c30db640 1 -- 172.21.15.71:0/3818849353 wait complete. 2024-09-10T10:02:13.371 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-10T10:02:13.621 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:02:14.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:13 smithi071 ceph-mon[27559]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-10T10:02:14.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:13 smithi107 ceph-mon[34215]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-10T10:02:15.015 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:02:15.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:02:15.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.225+0000 7fa77907a640 1 -- 172.21.15.71:0/140582395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7740fe4f0 msgr2=0x7fa7740fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:15.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.225+0000 7fa77907a640 1 --2- 172.21.15.71:0/140582395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7740fe4f0 0x7fa7740fa650 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa7640048d0 tx=0x7fa764009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:15.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.225+0000 7fa77907a640 1 -- 172.21.15.71:0/140582395 shutdown_connections 2024-09-10T10:02:15.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.225+0000 7fa77907a640 1 --2- 172.21.15.71:0/140582395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7740fe4f0 0x7fa7740fa650 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:15.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.225+0000 7fa77907a640 1 --2- 172.21.15.71:0/140582395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7740fdba0 0x7fa7740fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:15.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.225+0000 7fa77907a640 1 -- 172.21.15.71:0/140582395 >> 172.21.15.71:0/140582395 conn(0x7fa7740f63a0 msgr2=0x7fa7740f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:15.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.225+0000 7fa77907a640 1 -- 172.21.15.71:0/140582395 shutdown_connections 2024-09-10T10:02:15.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.225+0000 7fa77907a640 1 -- 172.21.15.71:0/140582395 wait complete. 2024-09-10T10:02:15.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa77907a640 1 Processor -- start 2024-09-10T10:02:15.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa77907a640 1 -- start start 2024-09-10T10:02:15.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa77907a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7740fdba0 0x7fa7740fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:15.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa77907a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7740fe4f0 0x7fa7740fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:15.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa77907a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7740fbe10 con 0x7fa7740fdba0 2024-09-10T10:02:15.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa77907a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7740fbf50 con 0x7fa7740fe4f0 2024-09-10T10:02:15.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa772d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7740fdba0 0x7fa7740fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:15.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa772d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7740fdba0 0x7fa7740fd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45702/0 (socket says 172.21.15.71:45702) 2024-09-10T10:02:15.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa772d9d640 1 -- 172.21.15.71:0/2246386524 learned_addr learned my addr 172.21.15.71:0/2246386524 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:15.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa77259c640 1 --2- 172.21.15.71:0/2246386524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7740fe4f0 0x7fa7740fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:15.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa772d9d640 1 -- 172.21.15.71:0/2246386524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7740fe4f0 msgr2=0x7fa7740fb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:15.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa772d9d640 1 --2- 172.21.15.71:0/2246386524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7740fe4f0 0x7fa7740fb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:15.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa772d9d640 1 -- 172.21.15.71:0/2246386524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa764005040 con 0x7fa7740fdba0 2024-09-10T10:02:15.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.226+0000 7fa77259c640 1 --2- 172.21.15.71:0/2246386524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7740fe4f0 0x7fa7740fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:02:15.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.227+0000 7fa772d9d640 1 --2- 172.21.15.71:0/2246386524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7740fdba0 0x7fa7740fd390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa768002a50 tx=0x7fa768004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:15.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.227+0000 7fa75b7fe640 1 -- 172.21.15.71:0/2246386524 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa768007c30 con 0x7fa7740fdba0 2024-09-10T10:02:15.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.227+0000 7fa75b7fe640 1 -- 172.21.15.71:0/2246386524 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa76800f040 con 0x7fa7740fdba0 2024-09-10T10:02:15.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.227+0000 7fa77907a640 1 -- 172.21.15.71:0/2246386524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7740fc230 con 0x7fa7740fdba0 2024-09-10T10:02:15.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.227+0000 7fa75b7fe640 1 -- 172.21.15.71:0/2246386524 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa76800da90 con 0x7fa7740fdba0 2024-09-10T10:02:15.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.227+0000 7fa77907a640 1 -- 172.21.15.71:0/2246386524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7741150f0 con 0x7fa7740fdba0 2024-09-10T10:02:15.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.228+0000 7fa77907a640 1 -- 172.21.15.71:0/2246386524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7740fa040 con 0x7fa7740fdba0 2024-09-10T10:02:15.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.229+0000 7fa75b7fe640 1 -- 172.21.15.71:0/2246386524 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fa76800dc30 con 0x7fa7740fdba0 2024-09-10T10:02:15.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.230+0000 7fa75b7fe640 1 --2- 172.21.15.71:0/2246386524 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa75c06ed60 0x7fa75c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:15.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.230+0000 7fa75b7fe640 1 -- 172.21.15.71:0/2246386524 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa76808d9e0 con 0x7fa7740fdba0 2024-09-10T10:02:15.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.230+0000 7fa77259c640 1 --2- 172.21.15.71:0/2246386524 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa75c06ed60 0x7fa75c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:15.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.230+0000 7fa77259c640 1 --2- 172.21.15.71:0/2246386524 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa75c06ed60 0x7fa75c071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa76400b020 tx=0x7fa764009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:15.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.234+0000 7fa75b7fe640 1 -- 172.21.15.71:0/2246386524 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa76804d2a0 con 0x7fa7740fdba0 2024-09-10T10:02:15.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.389+0000 7fa77907a640 1 -- 172.21.15.71:0/2246386524 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fa77404b720 con 0x7fa7740fdba0 2024-09-10T10:02:15.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.389+0000 7fa75b7fe640 1 -- 172.21.15.71:0/2246386524 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fa76805aba0 con 0x7fa7740fdba0 2024-09-10T10:02:15.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.391+0000 7fa77907a640 1 -- 172.21.15.71:0/2246386524 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa75c06ed60 msgr2=0x7fa75c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:15.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.391+0000 7fa77907a640 1 --2- 172.21.15.71:0/2246386524 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa75c06ed60 0x7fa75c071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa76400b020 tx=0x7fa764009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:15.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.391+0000 7fa77907a640 1 -- 172.21.15.71:0/2246386524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7740fdba0 msgr2=0x7fa7740fd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:15.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.391+0000 7fa77907a640 1 --2- 172.21.15.71:0/2246386524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7740fdba0 0x7fa7740fd390 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa768002a50 tx=0x7fa768004600 comp rx=0 tx=0).stop 2024-09-10T10:02:15.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.391+0000 7fa77907a640 1 -- 172.21.15.71:0/2246386524 shutdown_connections 2024-09-10T10:02:15.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.391+0000 7fa77907a640 1 --2- 172.21.15.71:0/2246386524 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa75c06ed60 0x7fa75c071210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:15.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.391+0000 7fa77907a640 1 --2- 172.21.15.71:0/2246386524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7740fe4f0 0x7fa7740fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:15.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.391+0000 7fa77907a640 1 --2- 172.21.15.71:0/2246386524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7740fdba0 0x7fa7740fd390 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:15.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.391+0000 7fa77907a640 1 -- 172.21.15.71:0/2246386524 >> 172.21.15.71:0/2246386524 conn(0x7fa7740f63a0 msgr2=0x7fa7740f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:15.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.391+0000 7fa77907a640 1 -- 172.21.15.71:0/2246386524 shutdown_connections 2024-09-10T10:02:15.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:15.391+0000 7fa77907a640 1 -- 172.21.15.71:0/2246386524 wait complete. 2024-09-10T10:02:16.015 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:15 smithi071 ceph-mon[27559]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-10T10:02:16.017 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-10T10:02:16.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:15 smithi107 ceph-mon[34215]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-10T10:02:16.261 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:02:17.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.900+0000 7f278ce42640 1 -- 172.21.15.71:0/3918453987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27880fc570 msgr2=0x7f27880fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:17.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.900+0000 7f278ce42640 1 --2- 172.21.15.71:0/3918453987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27880fc570 0x7f27880fc980 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2780004a10 tx=0x7f2780009d40 comp rx=0 tx=0).stop 2024-09-10T10:02:17.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.901+0000 7f278ce42640 1 -- 172.21.15.71:0/3918453987 shutdown_connections 2024-09-10T10:02:17.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.901+0000 7f278ce42640 1 --2- 172.21.15.71:0/3918453987 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27880fd840 0x7f27880fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:17.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.901+0000 7f278ce42640 1 --2- 172.21.15.71:0/3918453987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27880fc570 0x7f27880fc980 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:17.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.901+0000 7f278ce42640 1 -- 172.21.15.71:0/3918453987 >> 172.21.15.71:0/3918453987 conn(0x7f27880f7d30 msgr2=0x7f27880fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:17.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.901+0000 7f278ce42640 1 -- 172.21.15.71:0/3918453987 shutdown_connections 2024-09-10T10:02:17.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.901+0000 7f278ce42640 1 -- 172.21.15.71:0/3918453987 wait complete. 2024-09-10T10:02:17.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.901+0000 7f278ce42640 1 Processor -- start 2024-09-10T10:02:17.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.901+0000 7f278ce42640 1 -- start start 2024-09-10T10:02:17.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f278ce42640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27880fc570 0x7f278810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:17.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f278ce42640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27880fd840 0x7f278810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:17.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f278ce42640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278810dc00 con 0x7f27880fd840 2024-09-10T10:02:17.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f278ce42640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278810e420 con 0x7f27880fc570 2024-09-10T10:02:17.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f2785d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27880fd840 0x7f278810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:17.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f2785d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27880fd840 0x7f278810d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45714/0 (socket says 172.21.15.71:45714) 2024-09-10T10:02:17.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f2785d9b640 1 -- 172.21.15.71:0/2762273171 learned_addr learned my addr 172.21.15.71:0/2762273171 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:17.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f278659c640 1 --2- 172.21.15.71:0/2762273171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27880fc570 0x7f278810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:17.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f2785d9b640 1 -- 172.21.15.71:0/2762273171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27880fc570 msgr2=0x7f278810d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:17.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f2785d9b640 1 --2- 172.21.15.71:0/2762273171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27880fc570 0x7f278810d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f2785d9b640 1 -- 172.21.15.71:0/2762273171 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27800045d0 con 0x7f27880fd840 2024-09-10T10:02:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f278659c640 1 --2- 172.21.15.71:0/2762273171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27880fc570 0x7f278810d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:02:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f2785d9b640 1 --2- 172.21.15.71:0/2762273171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27880fd840 0x7f278810d5b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f277c00cb10 tx=0x7f277c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f2776ffd640 1 -- 172.21.15.71:0/2762273171 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f277c004200 con 0x7f27880fd840 2024-09-10T10:02:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.902+0000 7f2776ffd640 1 -- 172.21.15.71:0/2762273171 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f277c00acc0 con 0x7f27880fd840 2024-09-10T10:02:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.903+0000 7f278ce42640 1 -- 172.21.15.71:0/2762273171 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278810e6b0 con 0x7f27880fd840 2024-09-10T10:02:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.903+0000 7f2776ffd640 1 -- 172.21.15.71:0/2762273171 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f277c003cd0 con 0x7f27880fd840 2024-09-10T10:02:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.903+0000 7f278ce42640 1 -- 172.21.15.71:0/2762273171 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278810ec50 con 0x7f27880fd840 2024-09-10T10:02:17.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.904+0000 7f278ce42640 1 -- 172.21.15.71:0/2762273171 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27880fb9d0 con 0x7f27880fd840 2024-09-10T10:02:17.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.904+0000 7f2776ffd640 1 -- 172.21.15.71:0/2762273171 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f277c00a820 con 0x7f27880fd840 2024-09-10T10:02:17.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.904+0000 7f2776ffd640 1 --2- 172.21.15.71:0/2762273171 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f277006ed60 0x7f2770071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:17.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.905+0000 7f2776ffd640 1 -- 172.21.15.71:0/2762273171 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f277c08e8f0 con 0x7f27880fd840 2024-09-10T10:02:17.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.905+0000 7f278659c640 1 --2- 172.21.15.71:0/2762273171 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f277006ed60 0x7f2770071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:17.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.905+0000 7f278659c640 1 --2- 172.21.15.71:0/2762273171 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f277006ed60 0x7f2770071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2780000c00 tx=0x7f2780009d40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:17.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:17.909+0000 7f2776ffd640 1 -- 172.21.15.71:0/2762273171 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f277c05b9c0 con 0x7f27880fd840 2024-09-10T10:02:18.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:17 smithi071 ceph-mon[27559]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-10T10:02:18.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:18.067+0000 7f278ce42640 1 -- 172.21.15.71:0/2762273171 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f278804b770 con 0x7f27880fd840 2024-09-10T10:02:18.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:18.067+0000 7f2776ffd640 1 -- 172.21.15.71:0/2762273171 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f278804b770 con 0x7f27880fd840 2024-09-10T10:02:18.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:18.070+0000 7f278ce42640 1 -- 172.21.15.71:0/2762273171 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f277006ed60 msgr2=0x7f2770071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:18.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:18.070+0000 7f278ce42640 1 --2- 172.21.15.71:0/2762273171 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f277006ed60 0x7f2770071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2780000c00 tx=0x7f2780009d40 comp rx=0 tx=0).stop 2024-09-10T10:02:18.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:18.070+0000 7f278ce42640 1 -- 172.21.15.71:0/2762273171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27880fd840 msgr2=0x7f278810d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:18.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:18.070+0000 7f278ce42640 1 --2- 172.21.15.71:0/2762273171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27880fd840 0x7f278810d5b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f277c00cb10 tx=0x7f277c007ee0 comp rx=0 tx=0).stop 2024-09-10T10:02:18.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:18.070+0000 7f278ce42640 1 -- 172.21.15.71:0/2762273171 shutdown_connections 2024-09-10T10:02:18.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:18.070+0000 7f278ce42640 1 --2- 172.21.15.71:0/2762273171 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f277006ed60 0x7f2770071210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:18.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:18.070+0000 7f278ce42640 1 --2- 172.21.15.71:0/2762273171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27880fd840 0x7f278810d5b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:18.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:18.070+0000 7f278ce42640 1 --2- 172.21.15.71:0/2762273171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27880fc570 0x7f278810d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:18.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:18.070+0000 7f278ce42640 1 -- 172.21.15.71:0/2762273171 >> 172.21.15.71:0/2762273171 conn(0x7f27880f7d30 msgr2=0x7f27880f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:18.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:18.070+0000 7f278ce42640 1 -- 172.21.15.71:0/2762273171 shutdown_connections 2024-09-10T10:02:18.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:18.070+0000 7f278ce42640 1 -- 172.21.15.71:0/2762273171 wait complete. 2024-09-10T10:02:18.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:17 smithi107 ceph-mon[34215]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-10T10:02:18.817 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-10T10:02:19.063 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:02:20.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:19 smithi071 ceph-mon[27559]: pgmap v200: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-10T10:02:20.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:19 smithi107 ceph-mon[34215]: pgmap v200: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-10T10:02:20.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.734+0000 7f67e2171640 1 -- 172.21.15.71:0/1232882383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67dc0fbbf0 msgr2=0x7f67dc0fdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:20.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.734+0000 7f67e2171640 1 --2- 172.21.15.71:0/1232882383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67dc0fbbf0 0x7f67dc0fdfd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f67cc0048d0 tx=0x7f67cc009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:20.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.734+0000 7f67e2171640 1 -- 172.21.15.71:0/1232882383 shutdown_connections 2024-09-10T10:02:20.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.734+0000 7f67e2171640 1 --2- 172.21.15.71:0/1232882383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67dc0fe510 0x7f67dc100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:20.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.734+0000 7f67e2171640 1 --2- 172.21.15.71:0/1232882383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67dc0fbbf0 0x7f67dc0fdfd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:20.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.734+0000 7f67e2171640 1 -- 172.21.15.71:0/1232882383 >> 172.21.15.71:0/1232882383 conn(0x7f67dc0f5f20 msgr2=0x7f67dc0f8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:20.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.734+0000 7f67e2171640 1 -- 172.21.15.71:0/1232882383 shutdown_connections 2024-09-10T10:02:20.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.734+0000 7f67e2171640 1 -- 172.21.15.71:0/1232882383 wait complete. 2024-09-10T10:02:20.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.735+0000 7f67e2171640 1 Processor -- start 2024-09-10T10:02:20.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.735+0000 7f67e2171640 1 -- start start 2024-09-10T10:02:20.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.735+0000 7f67e2171640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67dc0fbbf0 0x7f67dc0fb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:20.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.735+0000 7f67e2171640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67dc0fe510 0x7f67dc111e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:20.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.735+0000 7f67e2171640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc112410 con 0x7f67dc0fe510 2024-09-10T10:02:20.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.735+0000 7f67e2171640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc112580 con 0x7f67dc0fbbf0 2024-09-10T10:02:20.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.735+0000 7f67daffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67dc0fe510 0x7f67dc111e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:20.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.735+0000 7f67daffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67dc0fe510 0x7f67dc111e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45732/0 (socket says 172.21.15.71:45732) 2024-09-10T10:02:20.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.735+0000 7f67daffd640 1 -- 172.21.15.71:0/1506810728 learned_addr learned my addr 172.21.15.71:0/1506810728 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:20.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.735+0000 7f67db7fe640 1 --2- 172.21.15.71:0/1506810728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67dc0fbbf0 0x7f67dc0fb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:20.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.736+0000 7f67daffd640 1 -- 172.21.15.71:0/1506810728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67dc0fbbf0 msgr2=0x7f67dc0fb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:20.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.736+0000 7f67daffd640 1 --2- 172.21.15.71:0/1506810728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67dc0fbbf0 0x7f67dc0fb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:20.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.736+0000 7f67daffd640 1 -- 172.21.15.71:0/1506810728 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc005040 con 0x7f67dc0fe510 2024-09-10T10:02:20.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.736+0000 7f67db7fe640 1 --2- 172.21.15.71:0/1506810728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67dc0fbbf0 0x7f67dc0fb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:02:20.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.736+0000 7f67daffd640 1 --2- 172.21.15.71:0/1506810728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67dc0fe510 0x7f67dc111e30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f67d000c790 tx=0x7f67d00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:20.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.736+0000 7f67c3fff640 1 -- 172.21.15.71:0/1506810728 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67d000a820 con 0x7f67dc0fe510 2024-09-10T10:02:20.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.736+0000 7f67e2171640 1 -- 172.21.15.71:0/1506810728 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67dc112860 con 0x7f67dc0fe510 2024-09-10T10:02:20.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.736+0000 7f67c3fff640 1 -- 172.21.15.71:0/1506810728 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f67d000ae20 con 0x7f67dc0fe510 2024-09-10T10:02:20.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.736+0000 7f67c3fff640 1 -- 172.21.15.71:0/1506810728 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67d00113a0 con 0x7f67dc0fe510 2024-09-10T10:02:20.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.736+0000 7f67e2171640 1 -- 172.21.15.71:0/1506810728 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc112e00 con 0x7f67dc0fe510 2024-09-10T10:02:20.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.737+0000 7f67e2171640 1 -- 172.21.15.71:0/1506810728 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67dc0f9bc0 con 0x7f67dc0fe510 2024-09-10T10:02:20.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.737+0000 7f67c3fff640 1 -- 172.21.15.71:0/1506810728 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f67d0012400 con 0x7f67dc0fe510 2024-09-10T10:02:20.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.738+0000 7f67c3fff640 1 --2- 172.21.15.71:0/1506810728 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f67c406ed60 0x7f67c4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:20.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.738+0000 7f67c3fff640 1 -- 172.21.15.71:0/1506810728 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f67d008e350 con 0x7f67dc0fe510 2024-09-10T10:02:20.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.738+0000 7f67db7fe640 1 --2- 172.21.15.71:0/1506810728 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f67c406ed60 0x7f67c4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:20.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.739+0000 7f67db7fe640 1 --2- 172.21.15.71:0/1506810728 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f67c406ed60 0x7f67c4071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f67cc000c00 tx=0x7f67cc035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:20.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.742+0000 7f67c3fff640 1 -- 172.21.15.71:0/1506810728 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f67d005b4a0 con 0x7f67dc0fe510 2024-09-10T10:02:20.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.912+0000 7f67e2171640 1 -- 172.21.15.71:0/1506810728 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", "target": ["mon-mgr", ""]}) v1 -- 0x7f67dc0f7a60 con 0x7f67c406ed60 2024-09-10T10:02:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.917+0000 7f67c3fff640 1 -- 172.21.15.71:0/1506810728 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f67dc0f7a60 con 0x7f67c406ed60 2024-09-10T10:02:20.918 INFO:teuthology.orchestra.run.smithi071.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:02:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.919+0000 7f67e2171640 1 -- 172.21.15.71:0/1506810728 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f67c406ed60 msgr2=0x7f67c4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.919+0000 7f67e2171640 1 --2- 172.21.15.71:0/1506810728 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f67c406ed60 0x7f67c4071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f67cc000c00 tx=0x7f67cc035040 comp rx=0 tx=0).stop 2024-09-10T10:02:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.919+0000 7f67e2171640 1 -- 172.21.15.71:0/1506810728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67dc0fe510 msgr2=0x7f67dc111e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.919+0000 7f67e2171640 1 --2- 172.21.15.71:0/1506810728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67dc0fe510 0x7f67dc111e30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f67d000c790 tx=0x7f67d00043c0 comp rx=0 tx=0).stop 2024-09-10T10:02:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.919+0000 7f67e2171640 1 -- 172.21.15.71:0/1506810728 shutdown_connections 2024-09-10T10:02:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.919+0000 7f67e2171640 1 --2- 172.21.15.71:0/1506810728 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f67c406ed60 0x7f67c4071210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.919+0000 7f67e2171640 1 --2- 172.21.15.71:0/1506810728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f67dc0fe510 0x7f67dc111e30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.919+0000 7f67e2171640 1 --2- 172.21.15.71:0/1506810728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67dc0fbbf0 0x7f67dc0fb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.919+0000 7f67e2171640 1 -- 172.21.15.71:0/1506810728 >> 172.21.15.71:0/1506810728 conn(0x7f67dc0f5f20 msgr2=0x7f67dc0f6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.920+0000 7f67e2171640 1 -- 172.21.15.71:0/1506810728 shutdown_connections 2024-09-10T10:02:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:20.920+0000 7f67e2171640 1 -- 172.21.15.71:0/1506810728 wait complete. 2024-09-10T10:02:21.616 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-10T10:02:21.617 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T10:02:21.618 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-10T10:02:21.894 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:02:22.175 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:21 smithi107 ceph-mon[34215]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-10T10:02:22.175 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:21 smithi107 ceph-mon[34215]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:22.175 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:21 smithi107 ceph-mon[34215]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:02:22.175 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:21 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:02:22.175 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:21 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:22.175 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:21 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:22.176 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:21 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:22.176 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:21 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:02:22.186 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:21 smithi071 ceph-mon[27559]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-10T10:02:22.186 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:21 smithi071 ceph-mon[27559]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:22.186 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:21 smithi071 ceph-mon[27559]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:02:22.186 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:21 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:02:22.186 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:21 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:22.186 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:21 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:22.186 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:21 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:22.186 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:21 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:02:23.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:22 smithi071 ceph-mon[27559]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:02:23.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:22 smithi107 ceph-mon[34215]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:02:23.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.609+0000 7f1477909640 1 -- 172.21.15.71:0/2460062408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14700fd810 msgr2=0x7f14700fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:23.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.609+0000 7f1477909640 1 --2- 172.21.15.71:0/2460062408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14700fd810 0x7f14700fdc80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f14600048d0 tx=0x7f1460009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:23.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.609+0000 7f1477909640 1 -- 172.21.15.71:0/2460062408 shutdown_connections 2024-09-10T10:02:23.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.609+0000 7f1477909640 1 --2- 172.21.15.71:0/2460062408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14700fd810 0x7f14700fdc80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:23.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.609+0000 7f1477909640 1 --2- 172.21.15.71:0/2460062408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14700fc540 0x7f14700fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.609+0000 7f1477909640 1 -- 172.21.15.71:0/2460062408 >> 172.21.15.71:0/2460062408 conn(0x7f14700f7ce0 msgr2=0x7f14700fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.609+0000 7f1477909640 1 -- 172.21.15.71:0/2460062408 shutdown_connections 2024-09-10T10:02:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.609+0000 7f1477909640 1 -- 172.21.15.71:0/2460062408 wait complete. 2024-09-10T10:02:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.609+0000 7f1477909640 1 Processor -- start 2024-09-10T10:02:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.609+0000 7f1477909640 1 -- start start 2024-09-10T10:02:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1477909640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14700fc540 0x7f147010d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1477909640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14700fd810 0x7f147010d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1477909640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147010e4a0 con 0x7f14700fd810 2024-09-10T10:02:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1477909640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147010e610 con 0x7f14700fc540 2024-09-10T10:02:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1474ea4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14700fd810 0x7f147010d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1474ea4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14700fd810 0x7f147010d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42826/0 (socket says 172.21.15.71:42826) 2024-09-10T10:02:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1474ea4640 1 -- 172.21.15.71:0/4043920775 learned_addr learned my addr 172.21.15.71:0/4043920775 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f14756a5640 1 --2- 172.21.15.71:0/4043920775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14700fc540 0x7f147010d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1474ea4640 1 -- 172.21.15.71:0/4043920775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14700fc540 msgr2=0x7f147010d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1474ea4640 1 --2- 172.21.15.71:0/4043920775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14700fc540 0x7f147010d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1474ea4640 1 -- 172.21.15.71:0/4043920775 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1460005040 con 0x7f14700fd810 2024-09-10T10:02:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1474ea4640 1 --2- 172.21.15.71:0/4043920775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14700fd810 0x7f147010d630 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1460003080 tx=0x7f1460009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1465ffb640 1 -- 172.21.15.71:0/4043920775 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1460038070 con 0x7f14700fd810 2024-09-10T10:02:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1477909640 1 -- 172.21.15.71:0/4043920775 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147010e890 con 0x7f14700fd810 2024-09-10T10:02:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1465ffb640 1 -- 172.21.15.71:0/4043920775 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f146002abd0 con 0x7f14700fd810 2024-09-10T10:02:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.610+0000 7f1465ffb640 1 -- 172.21.15.71:0/4043920775 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f146003e670 con 0x7f14700fd810 2024-09-10T10:02:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.611+0000 7f1477909640 1 -- 172.21.15.71:0/4043920775 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147010edb0 con 0x7f14700fd810 2024-09-10T10:02:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.612+0000 7f1477909640 1 -- 172.21.15.71:0/4043920775 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14700fb9a0 con 0x7f14700fd810 2024-09-10T10:02:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.612+0000 7f1465ffb640 1 -- 172.21.15.71:0/4043920775 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1460030020 con 0x7f14700fd810 2024-09-10T10:02:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.613+0000 7f1465ffb640 1 --2- 172.21.15.71:0/4043920775 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f145c06ed60 0x7f145c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:23.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.613+0000 7f1465ffb640 1 -- 172.21.15.71:0/4043920775 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f14600ae5d0 con 0x7f14700fd810 2024-09-10T10:02:23.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.613+0000 7f14756a5640 1 --2- 172.21.15.71:0/4043920775 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f145c06ed60 0x7f145c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:23.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.613+0000 7f14756a5640 1 --2- 172.21.15.71:0/4043920775 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f145c06ed60 0x7f145c071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f146c009b50 tx=0x7f146c009120 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:23.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.618+0000 7f1465ffb640 1 -- 172.21.15.71:0/4043920775 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f146007b6b0 con 0x7f14700fd810 2024-09-10T10:02:23.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.804+0000 7f1477909640 1 -- 172.21.15.71:0/4043920775 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1470105130 con 0x7f145c06ed60 2024-09-10T10:02:23.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.805+0000 7f1465ffb640 1 -- 172.21.15.71:0/4043920775 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f1470105130 con 0x7f145c06ed60 2024-09-10T10:02:23.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.807+0000 7f1477909640 1 -- 172.21.15.71:0/4043920775 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f145c06ed60 msgr2=0x7f145c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:23.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.807+0000 7f1477909640 1 --2- 172.21.15.71:0/4043920775 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f145c06ed60 0x7f145c071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f146c009b50 tx=0x7f146c009120 comp rx=0 tx=0).stop 2024-09-10T10:02:23.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.807+0000 7f1477909640 1 -- 172.21.15.71:0/4043920775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14700fd810 msgr2=0x7f147010d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:23.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.807+0000 7f1477909640 1 --2- 172.21.15.71:0/4043920775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14700fd810 0x7f147010d630 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1460003080 tx=0x7f1460009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:23.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.807+0000 7f1477909640 1 -- 172.21.15.71:0/4043920775 shutdown_connections 2024-09-10T10:02:23.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.807+0000 7f1477909640 1 --2- 172.21.15.71:0/4043920775 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f145c06ed60 0x7f145c071210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:23.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.807+0000 7f1477909640 1 --2- 172.21.15.71:0/4043920775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14700fd810 0x7f147010d630 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:23.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.807+0000 7f1477909640 1 --2- 172.21.15.71:0/4043920775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14700fc540 0x7f147010d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:23.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.807+0000 7f1477909640 1 -- 172.21.15.71:0/4043920775 >> 172.21.15.71:0/4043920775 conn(0x7f14700f7ce0 msgr2=0x7f14700f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:23.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.807+0000 7f1477909640 1 -- 172.21.15.71:0/4043920775 shutdown_connections 2024-09-10T10:02:23.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.807+0000 7f1477909640 1 -- 172.21.15.71:0/4043920775 wait complete. 2024-09-10T10:02:23.817 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:02:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.892+0000 7f8be8ab8640 1 -- 172.21.15.71:0/552467793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be40fb430 msgr2=0x7f8be40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.892+0000 7f8be8ab8640 1 --2- 172.21.15.71:0/552467793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be40fb430 0x7f8be40fb840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40048d0 tx=0x7f8bd4009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.892+0000 7f8be8ab8640 1 -- 172.21.15.71:0/552467793 shutdown_connections 2024-09-10T10:02:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.892+0000 7f8be8ab8640 1 --2- 172.21.15.71:0/552467793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be40fc700 0x7f8be40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.892+0000 7f8be8ab8640 1 --2- 172.21.15.71:0/552467793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be40fb430 0x7f8be40fb840 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.892+0000 7f8be8ab8640 1 -- 172.21.15.71:0/552467793 >> 172.21.15.71:0/552467793 conn(0x7f8be40f6bf0 msgr2=0x7f8be40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.892+0000 7f8be8ab8640 1 -- 172.21.15.71:0/552467793 shutdown_connections 2024-09-10T10:02:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.892+0000 7f8be8ab8640 1 -- 172.21.15.71:0/552467793 wait complete. 2024-09-10T10:02:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.893+0000 7f8be8ab8640 1 Processor -- start 2024-09-10T10:02:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.893+0000 7f8be8ab8640 1 -- start start 2024-09-10T10:02:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.893+0000 7f8be8ab8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be40fb430 0x7f8be410fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.893+0000 7f8be8ab8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be40fc700 0x7f8be4112320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.893+0000 7f8be8ab8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be4066730 con 0x7f8be40fb430 2024-09-10T10:02:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.893+0000 7f8be8ab8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be40668a0 con 0x7f8be40fc700 2024-09-10T10:02:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.893+0000 7f8be259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be40fb430 0x7f8be410fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.893+0000 7f8be259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be40fb430 0x7f8be410fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42848/0 (socket says 172.21.15.71:42848) 2024-09-10T10:02:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.893+0000 7f8be259c640 1 -- 172.21.15.71:0/378151907 learned_addr learned my addr 172.21.15.71:0/378151907 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.893+0000 7f8be1d9b640 1 --2- 172.21.15.71:0/378151907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be40fc700 0x7f8be4112320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.893+0000 7f8be259c640 1 -- 172.21.15.71:0/378151907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be40fc700 msgr2=0x7f8be4112320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.893+0000 7f8be259c640 1 --2- 172.21.15.71:0/378151907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be40fc700 0x7f8be4112320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.893+0000 7f8be259c640 1 -- 172.21.15.71:0/378151907 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd4005040 con 0x7f8be40fb430 2024-09-10T10:02:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.894+0000 7f8be259c640 1 --2- 172.21.15.71:0/378151907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be40fb430 0x7f8be410fdd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40043d0 tx=0x7f8bd4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.894+0000 7f8bd2ffd640 1 -- 172.21.15.71:0/378151907 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd4038070 con 0x7f8be40fb430 2024-09-10T10:02:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.894+0000 7f8bd2ffd640 1 -- 172.21.15.71:0/378151907 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8bd402ae90 con 0x7f8be40fb430 2024-09-10T10:02:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.894+0000 7f8be8ab8640 1 -- 172.21.15.71:0/378151907 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be4112860 con 0x7f8be40fb430 2024-09-10T10:02:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.894+0000 7f8bd2ffd640 1 -- 172.21.15.71:0/378151907 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd403e670 con 0x7f8be40fb430 2024-09-10T10:02:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.894+0000 7f8be8ab8640 1 -- 172.21.15.71:0/378151907 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be4112dd0 con 0x7f8be40fb430 2024-09-10T10:02:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.895+0000 7f8be8ab8640 1 -- 172.21.15.71:0/378151907 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be40fa890 con 0x7f8be40fb430 2024-09-10T10:02:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.895+0000 7f8bd2ffd640 1 -- 172.21.15.71:0/378151907 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8bd4030020 con 0x7f8be40fb430 2024-09-10T10:02:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.896+0000 7f8bd2ffd640 1 --2- 172.21.15.71:0/378151907 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8bcc06ed60 0x7f8bcc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.896+0000 7f8bd2ffd640 1 -- 172.21.15.71:0/378151907 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8bd40ae2b0 con 0x7f8be40fb430 2024-09-10T10:02:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.896+0000 7f8be1d9b640 1 --2- 172.21.15.71:0/378151907 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8bcc06ed60 0x7f8bcc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.896+0000 7f8be1d9b640 1 --2- 172.21.15.71:0/378151907 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8bcc06ed60 0x7f8bcc071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8004ed0 tx=0x7f8bd800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:23.901+0000 7f8bd2ffd640 1 -- 172.21.15.71:0/378151907 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8bd407b4b0 con 0x7f8be40fb430 2024-09-10T10:02:24.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.088+0000 7f8be8ab8640 1 -- 172.21.15.71:0/378151907 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8be4100b50 con 0x7f8bcc06ed60 2024-09-10T10:02:24.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.089+0000 7f8bd2ffd640 1 -- 172.21.15.71:0/378151907 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f8be4100b50 con 0x7f8bcc06ed60 2024-09-10T10:02:24.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.091+0000 7f8be8ab8640 1 -- 172.21.15.71:0/378151907 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8bcc06ed60 msgr2=0x7f8bcc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:24.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.091+0000 7f8be8ab8640 1 --2- 172.21.15.71:0/378151907 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8bcc06ed60 0x7f8bcc071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8004ed0 tx=0x7f8bd800b040 comp rx=0 tx=0).stop 2024-09-10T10:02:24.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.091+0000 7f8be8ab8640 1 -- 172.21.15.71:0/378151907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be40fb430 msgr2=0x7f8be410fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:24.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.091+0000 7f8be8ab8640 1 --2- 172.21.15.71:0/378151907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be40fb430 0x7f8be410fdd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40043d0 tx=0x7f8bd4009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.091+0000 7f8be8ab8640 1 -- 172.21.15.71:0/378151907 shutdown_connections 2024-09-10T10:02:24.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.091+0000 7f8be8ab8640 1 --2- 172.21.15.71:0/378151907 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8bcc06ed60 0x7f8bcc071210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.091+0000 7f8be8ab8640 1 --2- 172.21.15.71:0/378151907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8be40fc700 0x7f8be4112320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.091+0000 7f8be8ab8640 1 --2- 172.21.15.71:0/378151907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8be40fb430 0x7f8be410fdd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.091+0000 7f8be8ab8640 1 -- 172.21.15.71:0/378151907 >> 172.21.15.71:0/378151907 conn(0x7f8be40f6bf0 msgr2=0x7f8be40f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:24.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.092+0000 7f8be8ab8640 1 -- 172.21.15.71:0/378151907 shutdown_connections 2024-09-10T10:02:24.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.092+0000 7f8be8ab8640 1 -- 172.21.15.71:0/378151907 wait complete. 2024-09-10T10:02:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.176+0000 7f6619099640 1 -- 172.21.15.71:0/3721655614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66140ff690 msgr2=0x7f6614101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.176+0000 7f6619099640 1 --2- 172.21.15.71:0/3721655614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66140ff690 0x7f6614101a70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f66080048d0 tx=0x7f6608009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.176+0000 7f6619099640 1 -- 172.21.15.71:0/3721655614 shutdown_connections 2024-09-10T10:02:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.176+0000 7f6619099640 1 --2- 172.21.15.71:0/3721655614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66140ff690 0x7f6614101a70 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.176+0000 7f6619099640 1 --2- 172.21.15.71:0/3721655614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66140666b0 0x7f66140ff150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.176+0000 7f6619099640 1 -- 172.21.15.71:0/3721655614 >> 172.21.15.71:0/3721655614 conn(0x7f66140f6c20 msgr2=0x7f66140f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:24.178 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:23 smithi071 ceph-mon[27559]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-10T10:02:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.176+0000 7f6619099640 1 -- 172.21.15.71:0/3721655614 shutdown_connections 2024-09-10T10:02:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.176+0000 7f6619099640 1 -- 172.21.15.71:0/3721655614 wait complete. 2024-09-10T10:02:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.177+0000 7f6619099640 1 Processor -- start 2024-09-10T10:02:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.177+0000 7f6619099640 1 -- start start 2024-09-10T10:02:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.177+0000 7f6619099640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66140666b0 0x7f66140fcb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.177+0000 7f6619099640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66140ff690 0x7f66140fb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.177+0000 7f6619099640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66140fb620 con 0x7f66140ff690 2024-09-10T10:02:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.177+0000 7f6619099640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66140fb760 con 0x7f66140666b0 2024-09-10T10:02:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.177+0000 7f661259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66140ff690 0x7f66140fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.177+0000 7f661259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66140ff690 0x7f66140fb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42864/0 (socket says 172.21.15.71:42864) 2024-09-10T10:02:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.177+0000 7f661259c640 1 -- 172.21.15.71:0/2155570369 learned_addr learned my addr 172.21.15.71:0/2155570369 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.178+0000 7f6612d9d640 1 --2- 172.21.15.71:0/2155570369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66140666b0 0x7f66140fcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.178+0000 7f661259c640 1 -- 172.21.15.71:0/2155570369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66140666b0 msgr2=0x7f66140fcb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.178+0000 7f661259c640 1 --2- 172.21.15.71:0/2155570369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66140666b0 0x7f66140fcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.178+0000 7f661259c640 1 -- 172.21.15.71:0/2155570369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6608005040 con 0x7f66140ff690 2024-09-10T10:02:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.178+0000 7f661259c640 1 --2- 172.21.15.71:0/2155570369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66140ff690 0x7f66140fb050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6608000c00 tx=0x7f6608009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.178+0000 7f65fb7fe640 1 -- 172.21.15.71:0/2155570369 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6608038070 con 0x7f66140ff690 2024-09-10T10:02:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.178+0000 7f65fb7fe640 1 -- 172.21.15.71:0/2155570369 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f660802ae90 con 0x7f66140ff690 2024-09-10T10:02:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.178+0000 7f65fb7fe640 1 -- 172.21.15.71:0/2155570369 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f660803d420 con 0x7f66140ff690 2024-09-10T10:02:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.178+0000 7f6619099640 1 -- 172.21.15.71:0/2155570369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66140fb9e0 con 0x7f66140ff690 2024-09-10T10:02:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.178+0000 7f6619099640 1 -- 172.21.15.71:0/2155570369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66140fbea0 con 0x7f66140ff690 2024-09-10T10:02:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.179+0000 7f6619099640 1 -- 172.21.15.71:0/2155570369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66140fa8a0 con 0x7f66140ff690 2024-09-10T10:02:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.180+0000 7f65fb7fe640 1 -- 172.21.15.71:0/2155570369 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6608030020 con 0x7f66140ff690 2024-09-10T10:02:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.180+0000 7f65fb7fe640 1 --2- 172.21.15.71:0/2155570369 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f65fc06ed60 0x7f65fc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.180+0000 7f65fb7fe640 1 -- 172.21.15.71:0/2155570369 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f66080ae9b0 con 0x7f66140ff690 2024-09-10T10:02:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.180+0000 7f6612d9d640 1 --2- 172.21.15.71:0/2155570369 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f65fc06ed60 0x7f65fc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.181+0000 7f6612d9d640 1 --2- 172.21.15.71:0/2155570369 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f65fc06ed60 0x7f65fc071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f66140fc8c0 tx=0x7f660c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.185+0000 7f65fb7fe640 1 -- 172.21.15.71:0/2155570369 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f660807ba80 con 0x7f66140ff690 2024-09-10T10:02:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.366+0000 7f6619099640 1 -- 172.21.15.71:0/2155570369 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f66140f8710 con 0x7f65fc06ed60 2024-09-10T10:02:24.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.375+0000 7f65fb7fe640 1 -- 172.21.15.71:0/2155570369 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f66140f8710 con 0x7f65fc06ed60 2024-09-10T10:02:24.376 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:02:24.376 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (4m) 26s ago 6m 25.4M - 0.25.0 c8568f914cd2 b3a4270190ef 2024-09-10T10:02:24.376 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (6m) 26s ago 6m 6891k - 17.2.7-1597-g96d63e75 f3fc7d52e233 f70481a4c3c7 2024-09-10T10:02:24.376 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (5m) 32s ago 5m 6895k - 17.2.7-1597-g96d63e75 f3fc7d52e233 cf27ebcc0f98 2024-09-10T10:02:24.376 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (4m) 26s ago 6m 81.4M - 9.4.7 954c08fa6188 1998c9de2d92 2024-09-10T10:02:24.376 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (47s) 26s ago 46s 16.6M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:02:24.376 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (53s) 26s ago 52s 11.8M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:02:24.377 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (50s) 32s ago 49s 16.5M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:02:24.377 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (44s) 32s ago 43s 14.9M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:02:24.377 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:9283,8765,8443 running (7m) 26s ago 7m 449M - 17.2.7-1597-g96d63e75 f3fc7d52e233 dc0e497fa11e 2024-09-10T10:02:24.377 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283 running (5m) 32s ago 5m 401M - 17.2.7-1597-g96d63e75 f3fc7d52e233 d93840908437 2024-09-10T10:02:24.377 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (7m) 26s ago 7m 49.6M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 35e491e574a3 2024-09-10T10:02:24.377 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (5m) 32s ago 5m 35.7M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 682e2b6e311f 2024-09-10T10:02:24.377 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (6m) 26s ago 6m 16.1M - 1.5.0 0da6a335fe13 acc088fb47d4 2024-09-10T10:02:24.377 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (5m) 32s ago 5m 15.8M - 1.5.0 0da6a335fe13 12be03d3d11f 2024-09-10T10:02:24.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (4m) 26s ago 4m 46.5M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 a79e69c9b514 2024-09-10T10:02:24.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (3m) 26s ago 3m 44.4M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 44a84bf577da 2024-09-10T10:02:24.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (3m) 26s ago 3m 42.9M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 4fae52756a24 2024-09-10T10:02:24.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (3m) 32s ago 3m 47.1M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:02:24.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (2m) 32s ago 2m 42.6M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:02:24.378 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (2m) 32s ago 2m 42.0M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:02:24.378 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (4m) 26s ago 5m 56.1M - 2.43.0 a07b618ecd1d 1a619aeb5698 2024-09-10T10:02:24.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.377+0000 7f6619099640 1 -- 172.21.15.71:0/2155570369 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f65fc06ed60 msgr2=0x7f65fc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:24.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.377+0000 7f6619099640 1 --2- 172.21.15.71:0/2155570369 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f65fc06ed60 0x7f65fc071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f66140fc8c0 tx=0x7f660c008040 comp rx=0 tx=0).stop 2024-09-10T10:02:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.377+0000 7f6619099640 1 -- 172.21.15.71:0/2155570369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66140ff690 msgr2=0x7f66140fb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.377+0000 7f6619099640 1 --2- 172.21.15.71:0/2155570369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66140ff690 0x7f66140fb050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6608000c00 tx=0x7f6608009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.377+0000 7f6619099640 1 -- 172.21.15.71:0/2155570369 shutdown_connections 2024-09-10T10:02:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.377+0000 7f6619099640 1 --2- 172.21.15.71:0/2155570369 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f65fc06ed60 0x7f65fc071210 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.377+0000 7f6619099640 1 --2- 172.21.15.71:0/2155570369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66140ff690 0x7f66140fb050 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.377+0000 7f6619099640 1 --2- 172.21.15.71:0/2155570369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66140666b0 0x7f66140fcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.377+0000 7f6619099640 1 -- 172.21.15.71:0/2155570369 >> 172.21.15.71:0/2155570369 conn(0x7f66140f6c20 msgr2=0x7f66140f6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.377+0000 7f6619099640 1 -- 172.21.15.71:0/2155570369 shutdown_connections 2024-09-10T10:02:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.377+0000 7f6619099640 1 -- 172.21.15.71:0/2155570369 wait complete. 2024-09-10T10:02:24.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:23 smithi107 ceph-mon[34215]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-10T10:02:24.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.459+0000 7f68229a0640 1 -- 172.21.15.71:0/3013583021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f681c0fb290 msgr2=0x7f681c0fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:24.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.459+0000 7f68229a0640 1 --2- 172.21.15.71:0/3013583021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f681c0fb290 0x7f681c0fb6a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f68180048d0 tx=0x7f6818009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.459+0000 7f68229a0640 1 -- 172.21.15.71:0/3013583021 shutdown_connections 2024-09-10T10:02:24.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.459+0000 7f68229a0640 1 --2- 172.21.15.71:0/3013583021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f681c0fc560 0x7f681c0fc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.459+0000 7f68229a0640 1 --2- 172.21.15.71:0/3013583021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f681c0fb290 0x7f681c0fb6a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.459+0000 7f68229a0640 1 -- 172.21.15.71:0/3013583021 >> 172.21.15.71:0/3013583021 conn(0x7f681c0f6a50 msgr2=0x7f681c0f8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:24.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.459+0000 7f68229a0640 1 -- 172.21.15.71:0/3013583021 shutdown_connections 2024-09-10T10:02:24.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.460+0000 7f68229a0640 1 -- 172.21.15.71:0/3013583021 wait complete. 2024-09-10T10:02:24.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.460+0000 7f68229a0640 1 Processor -- start 2024-09-10T10:02:24.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.460+0000 7f68229a0640 1 -- start start 2024-09-10T10:02:24.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.460+0000 7f68229a0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f681c0fb290 0x7f681c10ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:24.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.460+0000 7f68229a0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f681c0fc560 0x7f681c10d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:24.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.460+0000 7f68229a0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681c10da60 con 0x7f681c0fb290 2024-09-10T10:02:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.460+0000 7f68229a0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681c10e280 con 0x7f681c0fc560 2024-09-10T10:02:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.461+0000 7f682199e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f681c0fb290 0x7f681c10ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.461+0000 7f682199e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f681c0fb290 0x7f681c10ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42882/0 (socket says 172.21.15.71:42882) 2024-09-10T10:02:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.461+0000 7f682199e640 1 -- 172.21.15.71:0/2598684466 learned_addr learned my addr 172.21.15.71:0/2598684466 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.461+0000 7f682119d640 1 --2- 172.21.15.71:0/2598684466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f681c0fc560 0x7f681c10d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.461+0000 7f682199e640 1 -- 172.21.15.71:0/2598684466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f681c0fc560 msgr2=0x7f681c10d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:24.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.461+0000 7f682199e640 1 --2- 172.21.15.71:0/2598684466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f681c0fc560 0x7f681c10d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.461+0000 7f682199e640 1 -- 172.21.15.71:0/2598684466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6818005040 con 0x7f681c0fb290 2024-09-10T10:02:24.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.461+0000 7f682199e640 1 --2- 172.21.15.71:0/2598684466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f681c0fb290 0x7f681c10ced0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6818003080 tx=0x7f6818009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:24.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.461+0000 7f68127fc640 1 -- 172.21.15.71:0/2598684466 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6818038070 con 0x7f681c0fb290 2024-09-10T10:02:24.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.461+0000 7f68229a0640 1 -- 172.21.15.71:0/2598684466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681c10e4b0 con 0x7f681c0fb290 2024-09-10T10:02:24.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.461+0000 7f68127fc640 1 -- 172.21.15.71:0/2598684466 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f681802abd0 con 0x7f681c0fb290 2024-09-10T10:02:24.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.461+0000 7f68127fc640 1 -- 172.21.15.71:0/2598684466 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f681803e670 con 0x7f681c0fb290 2024-09-10T10:02:24.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.461+0000 7f68229a0640 1 -- 172.21.15.71:0/2598684466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681c10ea50 con 0x7f681c0fb290 2024-09-10T10:02:24.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.462+0000 7f68229a0640 1 -- 172.21.15.71:0/2598684466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681c05ed70 con 0x7f681c0fb290 2024-09-10T10:02:24.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.463+0000 7f68127fc640 1 -- 172.21.15.71:0/2598684466 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6818030020 con 0x7f681c0fb290 2024-09-10T10:02:24.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.463+0000 7f68127fc640 1 --2- 172.21.15.71:0/2598684466 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f680806ed60 0x7f6808071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:24.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.464+0000 7f68127fc640 1 -- 172.21.15.71:0/2598684466 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f68180ae530 con 0x7f681c0fb290 2024-09-10T10:02:24.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.464+0000 7f682119d640 1 --2- 172.21.15.71:0/2598684466 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f680806ed60 0x7f6808071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:24.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.464+0000 7f682119d640 1 --2- 172.21.15.71:0/2598684466 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f680806ed60 0x7f6808071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f681c10cc80 tx=0x7f680c009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:24.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.469+0000 7f68127fc640 1 -- 172.21.15.71:0/2598684466 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f681807b6b0 con 0x7f681c0fb290 2024-09-10T10:02:24.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.702+0000 7f68229a0640 1 -- 172.21.15.71:0/2598684466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f681c10ed60 con 0x7f681c0fb290 2024-09-10T10:02:24.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.702+0000 7f68127fc640 1 -- 172.21.15.71:0/2598684466 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f681807b050 con 0x7f681c0fb290 2024-09-10T10:02:24.704 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:02:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:02:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2 2024-09-10T10:02:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:02:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:02:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2 2024-09-10T10:02:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:02:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:02:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 6 2024-09-10T10:02:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:02:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:02:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:02:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:02:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:02:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 14 2024-09-10T10:02:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:02:24.705 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:02:24.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.705+0000 7f68229a0640 1 -- 172.21.15.71:0/2598684466 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f680806ed60 msgr2=0x7f6808071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:24.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.705+0000 7f68229a0640 1 --2- 172.21.15.71:0/2598684466 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f680806ed60 0x7f6808071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f681c10cc80 tx=0x7f680c009040 comp rx=0 tx=0).stop 2024-09-10T10:02:24.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.705+0000 7f68229a0640 1 -- 172.21.15.71:0/2598684466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f681c0fb290 msgr2=0x7f681c10ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:24.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.705+0000 7f68229a0640 1 --2- 172.21.15.71:0/2598684466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f681c0fb290 0x7f681c10ced0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6818003080 tx=0x7f6818009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.705+0000 7f68229a0640 1 -- 172.21.15.71:0/2598684466 shutdown_connections 2024-09-10T10:02:24.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.705+0000 7f68229a0640 1 --2- 172.21.15.71:0/2598684466 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f680806ed60 0x7f6808071210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.705+0000 7f68229a0640 1 --2- 172.21.15.71:0/2598684466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f681c0fc560 0x7f681c10d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.705+0000 7f68229a0640 1 --2- 172.21.15.71:0/2598684466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f681c0fb290 0x7f681c10ced0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.705+0000 7f68229a0640 1 -- 172.21.15.71:0/2598684466 >> 172.21.15.71:0/2598684466 conn(0x7f681c0f6a50 msgr2=0x7f681c0656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.705+0000 7f68229a0640 1 -- 172.21.15.71:0/2598684466 shutdown_connections 2024-09-10T10:02:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.705+0000 7f68229a0640 1 -- 172.21.15.71:0/2598684466 wait complete. 2024-09-10T10:02:24.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.789+0000 7fe0090b3640 1 -- 172.21.15.71:0/2805040675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe004066490 msgr2=0x7fe0040ff170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:24.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.789+0000 7fe0090b3640 1 --2- 172.21.15.71:0/2805040675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe004066490 0x7fe0040ff170 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdff40048d0 tx=0x7fdff4009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.789+0000 7fe0090b3640 1 -- 172.21.15.71:0/2805040675 shutdown_connections 2024-09-10T10:02:24.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.789+0000 7fe0090b3640 1 --2- 172.21.15.71:0/2805040675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0040ff6b0 0x7fe004101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.789+0000 7fe0090b3640 1 --2- 172.21.15.71:0/2805040675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe004066490 0x7fe0040ff170 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.789+0000 7fe0090b3640 1 -- 172.21.15.71:0/2805040675 >> 172.21.15.71:0/2805040675 conn(0x7fe0040f6c00 msgr2=0x7fe0040f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:24.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.790+0000 7fe0090b3640 1 -- 172.21.15.71:0/2805040675 shutdown_connections 2024-09-10T10:02:24.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.790+0000 7fe0090b3640 1 -- 172.21.15.71:0/2805040675 wait complete. 2024-09-10T10:02:24.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.790+0000 7fe0090b3640 1 Processor -- start 2024-09-10T10:02:24.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.791+0000 7fe0090b3640 1 -- start start 2024-09-10T10:02:24.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.791+0000 7fe0090b3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe004066490 0x7fe00410f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:24.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.791+0000 7fe0090b3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0040ff6b0 0x7fe00410f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:24.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.791+0000 7fe0090b3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe004110710 con 0x7fe0040ff6b0 2024-09-10T10:02:24.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.791+0000 7fe0090b3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe004110880 con 0x7fe004066490 2024-09-10T10:02:24.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.791+0000 7fe00259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0040ff6b0 0x7fe00410f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:24.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.791+0000 7fe00259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0040ff6b0 0x7fe00410f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42900/0 (socket says 172.21.15.71:42900) 2024-09-10T10:02:24.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.791+0000 7fe00259c640 1 -- 172.21.15.71:0/1977497509 learned_addr learned my addr 172.21.15.71:0/1977497509 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:24.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.791+0000 7fe002d9d640 1 --2- 172.21.15.71:0/1977497509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe004066490 0x7fe00410f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:24.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.791+0000 7fe00259c640 1 -- 172.21.15.71:0/1977497509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe004066490 msgr2=0x7fe00410f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:24.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.791+0000 7fe00259c640 1 --2- 172.21.15.71:0/1977497509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe004066490 0x7fe00410f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:24.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.791+0000 7fe00259c640 1 -- 172.21.15.71:0/1977497509 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff4005040 con 0x7fe0040ff6b0 2024-09-10T10:02:24.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.791+0000 7fe002d9d640 1 --2- 172.21.15.71:0/1977497509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe004066490 0x7fe00410f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:02:24.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.792+0000 7fe00259c640 1 --2- 172.21.15.71:0/1977497509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0040ff6b0 0x7fe00410f8a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdff800b790 tx=0x7fdff80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:24.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.792+0000 7fdfeb7fe640 1 -- 172.21.15.71:0/1977497509 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff800c700 con 0x7fe0040ff6b0 2024-09-10T10:02:24.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.792+0000 7fe0090b3640 1 -- 172.21.15.71:0/1977497509 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe004110b60 con 0x7fe0040ff6b0 2024-09-10T10:02:24.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.792+0000 7fdfeb7fe640 1 -- 172.21.15.71:0/1977497509 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdff800cd00 con 0x7fe0040ff6b0 2024-09-10T10:02:24.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.792+0000 7fdfeb7fe640 1 -- 172.21.15.71:0/1977497509 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff8015e40 con 0x7fe0040ff6b0 2024-09-10T10:02:24.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.792+0000 7fe0090b3640 1 -- 172.21.15.71:0/1977497509 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe004111080 con 0x7fe0040ff6b0 2024-09-10T10:02:24.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.793+0000 7fe0090b3640 1 -- 172.21.15.71:0/1977497509 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0040fa880 con 0x7fe0040ff6b0 2024-09-10T10:02:24.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.794+0000 7fdfeb7fe640 1 -- 172.21.15.71:0/1977497509 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fdff8012070 con 0x7fe0040ff6b0 2024-09-10T10:02:24.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.794+0000 7fdfeb7fe640 1 --2- 172.21.15.71:0/1977497509 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdfec06ed50 0x7fdfec071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:24.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.795+0000 7fdfeb7fe640 1 -- 172.21.15.71:0/1977497509 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdff808db00 con 0x7fe0040ff6b0 2024-09-10T10:02:24.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.795+0000 7fe002d9d640 1 --2- 172.21.15.71:0/1977497509 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdfec06ed50 0x7fdfec071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:24.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.795+0000 7fe002d9d640 1 --2- 172.21.15.71:0/1977497509 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdfec06ed50 0x7fdfec071200 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdff400b020 tx=0x7fdff4009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:24.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:24.798+0000 7fdfeb7fe640 1 -- 172.21.15.71:0/1977497509 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdff805abd0 con 0x7fe0040ff6b0 2024-09-10T10:02:25.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.011+0000 7fe0090b3640 1 -- 172.21.15.71:0/1977497509 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe004104fa0 con 0x7fe0040ff6b0 2024-09-10T10:02:25.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.011+0000 7fdfeb7fe640 1 -- 172.21.15.71:0/1977497509 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1832 (secure 0 0 0) 0x7fdff805a570 con 0x7fe0040ff6b0 2024-09-10T10:02:25.012 INFO:teuthology.orchestra.run.smithi071.stdout:e20 2024-09-10T10:02:25.012 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:02:25.013 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:02:25.013 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:02:25.013 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:02:25.013 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:02:25.013 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:02:25.013 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 20 2024-09-10T10:02:25.013 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:02:25.013 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:02:25.013 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:01:46.701856+0000 2024-09-10T10:02:25.013 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:02:25.013 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:02:25.013 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:02:25.014 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:02:25.014 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:02:25.014 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:02:25.014 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:02:25.014 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:02:25.014 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:02:25.014 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:02:25.014 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:02:25.014 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:02:25.014 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:02:25.014 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:02:25.015 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:02:25.015 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:02:25.015 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:02:25.015 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:02:25.015 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:02:25.015 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:02:25.015 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:02:25.015 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:02:25.015 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:02:25.015 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:02:25.015 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:02:25.016 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:02:25.016 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 20 2024-09-10T10:02:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.013+0000 7fe0090b3640 1 -- 172.21.15.71:0/1977497509 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdfec06ed50 msgr2=0x7fdfec071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.013+0000 7fe0090b3640 1 --2- 172.21.15.71:0/1977497509 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdfec06ed50 0x7fdfec071200 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdff400b020 tx=0x7fdff4009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.013+0000 7fe0090b3640 1 -- 172.21.15.71:0/1977497509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0040ff6b0 msgr2=0x7fe00410f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.013+0000 7fe0090b3640 1 --2- 172.21.15.71:0/1977497509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0040ff6b0 0x7fe00410f8a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdff800b790 tx=0x7fdff80091d0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.013+0000 7fe0090b3640 1 -- 172.21.15.71:0/1977497509 shutdown_connections 2024-09-10T10:02:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.013+0000 7fe0090b3640 1 --2- 172.21.15.71:0/1977497509 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdfec06ed50 0x7fdfec071200 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.013+0000 7fe0090b3640 1 --2- 172.21.15.71:0/1977497509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0040ff6b0 0x7fe00410f8a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.013+0000 7fe0090b3640 1 --2- 172.21.15.71:0/1977497509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe004066490 0x7fe00410f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.013+0000 7fe0090b3640 1 -- 172.21.15.71:0/1977497509 >> 172.21.15.71:0/1977497509 conn(0x7fe0040f6c00 msgr2=0x7fe0040fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.013+0000 7fe0090b3640 1 -- 172.21.15.71:0/1977497509 shutdown_connections 2024-09-10T10:02:25.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.013+0000 7fe0090b3640 1 -- 172.21.15.71:0/1977497509 wait complete. 2024-09-10T10:02:25.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.097+0000 7fd0efd04640 1 -- 172.21.15.71:0/560647833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e80fc520 msgr2=0x7fd0e80fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:25.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.097+0000 7fd0efd04640 1 --2- 172.21.15.71:0/560647833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e80fc520 0x7fd0e80fc930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40048d0 tx=0x7fd0e4009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.097+0000 7fd0efd04640 1 -- 172.21.15.71:0/560647833 shutdown_connections 2024-09-10T10:02:25.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.097+0000 7fd0efd04640 1 --2- 172.21.15.71:0/560647833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e80fd7f0 0x7fd0e80fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.099 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:24 smithi071 ceph-mon[27559]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:25.099 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:24 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/2598684466' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:02:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.097+0000 7fd0efd04640 1 --2- 172.21.15.71:0/560647833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e80fc520 0x7fd0e80fc930 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.097+0000 7fd0efd04640 1 -- 172.21.15.71:0/560647833 >> 172.21.15.71:0/560647833 conn(0x7fd0e80f7ce0 msgr2=0x7fd0e80fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.097+0000 7fd0efd04640 1 -- 172.21.15.71:0/560647833 shutdown_connections 2024-09-10T10:02:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.097+0000 7fd0efd04640 1 -- 172.21.15.71:0/560647833 wait complete. 2024-09-10T10:02:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.098+0000 7fd0efd04640 1 Processor -- start 2024-09-10T10:02:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.098+0000 7fd0efd04640 1 -- start start 2024-09-10T10:02:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.098+0000 7fd0efd04640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e80fc520 0x7fd0e810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.098+0000 7fd0efd04640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e80fd7f0 0x7fd0e810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.098+0000 7fd0efd04640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e810dc10 con 0x7fd0e80fd7f0 2024-09-10T10:02:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.098+0000 7fd0efd04640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e810e430 con 0x7fd0e80fc520 2024-09-10T10:02:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.098+0000 7fd0ed29f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e80fd7f0 0x7fd0e810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.098+0000 7fd0ed29f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e80fd7f0 0x7fd0e810d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42920/0 (socket says 172.21.15.71:42920) 2024-09-10T10:02:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.098+0000 7fd0ed29f640 1 -- 172.21.15.71:0/4109076116 learned_addr learned my addr 172.21.15.71:0/4109076116 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.099+0000 7fd0edaa0640 1 --2- 172.21.15.71:0/4109076116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e80fc520 0x7fd0e810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.099+0000 7fd0ed29f640 1 -- 172.21.15.71:0/4109076116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e80fc520 msgr2=0x7fd0e810d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.099+0000 7fd0ed29f640 1 --2- 172.21.15.71:0/4109076116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e80fc520 0x7fd0e810d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.099+0000 7fd0ed29f640 1 -- 172.21.15.71:0/4109076116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e4005040 con 0x7fd0e80fd7f0 2024-09-10T10:02:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.099+0000 7fd0edaa0640 1 --2- 172.21.15.71:0/4109076116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e80fc520 0x7fd0e810d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:02:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.099+0000 7fd0ed29f640 1 --2- 172.21.15.71:0/4109076116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e80fd7f0 0x7fd0e810d5c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800c830 tx=0x7fd0d8004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.099+0000 7fd0de7fc640 1 -- 172.21.15.71:0/4109076116 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0d800a850 con 0x7fd0e80fd7f0 2024-09-10T10:02:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.099+0000 7fd0efd04640 1 -- 172.21.15.71:0/4109076116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e810e6c0 con 0x7fd0e80fd7f0 2024-09-10T10:02:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.099+0000 7fd0de7fc640 1 -- 172.21.15.71:0/4109076116 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd0d800ae50 con 0x7fd0e80fd7f0 2024-09-10T10:02:25.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.099+0000 7fd0de7fc640 1 -- 172.21.15.71:0/4109076116 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0d80113a0 con 0x7fd0e80fd7f0 2024-09-10T10:02:25.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.099+0000 7fd0efd04640 1 -- 172.21.15.71:0/4109076116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e810ec60 con 0x7fd0e80fd7f0 2024-09-10T10:02:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.100+0000 7fd0efd04640 1 -- 172.21.15.71:0/4109076116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e80fb980 con 0x7fd0e80fd7f0 2024-09-10T10:02:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.101+0000 7fd0de7fc640 1 -- 172.21.15.71:0/4109076116 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fd0d8011580 con 0x7fd0e80fd7f0 2024-09-10T10:02:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.102+0000 7fd0de7fc640 1 --2- 172.21.15.71:0/4109076116 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd0d406ed60 0x7fd0d4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.102+0000 7fd0de7fc640 1 -- 172.21.15.71:0/4109076116 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd0d808e300 con 0x7fd0e80fd7f0 2024-09-10T10:02:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.102+0000 7fd0edaa0640 1 --2- 172.21.15.71:0/4109076116 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd0d406ed60 0x7fd0d4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.102+0000 7fd0edaa0640 1 --2- 172.21.15.71:0/4109076116 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd0d406ed60 0x7fd0d4071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4004540 tx=0x7fd0e4035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:25.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.107+0000 7fd0de7fc640 1 -- 172.21.15.71:0/4109076116 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd0d805b640 con 0x7fd0e80fd7f0 2024-09-10T10:02:25.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.291+0000 7fd0efd04640 1 -- 172.21.15.71:0/4109076116 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0e810f000 con 0x7fd0d406ed60 2024-09-10T10:02:25.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.292+0000 7fd0de7fc640 1 -- 172.21.15.71:0/4109076116 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fd0e810f000 con 0x7fd0d406ed60 2024-09-10T10:02:25.293 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:02:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", 2024-09-10T10:02:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:02:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:02:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-10T10:02:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "", 2024-09-10T10:02:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b image", 2024-09-10T10:02:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:02:25.294 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:02:25.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.294+0000 7fd0efd04640 1 -- 172.21.15.71:0/4109076116 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd0d406ed60 msgr2=0x7fd0d4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:25.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.294+0000 7fd0efd04640 1 --2- 172.21.15.71:0/4109076116 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd0d406ed60 0x7fd0d4071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4004540 tx=0x7fd0e4035040 comp rx=0 tx=0).stop 2024-09-10T10:02:25.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.294+0000 7fd0efd04640 1 -- 172.21.15.71:0/4109076116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e80fd7f0 msgr2=0x7fd0e810d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:25.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.294+0000 7fd0efd04640 1 --2- 172.21.15.71:0/4109076116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e80fd7f0 0x7fd0e810d5c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800c830 tx=0x7fd0d8004430 comp rx=0 tx=0).stop 2024-09-10T10:02:25.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.294+0000 7fd0efd04640 1 -- 172.21.15.71:0/4109076116 shutdown_connections 2024-09-10T10:02:25.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.294+0000 7fd0efd04640 1 --2- 172.21.15.71:0/4109076116 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd0d406ed60 0x7fd0d4071210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.294+0000 7fd0efd04640 1 --2- 172.21.15.71:0/4109076116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0e80fd7f0 0x7fd0e810d5c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.294+0000 7fd0efd04640 1 --2- 172.21.15.71:0/4109076116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0e80fc520 0x7fd0e810d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.294+0000 7fd0efd04640 1 -- 172.21.15.71:0/4109076116 >> 172.21.15.71:0/4109076116 conn(0x7fd0e80f7ce0 msgr2=0x7fd0e80f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:25.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.294+0000 7fd0efd04640 1 -- 172.21.15.71:0/4109076116 shutdown_connections 2024-09-10T10:02:25.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.294+0000 7fd0efd04640 1 -- 172.21.15.71:0/4109076116 wait complete. 2024-09-10T10:02:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.375+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1102450349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8ec065c40 msgr2=0x7fa8ec0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.375+0000 7fa8f0a24640 1 --2- 172.21.15.71:0/1102450349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8ec065c40 0x7fa8ec0ff140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc0048d0 tx=0x7fa8dc009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.375+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1102450349 shutdown_connections 2024-09-10T10:02:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.375+0000 7fa8f0a24640 1 --2- 172.21.15.71:0/1102450349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8ec0ff680 0x7fa8ec101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.375+0000 7fa8f0a24640 1 --2- 172.21.15.71:0/1102450349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8ec065c40 0x7fa8ec0ff140 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.375+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1102450349 >> 172.21.15.71:0/1102450349 conn(0x7fa8ec0f6c10 msgr2=0x7fa8ec0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.376+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1102450349 shutdown_connections 2024-09-10T10:02:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.376+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1102450349 wait complete. 2024-09-10T10:02:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.376+0000 7fa8f0a24640 1 Processor -- start 2024-09-10T10:02:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.376+0000 7fa8f0a24640 1 -- start start 2024-09-10T10:02:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.376+0000 7fa8f0a24640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8ec065c40 0x7fa8ec10f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.376+0000 7fa8f0a24640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8ec0ff680 0x7fa8ec10f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.376+0000 7fa8f0a24640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec10fe40 con 0x7fa8ec0ff680 2024-09-10T10:02:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.376+0000 7fa8f0a24640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec110660 con 0x7fa8ec065c40 2024-09-10T10:02:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.376+0000 7fa8e9d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8ec0ff680 0x7fa8ec10f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.377+0000 7fa8e9d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8ec0ff680 0x7fa8ec10f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42938/0 (socket says 172.21.15.71:42938) 2024-09-10T10:02:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.377+0000 7fa8e9d9b640 1 -- 172.21.15.71:0/1774019064 learned_addr learned my addr 172.21.15.71:0/1774019064 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.377+0000 7fa8ea59c640 1 --2- 172.21.15.71:0/1774019064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8ec065c40 0x7fa8ec10f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.377+0000 7fa8e9d9b640 1 -- 172.21.15.71:0/1774019064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8ec065c40 msgr2=0x7fa8ec10f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.377+0000 7fa8e9d9b640 1 --2- 172.21.15.71:0/1774019064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8ec065c40 0x7fa8ec10f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.377+0000 7fa8e9d9b640 1 -- 172.21.15.71:0/1774019064 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc005040 con 0x7fa8ec0ff680 2024-09-10T10:02:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.377+0000 7fa8ea59c640 1 --2- 172.21.15.71:0/1774019064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8ec065c40 0x7fa8ec10f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:02:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.377+0000 7fa8e9d9b640 1 --2- 172.21.15.71:0/1774019064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8ec0ff680 0x7fa8ec10f7f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0002a50 tx=0x7fa8e0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.377+0000 7fa8daffd640 1 -- 172.21.15.71:0/1774019064 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8e0007c30 con 0x7fa8ec0ff680 2024-09-10T10:02:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.377+0000 7fa8daffd640 1 -- 172.21.15.71:0/1774019064 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa8e000f040 con 0x7fa8ec0ff680 2024-09-10T10:02:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.377+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1774019064 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ec1108f0 con 0x7fa8ec0ff680 2024-09-10T10:02:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.377+0000 7fa8daffd640 1 -- 172.21.15.71:0/1774019064 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8e000da90 con 0x7fa8ec0ff680 2024-09-10T10:02:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.377+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1774019064 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ec110e90 con 0x7fa8ec0ff680 2024-09-10T10:02:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.379+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1774019064 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ec0fa890 con 0x7fa8ec0ff680 2024-09-10T10:02:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.379+0000 7fa8daffd640 1 -- 172.21.15.71:0/1774019064 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fa8e000dc30 con 0x7fa8ec0ff680 2024-09-10T10:02:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.380+0000 7fa8daffd640 1 --2- 172.21.15.71:0/1774019064 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa8d406ed60 0x7fa8d4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.380+0000 7fa8ea59c640 1 --2- 172.21.15.71:0/1774019064 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa8d406ed60 0x7fa8d4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.380+0000 7fa8daffd640 1 -- 172.21.15.71:0/1774019064 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa8e008da20 con 0x7fa8ec0ff680 2024-09-10T10:02:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.380+0000 7fa8ea59c640 1 --2- 172.21.15.71:0/1774019064 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa8d406ed60 0x7fa8d4071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc007ac0 tx=0x7fa8dc035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.385+0000 7fa8daffd640 1 -- 172.21.15.71:0/1774019064 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa8e004d2a0 con 0x7fa8ec0ff680 2024-09-10T10:02:25.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:24 smithi107 ceph-mon[34215]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:25.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:24 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/2598684466' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:02:25.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.621+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1774019064 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa8ec105090 con 0x7fa8ec0ff680 2024-09-10T10:02:25.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.621+0000 7fa8daffd640 1 -- 172.21.15.71:0/1774019064 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa8e005ac30 con 0x7fa8ec0ff680 2024-09-10T10:02:25.623 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:02:25.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.623+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1774019064 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa8d406ed60 msgr2=0x7fa8d4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:25.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.623+0000 7fa8f0a24640 1 --2- 172.21.15.71:0/1774019064 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa8d406ed60 0x7fa8d4071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc007ac0 tx=0x7fa8dc035040 comp rx=0 tx=0).stop 2024-09-10T10:02:25.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.623+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1774019064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8ec0ff680 msgr2=0x7fa8ec10f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:25.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.623+0000 7fa8f0a24640 1 --2- 172.21.15.71:0/1774019064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8ec0ff680 0x7fa8ec10f7f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0002a50 tx=0x7fa8e0004600 comp rx=0 tx=0).stop 2024-09-10T10:02:25.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.623+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1774019064 shutdown_connections 2024-09-10T10:02:25.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.623+0000 7fa8f0a24640 1 --2- 172.21.15.71:0/1774019064 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fa8d406ed60 0x7fa8d4071210 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.623+0000 7fa8f0a24640 1 --2- 172.21.15.71:0/1774019064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8ec0ff680 0x7fa8ec10f7f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.623+0000 7fa8f0a24640 1 --2- 172.21.15.71:0/1774019064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8ec065c40 0x7fa8ec10f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:25.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.623+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1774019064 >> 172.21.15.71:0/1774019064 conn(0x7fa8ec0f6c10 msgr2=0x7fa8ec0fb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:25.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.624+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1774019064 shutdown_connections 2024-09-10T10:02:25.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:25.624+0000 7fa8f0a24640 1 -- 172.21.15.71:0/1774019064 wait complete. 2024-09-10T10:02:26.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:25 smithi071 ceph-mon[27559]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:26.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:25 smithi071 ceph-mon[27559]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T10:02:26.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:25 smithi071 ceph-mon[27559]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:26.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:25 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1977497509' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:02:26.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:25 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1774019064' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:02:26.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:25 smithi107 ceph-mon[34215]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:26.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:25 smithi107 ceph-mon[34215]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T10:02:26.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:25 smithi107 ceph-mon[34215]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:26.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:25 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1977497509' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:02:26.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:25 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1774019064' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:02:27.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:26 smithi071 ceph-mon[27559]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:27.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:26 smithi107 ceph-mon[34215]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:28.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:27 smithi071 ceph-mon[27559]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-10T10:02:28.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:27 smithi107 ceph-mon[34215]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-10T10:02:30.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:29 smithi071 ceph-mon[27559]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-10T10:02:30.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:02:30.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:29 smithi107 ceph-mon[34215]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-10T10:02:30.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:02:32.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:31 smithi071 ceph-mon[27559]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-10T10:02:32.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:31 smithi107 ceph-mon[34215]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-10T10:02:34.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:33 smithi071 ceph-mon[27559]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-10T10:02:34.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:33 smithi107 ceph-mon[34215]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-10T10:02:36.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:35 smithi071 ceph-mon[27559]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:02:36.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:35 smithi107 ceph-mon[34215]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:02:38.204 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:37 smithi071 ceph-mon[27559]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:02:38.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:37 smithi107 ceph-mon[34215]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:02:40.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:39 smithi071 ceph-mon[27559]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:02:40.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:39 smithi107 ceph-mon[34215]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:02:42.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:41 smithi071 ceph-mon[27559]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:02:42.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:41 smithi107 ceph-mon[34215]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:02:44.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:43 smithi071 ceph-mon[27559]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:02:44.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:43 smithi107 ceph-mon[34215]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:02:45.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:02:45.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:44 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:02:46.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:45 smithi071 ceph-mon[27559]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:02:46.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:45 smithi107 ceph-mon[34215]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:02:48.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:47 smithi071 ceph-mon[27559]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:02:48.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:47 smithi107 ceph-mon[34215]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:02:50.042 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:49 smithi071 ceph-mon[27559]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:02:50.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:49 smithi107 ceph-mon[34215]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:02:52.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:51 smithi071 ceph-mon[27559]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:02:52.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:51 smithi107 ceph-mon[34215]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:02:54.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:53 smithi071 ceph-mon[27559]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:02:54.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:53 smithi107 ceph-mon[34215]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:02:55.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.734+0000 7f56fe39e640 1 -- 172.21.15.71:0/1449688039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f80ff680 msgr2=0x7f56f8101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:55.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.734+0000 7f56fe39e640 1 --2- 172.21.15.71:0/1449688039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f80ff680 0x7f56f8101a60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0048d0 tx=0x7f56ec009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:55.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.734+0000 7f56fe39e640 1 -- 172.21.15.71:0/1449688039 shutdown_connections 2024-09-10T10:02:55.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.734+0000 7f56fe39e640 1 --2- 172.21.15.71:0/1449688039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f80ff680 0x7f56f8101a60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:55.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.734+0000 7f56fe39e640 1 --2- 172.21.15.71:0/1449688039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56f8065c40 0x7f56f80ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:55.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.734+0000 7f56fe39e640 1 -- 172.21.15.71:0/1449688039 >> 172.21.15.71:0/1449688039 conn(0x7f56f80f6c10 msgr2=0x7f56f80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:55.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.734+0000 7f56fe39e640 1 -- 172.21.15.71:0/1449688039 shutdown_connections 2024-09-10T10:02:55.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.734+0000 7f56fe39e640 1 -- 172.21.15.71:0/1449688039 wait complete. 2024-09-10T10:02:55.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.735+0000 7f56fe39e640 1 Processor -- start 2024-09-10T10:02:55.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.736+0000 7f56fe39e640 1 -- start start 2024-09-10T10:02:55.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.736+0000 7f56fe39e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56f8065c40 0x7f56f81137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:55.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.736+0000 7f56fe39e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8113d00 0x7f56f8114b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:55.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.736+0000 7f56fe39e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f81141c0 con 0x7f56f8113d00 2024-09-10T10:02:55.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.736+0000 7f56fe39e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8114300 con 0x7f56f8065c40 2024-09-10T10:02:55.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.736+0000 7f56f77fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8113d00 0x7f56f8114b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:55.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.736+0000 7f56f77fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8113d00 0x7f56f8114b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45608/0 (socket says 172.21.15.71:45608) 2024-09-10T10:02:55.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.736+0000 7f56f77fe640 1 -- 172.21.15.71:0/600587290 learned_addr learned my addr 172.21.15.71:0/600587290 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:55.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.736+0000 7f56f7fff640 1 --2- 172.21.15.71:0/600587290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56f8065c40 0x7f56f81137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:55.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.736+0000 7f56f77fe640 1 -- 172.21.15.71:0/600587290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56f8065c40 msgr2=0x7f56f81137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:55.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.736+0000 7f56f77fe640 1 --2- 172.21.15.71:0/600587290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56f8065c40 0x7f56f81137c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:55.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.736+0000 7f56f77fe640 1 -- 172.21.15.71:0/600587290 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e8005040 con 0x7f56f8113d00 2024-09-10T10:02:55.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.737+0000 7f56f77fe640 1 --2- 172.21.15.71:0/600587290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8113d00 0x7f56f8114b70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0048a0 tx=0x7f56ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:55.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.737+0000 7f56f4ff9640 1 -- 172.21.15.71:0/600587290 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56ec038070 con 0x7f56f8113d00 2024-09-10T10:02:55.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.737+0000 7f56fe39e640 1 -- 172.21.15.71:0/600587290 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ec005040 con 0x7f56f8113d00 2024-09-10T10:02:55.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.737+0000 7f56f4ff9640 1 -- 172.21.15.71:0/600587290 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f56ec004290 con 0x7f56f8113d00 2024-09-10T10:02:55.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.737+0000 7f56f4ff9640 1 -- 172.21.15.71:0/600587290 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56ec02c860 con 0x7f56f8113d00 2024-09-10T10:02:55.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.737+0000 7f56fe39e640 1 -- 172.21.15.71:0/600587290 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f81154c0 con 0x7f56f8113d00 2024-09-10T10:02:55.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.738+0000 7f56de7fc640 1 -- 172.21.15.71:0/600587290 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d8005210 con 0x7f56f8113d00 2024-09-10T10:02:55.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.740+0000 7f56f4ff9640 1 -- 172.21.15.71:0/600587290 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f56ec030020 con 0x7f56f8113d00 2024-09-10T10:02:55.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.740+0000 7f56f4ff9640 1 --2- 172.21.15.71:0/600587290 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f56e006ed60 0x7f56e0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:55.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.741+0000 7f56f4ff9640 1 -- 172.21.15.71:0/600587290 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f56ec0ae830 con 0x7f56f8113d00 2024-09-10T10:02:55.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.742+0000 7f56f7fff640 1 --2- 172.21.15.71:0/600587290 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f56e006ed60 0x7f56e0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:55.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.743+0000 7f56f7fff640 1 --2- 172.21.15.71:0/600587290 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f56e006ed60 0x7f56e0071210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56f80659a0 tx=0x7f56e800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:55.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:55.747+0000 7f56f4ff9640 1 -- 172.21.15.71:0/600587290 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f56ec07b980 con 0x7f56f8113d00 2024-09-10T10:02:56.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:55 smithi071 ceph-mon[27559]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:02:56.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.095+0000 7f56de7fc640 1 -- 172.21.15.71:0/600587290 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56d8000bc0 con 0x7f56e006ed60 2024-09-10T10:02:56.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.096+0000 7f56f4ff9640 1 -- 172.21.15.71:0/600587290 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f56d8000bc0 con 0x7f56e006ed60 2024-09-10T10:02:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.099+0000 7f56de7fc640 1 -- 172.21.15.71:0/600587290 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f56e006ed60 msgr2=0x7f56e0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.099+0000 7f56de7fc640 1 --2- 172.21.15.71:0/600587290 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f56e006ed60 0x7f56e0071210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56f80659a0 tx=0x7f56e800b040 comp rx=0 tx=0).stop 2024-09-10T10:02:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.099+0000 7f56de7fc640 1 -- 172.21.15.71:0/600587290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8113d00 msgr2=0x7f56f8114b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:56.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.099+0000 7f56de7fc640 1 --2- 172.21.15.71:0/600587290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8113d00 0x7f56f8114b70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0048a0 tx=0x7f56ec009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.099+0000 7f56de7fc640 1 -- 172.21.15.71:0/600587290 shutdown_connections 2024-09-10T10:02:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.099+0000 7f56de7fc640 1 --2- 172.21.15.71:0/600587290 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f56e006ed60 0x7f56e0071210 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.099+0000 7f56de7fc640 1 --2- 172.21.15.71:0/600587290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8113d00 0x7f56f8114b70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.099+0000 7f56de7fc640 1 --2- 172.21.15.71:0/600587290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56f8065c40 0x7f56f81137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.099+0000 7f56de7fc640 1 -- 172.21.15.71:0/600587290 >> 172.21.15.71:0/600587290 conn(0x7f56f80f6c10 msgr2=0x7f56f81062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.099+0000 7f56de7fc640 1 -- 172.21.15.71:0/600587290 shutdown_connections 2024-09-10T10:02:56.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.100+0000 7f56de7fc640 1 -- 172.21.15.71:0/600587290 wait complete. 2024-09-10T10:02:56.112 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:02:56.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.226+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/1661522141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bb40fdb70 msgr2=0x7f2bb40fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:56.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.226+0000 7f2bbaf9c640 1 --2- 172.21.15.71:0/1661522141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bb40fdb70 0x7f2bb40fdf80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80048d0 tx=0x7f2ba8009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.226+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/1661522141 shutdown_connections 2024-09-10T10:02:56.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.226+0000 7f2bbaf9c640 1 --2- 172.21.15.71:0/1661522141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bb40fe4c0 0x7f2bb40fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.226+0000 7f2bbaf9c640 1 --2- 172.21.15.71:0/1661522141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bb40fdb70 0x7f2bb40fdf80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.226+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/1661522141 >> 172.21.15.71:0/1661522141 conn(0x7f2bb40f6390 msgr2=0x7f2bb40f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:56.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.226+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/1661522141 shutdown_connections 2024-09-10T10:02:56.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.226+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/1661522141 wait complete. 2024-09-10T10:02:56.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.227+0000 7f2bbaf9c640 1 Processor -- start 2024-09-10T10:02:56.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.227+0000 7f2bbaf9c640 1 -- start start 2024-09-10T10:02:56.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.227+0000 7f2bbaf9c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bb40fe4c0 0x7f2bb410d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:56.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.228+0000 7f2bbaf9c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bb410d730 0x7f2bb410e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:56.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.228+0000 7f2bbaf9c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb410dbf0 con 0x7f2bb40fe4c0 2024-09-10T10:02:56.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.228+0000 7f2bbaf9c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb410dd30 con 0x7f2bb410d730 2024-09-10T10:02:56.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.228+0000 7f2bb8d38640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bb40fe4c0 0x7f2bb410d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:56.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.228+0000 7f2bb8d38640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bb40fe4c0 0x7f2bb410d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45614/0 (socket says 172.21.15.71:45614) 2024-09-10T10:02:56.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.228+0000 7f2bb8d38640 1 -- 172.21.15.71:0/2079224051 learned_addr learned my addr 172.21.15.71:0/2079224051 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:56.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.228+0000 7f2bb3fff640 1 --2- 172.21.15.71:0/2079224051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bb410d730 0x7f2bb410e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:56.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.228+0000 7f2bb3fff640 1 -- 172.21.15.71:0/2079224051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bb40fe4c0 msgr2=0x7f2bb410d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:56.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.228+0000 7f2bb3fff640 1 --2- 172.21.15.71:0/2079224051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bb40fe4c0 0x7f2bb410d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.228+0000 7f2bb3fff640 1 -- 172.21.15.71:0/2079224051 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba8005040 con 0x7f2bb410d730 2024-09-10T10:02:56.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.229+0000 7f2bb3fff640 1 --2- 172.21.15.71:0/2079224051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bb410d730 0x7f2bb410e5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4064eb0 tx=0x7f2ba0004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:56.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.229+0000 7f2bb17fa640 1 -- 172.21.15.71:0/2079224051 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba0002de0 con 0x7f2bb410d730 2024-09-10T10:02:56.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.229+0000 7f2bb17fa640 1 -- 172.21.15.71:0/2079224051 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2ba000f040 con 0x7f2bb410d730 2024-09-10T10:02:56.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.229+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/2079224051 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb410eba0 con 0x7f2bb410d730 2024-09-10T10:02:56.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.229+0000 7f2bb17fa640 1 -- 172.21.15.71:0/2079224051 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba0009550 con 0x7f2bb410d730 2024-09-10T10:02:56.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.229+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/2079224051 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb410f0c0 con 0x7f2bb410d730 2024-09-10T10:02:56.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.230+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/2079224051 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb40fa010 con 0x7f2bb410d730 2024-09-10T10:02:56.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.231+0000 7f2bb17fa640 1 -- 172.21.15.71:0/2079224051 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f2ba00097c0 con 0x7f2bb410d730 2024-09-10T10:02:56.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.232+0000 7f2bb17fa640 1 --2- 172.21.15.71:0/2079224051 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2ba406ee20 0x7f2ba40712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:56.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.232+0000 7f2bb17fa640 1 -- 172.21.15.71:0/2079224051 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2ba008df10 con 0x7f2bb410d730 2024-09-10T10:02:56.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.232+0000 7f2bb8d38640 1 --2- 172.21.15.71:0/2079224051 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2ba406ee20 0x7f2ba40712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:56.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.233+0000 7f2bb8d38640 1 --2- 172.21.15.71:0/2079224051 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2ba406ee20 0x7f2ba40712d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800b020 tx=0x7f2ba8035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:56.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.240+0000 7f2bb17fa640 1 -- 172.21.15.71:0/2079224051 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2ba005afc0 con 0x7f2bb410d730 2024-09-10T10:02:56.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:55 smithi107 ceph-mon[34215]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:02:56.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.594+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/2079224051 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bb41050d0 con 0x7f2ba406ee20 2024-09-10T10:02:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.596+0000 7f2bb17fa640 1 -- 172.21.15.71:0/2079224051 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f2bb41050d0 con 0x7f2ba406ee20 2024-09-10T10:02:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.598+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/2079224051 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2ba406ee20 msgr2=0x7f2ba40712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.598+0000 7f2bbaf9c640 1 --2- 172.21.15.71:0/2079224051 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2ba406ee20 0x7f2ba40712d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800b020 tx=0x7f2ba8035040 comp rx=0 tx=0).stop 2024-09-10T10:02:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.598+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/2079224051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bb410d730 msgr2=0x7f2bb410e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.598+0000 7f2bbaf9c640 1 --2- 172.21.15.71:0/2079224051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bb410d730 0x7f2bb410e5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4064eb0 tx=0x7f2ba0004570 comp rx=0 tx=0).stop 2024-09-10T10:02:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.599+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/2079224051 shutdown_connections 2024-09-10T10:02:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.599+0000 7f2bbaf9c640 1 --2- 172.21.15.71:0/2079224051 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f2ba406ee20 0x7f2ba40712d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.599+0000 7f2bbaf9c640 1 --2- 172.21.15.71:0/2079224051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bb410d730 0x7f2bb410e5a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.599+0000 7f2bbaf9c640 1 --2- 172.21.15.71:0/2079224051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2bb40fe4c0 0x7f2bb410d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.599+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/2079224051 >> 172.21.15.71:0/2079224051 conn(0x7f2bb40f6390 msgr2=0x7f2bb40f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:56.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.599+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/2079224051 shutdown_connections 2024-09-10T10:02:56.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.599+0000 7f2bbaf9c640 1 -- 172.21.15.71:0/2079224051 wait complete. 2024-09-10T10:02:56.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.725+0000 7fcdb14a8640 1 -- 172.21.15.71:0/1432564524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0fd7f0 msgr2=0x7fcdac0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:56.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.725+0000 7fcdb14a8640 1 --2- 172.21.15.71:0/1432564524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0fd7f0 0x7fcdac0fdc60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcda00048d0 tx=0x7fcda0009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.725+0000 7fcdb14a8640 1 -- 172.21.15.71:0/1432564524 shutdown_connections 2024-09-10T10:02:56.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.725+0000 7fcdb14a8640 1 --2- 172.21.15.71:0/1432564524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0fd7f0 0x7fcdac0fdc60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.725+0000 7fcdb14a8640 1 --2- 172.21.15.71:0/1432564524 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac0fc520 0x7fcdac0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.725+0000 7fcdb14a8640 1 -- 172.21.15.71:0/1432564524 >> 172.21.15.71:0/1432564524 conn(0x7fcdac0f7ce0 msgr2=0x7fcdac0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:56.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.725+0000 7fcdb14a8640 1 -- 172.21.15.71:0/1432564524 shutdown_connections 2024-09-10T10:02:56.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.725+0000 7fcdb14a8640 1 -- 172.21.15.71:0/1432564524 wait complete. 2024-09-10T10:02:56.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.726+0000 7fcdb14a8640 1 Processor -- start 2024-09-10T10:02:56.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.726+0000 7fcdb14a8640 1 -- start start 2024-09-10T10:02:56.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.726+0000 7fcdb14a8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0fc520 0x7fcdac071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:56.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.726+0000 7fcdb14a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac0fd7f0 0x7fcdac06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:56.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.727+0000 7fcdb14a8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac06fff0 con 0x7fcdac0fc520 2024-09-10T10:02:56.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.727+0000 7fcdb14a8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac070130 con 0x7fcdac0fd7f0 2024-09-10T10:02:56.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.727+0000 7fcdaaffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0fc520 0x7fcdac071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:56.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.727+0000 7fcdaaffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0fc520 0x7fcdac071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45638/0 (socket says 172.21.15.71:45638) 2024-09-10T10:02:56.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.727+0000 7fcdaaffd640 1 -- 172.21.15.71:0/2504269142 learned_addr learned my addr 172.21.15.71:0/2504269142 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:56.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.727+0000 7fcdaa7fc640 1 --2- 172.21.15.71:0/2504269142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac0fd7f0 0x7fcdac06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:56.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.727+0000 7fcdaaffd640 1 -- 172.21.15.71:0/2504269142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac0fd7f0 msgr2=0x7fcdac06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:56.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.727+0000 7fcdaaffd640 1 --2- 172.21.15.71:0/2504269142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac0fd7f0 0x7fcdac06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:56.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.727+0000 7fcdaaffd640 1 -- 172.21.15.71:0/2504269142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda0005040 con 0x7fcdac0fc520 2024-09-10T10:02:56.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.727+0000 7fcdaaffd640 1 --2- 172.21.15.71:0/2504269142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0fc520 0x7fcdac071570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00eb70 tx=0x7fcd9c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:56.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.728+0000 7fcd937fe640 1 -- 172.21.15.71:0/2504269142 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd9c007c30 con 0x7fcdac0fc520 2024-09-10T10:02:56.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.728+0000 7fcd937fe640 1 -- 172.21.15.71:0/2504269142 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcd9c00f040 con 0x7fcdac0fc520 2024-09-10T10:02:56.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.728+0000 7fcd937fe640 1 -- 172.21.15.71:0/2504269142 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd9c00ca60 con 0x7fcdac0fc520 2024-09-10T10:02:56.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.729+0000 7fcdb14a8640 1 -- 172.21.15.71:0/2504269142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac0703b0 con 0x7fcdac0fc520 2024-09-10T10:02:56.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.729+0000 7fcdb14a8640 1 -- 172.21.15.71:0/2504269142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac070810 con 0x7fcdac0fc520 2024-09-10T10:02:56.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.730+0000 7fcdb14a8640 1 -- 172.21.15.71:0/2504269142 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac04b720 con 0x7fcdac0fc520 2024-09-10T10:02:56.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.731+0000 7fcd937fe640 1 -- 172.21.15.71:0/2504269142 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fcd9c00cbc0 con 0x7fcdac0fc520 2024-09-10T10:02:56.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.732+0000 7fcd937fe640 1 --2- 172.21.15.71:0/2504269142 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fcd9406ee10 0x7fcd940712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:56.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.732+0000 7fcd937fe640 1 -- 172.21.15.71:0/2504269142 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcd9c08d7a0 con 0x7fcdac0fc520 2024-09-10T10:02:56.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.732+0000 7fcdaa7fc640 1 --2- 172.21.15.71:0/2504269142 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fcd9406ee10 0x7fcd940712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:56.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.732+0000 7fcdaa7fc640 1 --2- 172.21.15.71:0/2504269142 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fcd9406ee10 0x7fcd940712c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcda0000c00 tx=0x7fcda0035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:56.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:56.740+0000 7fcd937fe640 1 -- 172.21.15.71:0/2504269142 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcd9c05aa40 con 0x7fcdac0fc520 2024-09-10T10:02:57.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.073+0000 7fcdb14a8640 1 -- 172.21.15.71:0/2504269142 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdac101a30 con 0x7fcd9406ee10 2024-09-10T10:02:57.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.089+0000 7fcd937fe640 1 -- 172.21.15.71:0/2504269142 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fcdac101a30 con 0x7fcd9406ee10 2024-09-10T10:02:57.090 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:02:57.090 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (5m) 59s ago 6m 25.4M - 0.25.0 c8568f914cd2 b3a4270190ef 2024-09-10T10:02:57.090 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (6m) 59s ago 6m 6891k - 17.2.7-1597-g96d63e75 f3fc7d52e233 f70481a4c3c7 2024-09-10T10:02:57.090 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (6m) 65s ago 6m 6895k - 17.2.7-1597-g96d63e75 f3fc7d52e233 cf27ebcc0f98 2024-09-10T10:02:57.090 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (5m) 59s ago 6m 81.4M - 9.4.7 954c08fa6188 1998c9de2d92 2024-09-10T10:02:57.090 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (79s) 59s ago 78s 16.6M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:02:57.090 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (85s) 59s ago 84s 11.8M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:02:57.091 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (82s) 65s ago 82s 16.5M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:02:57.091 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (76s) 65s ago 76s 14.9M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:02:57.091 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:9283,8765,8443 running (8m) 59s ago 8m 449M - 17.2.7-1597-g96d63e75 f3fc7d52e233 dc0e497fa11e 2024-09-10T10:02:57.091 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283 running (5m) 65s ago 5m 401M - 17.2.7-1597-g96d63e75 f3fc7d52e233 d93840908437 2024-09-10T10:02:57.091 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (8m) 59s ago 8m 49.6M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 35e491e574a3 2024-09-10T10:02:57.091 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (5m) 65s ago 5m 35.7M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 682e2b6e311f 2024-09-10T10:02:57.091 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (6m) 59s ago 6m 16.1M - 1.5.0 0da6a335fe13 acc088fb47d4 2024-09-10T10:02:57.091 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (5m) 65s ago 5m 15.8M - 1.5.0 0da6a335fe13 12be03d3d11f 2024-09-10T10:02:57.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (5m) 59s ago 4m 46.5M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 a79e69c9b514 2024-09-10T10:02:57.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (4m) 59s ago 4m 44.4M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 44a84bf577da 2024-09-10T10:02:57.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (4m) 59s ago 4m 42.9M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 4fae52756a24 2024-09-10T10:02:57.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (3m) 65s ago 3m 47.1M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:02:57.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (3m) 65s ago 3m 42.6M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:02:57.092 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (2m) 65s ago 2m 42.0M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:02:57.092 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (5m) 59s ago 6m 56.1M - 2.43.0 a07b618ecd1d 1a619aeb5698 2024-09-10T10:02:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.091+0000 7fcdb14a8640 1 -- 172.21.15.71:0/2504269142 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fcd9406ee10 msgr2=0x7fcd940712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.091+0000 7fcdb14a8640 1 --2- 172.21.15.71:0/2504269142 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fcd9406ee10 0x7fcd940712c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcda0000c00 tx=0x7fcda0035040 comp rx=0 tx=0).stop 2024-09-10T10:02:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.091+0000 7fcdb14a8640 1 -- 172.21.15.71:0/2504269142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0fc520 msgr2=0x7fcdac071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.091+0000 7fcdb14a8640 1 --2- 172.21.15.71:0/2504269142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0fc520 0x7fcdac071570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00eb70 tx=0x7fcd9c00b040 comp rx=0 tx=0).stop 2024-09-10T10:02:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.091+0000 7fcdb14a8640 1 -- 172.21.15.71:0/2504269142 shutdown_connections 2024-09-10T10:02:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.091+0000 7fcdb14a8640 1 --2- 172.21.15.71:0/2504269142 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fcd9406ee10 0x7fcd940712c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.091+0000 7fcdb14a8640 1 --2- 172.21.15.71:0/2504269142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac0fd7f0 0x7fcdac06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.091+0000 7fcdb14a8640 1 --2- 172.21.15.71:0/2504269142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0fc520 0x7fcdac071570 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.091+0000 7fcdb14a8640 1 -- 172.21.15.71:0/2504269142 >> 172.21.15.71:0/2504269142 conn(0x7fcdac0f7ce0 msgr2=0x7fcdac0f92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.092+0000 7fcdb14a8640 1 -- 172.21.15.71:0/2504269142 shutdown_connections 2024-09-10T10:02:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.093+0000 7fcdb14a8640 1 -- 172.21.15.71:0/2504269142 wait complete. 2024-09-10T10:02:57.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.178+0000 7f971ad8b640 1 -- 172.21.15.71:0/202629381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9714065c40 msgr2=0x7f97140ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.178+0000 7f971ad8b640 1 --2- 172.21.15.71:0/202629381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9714065c40 0x7f97140ff140 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f97080048d0 tx=0x7f9708009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.178+0000 7f971ad8b640 1 -- 172.21.15.71:0/202629381 shutdown_connections 2024-09-10T10:02:57.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.178+0000 7f971ad8b640 1 --2- 172.21.15.71:0/202629381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97140ff680 0x7f9714101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.178+0000 7f971ad8b640 1 --2- 172.21.15.71:0/202629381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9714065c40 0x7f97140ff140 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.178+0000 7f971ad8b640 1 -- 172.21.15.71:0/202629381 >> 172.21.15.71:0/202629381 conn(0x7f97140f6c10 msgr2=0x7f97140f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:57.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.178+0000 7f971ad8b640 1 -- 172.21.15.71:0/202629381 shutdown_connections 2024-09-10T10:02:57.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.178+0000 7f971ad8b640 1 -- 172.21.15.71:0/202629381 wait complete. 2024-09-10T10:02:57.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.179+0000 7f971ad8b640 1 Processor -- start 2024-09-10T10:02:57.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.179+0000 7f971ad8b640 1 -- start start 2024-09-10T10:02:57.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.179+0000 7f971ad8b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9714065c40 0x7f971406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:57.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.179+0000 7f971ad8b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97140ff680 0x7f971406e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:57.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.179+0000 7f971ad8b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97140fcff0 con 0x7f9714065c40 2024-09-10T10:02:57.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.179+0000 7f971ad8b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971406f740 con 0x7f97140ff680 2024-09-10T10:02:57.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.179+0000 7f9718b27640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9714065c40 0x7f971406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:57.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.179+0000 7f9713fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97140ff680 0x7f971406e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:57.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.179+0000 7f9718b27640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9714065c40 0x7f971406dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45652/0 (socket says 172.21.15.71:45652) 2024-09-10T10:02:57.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.179+0000 7f9713fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97140ff680 0x7f971406e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.71:33080/0 (socket says 172.21.15.71:33080) 2024-09-10T10:02:57.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.179+0000 7f9718b27640 1 -- 172.21.15.71:0/4211386852 learned_addr learned my addr 172.21.15.71:0/4211386852 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:57.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.180+0000 7f9713fff640 1 -- 172.21.15.71:0/4211386852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9714065c40 msgr2=0x7f971406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.180+0000 7f9713fff640 1 --2- 172.21.15.71:0/4211386852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9714065c40 0x7f971406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.180+0000 7f9713fff640 1 -- 172.21.15.71:0/4211386852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9708005040 con 0x7f97140ff680 2024-09-10T10:02:57.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.180+0000 7f9713fff640 1 --2- 172.21.15.71:0/4211386852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97140ff680 0x7f971406e140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f970000eb40 tx=0x7f970000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:57.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.180+0000 7f97117fa640 1 -- 172.21.15.71:0/4211386852 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9700007c30 con 0x7f97140ff680 2024-09-10T10:02:57.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.180+0000 7f971ad8b640 1 -- 172.21.15.71:0/4211386852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971406e740 con 0x7f97140ff680 2024-09-10T10:02:57.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.180+0000 7f971ad8b640 1 -- 172.21.15.71:0/4211386852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9714119550 con 0x7f97140ff680 2024-09-10T10:02:57.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.180+0000 7f97117fa640 1 -- 172.21.15.71:0/4211386852 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f970000f040 con 0x7f97140ff680 2024-09-10T10:02:57.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.180+0000 7f97117fa640 1 -- 172.21.15.71:0/4211386852 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97000094b0 con 0x7f97140ff680 2024-09-10T10:02:57.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.182+0000 7f971ad8b640 1 -- 172.21.15.71:0/4211386852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f8005240 con 0x7f97140ff680 2024-09-10T10:02:57.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.183+0000 7f97117fa640 1 -- 172.21.15.71:0/4211386852 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f9700009610 con 0x7f97140ff680 2024-09-10T10:02:57.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.183+0000 7f97117fa640 1 --2- 172.21.15.71:0/4211386852 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f970406ed50 0x7f9704071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:57.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.183+0000 7f9718b27640 1 --2- 172.21.15.71:0/4211386852 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f970406ed50 0x7f9704071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:57.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.183+0000 7f97117fa640 1 -- 172.21.15.71:0/4211386852 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f970008dd20 con 0x7f97140ff680 2024-09-10T10:02:57.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.184+0000 7f9718b27640 1 --2- 172.21.15.71:0/4211386852 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f970406ed50 0x7f9704071200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9708000c00 tx=0x7f9708035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.191+0000 7f97117fa640 1 -- 172.21.15.71:0/4211386852 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f970005af20 con 0x7f97140ff680 2024-09-10T10:02:57.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.433+0000 7f971ad8b640 1 -- 172.21.15.71:0/4211386852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f96f8005d00 con 0x7f97140ff680 2024-09-10T10:02:57.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.434+0000 7f97117fa640 1 -- 172.21.15.71:0/4211386852 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f97000192a0 con 0x7f97140ff680 2024-09-10T10:02:57.436 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:02:57.436 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:02:57.436 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2 2024-09-10T10:02:57.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:02:57.436 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:02:57.436 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2 2024-09-10T10:02:57.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:02:57.436 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:02:57.436 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 6 2024-09-10T10:02:57.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:02:57.437 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:02:57.437 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:02:57.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:02:57.437 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:02:57.437 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 14 2024-09-10T10:02:57.437 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:02:57.437 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:02:57.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.436+0000 7f971ad8b640 1 -- 172.21.15.71:0/4211386852 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f970406ed50 msgr2=0x7f9704071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.436+0000 7f971ad8b640 1 --2- 172.21.15.71:0/4211386852 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f970406ed50 0x7f9704071200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9708000c00 tx=0x7f9708035040 comp rx=0 tx=0).stop 2024-09-10T10:02:57.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.436+0000 7f971ad8b640 1 -- 172.21.15.71:0/4211386852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97140ff680 msgr2=0x7f971406e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.436+0000 7f971ad8b640 1 --2- 172.21.15.71:0/4211386852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97140ff680 0x7f971406e140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f970000eb40 tx=0x7f970000b040 comp rx=0 tx=0).stop 2024-09-10T10:02:57.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.437+0000 7f971ad8b640 1 -- 172.21.15.71:0/4211386852 shutdown_connections 2024-09-10T10:02:57.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.437+0000 7f971ad8b640 1 --2- 172.21.15.71:0/4211386852 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f970406ed50 0x7f9704071200 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.437+0000 7f971ad8b640 1 --2- 172.21.15.71:0/4211386852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97140ff680 0x7f971406e140 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.437+0000 7f971ad8b640 1 --2- 172.21.15.71:0/4211386852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9714065c40 0x7f971406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.437+0000 7f971ad8b640 1 -- 172.21.15.71:0/4211386852 >> 172.21.15.71:0/4211386852 conn(0x7f97140f6c10 msgr2=0x7f97140f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:57.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.437+0000 7f971ad8b640 1 -- 172.21.15.71:0/4211386852 shutdown_connections 2024-09-10T10:02:57.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.437+0000 7f971ad8b640 1 -- 172.21.15.71:0/4211386852 wait complete. 2024-09-10T10:02:57.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.538+0000 7ff634ccc640 1 -- 172.21.15.71:0/1916230012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6300fc6f0 msgr2=0x7ff6300fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.538+0000 7ff634ccc640 1 --2- 172.21.15.71:0/1916230012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6300fc6f0 0x7ff6300fcb60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff6180048d0 tx=0x7ff618009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.539+0000 7ff634ccc640 1 -- 172.21.15.71:0/1916230012 shutdown_connections 2024-09-10T10:02:57.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.539+0000 7ff634ccc640 1 --2- 172.21.15.71:0/1916230012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6300fc6f0 0x7ff6300fcb60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.539+0000 7ff634ccc640 1 --2- 172.21.15.71:0/1916230012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6300fb420 0x7ff6300fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.539+0000 7ff634ccc640 1 -- 172.21.15.71:0/1916230012 >> 172.21.15.71:0/1916230012 conn(0x7ff6300f6c00 msgr2=0x7ff6300f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:57.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.539+0000 7ff634ccc640 1 -- 172.21.15.71:0/1916230012 shutdown_connections 2024-09-10T10:02:57.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.539+0000 7ff634ccc640 1 -- 172.21.15.71:0/1916230012 wait complete. 2024-09-10T10:02:57.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.540+0000 7ff634ccc640 1 Processor -- start 2024-09-10T10:02:57.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.540+0000 7ff634ccc640 1 -- start start 2024-09-10T10:02:57.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.540+0000 7ff634ccc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6300fb420 0x7ff63010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:57.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.540+0000 7ff634ccc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6300fc6f0 0x7ff63010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:57.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.541+0000 7ff634ccc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63010dbf0 con 0x7ff6300fb420 2024-09-10T10:02:57.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.541+0000 7ff634ccc640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63010e410 con 0x7ff6300fc6f0 2024-09-10T10:02:57.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.541+0000 7ff627fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6300fc6f0 0x7ff63010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:57.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.541+0000 7ff627fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6300fc6f0 0x7ff63010d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.71:33098/0 (socket says 172.21.15.71:33098) 2024-09-10T10:02:57.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.541+0000 7ff627fff640 1 -- 172.21.15.71:0/1606359257 learned_addr learned my addr 172.21.15.71:0/1606359257 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:57.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.541+0000 7ff62e59c640 1 --2- 172.21.15.71:0/1606359257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6300fb420 0x7ff63010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:57.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.541+0000 7ff627fff640 1 -- 172.21.15.71:0/1606359257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6300fb420 msgr2=0x7ff63010d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.542+0000 7ff627fff640 1 --2- 172.21.15.71:0/1606359257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6300fb420 0x7ff63010d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.542+0000 7ff627fff640 1 -- 172.21.15.71:0/1606359257 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff620005040 con 0x7ff6300fc6f0 2024-09-10T10:02:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.542+0000 7ff627fff640 1 --2- 172.21.15.71:0/1606359257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6300fc6f0 0x7ff63010d5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff6180048a0 tx=0x7ff618009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.542+0000 7ff626ffd640 1 -- 172.21.15.71:0/1606359257 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff618038070 con 0x7ff6300fc6f0 2024-09-10T10:02:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.542+0000 7ff626ffd640 1 -- 172.21.15.71:0/1606359257 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff618009800 con 0x7ff6300fc6f0 2024-09-10T10:02:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.542+0000 7ff626ffd640 1 -- 172.21.15.71:0/1606359257 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff61803e670 con 0x7ff6300fc6f0 2024-09-10T10:02:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.542+0000 7ff634ccc640 1 -- 172.21.15.71:0/1606359257 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff618005040 con 0x7ff6300fc6f0 2024-09-10T10:02:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.542+0000 7ff634ccc640 1 -- 172.21.15.71:0/1606359257 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63010ea50 con 0x7ff6300fc6f0 2024-09-10T10:02:57.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.544+0000 7ff634ccc640 1 -- 172.21.15.71:0/1606359257 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6300fa880 con 0x7ff6300fc6f0 2024-09-10T10:02:57.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.544+0000 7ff626ffd640 1 -- 172.21.15.71:0/1606359257 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff618030020 con 0x7ff6300fc6f0 2024-09-10T10:02:57.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.545+0000 7ff626ffd640 1 --2- 172.21.15.71:0/1606359257 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff61c06ed50 0x7ff61c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:57.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.545+0000 7ff626ffd640 1 -- 172.21.15.71:0/1606359257 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff6180ae250 con 0x7ff6300fc6f0 2024-09-10T10:02:57.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.546+0000 7ff62e59c640 1 --2- 172.21.15.71:0/1606359257 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff61c06ed50 0x7ff61c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:57.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.546+0000 7ff62e59c640 1 --2- 172.21.15.71:0/1606359257 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff61c06ed50 0x7ff61c071200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff620004aa0 tx=0x7ff62000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:57.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.553+0000 7ff626ffd640 1 -- 172.21.15.71:0/1606359257 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff61807b420 con 0x7ff6300fc6f0 2024-09-10T10:02:57.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.785+0000 7ff634ccc640 1 -- 172.21.15.71:0/1606359257 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff63004b720 con 0x7ff6300fc6f0 2024-09-10T10:02:57.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.785+0000 7ff626ffd640 1 -- 172.21.15.71:0/1606359257 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1832 (secure 0 0 0) 0x7ff61807adc0 con 0x7ff6300fc6f0 2024-09-10T10:02:57.788 INFO:teuthology.orchestra.run.smithi071.stdout:e20 2024-09-10T10:02:57.789 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:02:57.789 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:02:57.789 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:02:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:02:57.789 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:02:57.789 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:02:57.789 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 20 2024-09-10T10:02:57.789 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:02:57.789 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:02:57.789 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:01:46.701856+0000 2024-09-10T10:02:57.789 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:02:57.790 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:02:57.791 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:02:57.791 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:02:57.791 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:02:57.791 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:02:57.791 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:02:57.791 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:02:57.791 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:02:57.791 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:02:57.791 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:02:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:02:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:02:57.792 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 20 2024-09-10T10:02:57.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.788+0000 7ff634ccc640 1 -- 172.21.15.71:0/1606359257 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff61c06ed50 msgr2=0x7ff61c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.788+0000 7ff634ccc640 1 --2- 172.21.15.71:0/1606359257 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff61c06ed50 0x7ff61c071200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff620004aa0 tx=0x7ff62000b040 comp rx=0 tx=0).stop 2024-09-10T10:02:57.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.788+0000 7ff634ccc640 1 -- 172.21.15.71:0/1606359257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6300fc6f0 msgr2=0x7ff63010d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.788+0000 7ff634ccc640 1 --2- 172.21.15.71:0/1606359257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6300fc6f0 0x7ff63010d5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff6180048a0 tx=0x7ff618009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.788+0000 7ff634ccc640 1 -- 172.21.15.71:0/1606359257 shutdown_connections 2024-09-10T10:02:57.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.788+0000 7ff634ccc640 1 --2- 172.21.15.71:0/1606359257 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff61c06ed50 0x7ff61c071200 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.788+0000 7ff634ccc640 1 --2- 172.21.15.71:0/1606359257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6300fc6f0 0x7ff63010d5a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.788+0000 7ff634ccc640 1 --2- 172.21.15.71:0/1606359257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6300fb420 0x7ff63010d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.788+0000 7ff634ccc640 1 -- 172.21.15.71:0/1606359257 >> 172.21.15.71:0/1606359257 conn(0x7ff6300f6c00 msgr2=0x7ff6300f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:57.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.788+0000 7ff634ccc640 1 -- 172.21.15.71:0/1606359257 shutdown_connections 2024-09-10T10:02:57.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.788+0000 7ff634ccc640 1 -- 172.21.15.71:0/1606359257 wait complete. 2024-09-10T10:02:57.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.877+0000 7fbc563e7640 1 -- 172.21.15.71:0/647419209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50066410 msgr2=0x7fbc500ff1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.877+0000 7fbc563e7640 1 --2- 172.21.15.71:0/647419209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50066410 0x7fbc500ff1f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbc400048d0 tx=0x7fbc40009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.877+0000 7fbc563e7640 1 -- 172.21.15.71:0/647419209 shutdown_connections 2024-09-10T10:02:57.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.877+0000 7fbc563e7640 1 --2- 172.21.15.71:0/647419209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc500ff730 0x7fbc50101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.878+0000 7fbc563e7640 1 --2- 172.21.15.71:0/647419209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50066410 0x7fbc500ff1f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.878+0000 7fbc563e7640 1 -- 172.21.15.71:0/647419209 >> 172.21.15.71:0/647419209 conn(0x7fbc500f6c00 msgr2=0x7fbc500f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:57.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.878+0000 7fbc563e7640 1 -- 172.21.15.71:0/647419209 shutdown_connections 2024-09-10T10:02:57.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.878+0000 7fbc563e7640 1 -- 172.21.15.71:0/647419209 wait complete. 2024-09-10T10:02:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.878+0000 7fbc563e7640 1 Processor -- start 2024-09-10T10:02:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.879+0000 7fbc563e7640 1 -- start start 2024-09-10T10:02:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.879+0000 7fbc563e7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50066410 0x7fbc5010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.879+0000 7fbc563e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc500ff730 0x7fbc5010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.879+0000 7fbc563e7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5010dc10 con 0x7fbc50066410 2024-09-10T10:02:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.879+0000 7fbc563e7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5010e430 con 0x7fbc500ff730 2024-09-10T10:02:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.879+0000 7fbc4f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc500ff730 0x7fbc5010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.879+0000 7fbc4f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc500ff730 0x7fbc5010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.71:33114/0 (socket says 172.21.15.71:33114) 2024-09-10T10:02:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.879+0000 7fbc4f7fe640 1 -- 172.21.15.71:0/3602658784 learned_addr learned my addr 172.21.15.71:0/3602658784 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.879+0000 7fbc4ffff640 1 --2- 172.21.15.71:0/3602658784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50066410 0x7fbc5010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.880+0000 7fbc4f7fe640 1 -- 172.21.15.71:0/3602658784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50066410 msgr2=0x7fbc5010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.880+0000 7fbc4f7fe640 1 --2- 172.21.15.71:0/3602658784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50066410 0x7fbc5010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.880+0000 7fbc4f7fe640 1 -- 172.21.15.71:0/3602658784 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40005040 con 0x7fbc500ff730 2024-09-10T10:02:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.880+0000 7fbc4ffff640 1 --2- 172.21.15.71:0/3602658784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50066410 0x7fbc5010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:02:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.880+0000 7fbc4f7fe640 1 --2- 172.21.15.71:0/3602658784 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc500ff730 0x7fbc5010d5c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbc44002a50 tx=0x7fbc44004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.880+0000 7fbc4cff9640 1 -- 172.21.15.71:0/3602658784 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc44007c30 con 0x7fbc500ff730 2024-09-10T10:02:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.880+0000 7fbc4cff9640 1 -- 172.21.15.71:0/3602658784 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbc4400f040 con 0x7fbc500ff730 2024-09-10T10:02:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.880+0000 7fbc563e7640 1 -- 172.21.15.71:0/3602658784 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5010e6c0 con 0x7fbc500ff730 2024-09-10T10:02:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.880+0000 7fbc4cff9640 1 -- 172.21.15.71:0/3602658784 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc440094b0 con 0x7fbc500ff730 2024-09-10T10:02:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.880+0000 7fbc563e7640 1 -- 172.21.15.71:0/3602658784 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5010ec60 con 0x7fbc500ff730 2024-09-10T10:02:57.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.881+0000 7fbc563e7640 1 -- 172.21.15.71:0/3602658784 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc500fa880 con 0x7fbc500ff730 2024-09-10T10:02:57.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.882+0000 7fbc4cff9640 1 -- 172.21.15.71:0/3602658784 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fbc4400dc50 con 0x7fbc500ff730 2024-09-10T10:02:57.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.883+0000 7fbc4cff9640 1 --2- 172.21.15.71:0/3602658784 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fbc3806ed60 0x7fbc38071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:57.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.883+0000 7fbc4cff9640 1 -- 172.21.15.71:0/3602658784 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbc4408e060 con 0x7fbc500ff730 2024-09-10T10:02:57.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.883+0000 7fbc4ffff640 1 --2- 172.21.15.71:0/3602658784 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fbc3806ed60 0x7fbc38071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:57.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.884+0000 7fbc4ffff640 1 --2- 172.21.15.71:0/3602658784 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fbc3806ed60 0x7fbc38071210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbc40000c00 tx=0x7fbc40035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:57.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:57.891+0000 7fbc4cff9640 1 -- 172.21.15.71:0/3602658784 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbc4405b090 con 0x7fbc500ff730 2024-09-10T10:02:58.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.071+0000 7fbc563e7640 1 -- 172.21.15.71:0/3602658784 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc5010f000 con 0x7fbc3806ed60 2024-09-10T10:02:58.073 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:02:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", 2024-09-10T10:02:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:02:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:02:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-10T10:02:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "", 2024-09-10T10:02:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b image", 2024-09-10T10:02:58.074 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:02:58.074 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:02:58.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.072+0000 7fbc4cff9640 1 -- 172.21.15.71:0/3602658784 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fbc5010f000 con 0x7fbc3806ed60 2024-09-10T10:02:58.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.075+0000 7fbc563e7640 1 -- 172.21.15.71:0/3602658784 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fbc3806ed60 msgr2=0x7fbc38071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:58.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.075+0000 7fbc563e7640 1 --2- 172.21.15.71:0/3602658784 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fbc3806ed60 0x7fbc38071210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbc40000c00 tx=0x7fbc40035040 comp rx=0 tx=0).stop 2024-09-10T10:02:58.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.075+0000 7fbc563e7640 1 -- 172.21.15.71:0/3602658784 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc500ff730 msgr2=0x7fbc5010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:58.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.075+0000 7fbc563e7640 1 --2- 172.21.15.71:0/3602658784 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc500ff730 0x7fbc5010d5c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbc44002a50 tx=0x7fbc44004600 comp rx=0 tx=0).stop 2024-09-10T10:02:58.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.075+0000 7fbc563e7640 1 -- 172.21.15.71:0/3602658784 shutdown_connections 2024-09-10T10:02:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.075+0000 7fbc563e7640 1 --2- 172.21.15.71:0/3602658784 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fbc3806ed60 0x7fbc38071210 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.075+0000 7fbc563e7640 1 --2- 172.21.15.71:0/3602658784 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc500ff730 0x7fbc5010d5c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.075+0000 7fbc563e7640 1 --2- 172.21.15.71:0/3602658784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc50066410 0x7fbc5010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.075+0000 7fbc563e7640 1 -- 172.21.15.71:0/3602658784 >> 172.21.15.71:0/3602658784 conn(0x7fbc500f6c00 msgr2=0x7fbc500f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.075+0000 7fbc563e7640 1 -- 172.21.15.71:0/3602658784 shutdown_connections 2024-09-10T10:02:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.075+0000 7fbc563e7640 1 -- 172.21.15.71:0/3602658784 wait complete. 2024-09-10T10:02:58.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.155+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/3766343854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5d80fc6f0 msgr2=0x7fb5d80fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:58.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.155+0000 7fb5ddf7f640 1 --2- 172.21.15.71:0/3766343854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5d80fc6f0 0x7fb5d80fcb60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc0048d0 tx=0x7fb5cc009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:58.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.155+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/3766343854 shutdown_connections 2024-09-10T10:02:58.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.155+0000 7fb5ddf7f640 1 --2- 172.21.15.71:0/3766343854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5d80fc6f0 0x7fb5d80fcb60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:58.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.155+0000 7fb5ddf7f640 1 --2- 172.21.15.71:0/3766343854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5d80fb420 0x7fb5d80fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:58.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.155+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/3766343854 >> 172.21.15.71:0/3766343854 conn(0x7fb5d80f6c00 msgr2=0x7fb5d80f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:58.157 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:57 smithi071 ceph-mon[27559]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:58.157 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:57 smithi071 ceph-mon[27559]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:02:58.158 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:57 smithi071 ceph-mon[27559]: from='client.24339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:58.158 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:57 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/4211386852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:02:58.158 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:57 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1606359257' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:02:58.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.156+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/3766343854 shutdown_connections 2024-09-10T10:02:58.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.156+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/3766343854 wait complete. 2024-09-10T10:02:58.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.156+0000 7fb5ddf7f640 1 Processor -- start 2024-09-10T10:02:58.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.157+0000 7fb5ddf7f640 1 -- start start 2024-09-10T10:02:58.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.157+0000 7fb5ddf7f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5d80fb420 0x7fb5d806dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:58.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.157+0000 7fb5ddf7f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5d80fc6f0 0x7fb5d806e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:58.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.157+0000 7fb5d77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5d80fb420 0x7fb5d806dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:58.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.157+0000 7fb5d6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5d80fc6f0 0x7fb5d806e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.157+0000 7fb5d6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5d80fc6f0 0x7fb5d806e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45704/0 (socket says 172.21.15.71:45704) 2024-09-10T10:02:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.157+0000 7fb5d77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5d80fb420 0x7fb5d806dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.71:33126/0 (socket says 172.21.15.71:33126) 2024-09-10T10:02:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.157+0000 7fb5d6ffd640 1 -- 172.21.15.71:0/2216497808 learned_addr learned my addr 172.21.15.71:0/2216497808 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:02:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.157+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/2216497808 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d806f7c0 con 0x7fb5d80fc6f0 2024-09-10T10:02:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.157+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/2216497808 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d806e660 con 0x7fb5d80fb420 2024-09-10T10:02:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.158+0000 7fb5d6ffd640 1 -- 172.21.15.71:0/2216497808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5d80fb420 msgr2=0x7fb5d806dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.158+0000 7fb5d6ffd640 1 --2- 172.21.15.71:0/2216497808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5d80fb420 0x7fb5d806dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.158+0000 7fb5d6ffd640 1 -- 172.21.15.71:0/2216497808 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc005040 con 0x7fb5d80fc6f0 2024-09-10T10:02:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.158+0000 7fb5d6ffd640 1 --2- 172.21.15.71:0/2216497808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5d80fc6f0 0x7fb5d806e120 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc0043d0 tx=0x7fb5cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.158+0000 7fb5bffff640 1 -- 172.21.15.71:0/2216497808 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5cc02abd0 con 0x7fb5d80fc6f0 2024-09-10T10:02:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.158+0000 7fb5bffff640 1 -- 172.21.15.71:0/2216497808 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb5cc02ad30 con 0x7fb5d80fc6f0 2024-09-10T10:02:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.158+0000 7fb5bffff640 1 -- 172.21.15.71:0/2216497808 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5cc0386d0 con 0x7fb5d80fc6f0 2024-09-10T10:02:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.159+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/2216497808 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d806e8e0 con 0x7fb5d80fc6f0 2024-09-10T10:02:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.159+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/2216497808 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d8065a30 con 0x7fb5d80fc6f0 2024-09-10T10:02:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.160+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/2216497808 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d80fa880 con 0x7fb5d80fc6f0 2024-09-10T10:02:58.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.161+0000 7fb5bffff640 1 -- 172.21.15.71:0/2216497808 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb5cc030020 con 0x7fb5d80fc6f0 2024-09-10T10:02:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.162+0000 7fb5bffff640 1 --2- 172.21.15.71:0/2216497808 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb5c006ee10 0x7fb5c00712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.162+0000 7fb5bffff640 1 -- 172.21.15.71:0/2216497808 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb5cc0b2630 con 0x7fb5d80fc6f0 2024-09-10T10:02:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.162+0000 7fb5d77fe640 1 --2- 172.21.15.71:0/2216497808 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb5c006ee10 0x7fb5c00712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.163+0000 7fb5d77fe640 1 --2- 172.21.15.71:0/2216497808 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb5c006ee10 0x7fb5c00712c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb5d806f4a0 tx=0x7fb5c800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:58.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.166+0000 7fb5bffff640 1 -- 172.21.15.71:0/2216497808 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb5cc07f8d0 con 0x7fb5d80fc6f0 2024-09-10T10:02:58.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:57 smithi107 ceph-mon[34215]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:58.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:57 smithi107 ceph-mon[34215]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:02:58.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:57 smithi107 ceph-mon[34215]: from='client.24339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:58.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:57 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/4211386852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:02:58.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:57 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1606359257' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:02:58.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.404+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/2216497808 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb5d8065da0 con 0x7fb5d80fc6f0 2024-09-10T10:02:58.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.404+0000 7fb5bffff640 1 -- 172.21.15.71:0/2216497808 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb5cc07f270 con 0x7fb5d80fc6f0 2024-09-10T10:02:58.405 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:02:58.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.406+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/2216497808 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb5c006ee10 msgr2=0x7fb5c00712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:58.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.406+0000 7fb5ddf7f640 1 --2- 172.21.15.71:0/2216497808 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb5c006ee10 0x7fb5c00712c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb5d806f4a0 tx=0x7fb5c800b040 comp rx=0 tx=0).stop 2024-09-10T10:02:58.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.406+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/2216497808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5d80fc6f0 msgr2=0x7fb5d806e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:58.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.406+0000 7fb5ddf7f640 1 --2- 172.21.15.71:0/2216497808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5d80fc6f0 0x7fb5d806e120 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc0043d0 tx=0x7fb5cc009da0 comp rx=0 tx=0).stop 2024-09-10T10:02:58.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.406+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/2216497808 shutdown_connections 2024-09-10T10:02:58.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.406+0000 7fb5ddf7f640 1 --2- 172.21.15.71:0/2216497808 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fb5c006ee10 0x7fb5c00712c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:58.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.406+0000 7fb5ddf7f640 1 --2- 172.21.15.71:0/2216497808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5d80fc6f0 0x7fb5d806e120 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:58.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.406+0000 7fb5ddf7f640 1 --2- 172.21.15.71:0/2216497808 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5d80fb420 0x7fb5d806dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:58.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.407+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/2216497808 >> 172.21.15.71:0/2216497808 conn(0x7fb5d80f6c00 msgr2=0x7fb5d80f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:58.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.407+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/2216497808 shutdown_connections 2024-09-10T10:02:58.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:02:58.407+0000 7fb5ddf7f640 1 -- 172.21.15.71:0/2216497808 wait complete. 2024-09-10T10:02:59.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:58 smithi071 ceph-mon[27559]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:59.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:58 smithi071 ceph-mon[27559]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:59.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:02:59.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:59.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:02:59.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:58 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/2216497808' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:02:59.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:58 smithi107 ceph-mon[34215]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:59.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:58 smithi107 ceph-mon[34215]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:59.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:02:59.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:59.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:02:59.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:58 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/2216497808' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:03:00.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:59 smithi071 ceph-mon[27559]: Upgrade: Target is version 19.1.1-305-g1cf819b7 (unknown) 2024-09-10T10:03:00.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:59 smithi071 ceph-mon[27559]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559'] 2024-09-10T10:03:00.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:59 smithi071 ceph-mon[27559]: Upgrade: Need to upgrade myself (mgr.smithi071.gtqytr) 2024-09-10T10:03:00.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:59 smithi071 ceph-mon[27559]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:03:00.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:59 smithi071 ceph-mon[27559]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 on smithi107 2024-09-10T10:03:00.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:02:59 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:03:00.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:59 smithi107 ceph-mon[34215]: Upgrade: Target is version 19.1.1-305-g1cf819b7 (unknown) 2024-09-10T10:03:00.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:59 smithi107 ceph-mon[34215]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559'] 2024-09-10T10:03:00.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:59 smithi107 ceph-mon[34215]: Upgrade: Need to upgrade myself (mgr.smithi071.gtqytr) 2024-09-10T10:03:00.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:59 smithi107 ceph-mon[34215]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:03:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:59 smithi107 ceph-mon[34215]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 on smithi107 2024-09-10T10:03:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:02:59 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:03:01.980 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:01 smithi107 ceph-mon[34215]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:03:02.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:01 smithi071 ceph-mon[27559]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:03:04.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:03 smithi071 ceph-mon[27559]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:03:04.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:03 smithi107 ceph-mon[34215]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:03:06.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:05 smithi071 ceph-mon[27559]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:03:06.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:05 smithi107 ceph-mon[34215]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:03:08.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:07 smithi071 ceph-mon[27559]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:03:08.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:07 smithi107 ceph-mon[34215]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:03:10.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:09 smithi071 ceph-mon[27559]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:03:10.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:09 smithi107 ceph-mon[34215]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:03:12.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:11 smithi071 ceph-mon[27559]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:03:12.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:11 smithi107 ceph-mon[34215]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:03:13.881 INFO:tasks.workunit.client.1.smithi107.stderr:Updating files: 87% (11173/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-10T10:03:14.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:13 smithi071 ceph-mon[27559]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:03:14.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:13 smithi107 ceph-mon[34215]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:03:14.800 INFO:tasks.workunit.client.1.smithi107.stderr:Note: switching to '1cf819b7212a6048e92fc78c4eff963344f6d56b'. 2024-09-10T10:03:14.800 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-09-10T10:03:14.800 INFO:tasks.workunit.client.1.smithi107.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T10:03:14.800 INFO:tasks.workunit.client.1.smithi107.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T10:03:14.800 INFO:tasks.workunit.client.1.smithi107.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T10:03:14.800 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-09-10T10:03:14.801 INFO:tasks.workunit.client.1.smithi107.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T10:03:14.801 INFO:tasks.workunit.client.1.smithi107.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T10:03:14.801 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-09-10T10:03:14.801 INFO:tasks.workunit.client.1.smithi107.stderr: git switch -c 2024-09-10T10:03:14.801 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-09-10T10:03:14.801 INFO:tasks.workunit.client.1.smithi107.stderr:Or undo this operation with: 2024-09-10T10:03:14.801 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-09-10T10:03:14.801 INFO:tasks.workunit.client.1.smithi107.stderr: git switch - 2024-09-10T10:03:14.801 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-09-10T10:03:14.801 INFO:tasks.workunit.client.1.smithi107.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T10:03:14.802 INFO:tasks.workunit.client.1.smithi107.stderr: 2024-09-10T10:03:14.802 INFO:tasks.workunit.client.1.smithi107.stderr:HEAD is now at 1cf819b7212 Merge PR #59672 into wip-rishabh-testing-20240909.165402-squid 2024-09-10T10:03:14.806 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-10T10:03:14.877 INFO:tasks.workunit.client.1.smithi107.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T10:03:14.879 INFO:tasks.workunit.client.1.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-10T10:03:14.879 INFO:tasks.workunit.client.1.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T10:03:15.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:03:15.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:03:15.599 INFO:tasks.workunit.client.1.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T10:03:15.673 INFO:tasks.workunit.client.1.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T10:03:15.716 INFO:tasks.workunit.client.1.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-10T10:03:15.718 INFO:tasks.workunit.client.1.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-10T10:03:15.718 INFO:tasks.workunit.client.1.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T10:03:15.760 INFO:tasks.workunit.client.1.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-10T10:03:15.763 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-10T10:03:15.764 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-10T10:03:15.821 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-10T10:03:15.823 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-10T10:03:15.823 DEBUG:teuthology.orchestra.run.smithi107:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-10T10:03:15.890 INFO:tasks.workunit.client.1.smithi107.stderr:+ mkdir -p fsstress 2024-09-10T10:03:15.893 INFO:tasks.workunit.client.1.smithi107.stderr:+ pushd fsstress 2024-09-10T10:03:15.894 INFO:tasks.workunit.client.1.smithi107.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-10T10:03:15.894 INFO:tasks.workunit.client.1.smithi107.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-10T10:03:16.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:15 smithi071 ceph-mon[27559]: pgmap v228: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:03:16.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:15 smithi107 ceph-mon[34215]: pgmap v228: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:03:16.465 INFO:tasks.workunit.client.1.smithi107.stderr:+ tar xzf ltp-full.tgz 2024-09-10T10:03:17.246 INFO:tasks.workunit.client.0.smithi071.stderr:Updating files: 89% (11425/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-10T10:03:17.858 INFO:tasks.workunit.client.0.smithi071.stderr:Note: switching to '1cf819b7212a6048e92fc78c4eff963344f6d56b'. 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr: git switch -c 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr:Or undo this operation with: 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr: git switch - 2024-09-10T10:03:17.859 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-10T10:03:17.860 INFO:tasks.workunit.client.0.smithi071.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T10:03:17.860 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-10T10:03:17.860 INFO:tasks.workunit.client.0.smithi071.stderr:HEAD is now at 1cf819b7212 Merge PR #59672 into wip-rishabh-testing-20240909.165402-squid 2024-09-10T10:03:17.865 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T10:03:17.945 INFO:tasks.workunit.client.0.smithi071.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T10:03:17.947 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T10:03:17.947 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T10:03:18.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:17 smithi071 ceph-mon[27559]: pgmap v229: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:03:18.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:17 smithi107 ceph-mon[34215]: pgmap v229: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:03:20.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:20 smithi071 ceph-mon[27559]: pgmap v230: 65 pgs: 65 active+clean; 12 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 959 KiB/s wr, 20 op/s 2024-09-10T10:03:20.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:20 smithi107 ceph-mon[34215]: pgmap v230: 65 pgs: 65 active+clean; 12 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 959 KiB/s wr, 20 op/s 2024-09-10T10:03:22.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:22 smithi071 ceph-mon[27559]: pgmap v231: 65 pgs: 65 active+clean; 14 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 105 KiB/s rd, 1.1 MiB/s wr, 47 op/s 2024-09-10T10:03:22.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:22 smithi107 ceph-mon[34215]: pgmap v231: 65 pgs: 65 active+clean; 14 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 105 KiB/s rd, 1.1 MiB/s wr, 47 op/s 2024-09-10T10:03:22.989 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T10:03:23.079 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T10:03:23.124 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T10:03:23.126 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T10:03:23.127 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T10:03:23.176 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T10:03:23.180 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T10:03:23.180 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T10:03:23.198 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-10T10:03:23.200 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-10T10:03:23.200 DEBUG:teuthology.orchestra.run.smithi071:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-10T10:03:23.268 INFO:tasks.workunit.client.0.smithi071.stderr:+ mkdir -p fsstress 2024-09-10T10:03:23.272 INFO:tasks.workunit.client.0.smithi071.stderr:+ pushd fsstress 2024-09-10T10:03:23.273 INFO:tasks.workunit.client.0.smithi071.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-10T10:03:23.273 INFO:tasks.workunit.client.0.smithi071.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-10T10:03:23.832 INFO:tasks.workunit.client.0.smithi071.stderr:+ tar xzf ltp-full.tgz 2024-09-10T10:03:24.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:24 smithi071 ceph-mon[27559]: pgmap v232: 65 pgs: 65 active+clean; 16 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 104 KiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-09-10T10:03:24.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:24 smithi107 ceph-mon[34215]: pgmap v232: 65 pgs: 65 active+clean; 16 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 104 KiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-09-10T10:03:25.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:25 smithi071 ceph-mon[27559]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:03:25.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:25 smithi107 ceph-mon[34215]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:03:26.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:26 smithi071 ceph-mon[27559]: pgmap v233: 65 pgs: 65 active+clean; 23 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s rd, 2.0 MiB/s wr, 159 op/s 2024-09-10T10:03:26.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:26 smithi107 ceph-mon[34215]: pgmap v233: 65 pgs: 65 active+clean; 23 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s rd, 2.0 MiB/s wr, 159 op/s 2024-09-10T10:03:28.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:28 smithi071 ceph-mon[27559]: pgmap v234: 65 pgs: 65 active+clean; 30 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 2.5 MiB/s wr, 210 op/s 2024-09-10T10:03:28.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:28 smithi107 ceph-mon[34215]: pgmap v234: 65 pgs: 65 active+clean; 30 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 2.5 MiB/s wr, 210 op/s 2024-09-10T10:03:28.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.514+0000 7f8e751c6640 1 -- 172.21.15.71:0/2396346782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e700fb430 msgr2=0x7f8e700fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:28.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.514+0000 7f8e751c6640 1 --2- 172.21.15.71:0/2396346782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e700fb430 0x7f8e700fb840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8e600048d0 tx=0x7f8e60009da0 comp rx=0 tx=0).stop 2024-09-10T10:03:28.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.514+0000 7f8e751c6640 1 -- 172.21.15.71:0/2396346782 shutdown_connections 2024-09-10T10:03:28.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.514+0000 7f8e751c6640 1 --2- 172.21.15.71:0/2396346782 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e700fc700 0x7f8e700fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.514+0000 7f8e751c6640 1 --2- 172.21.15.71:0/2396346782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e700fb430 0x7f8e700fb840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.514+0000 7f8e751c6640 1 -- 172.21.15.71:0/2396346782 >> 172.21.15.71:0/2396346782 conn(0x7f8e700f6c10 msgr2=0x7f8e700f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.514+0000 7f8e751c6640 1 -- 172.21.15.71:0/2396346782 shutdown_connections 2024-09-10T10:03:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.514+0000 7f8e751c6640 1 -- 172.21.15.71:0/2396346782 wait complete. 2024-09-10T10:03:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.515+0000 7f8e751c6640 1 Processor -- start 2024-09-10T10:03:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.515+0000 7f8e751c6640 1 -- start start 2024-09-10T10:03:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.515+0000 7f8e751c6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e700fb430 0x7f8e7010fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.515+0000 7f8e751c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e700fc700 0x7f8e70112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.515+0000 7f8e751c6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70065c60 con 0x7f8e700fc700 2024-09-10T10:03:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.515+0000 7f8e751c6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70065dd0 con 0x7f8e700fb430 2024-09-10T10:03:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.515+0000 7f8e6e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e700fc700 0x7f8e70112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.515+0000 7f8e6e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e700fc700 0x7f8e70112300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45782/0 (socket says 172.21.15.71:45782) 2024-09-10T10:03:28.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.515+0000 7f8e6e59c640 1 -- 172.21.15.71:0/80155020 learned_addr learned my addr 172.21.15.71:0/80155020 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:03:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.516+0000 7f8e6ed9d640 1 --2- 172.21.15.71:0/80155020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e700fb430 0x7f8e7010fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.516+0000 7f8e6e59c640 1 -- 172.21.15.71:0/80155020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e700fb430 msgr2=0x7f8e7010fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.516+0000 7f8e6e59c640 1 --2- 172.21.15.71:0/80155020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e700fb430 0x7f8e7010fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.516+0000 7f8e6e59c640 1 -- 172.21.15.71:0/80155020 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e60005040 con 0x7f8e700fc700 2024-09-10T10:03:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.516+0000 7f8e6ed9d640 1 --2- 172.21.15.71:0/80155020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e700fb430 0x7f8e7010fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:03:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.516+0000 7f8e6e59c640 1 --2- 172.21.15.71:0/80155020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e700fc700 0x7f8e70112300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8e64004e80 tx=0x7f8e6400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.516+0000 7f8e577fe640 1 -- 172.21.15.71:0/80155020 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e64007e10 con 0x7f8e700fc700 2024-09-10T10:03:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.516+0000 7f8e577fe640 1 -- 172.21.15.71:0/80155020 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8e6400f040 con 0x7f8e700fc700 2024-09-10T10:03:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.516+0000 7f8e577fe640 1 -- 172.21.15.71:0/80155020 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e6400cc10 con 0x7f8e700fc700 2024-09-10T10:03:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.516+0000 7f8e751c6640 1 -- 172.21.15.71:0/80155020 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7010bb90 con 0x7f8e700fc700 2024-09-10T10:03:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.517+0000 7f8e751c6640 1 -- 172.21.15.71:0/80155020 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7010c0b0 con 0x7f8e700fc700 2024-09-10T10:03:28.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.518+0000 7f8e751c6640 1 -- 172.21.15.71:0/80155020 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7004b720 con 0x7f8e700fc700 2024-09-10T10:03:28.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.518+0000 7f8e577fe640 1 -- 172.21.15.71:0/80155020 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8e640090d0 con 0x7f8e700fc700 2024-09-10T10:03:28.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.519+0000 7f8e577fe640 1 --2- 172.21.15.71:0/80155020 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8e5806ed60 0x7f8e58071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:28.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.519+0000 7f8e577fe640 1 -- 172.21.15.71:0/80155020 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8e640920d0 con 0x7f8e700fc700 2024-09-10T10:03:28.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.519+0000 7f8e6ed9d640 1 --2- 172.21.15.71:0/80155020 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8e5806ed60 0x7f8e58071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:28.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.520+0000 7f8e6ed9d640 1 --2- 172.21.15.71:0/80155020 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8e5806ed60 0x7f8e58071210 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009af0 tx=0x7f8e60035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:28.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.527+0000 7f8e577fe640 1 -- 172.21.15.71:0/80155020 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8e6405f220 con 0x7f8e700fc700 2024-09-10T10:03:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.751+0000 7f8e751c6640 1 -- 172.21.15.71:0/80155020 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e70100b60 con 0x7f8e5806ed60 2024-09-10T10:03:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.753+0000 7f8e577fe640 1 -- 172.21.15.71:0/80155020 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f8e70100b60 con 0x7f8e5806ed60 2024-09-10T10:03:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.756+0000 7f8e751c6640 1 -- 172.21.15.71:0/80155020 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8e5806ed60 msgr2=0x7f8e58071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.756+0000 7f8e751c6640 1 --2- 172.21.15.71:0/80155020 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8e5806ed60 0x7f8e58071210 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009af0 tx=0x7f8e60035040 comp rx=0 tx=0).stop 2024-09-10T10:03:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.756+0000 7f8e751c6640 1 -- 172.21.15.71:0/80155020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e700fc700 msgr2=0x7f8e70112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.756+0000 7f8e751c6640 1 --2- 172.21.15.71:0/80155020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e700fc700 0x7f8e70112300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8e64004e80 tx=0x7f8e6400b040 comp rx=0 tx=0).stop 2024-09-10T10:03:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.756+0000 7f8e751c6640 1 -- 172.21.15.71:0/80155020 shutdown_connections 2024-09-10T10:03:28.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.756+0000 7f8e751c6640 1 --2- 172.21.15.71:0/80155020 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8e5806ed60 0x7f8e58071210 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:28.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.756+0000 7f8e751c6640 1 --2- 172.21.15.71:0/80155020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e700fc700 0x7f8e70112300 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:28.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.756+0000 7f8e751c6640 1 --2- 172.21.15.71:0/80155020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e700fb430 0x7f8e7010fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:28.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.756+0000 7f8e751c6640 1 -- 172.21.15.71:0/80155020 >> 172.21.15.71:0/80155020 conn(0x7f8e700f6c10 msgr2=0x7f8e700f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:28.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.757+0000 7f8e751c6640 1 -- 172.21.15.71:0/80155020 shutdown_connections 2024-09-10T10:03:28.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.757+0000 7f8e751c6640 1 -- 172.21.15.71:0/80155020 wait complete. 2024-09-10T10:03:28.768 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:03:28.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.870+0000 7f10cf08f640 1 -- 172.21.15.71:0/1287125284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c80fc700 msgr2=0x7f10c80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:28.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.870+0000 7f10cf08f640 1 --2- 172.21.15.71:0/1287125284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c80fc700 0x7f10c80fcb70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f10b4004810 tx=0x7f10b4009da0 comp rx=0 tx=0).stop 2024-09-10T10:03:28.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.870+0000 7f10cf08f640 1 -- 172.21.15.71:0/1287125284 shutdown_connections 2024-09-10T10:03:28.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.870+0000 7f10cf08f640 1 --2- 172.21.15.71:0/1287125284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c80fc700 0x7f10c80fcb70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:28.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.870+0000 7f10cf08f640 1 --2- 172.21.15.71:0/1287125284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10c80fb430 0x7f10c80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:28.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.870+0000 7f10cf08f640 1 -- 172.21.15.71:0/1287125284 >> 172.21.15.71:0/1287125284 conn(0x7f10c80f6c10 msgr2=0x7f10c80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:28.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.870+0000 7f10cf08f640 1 -- 172.21.15.71:0/1287125284 shutdown_connections 2024-09-10T10:03:28.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.870+0000 7f10cf08f640 1 -- 172.21.15.71:0/1287125284 wait complete. 2024-09-10T10:03:28.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.871+0000 7f10cf08f640 1 Processor -- start 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.871+0000 7f10cf08f640 1 -- start start 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.871+0000 7f10cf08f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10c80fb430 0x7f10c80ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.871+0000 7f10cf08f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c80fc700 0x7f10c80fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.871+0000 7f10cf08f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c80fdfd0 con 0x7f10c80fc700 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.871+0000 7f10cf08f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c80fe110 con 0x7f10c80fb430 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.872+0000 7f10c7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c80fc700 0x7f10c80fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.872+0000 7f10cce2b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10c80fb430 0x7f10c80ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.872+0000 7f10c7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c80fc700 0x7f10c80fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45796/0 (socket says 172.21.15.71:45796) 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.872+0000 7f10c7fff640 1 -- 172.21.15.71:0/786280583 learned_addr learned my addr 172.21.15.71:0/786280583 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.872+0000 7f10c7fff640 1 -- 172.21.15.71:0/786280583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10c80fb430 msgr2=0x7f10c80ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.872+0000 7f10c7fff640 1 --2- 172.21.15.71:0/786280583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10c80fb430 0x7f10c80ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.872+0000 7f10c7fff640 1 -- 172.21.15.71:0/786280583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b4005040 con 0x7f10c80fc700 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.872+0000 7f10cce2b640 1 --2- 172.21.15.71:0/786280583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10c80fb430 0x7f10c80ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:03:28.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.872+0000 7f10c7fff640 1 --2- 172.21.15.71:0/786280583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c80fc700 0x7f10c80fda40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f10b400b020 tx=0x7f10b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:28.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.873+0000 7f10c57fa640 1 -- 172.21.15.71:0/786280583 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b4038070 con 0x7f10c80fc700 2024-09-10T10:03:28.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.873+0000 7f10c57fa640 1 -- 172.21.15.71:0/786280583 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f10b4009700 con 0x7f10c80fc700 2024-09-10T10:03:28.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.873+0000 7f10cf08f640 1 -- 172.21.15.71:0/786280583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c80fe390 con 0x7f10c80fc700 2024-09-10T10:03:28.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.873+0000 7f10c57fa640 1 -- 172.21.15.71:0/786280583 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b403c670 con 0x7f10c80fc700 2024-09-10T10:03:28.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.873+0000 7f10cf08f640 1 -- 172.21.15.71:0/786280583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c81150d0 con 0x7f10c80fc700 2024-09-10T10:03:28.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.874+0000 7f10cf08f640 1 -- 172.21.15.71:0/786280583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c80fa890 con 0x7f10c80fc700 2024-09-10T10:03:28.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.875+0000 7f10c57fa640 1 -- 172.21.15.71:0/786280583 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f10b4030020 con 0x7f10c80fc700 2024-09-10T10:03:28.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.876+0000 7f10c57fa640 1 --2- 172.21.15.71:0/786280583 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f10b806eda0 0x7f10b8071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:28.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.876+0000 7f10c57fa640 1 -- 172.21.15.71:0/786280583 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f10b40ae230 con 0x7f10c80fc700 2024-09-10T10:03:28.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.876+0000 7f10cce2b640 1 --2- 172.21.15.71:0/786280583 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f10b806eda0 0x7f10b8071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:28.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.877+0000 7f10cce2b640 1 --2- 172.21.15.71:0/786280583 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f10b806eda0 0x7f10b8071250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f10c80ff300 tx=0x7f10bc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:28.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:28.880+0000 7f10c57fa640 1 -- 172.21.15.71:0/786280583 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f10b407b420 con 0x7f10c80fc700 2024-09-10T10:03:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.132+0000 7f10cf08f640 1 -- 172.21.15.71:0/786280583 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f10c8103f60 con 0x7f10b806eda0 2024-09-10T10:03:29.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.133+0000 7f10c57fa640 1 -- 172.21.15.71:0/786280583 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f10c8103f60 con 0x7f10b806eda0 2024-09-10T10:03:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.136+0000 7f10cf08f640 1 -- 172.21.15.71:0/786280583 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f10b806eda0 msgr2=0x7f10b8071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.136+0000 7f10cf08f640 1 --2- 172.21.15.71:0/786280583 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f10b806eda0 0x7f10b8071250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f10c80ff300 tx=0x7f10bc00b040 comp rx=0 tx=0).stop 2024-09-10T10:03:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.136+0000 7f10cf08f640 1 -- 172.21.15.71:0/786280583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c80fc700 msgr2=0x7f10c80fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.136+0000 7f10cf08f640 1 --2- 172.21.15.71:0/786280583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c80fc700 0x7f10c80fda40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f10b400b020 tx=0x7f10b4009da0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.136+0000 7f10cf08f640 1 -- 172.21.15.71:0/786280583 shutdown_connections 2024-09-10T10:03:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.136+0000 7f10cf08f640 1 --2- 172.21.15.71:0/786280583 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f10b806eda0 0x7f10b8071250 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.136+0000 7f10cf08f640 1 --2- 172.21.15.71:0/786280583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10c80fc700 0x7f10c80fda40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.136+0000 7f10cf08f640 1 --2- 172.21.15.71:0/786280583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10c80fb430 0x7f10c80ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.136+0000 7f10cf08f640 1 -- 172.21.15.71:0/786280583 >> 172.21.15.71:0/786280583 conn(0x7f10c80f6c10 msgr2=0x7f10c8065550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.136+0000 7f10cf08f640 1 -- 172.21.15.71:0/786280583 shutdown_connections 2024-09-10T10:03:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.136+0000 7f10cf08f640 1 -- 172.21.15.71:0/786280583 wait complete. 2024-09-10T10:03:29.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.240+0000 7f788d53b640 1 -- 172.21.15.71:0/26458297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78880fd810 msgr2=0x7f78880fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:29.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.240+0000 7f788d53b640 1 --2- 172.21.15.71:0/26458297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78880fd810 0x7f78880fdc80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f787c0048d0 tx=0x7f787c009da0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.240+0000 7f788d53b640 1 -- 172.21.15.71:0/26458297 shutdown_connections 2024-09-10T10:03:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.240+0000 7f788d53b640 1 --2- 172.21.15.71:0/26458297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78880fd810 0x7f78880fdc80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.240+0000 7f788d53b640 1 --2- 172.21.15.71:0/26458297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78880fc540 0x7f78880fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.240+0000 7f788d53b640 1 -- 172.21.15.71:0/26458297 >> 172.21.15.71:0/26458297 conn(0x7f78880f7d00 msgr2=0x7f78880fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.240+0000 7f788d53b640 1 -- 172.21.15.71:0/26458297 shutdown_connections 2024-09-10T10:03:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.240+0000 7f788d53b640 1 -- 172.21.15.71:0/26458297 wait complete. 2024-09-10T10:03:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.240+0000 7f788d53b640 1 Processor -- start 2024-09-10T10:03:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.241+0000 7f788d53b640 1 -- start start 2024-09-10T10:03:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.241+0000 7f788d53b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78880fc540 0x7f788810d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.241+0000 7f788d53b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78880fd810 0x7f788810d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.241+0000 7f788d53b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788810dbe0 con 0x7f78880fc540 2024-09-10T10:03:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.241+0000 7f788d53b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788810e400 con 0x7f78880fd810 2024-09-10T10:03:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.241+0000 7f7886ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78880fc540 0x7f788810d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.241+0000 7f7886ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78880fc540 0x7f788810d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45810/0 (socket says 172.21.15.71:45810) 2024-09-10T10:03:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.241+0000 7f7886ffd640 1 -- 172.21.15.71:0/2687340148 learned_addr learned my addr 172.21.15.71:0/2687340148 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:03:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.241+0000 7f78867fc640 1 --2- 172.21.15.71:0/2687340148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78880fd810 0x7f788810d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.241+0000 7f7886ffd640 1 -- 172.21.15.71:0/2687340148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78880fd810 msgr2=0x7f788810d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.241+0000 7f7886ffd640 1 --2- 172.21.15.71:0/2687340148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78880fd810 0x7f788810d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.241+0000 7f7886ffd640 1 -- 172.21.15.71:0/2687340148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c005040 con 0x7f78880fc540 2024-09-10T10:03:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.241+0000 7f78867fc640 1 --2- 172.21.15.71:0/2687340148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78880fd810 0x7f788810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:03:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.242+0000 7f7886ffd640 1 --2- 172.21.15.71:0/2687340148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78880fc540 0x7f788810d050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f787800eb70 tx=0x7f787800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.242+0000 7f786f7fe640 1 -- 172.21.15.71:0/2687340148 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7878007c30 con 0x7f78880fc540 2024-09-10T10:03:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.242+0000 7f786f7fe640 1 -- 172.21.15.71:0/2687340148 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f787800f040 con 0x7f78880fc540 2024-09-10T10:03:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.242+0000 7f788d53b640 1 -- 172.21.15.71:0/2687340148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788810e630 con 0x7f78880fc540 2024-09-10T10:03:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.242+0000 7f786f7fe640 1 -- 172.21.15.71:0/2687340148 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78780094e0 con 0x7f78880fc540 2024-09-10T10:03:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.242+0000 7f788d53b640 1 -- 172.21.15.71:0/2687340148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788810eb80 con 0x7f78880fc540 2024-09-10T10:03:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.244+0000 7f788d53b640 1 -- 172.21.15.71:0/2687340148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78880fb9a0 con 0x7f78880fc540 2024-09-10T10:03:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.244+0000 7f786f7fe640 1 -- 172.21.15.71:0/2687340148 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7878009750 con 0x7f78880fc540 2024-09-10T10:03:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.245+0000 7f786f7fe640 1 --2- 172.21.15.71:0/2687340148 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f787006ed60 0x7f7870071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.245+0000 7f786f7fe640 1 -- 172.21.15.71:0/2687340148 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f787808de70 con 0x7f78880fc540 2024-09-10T10:03:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.245+0000 7f78867fc640 1 --2- 172.21.15.71:0/2687340148 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f787006ed60 0x7f7870071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.246+0000 7f78867fc640 1 --2- 172.21.15.71:0/2687340148 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f787006ed60 0x7f7870071210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f788810ce00 tx=0x7f787c035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.251+0000 7f786f7fe640 1 -- 172.21.15.71:0/2687340148 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f787804e2a0 con 0x7f78880fc540 2024-09-10T10:03:29.391 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:29 smithi107 ceph-mon[34215]: Upgrade: Updating mgr.smithi107.qurtcs 2024-09-10T10:03:29.391 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:03:29.391 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.qurtcs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:03:29.392 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:03:29.392 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:29 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:29.392 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:29 smithi107 ceph-mon[34215]: Deploying daemon mgr.smithi107.qurtcs on smithi107 2024-09-10T10:03:29.392 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:29 smithi107 ceph-mon[34215]: pgmap v235: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 697 KiB/s rd, 3.9 MiB/s wr, 319 op/s 2024-09-10T10:03:29.392 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:29 smithi107 ceph-mon[34215]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:29.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.525+0000 7f788d53b640 1 -- 172.21.15.71:0/2687340148 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f788810ef30 con 0x7f787006ed60 2024-09-10T10:03:29.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:29 smithi071 ceph-mon[27559]: Upgrade: Updating mgr.smithi107.qurtcs 2024-09-10T10:03:29.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:03:29.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.qurtcs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:03:29.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:03:29.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:29 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:29.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:29 smithi071 ceph-mon[27559]: Deploying daemon mgr.smithi107.qurtcs on smithi107 2024-09-10T10:03:29.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:29 smithi071 ceph-mon[27559]: pgmap v235: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 697 KiB/s rd, 3.9 MiB/s wr, 319 op/s 2024-09-10T10:03:29.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:29 smithi071 ceph-mon[27559]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:29.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.539+0000 7f786f7fe640 1 -- 172.21.15.71:0/2687340148 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f788810ef30 con 0x7f787006ed60 2024-09-10T10:03:29.540 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:03:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (6m) 91s ago 7m 25.4M - 0.25.0 c8568f914cd2 b3a4270190ef 2024-09-10T10:03:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (7m) 91s ago 7m 6891k - 17.2.7-1597-g96d63e75 f3fc7d52e233 f70481a4c3c7 2024-09-10T10:03:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (6m) 97s ago 6m 6895k - 17.2.7-1597-g96d63e75 f3fc7d52e233 cf27ebcc0f98 2024-09-10T10:03:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (5m) 91s ago 7m 81.4M - 9.4.7 954c08fa6188 1998c9de2d92 2024-09-10T10:03:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (112s) 91s ago 111s 16.6M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:03:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (118s) 91s ago 117s 11.8M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:03:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (115s) 97s ago 114s 16.5M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:03:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (109s) 97s ago 108s 14.9M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:03:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:9283,8765,8443 running (8m) 91s ago 8m 449M - 17.2.7-1597-g96d63e75 f3fc7d52e233 dc0e497fa11e 2024-09-10T10:03:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283 running (6m) 97s ago 6m 401M - 17.2.7-1597-g96d63e75 f3fc7d52e233 d93840908437 2024-09-10T10:03:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (8m) 91s ago 8m 49.6M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 35e491e574a3 2024-09-10T10:03:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (6m) 97s ago 6m 35.7M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 682e2b6e311f 2024-09-10T10:03:29.541 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (7m) 91s ago 7m 16.1M - 1.5.0 0da6a335fe13 acc088fb47d4 2024-09-10T10:03:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (6m) 97s ago 6m 15.8M - 1.5.0 0da6a335fe13 12be03d3d11f 2024-09-10T10:03:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (5m) 91s ago 5m 46.5M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 a79e69c9b514 2024-09-10T10:03:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (5m) 91s ago 5m 44.4M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 44a84bf577da 2024-09-10T10:03:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (4m) 91s ago 4m 42.9M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 4fae52756a24 2024-09-10T10:03:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (4m) 97s ago 4m 47.1M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:03:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (3m) 97s ago 3m 42.6M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:03:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (3m) 97s ago 3m 42.0M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:03:29.542 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (5m) 91s ago 6m 56.1M - 2.43.0 a07b618ecd1d 1a619aeb5698 2024-09-10T10:03:29.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.542+0000 7f788d53b640 1 -- 172.21.15.71:0/2687340148 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f787006ed60 msgr2=0x7f7870071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:29.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.542+0000 7f788d53b640 1 --2- 172.21.15.71:0/2687340148 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f787006ed60 0x7f7870071210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f788810ce00 tx=0x7f787c035040 comp rx=0 tx=0).stop 2024-09-10T10:03:29.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.542+0000 7f788d53b640 1 -- 172.21.15.71:0/2687340148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78880fc540 msgr2=0x7f788810d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:29.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.542+0000 7f788d53b640 1 --2- 172.21.15.71:0/2687340148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78880fc540 0x7f788810d050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f787800eb70 tx=0x7f787800b040 comp rx=0 tx=0).stop 2024-09-10T10:03:29.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.542+0000 7f788d53b640 1 -- 172.21.15.71:0/2687340148 shutdown_connections 2024-09-10T10:03:29.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.542+0000 7f788d53b640 1 --2- 172.21.15.71:0/2687340148 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f787006ed60 0x7f7870071210 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.542+0000 7f788d53b640 1 --2- 172.21.15.71:0/2687340148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78880fd810 0x7f788810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.542+0000 7f788d53b640 1 --2- 172.21.15.71:0/2687340148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78880fc540 0x7f788810d050 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.542+0000 7f788d53b640 1 -- 172.21.15.71:0/2687340148 >> 172.21.15.71:0/2687340148 conn(0x7f78880f7d00 msgr2=0x7f78880f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:29.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.542+0000 7f788d53b640 1 -- 172.21.15.71:0/2687340148 shutdown_connections 2024-09-10T10:03:29.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.543+0000 7f788d53b640 1 -- 172.21.15.71:0/2687340148 wait complete. 2024-09-10T10:03:29.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.650+0000 7f0899b0c640 1 -- 172.21.15.71:0/1836723651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08940fdb70 msgr2=0x7f08940fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:29.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.650+0000 7f0899b0c640 1 --2- 172.21.15.71:0/1836723651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08940fdb70 0x7f08940fdf80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f08840048d0 tx=0x7f0884009da0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.650+0000 7f0899b0c640 1 -- 172.21.15.71:0/1836723651 shutdown_connections 2024-09-10T10:03:29.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.650+0000 7f0899b0c640 1 --2- 172.21.15.71:0/1836723651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08940fe4c0 0x7f08940fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.650+0000 7f0899b0c640 1 --2- 172.21.15.71:0/1836723651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08940fdb70 0x7f08940fdf80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.650+0000 7f0899b0c640 1 -- 172.21.15.71:0/1836723651 >> 172.21.15.71:0/1836723651 conn(0x7f08940f6390 msgr2=0x7f08940f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.651+0000 7f0899b0c640 1 -- 172.21.15.71:0/1836723651 shutdown_connections 2024-09-10T10:03:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.651+0000 7f0899b0c640 1 -- 172.21.15.71:0/1836723651 wait complete. 2024-09-10T10:03:29.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.651+0000 7f0899b0c640 1 Processor -- start 2024-09-10T10:03:29.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.651+0000 7f0899b0c640 1 -- start start 2024-09-10T10:03:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.652+0000 7f0899b0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08940fdb70 0x7f089410ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.652+0000 7f0899b0c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08940fe4c0 0x7f089410b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.652+0000 7f0899b0c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089410b990 con 0x7f08940fe4c0 2024-09-10T10:03:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.652+0000 7f0899b0c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089410c250 con 0x7f08940fdb70 2024-09-10T10:03:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.652+0000 7f0892ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08940fe4c0 0x7f089410b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.652+0000 7f0892ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08940fe4c0 0x7f089410b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45834/0 (socket says 172.21.15.71:45834) 2024-09-10T10:03:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.652+0000 7f0892ffd640 1 -- 172.21.15.71:0/1229270390 learned_addr learned my addr 172.21.15.71:0/1229270390 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:03:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.652+0000 7f08937fe640 1 --2- 172.21.15.71:0/1229270390 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08940fdb70 0x7f089410ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.652+0000 7f0892ffd640 1 -- 172.21.15.71:0/1229270390 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08940fdb70 msgr2=0x7f089410ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.652+0000 7f0892ffd640 1 --2- 172.21.15.71:0/1229270390 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08940fdb70 0x7f089410ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.652+0000 7f0892ffd640 1 -- 172.21.15.71:0/1229270390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0884005040 con 0x7f08940fe4c0 2024-09-10T10:03:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.652+0000 7f0892ffd640 1 --2- 172.21.15.71:0/1229270390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08940fe4c0 0x7f089410b390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0888002a50 tx=0x7f0888004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:29.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.652+0000 7f087bfff640 1 -- 172.21.15.71:0/1229270390 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0888007c30 con 0x7f08940fe4c0 2024-09-10T10:03:29.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.653+0000 7f087bfff640 1 -- 172.21.15.71:0/1229270390 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f088800f040 con 0x7f08940fe4c0 2024-09-10T10:03:29.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.653+0000 7f0899b0c640 1 -- 172.21.15.71:0/1229270390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089410c530 con 0x7f08940fe4c0 2024-09-10T10:03:29.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.653+0000 7f087bfff640 1 -- 172.21.15.71:0/1229270390 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f088800db10 con 0x7f08940fe4c0 2024-09-10T10:03:29.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.653+0000 7f0899b0c640 1 -- 172.21.15.71:0/1229270390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089410c990 con 0x7f08940fe4c0 2024-09-10T10:03:29.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.654+0000 7f087bfff640 1 -- 172.21.15.71:0/1229270390 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f088800dc70 con 0x7f08940fe4c0 2024-09-10T10:03:29.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.654+0000 7f0899b0c640 1 -- 172.21.15.71:0/1229270390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08940fa010 con 0x7f08940fe4c0 2024-09-10T10:03:29.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.655+0000 7f087bfff640 1 --2- 172.21.15.71:0/1229270390 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f087c06ed60 0x7f087c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:29.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.655+0000 7f087bfff640 1 -- 172.21.15.71:0/1229270390 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f088808de50 con 0x7f08940fe4c0 2024-09-10T10:03:29.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.655+0000 7f08937fe640 1 --2- 172.21.15.71:0/1229270390 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f087c06ed60 0x7f087c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:29.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.656+0000 7f08937fe640 1 --2- 172.21.15.71:0/1229270390 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f087c06ed60 0x7f087c071210 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0884000c00 tx=0x7f0884035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:29.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.661+0000 7f087bfff640 1 -- 172.21.15.71:0/1229270390 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f088805afa0 con 0x7f08940fe4c0 2024-09-10T10:03:29.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.997+0000 7f0899b0c640 1 -- 172.21.15.71:0/1229270390 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f089404b720 con 0x7f08940fe4c0 2024-09-10T10:03:29.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:29.997+0000 7f087bfff640 1 -- 172.21.15.71:0/1229270390 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f088805a940 con 0x7f08940fe4c0 2024-09-10T10:03:29.999 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:03:29.999 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:03:29.999 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2 2024-09-10T10:03:29.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:03:29.999 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:03:29.999 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2 2024-09-10T10:03:29.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:03:29.999 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:03:29.999 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 6 2024-09-10T10:03:29.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:03:29.999 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:03:30.000 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:03:30.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:03:30.000 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:03:30.000 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 14 2024-09-10T10:03:30.000 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:03:30.000 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:03:30.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.000+0000 7f0899b0c640 1 -- 172.21.15.71:0/1229270390 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f087c06ed60 msgr2=0x7f087c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:30.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.000+0000 7f0899b0c640 1 --2- 172.21.15.71:0/1229270390 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f087c06ed60 0x7f087c071210 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0884000c00 tx=0x7f0884035040 comp rx=0 tx=0).stop 2024-09-10T10:03:30.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.000+0000 7f0899b0c640 1 -- 172.21.15.71:0/1229270390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08940fe4c0 msgr2=0x7f089410b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:30.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.000+0000 7f0899b0c640 1 --2- 172.21.15.71:0/1229270390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08940fe4c0 0x7f089410b390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0888002a50 tx=0x7f0888004600 comp rx=0 tx=0).stop 2024-09-10T10:03:30.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.001+0000 7f0899b0c640 1 -- 172.21.15.71:0/1229270390 shutdown_connections 2024-09-10T10:03:30.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.001+0000 7f0899b0c640 1 --2- 172.21.15.71:0/1229270390 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f087c06ed60 0x7f087c071210 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.001+0000 7f0899b0c640 1 --2- 172.21.15.71:0/1229270390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08940fe4c0 0x7f089410b390 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.001+0000 7f0899b0c640 1 --2- 172.21.15.71:0/1229270390 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08940fdb70 0x7f089410ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.001+0000 7f0899b0c640 1 -- 172.21.15.71:0/1229270390 >> 172.21.15.71:0/1229270390 conn(0x7f08940f6390 msgr2=0x7f08940f7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:30.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.001+0000 7f0899b0c640 1 -- 172.21.15.71:0/1229270390 shutdown_connections 2024-09-10T10:03:30.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.001+0000 7f0899b0c640 1 -- 172.21.15.71:0/1229270390 wait complete. 2024-09-10T10:03:30.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.105+0000 7fe355b3b640 1 -- 172.21.15.71:0/2136528830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe350065be0 msgr2=0x7fe3500ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.105+0000 7fe355b3b640 1 --2- 172.21.15.71:0/2136528830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe350065be0 0x7fe3500ff1a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe3400048d0 tx=0x7fe340009da0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.105+0000 7fe355b3b640 1 -- 172.21.15.71:0/2136528830 shutdown_connections 2024-09-10T10:03:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.105+0000 7fe355b3b640 1 --2- 172.21.15.71:0/2136528830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3500ff6e0 0x7fe350101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.105+0000 7fe355b3b640 1 --2- 172.21.15.71:0/2136528830 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe350065be0 0x7fe3500ff1a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.105+0000 7fe355b3b640 1 -- 172.21.15.71:0/2136528830 >> 172.21.15.71:0/2136528830 conn(0x7fe3500f6c10 msgr2=0x7fe3500f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.105+0000 7fe355b3b640 1 -- 172.21.15.71:0/2136528830 shutdown_connections 2024-09-10T10:03:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.106+0000 7fe355b3b640 1 -- 172.21.15.71:0/2136528830 wait complete. 2024-09-10T10:03:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.106+0000 7fe355b3b640 1 Processor -- start 2024-09-10T10:03:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.107+0000 7fe355b3b640 1 -- start start 2024-09-10T10:03:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.107+0000 7fe355b3b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe350065be0 0x7fe35010f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.107+0000 7fe355b3b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3500ff6e0 0x7fe35010f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.107+0000 7fe355b3b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35010fe90 con 0x7fe350065be0 2024-09-10T10:03:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.107+0000 7fe355b3b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3501106b0 con 0x7fe3500ff6e0 2024-09-10T10:03:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.107+0000 7fe34f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe350065be0 0x7fe35010f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.107+0000 7fe34effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3500ff6e0 0x7fe35010f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.107+0000 7fe34effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3500ff6e0 0x7fe35010f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.71:35990/0 (socket says 172.21.15.71:35990) 2024-09-10T10:03:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.107+0000 7fe34effd640 1 -- 172.21.15.71:0/2514015032 learned_addr learned my addr 172.21.15.71:0/2514015032 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:03:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.108+0000 7fe34effd640 1 -- 172.21.15.71:0/2514015032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe350065be0 msgr2=0x7fe35010f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.108+0000 7fe34effd640 1 --2- 172.21.15.71:0/2514015032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe350065be0 0x7fe35010f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.108+0000 7fe34effd640 1 -- 172.21.15.71:0/2514015032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe340005040 con 0x7fe3500ff6e0 2024-09-10T10:03:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.108+0000 7fe34effd640 1 --2- 172.21.15.71:0/2514015032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3500ff6e0 0x7fe35010f840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe34400eb70 tx=0x7fe34400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.109+0000 7fe337fff640 1 -- 172.21.15.71:0/2514015032 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe344007c30 con 0x7fe3500ff6e0 2024-09-10T10:03:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.109+0000 7fe355b3b640 1 -- 172.21.15.71:0/2514015032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3501108e0 con 0x7fe3500ff6e0 2024-09-10T10:03:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.109+0000 7fe337fff640 1 -- 172.21.15.71:0/2514015032 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe34400f040 con 0x7fe3500ff6e0 2024-09-10T10:03:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.109+0000 7fe337fff640 1 -- 172.21.15.71:0/2514015032 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe344007c30 con 0x7fe3500ff6e0 2024-09-10T10:03:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.109+0000 7fe355b3b640 1 -- 172.21.15.71:0/2514015032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe350110e80 con 0x7fe3500ff6e0 2024-09-10T10:03:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.110+0000 7fe355b3b640 1 -- 172.21.15.71:0/2514015032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3500fa890 con 0x7fe3500ff6e0 2024-09-10T10:03:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.111+0000 7fe337fff640 1 -- 172.21.15.71:0/2514015032 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe3440090d0 con 0x7fe3500ff6e0 2024-09-10T10:03:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.112+0000 7fe337fff640 1 --2- 172.21.15.71:0/2514015032 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe33806edb0 0x7fe338071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.112+0000 7fe34f7fe640 1 --2- 172.21.15.71:0/2514015032 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe33806edb0 0x7fe338071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.112+0000 7fe337fff640 1 -- 172.21.15.71:0/2514015032 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe34408da30 con 0x7fe3500ff6e0 2024-09-10T10:03:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.112+0000 7fe34f7fe640 1 --2- 172.21.15.71:0/2514015032 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe33806edb0 0x7fe338071260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe3400048a0 tx=0x7fe340035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:30.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.118+0000 7fe337fff640 1 -- 172.21.15.71:0/2514015032 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe34405abb0 con 0x7fe3500ff6e0 2024-09-10T10:03:30.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:30 smithi071 ceph-mon[27559]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:30.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:30 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:03:30.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:30 smithi071 ceph-mon[27559]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:30.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:30 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1229270390' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:03:30.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:30 smithi107 ceph-mon[34215]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:30.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:30 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:03:30.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:30 smithi107 ceph-mon[34215]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:30.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:30 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1229270390' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:03:30.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.408+0000 7fe355b3b640 1 -- 172.21.15.71:0/2514015032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe35004b720 con 0x7fe3500ff6e0 2024-09-10T10:03:30.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.408+0000 7fe337fff640 1 -- 172.21.15.71:0/2514015032 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1849 (secure 0 0 0) 0x7fe344019750 con 0x7fe3500ff6e0 2024-09-10T10:03:30.410 INFO:teuthology.orchestra.run.smithi071.stdout:e21 2024-09-10T10:03:30.410 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:03:30.410 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:03:30.410 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:03:30.410 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:03:30.410 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:03:30.410 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:03:30.410 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 21 2024-09-10T10:03:30.410 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:03:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:03:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:03:24.004737+0000 2024-09-10T10:03:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:03:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:03:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:03:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:03:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:03:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:03:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:03:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:03:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:03:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:03:30.411 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:03:30.412 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:03:30.412 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:03:30.412 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:03:30.412 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:03:30.412 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:03:30.412 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:03:30.412 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:03:30.412 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:03:30.412 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:03:30.413 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:03:30.413 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:03:30.413 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:03:30.413 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:03:30.413 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:03:30.413 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:03:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 21 2024-09-10T10:03:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.411+0000 7fe355b3b640 1 -- 172.21.15.71:0/2514015032 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe33806edb0 msgr2=0x7fe338071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.411+0000 7fe355b3b640 1 --2- 172.21.15.71:0/2514015032 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe33806edb0 0x7fe338071260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe3400048a0 tx=0x7fe340035040 comp rx=0 tx=0).stop 2024-09-10T10:03:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.411+0000 7fe355b3b640 1 -- 172.21.15.71:0/2514015032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3500ff6e0 msgr2=0x7fe35010f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.411+0000 7fe355b3b640 1 --2- 172.21.15.71:0/2514015032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3500ff6e0 0x7fe35010f840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe34400eb70 tx=0x7fe34400b040 comp rx=0 tx=0).stop 2024-09-10T10:03:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.411+0000 7fe355b3b640 1 -- 172.21.15.71:0/2514015032 shutdown_connections 2024-09-10T10:03:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.412+0000 7fe355b3b640 1 --2- 172.21.15.71:0/2514015032 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fe33806edb0 0x7fe338071260 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.412+0000 7fe355b3b640 1 --2- 172.21.15.71:0/2514015032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3500ff6e0 0x7fe35010f840 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.412+0000 7fe355b3b640 1 --2- 172.21.15.71:0/2514015032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe350065be0 0x7fe35010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.412+0000 7fe355b3b640 1 -- 172.21.15.71:0/2514015032 >> 172.21.15.71:0/2514015032 conn(0x7fe3500f6c10 msgr2=0x7fe3500fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.412+0000 7fe355b3b640 1 -- 172.21.15.71:0/2514015032 shutdown_connections 2024-09-10T10:03:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.412+0000 7fe355b3b640 1 -- 172.21.15.71:0/2514015032 wait complete. 2024-09-10T10:03:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.522+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1240715172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa40fb430 msgr2=0x7f0fa40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.522+0000 7f0fa8aae640 1 --2- 172.21.15.71:0/1240715172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa40fb430 0x7f0fa40fb840 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0f940048d0 tx=0x7f0f94009da0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.522+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1240715172 shutdown_connections 2024-09-10T10:03:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.522+0000 7f0fa8aae640 1 --2- 172.21.15.71:0/1240715172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fa40fc700 0x7f0fa40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.522+0000 7f0fa8aae640 1 --2- 172.21.15.71:0/1240715172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa40fb430 0x7f0fa40fb840 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.522+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1240715172 >> 172.21.15.71:0/1240715172 conn(0x7f0fa40f6c10 msgr2=0x7f0fa40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.522+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1240715172 shutdown_connections 2024-09-10T10:03:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.522+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1240715172 wait complete. 2024-09-10T10:03:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.522+0000 7f0fa8aae640 1 Processor -- start 2024-09-10T10:03:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.522+0000 7f0fa8aae640 1 -- start start 2024-09-10T10:03:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.523+0000 7f0fa8aae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fa40fb430 0x7f0fa410d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.523+0000 7f0fa8aae640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa40fc700 0x7f0fa410d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.523+0000 7f0fa8aae640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa410dbf0 con 0x7f0fa40fc700 2024-09-10T10:03:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.523+0000 7f0fa8aae640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa410e410 con 0x7f0fa40fb430 2024-09-10T10:03:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.523+0000 7f0fa1d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa40fc700 0x7f0fa410d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.523+0000 7f0fa1d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa40fc700 0x7f0fa410d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45868/0 (socket says 172.21.15.71:45868) 2024-09-10T10:03:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.523+0000 7f0fa1d9b640 1 -- 172.21.15.71:0/1578986415 learned_addr learned my addr 172.21.15.71:0/1578986415 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:03:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.523+0000 7f0fa259c640 1 --2- 172.21.15.71:0/1578986415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fa40fb430 0x7f0fa410d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.523+0000 7f0fa1d9b640 1 -- 172.21.15.71:0/1578986415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fa40fb430 msgr2=0x7f0fa410d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.523+0000 7f0fa1d9b640 1 --2- 172.21.15.71:0/1578986415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fa40fb430 0x7f0fa410d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.523+0000 7f0fa1d9b640 1 -- 172.21.15.71:0/1578986415 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f94005040 con 0x7f0fa40fc700 2024-09-10T10:03:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.523+0000 7f0fa1d9b640 1 --2- 172.21.15.71:0/1578986415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa40fc700 0x7f0fa410d5a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800eb70 tx=0x7f0f9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.524+0000 7f0f92ffd640 1 -- 172.21.15.71:0/1578986415 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f98007c30 con 0x7f0fa40fc700 2024-09-10T10:03:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.524+0000 7f0f92ffd640 1 -- 172.21.15.71:0/1578986415 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0f9800f040 con 0x7f0fa40fc700 2024-09-10T10:03:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.524+0000 7f0f92ffd640 1 -- 172.21.15.71:0/1578986415 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f980094e0 con 0x7f0fa40fc700 2024-09-10T10:03:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.524+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1578986415 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa410e640 con 0x7f0fa40fc700 2024-09-10T10:03:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.524+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1578986415 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa410eb90 con 0x7f0fa40fc700 2024-09-10T10:03:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.525+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1578986415 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa40fa890 con 0x7f0fa40fc700 2024-09-10T10:03:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.526+0000 7f0f92ffd640 1 -- 172.21.15.71:0/1578986415 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f0f98009750 con 0x7f0fa40fc700 2024-09-10T10:03:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.527+0000 7f0f92ffd640 1 --2- 172.21.15.71:0/1578986415 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0f8c06ed60 0x7f0f8c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.527+0000 7f0f92ffd640 1 -- 172.21.15.71:0/1578986415 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0f9808de60 con 0x7f0fa40fc700 2024-09-10T10:03:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.527+0000 7f0fa259c640 1 --2- 172.21.15.71:0/1578986415 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0f8c06ed60 0x7f0f8c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.528+0000 7f0fa259c640 1 --2- 172.21.15.71:0/1578986415 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0f8c06ed60 0x7f0f8c071210 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0f94004540 tx=0x7f0f94035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.534+0000 7f0f92ffd640 1 -- 172.21.15.71:0/1578986415 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0f9804e2a0 con 0x7f0fa40fc700 2024-09-10T10:03:30.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.750+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1578986415 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fa402ab50 con 0x7f0f8c06ed60 2024-09-10T10:03:30.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.751+0000 7f0f92ffd640 1 -- 172.21.15.71:0/1578986415 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f0fa402ab50 con 0x7f0f8c06ed60 2024-09-10T10:03:30.752 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:03:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:03:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:03:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:03:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-10T10:03:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "0/21 daemons upgraded", 2024-09-10T10:03:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mgr daemons", 2024-09-10T10:03:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:03:30.752 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:03:30.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.753+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1578986415 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0f8c06ed60 msgr2=0x7f0f8c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:30.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.753+0000 7f0fa8aae640 1 --2- 172.21.15.71:0/1578986415 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0f8c06ed60 0x7f0f8c071210 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0f94004540 tx=0x7f0f94035040 comp rx=0 tx=0).stop 2024-09-10T10:03:30.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.753+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1578986415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa40fc700 msgr2=0x7f0fa410d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:30.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.753+0000 7f0fa8aae640 1 --2- 172.21.15.71:0/1578986415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa40fc700 0x7f0fa410d5a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800eb70 tx=0x7f0f9800b040 comp rx=0 tx=0).stop 2024-09-10T10:03:30.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.753+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1578986415 shutdown_connections 2024-09-10T10:03:30.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.753+0000 7f0fa8aae640 1 --2- 172.21.15.71:0/1578986415 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f0f8c06ed60 0x7f0f8c071210 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.753+0000 7f0fa8aae640 1 --2- 172.21.15.71:0/1578986415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fa40fc700 0x7f0fa410d5a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.753+0000 7f0fa8aae640 1 --2- 172.21.15.71:0/1578986415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fa40fb430 0x7f0fa410d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.753+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1578986415 >> 172.21.15.71:0/1578986415 conn(0x7f0fa40f6c10 msgr2=0x7f0fa4065640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:30.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.753+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1578986415 shutdown_connections 2024-09-10T10:03:30.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.753+0000 7f0fa8aae640 1 -- 172.21.15.71:0/1578986415 wait complete. 2024-09-10T10:03:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.847+0000 7ffaeee32640 1 -- 172.21.15.71:0/1671024358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffae80fd840 msgr2=0x7ffae80fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.847+0000 7ffaeee32640 1 --2- 172.21.15.71:0/1671024358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffae80fd840 0x7ffae80fdcb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffad40048d0 tx=0x7ffad4009da0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.847+0000 7ffaeee32640 1 -- 172.21.15.71:0/1671024358 shutdown_connections 2024-09-10T10:03:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.847+0000 7ffaeee32640 1 --2- 172.21.15.71:0/1671024358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffae80fd840 0x7ffae80fdcb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.847+0000 7ffaeee32640 1 --2- 172.21.15.71:0/1671024358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae80fc570 0x7ffae80fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.847+0000 7ffaeee32640 1 -- 172.21.15.71:0/1671024358 >> 172.21.15.71:0/1671024358 conn(0x7ffae80f7d30 msgr2=0x7ffae80fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.847+0000 7ffaeee32640 1 -- 172.21.15.71:0/1671024358 shutdown_connections 2024-09-10T10:03:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.847+0000 7ffaeee32640 1 -- 172.21.15.71:0/1671024358 wait complete. 2024-09-10T10:03:30.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.848+0000 7ffaeee32640 1 Processor -- start 2024-09-10T10:03:30.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.848+0000 7ffaeee32640 1 -- start start 2024-09-10T10:03:30.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.849+0000 7ffaeee32640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffae80fc570 0x7ffae8113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:30.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.849+0000 7ffaeee32640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae80fd840 0x7ffae8113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:30.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.849+0000 7ffaeee32640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8114200 con 0x7ffae80fc570 2024-09-10T10:03:30.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.849+0000 7ffaeee32640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8114a20 con 0x7ffae80fd840 2024-09-10T10:03:30.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.849+0000 7ffaecbce640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffae80fc570 0x7ffae8113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:30.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.849+0000 7ffaecbce640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffae80fc570 0x7ffae8113670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45894/0 (socket says 172.21.15.71:45894) 2024-09-10T10:03:30.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.849+0000 7ffaecbce640 1 -- 172.21.15.71:0/1812184225 learned_addr learned my addr 172.21.15.71:0/1812184225 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:03:30.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.849+0000 7ffae7fff640 1 --2- 172.21.15.71:0/1812184225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae80fd840 0x7ffae8113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:30.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.849+0000 7ffae7fff640 1 -- 172.21.15.71:0/1812184225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffae80fc570 msgr2=0x7ffae8113670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:30.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.849+0000 7ffae7fff640 1 --2- 172.21.15.71:0/1812184225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffae80fc570 0x7ffae8113670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:30.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.850+0000 7ffae7fff640 1 -- 172.21.15.71:0/1812184225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad4005040 con 0x7ffae80fd840 2024-09-10T10:03:30.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.850+0000 7ffae7fff640 1 --2- 172.21.15.71:0/1812184225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae80fd840 0x7ffae8113bb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffad40048a0 tx=0x7ffad4009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:30.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.850+0000 7ffae57fa640 1 -- 172.21.15.71:0/1812184225 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffad4038070 con 0x7ffae80fd840 2024-09-10T10:03:30.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.850+0000 7ffaeee32640 1 -- 172.21.15.71:0/1812184225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae8114c50 con 0x7ffae80fd840 2024-09-10T10:03:30.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.850+0000 7ffaeee32640 1 -- 172.21.15.71:0/1812184225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae81151f0 con 0x7ffae80fd840 2024-09-10T10:03:30.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.850+0000 7ffae57fa640 1 -- 172.21.15.71:0/1812184225 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffad402ae90 con 0x7ffae80fd840 2024-09-10T10:03:30.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.850+0000 7ffae57fa640 1 -- 172.21.15.71:0/1812184225 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffad403e430 con 0x7ffae80fd840 2024-09-10T10:03:30.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.851+0000 7ffaeee32640 1 -- 172.21.15.71:0/1812184225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae80fb9d0 con 0x7ffae80fd840 2024-09-10T10:03:30.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.852+0000 7ffae57fa640 1 -- 172.21.15.71:0/1812184225 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ffad4030020 con 0x7ffae80fd840 2024-09-10T10:03:30.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.853+0000 7ffae57fa640 1 --2- 172.21.15.71:0/1812184225 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ffad806eda0 0x7ffad8071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:30.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.853+0000 7ffae57fa640 1 -- 172.21.15.71:0/1812184225 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ffad40ae2e0 con 0x7ffae80fd840 2024-09-10T10:03:30.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.853+0000 7ffaecbce640 1 --2- 172.21.15.71:0/1812184225 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ffad806eda0 0x7ffad8071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:30.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.853+0000 7ffaecbce640 1 --2- 172.21.15.71:0/1812184225 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ffad806eda0 0x7ffad8071250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffadc004aa0 tx=0x7ffadc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:30.858+0000 7ffae57fa640 1 -- 172.21.15.71:0/1812184225 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffad407b3c0 con 0x7ffae80fd840 2024-09-10T10:03:31.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:31.136+0000 7ffaeee32640 1 -- 172.21.15.71:0/1812184225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ffae8071420 con 0x7ffae80fd840 2024-09-10T10:03:31.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:31.136+0000 7ffae57fa640 1 -- 172.21.15.71:0/1812184225 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ffad407ad60 con 0x7ffae80fd840 2024-09-10T10:03:31.138 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:03:31.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:31.139+0000 7ffaeee32640 1 -- 172.21.15.71:0/1812184225 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ffad806eda0 msgr2=0x7ffad8071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:31.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:31.139+0000 7ffaeee32640 1 --2- 172.21.15.71:0/1812184225 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ffad806eda0 0x7ffad8071250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffadc004aa0 tx=0x7ffadc00b040 comp rx=0 tx=0).stop 2024-09-10T10:03:31.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:31.139+0000 7ffaeee32640 1 -- 172.21.15.71:0/1812184225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae80fd840 msgr2=0x7ffae8113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:31.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:31.139+0000 7ffaeee32640 1 --2- 172.21.15.71:0/1812184225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae80fd840 0x7ffae8113bb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffad40048a0 tx=0x7ffad4009da0 comp rx=0 tx=0).stop 2024-09-10T10:03:31.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:31.139+0000 7ffaeee32640 1 -- 172.21.15.71:0/1812184225 shutdown_connections 2024-09-10T10:03:31.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:31.139+0000 7ffaeee32640 1 --2- 172.21.15.71:0/1812184225 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ffad806eda0 0x7ffad8071250 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:31.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:31.139+0000 7ffaeee32640 1 --2- 172.21.15.71:0/1812184225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae80fd840 0x7ffae8113bb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:31.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:31.139+0000 7ffaeee32640 1 --2- 172.21.15.71:0/1812184225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffae80fc570 0x7ffae8113670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:31.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:31.139+0000 7ffaeee32640 1 -- 172.21.15.71:0/1812184225 >> 172.21.15.71:0/1812184225 conn(0x7ffae80f7d30 msgr2=0x7ffae80f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:31.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:31.139+0000 7ffaeee32640 1 -- 172.21.15.71:0/1812184225 shutdown_connections 2024-09-10T10:03:31.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:03:31.139+0000 7ffaeee32640 1 -- 172.21.15.71:0/1812184225 wait complete. 2024-09-10T10:03:31.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:31 smithi107 ceph-mon[34215]: pgmap v236: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 369 op/s 2024-09-10T10:03:31.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:31 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/2514015032' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:03:31.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:31 smithi107 ceph-mon[34215]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:31.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:31 smithi071 ceph-mon[27559]: pgmap v236: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 369 op/s 2024-09-10T10:03:31.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:31 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/2514015032' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:03:31.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:31 smithi071 ceph-mon[27559]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:32.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:32 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1812184225' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:03:32.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:32 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1812184225' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:03:33.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:33 smithi107 ceph-mon[34215]: pgmap v237: 65 pgs: 65 active+clean; 67 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 441 op/s 2024-09-10T10:03:33.509 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:33 smithi071 ceph-mon[27559]: pgmap v237: 65 pgs: 65 active+clean; 67 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 441 op/s 2024-09-10T10:03:35.614 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:35 smithi107 ceph-mon[34215]: pgmap v238: 65 pgs: 65 active+clean; 76 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 486 op/s 2024-09-10T10:03:35.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:35 smithi071 ceph-mon[27559]: pgmap v238: 65 pgs: 65 active+clean; 76 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 486 op/s 2024-09-10T10:03:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:37 smithi107 ceph-mon[34215]: pgmap v239: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 5.1 MiB/s wr, 507 op/s 2024-09-10T10:03:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:37 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:03:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:37 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:03:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:37 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:37.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:37 smithi071 ceph-mon[27559]: pgmap v239: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 5.1 MiB/s wr, 507 op/s 2024-09-10T10:03:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:37 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:03:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:37 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:03:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:37 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:39.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:39 smithi071 ceph-mon[27559]: pgmap v240: 65 pgs: 65 active+clean; 94 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 577 op/s 2024-09-10T10:03:39.862 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:39 smithi107 ceph-mon[34215]: pgmap v240: 65 pgs: 65 active+clean; 94 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 577 op/s 2024-09-10T10:03:41.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:41 smithi071 ceph-mon[27559]: pgmap v241: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 542 op/s 2024-09-10T10:03:41.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:41 smithi107 ceph-mon[34215]: pgmap v241: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.4 MiB/s wr, 542 op/s 2024-09-10T10:03:42.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:42 smithi107 ceph-mon[34215]: Standby manager daemon smithi107.qurtcs restarted 2024-09-10T10:03:42.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:42 smithi107 ceph-mon[34215]: Standby manager daemon smithi107.qurtcs started 2024-09-10T10:03:42.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:42 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/crt"}]: dispatch 2024-09-10T10:03:42.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:42 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:03:42.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:42 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/key"}]: dispatch 2024-09-10T10:03:42.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:42 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:03:42.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:42 smithi071 ceph-mon[27559]: Standby manager daemon smithi107.qurtcs restarted 2024-09-10T10:03:42.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:42 smithi071 ceph-mon[27559]: Standby manager daemon smithi107.qurtcs started 2024-09-10T10:03:42.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:42 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/crt"}]: dispatch 2024-09-10T10:03:42.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:42 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:03:42.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:42 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/key"}]: dispatch 2024-09-10T10:03:42.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:42 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:03:43.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:43 smithi071 ceph-mon[27559]: pgmap v242: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 5.0 MiB/s wr, 553 op/s 2024-09-10T10:03:43.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:43 smithi071 ceph-mon[27559]: mgrmap e20: smithi071.gtqytr(active, since 6m), standbys: smithi107.qurtcs 2024-09-10T10:03:43.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:43 smithi107 ceph-mon[34215]: pgmap v242: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 5.0 MiB/s wr, 553 op/s 2024-09-10T10:03:43.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:43 smithi107 ceph-mon[34215]: mgrmap e20: smithi071.gtqytr(active, since 6m), standbys: smithi107.qurtcs 2024-09-10T10:03:44.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:44 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:03:44.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:44 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:03:45.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:45 smithi071 ceph-mon[27559]: pgmap v243: 65 pgs: 65 active+clean; 120 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 549 op/s 2024-09-10T10:03:45.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:45 smithi107 ceph-mon[34215]: pgmap v243: 65 pgs: 65 active+clean; 120 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 549 op/s 2024-09-10T10:03:47.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:47 smithi071 ceph-mon[27559]: pgmap v244: 65 pgs: 65 active+clean; 126 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 517 op/s 2024-09-10T10:03:47.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:47 smithi107 ceph-mon[34215]: pgmap v244: 65 pgs: 65 active+clean; 126 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 517 op/s 2024-09-10T10:03:49.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:49 smithi071 ceph-mon[27559]: pgmap v245: 65 pgs: 65 active+clean; 136 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 558 op/s 2024-09-10T10:03:49.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:49 smithi107 ceph-mon[34215]: pgmap v245: 65 pgs: 65 active+clean; 136 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 558 op/s 2024-09-10T10:03:51.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:51 smithi071 ceph-mon[27559]: pgmap v246: 65 pgs: 65 active+clean; 143 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 511 op/s 2024-09-10T10:03:51.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:51 smithi107 ceph-mon[34215]: pgmap v246: 65 pgs: 65 active+clean; 143 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 511 op/s 2024-09-10T10:03:53.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:53 smithi071 ceph-mon[27559]: pgmap v247: 65 pgs: 65 active+clean; 152 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 532 op/s 2024-09-10T10:03:53.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:53 smithi107 ceph-mon[34215]: pgmap v247: 65 pgs: 65 active+clean; 152 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 532 op/s 2024-09-10T10:03:55.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:55 smithi071 ceph-mon[27559]: pgmap v248: 65 pgs: 65 active+clean; 165 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.9 MiB/s wr, 542 op/s 2024-09-10T10:03:55.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:55 smithi107 ceph-mon[34215]: pgmap v248: 65 pgs: 65 active+clean; 165 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.9 MiB/s wr, 542 op/s 2024-09-10T10:03:56.205 INFO:tasks.workunit.client.1.smithi107.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-10T10:03:56.214 INFO:tasks.workunit.client.1.smithi107.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-10T10:03:56.214 INFO:tasks.workunit.client.1.smithi107.stderr:+ make 2024-09-10T10:03:56.617 INFO:tasks.workunit.client.1.smithi107.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-10T10:03:57.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:57 smithi071 ceph-mon[27559]: pgmap v249: 65 pgs: 65 active+clean; 173 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 505 op/s 2024-09-10T10:03:57.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:57 smithi107 ceph-mon[34215]: pgmap v249: 65 pgs: 65 active+clean; 173 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 505 op/s 2024-09-10T10:03:58.257 INFO:tasks.workunit.client.1.smithi107.stderr:++ readlink -f fsstress 2024-09-10T10:03:58.258 INFO:tasks.workunit.client.1.smithi107.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-10T10:03:58.258 INFO:tasks.workunit.client.1.smithi107.stderr:+ popd 2024-09-10T10:03:58.261 INFO:tasks.workunit.client.1.smithi107.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-10T10:03:58.261 INFO:tasks.workunit.client.1.smithi107.stderr:+ popd 2024-09-10T10:03:58.262 INFO:tasks.workunit.client.1.smithi107.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-10T10:03:58.262 INFO:tasks.workunit.client.1.smithi107.stderr:++ mktemp -d -p . 2024-09-10T10:03:58.266 INFO:tasks.workunit.client.1.smithi107.stderr:+ T=./tmp.5K5xN91LOm 2024-09-10T10:03:58.266 INFO:tasks.workunit.client.1.smithi107.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.5K5xN91LOm -l 1 -n 1000 -p 10 -v 2024-09-10T10:03:58.270 INFO:tasks.workunit.client.1.smithi107.stdout:seed = 1726233502 2024-09-10T10:03:58.275 INFO:tasks.workunit.client.1.smithi107.stdout:0/0: chown . 153 1 2024-09-10T10:03:58.275 INFO:tasks.workunit.client.1.smithi107.stdout:0/1: dwrite - no filename 2024-09-10T10:03:58.275 INFO:tasks.workunit.client.1.smithi107.stdout:0/2: stat - no entries 2024-09-10T10:03:58.276 INFO:tasks.workunit.client.1.smithi107.stdout:0/3: creat f0 x:0 0 0 2024-09-10T10:03:58.279 INFO:tasks.workunit.client.1.smithi107.stdout:2/0: rmdir - no directory 2024-09-10T10:03:58.279 INFO:tasks.workunit.client.1.smithi107.stdout:1/0: mknod c0 0 2024-09-10T10:03:58.279 INFO:tasks.workunit.client.1.smithi107.stdout:2/1: read - no filename 2024-09-10T10:03:58.282 INFO:tasks.workunit.client.1.smithi107.stdout:1/1: creat f1 x:0 0 0 2024-09-10T10:03:58.283 INFO:tasks.workunit.client.1.smithi107.stdout:2/2: creat f0 x:0 0 0 2024-09-10T10:03:58.285 INFO:tasks.workunit.client.1.smithi107.stdout:1/2: mkdir d2 0 2024-09-10T10:03:58.285 INFO:tasks.workunit.client.1.smithi107.stdout:5/0: stat - no entries 2024-09-10T10:03:58.285 INFO:tasks.workunit.client.1.smithi107.stdout:5/1: dwrite - no filename 2024-09-10T10:03:58.285 INFO:tasks.workunit.client.1.smithi107.stdout:5/2: unlink - no file 2024-09-10T10:03:58.285 INFO:tasks.workunit.client.1.smithi107.stdout:5/3: truncate - no filename 2024-09-10T10:03:58.285 INFO:tasks.workunit.client.1.smithi107.stdout:5/4: stat - no entries 2024-09-10T10:03:58.286 INFO:tasks.workunit.client.1.smithi107.stdout:2/3: symlink l1 0 2024-09-10T10:03:58.287 INFO:tasks.workunit.client.1.smithi107.stdout:1/3: rename d2 to d2/d3 22 2024-09-10T10:03:58.288 INFO:tasks.workunit.client.1.smithi107.stdout:3/0: creat f0 x:0 0 0 2024-09-10T10:03:58.288 INFO:tasks.workunit.client.1.smithi107.stdout:6/0: fsync - no filename 2024-09-10T10:03:58.289 INFO:tasks.workunit.client.1.smithi107.stdout:5/5: creat f0 x:0 0 0 2024-09-10T10:03:58.290 INFO:tasks.workunit.client.1.smithi107.stdout:3/1: write f0 [441259,60190] 0 2024-09-10T10:03:58.291 INFO:tasks.workunit.client.1.smithi107.stdout:2/4: truncate f0 66915 0 2024-09-10T10:03:58.293 INFO:tasks.workunit.client.1.smithi107.stdout:5/6: write f0 [368236,71000] 0 2024-09-10T10:03:58.294 INFO:tasks.workunit.client.1.smithi107.stdout:5/7: readlink - no filename 2024-09-10T10:03:58.294 INFO:tasks.workunit.client.1.smithi107.stdout:3/2: truncate f0 1110871 0 2024-09-10T10:03:58.295 INFO:tasks.workunit.client.1.smithi107.stdout:4/0: dwrite - no filename 2024-09-10T10:03:58.295 INFO:tasks.workunit.client.1.smithi107.stdout:4/1: dwrite - no filename 2024-09-10T10:03:58.296 INFO:tasks.workunit.client.1.smithi107.stdout:0/4: dwrite f0 [0,4194304] 0 2024-09-10T10:03:58.296 INFO:tasks.workunit.client.1.smithi107.stdout:4/2: chown . 58198521 1 2024-09-10T10:03:58.296 INFO:tasks.workunit.client.1.smithi107.stdout:4/3: dwrite - no filename 2024-09-10T10:03:58.298 INFO:tasks.workunit.client.1.smithi107.stdout:6/1: mkdir d0 0 2024-09-10T10:03:58.298 INFO:tasks.workunit.client.1.smithi107.stdout:2/5: dread f0 [0,4194304] 0 2024-09-10T10:03:58.300 INFO:tasks.workunit.client.1.smithi107.stdout:1/4: creat d2/f4 x:0 0 0 2024-09-10T10:03:58.300 INFO:tasks.workunit.client.1.smithi107.stdout:7/0: mkdir d0 0 2024-09-10T10:03:58.301 INFO:tasks.workunit.client.1.smithi107.stdout:6/2: rename d0 to d0/d1 22 2024-09-10T10:03:58.301 INFO:tasks.workunit.client.1.smithi107.stdout:6/3: truncate - no filename 2024-09-10T10:03:58.301 INFO:tasks.workunit.client.1.smithi107.stdout:6/4: unlink - no file 2024-09-10T10:03:58.301 INFO:tasks.workunit.client.1.smithi107.stdout:6/5: write - no filename 2024-09-10T10:03:58.301 INFO:tasks.workunit.client.1.smithi107.stdout:6/6: dwrite - no filename 2024-09-10T10:03:58.301 INFO:tasks.workunit.client.1.smithi107.stdout:7/1: chown d0 4237980 1 2024-09-10T10:03:58.302 INFO:tasks.workunit.client.1.smithi107.stdout:4/4: mkdir d0 0 2024-09-10T10:03:58.303 INFO:tasks.workunit.client.1.smithi107.stdout:5/8: truncate f0 567847 0 2024-09-10T10:03:58.304 INFO:tasks.workunit.client.1.smithi107.stdout:3/3: fsync f0 0 2024-09-10T10:03:58.305 INFO:tasks.workunit.client.1.smithi107.stdout:2/6: dread f0 [0,4194304] 0 2024-09-10T10:03:58.308 INFO:tasks.workunit.client.1.smithi107.stdout:1/5: write d2/f4 [176319,41724] 0 2024-09-10T10:03:58.309 INFO:tasks.workunit.client.1.smithi107.stdout:5/9: write f0 [1466933,51140] 0 2024-09-10T10:03:58.310 INFO:tasks.workunit.client.1.smithi107.stdout:6/7: creat d0/f2 x:0 0 0 2024-09-10T10:03:58.313 INFO:tasks.workunit.client.1.smithi107.stdout:1/6: write d2/f4 [1219016,109941] 0 2024-09-10T10:03:58.313 INFO:tasks.workunit.client.1.smithi107.stdout:4/5: mknod d0/c1 0 2024-09-10T10:03:58.313 INFO:tasks.workunit.client.1.smithi107.stdout:4/6: write - no filename 2024-09-10T10:03:58.313 INFO:tasks.workunit.client.1.smithi107.stdout:4/7: dwrite - no filename 2024-09-10T10:03:58.313 INFO:tasks.workunit.client.1.smithi107.stdout:4/8: write - no filename 2024-09-10T10:03:58.314 INFO:tasks.workunit.client.1.smithi107.stdout:7/2: symlink d0/l1 0 2024-09-10T10:03:58.314 INFO:tasks.workunit.client.1.smithi107.stdout:7/3: dwrite - no filename 2024-09-10T10:03:58.314 INFO:tasks.workunit.client.1.smithi107.stdout:7/4: read - no filename 2024-09-10T10:03:58.314 INFO:tasks.workunit.client.1.smithi107.stdout:9/0: mknod c0 0 2024-09-10T10:03:58.314 INFO:tasks.workunit.client.1.smithi107.stdout:9/1: dwrite - no filename 2024-09-10T10:03:58.315 INFO:tasks.workunit.client.1.smithi107.stdout:9/2: dread - no filename 2024-09-10T10:03:58.315 INFO:tasks.workunit.client.1.smithi107.stdout:9/3: dread - no filename 2024-09-10T10:03:58.315 INFO:tasks.workunit.client.1.smithi107.stdout:9/4: fdatasync - no filename 2024-09-10T10:03:58.317 INFO:tasks.workunit.client.1.smithi107.stdout:1/7: write f1 [75471,30915] 0 2024-09-10T10:03:58.318 INFO:tasks.workunit.client.1.smithi107.stdout:4/9: creat d0/f2 x:0 0 0 2024-09-10T10:03:58.318 INFO:tasks.workunit.client.1.smithi107.stdout:6/8: write d0/f2 [855044,39317] 0 2024-09-10T10:03:58.318 INFO:tasks.workunit.client.1.smithi107.stdout:3/4: dread f0 [0,4194304] 0 2024-09-10T10:03:58.320 INFO:tasks.workunit.client.1.smithi107.stdout:5/10: write f0 [1215681,73706] 0 2024-09-10T10:03:58.320 INFO:tasks.workunit.client.1.smithi107.stdout:0/5: dwrite f0 [0,4194304] 0 2024-09-10T10:03:58.321 INFO:tasks.workunit.client.1.smithi107.stdout:1/8: fsync f1 0 2024-09-10T10:03:58.323 INFO:tasks.workunit.client.1.smithi107.stdout:9/5: symlink l1 0 2024-09-10T10:03:58.323 INFO:tasks.workunit.client.1.smithi107.stdout:9/6: read - no filename 2024-09-10T10:03:58.323 INFO:tasks.workunit.client.1.smithi107.stdout:6/9: stat d0/f2 0 2024-09-10T10:03:58.323 INFO:tasks.workunit.client.1.smithi107.stdout:2/7: truncate f0 484828 0 2024-09-10T10:03:58.323 INFO:tasks.workunit.client.1.smithi107.stdout:7/5: rename d0/l1 to d0/l2 0 2024-09-10T10:03:58.325 INFO:tasks.workunit.client.1.smithi107.stdout:3/5: creat f1 x:0 0 0 2024-09-10T10:03:58.325 INFO:tasks.workunit.client.1.smithi107.stdout:3/6: chown f1 23419938 1 2024-09-10T10:03:58.325 INFO:tasks.workunit.client.1.smithi107.stdout:3/7: dread - f1 zero size 2024-09-10T10:03:58.327 INFO:tasks.workunit.client.1.smithi107.stdout:9/7: rename c0 to c2 0 2024-09-10T10:03:58.328 INFO:tasks.workunit.client.1.smithi107.stdout:7/6: symlink d0/l3 0 2024-09-10T10:03:58.329 INFO:tasks.workunit.client.1.smithi107.stdout:0/6: chown f0 492545654 1 2024-09-10T10:03:58.330 INFO:tasks.workunit.client.1.smithi107.stdout:9/8: creat f3 x:0 0 0 2024-09-10T10:03:58.331 INFO:tasks.workunit.client.1.smithi107.stdout:4/10: link d0/c1 d0/c3 0 2024-09-10T10:03:58.333 INFO:tasks.workunit.client.1.smithi107.stdout:0/7: write f0 [3997019,64484] 0 2024-09-10T10:03:58.333 INFO:tasks.workunit.client.1.smithi107.stdout:0/8: rmdir - no directory 2024-09-10T10:03:58.333 INFO:tasks.workunit.client.1.smithi107.stdout:6/10: creat d0/f3 x:0 0 0 2024-09-10T10:03:58.334 INFO:tasks.workunit.client.1.smithi107.stdout:1/9: rename f1 to d2/f5 0 2024-09-10T10:03:58.335 INFO:tasks.workunit.client.1.smithi107.stdout:4/11: dread - d0/f2 zero size 2024-09-10T10:03:58.337 INFO:tasks.workunit.client.1.smithi107.stdout:3/8: dwrite f0 [0,4194304] 0 2024-09-10T10:03:58.342 INFO:tasks.workunit.client.1.smithi107.stdout:4/12: truncate d0/f2 926132 0 2024-09-10T10:03:58.343 INFO:tasks.workunit.client.1.smithi107.stdout:3/9: read f0 [2674875,38859] 0 2024-09-10T10:03:58.343 INFO:tasks.workunit.client.1.smithi107.stdout:2/8: read f0 [68320,77469] 0 2024-09-10T10:03:58.348 INFO:tasks.workunit.client.1.smithi107.stdout:4/13: write d0/f2 [1300085,74120] 0 2024-09-10T10:03:58.353 INFO:tasks.workunit.client.1.smithi107.stdout:0/9: dread f0 [0,4194304] 0 2024-09-10T10:03:58.354 INFO:tasks.workunit.client.1.smithi107.stdout:3/10: creat f2 x:0 0 0 2024-09-10T10:03:58.354 INFO:tasks.workunit.client.1.smithi107.stdout:7/7: stat d0/l2 0 2024-09-10T10:03:58.355 INFO:tasks.workunit.client.1.smithi107.stdout:1/10: dread d2/f4 [0,4194304] 0 2024-09-10T10:03:58.358 INFO:tasks.workunit.client.1.smithi107.stdout:9/9: dwrite f3 [0,4194304] 0 2024-09-10T10:03:58.358 INFO:tasks.workunit.client.1.smithi107.stdout:4/14: creat d0/f4 x:0 0 0 2024-09-10T10:03:58.359 INFO:tasks.workunit.client.1.smithi107.stdout:0/10: creat f1 x:0 0 0 2024-09-10T10:03:58.360 INFO:tasks.workunit.client.1.smithi107.stdout:0/11: write f1 [916899,12542] 0 2024-09-10T10:03:58.364 INFO:tasks.workunit.client.1.smithi107.stdout:6/11: dwrite d0/f3 [0,4194304] 0 2024-09-10T10:03:58.368 INFO:tasks.workunit.client.1.smithi107.stdout:1/11: dread d2/f5 [0,4194304] 0 2024-09-10T10:03:58.368 INFO:tasks.workunit.client.1.smithi107.stdout:7/8: creat d0/f4 x:0 0 0 2024-09-10T10:03:58.369 INFO:tasks.workunit.client.1.smithi107.stdout:9/10: symlink l4 0 2024-09-10T10:03:58.370 INFO:tasks.workunit.client.1.smithi107.stdout:6/12: symlink d0/l4 0 2024-09-10T10:03:58.370 INFO:tasks.workunit.client.1.smithi107.stdout:4/15: rmdir d0 39 2024-09-10T10:03:58.373 INFO:tasks.workunit.client.1.smithi107.stdout:9/11: mkdir d5 0 2024-09-10T10:03:58.374 INFO:tasks.workunit.client.1.smithi107.stdout:1/12: stat d2/f5 0 2024-09-10T10:03:58.377 INFO:tasks.workunit.client.1.smithi107.stdout:6/13: read d0/f2 [407647,1524] 0 2024-09-10T10:03:58.379 INFO:tasks.workunit.client.1.smithi107.stdout:7/9: unlink d0/l3 0 2024-09-10T10:03:58.385 INFO:tasks.workunit.client.1.smithi107.stdout:1/13: fdatasync d2/f4 0 2024-09-10T10:03:58.389 INFO:tasks.workunit.client.1.smithi107.stdout:3/11: dwrite f0 [0,4194304] 0 2024-09-10T10:03:58.390 INFO:tasks.workunit.client.1.smithi107.stdout:2/9: dwrite f0 [0,4194304] 0 2024-09-10T10:03:58.391 INFO:tasks.workunit.client.1.smithi107.stdout:9/12: creat d5/f6 x:0 0 0 2024-09-10T10:03:58.394 INFO:tasks.workunit.client.1.smithi107.stdout:7/10: rename d0/l2 to d0/l5 0 2024-09-10T10:03:58.395 INFO:tasks.workunit.client.1.smithi107.stdout:1/14: write d2/f4 [245086,76133] 0 2024-09-10T10:03:58.395 INFO:tasks.workunit.client.1.smithi107.stdout:3/12: dread - f1 zero size 2024-09-10T10:03:58.396 INFO:tasks.workunit.client.1.smithi107.stdout:0/12: dwrite f1 [0,4194304] 0 2024-09-10T10:03:58.397 INFO:tasks.workunit.client.1.smithi107.stdout:2/10: rename l1 to l2 0 2024-09-10T10:03:58.398 INFO:tasks.workunit.client.1.smithi107.stdout:3/13: dread - f1 zero size 2024-09-10T10:03:58.401 INFO:tasks.workunit.client.1.smithi107.stdout:9/13: write d5/f6 [200858,81692] 0 2024-09-10T10:03:58.404 INFO:tasks.workunit.client.1.smithi107.stdout:7/11: symlink d0/l6 0 2024-09-10T10:03:58.407 INFO:tasks.workunit.client.1.smithi107.stdout:1/15: write d2/f5 [681011,50252] 0 2024-09-10T10:03:58.409 INFO:tasks.workunit.client.1.smithi107.stdout:4/16: dwrite d0/f2 [0,4194304] 0 2024-09-10T10:03:58.410 INFO:tasks.workunit.client.1.smithi107.stdout:9/14: mkdir d5/d7 0 2024-09-10T10:03:58.413 INFO:tasks.workunit.client.1.smithi107.stdout:0/13: write f0 [3584091,99995] 0 2024-09-10T10:03:58.414 INFO:tasks.workunit.client.1.smithi107.stdout:6/14: dwrite d0/f2 [0,4194304] 0 2024-09-10T10:03:58.417 INFO:tasks.workunit.client.1.smithi107.stdout:1/16: mkdir d2/d6 0 2024-09-10T10:03:58.418 INFO:tasks.workunit.client.1.smithi107.stdout:4/17: write d0/f4 [501505,92768] 0 2024-09-10T10:03:58.419 INFO:tasks.workunit.client.1.smithi107.stdout:9/15: rmdir d5 39 2024-09-10T10:03:58.423 INFO:tasks.workunit.client.1.smithi107.stdout:1/17: write d2/f5 [895390,15780] 0 2024-09-10T10:03:58.424 INFO:tasks.workunit.client.1.smithi107.stdout:1/18: chown d2 96659 1 2024-09-10T10:03:58.427 INFO:tasks.workunit.client.1.smithi107.stdout:3/14: getdents . 0 2024-09-10T10:03:58.427 INFO:tasks.workunit.client.1.smithi107.stdout:4/18: creat d0/f5 x:0 0 0 2024-09-10T10:03:58.427 INFO:tasks.workunit.client.1.smithi107.stdout:1/19: rmdir d2 39 2024-09-10T10:03:58.428 INFO:tasks.workunit.client.1.smithi107.stdout:7/12: dwrite d0/f4 [0,4194304] 0 2024-09-10T10:03:58.428 INFO:tasks.workunit.client.1.smithi107.stdout:3/15: read - f2 zero size 2024-09-10T10:03:58.429 INFO:tasks.workunit.client.1.smithi107.stdout:2/11: dread f0 [0,4194304] 0 2024-09-10T10:03:58.429 INFO:tasks.workunit.client.1.smithi107.stdout:9/16: symlink d5/d7/l8 0 2024-09-10T10:03:58.430 INFO:tasks.workunit.client.1.smithi107.stdout:4/19: chown d0/f5 15330 1 2024-09-10T10:03:58.431 INFO:tasks.workunit.client.1.smithi107.stdout:3/16: write f1 [671888,56669] 0 2024-09-10T10:03:58.433 INFO:tasks.workunit.client.1.smithi107.stdout:3/17: chown f1 72889825 1 2024-09-10T10:03:58.434 INFO:tasks.workunit.client.1.smithi107.stdout:9/17: creat d5/d7/f9 x:0 0 0 2024-09-10T10:03:58.434 INFO:tasks.workunit.client.1.smithi107.stdout:4/20: mknod d0/c6 0 2024-09-10T10:03:58.438 INFO:tasks.workunit.client.1.smithi107.stdout:4/21: rename d0/c6 to d0/c7 0 2024-09-10T10:03:58.440 INFO:tasks.workunit.client.1.smithi107.stdout:3/18: link f1 f3 0 2024-09-10T10:03:58.441 INFO:tasks.workunit.client.1.smithi107.stdout:6/15: truncate d0/f2 3093164 0 2024-09-10T10:03:58.445 INFO:tasks.workunit.client.1.smithi107.stdout:1/20: getdents d2 0 2024-09-10T10:03:58.448 INFO:tasks.workunit.client.1.smithi107.stdout:2/12: truncate f0 1686899 0 2024-09-10T10:03:58.450 INFO:tasks.workunit.client.1.smithi107.stdout:9/18: dwrite d5/f6 [0,4194304] 0 2024-09-10T10:03:58.454 INFO:tasks.workunit.client.1.smithi107.stdout:2/13: mkdir d3 0 2024-09-10T10:03:58.457 INFO:tasks.workunit.client.1.smithi107.stdout:1/21: mknod d2/d6/c7 0 2024-09-10T10:03:58.461 INFO:tasks.workunit.client.1.smithi107.stdout:6/16: dread d0/f3 [0,4194304] 0 2024-09-10T10:03:58.461 INFO:tasks.workunit.client.1.smithi107.stdout:4/22: dread d0/f2 [0,4194304] 0 2024-09-10T10:03:58.462 INFO:tasks.workunit.client.1.smithi107.stdout:3/19: dwrite f0 [4194304,4194304] 0 2024-09-10T10:03:58.464 INFO:tasks.workunit.client.1.smithi107.stdout:6/17: unlink d0/l4 0 2024-09-10T10:03:58.464 INFO:tasks.workunit.client.1.smithi107.stdout:2/14: creat d3/f4 x:0 0 0 2024-09-10T10:03:58.465 INFO:tasks.workunit.client.1.smithi107.stdout:7/13: dwrite d0/f4 [4194304,4194304] 0 2024-09-10T10:03:58.465 INFO:tasks.workunit.client.1.smithi107.stdout:1/22: rename d2/d6/c7 to d2/c8 0 2024-09-10T10:03:58.466 INFO:tasks.workunit.client.1.smithi107.stdout:1/23: fdatasync d2/f5 0 2024-09-10T10:03:58.468 INFO:tasks.workunit.client.1.smithi107.stdout:4/23: write d0/f2 [184997,106671] 0 2024-09-10T10:03:58.470 INFO:tasks.workunit.client.1.smithi107.stdout:1/24: write d2/f4 [921921,66858] 0 2024-09-10T10:03:58.473 INFO:tasks.workunit.client.1.smithi107.stdout:9/19: getdents d5 0 2024-09-10T10:03:58.476 INFO:tasks.workunit.client.1.smithi107.stdout:2/15: rmdir d3 39 2024-09-10T10:03:58.476 INFO:tasks.workunit.client.1.smithi107.stdout:1/25: write d2/f5 [230312,111939] 0 2024-09-10T10:03:58.476 INFO:tasks.workunit.client.1.smithi107.stdout:1/26: readlink - no filename 2024-09-10T10:03:58.477 INFO:tasks.workunit.client.1.smithi107.stdout:9/20: mknod d5/ca 0 2024-09-10T10:03:58.478 INFO:tasks.workunit.client.1.smithi107.stdout:4/24: dread d0/f4 [0,4194304] 0 2024-09-10T10:03:58.479 INFO:tasks.workunit.client.1.smithi107.stdout:1/27: chown d2/d6 11564850 1 2024-09-10T10:03:58.482 INFO:tasks.workunit.client.1.smithi107.stdout:7/14: dwrite d0/f4 [0,4194304] 0 2024-09-10T10:03:58.484 INFO:tasks.workunit.client.1.smithi107.stdout:4/25: chown d0/c3 1 1 2024-09-10T10:03:58.486 INFO:tasks.workunit.client.1.smithi107.stdout:1/28: creat d2/f9 x:0 0 0 2024-09-10T10:03:58.487 INFO:tasks.workunit.client.1.smithi107.stdout:7/15: creat d0/f7 x:0 0 0 2024-09-10T10:03:58.489 INFO:tasks.workunit.client.1.smithi107.stdout:6/18: dwrite d0/f3 [0,4194304] 0 2024-09-10T10:03:58.492 INFO:tasks.workunit.client.1.smithi107.stdout:4/26: creat d0/f8 x:0 0 0 2024-09-10T10:03:58.492 INFO:tasks.workunit.client.1.smithi107.stdout:4/27: readlink - no filename 2024-09-10T10:03:58.492 INFO:tasks.workunit.client.1.smithi107.stdout:6/19: chown d0/f3 1 1 2024-09-10T10:03:58.492 INFO:tasks.workunit.client.1.smithi107.stdout:2/16: dread f0 [0,4194304] 0 2024-09-10T10:03:58.493 INFO:tasks.workunit.client.1.smithi107.stdout:7/16: mkdir d0/d8 0 2024-09-10T10:03:58.495 INFO:tasks.workunit.client.1.smithi107.stdout:1/29: rename d2/f9 to d2/d6/fa 0 2024-09-10T10:03:58.495 INFO:tasks.workunit.client.1.smithi107.stdout:4/28: fdatasync d0/f8 0 2024-09-10T10:03:58.498 INFO:tasks.workunit.client.1.smithi107.stdout:3/20: dwrite f3 [0,4194304] 0 2024-09-10T10:03:58.498 INFO:tasks.workunit.client.1.smithi107.stdout:3/21: rmdir - no directory 2024-09-10T10:03:58.499 INFO:tasks.workunit.client.1.smithi107.stdout:7/17: write d0/f7 [879041,70185] 0 2024-09-10T10:03:58.503 INFO:tasks.workunit.client.1.smithi107.stdout:1/30: creat d2/d6/fb x:0 0 0 2024-09-10T10:03:58.503 INFO:tasks.workunit.client.1.smithi107.stdout:1/31: readlink - no filename 2024-09-10T10:03:58.503 INFO:tasks.workunit.client.1.smithi107.stdout:4/29: rename d0/c1 to d0/c9 0 2024-09-10T10:03:58.504 INFO:tasks.workunit.client.1.smithi107.stdout:6/20: dread d0/f3 [0,4194304] 0 2024-09-10T10:03:58.507 INFO:tasks.workunit.client.1.smithi107.stdout:1/32: chown d2/c8 742 1 2024-09-10T10:03:58.508 INFO:tasks.workunit.client.1.smithi107.stdout:3/22: dread f3 [0,4194304] 0 2024-09-10T10:03:58.508 INFO:tasks.workunit.client.1.smithi107.stdout:6/21: mknod d0/c5 0 2024-09-10T10:03:58.509 INFO:tasks.workunit.client.1.smithi107.stdout:7/18: mkdir d0/d8/d9 0 2024-09-10T10:03:58.511 INFO:tasks.workunit.client.1.smithi107.stdout:1/33: fsync d2/d6/fb 0 2024-09-10T10:03:58.513 INFO:tasks.workunit.client.1.smithi107.stdout:6/22: rename d0/f3 to d0/f6 0 2024-09-10T10:03:58.514 INFO:tasks.workunit.client.1.smithi107.stdout:1/34: read - d2/d6/fa zero size 2024-09-10T10:03:58.515 INFO:tasks.workunit.client.1.smithi107.stdout:4/30: dwrite d0/f2 [4194304,4194304] 0 2024-09-10T10:03:58.518 INFO:tasks.workunit.client.1.smithi107.stdout:4/31: rmdir d0 39 2024-09-10T10:03:58.518 INFO:tasks.workunit.client.1.smithi107.stdout:3/23: dread f1 [0,4194304] 0 2024-09-10T10:03:58.520 INFO:tasks.workunit.client.1.smithi107.stdout:1/35: creat d2/d6/fc x:0 0 0 2024-09-10T10:03:58.522 INFO:tasks.workunit.client.1.smithi107.stdout:1/36: dread - d2/d6/fc zero size 2024-09-10T10:03:58.524 INFO:tasks.workunit.client.1.smithi107.stdout:7/19: dwrite d0/f4 [4194304,4194304] 0 2024-09-10T10:03:58.526 INFO:tasks.workunit.client.1.smithi107.stdout:4/32: truncate d0/f5 473792 0 2024-09-10T10:03:58.526 INFO:tasks.workunit.client.1.smithi107.stdout:1/37: read - d2/d6/fa zero size 2024-09-10T10:03:58.526 INFO:tasks.workunit.client.1.smithi107.stdout:6/23: dread d0/f2 [0,4194304] 0 2024-09-10T10:03:58.528 INFO:tasks.workunit.client.1.smithi107.stdout:4/33: fdatasync d0/f5 0 2024-09-10T10:03:58.528 INFO:tasks.workunit.client.1.smithi107.stdout:3/24: write f3 [5202998,39225] 0 2024-09-10T10:03:58.532 INFO:tasks.workunit.client.1.smithi107.stdout:1/38: mkdir d2/dd 0 2024-09-10T10:03:58.533 INFO:tasks.workunit.client.1.smithi107.stdout:4/34: write d0/f8 [875718,70406] 0 2024-09-10T10:03:58.539 INFO:tasks.workunit.client.1.smithi107.stdout:6/24: dread d0/f6 [0,4194304] 0 2024-09-10T10:03:58.539 INFO:tasks.workunit.client.1.smithi107.stdout:1/39: truncate d2/d6/fb 1039920 0 2024-09-10T10:03:58.541 INFO:tasks.workunit.client.1.smithi107.stdout:4/35: link d0/f5 d0/fa 0 2024-09-10T10:03:58.542 INFO:tasks.workunit.client.1.smithi107.stdout:6/25: symlink d0/l7 0 2024-09-10T10:03:58.542 INFO:tasks.workunit.client.1.smithi107.stdout:3/25: dread f0 [4194304,4194304] 0 2024-09-10T10:03:58.543 INFO:tasks.workunit.client.1.smithi107.stdout:1/40: symlink d2/le 0 2024-09-10T10:03:58.545 INFO:tasks.workunit.client.1.smithi107.stdout:7/20: dwrite d0/f7 [0,4194304] 0 2024-09-10T10:03:58.547 INFO:tasks.workunit.client.1.smithi107.stdout:3/26: creat f4 x:0 0 0 2024-09-10T10:03:58.548 INFO:tasks.workunit.client.1.smithi107.stdout:7/21: unlink d0/l6 0 2024-09-10T10:03:58.550 INFO:tasks.workunit.client.1.smithi107.stdout:7/22: stat d0/f7 0 2024-09-10T10:03:58.551 INFO:tasks.workunit.client.1.smithi107.stdout:4/36: link d0/f8 d0/fb 0 2024-09-10T10:03:58.554 INFO:tasks.workunit.client.1.smithi107.stdout:1/41: rmdir d2/dd 0 2024-09-10T10:03:58.557 INFO:tasks.workunit.client.1.smithi107.stdout:7/23: unlink d0/l5 0 2024-09-10T10:03:58.559 INFO:tasks.workunit.client.1.smithi107.stdout:3/27: dwrite f4 [0,4194304] 0 2024-09-10T10:03:58.559 INFO:tasks.workunit.client.1.smithi107.stdout:3/28: rmdir - no directory 2024-09-10T10:03:58.562 INFO:tasks.workunit.client.1.smithi107.stdout:1/42: dread d2/f5 [0,4194304] 0 2024-09-10T10:03:58.562 INFO:tasks.workunit.client.1.smithi107.stdout:3/29: mknod c5 0 2024-09-10T10:03:58.564 INFO:tasks.workunit.client.1.smithi107.stdout:6/26: getdents d0 0 2024-09-10T10:03:58.567 INFO:tasks.workunit.client.1.smithi107.stdout:3/30: rename c5 to c6 0 2024-09-10T10:03:58.567 INFO:tasks.workunit.client.1.smithi107.stdout:3/31: rmdir - no directory 2024-09-10T10:03:58.568 INFO:tasks.workunit.client.1.smithi107.stdout:1/43: rename d2/f4 to d2/ff 0 2024-09-10T10:03:58.570 INFO:tasks.workunit.client.1.smithi107.stdout:1/44: stat d2/d6/fb 0 2024-09-10T10:03:58.570 INFO:tasks.workunit.client.1.smithi107.stdout:7/24: dwrite d0/f7 [0,4194304] 0 2024-09-10T10:03:58.571 INFO:tasks.workunit.client.1.smithi107.stdout:3/32: creat f7 x:0 0 0 2024-09-10T10:03:58.573 INFO:tasks.workunit.client.1.smithi107.stdout:1/45: creat d2/f10 x:0 0 0 2024-09-10T10:03:58.573 INFO:tasks.workunit.client.1.smithi107.stdout:6/27: dread d0/f6 [0,4194304] 0 2024-09-10T10:03:58.574 INFO:tasks.workunit.client.1.smithi107.stdout:1/46: fsync d2/d6/fb 0 2024-09-10T10:03:58.574 INFO:tasks.workunit.client.1.smithi107.stdout:1/47: chown d2 228 1 2024-09-10T10:03:58.575 INFO:tasks.workunit.client.1.smithi107.stdout:3/33: creat f8 x:0 0 0 2024-09-10T10:03:58.577 INFO:tasks.workunit.client.1.smithi107.stdout:1/48: chown d2/f10 104045187 1 2024-09-10T10:03:58.577 INFO:tasks.workunit.client.1.smithi107.stdout:7/25: dread d0/f4 [0,4194304] 0 2024-09-10T10:03:58.578 INFO:tasks.workunit.client.1.smithi107.stdout:1/49: fsync d2/d6/fb 0 2024-09-10T10:03:58.578 INFO:tasks.workunit.client.1.smithi107.stdout:3/34: rename f8 to f9 0 2024-09-10T10:03:58.578 INFO:tasks.workunit.client.1.smithi107.stdout:6/28: dread d0/f2 [0,4194304] 0 2024-09-10T10:03:58.579 INFO:tasks.workunit.client.1.smithi107.stdout:7/26: fdatasync d0/f4 0 2024-09-10T10:03:58.579 INFO:tasks.workunit.client.1.smithi107.stdout:1/50: fdatasync d2/f10 0 2024-09-10T10:03:58.581 INFO:tasks.workunit.client.1.smithi107.stdout:7/27: write d0/f7 [2103094,128376] 0 2024-09-10T10:03:58.582 INFO:tasks.workunit.client.1.smithi107.stdout:3/35: link f4 fa 0 2024-09-10T10:03:58.587 INFO:tasks.workunit.client.1.smithi107.stdout:3/36: link f0 fb 0 2024-09-10T10:03:58.593 INFO:tasks.workunit.client.1.smithi107.stdout:6/29: dwrite d0/f6 [0,4194304] 0 2024-09-10T10:03:58.596 INFO:tasks.workunit.client.1.smithi107.stdout:1/51: dwrite d2/ff [0,4194304] 0 2024-09-10T10:03:58.596 INFO:tasks.workunit.client.1.smithi107.stdout:7/28: dread d0/f7 [0,4194304] 0 2024-09-10T10:03:58.596 INFO:tasks.workunit.client.1.smithi107.stdout:6/30: chown d0/f2 11 1 2024-09-10T10:03:58.598 INFO:tasks.workunit.client.1.smithi107.stdout:7/29: mknod d0/ca 0 2024-09-10T10:03:58.599 INFO:tasks.workunit.client.1.smithi107.stdout:1/52: rmdir d2/d6 39 2024-09-10T10:03:58.600 INFO:tasks.workunit.client.1.smithi107.stdout:3/37: dread fa [0,4194304] 0 2024-09-10T10:03:58.601 INFO:tasks.workunit.client.1.smithi107.stdout:6/31: creat d0/f8 x:0 0 0 2024-09-10T10:03:58.603 INFO:tasks.workunit.client.1.smithi107.stdout:3/38: unlink f3 0 2024-09-10T10:03:58.604 INFO:tasks.workunit.client.1.smithi107.stdout:7/30: dread d0/f4 [4194304,4194304] 0 2024-09-10T10:03:58.604 INFO:tasks.workunit.client.1.smithi107.stdout:1/53: unlink c0 0 2024-09-10T10:03:58.608 INFO:tasks.workunit.client.1.smithi107.stdout:7/31: creat d0/fb x:0 0 0 2024-09-10T10:03:58.609 INFO:tasks.workunit.client.1.smithi107.stdout:1/54: mknod d2/c11 0 2024-09-10T10:03:58.610 INFO:tasks.workunit.client.1.smithi107.stdout:6/32: dwrite d0/f6 [0,4194304] 0 2024-09-10T10:03:58.611 INFO:tasks.workunit.client.1.smithi107.stdout:7/32: write d0/fb [856445,95018] 0 2024-09-10T10:03:58.614 INFO:tasks.workunit.client.1.smithi107.stdout:1/55: write d2/d6/fc [175972,99657] 0 2024-09-10T10:03:58.617 INFO:tasks.workunit.client.1.smithi107.stdout:6/33: link d0/c5 d0/c9 0 2024-09-10T10:03:58.619 INFO:tasks.workunit.client.1.smithi107.stdout:6/34: write d0/f8 [454440,112763] 0 2024-09-10T10:03:58.619 INFO:tasks.workunit.client.1.smithi107.stdout:7/33: getdents d0/d8 0 2024-09-10T10:03:58.622 INFO:tasks.workunit.client.1.smithi107.stdout:7/34: mkdir d0/d8/dc 0 2024-09-10T10:03:58.623 INFO:tasks.workunit.client.1.smithi107.stdout:7/35: chown d0/f4 1588670 1 2024-09-10T10:03:58.624 INFO:tasks.workunit.client.1.smithi107.stdout:6/35: dread d0/f2 [0,4194304] 0 2024-09-10T10:03:58.625 INFO:tasks.workunit.client.1.smithi107.stdout:7/36: write d0/f4 [5339036,12271] 0 2024-09-10T10:03:58.627 INFO:tasks.workunit.client.1.smithi107.stdout:6/36: creat d0/fa x:0 0 0 2024-09-10T10:03:58.631 INFO:tasks.workunit.client.1.smithi107.stdout:3/39: dwrite f4 [4194304,4194304] 0 2024-09-10T10:03:58.634 INFO:tasks.workunit.client.1.smithi107.stdout:3/40: unlink fb 0 2024-09-10T10:03:58.638 INFO:tasks.workunit.client.1.smithi107.stdout:3/41: dread fa [4194304,4194304] 0 2024-09-10T10:03:58.638 INFO:tasks.workunit.client.1.smithi107.stdout:6/37: truncate d0/f2 892345 0 2024-09-10T10:03:58.639 INFO:tasks.workunit.client.1.smithi107.stdout:7/37: truncate d0/fb 854482 0 2024-09-10T10:03:58.642 INFO:tasks.workunit.client.1.smithi107.stdout:7/38: write d0/f7 [3078514,44573] 0 2024-09-10T10:03:58.647 INFO:tasks.workunit.client.1.smithi107.stdout:6/38: dwrite d0/fa [0,4194304] 0 2024-09-10T10:03:58.650 INFO:tasks.workunit.client.1.smithi107.stdout:3/42: dread f0 [0,4194304] 0 2024-09-10T10:03:58.658 INFO:tasks.workunit.client.1.smithi107.stdout:6/39: dwrite d0/fa [0,4194304] 0 2024-09-10T10:03:58.669 INFO:tasks.workunit.client.1.smithi107.stdout:7/39: dread d0/fb [0,4194304] 0 2024-09-10T10:03:58.676 INFO:tasks.workunit.client.1.smithi107.stdout:6/40: dread d0/f2 [0,4194304] 0 2024-09-10T10:03:58.677 INFO:tasks.workunit.client.1.smithi107.stdout:7/40: dwrite d0/f7 [0,4194304] 0 2024-09-10T10:03:58.680 INFO:tasks.workunit.client.1.smithi107.stdout:7/41: symlink d0/d8/ld 0 2024-09-10T10:03:58.681 INFO:tasks.workunit.client.1.smithi107.stdout:3/43: dwrite f1 [4194304,4194304] 0 2024-09-10T10:03:58.681 INFO:tasks.workunit.client.1.smithi107.stdout:3/44: readlink - no filename 2024-09-10T10:03:58.685 INFO:tasks.workunit.client.1.smithi107.stdout:3/45: mkdir dc 0 2024-09-10T10:03:58.694 INFO:tasks.workunit.client.1.smithi107.stdout:3/46: write f0 [8879458,121319] 0 2024-09-10T10:03:58.696 INFO:tasks.workunit.client.1.smithi107.stdout:3/47: mkdir dc/dd 0 2024-09-10T10:03:58.697 INFO:tasks.workunit.client.1.smithi107.stdout:3/48: dread - f2 zero size 2024-09-10T10:03:58.699 INFO:tasks.workunit.client.1.smithi107.stdout:3/49: mknod dc/dd/ce 0 2024-09-10T10:03:58.702 INFO:tasks.workunit.client.1.smithi107.stdout:3/50: dread f0 [4194304,4194304] 0 2024-09-10T10:03:59.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:03:59.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:03:59.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:03:59.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:58 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:03:59.125 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:03:59.125 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:03:59.125 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:03:59.125 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:58 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:04:00.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:59 smithi071 ceph-mon[27559]: pgmap v250: 65 pgs: 65 active+clean; 185 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 533 op/s 2024-09-10T10:04:00.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:03:59 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:04:00.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:59 smithi107 ceph-mon[34215]: pgmap v250: 65 pgs: 65 active+clean; 185 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 533 op/s 2024-09-10T10:04:00.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:03:59 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:04:01.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.225+0000 7fd8d9582640 1 -- 172.21.15.71:0/70883212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d40fc6f0 msgr2=0x7fd8d40fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:01.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.225+0000 7fd8d9582640 1 --2- 172.21.15.71:0/70883212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d40fc6f0 0x7fd8d40fcb60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80048d0 tx=0x7fd8c8009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.225+0000 7fd8d9582640 1 -- 172.21.15.71:0/70883212 shutdown_connections 2024-09-10T10:04:01.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.225+0000 7fd8d9582640 1 --2- 172.21.15.71:0/70883212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d40fc6f0 0x7fd8d40fcb60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.225+0000 7fd8d9582640 1 --2- 172.21.15.71:0/70883212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d40fb420 0x7fd8d40fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.225+0000 7fd8d9582640 1 -- 172.21.15.71:0/70883212 >> 172.21.15.71:0/70883212 conn(0x7fd8d40f6c00 msgr2=0x7fd8d40f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:01.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.225+0000 7fd8d9582640 1 -- 172.21.15.71:0/70883212 shutdown_connections 2024-09-10T10:04:01.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.225+0000 7fd8d9582640 1 -- 172.21.15.71:0/70883212 wait complete. 2024-09-10T10:04:01.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d9582640 1 Processor -- start 2024-09-10T10:04:01.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d9582640 1 -- start start 2024-09-10T10:04:01.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d9582640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d40fb420 0x7fd8d410fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:01.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d9582640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d40fc6f0 0x7fd8d4112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:01.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d9582640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d40664f0 con 0x7fd8d40fc6f0 2024-09-10T10:04:01.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d9582640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d4066660 con 0x7fd8d40fb420 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d27fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d40fc6f0 0x7fd8d4112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d27fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d40fc6f0 0x7fd8d4112300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50054/0 (socket says 172.21.15.71:50054) 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d27fc640 1 -- 172.21.15.71:0/799518766 learned_addr learned my addr 172.21.15.71:0/799518766 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d2ffd640 1 --2- 172.21.15.71:0/799518766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d40fb420 0x7fd8d410fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d27fc640 1 -- 172.21.15.71:0/799518766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d40fb420 msgr2=0x7fd8d410fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d27fc640 1 --2- 172.21.15.71:0/799518766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d40fb420 0x7fd8d410fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d27fc640 1 -- 172.21.15.71:0/799518766 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c8005040 con 0x7fd8d40fc6f0 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.226+0000 7fd8d2ffd640 1 --2- 172.21.15.71:0/799518766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d40fb420 0x7fd8d410fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.227+0000 7fd8d27fc640 1 --2- 172.21.15.71:0/799518766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d40fc6f0 0x7fd8d4112300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80048a0 tx=0x7fd8c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.227+0000 7fd8bb7fe640 1 -- 172.21.15.71:0/799518766 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c8038070 con 0x7fd8d40fc6f0 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.227+0000 7fd8d9582640 1 -- 172.21.15.71:0/799518766 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d4112840 con 0x7fd8d40fc6f0 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.227+0000 7fd8bb7fe640 1 -- 172.21.15.71:0/799518766 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd8c8004290 con 0x7fd8d40fc6f0 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.227+0000 7fd8bb7fe640 1 -- 172.21.15.71:0/799518766 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c8033660 con 0x7fd8d40fc6f0 2024-09-10T10:04:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.227+0000 7fd8d9582640 1 -- 172.21.15.71:0/799518766 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d4112db0 con 0x7fd8d40fc6f0 2024-09-10T10:04:01.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.228+0000 7fd8d9582640 1 -- 172.21.15.71:0/799518766 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d40fa880 con 0x7fd8d40fc6f0 2024-09-10T10:04:01.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.228+0000 7fd8bb7fe640 1 -- 172.21.15.71:0/799518766 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 20) v1 ==== 91408+0+0 (secure 0 0 0) 0x7fd8c8030020 con 0x7fd8d40fc6f0 2024-09-10T10:04:01.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.229+0000 7fd8bb7fe640 1 --2- 172.21.15.71:0/799518766 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd8bc06e380 0x7fd8bc070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:01.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.229+0000 7fd8bb7fe640 1 -- 172.21.15.71:0/799518766 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd8c80ad9e0 con 0x7fd8d40fc6f0 2024-09-10T10:04:01.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.229+0000 7fd8d2ffd640 1 --2- 172.21.15.71:0/799518766 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd8bc06e380 0x7fd8bc070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:01.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.229+0000 7fd8d2ffd640 1 --2- 172.21.15.71:0/799518766 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd8bc06e380 0x7fd8bc070830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40661e0 tx=0x7fd8c400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:01.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.233+0000 7fd8bb7fe640 1 -- 172.21.15.71:0/799518766 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd8c807ab60 con 0x7fd8d40fc6f0 2024-09-10T10:04:01.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.404+0000 7fd8d9582640 1 -- 172.21.15.71:0/799518766 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8d4100b10 con 0x7fd8bc06e380 2024-09-10T10:04:01.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.405+0000 7fd8bb7fe640 1 -- 172.21.15.71:0/799518766 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fd8d4100b10 con 0x7fd8bc06e380 2024-09-10T10:04:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.407+0000 7fd8d9582640 1 -- 172.21.15.71:0/799518766 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd8bc06e380 msgr2=0x7fd8bc070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.407+0000 7fd8d9582640 1 --2- 172.21.15.71:0/799518766 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd8bc06e380 0x7fd8bc070830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40661e0 tx=0x7fd8c400b040 comp rx=0 tx=0).stop 2024-09-10T10:04:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.407+0000 7fd8d9582640 1 -- 172.21.15.71:0/799518766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d40fc6f0 msgr2=0x7fd8d4112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.407+0000 7fd8d9582640 1 --2- 172.21.15.71:0/799518766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d40fc6f0 0x7fd8d4112300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80048a0 tx=0x7fd8c8009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.407+0000 7fd8d9582640 1 -- 172.21.15.71:0/799518766 shutdown_connections 2024-09-10T10:04:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.407+0000 7fd8d9582640 1 --2- 172.21.15.71:0/799518766 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fd8bc06e380 0x7fd8bc070830 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.407+0000 7fd8d9582640 1 --2- 172.21.15.71:0/799518766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d40fc6f0 0x7fd8d4112300 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.407+0000 7fd8d9582640 1 --2- 172.21.15.71:0/799518766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d40fb420 0x7fd8d410fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.407+0000 7fd8d9582640 1 -- 172.21.15.71:0/799518766 >> 172.21.15.71:0/799518766 conn(0x7fd8d40f6c00 msgr2=0x7fd8d40f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.408+0000 7fd8d9582640 1 -- 172.21.15.71:0/799518766 shutdown_connections 2024-09-10T10:04:01.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.408+0000 7fd8d9582640 1 -- 172.21.15.71:0/799518766 wait complete. 2024-09-10T10:04:01.417 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:04:01.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.499+0000 7fdc491c4640 1 -- 172.21.15.71:0/2867923590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc440ff740 msgr2=0x7fdc44101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:01.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.499+0000 7fdc491c4640 1 --2- 172.21.15.71:0/2867923590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc440ff740 0x7fdc44101b20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdc380048d0 tx=0x7fdc38009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.499+0000 7fdc491c4640 1 -- 172.21.15.71:0/2867923590 shutdown_connections 2024-09-10T10:04:01.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.499+0000 7fdc491c4640 1 --2- 172.21.15.71:0/2867923590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc440ff740 0x7fdc44101b20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.499+0000 7fdc491c4640 1 --2- 172.21.15.71:0/2867923590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc44065b80 0x7fdc440ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.499+0000 7fdc491c4640 1 -- 172.21.15.71:0/2867923590 >> 172.21.15.71:0/2867923590 conn(0x7fdc440f6c10 msgr2=0x7fdc440f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:01.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.500+0000 7fdc491c4640 1 -- 172.21.15.71:0/2867923590 shutdown_connections 2024-09-10T10:04:01.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.500+0000 7fdc491c4640 1 -- 172.21.15.71:0/2867923590 wait complete. 2024-09-10T10:04:01.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.500+0000 7fdc491c4640 1 Processor -- start 2024-09-10T10:04:01.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.500+0000 7fdc491c4640 1 -- start start 2024-09-10T10:04:01.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.501+0000 7fdc491c4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc44065b80 0x7fdc4410f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:01.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.501+0000 7fdc491c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc440ff740 0x7fdc4410f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:01.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.501+0000 7fdc491c4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4410fe10 con 0x7fdc44065b80 2024-09-10T10:04:01.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.501+0000 7fdc491c4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc44110630 con 0x7fdc440ff740 2024-09-10T10:04:01.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.501+0000 7fdc42d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc44065b80 0x7fdc4410f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:01.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.501+0000 7fdc42d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc44065b80 0x7fdc4410f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50068/0 (socket says 172.21.15.71:50068) 2024-09-10T10:04:01.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.501+0000 7fdc42d9d640 1 -- 172.21.15.71:0/2117140591 learned_addr learned my addr 172.21.15.71:0/2117140591 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:01.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.501+0000 7fdc4259c640 1 --2- 172.21.15.71:0/2117140591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc440ff740 0x7fdc4410f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:01.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.501+0000 7fdc42d9d640 1 -- 172.21.15.71:0/2117140591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc440ff740 msgr2=0x7fdc4410f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:01.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.501+0000 7fdc42d9d640 1 --2- 172.21.15.71:0/2117140591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc440ff740 0x7fdc4410f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.501+0000 7fdc42d9d640 1 -- 172.21.15.71:0/2117140591 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc38005040 con 0x7fdc44065b80 2024-09-10T10:04:01.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.501+0000 7fdc4259c640 1 --2- 172.21.15.71:0/2117140591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc440ff740 0x7fdc4410f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:04:01.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.501+0000 7fdc42d9d640 1 --2- 172.21.15.71:0/2117140591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc44065b80 0x7fdc4410f280 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400eb70 tx=0x7fdc3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:01.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.502+0000 7fdc2b7fe640 1 -- 172.21.15.71:0/2117140591 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc34007c30 con 0x7fdc44065b80 2024-09-10T10:04:01.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.502+0000 7fdc491c4640 1 -- 172.21.15.71:0/2117140591 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc441108c0 con 0x7fdc44065b80 2024-09-10T10:04:01.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.502+0000 7fdc491c4640 1 -- 172.21.15.71:0/2117140591 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc44110e60 con 0x7fdc44065b80 2024-09-10T10:04:01.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.502+0000 7fdc2b7fe640 1 -- 172.21.15.71:0/2117140591 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdc3400f040 con 0x7fdc44065b80 2024-09-10T10:04:01.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.503+0000 7fdc2b7fe640 1 -- 172.21.15.71:0/2117140591 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc34009290 con 0x7fdc44065b80 2024-09-10T10:04:01.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.503+0000 7fdc491c4640 1 -- 172.21.15.71:0/2117140591 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc30005210 con 0x7fdc44065b80 2024-09-10T10:04:01.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.504+0000 7fdc2b7fe640 1 -- 172.21.15.71:0/2117140591 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 20) v1 ==== 91408+0+0 (secure 0 0 0) 0x7fdc3400c710 con 0x7fdc44065b80 2024-09-10T10:04:01.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.504+0000 7fdc2b7fe640 1 --2- 172.21.15.71:0/2117140591 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdc2c06e180 0x7fdc2c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:01.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.504+0000 7fdc4259c640 1 --2- 172.21.15.71:0/2117140591 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdc2c06e180 0x7fdc2c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:01.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.505+0000 7fdc2b7fe640 1 -- 172.21.15.71:0/2117140591 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdc3408d7d0 con 0x7fdc44065b80 2024-09-10T10:04:01.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.505+0000 7fdc4259c640 1 --2- 172.21.15.71:0/2117140591 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdc2c06e180 0x7fdc2c070630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009ac0 tx=0x7fdc38035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:01.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.510+0000 7fdc2b7fe640 1 -- 172.21.15.71:0/2117140591 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdc3405a920 con 0x7fdc44065b80 2024-09-10T10:04:01.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.743+0000 7fdc491c4640 1 -- 172.21.15.71:0/2117140591 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc30000bc0 con 0x7fdc2c06e180 2024-09-10T10:04:01.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.744+0000 7fdc2b7fe640 1 -- 172.21.15.71:0/2117140591 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fdc30000bc0 con 0x7fdc2c06e180 2024-09-10T10:04:01.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.747+0000 7fdc491c4640 1 -- 172.21.15.71:0/2117140591 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdc2c06e180 msgr2=0x7fdc2c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:01.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.747+0000 7fdc491c4640 1 --2- 172.21.15.71:0/2117140591 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdc2c06e180 0x7fdc2c070630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009ac0 tx=0x7fdc38035040 comp rx=0 tx=0).stop 2024-09-10T10:04:01.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.747+0000 7fdc491c4640 1 -- 172.21.15.71:0/2117140591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc44065b80 msgr2=0x7fdc4410f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:01.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.747+0000 7fdc491c4640 1 --2- 172.21.15.71:0/2117140591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc44065b80 0x7fdc4410f280 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400eb70 tx=0x7fdc3400b040 comp rx=0 tx=0).stop 2024-09-10T10:04:01.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.747+0000 7fdc491c4640 1 -- 172.21.15.71:0/2117140591 shutdown_connections 2024-09-10T10:04:01.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.747+0000 7fdc491c4640 1 --2- 172.21.15.71:0/2117140591 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7fdc2c06e180 0x7fdc2c070630 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.747+0000 7fdc491c4640 1 --2- 172.21.15.71:0/2117140591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdc440ff740 0x7fdc4410f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.747+0000 7fdc491c4640 1 --2- 172.21.15.71:0/2117140591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc44065b80 0x7fdc4410f280 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.747+0000 7fdc491c4640 1 -- 172.21.15.71:0/2117140591 >> 172.21.15.71:0/2117140591 conn(0x7fdc440f6c10 msgr2=0x7fdc440fb380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:01.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.747+0000 7fdc491c4640 1 -- 172.21.15.71:0/2117140591 shutdown_connections 2024-09-10T10:04:01.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.747+0000 7fdc491c4640 1 -- 172.21.15.71:0/2117140591 wait complete. 2024-09-10T10:04:01.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:01 smithi071 ceph-mon[27559]: pgmap v251: 65 pgs: 65 active+clean; 220 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 9.0 MiB/s wr, 468 op/s 2024-09-10T10:04:01.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.842+0000 7f08ec69e640 1 -- 172.21.15.71:0/1048768797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e4065c40 msgr2=0x7f08e40ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:01.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.842+0000 7f08ec69e640 1 --2- 172.21.15.71:0/1048768797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e4065c40 0x7f08e40ff140 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f08e00048d0 tx=0x7f08e0009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.842+0000 7f08ec69e640 1 -- 172.21.15.71:0/1048768797 shutdown_connections 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.842+0000 7f08ec69e640 1 --2- 172.21.15.71:0/1048768797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08e40ff680 0x7f08e4101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.842+0000 7f08ec69e640 1 --2- 172.21.15.71:0/1048768797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e4065c40 0x7f08e40ff140 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.842+0000 7f08ec69e640 1 -- 172.21.15.71:0/1048768797 >> 172.21.15.71:0/1048768797 conn(0x7f08e40f6c10 msgr2=0x7f08e40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.842+0000 7f08ec69e640 1 -- 172.21.15.71:0/1048768797 shutdown_connections 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.842+0000 7f08ec69e640 1 -- 172.21.15.71:0/1048768797 wait complete. 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.843+0000 7f08ec69e640 1 Processor -- start 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.843+0000 7f08ec69e640 1 -- start start 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.843+0000 7f08ec69e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08e4065c40 0x7f08e410f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.843+0000 7f08ec69e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e40ff680 0x7f08e410f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.843+0000 7f08ec69e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e410fea0 con 0x7f08e40ff680 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.843+0000 7f08ec69e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e4110670 con 0x7f08e4065c40 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.843+0000 7f08e9c39640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e40ff680 0x7f08e410f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.843+0000 7f08e9c39640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e40ff680 0x7f08e410f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50082/0 (socket says 172.21.15.71:50082) 2024-09-10T10:04:01.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.843+0000 7f08e9c39640 1 -- 172.21.15.71:0/2596799885 learned_addr learned my addr 172.21.15.71:0/2596799885 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:01.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.843+0000 7f08ea43a640 1 --2- 172.21.15.71:0/2596799885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08e4065c40 0x7f08e410f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:01.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.843+0000 7f08e9c39640 1 -- 172.21.15.71:0/2596799885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08e4065c40 msgr2=0x7f08e410f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:01.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.843+0000 7f08e9c39640 1 --2- 172.21.15.71:0/2596799885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08e4065c40 0x7f08e410f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:01.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.843+0000 7f08e9c39640 1 -- 172.21.15.71:0/2596799885 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e0005040 con 0x7f08e40ff680 2024-09-10T10:04:01.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.844+0000 7f08e9c39640 1 --2- 172.21.15.71:0/2596799885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e40ff680 0x7f08e410f850 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f08d4002a80 tx=0x7f08d4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:01.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.844+0000 7f08daffd640 1 -- 172.21.15.71:0/2596799885 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d4007c30 con 0x7f08e40ff680 2024-09-10T10:04:01.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.844+0000 7f08daffd640 1 -- 172.21.15.71:0/2596799885 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f08d400f040 con 0x7f08e40ff680 2024-09-10T10:04:01.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.844+0000 7f08ec69e640 1 -- 172.21.15.71:0/2596799885 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e4110900 con 0x7f08e40ff680 2024-09-10T10:04:01.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.844+0000 7f08ec69e640 1 -- 172.21.15.71:0/2596799885 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e4110e20 con 0x7f08e40ff680 2024-09-10T10:04:01.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.844+0000 7f08daffd640 1 -- 172.21.15.71:0/2596799885 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d400dab0 con 0x7f08e40ff680 2024-09-10T10:04:01.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.845+0000 7f08ec69e640 1 -- 172.21.15.71:0/2596799885 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c8005210 con 0x7f08e40ff680 2024-09-10T10:04:01.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.846+0000 7f08daffd640 1 -- 172.21.15.71:0/2596799885 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 20) v1 ==== 91408+0+0 (secure 0 0 0) 0x7f08d400dcf0 con 0x7f08e40ff680 2024-09-10T10:04:01.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.847+0000 7f08daffd640 1 --2- 172.21.15.71:0/2596799885 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f08d006e380 0x7f08d0070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:01.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.847+0000 7f08daffd640 1 -- 172.21.15.71:0/2596799885 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f08d408d010 con 0x7f08e40ff680 2024-09-10T10:04:01.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.847+0000 7f08ea43a640 1 --2- 172.21.15.71:0/2596799885 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f08d006e380 0x7f08d0070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:01.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.847+0000 7f08ea43a640 1 --2- 172.21.15.71:0/2596799885 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f08d006e380 0x7f08d0070830 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f08e0000c00 tx=0x7f08e0035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:01.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:01.852+0000 7f08daffd640 1 -- 172.21.15.71:0/2596799885 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f08d405a210 con 0x7f08e40ff680 2024-09-10T10:04:02.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.068+0000 7f08ec69e640 1 -- 172.21.15.71:0/2596799885 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f08c8000bc0 con 0x7f08d006e380 2024-09-10T10:04:02.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.080+0000 7f08daffd640 1 -- 172.21.15.71:0/2596799885 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f08c8000bc0 con 0x7f08d006e380 2024-09-10T10:04:02.081 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:04:02.081 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (6m) 2m ago 7m 25.4M - 0.25.0 c8568f914cd2 b3a4270190ef 2024-09-10T10:04:02.081 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (8m) 2m ago 8m 6891k - 17.2.7-1597-g96d63e75 f3fc7d52e233 f70481a4c3c7 2024-09-10T10:04:02.081 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (7m) 4s ago 7m 6895k - 17.2.7-1597-g96d63e75 f3fc7d52e233 cf27ebcc0f98 2024-09-10T10:04:02.081 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (6m) 2m ago 7m 81.4M - 9.4.7 954c08fa6188 1998c9de2d92 2024-09-10T10:04:02.081 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (2m) 2m ago 2m 16.6M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:04:02.081 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (2m) 2m ago 2m 11.8M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (2m) 4s ago 2m 59.2M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (2m) 4s ago 2m 38.4M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:9283,8765,8443 running (9m) 2m ago 9m 449M - 17.2.7-1597-g96d63e75 f3fc7d52e233 dc0e497fa11e 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283 running (29s) 4s ago 6m 109M - 19.1.1-305-g1cf819b7 41d671128357 7eef59ade56b 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (9m) 2m ago 9m 49.6M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 35e491e574a3 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (6m) 4s ago 6m 36.9M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 682e2b6e311f 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (8m) 2m ago 8m 16.1M - 1.5.0 0da6a335fe13 acc088fb47d4 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (7m) 4s ago 7m 15.4M - 1.5.0 0da6a335fe13 12be03d3d11f 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (6m) 2m ago 6m 46.5M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 a79e69c9b514 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (5m) 2m ago 5m 44.4M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 44a84bf577da 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (5m) 2m ago 5m 42.9M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 4fae52756a24 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (4m) 4s ago 4m 92.2M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (4m) 4s ago 4m 87.2M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:04:02.082 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (3m) 4s ago 3m 87.7M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:04:02.083 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (6m) 2m ago 7m 56.1M - 2.43.0 a07b618ecd1d 1a619aeb5698 2024-09-10T10:04:02.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.082+0000 7f08ec69e640 1 -- 172.21.15.71:0/2596799885 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f08d006e380 msgr2=0x7f08d0070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:02.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.082+0000 7f08ec69e640 1 --2- 172.21.15.71:0/2596799885 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f08d006e380 0x7f08d0070830 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f08e0000c00 tx=0x7f08e0035040 comp rx=0 tx=0).stop 2024-09-10T10:04:02.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.082+0000 7f08ec69e640 1 -- 172.21.15.71:0/2596799885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e40ff680 msgr2=0x7f08e410f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:02.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.082+0000 7f08ec69e640 1 --2- 172.21.15.71:0/2596799885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e40ff680 0x7f08e410f850 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f08d4002a80 tx=0x7f08d4004600 comp rx=0 tx=0).stop 2024-09-10T10:04:02.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.082+0000 7f08ec69e640 1 -- 172.21.15.71:0/2596799885 shutdown_connections 2024-09-10T10:04:02.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.082+0000 7f08ec69e640 1 --2- 172.21.15.71:0/2596799885 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f08d006e380 0x7f08d0070830 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.082+0000 7f08ec69e640 1 --2- 172.21.15.71:0/2596799885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08e40ff680 0x7f08e410f850 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.082+0000 7f08ec69e640 1 --2- 172.21.15.71:0/2596799885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08e4065c40 0x7f08e410f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.082+0000 7f08ec69e640 1 -- 172.21.15.71:0/2596799885 >> 172.21.15.71:0/2596799885 conn(0x7f08e40f6c10 msgr2=0x7f08e40fb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:02.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.082+0000 7f08ec69e640 1 -- 172.21.15.71:0/2596799885 shutdown_connections 2024-09-10T10:04:02.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.082+0000 7f08ec69e640 1 -- 172.21.15.71:0/2596799885 wait complete. 2024-09-10T10:04:02.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:01 smithi107 ceph-mon[34215]: pgmap v251: 65 pgs: 65 active+clean; 220 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 9.0 MiB/s wr, 468 op/s 2024-09-10T10:04:02.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.177+0000 7f8e3745e640 1 -- 172.21.15.71:0/604080920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e300fd820 msgr2=0x7f8e300fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:02.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.177+0000 7f8e3745e640 1 --2- 172.21.15.71:0/604080920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e300fd820 0x7f8e300fdc90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8e200048d0 tx=0x7f8e20009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.177+0000 7f8e3745e640 1 -- 172.21.15.71:0/604080920 shutdown_connections 2024-09-10T10:04:02.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.177+0000 7f8e3745e640 1 --2- 172.21.15.71:0/604080920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e300fd820 0x7f8e300fdc90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.177+0000 7f8e3745e640 1 --2- 172.21.15.71:0/604080920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e300fc550 0x7f8e300fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.177+0000 7f8e3745e640 1 -- 172.21.15.71:0/604080920 >> 172.21.15.71:0/604080920 conn(0x7f8e300f7d30 msgr2=0x7f8e300fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:02.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.177+0000 7f8e3745e640 1 -- 172.21.15.71:0/604080920 shutdown_connections 2024-09-10T10:04:02.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.177+0000 7f8e3745e640 1 -- 172.21.15.71:0/604080920 wait complete. 2024-09-10T10:04:02.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.177+0000 7f8e3745e640 1 Processor -- start 2024-09-10T10:04:02.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.177+0000 7f8e3745e640 1 -- start start 2024-09-10T10:04:02.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.178+0000 7f8e3745e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e300fc550 0x7f8e3010d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:02.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.178+0000 7f8e3745e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e300fd820 0x7f8e3010d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:02.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.178+0000 7f8e3745e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3010dc00 con 0x7f8e300fd820 2024-09-10T10:04:02.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.178+0000 7f8e3745e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3010e420 con 0x7f8e300fc550 2024-09-10T10:04:02.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.178+0000 7f8e351fa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e300fc550 0x7f8e3010d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:02.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.178+0000 7f8e351fa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e300fc550 0x7f8e3010d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.71:49782/0 (socket says 172.21.15.71:49782) 2024-09-10T10:04:02.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.178+0000 7f8e351fa640 1 -- 172.21.15.71:0/2932609905 learned_addr learned my addr 172.21.15.71:0/2932609905 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:02.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.178+0000 7f8e349f9640 1 --2- 172.21.15.71:0/2932609905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e300fd820 0x7f8e3010d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:02.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.178+0000 7f8e351fa640 1 -- 172.21.15.71:0/2932609905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e300fd820 msgr2=0x7f8e3010d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:02.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.178+0000 7f8e351fa640 1 --2- 172.21.15.71:0/2932609905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e300fd820 0x7f8e3010d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.178+0000 7f8e351fa640 1 -- 172.21.15.71:0/2932609905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e20005040 con 0x7f8e300fc550 2024-09-10T10:04:02.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.178+0000 7f8e349f9640 1 --2- 172.21.15.71:0/2932609905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e300fd820 0x7f8e3010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:04:02.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.178+0000 7f8e351fa640 1 --2- 172.21.15.71:0/2932609905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e300fc550 0x7f8e3010d070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c002a80 tx=0x7f8e2c004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:02.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.179+0000 7f8e25ffb640 1 -- 172.21.15.71:0/2932609905 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e2c007c30 con 0x7f8e300fc550 2024-09-10T10:04:02.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.179+0000 7f8e25ffb640 1 -- 172.21.15.71:0/2932609905 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8e2c00f040 con 0x7f8e300fc550 2024-09-10T10:04:02.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.179+0000 7f8e3745e640 1 -- 172.21.15.71:0/2932609905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3010e6b0 con 0x7f8e300fc550 2024-09-10T10:04:02.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.179+0000 7f8e25ffb640 1 -- 172.21.15.71:0/2932609905 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e2c0095b0 con 0x7f8e300fc550 2024-09-10T10:04:02.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.179+0000 7f8e3745e640 1 -- 172.21.15.71:0/2932609905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3010ebd0 con 0x7f8e300fc550 2024-09-10T10:04:02.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.180+0000 7f8e3745e640 1 -- 172.21.15.71:0/2932609905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e300fb9b0 con 0x7f8e300fc550 2024-09-10T10:04:02.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.180+0000 7f8e25ffb640 1 -- 172.21.15.71:0/2932609905 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) v1 ==== 91408+0+0 (secure 0 0 0) 0x7f8e2c009710 con 0x7f8e300fc550 2024-09-10T10:04:02.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.181+0000 7f8e25ffb640 1 --2- 172.21.15.71:0/2932609905 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8e1c06e380 0x7f8e1c070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:02.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.181+0000 7f8e25ffb640 1 -- 172.21.15.71:0/2932609905 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8e2c08d2b0 con 0x7f8e300fc550 2024-09-10T10:04:02.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.181+0000 7f8e349f9640 1 --2- 172.21.15.71:0/2932609905 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8e1c06e380 0x7f8e1c070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:02.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.181+0000 7f8e349f9640 1 --2- 172.21.15.71:0/2932609905 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8e1c06e380 0x7f8e1c070830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8e3010ce20 tx=0x7f8e20035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:02.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.185+0000 7f8e25ffb640 1 -- 172.21.15.71:0/2932609905 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8e2c05a390 con 0x7f8e300fc550 2024-09-10T10:04:02.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.450+0000 7f8e3745e640 1 -- 172.21.15.71:0/2932609905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8e3010ef80 con 0x7f8e300fc550 2024-09-10T10:04:02.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.451+0000 7f8e25ffb640 1 -- 172.21.15.71:0/2932609905 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f8e2c059d30 con 0x7f8e300fc550 2024-09-10T10:04:02.453 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:04:02.453 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:04:02.453 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2 2024-09-10T10:04:02.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:04:02.453 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:04:02.453 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 1, 2024-09-10T10:04:02.453 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 1 2024-09-10T10:04:02.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:04:02.454 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:04:02.454 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 6 2024-09-10T10:04:02.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:04:02.454 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:04:02.454 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:04:02.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:04:02.454 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:04:02.454 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 13, 2024-09-10T10:04:02.454 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 1 2024-09-10T10:04:02.454 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:04:02.454 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:04:02.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.454+0000 7f8e3745e640 1 -- 172.21.15.71:0/2932609905 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8e1c06e380 msgr2=0x7f8e1c070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:02.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.454+0000 7f8e3745e640 1 --2- 172.21.15.71:0/2932609905 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8e1c06e380 0x7f8e1c070830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8e3010ce20 tx=0x7f8e20035040 comp rx=0 tx=0).stop 2024-09-10T10:04:02.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.454+0000 7f8e3745e640 1 -- 172.21.15.71:0/2932609905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e300fc550 msgr2=0x7f8e3010d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:02.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.454+0000 7f8e3745e640 1 --2- 172.21.15.71:0/2932609905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e300fc550 0x7f8e3010d070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c002a80 tx=0x7f8e2c004600 comp rx=0 tx=0).stop 2024-09-10T10:04:02.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.454+0000 7f8e3745e640 1 -- 172.21.15.71:0/2932609905 shutdown_connections 2024-09-10T10:04:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.454+0000 7f8e3745e640 1 --2- 172.21.15.71:0/2932609905 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f8e1c06e380 0x7f8e1c070830 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.454+0000 7f8e3745e640 1 --2- 172.21.15.71:0/2932609905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e300fd820 0x7f8e3010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.454+0000 7f8e3745e640 1 --2- 172.21.15.71:0/2932609905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e300fc550 0x7f8e3010d070 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.454+0000 7f8e3745e640 1 -- 172.21.15.71:0/2932609905 >> 172.21.15.71:0/2932609905 conn(0x7f8e300f7d30 msgr2=0x7f8e300f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.454+0000 7f8e3745e640 1 -- 172.21.15.71:0/2932609905 shutdown_connections 2024-09-10T10:04:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.454+0000 7f8e3745e640 1 -- 172.21.15.71:0/2932609905 wait complete. 2024-09-10T10:04:02.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.552+0000 7ff2f6078640 1 -- 172.21.15.71:0/3933634869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f00fd7f0 msgr2=0x7ff2f00fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:02.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.552+0000 7ff2f6078640 1 --2- 172.21.15.71:0/3933634869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f00fd7f0 0x7ff2f00fdc60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40048d0 tx=0x7ff2e4009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.553+0000 7ff2f6078640 1 -- 172.21.15.71:0/3933634869 shutdown_connections 2024-09-10T10:04:02.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.553+0000 7ff2f6078640 1 --2- 172.21.15.71:0/3933634869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f00fd7f0 0x7ff2f00fdc60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.553+0000 7ff2f6078640 1 --2- 172.21.15.71:0/3933634869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2f00fc520 0x7ff2f00fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.553+0000 7ff2f6078640 1 -- 172.21.15.71:0/3933634869 >> 172.21.15.71:0/3933634869 conn(0x7ff2f00f7ce0 msgr2=0x7ff2f00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:02.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.553+0000 7ff2f6078640 1 -- 172.21.15.71:0/3933634869 shutdown_connections 2024-09-10T10:04:02.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.553+0000 7ff2f6078640 1 -- 172.21.15.71:0/3933634869 wait complete. 2024-09-10T10:04:02.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.553+0000 7ff2f6078640 1 Processor -- start 2024-09-10T10:04:02.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.554+0000 7ff2f6078640 1 -- start start 2024-09-10T10:04:02.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.554+0000 7ff2f6078640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2f00fc520 0x7ff2f010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:02.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.554+0000 7ff2f6078640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f00fd7f0 0x7ff2f010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:02.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.554+0000 7ff2f6078640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f010dbf0 con 0x7ff2f00fd7f0 2024-09-10T10:04:02.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.554+0000 7ff2f6078640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f010e410 con 0x7ff2f00fc520 2024-09-10T10:04:02.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.554+0000 7ff2eeffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f00fd7f0 0x7ff2f010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:02.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.554+0000 7ff2ef7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2f00fc520 0x7ff2f010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:02.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.554+0000 7ff2eeffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f00fd7f0 0x7ff2f010d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50118/0 (socket says 172.21.15.71:50118) 2024-09-10T10:04:02.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.554+0000 7ff2eeffd640 1 -- 172.21.15.71:0/330286447 learned_addr learned my addr 172.21.15.71:0/330286447 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:02.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.554+0000 7ff2ef7fe640 1 -- 172.21.15.71:0/330286447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f00fd7f0 msgr2=0x7ff2f010d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.554+0000 7ff2ef7fe640 1 --2- 172.21.15.71:0/330286447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f00fd7f0 0x7ff2f010d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.554+0000 7ff2ef7fe640 1 -- 172.21.15.71:0/330286447 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e4005040 con 0x7ff2f00fc520 2024-09-10T10:04:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.554+0000 7ff2eeffd640 1 --2- 172.21.15.71:0/330286447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f00fd7f0 0x7ff2f010d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:04:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.555+0000 7ff2ef7fe640 1 --2- 172.21.15.71:0/330286447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2f00fc520 0x7ff2f010d060 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000e910 tx=0x7ff2e000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.555+0000 7ff2d7fff640 1 -- 172.21.15.71:0/330286447 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e000eea0 con 0x7ff2f00fc520 2024-09-10T10:04:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.555+0000 7ff2f6078640 1 -- 172.21.15.71:0/330286447 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f010e640 con 0x7ff2f00fc520 2024-09-10T10:04:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.555+0000 7ff2d7fff640 1 -- 172.21.15.71:0/330286447 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff2e000f040 con 0x7ff2f00fc520 2024-09-10T10:04:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.555+0000 7ff2d7fff640 1 -- 172.21.15.71:0/330286447 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e0009410 con 0x7ff2f00fc520 2024-09-10T10:04:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.555+0000 7ff2f6078640 1 -- 172.21.15.71:0/330286447 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f010ebe0 con 0x7ff2f00fc520 2024-09-10T10:04:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.556+0000 7ff2f6078640 1 -- 172.21.15.71:0/330286447 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f00fb980 con 0x7ff2f00fc520 2024-09-10T10:04:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.556+0000 7ff2d7fff640 1 -- 172.21.15.71:0/330286447 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) v1 ==== 91408+0+0 (secure 0 0 0) 0x7ff2e0009640 con 0x7ff2f00fc520 2024-09-10T10:04:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.557+0000 7ff2d7fff640 1 --2- 172.21.15.71:0/330286447 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff2d806e380 0x7ff2d8070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.557+0000 7ff2d7fff640 1 -- 172.21.15.71:0/330286447 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff2e008d3f0 con 0x7ff2f00fc520 2024-09-10T10:04:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.557+0000 7ff2eeffd640 1 --2- 172.21.15.71:0/330286447 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff2d806e380 0x7ff2d8070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.557+0000 7ff2eeffd640 1 --2- 172.21.15.71:0/330286447 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff2d806e380 0x7ff2d8070830 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff2f010ce10 tx=0x7ff2e4035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.562+0000 7ff2d7fff640 1 -- 172.21.15.71:0/330286447 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff2e005a510 con 0x7ff2f00fc520 2024-09-10T10:04:02.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.806+0000 7ff2f6078640 1 -- 172.21.15.71:0/330286447 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff2f010eed0 con 0x7ff2f00fc520 2024-09-10T10:04:02.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.807+0000 7ff2d7fff640 1 -- 172.21.15.71:0/330286447 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1849 (secure 0 0 0) 0x7ff2e0059eb0 con 0x7ff2f00fc520 2024-09-10T10:04:02.808 INFO:teuthology.orchestra.run.smithi071.stdout:e21 2024-09-10T10:04:02.808 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:04:02.808 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:04:02.808 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 21 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:03:24.004737+0000 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:04:02.809 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:04:02.810 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:04:02.810 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:04:02.810 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:04:02.810 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:04:02.810 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:04:02.810 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:04:02.810 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:04:02.810 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:04:02.810 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:04:02.810 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:04:02.810 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:04:02.810 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:04:02.810 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:04:02.811 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:04:02.811 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:04:02.811 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:04:02.811 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:04:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:04:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:04:02.811 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 21 2024-09-10T10:04:02.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.809+0000 7ff2f6078640 1 -- 172.21.15.71:0/330286447 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff2d806e380 msgr2=0x7ff2d8070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:02.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.809+0000 7ff2f6078640 1 --2- 172.21.15.71:0/330286447 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff2d806e380 0x7ff2d8070830 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff2f010ce10 tx=0x7ff2e4035040 comp rx=0 tx=0).stop 2024-09-10T10:04:02.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.809+0000 7ff2f6078640 1 -- 172.21.15.71:0/330286447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2f00fc520 msgr2=0x7ff2f010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:02.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.809+0000 7ff2f6078640 1 --2- 172.21.15.71:0/330286447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2f00fc520 0x7ff2f010d060 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000e910 tx=0x7ff2e000b040 comp rx=0 tx=0).stop 2024-09-10T10:04:02.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.809+0000 7ff2f6078640 1 -- 172.21.15.71:0/330286447 shutdown_connections 2024-09-10T10:04:02.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.809+0000 7ff2f6078640 1 --2- 172.21.15.71:0/330286447 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7ff2d806e380 0x7ff2d8070830 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.809+0000 7ff2f6078640 1 --2- 172.21.15.71:0/330286447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f00fd7f0 0x7ff2f010d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.809+0000 7ff2f6078640 1 --2- 172.21.15.71:0/330286447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2f00fc520 0x7ff2f010d060 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.809+0000 7ff2f6078640 1 -- 172.21.15.71:0/330286447 >> 172.21.15.71:0/330286447 conn(0x7ff2f00f7ce0 msgr2=0x7ff2f00f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:02.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.809+0000 7ff2f6078640 1 -- 172.21.15.71:0/330286447 shutdown_connections 2024-09-10T10:04:02.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.809+0000 7ff2f6078640 1 -- 172.21.15.71:0/330286447 wait complete. 2024-09-10T10:04:02.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:02 smithi107 ceph-mon[34215]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:02.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:02 smithi107 ceph-mon[34215]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:02.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:02 smithi107 ceph-mon[34215]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:02.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:02 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/2932609905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:04:02.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.906+0000 7f635c390640 1 -- 172.21.15.71:0/3884641613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6354066490 msgr2=0x7f63540ff170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:02.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.906+0000 7f635c390640 1 --2- 172.21.15.71:0/3884641613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6354066490 0x7f63540ff170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f63500048d0 tx=0x7f6350009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.906+0000 7f635c390640 1 -- 172.21.15.71:0/3884641613 shutdown_connections 2024-09-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.906+0000 7f635c390640 1 --2- 172.21.15.71:0/3884641613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63540ff6b0 0x7f6354101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.906+0000 7f635c390640 1 --2- 172.21.15.71:0/3884641613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6354066490 0x7f63540ff170 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.906+0000 7f635c390640 1 -- 172.21.15.71:0/3884641613 >> 172.21.15.71:0/3884641613 conn(0x7f63540f6c00 msgr2=0x7f63540f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.906+0000 7f635c390640 1 -- 172.21.15.71:0/3884641613 shutdown_connections 2024-09-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.906+0000 7f635c390640 1 -- 172.21.15.71:0/3884641613 wait complete. 2024-09-10T10:04:02.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.907+0000 7f635c390640 1 Processor -- start 2024-09-10T10:04:02.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.907+0000 7f635c390640 1 -- start start 2024-09-10T10:04:02.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.907+0000 7f635c390640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6354066490 0x7f635410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.907+0000 7f635c390640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63540ff6b0 0x7f635410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.907+0000 7f635c390640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635410dc70 con 0x7f6354066490 2024-09-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.907+0000 7f635c390640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635410e3f0 con 0x7f63540ff6b0 2024-09-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.907+0000 7f635a12c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6354066490 0x7f635410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.907+0000 7f635a12c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6354066490 0x7f635410d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50136/0 (socket says 172.21.15.71:50136) 2024-09-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.907+0000 7f635a12c640 1 -- 172.21.15.71:0/2646183236 learned_addr learned my addr 172.21.15.71:0/2646183236 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.907+0000 7f635992b640 1 --2- 172.21.15.71:0/2646183236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63540ff6b0 0x7f635410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.908+0000 7f635a12c640 1 -- 172.21.15.71:0/2646183236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63540ff6b0 msgr2=0x7f635410d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.908+0000 7f635a12c640 1 --2- 172.21.15.71:0/2646183236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63540ff6b0 0x7f635410d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.908+0000 7f635a12c640 1 -- 172.21.15.71:0/2646183236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6350005040 con 0x7f6354066490 2024-09-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.908+0000 7f635992b640 1 --2- 172.21.15.71:0/2646183236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63540ff6b0 0x7f635410d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.908+0000 7f635a12c640 1 --2- 172.21.15.71:0/2646183236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6354066490 0x7f635410d0e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f63500043d0 tx=0x7f6350009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.908+0000 7f6346ffd640 1 -- 172.21.15.71:0/2646183236 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6350038070 con 0x7f6354066490 2024-09-10T10:04:02.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.908+0000 7f6346ffd640 1 -- 172.21.15.71:0/2646183236 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f635002ae90 con 0x7f6354066490 2024-09-10T10:04:02.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.908+0000 7f635c390640 1 -- 172.21.15.71:0/2646183236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635410e620 con 0x7f6354066490 2024-09-10T10:04:02.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.908+0000 7f6346ffd640 1 -- 172.21.15.71:0/2646183236 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f635003e670 con 0x7f6354066490 2024-09-10T10:04:02.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.908+0000 7f635c390640 1 -- 172.21.15.71:0/2646183236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635410eb40 con 0x7f6354066490 2024-09-10T10:04:02.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.909+0000 7f635c390640 1 -- 172.21.15.71:0/2646183236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63540fa880 con 0x7f6354066490 2024-09-10T10:04:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.910+0000 7f6346ffd640 1 -- 172.21.15.71:0/2646183236 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 20) v1 ==== 91408+0+0 (secure 0 0 0) 0x7f6350030020 con 0x7f6354066490 2024-09-10T10:04:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.910+0000 7f6346ffd640 1 --2- 172.21.15.71:0/2646183236 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f634006e380 0x7f6340070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.910+0000 7f6346ffd640 1 -- 172.21.15.71:0/2646183236 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f63500ada40 con 0x7f6354066490 2024-09-10T10:04:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.911+0000 7f635992b640 1 --2- 172.21.15.71:0/2646183236 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f634006e380 0x7f6340070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:02.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.911+0000 7f635992b640 1 --2- 172.21.15.71:0/2646183236 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f634006e380 0x7f6340070830 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f635410ce90 tx=0x7f634800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:02.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:02.915+0000 7f6346ffd640 1 -- 172.21.15.71:0/2646183236 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f635007ab60 con 0x7f6354066490 2024-09-10T10:04:03.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:02 smithi071 ceph-mon[27559]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:03.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:02 smithi071 ceph-mon[27559]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:03.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:02 smithi071 ceph-mon[27559]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:03.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:02 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/2932609905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:04:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.163+0000 7f635c390640 1 -- 172.21.15.71:0/2646183236 --> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f635410eed0 con 0x7f634006e380 2024-09-10T10:04:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.165+0000 7f6346ffd640 1 -- 172.21.15.71:0/2646183236 <== mgr.14208 v2:172.21.15.71:6800/1474777768 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f635410eed0 con 0x7f634006e380 2024-09-10T10:04:03.166 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:04:03.166 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:04:03.166 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:04:03.166 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:04:03.166 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-10T10:04:03.166 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "1/21 daemons upgraded", 2024-09-10T10:04:03.166 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mgr daemons", 2024-09-10T10:04:03.166 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:04:03.167 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:04:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.167+0000 7f635c390640 1 -- 172.21.15.71:0/2646183236 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f634006e380 msgr2=0x7f6340070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.167+0000 7f635c390640 1 --2- 172.21.15.71:0/2646183236 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f634006e380 0x7f6340070830 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f635410ce90 tx=0x7f634800b040 comp rx=0 tx=0).stop 2024-09-10T10:04:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.167+0000 7f635c390640 1 -- 172.21.15.71:0/2646183236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6354066490 msgr2=0x7f635410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.167+0000 7f635c390640 1 --2- 172.21.15.71:0/2646183236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6354066490 0x7f635410d0e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f63500043d0 tx=0x7f6350009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.167+0000 7f635c390640 1 -- 172.21.15.71:0/2646183236 shutdown_connections 2024-09-10T10:04:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.167+0000 7f635c390640 1 --2- 172.21.15.71:0/2646183236 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f634006e380 0x7f6340070830 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.167+0000 7f635c390640 1 --2- 172.21.15.71:0/2646183236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63540ff6b0 0x7f635410d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.167+0000 7f635c390640 1 --2- 172.21.15.71:0/2646183236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6354066490 0x7f635410d0e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.167+0000 7f635c390640 1 -- 172.21.15.71:0/2646183236 >> 172.21.15.71:0/2646183236 conn(0x7f63540f6c00 msgr2=0x7f63540f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.167+0000 7f635c390640 1 -- 172.21.15.71:0/2646183236 shutdown_connections 2024-09-10T10:04:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.167+0000 7f635c390640 1 -- 172.21.15.71:0/2646183236 wait complete. 2024-09-10T10:04:03.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.245+0000 7f3348971640 1 -- 172.21.15.71:0/3863265739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33440fc700 msgr2=0x7f33440fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:03.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.245+0000 7f3348971640 1 --2- 172.21.15.71:0/3863265739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33440fc700 0x7f33440fcb70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f332c0048d0 tx=0x7f332c009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:03.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.245+0000 7f3348971640 1 -- 172.21.15.71:0/3863265739 shutdown_connections 2024-09-10T10:04:03.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.245+0000 7f3348971640 1 --2- 172.21.15.71:0/3863265739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33440fc700 0x7f33440fcb70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:03.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.245+0000 7f3348971640 1 --2- 172.21.15.71:0/3863265739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33440fb430 0x7f33440fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:03.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.245+0000 7f3348971640 1 -- 172.21.15.71:0/3863265739 >> 172.21.15.71:0/3863265739 conn(0x7f33440f6c10 msgr2=0x7f33440f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:03.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.245+0000 7f3348971640 1 -- 172.21.15.71:0/3863265739 shutdown_connections 2024-09-10T10:04:03.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.245+0000 7f3348971640 1 -- 172.21.15.71:0/3863265739 wait complete. 2024-09-10T10:04:03.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.245+0000 7f3348971640 1 Processor -- start 2024-09-10T10:04:03.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.245+0000 7f3348971640 1 -- start start 2024-09-10T10:04:03.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.246+0000 7f3348971640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33440fb430 0x7f334410fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:03.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.246+0000 7f3348971640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33440fc700 0x7f33441122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:03.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.246+0000 7f3348971640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3344065c60 con 0x7f33440fb430 2024-09-10T10:04:03.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.246+0000 7f3348971640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3344065dd0 con 0x7f33440fc700 2024-09-10T10:04:03.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.246+0000 7f334259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33440fb430 0x7f334410fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:03.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.246+0000 7f334259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33440fb430 0x7f334410fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49038/0 (socket says 172.21.15.71:49038) 2024-09-10T10:04:03.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.246+0000 7f334259c640 1 -- 172.21.15.71:0/2782436076 learned_addr learned my addr 172.21.15.71:0/2782436076 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:03.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.246+0000 7f3341d9b640 1 --2- 172.21.15.71:0/2782436076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33440fc700 0x7f33441122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:03.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.246+0000 7f334259c640 1 -- 172.21.15.71:0/2782436076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33440fc700 msgr2=0x7f33441122d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:03.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.246+0000 7f334259c640 1 --2- 172.21.15.71:0/2782436076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33440fc700 0x7f33441122d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:03.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.246+0000 7f334259c640 1 -- 172.21.15.71:0/2782436076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c005040 con 0x7f33440fb430 2024-09-10T10:04:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.246+0000 7f334259c640 1 --2- 172.21.15.71:0/2782436076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33440fb430 0x7f334410fd80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f333c002a50 tx=0x7f333c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.247+0000 7f333affd640 1 -- 172.21.15.71:0/2782436076 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f333c007c30 con 0x7f33440fb430 2024-09-10T10:04:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.247+0000 7f3348971640 1 -- 172.21.15.71:0/2782436076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3344112870 con 0x7f33440fb430 2024-09-10T10:04:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.247+0000 7f333affd640 1 -- 172.21.15.71:0/2782436076 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f333c00f040 con 0x7f33440fb430 2024-09-10T10:04:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.247+0000 7f333affd640 1 -- 172.21.15.71:0/2782436076 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f333c00dad0 con 0x7f33440fb430 2024-09-10T10:04:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.247+0000 7f3348971640 1 -- 172.21.15.71:0/2782436076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3344112de0 con 0x7f33440fb430 2024-09-10T10:04:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.248+0000 7f3348971640 1 -- 172.21.15.71:0/2782436076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33440fa890 con 0x7f33440fb430 2024-09-10T10:04:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.248+0000 7f333affd640 1 -- 172.21.15.71:0/2782436076 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 20) v1 ==== 91408+0+0 (secure 0 0 0) 0x7f333c00dc30 con 0x7f33440fb430 2024-09-10T10:04:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.249+0000 7f333affd640 1 --2- 172.21.15.71:0/2782436076 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f333006e380 0x7f3330070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.249+0000 7f333affd640 1 -- 172.21.15.71:0/2782436076 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f333c08d750 con 0x7f33440fb430 2024-09-10T10:04:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.249+0000 7f3341d9b640 1 --2- 172.21.15.71:0/2782436076 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f333006e380 0x7f3330070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.250+0000 7f3341d9b640 1 --2- 172.21.15.71:0/2782436076 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f333006e380 0x7f3330070830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f332c000c00 tx=0x7f332c035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.254+0000 7f333affd640 1 -- 172.21.15.71:0/2782436076 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f333c05a820 con 0x7f33440fb430 2024-09-10T10:04:03.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.524+0000 7f3348971640 1 -- 172.21.15.71:0/2782436076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f334404b720 con 0x7f33440fb430 2024-09-10T10:04:03.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.524+0000 7f333affd640 1 -- 172.21.15.71:0/2782436076 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f333c05a1c0 con 0x7f33440fb430 2024-09-10T10:04:03.526 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:04:03.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.527+0000 7f3348971640 1 -- 172.21.15.71:0/2782436076 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f333006e380 msgr2=0x7f3330070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:03.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.527+0000 7f3348971640 1 --2- 172.21.15.71:0/2782436076 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f333006e380 0x7f3330070830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f332c000c00 tx=0x7f332c035040 comp rx=0 tx=0).stop 2024-09-10T10:04:03.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.527+0000 7f3348971640 1 -- 172.21.15.71:0/2782436076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33440fb430 msgr2=0x7f334410fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:03.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.527+0000 7f3348971640 1 --2- 172.21.15.71:0/2782436076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33440fb430 0x7f334410fd80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f333c002a50 tx=0x7f333c004600 comp rx=0 tx=0).stop 2024-09-10T10:04:03.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.527+0000 7f3348971640 1 -- 172.21.15.71:0/2782436076 shutdown_connections 2024-09-10T10:04:03.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.527+0000 7f3348971640 1 --2- 172.21.15.71:0/2782436076 >> [v2:172.21.15.71:6800/1474777768,v1:172.21.15.71:6801/1474777768] conn(0x7f333006e380 0x7f3330070830 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:03.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.527+0000 7f3348971640 1 --2- 172.21.15.71:0/2782436076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33440fc700 0x7f33441122d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:03.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.527+0000 7f3348971640 1 --2- 172.21.15.71:0/2782436076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33440fb430 0x7f334410fd80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:03.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.527+0000 7f3348971640 1 -- 172.21.15.71:0/2782436076 >> 172.21.15.71:0/2782436076 conn(0x7f33440f6c10 msgr2=0x7f33440f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:03.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.527+0000 7f3348971640 1 -- 172.21.15.71:0/2782436076 shutdown_connections 2024-09-10T10:04:03.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:03.527+0000 7f3348971640 1 -- 172.21.15.71:0/2782436076 wait complete. 2024-09-10T10:04:03.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:03 smithi071 ceph-mon[27559]: pgmap v252: 65 pgs: 65 active+clean; 256 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 456 op/s 2024-09-10T10:04:03.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:03 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/330286447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:04:03.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:03 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/2782436076' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:04:04.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:03 smithi107 ceph-mon[34215]: pgmap v252: 65 pgs: 65 active+clean; 256 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 456 op/s 2024-09-10T10:04:04.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:03 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/330286447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:04:04.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:03 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/2782436076' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:04:04.179 INFO:tasks.workunit.client.1.smithi107.stdout:8/0: sync 2024-09-10T10:04:04.179 INFO:tasks.workunit.client.1.smithi107.stdout:8/1: rename - no filename 2024-09-10T10:04:04.184 INFO:tasks.workunit.client.1.smithi107.stdout:8/2: mknod c0 0 2024-09-10T10:04:04.184 INFO:tasks.workunit.client.1.smithi107.stdout:8/3: rmdir - no directory 2024-09-10T10:04:04.184 INFO:tasks.workunit.client.1.smithi107.stdout:8/4: symlink l1 0 2024-09-10T10:04:04.184 INFO:tasks.workunit.client.1.smithi107.stdout:8/5: chown l1 2906 1 2024-09-10T10:04:04.185 INFO:tasks.workunit.client.1.smithi107.stdout:8/6: fdatasync - no filename 2024-09-10T10:04:04.185 INFO:tasks.workunit.client.1.smithi107.stdout:8/7: chown l1 13 1 2024-09-10T10:04:04.185 INFO:tasks.workunit.client.1.smithi107.stdout:8/8: mknod c2 0 2024-09-10T10:04:04.187 INFO:tasks.workunit.client.1.smithi107.stdout:8/9: creat f3 x:0 0 0 2024-09-10T10:04:04.189 INFO:tasks.workunit.client.1.smithi107.stdout:8/10: rename l1 to l4 0 2024-09-10T10:04:04.201 INFO:tasks.workunit.client.1.smithi107.stdout:8/11: getdents . 0 2024-09-10T10:04:04.201 INFO:tasks.workunit.client.1.smithi107.stdout:8/12: dread - f3 zero size 2024-09-10T10:04:04.202 INFO:tasks.workunit.client.1.smithi107.stdout:8/13: write f3 [444342,105050] 0 2024-09-10T10:04:04.203 INFO:tasks.workunit.client.1.smithi107.stdout:8/14: rmdir - no directory 2024-09-10T10:04:04.209 INFO:tasks.workunit.client.1.smithi107.stdout:8/15: dwrite f3 [0,4194304] 0 2024-09-10T10:04:04.210 INFO:tasks.workunit.client.1.smithi107.stdout:8/16: write f3 [3259394,93829] 0 2024-09-10T10:04:04.211 INFO:tasks.workunit.client.1.smithi107.stdout:8/17: chown c2 72872 1 2024-09-10T10:04:04.211 INFO:tasks.workunit.client.1.smithi107.stdout:8/18: stat c0 0 2024-09-10T10:04:04.215 INFO:tasks.workunit.client.1.smithi107.stdout:8/19: dread f3 [0,4194304] 0 2024-09-10T10:04:04.217 INFO:tasks.workunit.client.1.smithi107.stdout:8/20: mkdir d5 0 2024-09-10T10:04:04.219 INFO:tasks.workunit.client.1.smithi107.stdout:8/21: mknod d5/c6 0 2024-09-10T10:04:04.220 INFO:tasks.workunit.client.1.smithi107.stdout:8/22: mkdir d5/d7 0 2024-09-10T10:04:04.226 INFO:tasks.workunit.client.1.smithi107.stdout:8/23: dwrite f3 [0,4194304] 0 2024-09-10T10:04:04.227 INFO:tasks.workunit.client.1.smithi107.stdout:8/24: write f3 [4497983,79317] 0 2024-09-10T10:04:04.228 INFO:tasks.workunit.client.1.smithi107.stdout:8/25: write f3 [4519215,38518] 0 2024-09-10T10:04:04.232 INFO:tasks.workunit.client.1.smithi107.stdout:8/26: rmdir d5/d7 0 2024-09-10T10:04:04.237 INFO:tasks.workunit.client.1.smithi107.stdout:8/27: dwrite f3 [0,4194304] 0 2024-09-10T10:04:04.239 INFO:tasks.workunit.client.1.smithi107.stdout:8/28: mkdir d5/d8 0 2024-09-10T10:04:04.245 INFO:tasks.workunit.client.1.smithi107.stdout:8/29: truncate f3 3116198 0 2024-09-10T10:04:04.254 INFO:tasks.workunit.client.1.smithi107.stdout:8/30: dread f3 [0,4194304] 0 2024-09-10T10:04:04.256 INFO:tasks.workunit.client.1.smithi107.stdout:8/31: creat d5/d8/f9 x:0 0 0 2024-09-10T10:04:04.258 INFO:tasks.workunit.client.1.smithi107.stdout:8/32: dread f3 [0,4194304] 0 2024-09-10T10:04:04.259 INFO:tasks.workunit.client.1.smithi107.stdout:8/33: fdatasync d5/d8/f9 0 2024-09-10T10:04:04.259 INFO:tasks.workunit.client.1.smithi107.stdout:8/34: write d5/d8/f9 [52570,40670] 0 2024-09-10T10:04:04.261 INFO:tasks.workunit.client.1.smithi107.stdout:8/35: truncate d5/d8/f9 840418 0 2024-09-10T10:04:04.263 INFO:tasks.workunit.client.1.smithi107.stdout:8/36: fsync d5/d8/f9 0 2024-09-10T10:04:04.264 INFO:tasks.workunit.client.1.smithi107.stdout:8/37: read d5/d8/f9 [454177,16423] 0 2024-09-10T10:04:04.264 INFO:tasks.workunit.client.1.smithi107.stdout:8/38: chown l4 7 1 2024-09-10T10:04:04.265 INFO:tasks.workunit.client.1.smithi107.stdout:8/39: creat d5/fa x:0 0 0 2024-09-10T10:04:04.266 INFO:tasks.workunit.client.1.smithi107.stdout:8/40: dread - d5/fa zero size 2024-09-10T10:04:04.268 INFO:tasks.workunit.client.1.smithi107.stdout:8/41: dread f3 [0,4194304] 0 2024-09-10T10:04:04.269 INFO:tasks.workunit.client.1.smithi107.stdout:8/42: creat d5/fb x:0 0 0 2024-09-10T10:04:04.270 INFO:tasks.workunit.client.1.smithi107.stdout:8/43: mkdir d5/d8/dc 0 2024-09-10T10:04:04.271 INFO:tasks.workunit.client.1.smithi107.stdout:8/44: creat d5/d8/fd x:0 0 0 2024-09-10T10:04:04.274 INFO:tasks.workunit.client.1.smithi107.stdout:8/45: dread d5/d8/f9 [0,4194304] 0 2024-09-10T10:04:04.275 INFO:tasks.workunit.client.1.smithi107.stdout:8/46: rename f3 to d5/d8/fe 0 2024-09-10T10:04:04.277 INFO:tasks.workunit.client.1.smithi107.stdout:8/47: link d5/d8/fd d5/ff 0 2024-09-10T10:04:04.282 INFO:tasks.workunit.client.1.smithi107.stdout:8/48: dwrite d5/fa [0,4194304] 0 2024-09-10T10:04:04.284 INFO:tasks.workunit.client.1.smithi107.stdout:8/49: creat d5/d8/f10 x:0 0 0 2024-09-10T10:04:04.285 INFO:tasks.workunit.client.1.smithi107.stdout:8/50: symlink d5/d8/l11 0 2024-09-10T10:04:04.397 INFO:tasks.workunit.client.1.smithi107.stdout:5/11: sync 2024-09-10T10:04:04.398 INFO:tasks.workunit.client.1.smithi107.stdout:5/12: fsync f0 0 2024-09-10T10:04:04.402 INFO:tasks.workunit.client.1.smithi107.stdout:5/13: dread f0 [0,4194304] 0 2024-09-10T10:04:04.404 INFO:tasks.workunit.client.1.smithi107.stdout:5/14: dread f0 [0,4194304] 0 2024-09-10T10:04:04.405 INFO:tasks.workunit.client.1.smithi107.stdout:5/15: creat f1 x:0 0 0 2024-09-10T10:04:04.406 INFO:tasks.workunit.client.1.smithi107.stdout:5/16: symlink l2 0 2024-09-10T10:04:04.407 INFO:tasks.workunit.client.1.smithi107.stdout:5/17: dread - f1 zero size 2024-09-10T10:04:04.408 INFO:tasks.workunit.client.1.smithi107.stdout:5/18: unlink f0 0 2024-09-10T10:04:04.409 INFO:tasks.workunit.client.1.smithi107.stdout:5/19: write f1 [540566,88433] 0 2024-09-10T10:04:04.409 INFO:tasks.workunit.client.1.smithi107.stdout:5/20: chown f1 30832985 1 2024-09-10T10:04:04.417 INFO:tasks.workunit.client.1.smithi107.stdout:5/21: dwrite f1 [0,4194304] 0 2024-09-10T10:04:04.417 INFO:tasks.workunit.client.1.smithi107.stdout:5/22: write f1 [170678,74699] 0 2024-09-10T10:04:04.419 INFO:tasks.workunit.client.1.smithi107.stdout:5/23: creat f3 x:0 0 0 2024-09-10T10:04:04.419 INFO:tasks.workunit.client.1.smithi107.stdout:5/24: readlink l2 0 2024-09-10T10:04:04.420 INFO:tasks.workunit.client.1.smithi107.stdout:5/25: chown f1 7095667 1 2024-09-10T10:04:04.426 INFO:tasks.workunit.client.1.smithi107.stdout:5/26: dwrite f1 [0,4194304] 0 2024-09-10T10:04:04.430 INFO:tasks.workunit.client.1.smithi107.stdout:5/27: dread f1 [0,4194304] 0 2024-09-10T10:04:04.430 INFO:tasks.workunit.client.1.smithi107.stdout:5/28: write f3 [749568,6553] 0 2024-09-10T10:04:04.512 INFO:tasks.workunit.client.1.smithi107.stdout:9/21: sync 2024-09-10T10:04:04.512 INFO:tasks.workunit.client.1.smithi107.stdout:0/14: sync 2024-09-10T10:04:04.514 INFO:tasks.workunit.client.1.smithi107.stdout:0/15: creat f2 x:0 0 0 2024-09-10T10:04:04.514 INFO:tasks.workunit.client.1.smithi107.stdout:9/22: creat d5/d7/fb x:0 0 0 2024-09-10T10:04:04.515 INFO:tasks.workunit.client.1.smithi107.stdout:0/16: symlink l3 0 2024-09-10T10:04:04.518 INFO:tasks.workunit.client.1.smithi107.stdout:9/23: dread f3 [0,4194304] 0 2024-09-10T10:04:04.521 INFO:tasks.workunit.client.1.smithi107.stdout:0/17: getdents . 0 2024-09-10T10:04:04.522 INFO:tasks.workunit.client.1.smithi107.stdout:9/24: dread d5/f6 [0,4194304] 0 2024-09-10T10:04:04.524 INFO:tasks.workunit.client.1.smithi107.stdout:9/25: mknod d5/d7/cc 0 2024-09-10T10:04:04.524 INFO:tasks.workunit.client.1.smithi107.stdout:0/18: write f0 [940944,82386] 0 2024-09-10T10:04:04.526 INFO:tasks.workunit.client.1.smithi107.stdout:9/26: mknod d5/cd 0 2024-09-10T10:04:04.527 INFO:tasks.workunit.client.1.smithi107.stdout:0/19: creat f4 x:0 0 0 2024-09-10T10:04:04.529 INFO:tasks.workunit.client.1.smithi107.stdout:0/20: unlink f1 0 2024-09-10T10:04:04.534 INFO:tasks.workunit.client.1.smithi107.stdout:0/21: truncate f0 1266233 0 2024-09-10T10:04:04.545 INFO:tasks.workunit.client.1.smithi107.stdout:0/22: dwrite f0 [0,4194304] 0 2024-09-10T10:04:04.546 INFO:tasks.workunit.client.1.smithi107.stdout:0/23: truncate f4 636928 0 2024-09-10T10:04:04.547 INFO:tasks.workunit.client.1.smithi107.stdout:0/24: chown f2 0 1 2024-09-10T10:04:04.548 INFO:tasks.workunit.client.1.smithi107.stdout:0/25: chown l3 3342 1 2024-09-10T10:04:04.548 INFO:tasks.workunit.client.1.smithi107.stdout:0/26: stat f2 0 2024-09-10T10:04:04.548 INFO:tasks.workunit.client.1.smithi107.stdout:0/27: write f2 [799319,80373] 0 2024-09-10T10:04:04.555 INFO:tasks.workunit.client.1.smithi107.stdout:0/28: dwrite f0 [0,4194304] 0 2024-09-10T10:04:04.557 INFO:tasks.workunit.client.1.smithi107.stdout:0/29: symlink l5 0 2024-09-10T10:04:04.564 INFO:tasks.workunit.client.1.smithi107.stdout:0/30: dwrite f0 [0,4194304] 0 2024-09-10T10:04:04.567 INFO:tasks.workunit.client.1.smithi107.stdout:0/31: mkdir d6 0 2024-09-10T10:04:04.570 INFO:tasks.workunit.client.1.smithi107.stdout:0/32: creat d6/f7 x:0 0 0 2024-09-10T10:04:04.572 INFO:tasks.workunit.client.1.smithi107.stdout:0/33: mkdir d6/d8 0 2024-09-10T10:04:04.573 INFO:tasks.workunit.client.1.smithi107.stdout:0/34: write d6/f7 [835841,97] 0 2024-09-10T10:04:04.578 INFO:tasks.workunit.client.1.smithi107.stdout:0/35: dread d6/f7 [0,4194304] 0 2024-09-10T10:04:04.579 INFO:tasks.workunit.client.1.smithi107.stdout:0/36: chown f2 73 1 2024-09-10T10:04:04.580 INFO:tasks.workunit.client.1.smithi107.stdout:0/37: creat d6/d8/f9 x:0 0 0 2024-09-10T10:04:04.586 INFO:tasks.workunit.client.1.smithi107.stdout:0/38: getdents d6 0 2024-09-10T10:04:04.592 INFO:tasks.workunit.client.1.smithi107.stdout:0/39: dwrite d6/d8/f9 [0,4194304] 0 2024-09-10T10:04:04.593 INFO:tasks.workunit.client.1.smithi107.stdout:0/40: fsync f4 0 2024-09-10T10:04:04.598 INFO:tasks.workunit.client.1.smithi107.stdout:0/41: dread d6/d8/f9 [0,4194304] 0 2024-09-10T10:04:04.600 INFO:tasks.workunit.client.1.smithi107.stdout:0/42: rename f0 to d6/fa 0 2024-09-10T10:04:04.602 INFO:tasks.workunit.client.1.smithi107.stdout:0/43: dread f4 [0,4194304] 0 2024-09-10T10:04:04.608 INFO:tasks.workunit.client.1.smithi107.stdout:0/44: dwrite f4 [0,4194304] 0 2024-09-10T10:04:04.611 INFO:tasks.workunit.client.1.smithi107.stdout:0/45: creat d6/d8/fb x:0 0 0 2024-09-10T10:04:04.613 INFO:tasks.workunit.client.1.smithi107.stdout:0/46: fdatasync d6/f7 0 2024-09-10T10:04:04.661 INFO:tasks.workunit.client.1.smithi107.stdout:4/37: sync 2024-09-10T10:04:04.661 INFO:tasks.workunit.client.1.smithi107.stdout:8/51: sync 2024-09-10T10:04:04.661 INFO:tasks.workunit.client.1.smithi107.stdout:2/17: sync 2024-09-10T10:04:04.661 INFO:tasks.workunit.client.1.smithi107.stdout:3/51: sync 2024-09-10T10:04:04.661 INFO:tasks.workunit.client.1.smithi107.stdout:6/41: sync 2024-09-10T10:04:04.661 INFO:tasks.workunit.client.1.smithi107.stdout:7/42: sync 2024-09-10T10:04:04.661 INFO:tasks.workunit.client.1.smithi107.stdout:1/56: sync 2024-09-10T10:04:04.662 INFO:tasks.workunit.client.1.smithi107.stdout:6/42: stat d0/f8 0 2024-09-10T10:04:04.663 INFO:tasks.workunit.client.1.smithi107.stdout:4/38: symlink d0/lc 0 2024-09-10T10:04:04.664 INFO:tasks.workunit.client.1.smithi107.stdout:6/43: mknod d0/cb 0 2024-09-10T10:04:04.664 INFO:tasks.workunit.client.1.smithi107.stdout:1/57: dread d2/f5 [0,4194304] 0 2024-09-10T10:04:04.665 INFO:tasks.workunit.client.1.smithi107.stdout:2/18: symlink d3/l5 0 2024-09-10T10:04:04.665 INFO:tasks.workunit.client.1.smithi107.stdout:1/58: chown d2/ff 8329053 1 2024-09-10T10:04:04.665 INFO:tasks.workunit.client.1.smithi107.stdout:1/59: readlink d2/le 0 2024-09-10T10:04:04.666 INFO:tasks.workunit.client.1.smithi107.stdout:6/44: chown d0/c5 1784377 1 2024-09-10T10:04:04.668 INFO:tasks.workunit.client.1.smithi107.stdout:2/19: rmdir d3 39 2024-09-10T10:04:04.669 INFO:tasks.workunit.client.1.smithi107.stdout:1/60: unlink d2/d6/fb 0 2024-09-10T10:04:04.670 INFO:tasks.workunit.client.1.smithi107.stdout:6/45: rename d0/c5 to d0/cc 0 2024-09-10T10:04:04.671 INFO:tasks.workunit.client.1.smithi107.stdout:8/52: link d5/c6 d5/d8/dc/c12 0 2024-09-10T10:04:04.671 INFO:tasks.workunit.client.1.smithi107.stdout:3/52: link c6 dc/dd/cf 0 2024-09-10T10:04:04.673 INFO:tasks.workunit.client.1.smithi107.stdout:8/53: creat d5/d8/f13 x:0 0 0 2024-09-10T10:04:04.675 INFO:tasks.workunit.client.1.smithi107.stdout:4/39: getdents d0 0 2024-09-10T10:04:04.676 INFO:tasks.workunit.client.1.smithi107.stdout:2/20: truncate d3/f4 140312 0 2024-09-10T10:04:04.677 INFO:tasks.workunit.client.1.smithi107.stdout:2/21: chown d3/l5 2423 1 2024-09-10T10:04:04.677 INFO:tasks.workunit.client.1.smithi107.stdout:6/46: dread d0/fa [0,4194304] 0 2024-09-10T10:04:04.677 INFO:tasks.workunit.client.1.smithi107.stdout:8/54: mknod d5/c14 0 2024-09-10T10:04:04.679 INFO:tasks.workunit.client.1.smithi107.stdout:8/55: truncate d5/fa 5077074 0 2024-09-10T10:04:04.679 INFO:tasks.workunit.client.1.smithi107.stdout:3/53: link f9 dc/f10 0 2024-09-10T10:04:04.679 INFO:tasks.workunit.client.1.smithi107.stdout:4/40: dread d0/f2 [4194304,4194304] 0 2024-09-10T10:04:04.680 INFO:tasks.workunit.client.1.smithi107.stdout:8/56: write d5/d8/f9 [1545027,33261] 0 2024-09-10T10:04:04.681 INFO:tasks.workunit.client.1.smithi107.stdout:8/57: write d5/d8/f9 [2268841,94148] 0 2024-09-10T10:04:04.682 INFO:tasks.workunit.client.1.smithi107.stdout:6/47: creat d0/fd x:0 0 0 2024-09-10T10:04:04.683 INFO:tasks.workunit.client.1.smithi107.stdout:3/54: rmdir dc 39 2024-09-10T10:04:04.686 INFO:tasks.workunit.client.1.smithi107.stdout:8/58: symlink d5/d8/l15 0 2024-09-10T10:04:04.686 INFO:tasks.workunit.client.1.smithi107.stdout:8/59: readlink l4 0 2024-09-10T10:04:04.689 INFO:tasks.workunit.client.1.smithi107.stdout:3/55: unlink f4 0 2024-09-10T10:04:04.693 INFO:tasks.workunit.client.1.smithi107.stdout:8/60: creat d5/d8/dc/f16 x:0 0 0 2024-09-10T10:04:04.704 INFO:tasks.workunit.client.1.smithi107.stdout:8/61: getdents d5/d8/dc 0 2024-09-10T10:04:04.704 INFO:tasks.workunit.client.1.smithi107.stdout:4/41: dwrite d0/f4 [0,4194304] 0 2024-09-10T10:04:04.710 INFO:tasks.workunit.client.1.smithi107.stdout:2/22: dwrite d3/f4 [0,4194304] 0 2024-09-10T10:04:04.710 INFO:tasks.workunit.client.1.smithi107.stdout:8/62: dread - d5/d8/f13 zero size 2024-09-10T10:04:04.711 INFO:tasks.workunit.client.1.smithi107.stdout:4/42: mknod d0/cd 0 2024-09-10T10:04:04.711 INFO:tasks.workunit.client.1.smithi107.stdout:6/48: dwrite d0/f8 [0,4194304] 0 2024-09-10T10:04:04.714 INFO:tasks.workunit.client.1.smithi107.stdout:3/56: dwrite fa [4194304,4194304] 0 2024-09-10T10:04:04.714 INFO:tasks.workunit.client.1.smithi107.stdout:6/49: rename d0 to d0/de 22 2024-09-10T10:04:04.718 INFO:tasks.workunit.client.1.smithi107.stdout:4/43: symlink d0/le 0 2024-09-10T10:04:04.718 INFO:tasks.workunit.client.1.smithi107.stdout:2/23: unlink l2 0 2024-09-10T10:04:04.719 INFO:tasks.workunit.client.1.smithi107.stdout:2/24: stat d3 0 2024-09-10T10:04:04.720 INFO:tasks.workunit.client.1.smithi107.stdout:6/50: read d0/f6 [681402,41564] 0 2024-09-10T10:04:04.720 INFO:tasks.workunit.client.1.smithi107.stdout:3/57: chown dc/f10 169570258 1 2024-09-10T10:04:04.722 INFO:tasks.workunit.client.1.smithi107.stdout:3/58: stat dc/f10 0 2024-09-10T10:04:04.724 INFO:tasks.workunit.client.1.smithi107.stdout:4/44: dread d0/f4 [0,4194304] 0 2024-09-10T10:04:04.727 INFO:tasks.workunit.client.1.smithi107.stdout:4/45: symlink d0/lf 0 2024-09-10T10:04:04.730 INFO:tasks.workunit.client.1.smithi107.stdout:4/46: creat d0/f10 x:0 0 0 2024-09-10T10:04:04.730 INFO:tasks.workunit.client.1.smithi107.stdout:4/47: chown d0 0 1 2024-09-10T10:04:04.731 INFO:tasks.workunit.client.1.smithi107.stdout:4/48: chown d0/f2 308655 1 2024-09-10T10:04:04.732 INFO:tasks.workunit.client.1.smithi107.stdout:4/49: write d0/f10 [418247,39973] 0 2024-09-10T10:04:04.733 INFO:tasks.workunit.client.1.smithi107.stdout:2/25: fsync d3/f4 0 2024-09-10T10:04:04.735 INFO:tasks.workunit.client.1.smithi107.stdout:4/50: creat d0/f11 x:0 0 0 2024-09-10T10:04:04.736 INFO:tasks.workunit.client.1.smithi107.stdout:2/26: mkdir d3/d6 0 2024-09-10T10:04:04.737 INFO:tasks.workunit.client.1.smithi107.stdout:2/27: write d3/f4 [3993115,25577] 0 2024-09-10T10:04:04.739 INFO:tasks.workunit.client.1.smithi107.stdout:2/28: getdents d3/d6 0 2024-09-10T10:04:04.739 INFO:tasks.workunit.client.1.smithi107.stdout:2/29: chown d3/d6 28153854 1 2024-09-10T10:04:04.740 INFO:tasks.workunit.client.1.smithi107.stdout:2/30: rename d3 to d3/d6/d7 22 2024-09-10T10:04:04.743 INFO:tasks.workunit.client.1.smithi107.stdout:2/31: rmdir d3/d6 0 2024-09-10T10:04:04.746 INFO:tasks.workunit.client.1.smithi107.stdout:2/32: mkdir d3/d8 0 2024-09-10T10:04:04.748 INFO:tasks.workunit.client.1.smithi107.stdout:6/51: dwrite d0/f2 [0,4194304] 0 2024-09-10T10:04:04.750 INFO:tasks.workunit.client.1.smithi107.stdout:2/33: fsync f0 0 2024-09-10T10:04:04.754 INFO:tasks.workunit.client.1.smithi107.stdout:6/52: mkdir d0/df 0 2024-09-10T10:04:04.759 INFO:tasks.workunit.client.1.smithi107.stdout:3/59: dwrite dc/f10 [0,4194304] 0 2024-09-10T10:04:04.762 INFO:tasks.workunit.client.1.smithi107.stdout:3/60: mknod dc/dd/c11 0 2024-09-10T10:04:04.764 INFO:tasks.workunit.client.1.smithi107.stdout:4/51: dwrite d0/fb [0,4194304] 0 2024-09-10T10:04:04.766 INFO:tasks.workunit.client.1.smithi107.stdout:6/53: dread d0/f8 [0,4194304] 0 2024-09-10T10:04:04.767 INFO:tasks.workunit.client.1.smithi107.stdout:4/52: rmdir d0 39 2024-09-10T10:04:04.771 INFO:tasks.workunit.client.1.smithi107.stdout:6/54: unlink d0/f2 0 2024-09-10T10:04:04.774 INFO:tasks.workunit.client.1.smithi107.stdout:2/34: truncate f0 2018379 0 2024-09-10T10:04:04.777 INFO:tasks.workunit.client.1.smithi107.stdout:6/55: rename d0/cb to d0/df/c10 0 2024-09-10T10:04:04.777 INFO:tasks.workunit.client.1.smithi107.stdout:4/53: truncate d0/f2 8727130 0 2024-09-10T10:04:04.778 INFO:tasks.workunit.client.1.smithi107.stdout:4/54: readlink d0/lc 0 2024-09-10T10:04:04.780 INFO:tasks.workunit.client.1.smithi107.stdout:6/56: unlink d0/l7 0 2024-09-10T10:04:04.780 INFO:tasks.workunit.client.1.smithi107.stdout:2/35: dread d3/f4 [0,4194304] 0 2024-09-10T10:04:04.786 INFO:tasks.workunit.client.1.smithi107.stdout:2/36: dread d3/f4 [0,4194304] 0 2024-09-10T10:04:04.789 INFO:tasks.workunit.client.1.smithi107.stdout:2/37: creat d3/f9 x:0 0 0 2024-09-10T10:04:04.797 INFO:tasks.workunit.client.1.smithi107.stdout:4/55: dwrite d0/fa [0,4194304] 0 2024-09-10T10:04:04.801 INFO:tasks.workunit.client.1.smithi107.stdout:6/57: dwrite d0/fa [4194304,4194304] 0 2024-09-10T10:04:04.807 INFO:tasks.workunit.client.1.smithi107.stdout:6/58: write d0/fd [172072,129543] 0 2024-09-10T10:04:04.808 INFO:tasks.workunit.client.1.smithi107.stdout:4/56: link d0/f2 d0/f12 0 2024-09-10T10:04:04.809 INFO:tasks.workunit.client.1.smithi107.stdout:2/38: dwrite d3/f9 [0,4194304] 0 2024-09-10T10:04:04.811 INFO:tasks.workunit.client.1.smithi107.stdout:4/57: mkdir d0/d13 0 2024-09-10T10:04:04.812 INFO:tasks.workunit.client.1.smithi107.stdout:2/39: stat d3/d8 0 2024-09-10T10:04:04.814 INFO:tasks.workunit.client.1.smithi107.stdout:2/40: chown f0 23656987 1 2024-09-10T10:04:04.815 INFO:tasks.workunit.client.1.smithi107.stdout:4/58: creat d0/f14 x:0 0 0 2024-09-10T10:04:04.818 INFO:tasks.workunit.client.1.smithi107.stdout:4/59: symlink d0/l15 0 2024-09-10T10:04:04.819 INFO:tasks.workunit.client.1.smithi107.stdout:4/60: stat d0/f4 0 2024-09-10T10:04:04.819 INFO:tasks.workunit.client.1.smithi107.stdout:6/59: dwrite d0/fa [0,4194304] 0 2024-09-10T10:04:04.820 INFO:tasks.workunit.client.1.smithi107.stdout:4/61: write d0/fa [3926757,78749] 0 2024-09-10T10:04:04.821 INFO:tasks.workunit.client.1.smithi107.stdout:4/62: chown d0/d13 915887 1 2024-09-10T10:04:04.822 INFO:tasks.workunit.client.1.smithi107.stdout:2/41: dread d3/f4 [0,4194304] 0 2024-09-10T10:04:04.825 INFO:tasks.workunit.client.1.smithi107.stdout:4/63: mknod d0/c16 0 2024-09-10T10:04:04.825 INFO:tasks.workunit.client.1.smithi107.stdout:2/42: write d3/f9 [2223651,17921] 0 2024-09-10T10:04:04.826 INFO:tasks.workunit.client.1.smithi107.stdout:9/27: sync 2024-09-10T10:04:04.826 INFO:tasks.workunit.client.1.smithi107.stdout:5/29: sync 2024-09-10T10:04:04.828 INFO:tasks.workunit.client.1.smithi107.stdout:2/43: mkdir d3/da 0 2024-09-10T10:04:04.828 INFO:tasks.workunit.client.1.smithi107.stdout:6/60: link d0/c9 d0/df/c11 0 2024-09-10T10:04:04.830 INFO:tasks.workunit.client.1.smithi107.stdout:9/28: creat d5/d7/fe x:0 0 0 2024-09-10T10:04:04.830 INFO:tasks.workunit.client.1.smithi107.stdout:2/44: write d3/f9 [3778814,90577] 0 2024-09-10T10:04:04.831 INFO:tasks.workunit.client.1.smithi107.stdout:5/30: write f1 [3824843,109507] 0 2024-09-10T10:04:04.831 INFO:tasks.workunit.client.1.smithi107.stdout:9/29: chown f3 3595559 1 2024-09-10T10:04:04.832 INFO:tasks.workunit.client.1.smithi107.stdout:2/45: stat d3/f9 0 2024-09-10T10:04:04.832 INFO:tasks.workunit.client.1.smithi107.stdout:2/46: chown d3 15513 1 2024-09-10T10:04:04.833 INFO:tasks.workunit.client.1.smithi107.stdout:5/31: mkdir d4 0 2024-09-10T10:04:04.834 INFO:tasks.workunit.client.1.smithi107.stdout:4/64: dread d0/f8 [0,4194304] 0 2024-09-10T10:04:04.834 INFO:tasks.workunit.client.1.smithi107.stdout:5/32: chown f1 2 1 2024-09-10T10:04:04.836 INFO:tasks.workunit.client.1.smithi107.stdout:2/47: unlink d3/f4 0 2024-09-10T10:04:04.836 INFO:tasks.workunit.client.1.smithi107.stdout:5/33: write f3 [869950,15588] 0 2024-09-10T10:04:04.839 INFO:tasks.workunit.client.1.smithi107.stdout:6/61: dread d0/f6 [0,4194304] 0 2024-09-10T10:04:04.841 INFO:tasks.workunit.client.1.smithi107.stdout:5/34: dread f1 [0,4194304] 0 2024-09-10T10:04:04.841 INFO:tasks.workunit.client.1.smithi107.stdout:4/65: creat d0/d13/f17 x:0 0 0 2024-09-10T10:04:04.843 INFO:tasks.workunit.client.1.smithi107.stdout:2/48: creat d3/da/fb x:0 0 0 2024-09-10T10:04:04.844 INFO:tasks.workunit.client.1.smithi107.stdout:6/62: rmdir d0/df 39 2024-09-10T10:04:04.846 INFO:tasks.workunit.client.1.smithi107.stdout:2/49: truncate d3/da/fb 982204 0 2024-09-10T10:04:04.846 INFO:tasks.workunit.client.1.smithi107.stdout:5/35: write f1 [2186437,60604] 0 2024-09-10T10:04:04.847 INFO:tasks.workunit.client.1.smithi107.stdout:9/30: getdents d5/d7 0 2024-09-10T10:04:04.850 INFO:tasks.workunit.client.1.smithi107.stdout:5/36: chown f1 84 1 2024-09-10T10:04:04.850 INFO:tasks.workunit.client.1.smithi107.stdout:2/50: fsync f0 0 2024-09-10T10:04:04.852 INFO:tasks.workunit.client.1.smithi107.stdout:9/31: truncate f3 4176411 0 2024-09-10T10:04:04.855 INFO:tasks.workunit.client.1.smithi107.stdout:2/51: creat d3/fc x:0 0 0 2024-09-10T10:04:04.855 INFO:tasks.workunit.client.1.smithi107.stdout:4/66: dwrite d0/f11 [0,4194304] 0 2024-09-10T10:04:04.857 INFO:tasks.workunit.client.1.smithi107.stdout:9/32: symlink d5/d7/lf 0 2024-09-10T10:04:04.858 INFO:tasks.workunit.client.1.smithi107.stdout:6/63: dwrite d0/fa [0,4194304] 0 2024-09-10T10:04:04.858 INFO:tasks.workunit.client.1.smithi107.stdout:5/37: rmdir d4 0 2024-09-10T10:04:04.859 INFO:tasks.workunit.client.1.smithi107.stdout:2/52: fdatasync f0 0 2024-09-10T10:04:04.863 INFO:tasks.workunit.client.1.smithi107.stdout:9/33: chown f3 281 1 2024-09-10T10:04:04.865 INFO:tasks.workunit.client.1.smithi107.stdout:4/67: dread d0/fb [0,4194304] 0 2024-09-10T10:04:04.867 INFO:tasks.workunit.client.1.smithi107.stdout:4/68: chown d0/l15 8878 1 2024-09-10T10:04:04.867 INFO:tasks.workunit.client.1.smithi107.stdout:6/64: symlink d0/df/l12 0 2024-09-10T10:04:04.867 INFO:tasks.workunit.client.1.smithi107.stdout:5/38: dread f1 [0,4194304] 0 2024-09-10T10:04:04.868 INFO:tasks.workunit.client.1.smithi107.stdout:4/69: dread - d0/f14 zero size 2024-09-10T10:04:04.869 INFO:tasks.workunit.client.1.smithi107.stdout:5/39: truncate f3 1926993 0 2024-09-10T10:04:04.869 INFO:tasks.workunit.client.1.smithi107.stdout:6/65: write d0/f8 [5069441,19263] 0 2024-09-10T10:04:04.869 INFO:tasks.workunit.client.1.smithi107.stdout:4/70: readlink d0/l15 0 2024-09-10T10:04:04.870 INFO:tasks.workunit.client.1.smithi107.stdout:5/40: fdatasync f3 0 2024-09-10T10:04:04.871 INFO:tasks.workunit.client.1.smithi107.stdout:2/53: getdents d3 0 2024-09-10T10:04:04.871 INFO:tasks.workunit.client.1.smithi107.stdout:6/66: write d0/f8 [1594307,81198] 0 2024-09-10T10:04:04.872 INFO:tasks.workunit.client.1.smithi107.stdout:5/41: mknod c5 0 2024-09-10T10:04:04.873 INFO:tasks.workunit.client.1.smithi107.stdout:4/71: symlink d0/d13/l18 0 2024-09-10T10:04:04.873 INFO:tasks.workunit.client.1.smithi107.stdout:2/54: write f0 [1943203,70384] 0 2024-09-10T10:04:04.876 INFO:tasks.workunit.client.1.smithi107.stdout:5/42: write f1 [4196225,27555] 0 2024-09-10T10:04:04.881 INFO:tasks.workunit.client.1.smithi107.stdout:5/43: unlink l2 0 2024-09-10T10:04:04.884 INFO:tasks.workunit.client.1.smithi107.stdout:5/44: unlink f3 0 2024-09-10T10:04:04.886 INFO:tasks.workunit.client.1.smithi107.stdout:5/45: read f1 [2101614,41523] 0 2024-09-10T10:04:04.887 INFO:tasks.workunit.client.1.smithi107.stdout:4/72: dwrite d0/f10 [0,4194304] 0 2024-09-10T10:04:04.888 INFO:tasks.workunit.client.1.smithi107.stdout:6/67: dwrite d0/f8 [0,4194304] 0 2024-09-10T10:04:04.888 INFO:tasks.workunit.client.1.smithi107.stdout:5/46: chown c5 3217 1 2024-09-10T10:04:04.892 INFO:tasks.workunit.client.1.smithi107.stdout:2/55: truncate d3/f9 3813124 0 2024-09-10T10:04:04.895 INFO:tasks.workunit.client.1.smithi107.stdout:4/73: symlink d0/l19 0 2024-09-10T10:04:04.895 INFO:tasks.workunit.client.1.smithi107.stdout:5/47: creat f6 x:0 0 0 2024-09-10T10:04:04.895 INFO:tasks.workunit.client.1.smithi107.stdout:4/74: readlink d0/l15 0 2024-09-10T10:04:04.895 INFO:tasks.workunit.client.1.smithi107.stdout:5/48: write f1 [2291533,68971] 0 2024-09-10T10:04:04.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:04 smithi107 ceph-mon[34215]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:04.897 INFO:tasks.workunit.client.1.smithi107.stdout:4/75: truncate d0/d13/f17 344029 0 2024-09-10T10:04:04.899 INFO:tasks.workunit.client.1.smithi107.stdout:5/49: mknod c7 0 2024-09-10T10:04:04.900 INFO:tasks.workunit.client.1.smithi107.stdout:2/56: getdents d3/da 0 2024-09-10T10:04:04.902 INFO:tasks.workunit.client.1.smithi107.stdout:5/50: creat f8 x:0 0 0 2024-09-10T10:04:04.903 INFO:tasks.workunit.client.1.smithi107.stdout:5/51: truncate f6 1032601 0 2024-09-10T10:04:04.904 INFO:tasks.workunit.client.1.smithi107.stdout:5/52: read - f8 zero size 2024-09-10T10:04:04.905 INFO:tasks.workunit.client.1.smithi107.stdout:4/76: link d0/c3 d0/c1a 0 2024-09-10T10:04:04.906 INFO:tasks.workunit.client.1.smithi107.stdout:5/53: creat f9 x:0 0 0 2024-09-10T10:04:04.908 INFO:tasks.workunit.client.1.smithi107.stdout:4/77: creat d0/d13/f1b x:0 0 0 2024-09-10T10:04:04.911 INFO:tasks.workunit.client.1.smithi107.stdout:5/54: symlink la 0 2024-09-10T10:04:04.913 INFO:tasks.workunit.client.1.smithi107.stdout:5/55: chown la 195544 1 2024-09-10T10:04:04.913 INFO:tasks.workunit.client.1.smithi107.stdout:4/78: mknod d0/d13/c1c 0 2024-09-10T10:04:04.914 INFO:tasks.workunit.client.1.smithi107.stdout:2/57: dwrite d3/fc [0,4194304] 0 2024-09-10T10:04:04.914 INFO:tasks.workunit.client.1.smithi107.stdout:5/56: chown c7 1000712 1 2024-09-10T10:04:04.917 INFO:tasks.workunit.client.1.smithi107.stdout:5/57: mknod cb 0 2024-09-10T10:04:04.918 INFO:tasks.workunit.client.1.smithi107.stdout:4/79: creat d0/f1d x:0 0 0 2024-09-10T10:04:04.919 INFO:tasks.workunit.client.1.smithi107.stdout:4/80: read - d0/d13/f1b zero size 2024-09-10T10:04:04.920 INFO:tasks.workunit.client.1.smithi107.stdout:5/58: unlink la 0 2024-09-10T10:04:04.922 INFO:tasks.workunit.client.1.smithi107.stdout:2/58: dwrite d3/fc [0,4194304] 0 2024-09-10T10:04:04.925 INFO:tasks.workunit.client.1.smithi107.stdout:5/59: link f6 fc 0 2024-09-10T10:04:04.928 INFO:tasks.workunit.client.1.smithi107.stdout:5/60: creat fd x:0 0 0 2024-09-10T10:04:04.929 INFO:tasks.workunit.client.1.smithi107.stdout:2/59: symlink d3/d8/ld 0 2024-09-10T10:04:04.930 INFO:tasks.workunit.client.1.smithi107.stdout:5/61: mkdir de 0 2024-09-10T10:04:04.930 INFO:tasks.workunit.client.1.smithi107.stdout:5/62: readlink - no filename 2024-09-10T10:04:04.935 INFO:tasks.workunit.client.1.smithi107.stdout:5/63: mknod de/cf 0 2024-09-10T10:04:04.937 INFO:tasks.workunit.client.1.smithi107.stdout:4/81: write d0/f12 [9221591,945] 0 2024-09-10T10:04:04.940 INFO:tasks.workunit.client.1.smithi107.stdout:2/60: truncate d3/fc 3441433 0 2024-09-10T10:04:04.943 INFO:tasks.workunit.client.1.smithi107.stdout:5/64: dread f1 [0,4194304] 0 2024-09-10T10:04:04.943 INFO:tasks.workunit.client.1.smithi107.stdout:2/61: stat d3/f9 0 2024-09-10T10:04:04.945 INFO:tasks.workunit.client.1.smithi107.stdout:5/65: mknod de/c10 0 2024-09-10T10:04:04.946 INFO:tasks.workunit.client.1.smithi107.stdout:5/66: fsync fd 0 2024-09-10T10:04:04.947 INFO:tasks.workunit.client.1.smithi107.stdout:4/82: dwrite d0/f10 [0,4194304] 0 2024-09-10T10:04:04.951 INFO:tasks.workunit.client.1.smithi107.stdout:2/62: truncate d3/da/fb 318664 0 2024-09-10T10:04:04.955 INFO:tasks.workunit.client.1.smithi107.stdout:4/83: dread d0/f4 [0,4194304] 0 2024-09-10T10:04:04.955 INFO:tasks.workunit.client.1.smithi107.stdout:2/63: symlink d3/da/le 0 2024-09-10T10:04:04.957 INFO:tasks.workunit.client.1.smithi107.stdout:5/67: dwrite f9 [0,4194304] 0 2024-09-10T10:04:04.958 INFO:tasks.workunit.client.1.smithi107.stdout:4/84: write d0/fa [474601,70293] 0 2024-09-10T10:04:04.959 INFO:tasks.workunit.client.1.smithi107.stdout:4/85: chown d0/lc 329773289 1 2024-09-10T10:04:04.960 INFO:tasks.workunit.client.1.smithi107.stdout:4/86: dread - d0/f14 zero size 2024-09-10T10:04:04.960 INFO:tasks.workunit.client.1.smithi107.stdout:2/64: getdents d3 0 2024-09-10T10:04:04.962 INFO:tasks.workunit.client.1.smithi107.stdout:4/87: creat d0/d13/f1e x:0 0 0 2024-09-10T10:04:04.965 INFO:tasks.workunit.client.1.smithi107.stdout:2/65: rmdir d3/da 39 2024-09-10T10:04:04.967 INFO:tasks.workunit.client.1.smithi107.stdout:5/68: link f6 de/f11 0 2024-09-10T10:04:04.969 INFO:tasks.workunit.client.1.smithi107.stdout:4/88: mkdir d0/d1f 0 2024-09-10T10:04:04.970 INFO:tasks.workunit.client.1.smithi107.stdout:5/69: mknod de/c12 0 2024-09-10T10:04:04.976 INFO:tasks.workunit.client.1.smithi107.stdout:2/66: dwrite f0 [0,4194304] 0 2024-09-10T10:04:04.982 INFO:tasks.workunit.client.1.smithi107.stdout:4/89: dwrite d0/d13/f1b [0,4194304] 0 2024-09-10T10:04:04.983 INFO:tasks.workunit.client.1.smithi107.stdout:5/70: getdents de 0 2024-09-10T10:04:04.984 INFO:tasks.workunit.client.1.smithi107.stdout:5/71: fdatasync fd 0 2024-09-10T10:04:04.985 INFO:tasks.workunit.client.1.smithi107.stdout:2/67: mkdir d3/da/df 0 2024-09-10T10:04:04.985 INFO:tasks.workunit.client.1.smithi107.stdout:2/68: readlink d3/da/le 0 2024-09-10T10:04:04.986 INFO:tasks.workunit.client.1.smithi107.stdout:4/90: unlink d0/f5 0 2024-09-10T10:04:04.986 INFO:tasks.workunit.client.1.smithi107.stdout:2/69: chown d3/fc 1 1 2024-09-10T10:04:04.988 INFO:tasks.workunit.client.1.smithi107.stdout:5/72: rename fd to de/f13 0 2024-09-10T10:04:04.989 INFO:tasks.workunit.client.1.smithi107.stdout:4/91: chown d0/c3 4934 1 2024-09-10T10:04:04.992 INFO:tasks.workunit.client.1.smithi107.stdout:5/73: read f6 [555267,107119] 0 2024-09-10T10:04:04.992 INFO:tasks.workunit.client.1.smithi107.stdout:2/70: dread d3/da/fb [0,4194304] 0 2024-09-10T10:04:05.002 INFO:tasks.workunit.client.1.smithi107.stdout:5/74: write fc [1446865,115985] 0 2024-09-10T10:04:05.002 INFO:tasks.workunit.client.1.smithi107.stdout:2/71: write f0 [5213251,127872] 0 2024-09-10T10:04:05.003 INFO:tasks.workunit.client.1.smithi107.stdout:2/72: chown d3/da/df 13 1 2024-09-10T10:04:05.005 INFO:tasks.workunit.client.1.smithi107.stdout:2/73: write f0 [5991154,35014] 0 2024-09-10T10:04:05.006 INFO:tasks.workunit.client.1.smithi107.stdout:2/74: truncate d3/fc 3951355 0 2024-09-10T10:04:05.007 INFO:tasks.workunit.client.1.smithi107.stdout:5/75: dread f9 [0,4194304] 0 2024-09-10T10:04:05.008 INFO:tasks.workunit.client.1.smithi107.stdout:2/75: dread d3/da/fb [0,4194304] 0 2024-09-10T10:04:05.008 INFO:tasks.workunit.client.1.smithi107.stdout:2/76: readlink d3/da/le 0 2024-09-10T10:04:05.013 INFO:tasks.workunit.client.1.smithi107.stdout:2/77: rmdir d3/da 39 2024-09-10T10:04:05.016 INFO:tasks.workunit.client.1.smithi107.stdout:2/78: creat d3/da/df/f10 x:0 0 0 2024-09-10T10:04:05.018 INFO:tasks.workunit.client.1.smithi107.stdout:5/76: dwrite f8 [0,4194304] 0 2024-09-10T10:04:05.021 INFO:tasks.workunit.client.1.smithi107.stdout:5/77: mknod de/c14 0 2024-09-10T10:04:05.023 INFO:tasks.workunit.client.1.smithi107.stdout:2/79: rename d3/da/df/f10 to d3/f11 0 2024-09-10T10:04:05.024 INFO:tasks.workunit.client.1.smithi107.stdout:5/78: mknod de/c15 0 2024-09-10T10:04:05.027 INFO:tasks.workunit.client.1.smithi107.stdout:5/79: creat de/f16 x:0 0 0 2024-09-10T10:04:05.028 INFO:tasks.workunit.client.1.smithi107.stdout:5/80: stat f9 0 2024-09-10T10:04:05.030 INFO:tasks.workunit.client.1.smithi107.stdout:5/81: rename de/c10 to de/c17 0 2024-09-10T10:04:05.031 INFO:tasks.workunit.client.1.smithi107.stdout:5/82: write de/f13 [263447,16189] 0 2024-09-10T10:04:05.032 INFO:tasks.workunit.client.1.smithi107.stdout:5/83: stat cb 0 2024-09-10T10:04:05.032 INFO:tasks.workunit.client.1.smithi107.stdout:5/84: stat de/f16 0 2024-09-10T10:04:05.033 INFO:tasks.workunit.client.1.smithi107.stdout:5/85: creat de/f18 x:0 0 0 2024-09-10T10:04:05.034 INFO:tasks.workunit.client.1.smithi107.stdout:5/86: truncate f9 5114556 0 2024-09-10T10:04:05.035 INFO:tasks.workunit.client.1.smithi107.stdout:5/87: symlink de/l19 0 2024-09-10T10:04:05.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:04 smithi071 ceph-mon[27559]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:05.040 INFO:tasks.workunit.client.1.smithi107.stdout:2/80: getdents d3 0 2024-09-10T10:04:05.041 INFO:tasks.workunit.client.1.smithi107.stdout:5/88: link c5 de/c1a 0 2024-09-10T10:04:05.041 INFO:tasks.workunit.client.1.smithi107.stdout:2/81: read f0 [614714,41041] 0 2024-09-10T10:04:05.042 INFO:tasks.workunit.client.1.smithi107.stdout:5/89: creat de/f1b x:0 0 0 2024-09-10T10:04:05.044 INFO:tasks.workunit.client.1.smithi107.stdout:2/82: creat d3/da/f12 x:0 0 0 2024-09-10T10:04:05.046 INFO:tasks.workunit.client.1.smithi107.stdout:2/83: rename d3/da/le to d3/da/l13 0 2024-09-10T10:04:05.048 INFO:tasks.workunit.client.1.smithi107.stdout:2/84: creat d3/f14 x:0 0 0 2024-09-10T10:04:05.050 INFO:tasks.workunit.client.1.smithi107.stdout:5/90: dwrite f9 [0,4194304] 0 2024-09-10T10:04:05.057 INFO:tasks.workunit.client.1.smithi107.stdout:5/91: dread f8 [0,4194304] 0 2024-09-10T10:04:05.059 INFO:tasks.workunit.client.1.smithi107.stdout:2/85: dwrite d3/da/f12 [0,4194304] 0 2024-09-10T10:04:05.064 INFO:tasks.workunit.client.1.smithi107.stdout:2/86: rename d3/f14 to d3/da/df/f15 0 2024-09-10T10:04:05.068 INFO:tasks.workunit.client.1.smithi107.stdout:5/92: dwrite de/f16 [0,4194304] 0 2024-09-10T10:04:05.070 INFO:tasks.workunit.client.1.smithi107.stdout:5/93: rename de to de/d1c 22 2024-09-10T10:04:05.070 INFO:tasks.workunit.client.1.smithi107.stdout:5/94: readlink de/l19 0 2024-09-10T10:04:05.074 INFO:tasks.workunit.client.1.smithi107.stdout:5/95: unlink de/cf 0 2024-09-10T10:04:05.075 INFO:tasks.workunit.client.1.smithi107.stdout:5/96: write fc [791648,13954] 0 2024-09-10T10:04:05.075 INFO:tasks.workunit.client.1.smithi107.stdout:5/97: chown de/f16 2 1 2024-09-10T10:04:05.079 INFO:tasks.workunit.client.1.smithi107.stdout:0/47: sync 2024-09-10T10:04:05.082 INFO:tasks.workunit.client.1.smithi107.stdout:5/98: dwrite de/f16 [0,4194304] 0 2024-09-10T10:04:05.087 INFO:tasks.workunit.client.1.smithi107.stdout:5/99: dread f1 [0,4194304] 0 2024-09-10T10:04:05.089 INFO:tasks.workunit.client.1.smithi107.stdout:5/100: symlink de/l1d 0 2024-09-10T10:04:05.092 INFO:tasks.workunit.client.1.smithi107.stdout:2/87: dwrite d3/f9 [0,4194304] 0 2024-09-10T10:04:05.092 INFO:tasks.workunit.client.1.smithi107.stdout:5/101: unlink de/f18 0 2024-09-10T10:04:05.095 INFO:tasks.workunit.client.1.smithi107.stdout:5/102: creat de/f1e x:0 0 0 2024-09-10T10:04:05.096 INFO:tasks.workunit.client.1.smithi107.stdout:5/103: read de/f16 [3620548,35134] 0 2024-09-10T10:04:05.098 INFO:tasks.workunit.client.1.smithi107.stdout:5/104: unlink cb 0 2024-09-10T10:04:05.100 INFO:tasks.workunit.client.1.smithi107.stdout:5/105: creat de/f1f x:0 0 0 2024-09-10T10:04:05.107 INFO:tasks.workunit.client.1.smithi107.stdout:5/106: dwrite de/f11 [0,4194304] 0 2024-09-10T10:04:05.115 INFO:tasks.workunit.client.1.smithi107.stdout:2/88: fsync d3/f9 0 2024-09-10T10:04:05.118 INFO:tasks.workunit.client.1.smithi107.stdout:2/89: creat d3/d8/f16 x:0 0 0 2024-09-10T10:04:05.119 INFO:tasks.workunit.client.1.smithi107.stdout:2/90: chown d3/da/df 1671317984 1 2024-09-10T10:04:05.121 INFO:tasks.workunit.client.1.smithi107.stdout:2/91: creat d3/da/f17 x:0 0 0 2024-09-10T10:04:05.123 INFO:tasks.workunit.client.1.smithi107.stdout:2/92: creat d3/f18 x:0 0 0 2024-09-10T10:04:05.132 INFO:tasks.workunit.client.1.smithi107.stdout:2/93: dwrite d3/da/f12 [4194304,4194304] 0 2024-09-10T10:04:05.136 INFO:tasks.workunit.client.1.smithi107.stdout:2/94: symlink d3/l19 0 2024-09-10T10:04:05.141 INFO:tasks.workunit.client.1.smithi107.stdout:2/95: dread d3/fc [0,4194304] 0 2024-09-10T10:04:05.143 INFO:tasks.workunit.client.1.smithi107.stdout:2/96: write d3/da/f12 [2399726,39122] 0 2024-09-10T10:04:05.146 INFO:tasks.workunit.client.1.smithi107.stdout:2/97: rename d3/f9 to d3/f1a 0 2024-09-10T10:04:05.148 INFO:tasks.workunit.client.1.smithi107.stdout:2/98: symlink d3/l1b 0 2024-09-10T10:04:05.151 INFO:tasks.workunit.client.1.smithi107.stdout:2/99: unlink d3/da/fb 0 2024-09-10T10:04:05.159 INFO:tasks.workunit.client.1.smithi107.stdout:2/100: dwrite d3/da/f17 [0,4194304] 0 2024-09-10T10:04:05.164 INFO:tasks.workunit.client.1.smithi107.stdout:2/101: rename d3/da/f12 to d3/f1c 0 2024-09-10T10:04:05.172 INFO:tasks.workunit.client.1.smithi107.stdout:2/102: dwrite d3/fc [0,4194304] 0 2024-09-10T10:04:05.174 INFO:tasks.workunit.client.1.smithi107.stdout:2/103: truncate d3/d8/f16 389399 0 2024-09-10T10:04:05.176 INFO:tasks.workunit.client.1.smithi107.stdout:2/104: creat d3/da/f1d x:0 0 0 2024-09-10T10:04:05.184 INFO:tasks.workunit.client.1.smithi107.stdout:2/105: dwrite d3/f1c [4194304,4194304] 0 2024-09-10T10:04:05.187 INFO:tasks.workunit.client.1.smithi107.stdout:2/106: mkdir d3/da/d1e 0 2024-09-10T10:04:05.190 INFO:tasks.workunit.client.1.smithi107.stdout:2/107: unlink d3/f1a 0 2024-09-10T10:04:05.192 INFO:tasks.workunit.client.1.smithi107.stdout:2/108: read f0 [3299718,84535] 0 2024-09-10T10:04:05.199 INFO:tasks.workunit.client.1.smithi107.stdout:2/109: dwrite d3/f1c [8388608,4194304] 0 2024-09-10T10:04:05.202 INFO:tasks.workunit.client.1.smithi107.stdout:2/110: read d3/da/f17 [3070143,50924] 0 2024-09-10T10:04:05.213 INFO:tasks.workunit.client.1.smithi107.stdout:2/111: dwrite f0 [4194304,4194304] 0 2024-09-10T10:04:05.219 INFO:tasks.workunit.client.1.smithi107.stdout:2/112: dread d3/da/f17 [0,4194304] 0 2024-09-10T10:04:05.221 INFO:tasks.workunit.client.1.smithi107.stdout:2/113: rename d3/fc to d3/f1f 0 2024-09-10T10:04:05.223 INFO:tasks.workunit.client.1.smithi107.stdout:2/114: mkdir d3/da/df/d20 0 2024-09-10T10:04:05.223 INFO:tasks.workunit.client.1.smithi107.stdout:2/115: dread - d3/da/f1d zero size 2024-09-10T10:04:05.225 INFO:tasks.workunit.client.1.smithi107.stdout:2/116: mkdir d3/d21 0 2024-09-10T10:04:05.226 INFO:tasks.workunit.client.1.smithi107.stdout:2/117: mkdir d3/da/d1e/d22 0 2024-09-10T10:04:05.229 INFO:tasks.workunit.client.1.smithi107.stdout:2/118: dread d3/da/f17 [0,4194304] 0 2024-09-10T10:04:05.235 INFO:tasks.workunit.client.1.smithi107.stdout:2/119: rmdir d3/da 39 2024-09-10T10:04:05.236 INFO:tasks.workunit.client.1.smithi107.stdout:2/120: fsync d3/f18 0 2024-09-10T10:04:05.238 INFO:tasks.workunit.client.1.smithi107.stdout:2/121: getdents d3 0 2024-09-10T10:04:05.239 INFO:tasks.workunit.client.1.smithi107.stdout:2/122: chown d3/f18 1 1 2024-09-10T10:04:05.240 INFO:tasks.workunit.client.1.smithi107.stdout:2/123: mknod d3/d8/c23 0 2024-09-10T10:04:05.243 INFO:tasks.workunit.client.1.smithi107.stdout:2/124: link d3/f1f d3/da/d1e/f24 0 2024-09-10T10:04:05.244 INFO:tasks.workunit.client.1.smithi107.stdout:2/125: creat d3/d8/f25 x:0 0 0 2024-09-10T10:04:05.251 INFO:tasks.workunit.client.1.smithi107.stdout:2/126: dwrite d3/f1f [0,4194304] 0 2024-09-10T10:04:05.259 INFO:tasks.workunit.client.1.smithi107.stdout:2/127: dwrite d3/d8/f16 [0,4194304] 0 2024-09-10T10:04:05.335 INFO:tasks.workunit.client.1.smithi107.stdout:1/61: sync 2024-09-10T10:04:05.335 INFO:tasks.workunit.client.1.smithi107.stdout:7/43: sync 2024-09-10T10:04:05.338 INFO:tasks.workunit.client.1.smithi107.stdout:1/62: mkdir d2/d12 0 2024-09-10T10:04:05.339 INFO:tasks.workunit.client.1.smithi107.stdout:7/44: dread d0/fb [0,4194304] 0 2024-09-10T10:04:05.340 INFO:tasks.workunit.client.1.smithi107.stdout:1/63: fsync d2/ff 0 2024-09-10T10:04:05.343 INFO:tasks.workunit.client.1.smithi107.stdout:7/45: creat d0/d8/d9/fe x:0 0 0 2024-09-10T10:04:05.352 INFO:tasks.workunit.client.1.smithi107.stdout:1/64: dwrite d2/d6/fa [0,4194304] 0 2024-09-10T10:04:05.355 INFO:tasks.workunit.client.1.smithi107.stdout:7/46: dwrite d0/fb [0,4194304] 0 2024-09-10T10:04:05.357 INFO:tasks.workunit.client.1.smithi107.stdout:1/65: rename d2/c8 to d2/d6/c13 0 2024-09-10T10:04:05.358 INFO:tasks.workunit.client.1.smithi107.stdout:7/47: creat d0/d8/d9/ff x:0 0 0 2024-09-10T10:04:05.359 INFO:tasks.workunit.client.1.smithi107.stdout:1/66: creat d2/d6/f14 x:0 0 0 2024-09-10T10:04:05.360 INFO:tasks.workunit.client.1.smithi107.stdout:1/67: chown d2/ff 1729335 1 2024-09-10T10:04:05.360 INFO:tasks.workunit.client.1.smithi107.stdout:7/48: truncate d0/f7 1620521 0 2024-09-10T10:04:05.361 INFO:tasks.workunit.client.1.smithi107.stdout:1/68: fdatasync d2/d6/f14 0 2024-09-10T10:04:05.363 INFO:tasks.workunit.client.1.smithi107.stdout:7/49: creat d0/d8/d9/f10 x:0 0 0 2024-09-10T10:04:05.366 INFO:tasks.workunit.client.1.smithi107.stdout:7/50: creat d0/d8/f11 x:0 0 0 2024-09-10T10:04:05.368 INFO:tasks.workunit.client.1.smithi107.stdout:7/51: creat d0/f12 x:0 0 0 2024-09-10T10:04:05.371 INFO:tasks.workunit.client.1.smithi107.stdout:7/52: rename d0/d8/d9/f10 to d0/d8/f13 0 2024-09-10T10:04:05.375 INFO:tasks.workunit.client.1.smithi107.stdout:7/53: dread d0/fb [0,4194304] 0 2024-09-10T10:04:05.376 INFO:tasks.workunit.client.1.smithi107.stdout:7/54: write d0/f12 [463363,57833] 0 2024-09-10T10:04:05.378 INFO:tasks.workunit.client.1.smithi107.stdout:7/55: unlink d0/d8/d9/fe 0 2024-09-10T10:04:05.378 INFO:tasks.workunit.client.1.smithi107.stdout:7/56: readlink d0/d8/ld 0 2024-09-10T10:04:05.380 INFO:tasks.workunit.client.1.smithi107.stdout:7/57: truncate d0/d8/f13 81697 0 2024-09-10T10:04:05.380 INFO:tasks.workunit.client.1.smithi107.stdout:7/58: stat d0/d8/f11 0 2024-09-10T10:04:05.384 INFO:tasks.workunit.client.1.smithi107.stdout:7/59: dread d0/fb [0,4194304] 0 2024-09-10T10:04:05.391 INFO:tasks.workunit.client.1.smithi107.stdout:7/60: dwrite d0/d8/d9/ff [0,4194304] 0 2024-09-10T10:04:05.392 INFO:tasks.workunit.client.1.smithi107.stdout:7/61: symlink d0/l14 0 2024-09-10T10:04:05.403 INFO:tasks.workunit.client.1.smithi107.stdout:1/69: write d2/d6/fc [1312121,127196] 0 2024-09-10T10:04:05.405 INFO:tasks.workunit.client.1.smithi107.stdout:1/70: fdatasync d2/ff 0 2024-09-10T10:04:05.408 INFO:tasks.workunit.client.1.smithi107.stdout:1/71: mknod d2/d12/c15 0 2024-09-10T10:04:05.410 INFO:tasks.workunit.client.1.smithi107.stdout:7/62: getdents d0 0 2024-09-10T10:04:05.412 INFO:tasks.workunit.client.1.smithi107.stdout:1/72: creat d2/d6/f16 x:0 0 0 2024-09-10T10:04:05.415 INFO:tasks.workunit.client.1.smithi107.stdout:1/73: rename d2/c11 to d2/c17 0 2024-09-10T10:04:05.415 INFO:tasks.workunit.client.1.smithi107.stdout:7/63: dread d0/d8/d9/ff [0,4194304] 0 2024-09-10T10:04:05.416 INFO:tasks.workunit.client.1.smithi107.stdout:1/74: read d2/f5 [426626,107011] 0 2024-09-10T10:04:05.417 INFO:tasks.workunit.client.1.smithi107.stdout:7/64: rmdir d0/d8/d9 39 2024-09-10T10:04:05.418 INFO:tasks.workunit.client.1.smithi107.stdout:7/65: write d0/fb [296922,115857] 0 2024-09-10T10:04:05.419 INFO:tasks.workunit.client.1.smithi107.stdout:1/75: creat d2/f18 x:0 0 0 2024-09-10T10:04:05.423 INFO:tasks.workunit.client.1.smithi107.stdout:1/76: write d2/ff [4760910,65144] 0 2024-09-10T10:04:05.425 INFO:tasks.workunit.client.1.smithi107.stdout:1/77: dread - d2/d6/f14 zero size 2024-09-10T10:04:05.426 INFO:tasks.workunit.client.1.smithi107.stdout:1/78: fsync d2/f18 0 2024-09-10T10:04:05.426 INFO:tasks.workunit.client.1.smithi107.stdout:7/66: dwrite d0/fb [0,4194304] 0 2024-09-10T10:04:05.429 INFO:tasks.workunit.client.1.smithi107.stdout:7/67: write d0/d8/f13 [741885,51542] 0 2024-09-10T10:04:05.430 INFO:tasks.workunit.client.1.smithi107.stdout:7/68: chown d0/l14 389927460 1 2024-09-10T10:04:05.430 INFO:tasks.workunit.client.1.smithi107.stdout:1/79: getdents d2/d6 0 2024-09-10T10:04:05.431 INFO:tasks.workunit.client.1.smithi107.stdout:7/69: chown d0/l14 6266583 1 2024-09-10T10:04:05.433 INFO:tasks.workunit.client.1.smithi107.stdout:1/80: symlink d2/d12/l19 0 2024-09-10T10:04:05.434 INFO:tasks.workunit.client.1.smithi107.stdout:7/70: symlink d0/d8/l15 0 2024-09-10T10:04:05.437 INFO:tasks.workunit.client.1.smithi107.stdout:1/81: getdents d2 0 2024-09-10T10:04:05.442 INFO:tasks.workunit.client.1.smithi107.stdout:1/82: dread d2/d6/fa [0,4194304] 0 2024-09-10T10:04:05.444 INFO:tasks.workunit.client.1.smithi107.stdout:1/83: truncate d2/d6/f16 907227 0 2024-09-10T10:04:05.445 INFO:tasks.workunit.client.1.smithi107.stdout:1/84: dread - d2/d6/f14 zero size 2024-09-10T10:04:05.447 INFO:tasks.workunit.client.1.smithi107.stdout:7/71: dwrite d0/f4 [0,4194304] 0 2024-09-10T10:04:05.448 INFO:tasks.workunit.client.1.smithi107.stdout:7/72: fsync d0/f12 0 2024-09-10T10:04:05.449 INFO:tasks.workunit.client.1.smithi107.stdout:1/85: getdents d2/d12 0 2024-09-10T10:04:05.450 INFO:tasks.workunit.client.1.smithi107.stdout:1/86: fsync d2/d6/fc 0 2024-09-10T10:04:05.450 INFO:tasks.workunit.client.1.smithi107.stdout:7/73: getdents d0 0 2024-09-10T10:04:05.451 INFO:tasks.workunit.client.1.smithi107.stdout:7/74: chown d0/d8/ld 5003 1 2024-09-10T10:04:05.453 INFO:tasks.workunit.client.1.smithi107.stdout:1/87: creat d2/d12/f1a x:0 0 0 2024-09-10T10:04:05.453 INFO:tasks.workunit.client.1.smithi107.stdout:7/75: rename d0/d8 to d0/d8/d16 22 2024-09-10T10:04:05.453 INFO:tasks.workunit.client.1.smithi107.stdout:1/88: chown d2/d6/c13 156917195 1 2024-09-10T10:04:05.454 INFO:tasks.workunit.client.1.smithi107.stdout:7/76: write d0/f12 [1044265,57719] 0 2024-09-10T10:04:05.462 INFO:tasks.workunit.client.1.smithi107.stdout:7/77: dread d0/fb [0,4194304] 0 2024-09-10T10:04:05.462 INFO:tasks.workunit.client.1.smithi107.stdout:1/89: dwrite d2/d6/f14 [0,4194304] 0 2024-09-10T10:04:05.465 INFO:tasks.workunit.client.1.smithi107.stdout:7/78: creat d0/f17 x:0 0 0 2024-09-10T10:04:05.467 INFO:tasks.workunit.client.1.smithi107.stdout:1/90: symlink d2/l1b 0 2024-09-10T10:04:05.468 INFO:tasks.workunit.client.1.smithi107.stdout:1/91: dread - d2/f10 zero size 2024-09-10T10:04:05.468 INFO:tasks.workunit.client.1.smithi107.stdout:1/92: dread - d2/f10 zero size 2024-09-10T10:04:05.470 INFO:tasks.workunit.client.1.smithi107.stdout:1/93: read d2/d6/fc [1200590,26809] 0 2024-09-10T10:04:05.472 INFO:tasks.workunit.client.1.smithi107.stdout:7/79: dread d0/d8/f13 [0,4194304] 0 2024-09-10T10:04:05.474 INFO:tasks.workunit.client.1.smithi107.stdout:7/80: write d0/d8/f11 [83235,126201] 0 2024-09-10T10:04:05.476 INFO:tasks.workunit.client.1.smithi107.stdout:7/81: unlink d0/f17 0 2024-09-10T10:04:05.477 INFO:tasks.workunit.client.1.smithi107.stdout:7/82: write d0/f4 [6221950,68257] 0 2024-09-10T10:04:05.480 INFO:tasks.workunit.client.1.smithi107.stdout:1/94: truncate d2/ff 1770114 0 2024-09-10T10:04:05.481 INFO:tasks.workunit.client.1.smithi107.stdout:1/95: rmdir d2 39 2024-09-10T10:04:05.484 INFO:tasks.workunit.client.1.smithi107.stdout:7/83: dwrite d0/fb [0,4194304] 0 2024-09-10T10:04:05.489 INFO:tasks.workunit.client.1.smithi107.stdout:1/96: read d2/ff [325405,100260] 0 2024-09-10T10:04:05.490 INFO:tasks.workunit.client.1.smithi107.stdout:7/84: creat d0/d8/f18 x:0 0 0 2024-09-10T10:04:05.494 INFO:tasks.workunit.client.1.smithi107.stdout:1/97: link d2/d6/fc d2/d6/f1c 0 2024-09-10T10:04:05.495 INFO:tasks.workunit.client.1.smithi107.stdout:7/85: mknod d0/d8/d9/c19 0 2024-09-10T10:04:05.497 INFO:tasks.workunit.client.1.smithi107.stdout:1/98: symlink d2/d6/l1d 0 2024-09-10T10:04:05.499 INFO:tasks.workunit.client.1.smithi107.stdout:7/86: rename d0/f12 to d0/d8/dc/f1a 0 2024-09-10T10:04:05.502 INFO:tasks.workunit.client.1.smithi107.stdout:7/87: mkdir d0/d1b 0 2024-09-10T10:04:05.504 INFO:tasks.workunit.client.1.smithi107.stdout:7/88: creat d0/d8/d9/f1c x:0 0 0 2024-09-10T10:04:05.506 INFO:tasks.workunit.client.1.smithi107.stdout:1/99: write d2/f5 [1138076,62894] 0 2024-09-10T10:04:05.509 INFO:tasks.workunit.client.1.smithi107.stdout:1/100: write d2/d6/f14 [3105473,18094] 0 2024-09-10T10:04:05.512 INFO:tasks.workunit.client.1.smithi107.stdout:7/89: dwrite d0/d8/f18 [0,4194304] 0 2024-09-10T10:04:05.513 INFO:tasks.workunit.client.1.smithi107.stdout:7/90: chown d0/d1b 476730 1 2024-09-10T10:04:05.516 INFO:tasks.workunit.client.1.smithi107.stdout:1/101: truncate d2/f5 107162 0 2024-09-10T10:04:05.516 INFO:tasks.workunit.client.1.smithi107.stdout:1/102: readlink d2/le 0 2024-09-10T10:04:05.517 INFO:tasks.workunit.client.1.smithi107.stdout:7/91: link d0/d8/ld d0/d8/dc/l1d 0 2024-09-10T10:04:05.518 INFO:tasks.workunit.client.1.smithi107.stdout:7/92: readlink d0/d8/l15 0 2024-09-10T10:04:05.522 INFO:tasks.workunit.client.1.smithi107.stdout:1/103: link d2/f10 d2/d12/f1e 0 2024-09-10T10:04:05.526 INFO:tasks.workunit.client.1.smithi107.stdout:7/93: dwrite d0/d8/f11 [0,4194304] 0 2024-09-10T10:04:05.535 INFO:tasks.workunit.client.1.smithi107.stdout:7/94: dwrite d0/d8/d9/ff [0,4194304] 0 2024-09-10T10:04:05.537 INFO:tasks.workunit.client.1.smithi107.stdout:7/95: creat d0/f1e x:0 0 0 2024-09-10T10:04:05.537 INFO:tasks.workunit.client.1.smithi107.stdout:7/96: chown d0/d8 1342224 1 2024-09-10T10:04:05.541 INFO:tasks.workunit.client.1.smithi107.stdout:7/97: link d0/fb d0/d8/dc/f1f 0 2024-09-10T10:04:05.558 INFO:tasks.workunit.client.1.smithi107.stdout:7/98: truncate d0/d8/f11 767689 0 2024-09-10T10:04:05.560 INFO:tasks.workunit.client.1.smithi107.stdout:7/99: mkdir d0/d20 0 2024-09-10T10:04:05.565 INFO:tasks.workunit.client.1.smithi107.stdout:7/100: dread d0/d8/dc/f1f [0,4194304] 0 2024-09-10T10:04:05.568 INFO:tasks.workunit.client.1.smithi107.stdout:7/101: link d0/d8/d9/f1c d0/f21 0 2024-09-10T10:04:05.570 INFO:tasks.workunit.client.1.smithi107.stdout:7/102: mknod d0/d8/dc/c22 0 2024-09-10T10:04:05.573 INFO:tasks.workunit.client.1.smithi107.stdout:7/103: getdents d0/d8/d9 0 2024-09-10T10:04:05.584 INFO:tasks.workunit.client.1.smithi107.stdout:7/104: dwrite d0/f7 [0,4194304] 0 2024-09-10T10:04:05.587 INFO:tasks.workunit.client.1.smithi107.stdout:7/105: symlink d0/d20/l23 0 2024-09-10T10:04:05.593 INFO:tasks.workunit.client.1.smithi107.stdout:7/106: write d0/d8/f11 [816110,87309] 0 2024-09-10T10:04:05.594 INFO:tasks.workunit.client.1.smithi107.stdout:7/107: chown d0/d8 6125592 1 2024-09-10T10:04:05.596 INFO:tasks.workunit.client.1.smithi107.stdout:7/108: readlink d0/d8/dc/l1d 0 2024-09-10T10:04:05.597 INFO:tasks.workunit.client.1.smithi107.stdout:7/109: rename d0 to d0/d8/d24 22 2024-09-10T10:04:05.598 INFO:tasks.workunit.client.1.smithi107.stdout:7/110: write d0/d8/f18 [2880348,71058] 0 2024-09-10T10:04:05.600 INFO:tasks.workunit.client.1.smithi107.stdout:7/111: unlink d0/f21 0 2024-09-10T10:04:05.605 INFO:tasks.workunit.client.1.smithi107.stdout:7/112: truncate d0/d8/d9/ff 3592365 0 2024-09-10T10:04:05.606 INFO:tasks.workunit.client.1.smithi107.stdout:7/113: truncate d0/f7 5208061 0 2024-09-10T10:04:05.608 INFO:tasks.workunit.client.1.smithi107.stdout:7/114: write d0/d8/dc/f1a [442718,105480] 0 2024-09-10T10:04:05.609 INFO:tasks.workunit.client.1.smithi107.stdout:7/115: chown d0/d8/d9 4024276 1 2024-09-10T10:04:05.610 INFO:tasks.workunit.client.1.smithi107.stdout:7/116: write d0/f1e [392416,41729] 0 2024-09-10T10:04:05.616 INFO:tasks.workunit.client.1.smithi107.stdout:7/117: truncate d0/f7 1898556 0 2024-09-10T10:04:05.712 INFO:tasks.workunit.client.0.smithi071.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-10T10:04:05.719 INFO:tasks.workunit.client.0.smithi071.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-10T10:04:05.720 INFO:tasks.workunit.client.0.smithi071.stderr:+ make 2024-09-10T10:04:05.748 INFO:tasks.workunit.client.1.smithi107.stdout:8/63: sync 2024-09-10T10:04:05.750 INFO:tasks.workunit.client.1.smithi107.stdout:8/64: symlink d5/l17 0 2024-09-10T10:04:05.751 INFO:tasks.workunit.client.0.smithi071.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-10T10:04:05.751 INFO:tasks.workunit.client.1.smithi107.stdout:8/65: rmdir d5/d8 39 2024-09-10T10:04:05.755 INFO:tasks.workunit.client.1.smithi107.stdout:8/66: mkdir d5/d8/dc/d18 0 2024-09-10T10:04:05.757 INFO:tasks.workunit.client.1.smithi107.stdout:8/67: creat d5/f19 x:0 0 0 2024-09-10T10:04:05.917 INFO:tasks.workunit.client.1.smithi107.stdout:3/61: sync 2024-09-10T10:04:05.918 INFO:tasks.workunit.client.1.smithi107.stdout:3/62: chown dc/dd/ce 30 1 2024-09-10T10:04:05.920 INFO:tasks.workunit.client.1.smithi107.stdout:3/63: getdents dc 0 2024-09-10T10:04:05.923 INFO:tasks.workunit.client.1.smithi107.stdout:3/64: dread f0 [4194304,4194304] 0 2024-09-10T10:04:05.925 INFO:tasks.workunit.client.1.smithi107.stdout:3/65: creat dc/dd/f12 x:0 0 0 2024-09-10T10:04:05.926 INFO:tasks.workunit.client.1.smithi107.stdout:3/66: symlink dc/dd/l13 0 2024-09-10T10:04:05.927 INFO:tasks.workunit.client.1.smithi107.stdout:3/67: mknod dc/dd/c14 0 2024-09-10T10:04:05.927 INFO:tasks.workunit.client.1.smithi107.stdout:3/68: chown dc/dd 0 1 2024-09-10T10:04:05.928 INFO:tasks.workunit.client.1.smithi107.stdout:3/69: dread - f2 zero size 2024-09-10T10:04:05.929 INFO:tasks.workunit.client.1.smithi107.stdout:3/70: write fa [4980914,21503] 0 2024-09-10T10:04:05.931 INFO:tasks.workunit.client.1.smithi107.stdout:3/71: mkdir dc/dd/d15 0 2024-09-10T10:04:05.932 INFO:tasks.workunit.client.1.smithi107.stdout:3/72: mknod dc/dd/d15/c16 0 2024-09-10T10:04:05.933 INFO:tasks.workunit.client.1.smithi107.stdout:3/73: chown f9 30 1 2024-09-10T10:04:05.934 INFO:tasks.workunit.client.1.smithi107.stdout:3/74: fsync f2 0 2024-09-10T10:04:05.937 INFO:tasks.workunit.client.1.smithi107.stdout:3/75: dread dc/f10 [0,4194304] 0 2024-09-10T10:04:05.938 INFO:tasks.workunit.client.1.smithi107.stdout:3/76: write f0 [9529777,27849] 0 2024-09-10T10:04:05.945 INFO:tasks.workunit.client.1.smithi107.stdout:3/77: dwrite f2 [0,4194304] 0 2024-09-10T10:04:05.948 INFO:tasks.workunit.client.1.smithi107.stdout:3/78: rename fa to dc/dd/f17 0 2024-09-10T10:04:05.953 INFO:tasks.workunit.client.1.smithi107.stdout:3/79: dwrite dc/f10 [0,4194304] 0 2024-09-10T10:04:05.958 INFO:tasks.workunit.client.1.smithi107.stdout:3/80: dread dc/f10 [0,4194304] 0 2024-09-10T10:04:05.964 INFO:tasks.workunit.client.1.smithi107.stdout:3/81: dwrite f9 [0,4194304] 0 2024-09-10T10:04:05.966 INFO:tasks.workunit.client.1.smithi107.stdout:3/82: mkdir dc/d18 0 2024-09-10T10:04:05.969 INFO:tasks.workunit.client.1.smithi107.stdout:3/83: rename f0 to dc/dd/d15/f19 0 2024-09-10T10:04:05.969 INFO:tasks.workunit.client.1.smithi107.stdout:3/84: chown dc/f10 845826 1 2024-09-10T10:04:05.970 INFO:tasks.workunit.client.1.smithi107.stdout:3/85: rename dc/d18 to dc/d18/d1a 22 2024-09-10T10:04:05.972 INFO:tasks.workunit.client.1.smithi107.stdout:3/86: rename dc/dd/ce to dc/dd/c1b 0 2024-09-10T10:04:06.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:05 smithi071 ceph-mon[27559]: pgmap v253: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 15 MiB/s wr, 417 op/s 2024-09-10T10:04:06.067 INFO:tasks.workunit.client.1.smithi107.stdout:9/34: sync 2024-09-10T10:04:06.067 INFO:tasks.workunit.client.1.smithi107.stdout:6/68: sync 2024-09-10T10:04:06.070 INFO:tasks.workunit.client.1.smithi107.stdout:6/69: creat d0/f13 x:0 0 0 2024-09-10T10:04:06.072 INFO:tasks.workunit.client.1.smithi107.stdout:6/70: mkdir d0/df/d14 0 2024-09-10T10:04:06.073 INFO:tasks.workunit.client.1.smithi107.stdout:9/35: dwrite d5/f6 [4194304,4194304] 0 2024-09-10T10:04:06.074 INFO:tasks.workunit.client.1.smithi107.stdout:6/71: symlink d0/df/d14/l15 0 2024-09-10T10:04:06.074 INFO:tasks.workunit.client.1.smithi107.stdout:9/36: write d5/d7/fb [68504,21112] 0 2024-09-10T10:04:06.076 INFO:tasks.workunit.client.1.smithi107.stdout:6/72: creat d0/df/d14/f16 x:0 0 0 2024-09-10T10:04:06.082 INFO:tasks.workunit.client.1.smithi107.stdout:9/37: link f3 d5/f10 0 2024-09-10T10:04:06.082 INFO:tasks.workunit.client.1.smithi107.stdout:6/73: dwrite d0/fa [8388608,4194304] 0 2024-09-10T10:04:06.087 INFO:tasks.workunit.client.1.smithi107.stdout:6/74: dread d0/f8 [0,4194304] 0 2024-09-10T10:04:06.087 INFO:tasks.workunit.client.1.smithi107.stdout:9/38: rename d5/f10 to d5/d7/f11 0 2024-09-10T10:04:06.088 INFO:tasks.workunit.client.1.smithi107.stdout:9/39: truncate d5/d7/fe 72635 0 2024-09-10T10:04:06.089 INFO:tasks.workunit.client.1.smithi107.stdout:6/75: mkdir d0/df/d14/d17 0 2024-09-10T10:04:06.090 INFO:tasks.workunit.client.1.smithi107.stdout:9/40: symlink d5/l12 0 2024-09-10T10:04:06.092 INFO:tasks.workunit.client.1.smithi107.stdout:9/41: unlink l4 0 2024-09-10T10:04:06.094 INFO:tasks.workunit.client.1.smithi107.stdout:6/76: getdents d0 0 2024-09-10T10:04:06.100 INFO:tasks.workunit.client.1.smithi107.stdout:6/77: dwrite d0/f13 [0,4194304] 0 2024-09-10T10:04:06.103 INFO:tasks.workunit.client.1.smithi107.stdout:6/78: creat d0/df/f18 x:0 0 0 2024-09-10T10:04:06.105 INFO:tasks.workunit.client.1.smithi107.stdout:6/79: creat d0/f19 x:0 0 0 2024-09-10T10:04:06.109 INFO:tasks.workunit.client.1.smithi107.stdout:9/42: dwrite f3 [0,4194304] 0 2024-09-10T10:04:06.110 INFO:tasks.workunit.client.1.smithi107.stdout:9/43: rmdir d5 39 2024-09-10T10:04:06.113 INFO:tasks.workunit.client.1.smithi107.stdout:9/44: truncate d5/d7/f9 874925 0 2024-09-10T10:04:06.118 INFO:tasks.workunit.client.1.smithi107.stdout:9/45: dread d5/d7/f11 [0,4194304] 0 2024-09-10T10:04:06.119 INFO:tasks.workunit.client.1.smithi107.stdout:9/46: rmdir d5/d7 39 2024-09-10T10:04:06.120 INFO:tasks.workunit.client.1.smithi107.stdout:9/47: write f3 [2889702,79200] 0 2024-09-10T10:04:06.122 INFO:tasks.workunit.client.1.smithi107.stdout:9/48: read d5/d7/fe [67387,72533] 0 2024-09-10T10:04:06.124 INFO:tasks.workunit.client.1.smithi107.stdout:9/49: getdents d5 0 2024-09-10T10:04:06.125 INFO:tasks.workunit.client.1.smithi107.stdout:6/80: fdatasync d0/f13 0 2024-09-10T10:04:06.127 INFO:tasks.workunit.client.1.smithi107.stdout:9/50: dread d5/d7/f9 [0,4194304] 0 2024-09-10T10:04:06.129 INFO:tasks.workunit.client.1.smithi107.stdout:6/81: rename d0/df/d14/f16 to d0/df/d14/d17/f1a 0 2024-09-10T10:04:06.131 INFO:tasks.workunit.client.1.smithi107.stdout:9/51: link d5/d7/f11 d5/d7/f13 0 2024-09-10T10:04:06.131 INFO:tasks.workunit.client.1.smithi107.stdout:9/52: chown l1 3938 1 2024-09-10T10:04:06.133 INFO:tasks.workunit.client.1.smithi107.stdout:9/53: getdents d5 0 2024-09-10T10:04:06.134 INFO:tasks.workunit.client.1.smithi107.stdout:9/54: creat d5/d7/f14 x:0 0 0 2024-09-10T10:04:06.139 INFO:tasks.workunit.client.1.smithi107.stdout:9/55: write d5/d7/f9 [251879,115495] 0 2024-09-10T10:04:06.144 INFO:tasks.workunit.client.1.smithi107.stdout:9/56: dwrite d5/d7/f9 [0,4194304] 0 2024-09-10T10:04:06.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:05 smithi107 ceph-mon[34215]: pgmap v253: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 15 MiB/s wr, 417 op/s 2024-09-10T10:04:06.145 INFO:tasks.workunit.client.1.smithi107.stdout:9/57: symlink d5/d7/l15 0 2024-09-10T10:04:06.146 INFO:tasks.workunit.client.1.smithi107.stdout:9/58: write d5/d7/fb [915103,72366] 0 2024-09-10T10:04:06.149 INFO:tasks.workunit.client.1.smithi107.stdout:9/59: dread d5/d7/f13 [0,4194304] 0 2024-09-10T10:04:06.153 INFO:tasks.workunit.client.1.smithi107.stdout:9/60: symlink d5/d7/l16 0 2024-09-10T10:04:06.155 INFO:tasks.workunit.client.1.smithi107.stdout:9/61: rename l1 to d5/l17 0 2024-09-10T10:04:06.156 INFO:tasks.workunit.client.1.smithi107.stdout:9/62: mknod d5/c18 0 2024-09-10T10:04:06.159 INFO:tasks.workunit.client.1.smithi107.stdout:9/63: dread d5/d7/f11 [0,4194304] 0 2024-09-10T10:04:06.160 INFO:tasks.workunit.client.1.smithi107.stdout:9/64: mkdir d5/d7/d19 0 2024-09-10T10:04:06.163 INFO:tasks.workunit.client.1.smithi107.stdout:9/65: truncate d5/d7/f11 1780538 0 2024-09-10T10:04:06.164 INFO:tasks.workunit.client.1.smithi107.stdout:9/66: chown d5/d7/cc 6720697 1 2024-09-10T10:04:06.165 INFO:tasks.workunit.client.1.smithi107.stdout:9/67: creat d5/d7/f1a x:0 0 0 2024-09-10T10:04:06.165 INFO:tasks.workunit.client.1.smithi107.stdout:9/68: rename d5/d7/d19 to d5/d7/d19/d1b 22 2024-09-10T10:04:06.168 INFO:tasks.workunit.client.1.smithi107.stdout:9/69: rename d5/l17 to d5/d7/d19/l1c 0 2024-09-10T10:04:06.168 INFO:tasks.workunit.client.1.smithi107.stdout:9/70: fdatasync d5/d7/fb 0 2024-09-10T10:04:06.170 INFO:tasks.workunit.client.1.smithi107.stdout:9/71: mkdir d5/d7/d1d 0 2024-09-10T10:04:06.171 INFO:tasks.workunit.client.1.smithi107.stdout:9/72: mkdir d5/d1e 0 2024-09-10T10:04:06.172 INFO:tasks.workunit.client.1.smithi107.stdout:9/73: creat d5/d1e/f1f x:0 0 0 2024-09-10T10:04:06.173 INFO:tasks.workunit.client.1.smithi107.stdout:9/74: write d5/d7/f1a [292202,58858] 0 2024-09-10T10:04:06.174 INFO:tasks.workunit.client.1.smithi107.stdout:9/75: creat d5/f20 x:0 0 0 2024-09-10T10:04:06.179 INFO:tasks.workunit.client.1.smithi107.stdout:9/76: dwrite d5/f20 [0,4194304] 0 2024-09-10T10:04:06.192 INFO:tasks.workunit.client.1.smithi107.stdout:4/92: sync 2024-09-10T10:04:06.195 INFO:tasks.workunit.client.1.smithi107.stdout:9/77: dread d5/d7/f11 [0,4194304] 0 2024-09-10T10:04:06.197 INFO:tasks.workunit.client.1.smithi107.stdout:4/93: rename d0/d13 to d0/d1f/d20 0 2024-09-10T10:04:06.199 INFO:tasks.workunit.client.1.smithi107.stdout:9/78: creat d5/d7/d1d/f21 x:0 0 0 2024-09-10T10:04:06.201 INFO:tasks.workunit.client.1.smithi107.stdout:9/79: rename d5/d7/d1d/f21 to d5/d7/d19/f22 0 2024-09-10T10:04:06.203 INFO:tasks.workunit.client.1.smithi107.stdout:4/94: dwrite d0/d1f/d20/f1b [0,4194304] 0 2024-09-10T10:04:06.204 INFO:tasks.workunit.client.1.smithi107.stdout:9/80: symlink d5/d7/d1d/l23 0 2024-09-10T10:04:06.205 INFO:tasks.workunit.client.1.smithi107.stdout:9/81: write d5/d7/f14 [507943,71869] 0 2024-09-10T10:04:06.206 INFO:tasks.workunit.client.1.smithi107.stdout:4/95: write d0/f11 [4619565,124881] 0 2024-09-10T10:04:06.207 INFO:tasks.workunit.client.1.smithi107.stdout:9/82: mknod d5/d1e/c24 0 2024-09-10T10:04:06.209 INFO:tasks.workunit.client.1.smithi107.stdout:4/96: creat d0/d1f/d20/f21 x:0 0 0 2024-09-10T10:04:06.212 INFO:tasks.workunit.client.1.smithi107.stdout:4/97: symlink d0/l22 0 2024-09-10T10:04:06.214 INFO:tasks.workunit.client.1.smithi107.stdout:9/83: getdents d5/d7/d1d 0 2024-09-10T10:04:06.216 INFO:tasks.workunit.client.1.smithi107.stdout:4/98: chown d0/c16 41 1 2024-09-10T10:04:06.216 INFO:tasks.workunit.client.1.smithi107.stdout:9/84: read d5/d7/fb [810695,49919] 0 2024-09-10T10:04:06.219 INFO:tasks.workunit.client.1.smithi107.stdout:9/85: truncate d5/d7/f11 1166221 0 2024-09-10T10:04:06.224 INFO:tasks.workunit.client.1.smithi107.stdout:4/99: dwrite d0/f14 [0,4194304] 0 2024-09-10T10:04:06.225 INFO:tasks.workunit.client.1.smithi107.stdout:4/100: dread - d0/d1f/d20/f21 zero size 2024-09-10T10:04:06.226 INFO:tasks.workunit.client.1.smithi107.stdout:9/86: dread d5/f6 [0,4194304] 0 2024-09-10T10:04:06.233 INFO:tasks.workunit.client.1.smithi107.stdout:9/87: write d5/d7/f11 [1069598,58757] 0 2024-09-10T10:04:06.234 INFO:tasks.workunit.client.1.smithi107.stdout:4/101: truncate d0/f14 3797202 0 2024-09-10T10:04:06.236 INFO:tasks.workunit.client.1.smithi107.stdout:4/102: write d0/f11 [5447434,121002] 0 2024-09-10T10:04:06.236 INFO:tasks.workunit.client.1.smithi107.stdout:9/88: mkdir d5/d7/d1d/d25 0 2024-09-10T10:04:06.237 INFO:tasks.workunit.client.1.smithi107.stdout:4/103: symlink d0/d1f/d20/l23 0 2024-09-10T10:04:06.238 INFO:tasks.workunit.client.1.smithi107.stdout:9/89: rename d5/d7/l15 to d5/d7/d19/l26 0 2024-09-10T10:04:06.240 INFO:tasks.workunit.client.1.smithi107.stdout:9/90: mkdir d5/d7/d1d/d25/d27 0 2024-09-10T10:04:06.242 INFO:tasks.workunit.client.1.smithi107.stdout:2/128: sync 2024-09-10T10:04:06.242 INFO:tasks.workunit.client.1.smithi107.stdout:0/48: sync 2024-09-10T10:04:06.242 INFO:tasks.workunit.client.1.smithi107.stdout:8/68: sync 2024-09-10T10:04:06.242 INFO:tasks.workunit.client.1.smithi107.stdout:1/104: sync 2024-09-10T10:04:06.242 INFO:tasks.workunit.client.1.smithi107.stdout:6/82: sync 2024-09-10T10:04:06.243 INFO:tasks.workunit.client.1.smithi107.stdout:7/118: sync 2024-09-10T10:04:06.243 INFO:tasks.workunit.client.1.smithi107.stdout:3/87: sync 2024-09-10T10:04:06.243 INFO:tasks.workunit.client.1.smithi107.stdout:5/107: sync 2024-09-10T10:04:06.244 INFO:tasks.workunit.client.1.smithi107.stdout:1/105: stat d2/d6/c13 0 2024-09-10T10:04:06.245 INFO:tasks.workunit.client.1.smithi107.stdout:7/119: readlink d0/d8/l15 0 2024-09-10T10:04:06.245 INFO:tasks.workunit.client.1.smithi107.stdout:3/88: write dc/f10 [319804,28527] 0 2024-09-10T10:04:06.246 INFO:tasks.workunit.client.1.smithi107.stdout:2/129: chown d3/d8/c23 179345 1 2024-09-10T10:04:06.247 INFO:tasks.workunit.client.1.smithi107.stdout:0/49: mkdir d6/dc 0 2024-09-10T10:04:06.247 INFO:tasks.workunit.client.1.smithi107.stdout:6/83: mknod d0/df/d14/c1b 0 2024-09-10T10:04:06.250 INFO:tasks.workunit.client.1.smithi107.stdout:7/120: read d0/d8/dc/f1a [925601,12377] 0 2024-09-10T10:04:06.252 INFO:tasks.workunit.client.1.smithi107.stdout:9/91: rmdir d5/d7 39 2024-09-10T10:04:06.253 INFO:tasks.workunit.client.1.smithi107.stdout:2/130: creat d3/da/f26 x:0 0 0 2024-09-10T10:04:06.254 INFO:tasks.workunit.client.1.smithi107.stdout:8/69: getdents d5/d8/dc/d18 0 2024-09-10T10:04:06.254 INFO:tasks.workunit.client.1.smithi107.stdout:6/84: unlink d0/df/f18 0 2024-09-10T10:04:06.256 INFO:tasks.workunit.client.1.smithi107.stdout:2/131: chown d3/f1c 12520 1 2024-09-10T10:04:06.256 INFO:tasks.workunit.client.1.smithi107.stdout:7/121: dread d0/f1e [0,4194304] 0 2024-09-10T10:04:06.257 INFO:tasks.workunit.client.1.smithi107.stdout:5/108: dwrite f1 [0,4194304] 0 2024-09-10T10:04:06.259 INFO:tasks.workunit.client.1.smithi107.stdout:3/89: write f7 [875455,127653] 0 2024-09-10T10:04:06.260 INFO:tasks.workunit.client.1.smithi107.stdout:5/109: dread - de/f1f zero size 2024-09-10T10:04:06.260 INFO:tasks.workunit.client.1.smithi107.stdout:9/92: read d5/d7/f13 [81663,101135] 0 2024-09-10T10:04:06.260 INFO:tasks.workunit.client.1.smithi107.stdout:4/104: dread d0/f2 [0,4194304] 0 2024-09-10T10:04:06.261 INFO:tasks.workunit.client.1.smithi107.stdout:6/85: creat d0/df/d14/d17/f1c x:0 0 0 2024-09-10T10:04:06.262 INFO:tasks.workunit.client.1.smithi107.stdout:2/132: mkdir d3/da/d1e/d27 0 2024-09-10T10:04:06.263 INFO:tasks.workunit.client.1.smithi107.stdout:4/105: readlink d0/d1f/d20/l23 0 2024-09-10T10:04:06.263 INFO:tasks.workunit.client.1.smithi107.stdout:5/110: truncate de/f1b 13822 0 2024-09-10T10:04:06.264 INFO:tasks.workunit.client.1.smithi107.stdout:1/106: getdents d2/d6 0 2024-09-10T10:04:06.264 INFO:tasks.workunit.client.1.smithi107.stdout:5/111: readlink de/l1d 0 2024-09-10T10:04:06.265 INFO:tasks.workunit.client.1.smithi107.stdout:4/106: dread - d0/d1f/d20/f21 zero size 2024-09-10T10:04:06.266 INFO:tasks.workunit.client.1.smithi107.stdout:7/122: rename d0/l14 to d0/d8/dc/l25 0 2024-09-10T10:04:06.268 INFO:tasks.workunit.client.1.smithi107.stdout:9/93: creat d5/d7/d19/f28 x:0 0 0 2024-09-10T10:04:06.268 INFO:tasks.workunit.client.1.smithi107.stdout:5/112: mkdir de/d20 0 2024-09-10T10:04:06.269 INFO:tasks.workunit.client.1.smithi107.stdout:4/107: symlink d0/d1f/l24 0 2024-09-10T10:04:06.271 INFO:tasks.workunit.client.1.smithi107.stdout:2/133: rename d3/l19 to d3/da/d1e/d22/l28 0 2024-09-10T10:04:06.272 INFO:tasks.workunit.client.1.smithi107.stdout:6/86: creat d0/f1d x:0 0 0 2024-09-10T10:04:06.275 INFO:tasks.workunit.client.1.smithi107.stdout:8/70: dwrite d5/ff [0,4194304] 0 2024-09-10T10:04:06.277 INFO:tasks.workunit.client.1.smithi107.stdout:9/94: mkdir d5/d7/d1d/d29 0 2024-09-10T10:04:06.278 INFO:tasks.workunit.client.1.smithi107.stdout:3/90: truncate dc/f10 2810457 0 2024-09-10T10:04:06.280 INFO:tasks.workunit.client.1.smithi107.stdout:1/107: getdents d2 0 2024-09-10T10:04:06.281 INFO:tasks.workunit.client.1.smithi107.stdout:8/71: mkdir d5/d8/dc/d1a 0 2024-09-10T10:04:06.282 INFO:tasks.workunit.client.1.smithi107.stdout:4/108: creat d0/f25 x:0 0 0 2024-09-10T10:04:06.282 INFO:tasks.workunit.client.1.smithi107.stdout:6/87: symlink d0/df/d14/d17/l1e 0 2024-09-10T10:04:06.283 INFO:tasks.workunit.client.1.smithi107.stdout:1/108: stat d2/d12/c15 0 2024-09-10T10:04:06.283 INFO:tasks.workunit.client.1.smithi107.stdout:5/113: dwrite de/f11 [0,4194304] 0 2024-09-10T10:04:06.284 INFO:tasks.workunit.client.1.smithi107.stdout:9/95: mknod d5/c2a 0 2024-09-10T10:04:06.284 INFO:tasks.workunit.client.1.smithi107.stdout:4/109: chown d0/d1f/d20 56 1 2024-09-10T10:04:06.285 INFO:tasks.workunit.client.1.smithi107.stdout:8/72: unlink l4 0 2024-09-10T10:04:06.294 INFO:tasks.workunit.client.1.smithi107.stdout:9/96: symlink d5/d1e/l2b 0 2024-09-10T10:04:06.294 INFO:tasks.workunit.client.1.smithi107.stdout:4/110: mknod d0/d1f/c26 0 2024-09-10T10:04:06.295 INFO:tasks.workunit.client.1.smithi107.stdout:3/91: dwrite dc/dd/f17 [0,4194304] 0 2024-09-10T10:04:06.299 INFO:tasks.workunit.client.1.smithi107.stdout:5/114: dwrite f9 [0,4194304] 0 2024-09-10T10:04:06.301 INFO:tasks.workunit.client.1.smithi107.stdout:2/134: write d3/da/f1d [626927,106242] 0 2024-09-10T10:04:06.301 INFO:tasks.workunit.client.1.smithi107.stdout:9/97: read - d5/d7/d19/f28 zero size 2024-09-10T10:04:06.303 INFO:tasks.workunit.client.1.smithi107.stdout:8/73: link d5/l17 d5/d8/dc/d1a/l1b 0 2024-09-10T10:04:06.303 INFO:tasks.workunit.client.1.smithi107.stdout:6/88: dread d0/fa [8388608,4194304] 0 2024-09-10T10:04:06.305 INFO:tasks.workunit.client.1.smithi107.stdout:5/115: mknod de/d20/c21 0 2024-09-10T10:04:06.308 INFO:tasks.workunit.client.1.smithi107.stdout:3/92: rmdir dc/d18 0 2024-09-10T10:04:06.309 INFO:tasks.workunit.client.1.smithi107.stdout:9/98: dread - d5/d7/d19/f22 zero size 2024-09-10T10:04:06.313 INFO:tasks.workunit.client.1.smithi107.stdout:2/135: mknod d3/da/df/d20/c29 0 2024-09-10T10:04:06.313 INFO:tasks.workunit.client.1.smithi107.stdout:5/116: write f8 [4148344,45647] 0 2024-09-10T10:04:06.314 INFO:tasks.workunit.client.1.smithi107.stdout:8/74: rename c0 to d5/c1c 0 2024-09-10T10:04:06.316 INFO:tasks.workunit.client.1.smithi107.stdout:3/93: creat dc/dd/f1c x:0 0 0 2024-09-10T10:04:06.318 INFO:tasks.workunit.client.1.smithi107.stdout:1/109: dwrite d2/d6/f1c [0,4194304] 0 2024-09-10T10:04:06.323 INFO:tasks.workunit.client.1.smithi107.stdout:2/136: symlink d3/da/df/d20/l2a 0 2024-09-10T10:04:06.326 INFO:tasks.workunit.client.1.smithi107.stdout:4/111: dwrite d0/f4 [4194304,4194304] 0 2024-09-10T10:04:06.328 INFO:tasks.workunit.client.1.smithi107.stdout:1/110: dread d2/f5 [0,4194304] 0 2024-09-10T10:04:06.336 INFO:tasks.workunit.client.1.smithi107.stdout:6/89: dwrite d0/f19 [0,4194304] 0 2024-09-10T10:04:06.338 INFO:tasks.workunit.client.1.smithi107.stdout:3/94: getdents dc/dd/d15 0 2024-09-10T10:04:06.339 INFO:tasks.workunit.client.1.smithi107.stdout:1/111: symlink d2/l1f 0 2024-09-10T10:04:06.340 INFO:tasks.workunit.client.1.smithi107.stdout:5/117: dwrite de/f1f [0,4194304] 0 2024-09-10T10:04:06.340 INFO:tasks.workunit.client.1.smithi107.stdout:9/99: dwrite d5/d7/f9 [0,4194304] 0 2024-09-10T10:04:06.345 INFO:tasks.workunit.client.1.smithi107.stdout:5/118: readlink de/l1d 0 2024-09-10T10:04:06.345 INFO:tasks.workunit.client.1.smithi107.stdout:6/90: creat d0/df/d14/f1f x:0 0 0 2024-09-10T10:04:06.346 INFO:tasks.workunit.client.1.smithi107.stdout:8/75: dwrite d5/d8/fe [0,4194304] 0 2024-09-10T10:04:06.347 INFO:tasks.workunit.client.1.smithi107.stdout:5/119: chown de/c12 19 1 2024-09-10T10:04:06.347 INFO:tasks.workunit.client.1.smithi107.stdout:2/137: rename d3/da/d1e/d22/l28 to d3/d21/l2b 0 2024-09-10T10:04:06.351 INFO:tasks.workunit.client.1.smithi107.stdout:8/76: write d5/d8/fd [1592728,51339] 0 2024-09-10T10:04:06.352 INFO:tasks.workunit.client.1.smithi107.stdout:6/91: write d0/df/d14/d17/f1c [466905,6101] 0 2024-09-10T10:04:06.352 INFO:tasks.workunit.client.1.smithi107.stdout:6/92: stat d0/fa 0 2024-09-10T10:04:06.353 INFO:tasks.workunit.client.1.smithi107.stdout:4/112: rename d0/c9 to d0/c27 0 2024-09-10T10:04:06.353 INFO:tasks.workunit.client.1.smithi107.stdout:5/120: mknod de/d20/c22 0 2024-09-10T10:04:06.354 INFO:tasks.workunit.client.1.smithi107.stdout:9/100: mknod d5/c2c 0 2024-09-10T10:04:06.356 INFO:tasks.workunit.client.1.smithi107.stdout:5/121: unlink de/f13 0 2024-09-10T10:04:06.358 INFO:tasks.workunit.client.1.smithi107.stdout:2/138: mkdir d3/d2c 0 2024-09-10T10:04:06.359 INFO:tasks.workunit.client.1.smithi107.stdout:4/113: fsync d0/f10 0 2024-09-10T10:04:06.360 INFO:tasks.workunit.client.1.smithi107.stdout:8/77: readlink d5/l17 0 2024-09-10T10:04:06.360 INFO:tasks.workunit.client.1.smithi107.stdout:9/101: symlink d5/d7/d19/l2d 0 2024-09-10T10:04:06.360 INFO:tasks.workunit.client.1.smithi107.stdout:6/93: rename d0/c9 to d0/df/d14/d17/c20 0 2024-09-10T10:04:06.362 INFO:tasks.workunit.client.1.smithi107.stdout:9/102: write d5/d7/f1a [563915,45766] 0 2024-09-10T10:04:06.364 INFO:tasks.workunit.client.1.smithi107.stdout:5/122: link de/c12 de/d20/c23 0 2024-09-10T10:04:06.364 INFO:tasks.workunit.client.1.smithi107.stdout:2/139: symlink d3/l2d 0 2024-09-10T10:04:06.365 INFO:tasks.workunit.client.1.smithi107.stdout:4/114: creat d0/f28 x:0 0 0 2024-09-10T10:04:06.366 INFO:tasks.workunit.client.1.smithi107.stdout:6/94: mkdir d0/df/d14/d21 0 2024-09-10T10:04:06.367 INFO:tasks.workunit.client.1.smithi107.stdout:5/123: chown de/l1d 17 1 2024-09-10T10:04:06.368 INFO:tasks.workunit.client.1.smithi107.stdout:9/103: symlink d5/d7/d1d/l2e 0 2024-09-10T10:04:06.368 INFO:tasks.workunit.client.1.smithi107.stdout:4/115: mkdir d0/d29 0 2024-09-10T10:04:06.372 INFO:tasks.workunit.client.1.smithi107.stdout:8/78: dwrite d5/fb [0,4194304] 0 2024-09-10T10:04:06.372 INFO:tasks.workunit.client.1.smithi107.stdout:4/116: symlink d0/d1f/d20/l2a 0 2024-09-10T10:04:06.372 INFO:tasks.workunit.client.1.smithi107.stdout:9/104: truncate d5/d7/f1a 620524 0 2024-09-10T10:04:06.376 INFO:tasks.workunit.client.1.smithi107.stdout:3/95: truncate f2 3880896 0 2024-09-10T10:04:06.379 INFO:tasks.workunit.client.1.smithi107.stdout:3/96: readlink dc/dd/l13 0 2024-09-10T10:04:06.382 INFO:tasks.workunit.client.1.smithi107.stdout:2/140: dwrite d3/da/f1d [0,4194304] 0 2024-09-10T10:04:06.382 INFO:tasks.workunit.client.1.smithi107.stdout:1/112: dwrite d2/ff [0,4194304] 0 2024-09-10T10:04:06.383 INFO:tasks.workunit.client.1.smithi107.stdout:3/97: read f9 [716415,64199] 0 2024-09-10T10:04:06.384 INFO:tasks.workunit.client.1.smithi107.stdout:1/113: write d2/d6/fc [894400,51205] 0 2024-09-10T10:04:06.386 INFO:tasks.workunit.client.1.smithi107.stdout:1/114: fsync d2/d12/f1a 0 2024-09-10T10:04:06.386 INFO:tasks.workunit.client.1.smithi107.stdout:1/115: stat d2/d6/fa 0 2024-09-10T10:04:06.387 INFO:tasks.workunit.client.1.smithi107.stdout:9/105: link d5/d7/f14 d5/d7/d1d/d25/f2f 0 2024-09-10T10:04:06.390 INFO:tasks.workunit.client.1.smithi107.stdout:4/117: link d0/d1f/d20/f1e d0/d1f/d20/f2b 0 2024-09-10T10:04:06.390 INFO:tasks.workunit.client.1.smithi107.stdout:3/98: write dc/dd/d15/f19 [3769635,29344] 0 2024-09-10T10:04:06.391 INFO:tasks.workunit.client.1.smithi107.stdout:9/106: write d5/f6 [8868306,30651] 0 2024-09-10T10:04:06.391 INFO:tasks.workunit.client.1.smithi107.stdout:2/141: creat d3/da/d1e/d27/f2e x:0 0 0 2024-09-10T10:04:06.394 INFO:tasks.workunit.client.1.smithi107.stdout:1/116: dread d2/d6/f16 [0,4194304] 0 2024-09-10T10:04:06.395 INFO:tasks.workunit.client.1.smithi107.stdout:8/79: truncate d5/fb 2258371 0 2024-09-10T10:04:06.395 INFO:tasks.workunit.client.1.smithi107.stdout:4/118: dread - d0/f1d zero size 2024-09-10T10:04:06.397 INFO:tasks.workunit.client.1.smithi107.stdout:1/117: mknod d2/d6/c20 0 2024-09-10T10:04:06.397 INFO:tasks.workunit.client.1.smithi107.stdout:9/107: truncate d5/d7/d19/f28 11648 0 2024-09-10T10:04:06.399 INFO:tasks.workunit.client.1.smithi107.stdout:4/119: creat d0/d1f/d20/f2c x:0 0 0 2024-09-10T10:04:06.399 INFO:tasks.workunit.client.1.smithi107.stdout:1/118: dread - d2/f18 zero size 2024-09-10T10:04:06.400 INFO:tasks.workunit.client.1.smithi107.stdout:8/80: rename d5/fa to d5/d8/f1d 0 2024-09-10T10:04:06.401 INFO:tasks.workunit.client.1.smithi107.stdout:1/119: dread - d2/f18 zero size 2024-09-10T10:04:06.402 INFO:tasks.workunit.client.1.smithi107.stdout:4/120: symlink d0/d1f/d20/l2d 0 2024-09-10T10:04:06.404 INFO:tasks.workunit.client.1.smithi107.stdout:4/121: dread - d0/d1f/d20/f21 zero size 2024-09-10T10:04:06.406 INFO:tasks.workunit.client.1.smithi107.stdout:1/120: creat d2/f21 x:0 0 0 2024-09-10T10:04:06.408 INFO:tasks.workunit.client.1.smithi107.stdout:4/122: write d0/f1d [815379,14701] 0 2024-09-10T10:04:06.408 INFO:tasks.workunit.client.1.smithi107.stdout:2/142: dwrite d3/da/f26 [0,4194304] 0 2024-09-10T10:04:06.409 INFO:tasks.workunit.client.1.smithi107.stdout:1/121: chown d2/d6/fc 56736056 1 2024-09-10T10:04:06.409 INFO:tasks.workunit.client.1.smithi107.stdout:8/81: mkdir d5/d8/dc/d1a/d1e 0 2024-09-10T10:04:06.411 INFO:tasks.workunit.client.1.smithi107.stdout:1/122: write d2/ff [1888564,14066] 0 2024-09-10T10:04:06.413 INFO:tasks.workunit.client.1.smithi107.stdout:1/123: chown d2/d6/fc 900 1 2024-09-10T10:04:06.413 INFO:tasks.workunit.client.1.smithi107.stdout:9/108: link d5/d7/d19/l26 d5/d7/d1d/d25/d27/l30 0 2024-09-10T10:04:06.418 INFO:tasks.workunit.client.1.smithi107.stdout:2/143: dread d3/da/f26 [0,4194304] 0 2024-09-10T10:04:06.419 INFO:tasks.workunit.client.1.smithi107.stdout:1/124: symlink d2/d6/l22 0 2024-09-10T10:04:06.420 INFO:tasks.workunit.client.1.smithi107.stdout:3/99: dwrite dc/f10 [0,4194304] 0 2024-09-10T10:04:06.423 INFO:tasks.workunit.client.1.smithi107.stdout:1/125: dread - d2/f10 zero size 2024-09-10T10:04:06.424 INFO:tasks.workunit.client.1.smithi107.stdout:8/82: rmdir d5/d8/dc/d1a/d1e 0 2024-09-10T10:04:06.427 INFO:tasks.workunit.client.1.smithi107.stdout:9/109: rename d5/d7/d19/f22 to d5/f31 0 2024-09-10T10:04:06.427 INFO:tasks.workunit.client.1.smithi107.stdout:1/126: mkdir d2/d6/d23 0 2024-09-10T10:04:06.428 INFO:tasks.workunit.client.1.smithi107.stdout:3/100: link f7 dc/dd/f1d 0 2024-09-10T10:04:06.429 INFO:tasks.workunit.client.1.smithi107.stdout:2/144: fdatasync d3/da/f26 0 2024-09-10T10:04:06.430 INFO:tasks.workunit.client.1.smithi107.stdout:1/127: stat d2/d6/f1c 0 2024-09-10T10:04:06.432 INFO:tasks.workunit.client.1.smithi107.stdout:1/128: read d2/f5 [11005,22106] 0 2024-09-10T10:04:06.434 INFO:tasks.workunit.client.1.smithi107.stdout:4/123: dwrite d0/fa [0,4194304] 0 2024-09-10T10:04:06.435 INFO:tasks.workunit.client.1.smithi107.stdout:1/129: rmdir d2/d6/d23 0 2024-09-10T10:04:06.436 INFO:tasks.workunit.client.1.smithi107.stdout:1/130: chown d2/f5 11685 1 2024-09-10T10:04:06.438 INFO:tasks.workunit.client.1.smithi107.stdout:1/131: write d2/f18 [1025365,17806] 0 2024-09-10T10:04:06.438 INFO:tasks.workunit.client.1.smithi107.stdout:1/132: read - d2/d12/f1e zero size 2024-09-10T10:04:06.439 INFO:tasks.workunit.client.1.smithi107.stdout:4/124: dread d0/f10 [0,4194304] 0 2024-09-10T10:04:06.440 INFO:tasks.workunit.client.1.smithi107.stdout:3/101: fsync f7 0 2024-09-10T10:04:06.440 INFO:tasks.workunit.client.1.smithi107.stdout:3/102: stat dc 0 2024-09-10T10:04:06.441 INFO:tasks.workunit.client.1.smithi107.stdout:4/125: write d0/f14 [3993949,55876] 0 2024-09-10T10:04:06.442 INFO:tasks.workunit.client.1.smithi107.stdout:8/83: truncate d5/d8/f1d 110541 0 2024-09-10T10:04:06.444 INFO:tasks.workunit.client.1.smithi107.stdout:3/103: mkdir dc/dd/d1e 0 2024-09-10T10:04:06.446 INFO:tasks.workunit.client.1.smithi107.stdout:4/126: creat d0/d1f/f2e x:0 0 0 2024-09-10T10:04:06.447 INFO:tasks.workunit.client.1.smithi107.stdout:3/104: chown dc/dd/f1c 9 1 2024-09-10T10:04:06.449 INFO:tasks.workunit.client.1.smithi107.stdout:8/84: rename d5/d8/f10 to d5/d8/dc/d1a/f1f 0 2024-09-10T10:04:06.449 INFO:tasks.workunit.client.1.smithi107.stdout:3/105: chown dc/dd 1087496 1 2024-09-10T10:04:06.449 INFO:tasks.workunit.client.1.smithi107.stdout:9/110: dwrite f3 [0,4194304] 0 2024-09-10T10:04:06.449 INFO:tasks.workunit.client.1.smithi107.stdout:4/127: mkdir d0/d1f/d20/d2f 0 2024-09-10T10:04:06.451 INFO:tasks.workunit.client.1.smithi107.stdout:9/111: read - d5/f31 zero size 2024-09-10T10:04:06.452 INFO:tasks.workunit.client.1.smithi107.stdout:8/85: creat d5/d8/f20 x:0 0 0 2024-09-10T10:04:06.453 INFO:tasks.workunit.client.1.smithi107.stdout:2/145: dwrite d3/da/f17 [4194304,4194304] 0 2024-09-10T10:04:06.453 INFO:tasks.workunit.client.1.smithi107.stdout:2/146: stat d3/da/df 0 2024-09-10T10:04:06.454 INFO:tasks.workunit.client.1.smithi107.stdout:2/147: stat f0 0 2024-09-10T10:04:06.455 INFO:tasks.workunit.client.1.smithi107.stdout:4/128: creat d0/d1f/d20/f30 x:0 0 0 2024-09-10T10:04:06.455 INFO:tasks.workunit.client.1.smithi107.stdout:1/133: truncate d2/d6/fa 863713 0 2024-09-10T10:04:06.458 INFO:tasks.workunit.client.1.smithi107.stdout:9/112: creat d5/d7/d19/f32 x:0 0 0 2024-09-10T10:04:06.459 INFO:tasks.workunit.client.1.smithi107.stdout:8/86: mkdir d5/d8/dc/d21 0 2024-09-10T10:04:06.460 INFO:tasks.workunit.client.1.smithi107.stdout:1/134: mkdir d2/d6/d24 0 2024-09-10T10:04:06.461 INFO:tasks.workunit.client.1.smithi107.stdout:1/135: write d2/d6/f1c [1827958,111471] 0 2024-09-10T10:04:06.464 INFO:tasks.workunit.client.1.smithi107.stdout:2/148: rename d3/l5 to d3/da/d1e/d22/l2f 0 2024-09-10T10:04:06.466 INFO:tasks.workunit.client.1.smithi107.stdout:1/136: creat d2/d12/f25 x:0 0 0 2024-09-10T10:04:06.466 INFO:tasks.workunit.client.1.smithi107.stdout:1/137: stat d2/d6/d24 0 2024-09-10T10:04:06.468 INFO:tasks.workunit.client.1.smithi107.stdout:4/129: rename d0/d1f/d20/l18 to d0/d29/l31 0 2024-09-10T10:04:06.469 INFO:tasks.workunit.client.1.smithi107.stdout:9/113: link d5/d7/l8 d5/d7/d19/l33 0 2024-09-10T10:04:06.470 INFO:tasks.workunit.client.1.smithi107.stdout:9/114: write d5/f6 [9090881,18154] 0 2024-09-10T10:04:06.470 INFO:tasks.workunit.client.1.smithi107.stdout:2/149: write d3/f11 [447835,49447] 0 2024-09-10T10:04:06.471 INFO:tasks.workunit.client.0.smithi071.stderr:++ readlink -f fsstress 2024-09-10T10:04:06.473 INFO:tasks.workunit.client.0.smithi071.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-10T10:04:06.474 INFO:tasks.workunit.client.0.smithi071.stderr:+ popd 2024-09-10T10:04:06.475 INFO:tasks.workunit.client.0.smithi071.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-10T10:04:06.476 INFO:tasks.workunit.client.0.smithi071.stderr:+ popd 2024-09-10T10:04:06.476 INFO:tasks.workunit.client.0.smithi071.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-10T10:04:06.477 INFO:tasks.workunit.client.0.smithi071.stderr:++ mktemp -d -p . 2024-09-10T10:04:06.477 INFO:tasks.workunit.client.1.smithi107.stdout:4/130: unlink d0/f25 0 2024-09-10T10:04:06.478 INFO:tasks.workunit.client.1.smithi107.stdout:9/115: symlink d5/d7/d19/l34 0 2024-09-10T10:04:06.479 INFO:tasks.workunit.client.1.smithi107.stdout:2/150: mknod d3/da/d1e/d27/c30 0 2024-09-10T10:04:06.482 INFO:tasks.workunit.client.1.smithi107.stdout:8/87: dread d5/d8/f1d [0,4194304] 0 2024-09-10T10:04:06.483 INFO:tasks.workunit.client.0.smithi071.stderr:+ T=./tmp.3YsYuMMj07 2024-09-10T10:04:06.483 INFO:tasks.workunit.client.0.smithi071.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.3YsYuMMj07 -l 1 -n 1000 -p 10 -v 2024-09-10T10:04:06.485 INFO:tasks.workunit.client.1.smithi107.stdout:9/116: unlink d5/cd 0 2024-09-10T10:04:06.486 INFO:tasks.workunit.client.1.smithi107.stdout:2/151: rmdir d3/da/df/d20 39 2024-09-10T10:04:06.486 INFO:tasks.workunit.client.0.smithi071.stdout:seed = 1726444777 2024-09-10T10:04:06.486 INFO:tasks.workunit.client.1.smithi107.stdout:8/88: mknod d5/d8/dc/c22 0 2024-09-10T10:04:06.487 INFO:tasks.workunit.client.1.smithi107.stdout:4/131: symlink d0/l32 0 2024-09-10T10:04:06.490 INFO:tasks.workunit.client.1.smithi107.stdout:9/117: unlink d5/f20 0 2024-09-10T10:04:06.492 INFO:tasks.workunit.client.1.smithi107.stdout:8/89: fsync d5/d8/f1d 0 2024-09-10T10:04:06.494 INFO:tasks.workunit.client.1.smithi107.stdout:1/138: dwrite d2/d12/f1e [0,4194304] 0 2024-09-10T10:04:06.494 INFO:tasks.workunit.client.1.smithi107.stdout:8/90: readlink d5/d8/dc/d1a/l1b 0 2024-09-10T10:04:06.496 INFO:tasks.workunit.client.1.smithi107.stdout:2/152: creat d3/f31 x:0 0 0 2024-09-10T10:04:06.496 INFO:tasks.workunit.client.0.smithi071.stdout:1/0: stat - no entries 2024-09-10T10:04:06.496 INFO:tasks.workunit.client.0.smithi071.stdout:1/1: truncate - no filename 2024-09-10T10:04:06.497 INFO:tasks.workunit.client.0.smithi071.stdout:1/2: dwrite - no filename 2024-09-10T10:04:06.497 INFO:tasks.workunit.client.0.smithi071.stdout:1/3: rmdir - no directory 2024-09-10T10:04:06.497 INFO:tasks.workunit.client.0.smithi071.stdout:1/4: rename - no filename 2024-09-10T10:04:06.497 INFO:tasks.workunit.client.0.smithi071.stdout:1/5: readlink - no filename 2024-09-10T10:04:06.497 INFO:tasks.workunit.client.0.smithi071.stdout:1/6: chown . 12976 1 2024-09-10T10:04:06.497 INFO:tasks.workunit.client.0.smithi071.stdout:1/7: truncate - no filename 2024-09-10T10:04:06.497 INFO:tasks.workunit.client.0.smithi071.stdout:1/8: write - no filename 2024-09-10T10:04:06.497 INFO:tasks.workunit.client.0.smithi071.stdout:1/9: dwrite - no filename 2024-09-10T10:04:06.498 INFO:tasks.workunit.client.0.smithi071.stdout:0/0: creat f0 x:0 0 0 2024-09-10T10:04:06.498 INFO:tasks.workunit.client.1.smithi107.stdout:1/139: write d2/f10 [1061721,12538] 0 2024-09-10T10:04:06.498 INFO:tasks.workunit.client.1.smithi107.stdout:8/91: write d5/d8/f9 [2421027,111675] 0 2024-09-10T10:04:06.498 INFO:tasks.workunit.client.1.smithi107.stdout:9/118: creat d5/f35 x:0 0 0 2024-09-10T10:04:06.499 INFO:tasks.workunit.client.1.smithi107.stdout:1/140: chown d2/d12/c15 78 1 2024-09-10T10:04:06.499 INFO:tasks.workunit.client.0.smithi071.stdout:0/1: dread - f0 zero size 2024-09-10T10:04:06.499 INFO:tasks.workunit.client.1.smithi107.stdout:9/119: stat d5/d7/d19 0 2024-09-10T10:04:06.499 INFO:tasks.workunit.client.0.smithi071.stdout:1/10: symlink l0 0 2024-09-10T10:04:06.500 INFO:tasks.workunit.client.0.smithi071.stdout:1/11: truncate - no filename 2024-09-10T10:04:06.500 INFO:tasks.workunit.client.0.smithi071.stdout:1/12: dwrite - no filename 2024-09-10T10:04:06.501 INFO:tasks.workunit.client.1.smithi107.stdout:9/120: stat d5/d7/d1d/d25 0 2024-09-10T10:04:06.501 INFO:tasks.workunit.client.1.smithi107.stdout:2/153: dread d3/f11 [0,4194304] 0 2024-09-10T10:04:06.502 INFO:tasks.workunit.client.1.smithi107.stdout:4/132: rename d0/d1f/d20/f1b to d0/d1f/d20/d2f/f33 0 2024-09-10T10:04:06.502 INFO:tasks.workunit.client.0.smithi071.stdout:0/2: creat f1 x:0 0 0 2024-09-10T10:04:06.502 INFO:tasks.workunit.client.0.smithi071.stdout:3/0: write - no filename 2024-09-10T10:04:06.502 INFO:tasks.workunit.client.0.smithi071.stdout:3/1: dread - no filename 2024-09-10T10:04:06.502 INFO:tasks.workunit.client.0.smithi071.stdout:3/2: dread - no filename 2024-09-10T10:04:06.502 INFO:tasks.workunit.client.0.smithi071.stdout:3/3: fsync - no filename 2024-09-10T10:04:06.502 INFO:tasks.workunit.client.0.smithi071.stdout:3/4: dwrite - no filename 2024-09-10T10:04:06.502 INFO:tasks.workunit.client.0.smithi071.stdout:3/5: chown . 1419219 1 2024-09-10T10:04:06.502 INFO:tasks.workunit.client.0.smithi071.stdout:3/6: stat - no entries 2024-09-10T10:04:06.503 INFO:tasks.workunit.client.0.smithi071.stdout:1/13: mkdir d1 0 2024-09-10T10:04:06.503 INFO:tasks.workunit.client.0.smithi071.stdout:1/14: write - no filename 2024-09-10T10:04:06.505 INFO:tasks.workunit.client.0.smithi071.stdout:0/3: link f1 f2 0 2024-09-10T10:04:06.505 INFO:tasks.workunit.client.0.smithi071.stdout:0/4: stat f1 0 2024-09-10T10:04:06.505 INFO:tasks.workunit.client.0.smithi071.stdout:0/5: stat f0 0 2024-09-10T10:04:06.505 INFO:tasks.workunit.client.0.smithi071.stdout:3/7: creat f0 x:0 0 0 2024-09-10T10:04:06.506 INFO:tasks.workunit.client.0.smithi071.stdout:0/6: truncate f2 172349 0 2024-09-10T10:04:06.506 INFO:tasks.workunit.client.1.smithi107.stdout:1/141: unlink d2/le 0 2024-09-10T10:04:06.507 INFO:tasks.workunit.client.0.smithi071.stdout:3/8: truncate f0 982280 0 2024-09-10T10:04:06.507 INFO:tasks.workunit.client.0.smithi071.stdout:3/9: rmdir - no directory 2024-09-10T10:04:06.507 INFO:tasks.workunit.client.0.smithi071.stdout:1/15: mknod d1/c2 0 2024-09-10T10:04:06.507 INFO:tasks.workunit.client.0.smithi071.stdout:1/16: dread - no filename 2024-09-10T10:04:06.508 INFO:tasks.workunit.client.0.smithi071.stdout:5/0: dread - no filename 2024-09-10T10:04:06.508 INFO:tasks.workunit.client.0.smithi071.stdout:4/0: mknod c0 0 2024-09-10T10:04:06.508 INFO:tasks.workunit.client.0.smithi071.stdout:4/1: write - no filename 2024-09-10T10:04:06.509 INFO:tasks.workunit.client.1.smithi107.stdout:1/142: fdatasync d2/d6/fc 0 2024-09-10T10:04:06.509 INFO:tasks.workunit.client.1.smithi107.stdout:9/121: dwrite d5/d7/f13 [0,4194304] 0 2024-09-10T10:04:06.510 INFO:tasks.workunit.client.1.smithi107.stdout:2/154: fsync d3/f18 0 2024-09-10T10:04:06.510 INFO:tasks.workunit.client.0.smithi071.stdout:7/0: rename - no filename 2024-09-10T10:04:06.510 INFO:tasks.workunit.client.0.smithi071.stdout:7/1: write - no filename 2024-09-10T10:04:06.510 INFO:tasks.workunit.client.0.smithi071.stdout:7/2: dread - no filename 2024-09-10T10:04:06.511 INFO:tasks.workunit.client.0.smithi071.stdout:7/3: dwrite - no filename 2024-09-10T10:04:06.511 INFO:tasks.workunit.client.0.smithi071.stdout:7/4: fsync - no filename 2024-09-10T10:04:06.512 INFO:tasks.workunit.client.1.smithi107.stdout:4/133: rename d0/f2 to d0/d1f/f34 0 2024-09-10T10:04:06.513 INFO:tasks.workunit.client.1.smithi107.stdout:9/122: fdatasync d5/d7/d19/f28 0 2024-09-10T10:04:06.525 INFO:tasks.workunit.client.1.smithi107.stdout:8/92: getdents d5/d8 0 2024-09-10T10:04:06.525 INFO:tasks.workunit.client.1.smithi107.stdout:1/143: dwrite d2/f10 [4194304,4194304] 0 2024-09-10T10:04:06.526 INFO:tasks.workunit.client.1.smithi107.stdout:9/123: mknod d5/d7/d1d/d25/d27/c36 0 2024-09-10T10:04:06.527 INFO:tasks.workunit.client.1.smithi107.stdout:1/144: write d2/d6/f1c [2507164,87206] 0 2024-09-10T10:04:06.528 INFO:tasks.workunit.client.1.smithi107.stdout:8/93: symlink d5/d8/l23 0 2024-09-10T10:04:06.530 INFO:tasks.workunit.client.1.smithi107.stdout:2/155: getdents d3 0 2024-09-10T10:04:06.533 INFO:tasks.workunit.client.1.smithi107.stdout:4/134: getdents d0 0 2024-09-10T10:04:06.534 INFO:tasks.workunit.client.1.smithi107.stdout:8/94: unlink d5/d8/f1d 0 2024-09-10T10:04:06.535 INFO:tasks.workunit.client.1.smithi107.stdout:1/145: dread d2/ff [0,4194304] 0 2024-09-10T10:04:06.535 INFO:tasks.workunit.client.1.smithi107.stdout:1/146: chown d2/d6/f16 3 1 2024-09-10T10:04:06.536 INFO:tasks.workunit.client.1.smithi107.stdout:1/147: chown d2/d6/l22 1724 1 2024-09-10T10:04:06.536 INFO:tasks.workunit.client.1.smithi107.stdout:2/156: fdatasync d3/da/df/f15 0 2024-09-10T10:04:06.537 INFO:tasks.workunit.client.1.smithi107.stdout:1/148: truncate d2/d12/f25 1045294 0 2024-09-10T10:04:06.538 INFO:tasks.workunit.client.1.smithi107.stdout:4/135: symlink d0/d29/l35 0 2024-09-10T10:04:06.539 INFO:tasks.workunit.client.1.smithi107.stdout:8/95: creat d5/d8/f24 x:0 0 0 2024-09-10T10:04:06.540 INFO:tasks.workunit.client.1.smithi107.stdout:1/149: dread d2/d12/f25 [0,4194304] 0 2024-09-10T10:04:06.541 INFO:tasks.workunit.client.1.smithi107.stdout:8/96: write d5/d8/f20 [81372,67460] 0 2024-09-10T10:04:06.541 INFO:tasks.workunit.client.1.smithi107.stdout:4/136: symlink d0/d1f/d20/d2f/l36 0 2024-09-10T10:04:06.542 INFO:tasks.workunit.client.1.smithi107.stdout:2/157: rmdir d3/d2c 0 2024-09-10T10:04:06.546 INFO:tasks.workunit.client.1.smithi107.stdout:9/124: truncate d5/d7/f13 1346932 0 2024-09-10T10:04:06.546 INFO:tasks.workunit.client.1.smithi107.stdout:1/150: dread d2/ff [0,4194304] 0 2024-09-10T10:04:06.548 INFO:tasks.workunit.client.1.smithi107.stdout:9/125: write d5/f35 [199836,25719] 0 2024-09-10T10:04:06.549 INFO:tasks.workunit.client.1.smithi107.stdout:9/126: readlink d5/d7/l16 0 2024-09-10T10:04:06.550 INFO:tasks.workunit.client.1.smithi107.stdout:1/151: mknod d2/d6/c26 0 2024-09-10T10:04:06.550 INFO:tasks.workunit.client.1.smithi107.stdout:8/97: dwrite d5/d8/f9 [0,4194304] 0 2024-09-10T10:04:06.551 INFO:tasks.workunit.client.1.smithi107.stdout:8/98: fdatasync d5/d8/f20 0 2024-09-10T10:04:06.554 INFO:tasks.workunit.client.1.smithi107.stdout:4/137: truncate d0/f14 727536 0 2024-09-10T10:04:06.554 INFO:tasks.workunit.client.1.smithi107.stdout:9/127: readlink d5/d7/d19/l26 0 2024-09-10T10:04:06.556 INFO:tasks.workunit.client.1.smithi107.stdout:4/138: write d0/f1d [1599856,128571] 0 2024-09-10T10:04:06.556 INFO:tasks.workunit.client.1.smithi107.stdout:1/152: getdents d2/d6/d24 0 2024-09-10T10:04:06.556 INFO:tasks.workunit.client.1.smithi107.stdout:8/99: creat d5/d8/dc/d21/f25 x:0 0 0 2024-09-10T10:04:06.556 INFO:tasks.workunit.client.1.smithi107.stdout:1/153: dread - d2/d12/f1a zero size 2024-09-10T10:04:06.557 INFO:tasks.workunit.client.1.smithi107.stdout:9/128: fdatasync d5/d7/fe 0 2024-09-10T10:04:06.558 INFO:tasks.workunit.client.1.smithi107.stdout:2/158: chown d3/da/f17 194731528 1 2024-09-10T10:04:06.558 INFO:tasks.workunit.client.1.smithi107.stdout:4/139: mknod d0/d1f/c37 0 2024-09-10T10:04:06.559 INFO:tasks.workunit.client.1.smithi107.stdout:1/154: rmdir d2/d6 39 2024-09-10T10:04:06.560 INFO:tasks.workunit.client.1.smithi107.stdout:9/129: mkdir d5/d7/d1d/d25/d37 0 2024-09-10T10:04:06.560 INFO:tasks.workunit.client.1.smithi107.stdout:1/155: write d2/f10 [5891288,44278] 0 2024-09-10T10:04:06.564 INFO:tasks.workunit.client.1.smithi107.stdout:2/159: dread d3/da/d1e/f24 [0,4194304] 0 2024-09-10T10:04:06.565 INFO:tasks.workunit.client.1.smithi107.stdout:1/156: chown d2/d6/fc 1059171249 1 2024-09-10T10:04:06.566 INFO:tasks.workunit.client.1.smithi107.stdout:1/157: symlink d2/d6/l27 0 2024-09-10T10:04:06.568 INFO:tasks.workunit.client.1.smithi107.stdout:2/160: creat d3/d21/f32 x:0 0 0 2024-09-10T10:04:06.568 INFO:tasks.workunit.client.0.smithi071.stdout:0/7: link f2 f3 0 2024-09-10T10:04:06.568 INFO:tasks.workunit.client.0.smithi071.stdout:3/10: symlink l1 0 2024-09-10T10:04:06.568 INFO:tasks.workunit.client.0.smithi071.stdout:1/17: creat d1/f3 x:0 0 0 2024-09-10T10:04:06.569 INFO:tasks.workunit.client.0.smithi071.stdout:4/2: creat f1 x:0 0 0 2024-09-10T10:04:06.569 INFO:tasks.workunit.client.1.smithi107.stdout:1/158: unlink d2/d6/f14 0 2024-09-10T10:04:06.570 INFO:tasks.workunit.client.0.smithi071.stdout:3/11: write f0 [220746,130001] 0 2024-09-10T10:04:06.570 INFO:tasks.workunit.client.0.smithi071.stdout:6/0: truncate - no filename 2024-09-10T10:04:06.570 INFO:tasks.workunit.client.0.smithi071.stdout:4/3: fdatasync f1 0 2024-09-10T10:04:06.570 INFO:tasks.workunit.client.0.smithi071.stdout:1/18: read - d1/f3 zero size 2024-09-10T10:04:06.571 INFO:tasks.workunit.client.0.smithi071.stdout:3/12: chown l1 3188415 1 2024-09-10T10:04:06.571 INFO:tasks.workunit.client.0.smithi071.stdout:3/13: readlink l1 0 2024-09-10T10:04:06.572 INFO:tasks.workunit.client.0.smithi071.stdout:4/4: chown c0 29 1 2024-09-10T10:04:06.572 INFO:tasks.workunit.client.1.smithi107.stdout:2/161: write d3/f18 [998369,33082] 0 2024-09-10T10:04:06.573 INFO:tasks.workunit.client.0.smithi071.stdout:3/14: truncate f0 1747113 0 2024-09-10T10:04:06.574 INFO:tasks.workunit.client.1.smithi107.stdout:1/159: mknod d2/d12/c28 0 2024-09-10T10:04:06.577 INFO:tasks.workunit.client.1.smithi107.stdout:4/140: truncate d0/f12 5304031 0 2024-09-10T10:04:06.580 INFO:tasks.workunit.client.1.smithi107.stdout:4/141: write d0/f10 [3581881,103136] 0 2024-09-10T10:04:06.583 INFO:tasks.workunit.client.1.smithi107.stdout:2/162: dwrite d3/da/f1d [0,4194304] 0 2024-09-10T10:04:06.583 INFO:tasks.workunit.client.1.smithi107.stdout:4/142: readlink d0/d1f/d20/l2d 0 2024-09-10T10:04:06.588 INFO:tasks.workunit.client.1.smithi107.stdout:9/130: dwrite d5/d7/f14 [0,4194304] 0 2024-09-10T10:04:06.589 INFO:tasks.workunit.client.1.smithi107.stdout:4/143: write d0/f28 [161571,80549] 0 2024-09-10T10:04:06.591 INFO:tasks.workunit.client.1.smithi107.stdout:1/160: dwrite d2/f21 [0,4194304] 0 2024-09-10T10:04:06.591 INFO:tasks.workunit.client.1.smithi107.stdout:2/163: creat d3/da/df/d20/f33 x:0 0 0 2024-09-10T10:04:06.593 INFO:tasks.workunit.client.1.smithi107.stdout:4/144: unlink d0/f28 0 2024-09-10T10:04:06.597 INFO:tasks.workunit.client.1.smithi107.stdout:2/164: creat d3/da/d1e/d22/f34 x:0 0 0 2024-09-10T10:04:06.597 INFO:tasks.workunit.client.1.smithi107.stdout:9/131: symlink d5/d7/d1d/d25/d37/l38 0 2024-09-10T10:04:06.600 INFO:tasks.workunit.client.1.smithi107.stdout:9/132: rename d5/c2a to d5/d7/d1d/d25/d37/c39 0 2024-09-10T10:04:06.601 INFO:tasks.workunit.client.1.smithi107.stdout:2/165: dread d3/d8/f16 [0,4194304] 0 2024-09-10T10:04:06.603 INFO:tasks.workunit.client.1.smithi107.stdout:9/133: creat d5/d7/d1d/d29/f3a x:0 0 0 2024-09-10T10:04:06.605 INFO:tasks.workunit.client.1.smithi107.stdout:9/134: write d5/d1e/f1f [849702,94974] 0 2024-09-10T10:04:06.605 INFO:tasks.workunit.client.1.smithi107.stdout:2/166: creat d3/d8/f35 x:0 0 0 2024-09-10T10:04:06.606 INFO:tasks.workunit.client.1.smithi107.stdout:9/135: stat d5/d7/d19/l26 0 2024-09-10T10:04:06.615 INFO:tasks.workunit.client.1.smithi107.stdout:2/167: dwrite d3/da/df/d20/f33 [0,4194304] 0 2024-09-10T10:04:06.616 INFO:tasks.workunit.client.1.smithi107.stdout:9/136: dread d5/f6 [0,4194304] 0 2024-09-10T10:04:06.616 INFO:tasks.workunit.client.1.smithi107.stdout:1/161: dwrite d2/d6/fa [0,4194304] 0 2024-09-10T10:04:06.618 INFO:tasks.workunit.client.1.smithi107.stdout:9/137: chown d5/d7/d1d/d25/d27/l30 790258005 1 2024-09-10T10:04:06.618 INFO:tasks.workunit.client.1.smithi107.stdout:2/168: mkdir d3/da/df/d20/d36 0 2024-09-10T10:04:06.619 INFO:tasks.workunit.client.1.smithi107.stdout:9/138: mkdir d5/d7/d1d/d3b 0 2024-09-10T10:04:06.620 INFO:tasks.workunit.client.1.smithi107.stdout:1/162: creat d2/f29 x:0 0 0 2024-09-10T10:04:06.621 INFO:tasks.workunit.client.1.smithi107.stdout:2/169: rename d3/da/f26 to d3/d21/f37 0 2024-09-10T10:04:06.622 INFO:tasks.workunit.client.1.smithi107.stdout:9/139: mkdir d5/d7/d3c 0 2024-09-10T10:04:06.624 INFO:tasks.workunit.client.1.smithi107.stdout:1/163: unlink d2/d6/c26 0 2024-09-10T10:04:06.624 INFO:tasks.workunit.client.1.smithi107.stdout:9/140: rmdir d5/d7 39 2024-09-10T10:04:06.624 INFO:tasks.workunit.client.1.smithi107.stdout:1/164: read d2/d6/f1c [2859435,49307] 0 2024-09-10T10:04:06.625 INFO:tasks.workunit.client.1.smithi107.stdout:2/170: mknod d3/da/df/c38 0 2024-09-10T10:04:06.625 INFO:tasks.workunit.client.1.smithi107.stdout:1/165: chown d2/f21 104674527 1 2024-09-10T10:04:06.627 INFO:tasks.workunit.client.1.smithi107.stdout:2/171: rmdir d3/da/d1e 39 2024-09-10T10:04:06.629 INFO:tasks.workunit.client.1.smithi107.stdout:1/166: mkdir d2/d2a 0 2024-09-10T10:04:06.631 INFO:tasks.workunit.client.1.smithi107.stdout:2/172: mkdir d3/da/df/d20/d36/d39 0 2024-09-10T10:04:06.635 INFO:tasks.workunit.client.1.smithi107.stdout:9/141: dwrite d5/d7/d19/f28 [0,4194304] 0 2024-09-10T10:04:06.638 INFO:tasks.workunit.client.1.smithi107.stdout:9/142: mknod d5/d7/d1d/d25/d37/c3d 0 2024-09-10T10:04:06.640 INFO:tasks.workunit.client.1.smithi107.stdout:9/143: rename d5/d7/f14 to d5/d7/d1d/f3e 0 2024-09-10T10:04:06.640 INFO:tasks.workunit.client.1.smithi107.stdout:1/167: fdatasync d2/d6/fa 0 2024-09-10T10:04:06.644 INFO:tasks.workunit.client.1.smithi107.stdout:1/168: dread d2/d6/f16 [0,4194304] 0 2024-09-10T10:04:06.648 INFO:tasks.workunit.client.1.smithi107.stdout:2/173: truncate d3/da/d1e/f24 995942 0 2024-09-10T10:04:06.651 INFO:tasks.workunit.client.1.smithi107.stdout:9/144: dwrite d5/d7/f11 [0,4194304] 0 2024-09-10T10:04:06.652 INFO:tasks.workunit.client.1.smithi107.stdout:2/174: fsync d3/da/df/f15 0 2024-09-10T10:04:06.653 INFO:tasks.workunit.client.1.smithi107.stdout:1/169: dwrite d2/f21 [0,4194304] 0 2024-09-10T10:04:06.654 INFO:tasks.workunit.client.1.smithi107.stdout:9/145: write d5/d7/f13 [4914774,80034] 0 2024-09-10T10:04:06.655 INFO:tasks.workunit.client.1.smithi107.stdout:2/175: creat d3/d21/f3a x:0 0 0 2024-09-10T10:04:06.656 INFO:tasks.workunit.client.1.smithi107.stdout:9/146: stat d5/d7/l16 0 2024-09-10T10:04:06.656 INFO:tasks.workunit.client.1.smithi107.stdout:1/170: read d2/d6/f16 [490053,111720] 0 2024-09-10T10:04:06.658 INFO:tasks.workunit.client.1.smithi107.stdout:2/176: write d3/d8/f16 [3262525,30058] 0 2024-09-10T10:04:06.661 INFO:tasks.workunit.client.1.smithi107.stdout:1/171: mknod d2/d2a/c2b 0 2024-09-10T10:04:06.663 INFO:tasks.workunit.client.1.smithi107.stdout:9/147: dread d5/d7/d1d/f3e [0,4194304] 0 2024-09-10T10:04:06.668 INFO:tasks.workunit.client.1.smithi107.stdout:9/148: dwrite d5/f35 [0,4194304] 0 2024-09-10T10:04:06.677 INFO:tasks.workunit.client.1.smithi107.stdout:9/149: truncate d5/f35 734271 0 2024-09-10T10:04:06.679 INFO:tasks.workunit.client.1.smithi107.stdout:9/150: write d5/f6 [4367592,22757] 0 2024-09-10T10:04:06.681 INFO:tasks.workunit.client.1.smithi107.stdout:9/151: creat d5/d7/d1d/f3f x:0 0 0 2024-09-10T10:04:06.685 INFO:tasks.workunit.client.1.smithi107.stdout:2/177: dread d3/f1f [0,4194304] 0 2024-09-10T10:04:06.686 INFO:tasks.workunit.client.1.smithi107.stdout:2/178: chown d3/d21/f37 1625751 1 2024-09-10T10:04:06.687 INFO:tasks.workunit.client.1.smithi107.stdout:9/152: dwrite d5/d1e/f1f [0,4194304] 0 2024-09-10T10:04:06.687 INFO:tasks.workunit.client.1.smithi107.stdout:2/179: dread - d3/da/d1e/d27/f2e zero size 2024-09-10T10:04:06.689 INFO:tasks.workunit.client.1.smithi107.stdout:2/180: rmdir d3/da/d1e/d22 39 2024-09-10T10:04:06.692 INFO:tasks.workunit.client.1.smithi107.stdout:2/181: mknod d3/da/df/d20/d36/d39/c3b 0 2024-09-10T10:04:06.694 INFO:tasks.workunit.client.1.smithi107.stdout:9/153: dwrite d5/d7/d1d/d29/f3a [0,4194304] 0 2024-09-10T10:04:06.698 INFO:tasks.workunit.client.1.smithi107.stdout:9/154: unlink d5/d7/d1d/d29/f3a 0 2024-09-10T10:04:06.699 INFO:tasks.workunit.client.1.smithi107.stdout:9/155: fsync d5/d7/f1a 0 2024-09-10T10:04:06.700 INFO:tasks.workunit.client.0.smithi071.stdout:1/19: write d1/f3 [395829,5947] 0 2024-09-10T10:04:06.700 INFO:tasks.workunit.client.1.smithi107.stdout:2/182: dwrite d3/da/d1e/d27/f2e [0,4194304] 0 2024-09-10T10:04:06.701 INFO:tasks.workunit.client.1.smithi107.stdout:2/183: write d3/da/d1e/d27/f2e [4024610,22029] 0 2024-09-10T10:04:06.708 INFO:tasks.workunit.client.0.smithi071.stdout:3/15: dread f0 [0,4194304] 0 2024-09-10T10:04:06.709 INFO:tasks.workunit.client.0.smithi071.stdout:5/1: mknod c0 0 2024-09-10T10:04:06.709 INFO:tasks.workunit.client.0.smithi071.stdout:5/2: dwrite - no filename 2024-09-10T10:04:06.710 INFO:tasks.workunit.client.1.smithi107.stdout:0/50: sync 2024-09-10T10:04:06.710 INFO:tasks.workunit.client.0.smithi071.stdout:0/8: symlink l4 0 2024-09-10T10:04:06.711 INFO:tasks.workunit.client.0.smithi071.stdout:5/3: chown c0 56872 1 2024-09-10T10:04:06.711 INFO:tasks.workunit.client.0.smithi071.stdout:7/5: getdents . 0 2024-09-10T10:04:06.713 INFO:tasks.workunit.client.0.smithi071.stdout:4/5: creat f2 x:0 0 0 2024-09-10T10:04:06.713 INFO:tasks.workunit.client.0.smithi071.stdout:9/0: dread - no filename 2024-09-10T10:04:06.713 INFO:tasks.workunit.client.0.smithi071.stdout:9/1: rename - no filename 2024-09-10T10:04:06.713 INFO:tasks.workunit.client.0.smithi071.stdout:9/2: dread - no filename 2024-09-10T10:04:06.713 INFO:tasks.workunit.client.0.smithi071.stdout:9/3: readlink - no filename 2024-09-10T10:04:06.713 INFO:tasks.workunit.client.0.smithi071.stdout:9/4: truncate - no filename 2024-09-10T10:04:06.714 INFO:tasks.workunit.client.1.smithi107.stdout:9/156: link d5/d7/lf d5/l40 0 2024-09-10T10:04:06.714 INFO:tasks.workunit.client.0.smithi071.stdout:9/5: chown . 96 1 2024-09-10T10:04:06.714 INFO:tasks.workunit.client.0.smithi071.stdout:9/6: rmdir - no directory 2024-09-10T10:04:06.714 INFO:tasks.workunit.client.0.smithi071.stdout:4/6: dread - f1 zero size 2024-09-10T10:04:06.715 INFO:tasks.workunit.client.0.smithi071.stdout:4/7: read - f1 zero size 2024-09-10T10:04:06.716 INFO:tasks.workunit.client.1.smithi107.stdout:9/157: fdatasync d5/d7/f13 0 2024-09-10T10:04:06.716 INFO:tasks.workunit.client.0.smithi071.stdout:4/8: dread - f1 zero size 2024-09-10T10:04:06.717 INFO:tasks.workunit.client.1.smithi107.stdout:9/158: write d5/f6 [6061173,89729] 0 2024-09-10T10:04:06.718 INFO:tasks.workunit.client.1.smithi107.stdout:2/184: dwrite d3/d21/f3a [0,4194304] 0 2024-09-10T10:04:06.718 INFO:tasks.workunit.client.1.smithi107.stdout:0/51: getdents d6 0 2024-09-10T10:04:06.718 INFO:tasks.workunit.client.1.smithi107.stdout:9/159: dread - d5/f31 zero size 2024-09-10T10:04:06.724 INFO:tasks.workunit.client.1.smithi107.stdout:0/52: symlink d6/ld 0 2024-09-10T10:04:06.725 INFO:tasks.workunit.client.0.smithi071.stdout:0/9: dwrite f0 [0,4194304] 0 2024-09-10T10:04:06.728 INFO:tasks.workunit.client.0.smithi071.stdout:3/16: unlink l1 0 2024-09-10T10:04:06.728 INFO:tasks.workunit.client.0.smithi071.stdout:5/4: creat f1 x:0 0 0 2024-09-10T10:04:06.729 INFO:tasks.workunit.client.0.smithi071.stdout:8/0: link - no file 2024-09-10T10:04:06.729 INFO:tasks.workunit.client.0.smithi071.stdout:5/5: truncate f1 688729 0 2024-09-10T10:04:06.730 INFO:tasks.workunit.client.1.smithi107.stdout:9/160: dwrite d5/d7/f11 [0,4194304] 0 2024-09-10T10:04:06.734 INFO:tasks.workunit.client.1.smithi107.stdout:2/185: dwrite d3/f31 [0,4194304] 0 2024-09-10T10:04:06.739 INFO:tasks.workunit.client.1.smithi107.stdout:9/161: write d5/d7/d1d/f3e [3869546,91562] 0 2024-09-10T10:04:06.740 INFO:tasks.workunit.client.1.smithi107.stdout:0/53: dwrite d6/d8/fb [0,4194304] 0 2024-09-10T10:04:06.741 INFO:tasks.workunit.client.1.smithi107.stdout:9/162: chown d5/d7/d1d/d25/d37 720115 1 2024-09-10T10:04:06.743 INFO:tasks.workunit.client.1.smithi107.stdout:0/54: rename d6/d8 to d6/d8/de 22 2024-09-10T10:04:06.744 INFO:tasks.workunit.client.1.smithi107.stdout:9/163: write d5/d7/d1d/f3e [5222466,107208] 0 2024-09-10T10:04:06.745 INFO:tasks.workunit.client.1.smithi107.stdout:0/55: truncate d6/d8/f9 5241527 0 2024-09-10T10:04:06.746 INFO:tasks.workunit.client.1.smithi107.stdout:0/56: write d6/f7 [1481982,3964] 0 2024-09-10T10:04:06.746 INFO:tasks.workunit.client.1.smithi107.stdout:9/164: mkdir d5/d7/d1d/d41 0 2024-09-10T10:04:06.748 INFO:tasks.workunit.client.1.smithi107.stdout:9/165: write d5/d7/f11 [3982847,9415] 0 2024-09-10T10:04:06.749 INFO:tasks.workunit.client.1.smithi107.stdout:9/166: stat d5/d7/d1d/d25/d37/c3d 0 2024-09-10T10:04:06.750 INFO:tasks.workunit.client.1.smithi107.stdout:9/167: read d5/d7/fb [442499,39049] 0 2024-09-10T10:04:06.753 INFO:tasks.workunit.client.1.smithi107.stdout:9/168: creat d5/d7/d1d/d25/d27/f42 x:0 0 0 2024-09-10T10:04:06.754 INFO:tasks.workunit.client.1.smithi107.stdout:9/169: read d5/d1e/f1f [1878390,92148] 0 2024-09-10T10:04:06.756 INFO:tasks.workunit.client.1.smithi107.stdout:9/170: write d5/d7/f9 [2978202,64074] 0 2024-09-10T10:04:06.759 INFO:tasks.workunit.client.1.smithi107.stdout:9/171: getdents d5/d7 0 2024-09-10T10:04:06.765 INFO:tasks.workunit.client.1.smithi107.stdout:0/57: fsync d6/d8/f9 0 2024-09-10T10:04:06.767 INFO:tasks.workunit.client.1.smithi107.stdout:0/58: mkdir d6/df 0 2024-09-10T10:04:06.767 INFO:tasks.workunit.client.1.smithi107.stdout:9/172: dwrite d5/d7/f13 [0,4194304] 0 2024-09-10T10:04:06.769 INFO:tasks.workunit.client.1.smithi107.stdout:0/59: write d6/d8/fb [4870312,117436] 0 2024-09-10T10:04:06.771 INFO:tasks.workunit.client.1.smithi107.stdout:2/186: dwrite d3/f11 [0,4194304] 0 2024-09-10T10:04:06.774 INFO:tasks.workunit.client.1.smithi107.stdout:9/173: link c2 d5/d7/d1d/d25/c43 0 2024-09-10T10:04:06.776 INFO:tasks.workunit.client.1.smithi107.stdout:9/174: chown d5/f31 6744775 1 2024-09-10T10:04:06.778 INFO:tasks.workunit.client.1.smithi107.stdout:2/187: rename d3/d21/f37 to d3/f3c 0 2024-09-10T10:04:06.781 INFO:tasks.workunit.client.1.smithi107.stdout:2/188: creat d3/f3d x:0 0 0 2024-09-10T10:04:06.783 INFO:tasks.workunit.client.1.smithi107.stdout:2/189: mknod d3/c3e 0 2024-09-10T10:04:06.784 INFO:tasks.workunit.client.1.smithi107.stdout:2/190: chown d3/d8/c23 11 1 2024-09-10T10:04:06.784 INFO:tasks.workunit.client.1.smithi107.stdout:2/191: chown d3/d8 883 1 2024-09-10T10:04:06.787 INFO:tasks.workunit.client.0.smithi071.stdout:7/6: symlink l0 0 2024-09-10T10:04:06.788 INFO:tasks.workunit.client.0.smithi071.stdout:3/17: creat f2 x:0 0 0 2024-09-10T10:04:06.788 INFO:tasks.workunit.client.1.smithi107.stdout:2/192: rename d3/d8/f35 to d3/da/d1e/f3f 0 2024-09-10T10:04:06.789 INFO:tasks.workunit.client.0.smithi071.stdout:9/7: mkdir d0 0 2024-09-10T10:04:06.789 INFO:tasks.workunit.client.0.smithi071.stdout:9/8: write - no filename 2024-09-10T10:04:06.789 INFO:tasks.workunit.client.0.smithi071.stdout:9/9: write - no filename 2024-09-10T10:04:06.789 INFO:tasks.workunit.client.0.smithi071.stdout:9/10: truncate - no filename 2024-09-10T10:04:06.790 INFO:tasks.workunit.client.1.smithi107.stdout:9/175: rmdir d5/d7/d1d 39 2024-09-10T10:04:06.790 INFO:tasks.workunit.client.0.smithi071.stdout:9/11: rename d0 to d0/d1 22 2024-09-10T10:04:06.790 INFO:tasks.workunit.client.0.smithi071.stdout:4/9: fsync f2 0 2024-09-10T10:04:06.790 INFO:tasks.workunit.client.1.smithi107.stdout:0/60: truncate f2 808177 0 2024-09-10T10:04:06.791 INFO:tasks.workunit.client.0.smithi071.stdout:5/6: creat f2 x:0 0 0 2024-09-10T10:04:06.792 INFO:tasks.workunit.client.0.smithi071.stdout:0/10: rename f1 to f5 0 2024-09-10T10:04:06.793 INFO:tasks.workunit.client.1.smithi107.stdout:2/193: mkdir d3/da/d1e/d40 0 2024-09-10T10:04:06.793 INFO:tasks.workunit.client.0.smithi071.stdout:7/7: rename l0 to l1 0 2024-09-10T10:04:06.793 INFO:tasks.workunit.client.0.smithi071.stdout:7/8: dwrite - no filename 2024-09-10T10:04:06.794 INFO:tasks.workunit.client.0.smithi071.stdout:8/1: creat f0 x:0 0 0 2024-09-10T10:04:06.795 INFO:tasks.workunit.client.1.smithi107.stdout:9/176: mknod d5/d7/d1d/d3b/c44 0 2024-09-10T10:04:06.796 INFO:tasks.workunit.client.0.smithi071.stdout:4/10: creat f3 x:0 0 0 2024-09-10T10:04:06.796 INFO:tasks.workunit.client.1.smithi107.stdout:2/194: mkdir d3/d21/d41 0 2024-09-10T10:04:06.797 INFO:tasks.workunit.client.0.smithi071.stdout:5/7: symlink l3 0 2024-09-10T10:04:06.797 INFO:tasks.workunit.client.0.smithi071.stdout:5/8: readlink l3 0 2024-09-10T10:04:06.797 INFO:tasks.workunit.client.0.smithi071.stdout:0/11: symlink l6 0 2024-09-10T10:04:06.798 INFO:tasks.workunit.client.0.smithi071.stdout:3/18: dwrite f2 [0,4194304] 0 2024-09-10T10:04:06.799 INFO:tasks.workunit.client.1.smithi107.stdout:0/61: dwrite d6/f7 [0,4194304] 0 2024-09-10T10:04:06.799 INFO:tasks.workunit.client.0.smithi071.stdout:7/9: creat f2 x:0 0 0 2024-09-10T10:04:06.799 INFO:tasks.workunit.client.0.smithi071.stdout:9/12: mknod d0/c2 0 2024-09-10T10:04:06.800 INFO:tasks.workunit.client.0.smithi071.stdout:8/2: creat f1 x:0 0 0 2024-09-10T10:04:06.802 INFO:tasks.workunit.client.1.smithi107.stdout:2/195: unlink d3/f1c 0 2024-09-10T10:04:06.803 INFO:tasks.workunit.client.0.smithi071.stdout:4/11: rename f2 to f4 0 2024-09-10T10:04:06.804 INFO:tasks.workunit.client.0.smithi071.stdout:5/9: creat f4 x:0 0 0 2024-09-10T10:04:06.805 INFO:tasks.workunit.client.0.smithi071.stdout:0/12: creat f7 x:0 0 0 2024-09-10T10:04:06.806 INFO:tasks.workunit.client.0.smithi071.stdout:0/13: rmdir - no directory 2024-09-10T10:04:06.807 INFO:tasks.workunit.client.0.smithi071.stdout:5/10: write f1 [1524663,26928] 0 2024-09-10T10:04:06.808 INFO:tasks.workunit.client.0.smithi071.stdout:3/19: unlink f0 0 2024-09-10T10:04:06.809 INFO:tasks.workunit.client.1.smithi107.stdout:2/196: dread d3/f1f [0,4194304] 0 2024-09-10T10:04:06.810 INFO:tasks.workunit.client.0.smithi071.stdout:5/11: dread - f4 zero size 2024-09-10T10:04:06.810 INFO:tasks.workunit.client.0.smithi071.stdout:7/10: creat f3 x:0 0 0 2024-09-10T10:04:06.810 INFO:tasks.workunit.client.1.smithi107.stdout:0/62: link d6/d8/fb d6/f10 0 2024-09-10T10:04:06.810 INFO:tasks.workunit.client.1.smithi107.stdout:9/177: link d5/d7/cc d5/d7/d1d/c45 0 2024-09-10T10:04:06.810 INFO:tasks.workunit.client.1.smithi107.stdout:0/63: chown l5 253630776 1 2024-09-10T10:04:06.812 INFO:tasks.workunit.client.0.smithi071.stdout:9/13: creat d0/f3 x:0 0 0 2024-09-10T10:04:06.813 INFO:tasks.workunit.client.0.smithi071.stdout:7/11: chown f3 77839 1 2024-09-10T10:04:06.813 INFO:tasks.workunit.client.0.smithi071.stdout:8/3: rename f1 to f2 0 2024-09-10T10:04:06.814 INFO:tasks.workunit.client.1.smithi107.stdout:9/178: symlink d5/d7/d1d/d25/d27/l46 0 2024-09-10T10:04:06.814 INFO:tasks.workunit.client.0.smithi071.stdout:9/14: write d0/f3 [865487,68942] 0 2024-09-10T10:04:06.815 INFO:tasks.workunit.client.0.smithi071.stdout:7/12: truncate f2 55949 0 2024-09-10T10:04:06.815 INFO:tasks.workunit.client.1.smithi107.stdout:9/179: fsync d5/d7/f11 0 2024-09-10T10:04:06.816 INFO:tasks.workunit.client.0.smithi071.stdout:0/14: creat f8 x:0 0 0 2024-09-10T10:04:06.816 INFO:tasks.workunit.client.0.smithi071.stdout:4/12: dwrite f1 [0,4194304] 0 2024-09-10T10:04:06.816 INFO:tasks.workunit.client.1.smithi107.stdout:0/64: dread d6/d8/fb [0,4194304] 0 2024-09-10T10:04:06.816 INFO:tasks.workunit.client.1.smithi107.stdout:2/197: dread d3/f11 [0,4194304] 0 2024-09-10T10:04:06.817 INFO:tasks.workunit.client.0.smithi071.stdout:3/20: mkdir d3 0 2024-09-10T10:04:06.817 INFO:tasks.workunit.client.0.smithi071.stdout:4/13: chown f3 0 1 2024-09-10T10:04:06.818 INFO:tasks.workunit.client.0.smithi071.stdout:4/14: dread - f4 zero size 2024-09-10T10:04:06.819 INFO:tasks.workunit.client.1.smithi107.stdout:9/180: creat d5/d7/d1d/f47 x:0 0 0 2024-09-10T10:04:06.820 INFO:tasks.workunit.client.0.smithi071.stdout:8/4: creat f3 x:0 0 0 2024-09-10T10:04:06.820 INFO:tasks.workunit.client.1.smithi107.stdout:2/198: mknod d3/d21/c42 0 2024-09-10T10:04:06.820 INFO:tasks.workunit.client.0.smithi071.stdout:0/15: stat f2 0 2024-09-10T10:04:06.821 INFO:tasks.workunit.client.0.smithi071.stdout:3/21: fdatasync f2 0 2024-09-10T10:04:06.822 INFO:tasks.workunit.client.0.smithi071.stdout:9/15: unlink d0/f3 0 2024-09-10T10:04:06.823 INFO:tasks.workunit.client.0.smithi071.stdout:9/16: rename d0 to d0/d4 22 2024-09-10T10:04:06.825 INFO:tasks.workunit.client.1.smithi107.stdout:2/199: symlink d3/da/d1e/l43 0 2024-09-10T10:04:06.825 INFO:tasks.workunit.client.0.smithi071.stdout:4/15: creat f5 x:0 0 0 2024-09-10T10:04:06.825 INFO:tasks.workunit.client.1.smithi107.stdout:9/181: dread d5/d7/d1d/d25/f2f [0,4194304] 0 2024-09-10T10:04:06.826 INFO:tasks.workunit.client.0.smithi071.stdout:8/5: mknod c4 0 2024-09-10T10:04:06.827 INFO:tasks.workunit.client.0.smithi071.stdout:4/16: write f3 [21633,849] 0 2024-09-10T10:04:06.827 INFO:tasks.workunit.client.0.smithi071.stdout:8/6: dread - f0 zero size 2024-09-10T10:04:06.827 INFO:tasks.workunit.client.0.smithi071.stdout:7/13: dwrite f2 [0,4194304] 0 2024-09-10T10:04:06.828 INFO:tasks.workunit.client.0.smithi071.stdout:8/7: chown f2 27710397 1 2024-09-10T10:04:06.829 INFO:tasks.workunit.client.0.smithi071.stdout:7/14: write f2 [2618540,47098] 0 2024-09-10T10:04:06.829 INFO:tasks.workunit.client.0.smithi071.stdout:0/16: creat f9 x:0 0 0 2024-09-10T10:04:06.830 INFO:tasks.workunit.client.0.smithi071.stdout:7/15: write f3 [732717,128821] 0 2024-09-10T10:04:06.835 INFO:tasks.workunit.client.0.smithi071.stdout:9/17: rename d0/c2 to d0/c5 0 2024-09-10T10:04:06.835 INFO:tasks.workunit.client.0.smithi071.stdout:7/16: dread f2 [0,4194304] 0 2024-09-10T10:04:06.836 INFO:tasks.workunit.client.1.smithi107.stdout:9/182: dwrite d5/d7/d1d/d25/d27/f42 [0,4194304] 0 2024-09-10T10:04:06.836 INFO:tasks.workunit.client.0.smithi071.stdout:4/17: dread f3 [0,4194304] 0 2024-09-10T10:04:06.838 INFO:tasks.workunit.client.0.smithi071.stdout:8/8: mkdir d5 0 2024-09-10T10:04:06.838 INFO:tasks.workunit.client.1.smithi107.stdout:7/123: sync 2024-09-10T10:04:06.841 INFO:tasks.workunit.client.0.smithi071.stdout:3/22: mknod d3/c4 0 2024-09-10T10:04:06.841 INFO:tasks.workunit.client.1.smithi107.stdout:9/183: creat d5/d7/d1d/d41/f48 x:0 0 0 2024-09-10T10:04:06.842 INFO:tasks.workunit.client.0.smithi071.stdout:3/23: write f2 [1979079,14273] 0 2024-09-10T10:04:06.842 INFO:tasks.workunit.client.0.smithi071.stdout:9/18: creat d0/f6 x:0 0 0 2024-09-10T10:04:06.842 INFO:tasks.workunit.client.1.smithi107.stdout:0/65: dread d6/fa [0,4194304] 0 2024-09-10T10:04:06.843 INFO:tasks.workunit.client.0.smithi071.stdout:9/19: dread - d0/f6 zero size 2024-09-10T10:04:06.843 INFO:tasks.workunit.client.1.smithi107.stdout:0/66: chown d6/df 173 1 2024-09-10T10:04:06.844 INFO:tasks.workunit.client.0.smithi071.stdout:7/17: creat f4 x:0 0 0 2024-09-10T10:04:06.844 INFO:tasks.workunit.client.1.smithi107.stdout:0/67: read d6/f7 [2076090,17375] 0 2024-09-10T10:04:06.849 INFO:tasks.workunit.client.1.smithi107.stdout:2/200: truncate d3/da/df/d20/f33 2240610 0 2024-09-10T10:04:06.850 INFO:tasks.workunit.client.0.smithi071.stdout:3/24: dread f2 [0,4194304] 0 2024-09-10T10:04:06.851 INFO:tasks.workunit.client.0.smithi071.stdout:8/9: symlink d5/l6 0 2024-09-10T10:04:06.851 INFO:tasks.workunit.client.0.smithi071.stdout:9/20: unlink d0/c5 0 2024-09-10T10:04:06.852 INFO:tasks.workunit.client.1.smithi107.stdout:9/184: rename d5/d7/f11 to d5/d7/d1d/d25/d27/f49 0 2024-09-10T10:04:06.852 INFO:tasks.workunit.client.0.smithi071.stdout:3/25: rmdir d3 39 2024-09-10T10:04:06.853 INFO:tasks.workunit.client.1.smithi107.stdout:9/185: write d5/d7/f9 [4387140,88540] 0 2024-09-10T10:04:06.854 INFO:tasks.workunit.client.0.smithi071.stdout:4/18: getdents . 0 2024-09-10T10:04:06.854 INFO:tasks.workunit.client.0.smithi071.stdout:8/10: creat d5/f7 x:0 0 0 2024-09-10T10:04:06.855 INFO:tasks.workunit.client.1.smithi107.stdout:2/201: dread - d3/da/d1e/d22/f34 zero size 2024-09-10T10:04:06.856 INFO:tasks.workunit.client.0.smithi071.stdout:8/11: chown f0 1 1 2024-09-10T10:04:06.857 INFO:tasks.workunit.client.1.smithi107.stdout:2/202: write d3/da/f17 [7134953,129450] 0 2024-09-10T10:04:06.857 INFO:tasks.workunit.client.0.smithi071.stdout:4/19: unlink f5 0 2024-09-10T10:04:06.857 INFO:tasks.workunit.client.1.smithi107.stdout:9/186: rename d5/d7/d1d/d25/f2f to d5/d7/d1d/d3b/f4a 0 2024-09-10T10:04:06.858 INFO:tasks.workunit.client.1.smithi107.stdout:9/187: read f3 [853083,104658] 0 2024-09-10T10:04:06.858 INFO:tasks.workunit.client.0.smithi071.stdout:7/18: dwrite f2 [0,4194304] 0 2024-09-10T10:04:06.858 INFO:tasks.workunit.client.0.smithi071.stdout:9/21: link d0/f6 d0/f7 0 2024-09-10T10:04:06.859 INFO:tasks.workunit.client.0.smithi071.stdout:7/19: fdatasync f3 0 2024-09-10T10:04:06.859 INFO:tasks.workunit.client.0.smithi071.stdout:4/20: dread f3 [0,4194304] 0 2024-09-10T10:04:06.860 INFO:tasks.workunit.client.1.smithi107.stdout:2/203: unlink d3/d8/c23 0 2024-09-10T10:04:06.860 INFO:tasks.workunit.client.0.smithi071.stdout:3/26: creat d3/f5 x:0 0 0 2024-09-10T10:04:06.861 INFO:tasks.workunit.client.1.smithi107.stdout:2/204: truncate f0 9047550 0 2024-09-10T10:04:06.861 INFO:tasks.workunit.client.0.smithi071.stdout:9/22: chown d0/f6 126522 1 2024-09-10T10:04:06.865 INFO:tasks.workunit.client.0.smithi071.stdout:7/20: chown l1 166662152 1 2024-09-10T10:04:06.866 INFO:tasks.workunit.client.0.smithi071.stdout:4/21: write f4 [55544,119812] 0 2024-09-10T10:04:06.867 INFO:tasks.workunit.client.0.smithi071.stdout:3/27: fsync f2 0 2024-09-10T10:04:06.868 INFO:tasks.workunit.client.1.smithi107.stdout:9/188: dwrite d5/d7/d1d/d41/f48 [0,4194304] 0 2024-09-10T10:04:06.868 INFO:tasks.workunit.client.1.smithi107.stdout:7/124: dread d0/fb [0,4194304] 0 2024-09-10T10:04:06.868 INFO:tasks.workunit.client.0.smithi071.stdout:7/21: write f2 [1189631,35098] 0 2024-09-10T10:04:06.868 INFO:tasks.workunit.client.0.smithi071.stdout:8/12: dwrite f2 [0,4194304] 0 2024-09-10T10:04:06.869 INFO:tasks.workunit.client.0.smithi071.stdout:3/28: stat d3/c4 0 2024-09-10T10:04:06.869 INFO:tasks.workunit.client.0.smithi071.stdout:7/22: chown l1 1040138514 1 2024-09-10T10:04:06.870 INFO:tasks.workunit.client.0.smithi071.stdout:7/23: write f3 [592200,123199] 0 2024-09-10T10:04:06.871 INFO:tasks.workunit.client.0.smithi071.stdout:9/23: rename d0/f7 to d0/f8 0 2024-09-10T10:04:06.872 INFO:tasks.workunit.client.0.smithi071.stdout:7/24: write f2 [4137835,83417] 0 2024-09-10T10:04:06.872 INFO:tasks.workunit.client.1.smithi107.stdout:9/189: symlink d5/d7/d1d/d29/l4b 0 2024-09-10T10:04:06.874 INFO:tasks.workunit.client.1.smithi107.stdout:9/190: truncate d5/d7/d1d/f3e 5940696 0 2024-09-10T10:04:06.875 INFO:tasks.workunit.client.1.smithi107.stdout:9/191: readlink d5/d7/d19/l34 0 2024-09-10T10:04:06.876 INFO:tasks.workunit.client.0.smithi071.stdout:8/13: rename f0 to d5/f8 0 2024-09-10T10:04:06.877 INFO:tasks.workunit.client.0.smithi071.stdout:7/25: mknod c5 0 2024-09-10T10:04:06.878 INFO:tasks.workunit.client.1.smithi107.stdout:9/192: mknod d5/d7/d19/c4c 0 2024-09-10T10:04:06.882 INFO:tasks.workunit.client.0.smithi071.stdout:3/29: dwrite d3/f5 [0,4194304] 0 2024-09-10T10:04:06.882 INFO:tasks.workunit.client.0.smithi071.stdout:9/24: link d0/f6 d0/f9 0 2024-09-10T10:04:06.887 INFO:tasks.workunit.client.1.smithi107.stdout:7/125: write d0/d8/d9/ff [619950,22344] 0 2024-09-10T10:04:06.887 INFO:tasks.workunit.client.0.smithi071.stdout:9/25: creat d0/fa x:0 0 0 2024-09-10T10:04:06.889 INFO:tasks.workunit.client.0.smithi071.stdout:4/22: truncate f3 665415 0 2024-09-10T10:04:06.890 INFO:tasks.workunit.client.0.smithi071.stdout:4/23: fdatasync f4 0 2024-09-10T10:04:06.891 INFO:tasks.workunit.client.0.smithi071.stdout:8/14: dwrite f3 [0,4194304] 0 2024-09-10T10:04:06.891 INFO:tasks.workunit.client.0.smithi071.stdout:7/26: dread f2 [0,4194304] 0 2024-09-10T10:04:06.891 INFO:tasks.workunit.client.0.smithi071.stdout:7/27: rmdir - no directory 2024-09-10T10:04:06.891 INFO:tasks.workunit.client.0.smithi071.stdout:9/26: truncate d0/f9 399229 0 2024-09-10T10:04:06.892 INFO:tasks.workunit.client.1.smithi107.stdout:9/193: dwrite d5/d7/fb [0,4194304] 0 2024-09-10T10:04:06.892 INFO:tasks.workunit.client.0.smithi071.stdout:9/27: dread - d0/fa zero size 2024-09-10T10:04:06.892 INFO:tasks.workunit.client.0.smithi071.stdout:9/28: readlink - no filename 2024-09-10T10:04:06.893 INFO:tasks.workunit.client.1.smithi107.stdout:7/126: dread - d0/d8/d9/f1c zero size 2024-09-10T10:04:06.894 INFO:tasks.workunit.client.0.smithi071.stdout:4/24: rename c0 to c6 0 2024-09-10T10:04:06.895 INFO:tasks.workunit.client.0.smithi071.stdout:4/25: chown f1 95033346 1 2024-09-10T10:04:06.895 INFO:tasks.workunit.client.0.smithi071.stdout:4/26: readlink - no filename 2024-09-10T10:04:06.895 INFO:tasks.workunit.client.1.smithi107.stdout:2/205: dwrite d3/da/df/f15 [0,4194304] 0 2024-09-10T10:04:06.896 INFO:tasks.workunit.client.1.smithi107.stdout:7/127: write d0/d8/f11 [1361494,38068] 0 2024-09-10T10:04:06.897 INFO:tasks.workunit.client.0.smithi071.stdout:8/15: symlink d5/l9 0 2024-09-10T10:04:06.898 INFO:tasks.workunit.client.1.smithi107.stdout:9/194: rmdir d5/d7/d1d/d3b 39 2024-09-10T10:04:06.899 INFO:tasks.workunit.client.1.smithi107.stdout:9/195: stat d5/d7/d1d 0 2024-09-10T10:04:06.901 INFO:tasks.workunit.client.0.smithi071.stdout:8/16: truncate d5/f7 1001880 0 2024-09-10T10:04:06.901 INFO:tasks.workunit.client.1.smithi107.stdout:2/206: rename d3/d8/f16 to d3/d21/d41/f44 0 2024-09-10T10:04:06.902 INFO:tasks.workunit.client.1.smithi107.stdout:2/207: read - d3/d8/f25 zero size 2024-09-10T10:04:06.903 INFO:tasks.workunit.client.0.smithi071.stdout:8/17: write f2 [1706701,72530] 0 2024-09-10T10:04:06.904 INFO:tasks.workunit.client.1.smithi107.stdout:7/128: getdents d0/d1b 0 2024-09-10T10:04:06.908 INFO:tasks.workunit.client.0.smithi071.stdout:4/27: dwrite f1 [4194304,4194304] 0 2024-09-10T10:04:06.909 INFO:tasks.workunit.client.1.smithi107.stdout:7/129: creat d0/d8/dc/f26 x:0 0 0 2024-09-10T10:04:06.911 INFO:tasks.workunit.client.1.smithi107.stdout:9/196: dwrite d5/d7/d19/f28 [0,4194304] 0 2024-09-10T10:04:06.911 INFO:tasks.workunit.client.1.smithi107.stdout:7/130: stat d0/d1b 0 2024-09-10T10:04:06.911 INFO:tasks.workunit.client.1.smithi107.stdout:7/131: chown d0 19 1 2024-09-10T10:04:06.912 INFO:tasks.workunit.client.0.smithi071.stdout:4/28: symlink l7 0 2024-09-10T10:04:06.913 INFO:tasks.workunit.client.1.smithi107.stdout:2/208: dread d3/f18 [0,4194304] 0 2024-09-10T10:04:06.913 INFO:tasks.workunit.client.0.smithi071.stdout:3/30: write d3/f5 [4790253,47493] 0 2024-09-10T10:04:06.915 INFO:tasks.workunit.client.0.smithi071.stdout:9/29: getdents d0 0 2024-09-10T10:04:06.916 INFO:tasks.workunit.client.0.smithi071.stdout:3/31: creat d3/f6 x:0 0 0 2024-09-10T10:04:06.916 INFO:tasks.workunit.client.0.smithi071.stdout:9/30: truncate d0/fa 140907 0 2024-09-10T10:04:06.919 INFO:tasks.workunit.client.1.smithi107.stdout:9/197: creat d5/d7/d1d/f4d x:0 0 0 2024-09-10T10:04:06.919 INFO:tasks.workunit.client.0.smithi071.stdout:9/31: mkdir d0/db 0 2024-09-10T10:04:06.921 INFO:tasks.workunit.client.0.smithi071.stdout:4/29: link f3 f8 0 2024-09-10T10:04:06.921 INFO:tasks.workunit.client.1.smithi107.stdout:7/132: link d0/d8/dc/f1a d0/f27 0 2024-09-10T10:04:06.921 INFO:tasks.workunit.client.0.smithi071.stdout:9/32: fdatasync d0/f9 0 2024-09-10T10:04:06.922 INFO:tasks.workunit.client.1.smithi107.stdout:9/198: mknod d5/d7/d19/c4e 0 2024-09-10T10:04:06.923 INFO:tasks.workunit.client.0.smithi071.stdout:4/30: creat f9 x:0 0 0 2024-09-10T10:04:06.924 INFO:tasks.workunit.client.1.smithi107.stdout:2/209: getdents d3/da/df/d20/d36 0 2024-09-10T10:04:06.924 INFO:tasks.workunit.client.1.smithi107.stdout:7/133: stat d0/f27 0 2024-09-10T10:04:06.927 INFO:tasks.workunit.client.0.smithi071.stdout:8/18: rmdir d5 39 2024-09-10T10:04:06.928 INFO:tasks.workunit.client.0.smithi071.stdout:8/19: chown f3 96552 1 2024-09-10T10:04:06.931 INFO:tasks.workunit.client.1.smithi107.stdout:2/210: dread d3/f3c [0,4194304] 0 2024-09-10T10:04:06.931 INFO:tasks.workunit.client.0.smithi071.stdout:4/31: dread f3 [0,4194304] 0 2024-09-10T10:04:06.932 INFO:tasks.workunit.client.1.smithi107.stdout:9/199: dwrite d5/d7/d1d/d25/d27/f49 [0,4194304] 0 2024-09-10T10:04:06.933 INFO:tasks.workunit.client.0.smithi071.stdout:8/20: link d5/f7 d5/fa 0 2024-09-10T10:04:06.933 INFO:tasks.workunit.client.0.smithi071.stdout:4/32: symlink la 0 2024-09-10T10:04:06.936 INFO:tasks.workunit.client.0.smithi071.stdout:8/21: rename f2 to d5/fb 0 2024-09-10T10:04:06.938 INFO:tasks.workunit.client.1.smithi107.stdout:9/200: symlink d5/l4f 0 2024-09-10T10:04:06.938 INFO:tasks.workunit.client.0.smithi071.stdout:4/33: mkdir db 0 2024-09-10T10:04:06.938 INFO:tasks.workunit.client.0.smithi071.stdout:8/22: rmdir d5 39 2024-09-10T10:04:06.939 INFO:tasks.workunit.client.1.smithi107.stdout:2/211: creat d3/da/df/f45 x:0 0 0 2024-09-10T10:04:06.940 INFO:tasks.workunit.client.1.smithi107.stdout:7/134: rmdir d0/d8/dc 39 2024-09-10T10:04:06.940 INFO:tasks.workunit.client.1.smithi107.stdout:9/201: unlink d5/d7/f1a 0 2024-09-10T10:04:06.942 INFO:tasks.workunit.client.1.smithi107.stdout:9/202: write d5/d7/f13 [3966310,80510] 0 2024-09-10T10:04:06.943 INFO:tasks.workunit.client.0.smithi071.stdout:8/23: rename d5/l6 to d5/lc 0 2024-09-10T10:04:06.943 INFO:tasks.workunit.client.0.smithi071.stdout:4/34: link la db/lc 0 2024-09-10T10:04:06.944 INFO:tasks.workunit.client.1.smithi107.stdout:2/212: dread d3/f18 [0,4194304] 0 2024-09-10T10:04:06.945 INFO:tasks.workunit.client.1.smithi107.stdout:9/203: unlink d5/d7/l16 0 2024-09-10T10:04:06.948 INFO:tasks.workunit.client.0.smithi071.stdout:4/35: chown db/lc 1092505 1 2024-09-10T10:04:06.949 INFO:tasks.workunit.client.1.smithi107.stdout:9/204: rename d5/d7/d19 to d5/d7/d1d/d25/d50 0 2024-09-10T10:04:06.952 INFO:tasks.workunit.client.0.smithi071.stdout:4/36: dread f8 [0,4194304] 0 2024-09-10T10:04:06.953 INFO:tasks.workunit.client.1.smithi107.stdout:7/135: dwrite d0/d8/dc/f1f [0,4194304] 0 2024-09-10T10:04:06.953 INFO:tasks.workunit.client.1.smithi107.stdout:9/205: creat d5/d7/d1d/d25/d27/f51 x:0 0 0 2024-09-10T10:04:06.953 INFO:tasks.workunit.client.0.smithi071.stdout:9/33: dwrite d0/f6 [0,4194304] 0 2024-09-10T10:04:06.954 INFO:tasks.workunit.client.1.smithi107.stdout:7/136: dread - d0/d8/dc/f26 zero size 2024-09-10T10:04:06.955 INFO:tasks.workunit.client.1.smithi107.stdout:2/213: truncate d3/f3c 2695076 0 2024-09-10T10:04:06.958 INFO:tasks.workunit.client.1.smithi107.stdout:9/206: fdatasync d5/d7/d1d/d3b/f4a 0 2024-09-10T10:04:06.960 INFO:tasks.workunit.client.1.smithi107.stdout:7/137: creat d0/d1b/f28 x:0 0 0 2024-09-10T10:04:06.961 INFO:tasks.workunit.client.1.smithi107.stdout:9/207: creat d5/d7/d1d/d25/d37/f52 x:0 0 0 2024-09-10T10:04:06.962 INFO:tasks.workunit.client.1.smithi107.stdout:9/208: chown d5/d7/d3c 27 1 2024-09-10T10:04:06.963 INFO:tasks.workunit.client.1.smithi107.stdout:2/214: getdents d3/da/df/d20/d36 0 2024-09-10T10:04:06.965 INFO:tasks.workunit.client.1.smithi107.stdout:7/138: rename d0/d8/dc/l25 to d0/d20/l29 0 2024-09-10T10:04:06.965 INFO:tasks.workunit.client.1.smithi107.stdout:9/209: rmdir d5/d7/d1d/d25 39 2024-09-10T10:04:06.966 INFO:tasks.workunit.client.0.smithi071.stdout:8/24: dwrite d5/fa [0,4194304] 0 2024-09-10T10:04:06.967 INFO:tasks.workunit.client.0.smithi071.stdout:4/37: dwrite f1 [4194304,4194304] 0 2024-09-10T10:04:06.968 INFO:tasks.workunit.client.0.smithi071.stdout:9/34: dwrite d0/f6 [0,4194304] 0 2024-09-10T10:04:06.969 INFO:tasks.workunit.client.0.smithi071.stdout:9/35: write d0/f6 [952341,70135] 0 2024-09-10T10:04:06.971 INFO:tasks.workunit.client.0.smithi071.stdout:9/36: write d0/f9 [1521981,99702] 0 2024-09-10T10:04:06.971 INFO:tasks.workunit.client.1.smithi107.stdout:9/210: write d5/d7/d1d/d25/d50/f32 [541396,60640] 0 2024-09-10T10:04:06.972 INFO:tasks.workunit.client.0.smithi071.stdout:8/25: dread d5/f7 [0,4194304] 0 2024-09-10T10:04:06.972 INFO:tasks.workunit.client.1.smithi107.stdout:2/215: dwrite d3/da/d1e/d27/f2e [4194304,4194304] 0 2024-09-10T10:04:06.973 INFO:tasks.workunit.client.0.smithi071.stdout:9/37: truncate d0/f8 5184948 0 2024-09-10T10:04:06.974 INFO:tasks.workunit.client.0.smithi071.stdout:4/38: mknod db/cd 0 2024-09-10T10:04:06.975 INFO:tasks.workunit.client.0.smithi071.stdout:4/39: write f9 [383335,48790] 0 2024-09-10T10:04:06.975 INFO:tasks.workunit.client.0.smithi071.stdout:8/26: creat d5/fd x:0 0 0 2024-09-10T10:04:06.978 INFO:tasks.workunit.client.1.smithi107.stdout:9/211: mkdir d5/d7/d3c/d53 0 2024-09-10T10:04:06.979 INFO:tasks.workunit.client.1.smithi107.stdout:9/212: chown d5/d7/f9 135657167 1 2024-09-10T10:04:06.980 INFO:tasks.workunit.client.0.smithi071.stdout:4/40: symlink db/le 0 2024-09-10T10:04:06.981 INFO:tasks.workunit.client.0.smithi071.stdout:8/27: creat d5/fe x:0 0 0 2024-09-10T10:04:06.982 INFO:tasks.workunit.client.0.smithi071.stdout:9/38: dwrite d0/f8 [4194304,4194304] 0 2024-09-10T10:04:06.982 INFO:tasks.workunit.client.0.smithi071.stdout:9/39: chown d0/fa 9398801 1 2024-09-10T10:04:06.983 INFO:tasks.workunit.client.0.smithi071.stdout:8/28: truncate d5/fd 259404 0 2024-09-10T10:04:06.983 INFO:tasks.workunit.client.0.smithi071.stdout:4/41: dread f4 [0,4194304] 0 2024-09-10T10:04:06.985 INFO:tasks.workunit.client.0.smithi071.stdout:8/29: write d5/fe [207104,49413] 0 2024-09-10T10:04:06.985 INFO:tasks.workunit.client.0.smithi071.stdout:9/40: mkdir d0/dc 0 2024-09-10T10:04:06.987 INFO:tasks.workunit.client.0.smithi071.stdout:4/42: unlink f8 0 2024-09-10T10:04:06.988 INFO:tasks.workunit.client.1.smithi107.stdout:9/213: dwrite d5/d7/d1d/f3f [0,4194304] 0 2024-09-10T10:04:06.988 INFO:tasks.workunit.client.0.smithi071.stdout:8/30: mkdir d5/df 0 2024-09-10T10:04:06.992 INFO:tasks.workunit.client.1.smithi107.stdout:9/214: creat d5/d7/d1d/d41/f54 x:0 0 0 2024-09-10T10:04:06.993 INFO:tasks.workunit.client.1.smithi107.stdout:9/215: dread - d5/d7/d1d/d25/d37/f52 zero size 2024-09-10T10:04:06.994 INFO:tasks.workunit.client.1.smithi107.stdout:9/216: read d5/d7/d1d/f3f [3597507,57499] 0 2024-09-10T10:04:06.995 INFO:tasks.workunit.client.1.smithi107.stdout:6/95: sync 2024-09-10T10:04:06.996 INFO:tasks.workunit.client.0.smithi071.stdout:9/41: dwrite d0/f6 [0,4194304] 0 2024-09-10T10:04:06.996 INFO:tasks.workunit.client.1.smithi107.stdout:5/124: sync 2024-09-10T10:04:06.997 INFO:tasks.workunit.client.1.smithi107.stdout:6/96: write d0/df/d14/f1f [269947,104826] 0 2024-09-10T10:04:06.997 INFO:tasks.workunit.client.1.smithi107.stdout:6/97: dread - d0/f1d zero size 2024-09-10T10:04:06.998 INFO:tasks.workunit.client.1.smithi107.stdout:6/98: chown d0/df 3139342 1 2024-09-10T10:04:06.998 INFO:tasks.workunit.client.1.smithi107.stdout:5/125: write de/f16 [1956479,126770] 0 2024-09-10T10:04:07.002 INFO:tasks.workunit.client.1.smithi107.stdout:9/217: creat d5/f55 x:0 0 0 2024-09-10T10:04:07.005 INFO:tasks.workunit.client.0.smithi071.stdout:8/31: dwrite d5/fe [0,4194304] 0 2024-09-10T10:04:07.008 INFO:tasks.workunit.client.1.smithi107.stdout:5/126: dwrite f6 [0,4194304] 0 2024-09-10T10:04:07.008 INFO:tasks.workunit.client.0.smithi071.stdout:8/32: creat d5/f10 x:0 0 0 2024-09-10T10:04:07.010 INFO:tasks.workunit.client.1.smithi107.stdout:6/99: link d0/fd d0/df/d14/d21/f22 0 2024-09-10T10:04:07.010 INFO:tasks.workunit.client.1.smithi107.stdout:9/218: unlink d5/d7/cc 0 2024-09-10T10:04:07.011 INFO:tasks.workunit.client.0.smithi071.stdout:8/33: creat d5/f11 x:0 0 0 2024-09-10T10:04:07.011 INFO:tasks.workunit.client.0.smithi071.stdout:8/34: chown d5 294895 1 2024-09-10T10:04:07.012 INFO:tasks.workunit.client.1.smithi107.stdout:9/219: fdatasync d5/d7/d1d/f47 0 2024-09-10T10:04:07.012 INFO:tasks.workunit.client.1.smithi107.stdout:5/127: mknod de/d20/c24 0 2024-09-10T10:04:07.015 INFO:tasks.workunit.client.0.smithi071.stdout:8/35: write d5/f7 [25094,98948] 0 2024-09-10T10:04:07.015 INFO:tasks.workunit.client.1.smithi107.stdout:5/128: creat de/f25 x:0 0 0 2024-09-10T10:04:07.019 INFO:tasks.workunit.client.1.smithi107.stdout:5/129: creat de/d20/f26 x:0 0 0 2024-09-10T10:04:07.023 INFO:tasks.workunit.client.1.smithi107.stdout:6/100: creat d0/df/d14/d21/f23 x:0 0 0 2024-09-10T10:04:07.024 INFO:tasks.workunit.client.1.smithi107.stdout:9/220: dwrite d5/d7/f13 [0,4194304] 0 2024-09-10T10:04:07.024 INFO:tasks.workunit.client.1.smithi107.stdout:6/101: truncate d0/f1d 73724 0 2024-09-10T10:04:07.024 INFO:tasks.workunit.client.1.smithi107.stdout:5/130: rename de/f11 to de/d20/f27 0 2024-09-10T10:04:07.027 INFO:tasks.workunit.client.1.smithi107.stdout:5/131: creat de/f28 x:0 0 0 2024-09-10T10:04:07.029 INFO:tasks.workunit.client.1.smithi107.stdout:9/221: unlink d5/d7/d1d/d25/d50/c4e 0 2024-09-10T10:04:07.032 INFO:tasks.workunit.client.1.smithi107.stdout:9/222: creat d5/d7/d1d/d25/d50/f56 x:0 0 0 2024-09-10T10:04:07.034 INFO:tasks.workunit.client.1.smithi107.stdout:9/223: mkdir d5/d7/d3c/d53/d57 0 2024-09-10T10:04:07.034 INFO:tasks.workunit.client.1.smithi107.stdout:6/102: dread d0/df/d14/d21/f22 [0,4194304] 0 2024-09-10T10:04:07.036 INFO:tasks.workunit.client.1.smithi107.stdout:9/224: mknod d5/d7/d1d/d25/d37/c58 0 2024-09-10T10:04:07.038 INFO:tasks.workunit.client.1.smithi107.stdout:9/225: symlink d5/l59 0 2024-09-10T10:04:07.039 INFO:tasks.workunit.client.1.smithi107.stdout:9/226: mknod d5/d7/d3c/d53/c5a 0 2024-09-10T10:04:07.043 INFO:tasks.workunit.client.1.smithi107.stdout:9/227: creat d5/d1e/f5b x:0 0 0 2024-09-10T10:04:07.046 INFO:tasks.workunit.client.1.smithi107.stdout:9/228: link d5/d1e/f1f d5/f5c 0 2024-09-10T10:04:07.048 INFO:tasks.workunit.client.1.smithi107.stdout:9/229: write d5/d7/d1d/d25/d37/f52 [376313,64916] 0 2024-09-10T10:04:07.059 INFO:tasks.workunit.client.1.smithi107.stdout:7/139: stat d0/d20/l29 0 2024-09-10T10:04:07.064 INFO:tasks.workunit.client.0.smithi071.stdout:9/42: truncate d0/f9 5343736 0 2024-09-10T10:04:07.065 INFO:tasks.workunit.client.0.smithi071.stdout:4/43: dwrite f3 [0,4194304] 0 2024-09-10T10:04:07.066 INFO:tasks.workunit.client.0.smithi071.stdout:8/36: truncate d5/fb 415383 0 2024-09-10T10:04:07.066 INFO:tasks.workunit.client.0.smithi071.stdout:4/44: write f3 [2441966,90763] 0 2024-09-10T10:04:07.069 INFO:tasks.workunit.client.0.smithi071.stdout:4/45: symlink db/lf 0 2024-09-10T10:04:07.071 INFO:tasks.workunit.client.0.smithi071.stdout:4/46: mknod db/c10 0 2024-09-10T10:04:07.072 INFO:tasks.workunit.client.0.smithi071.stdout:4/47: read f4 [60846,5082] 0 2024-09-10T10:04:07.072 INFO:tasks.workunit.client.0.smithi071.stdout:9/43: unlink d0/f8 0 2024-09-10T10:04:07.074 INFO:tasks.workunit.client.0.smithi071.stdout:4/48: write f3 [1402395,72356] 0 2024-09-10T10:04:07.074 INFO:tasks.workunit.client.1.smithi107.stdout:6/103: write d0/f6 [4339496,106555] 0 2024-09-10T10:04:07.075 INFO:tasks.workunit.client.1.smithi107.stdout:7/140: dread d0/d8/f11 [0,4194304] 0 2024-09-10T10:04:07.075 INFO:tasks.workunit.client.0.smithi071.stdout:8/37: dwrite d5/f8 [0,4194304] 0 2024-09-10T10:04:07.077 INFO:tasks.workunit.client.1.smithi107.stdout:7/141: read d0/d8/dc/f1f [79694,19543] 0 2024-09-10T10:04:07.078 INFO:tasks.workunit.client.1.smithi107.stdout:6/104: fdatasync d0/fd 0 2024-09-10T10:04:07.078 INFO:tasks.workunit.client.0.smithi071.stdout:4/49: mknod db/c11 0 2024-09-10T10:04:07.080 INFO:tasks.workunit.client.0.smithi071.stdout:8/38: dread d5/f8 [0,4194304] 0 2024-09-10T10:04:07.082 INFO:tasks.workunit.client.1.smithi107.stdout:7/142: creat d0/d8/dc/f2a x:0 0 0 2024-09-10T10:04:07.083 INFO:tasks.workunit.client.0.smithi071.stdout:4/50: dread f3 [0,4194304] 0 2024-09-10T10:04:07.083 INFO:tasks.workunit.client.1.smithi107.stdout:7/143: chown d0/d1b/f28 39585 1 2024-09-10T10:04:07.085 INFO:tasks.workunit.client.0.smithi071.stdout:8/39: link d5/f8 d5/f12 0 2024-09-10T10:04:07.085 INFO:tasks.workunit.client.0.smithi071.stdout:8/40: rename d5 to d5/d13 22 2024-09-10T10:04:07.086 INFO:tasks.workunit.client.0.smithi071.stdout:4/51: creat db/f12 x:0 0 0 2024-09-10T10:04:07.091 INFO:tasks.workunit.client.0.smithi071.stdout:9/44: fdatasync d0/f9 0 2024-09-10T10:04:07.094 INFO:tasks.workunit.client.1.smithi107.stdout:7/144: getdents d0/d8/dc 0 2024-09-10T10:04:07.095 INFO:tasks.workunit.client.1.smithi107.stdout:6/105: truncate d0/fa 2156400 0 2024-09-10T10:04:07.096 INFO:tasks.workunit.client.1.smithi107.stdout:7/145: fdatasync d0/f1e 0 2024-09-10T10:04:07.096 INFO:tasks.workunit.client.0.smithi071.stdout:8/41: truncate d5/fe 1557528 0 2024-09-10T10:04:07.097 INFO:tasks.workunit.client.1.smithi107.stdout:7/146: chown d0/d8/d9/f1c 113125250 1 2024-09-10T10:04:07.097 INFO:tasks.workunit.client.1.smithi107.stdout:6/106: dread d0/df/d14/d21/f22 [0,4194304] 0 2024-09-10T10:04:07.097 INFO:tasks.workunit.client.1.smithi107.stdout:7/147: chown d0/d20 220437607 1 2024-09-10T10:04:07.098 INFO:tasks.workunit.client.1.smithi107.stdout:6/107: chown d0/df/l12 12142 1 2024-09-10T10:04:07.099 INFO:tasks.workunit.client.1.smithi107.stdout:7/148: write d0/d8/f13 [1815788,110983] 0 2024-09-10T10:04:07.100 INFO:tasks.workunit.client.1.smithi107.stdout:6/108: mkdir d0/df/d14/d17/d24 0 2024-09-10T10:04:07.100 INFO:tasks.workunit.client.1.smithi107.stdout:6/109: chown d0/df/d14/d17/l1e 207 1 2024-09-10T10:04:07.101 INFO:tasks.workunit.client.1.smithi107.stdout:7/149: creat d0/f2b x:0 0 0 2024-09-10T10:04:07.101 INFO:tasks.workunit.client.0.smithi071.stdout:9/45: dwrite d0/f6 [4194304,4194304] 0 2024-09-10T10:04:07.102 INFO:tasks.workunit.client.1.smithi107.stdout:7/150: write d0/d1b/f28 [237024,127804] 0 2024-09-10T10:04:07.103 INFO:tasks.workunit.client.1.smithi107.stdout:7/151: fsync d0/d8/dc/f26 0 2024-09-10T10:04:07.104 INFO:tasks.workunit.client.0.smithi071.stdout:9/46: getdents d0/dc 0 2024-09-10T10:04:07.105 INFO:tasks.workunit.client.1.smithi107.stdout:6/110: link d0/f19 d0/df/d14/d21/f25 0 2024-09-10T10:04:07.106 INFO:tasks.workunit.client.0.smithi071.stdout:8/42: dwrite d5/f12 [4194304,4194304] 0 2024-09-10T10:04:07.106 INFO:tasks.workunit.client.0.smithi071.stdout:9/47: mknod d0/cd 0 2024-09-10T10:04:07.107 INFO:tasks.workunit.client.1.smithi107.stdout:6/111: mknod d0/df/d14/c26 0 2024-09-10T10:04:07.108 INFO:tasks.workunit.client.0.smithi071.stdout:9/48: write d0/fa [184409,13317] 0 2024-09-10T10:04:07.108 INFO:tasks.workunit.client.0.smithi071.stdout:9/49: readlink - no filename 2024-09-10T10:04:07.108 INFO:tasks.workunit.client.0.smithi071.stdout:8/43: mknod d5/c14 0 2024-09-10T10:04:07.110 INFO:tasks.workunit.client.1.smithi107.stdout:6/112: write d0/df/d14/d21/f25 [723456,36311] 0 2024-09-10T10:04:07.116 INFO:tasks.workunit.client.0.smithi071.stdout:9/50: dread d0/f6 [4194304,4194304] 0 2024-09-10T10:04:07.118 INFO:tasks.workunit.client.0.smithi071.stdout:8/44: dwrite d5/f8 [0,4194304] 0 2024-09-10T10:04:07.119 INFO:tasks.workunit.client.1.smithi107.stdout:7/152: write d0/fb [2673449,40452] 0 2024-09-10T10:04:07.120 INFO:tasks.workunit.client.0.smithi071.stdout:9/51: truncate d0/f6 1435894 0 2024-09-10T10:04:07.120 INFO:tasks.workunit.client.0.smithi071.stdout:9/52: stat d0/cd 0 2024-09-10T10:04:07.121 INFO:tasks.workunit.client.0.smithi071.stdout:8/45: rename d5/l9 to d5/l15 0 2024-09-10T10:04:07.122 INFO:tasks.workunit.client.1.smithi107.stdout:7/153: mkdir d0/d8/dc/d2c 0 2024-09-10T10:04:07.126 INFO:tasks.workunit.client.1.smithi107.stdout:6/113: fdatasync d0/f19 0 2024-09-10T10:04:07.128 INFO:tasks.workunit.client.0.smithi071.stdout:9/53: truncate d0/f9 1935438 0 2024-09-10T10:04:07.129 INFO:tasks.workunit.client.1.smithi107.stdout:6/114: stat d0/df/c10 0 2024-09-10T10:04:07.130 INFO:tasks.workunit.client.1.smithi107.stdout:7/154: dwrite d0/fb [4194304,4194304] 0 2024-09-10T10:04:07.131 INFO:tasks.workunit.client.0.smithi071.stdout:9/54: dread d0/fa [0,4194304] 0 2024-09-10T10:04:07.134 INFO:tasks.workunit.client.1.smithi107.stdout:6/115: write d0/f8 [5666133,22261] 0 2024-09-10T10:04:07.136 INFO:tasks.workunit.client.1.smithi107.stdout:6/116: readlink d0/df/d14/d17/l1e 0 2024-09-10T10:04:07.139 INFO:tasks.workunit.client.0.smithi071.stdout:8/46: fdatasync d5/f12 0 2024-09-10T10:04:07.139 INFO:tasks.workunit.client.1.smithi107.stdout:7/155: dwrite d0/d8/dc/f1f [4194304,4194304] 0 2024-09-10T10:04:07.140 INFO:tasks.workunit.client.1.smithi107.stdout:7/156: readlink d0/d8/dc/l1d 0 2024-09-10T10:04:07.141 INFO:tasks.workunit.client.1.smithi107.stdout:6/117: symlink d0/df/d14/d21/l27 0 2024-09-10T10:04:07.142 INFO:tasks.workunit.client.1.smithi107.stdout:7/157: chown d0/f27 61 1 2024-09-10T10:04:07.146 INFO:tasks.workunit.client.0.smithi071.stdout:9/55: dread d0/f9 [0,4194304] 0 2024-09-10T10:04:07.147 INFO:tasks.workunit.client.0.smithi071.stdout:9/56: chown d0/cd 16860294 1 2024-09-10T10:04:07.148 INFO:tasks.workunit.client.1.smithi107.stdout:6/118: write d0/df/d14/d21/f22 [447339,420] 0 2024-09-10T10:04:07.150 INFO:tasks.workunit.client.0.smithi071.stdout:9/57: creat d0/db/fe x:0 0 0 2024-09-10T10:04:07.151 INFO:tasks.workunit.client.0.smithi071.stdout:9/58: chown d0/cd 192665 1 2024-09-10T10:04:07.151 INFO:tasks.workunit.client.0.smithi071.stdout:8/47: truncate d5/fa 2645386 0 2024-09-10T10:04:07.153 INFO:tasks.workunit.client.0.smithi071.stdout:9/59: creat d0/db/ff x:0 0 0 2024-09-10T10:04:07.154 INFO:tasks.workunit.client.0.smithi071.stdout:9/60: rename d0/dc to d0/dc/d10 22 2024-09-10T10:04:07.155 INFO:tasks.workunit.client.1.smithi107.stdout:6/119: dread d0/df/d14/d21/f22 [0,4194304] 0 2024-09-10T10:04:07.156 INFO:tasks.workunit.client.0.smithi071.stdout:8/48: dwrite d5/fd [0,4194304] 0 2024-09-10T10:04:07.157 INFO:tasks.workunit.client.0.smithi071.stdout:9/61: creat d0/dc/f11 x:0 0 0 2024-09-10T10:04:07.157 INFO:tasks.workunit.client.1.smithi107.stdout:6/120: dread d0/df/d14/d21/f22 [0,4194304] 0 2024-09-10T10:04:07.164 INFO:tasks.workunit.client.0.smithi071.stdout:9/62: rmdir d0/dc 39 2024-09-10T10:04:07.165 INFO:tasks.workunit.client.0.smithi071.stdout:8/49: write d5/f7 [2974053,55475] 0 2024-09-10T10:04:07.165 INFO:tasks.workunit.client.1.smithi107.stdout:6/121: dwrite d0/f13 [0,4194304] 0 2024-09-10T10:04:07.166 INFO:tasks.workunit.client.0.smithi071.stdout:9/63: write d0/f9 [1269918,97602] 0 2024-09-10T10:04:07.167 INFO:tasks.workunit.client.0.smithi071.stdout:9/64: write d0/db/fe [541247,41447] 0 2024-09-10T10:04:07.168 INFO:tasks.workunit.client.0.smithi071.stdout:9/65: chown d0/cd 1 1 2024-09-10T10:04:07.170 INFO:tasks.workunit.client.1.smithi107.stdout:6/122: truncate d0/fa 1215078 0 2024-09-10T10:04:07.170 INFO:tasks.workunit.client.1.smithi107.stdout:6/123: stat d0/df/d14 0 2024-09-10T10:04:07.172 INFO:tasks.workunit.client.0.smithi071.stdout:8/50: fdatasync d5/f7 0 2024-09-10T10:04:07.172 INFO:tasks.workunit.client.0.smithi071.stdout:9/66: fdatasync d0/db/fe 0 2024-09-10T10:04:07.173 INFO:tasks.workunit.client.1.smithi107.stdout:6/124: creat d0/df/d14/d21/f28 x:0 0 0 2024-09-10T10:04:07.177 INFO:tasks.workunit.client.1.smithi107.stdout:6/125: getdents d0/df/d14/d17 0 2024-09-10T10:04:07.179 INFO:tasks.workunit.client.1.smithi107.stdout:6/126: read d0/df/d14/d17/f1c [440429,37629] 0 2024-09-10T10:04:07.180 INFO:tasks.workunit.client.1.smithi107.stdout:6/127: truncate d0/f1d 461045 0 2024-09-10T10:04:07.180 INFO:tasks.workunit.client.0.smithi071.stdout:9/67: dwrite d0/fa [0,4194304] 0 2024-09-10T10:04:07.181 INFO:tasks.workunit.client.1.smithi107.stdout:6/128: chown d0/df/d14/d21/l27 3695 1 2024-09-10T10:04:07.184 INFO:tasks.workunit.client.0.smithi071.stdout:9/68: link d0/dc/f11 d0/dc/f12 0 2024-09-10T10:04:07.186 INFO:tasks.workunit.client.0.smithi071.stdout:8/51: truncate d5/fd 326210 0 2024-09-10T10:04:07.187 INFO:tasks.workunit.client.0.smithi071.stdout:9/69: unlink d0/db/fe 0 2024-09-10T10:04:07.189 INFO:tasks.workunit.client.0.smithi071.stdout:8/52: mkdir d5/df/d16 0 2024-09-10T10:04:07.190 INFO:tasks.workunit.client.0.smithi071.stdout:9/70: symlink d0/l13 0 2024-09-10T10:04:07.192 INFO:tasks.workunit.client.1.smithi107.stdout:6/129: write d0/fa [1041914,51066] 0 2024-09-10T10:04:07.193 INFO:tasks.workunit.client.0.smithi071.stdout:8/53: dread d5/f7 [0,4194304] 0 2024-09-10T10:04:07.195 INFO:tasks.workunit.client.0.smithi071.stdout:8/54: creat d5/df/d16/f17 x:0 0 0 2024-09-10T10:04:07.196 INFO:tasks.workunit.client.1.smithi107.stdout:6/130: rename d0/cc to d0/df/d14/c29 0 2024-09-10T10:04:07.198 INFO:tasks.workunit.client.0.smithi071.stdout:8/55: symlink d5/df/d16/l18 0 2024-09-10T10:04:07.199 INFO:tasks.workunit.client.0.smithi071.stdout:9/71: getdents d0 0 2024-09-10T10:04:07.200 INFO:tasks.workunit.client.0.smithi071.stdout:8/56: rename d5/f12 to d5/f19 0 2024-09-10T10:04:07.201 INFO:tasks.workunit.client.0.smithi071.stdout:9/72: symlink d0/db/l14 0 2024-09-10T10:04:07.201 INFO:tasks.workunit.client.0.smithi071.stdout:8/57: symlink d5/df/d16/l1a 0 2024-09-10T10:04:07.203 INFO:tasks.workunit.client.0.smithi071.stdout:8/58: mkdir d5/df/d16/d1b 0 2024-09-10T10:04:07.204 INFO:tasks.workunit.client.0.smithi071.stdout:8/59: chown d5/df/d16/l18 10138 1 2024-09-10T10:04:07.206 INFO:tasks.workunit.client.1.smithi107.stdout:6/131: dread d0/fa [0,4194304] 0 2024-09-10T10:04:07.206 INFO:tasks.workunit.client.0.smithi071.stdout:8/60: dread d5/fb [0,4194304] 0 2024-09-10T10:04:07.207 INFO:tasks.workunit.client.1.smithi107.stdout:6/132: write d0/df/d14/d21/f23 [765783,82037] 0 2024-09-10T10:04:07.208 INFO:tasks.workunit.client.0.smithi071.stdout:8/61: chown d5/f8 218 1 2024-09-10T10:04:07.209 INFO:tasks.workunit.client.0.smithi071.stdout:8/62: creat d5/df/d16/f1c x:0 0 0 2024-09-10T10:04:07.212 INFO:tasks.workunit.client.0.smithi071.stdout:9/73: dwrite d0/dc/f11 [0,4194304] 0 2024-09-10T10:04:07.212 INFO:tasks.workunit.client.1.smithi107.stdout:6/133: link d0/fd d0/f2a 0 2024-09-10T10:04:07.213 INFO:tasks.workunit.client.0.smithi071.stdout:9/74: chown d0/cd 1809496 1 2024-09-10T10:04:07.214 INFO:tasks.workunit.client.0.smithi071.stdout:8/63: write d5/fe [225947,92905] 0 2024-09-10T10:04:07.214 INFO:tasks.workunit.client.1.smithi107.stdout:6/134: rename d0/f6 to d0/df/f2b 0 2024-09-10T10:04:07.217 INFO:tasks.workunit.client.0.smithi071.stdout:8/64: mkdir d5/df/d1d 0 2024-09-10T10:04:07.219 INFO:tasks.workunit.client.1.smithi107.stdout:6/135: link d0/f8 d0/f2c 0 2024-09-10T10:04:07.219 INFO:tasks.workunit.client.0.smithi071.stdout:8/65: write d5/fa [2646457,47814] 0 2024-09-10T10:04:07.220 INFO:tasks.workunit.client.0.smithi071.stdout:9/75: dwrite d0/db/ff [0,4194304] 0 2024-09-10T10:04:07.221 INFO:tasks.workunit.client.1.smithi107.stdout:4/145: sync 2024-09-10T10:04:07.221 INFO:tasks.workunit.client.1.smithi107.stdout:8/100: sync 2024-09-10T10:04:07.221 INFO:tasks.workunit.client.1.smithi107.stdout:3/106: sync 2024-09-10T10:04:07.222 INFO:tasks.workunit.client.0.smithi071.stdout:8/66: mkdir d5/df/d1e 0 2024-09-10T10:04:07.223 INFO:tasks.workunit.client.1.smithi107.stdout:4/146: chown d0/d29 88999 1 2024-09-10T10:04:07.224 INFO:tasks.workunit.client.1.smithi107.stdout:3/107: creat dc/dd/d1e/f1f x:0 0 0 2024-09-10T10:04:07.224 INFO:tasks.workunit.client.0.smithi071.stdout:8/67: unlink d5/df/d16/f1c 0 2024-09-10T10:04:07.225 INFO:tasks.workunit.client.0.smithi071.stdout:8/68: fdatasync d5/f10 0 2024-09-10T10:04:07.225 INFO:tasks.workunit.client.1.smithi107.stdout:3/108: fsync dc/dd/d15/f19 0 2024-09-10T10:04:07.226 INFO:tasks.workunit.client.1.smithi107.stdout:3/109: fdatasync dc/dd/f17 0 2024-09-10T10:04:07.227 INFO:tasks.workunit.client.0.smithi071.stdout:9/76: link d0/f9 d0/db/f15 0 2024-09-10T10:04:07.228 INFO:tasks.workunit.client.1.smithi107.stdout:3/110: write dc/dd/f1c [990419,96209] 0 2024-09-10T10:04:07.229 INFO:tasks.workunit.client.0.smithi071.stdout:8/69: mknod d5/df/d16/c1f 0 2024-09-10T10:04:07.229 INFO:tasks.workunit.client.1.smithi107.stdout:4/147: getdents d0/d1f 0 2024-09-10T10:04:07.230 INFO:tasks.workunit.client.0.smithi071.stdout:8/70: read - d5/df/d16/f17 zero size 2024-09-10T10:04:07.230 INFO:tasks.workunit.client.1.smithi107.stdout:3/111: mkdir dc/dd/d20 0 2024-09-10T10:04:07.232 INFO:tasks.workunit.client.1.smithi107.stdout:4/148: mknod d0/c38 0 2024-09-10T10:04:07.232 INFO:tasks.workunit.client.0.smithi071.stdout:9/77: link d0/f9 d0/f16 0 2024-09-10T10:04:07.236 INFO:tasks.workunit.client.1.smithi107.stdout:4/149: link d0/d1f/d20/f2c d0/d29/f39 0 2024-09-10T10:04:07.243 INFO:tasks.workunit.client.1.smithi107.stdout:4/150: dwrite d0/f1d [0,4194304] 0 2024-09-10T10:04:07.248 INFO:tasks.workunit.client.1.smithi107.stdout:4/151: read d0/f8 [2115797,28416] 0 2024-09-10T10:04:07.251 INFO:tasks.workunit.client.1.smithi107.stdout:4/152: symlink d0/d1f/d20/l3a 0 2024-09-10T10:04:07.252 INFO:tasks.workunit.client.1.smithi107.stdout:6/136: dread d0/f8 [0,4194304] 0 2024-09-10T10:04:07.252 INFO:tasks.workunit.client.0.smithi071.stdout:8/71: dwrite d5/f19 [0,4194304] 0 2024-09-10T10:04:07.253 INFO:tasks.workunit.client.0.smithi071.stdout:9/78: dwrite d0/dc/f12 [0,4194304] 0 2024-09-10T10:04:07.253 INFO:tasks.workunit.client.1.smithi107.stdout:3/112: truncate dc/dd/f1c 148398 0 2024-09-10T10:04:07.255 INFO:tasks.workunit.client.1.smithi107.stdout:3/113: write dc/dd/d15/f19 [9777698,18372] 0 2024-09-10T10:04:07.256 INFO:tasks.workunit.client.1.smithi107.stdout:4/153: creat d0/d1f/d20/d2f/f3b x:0 0 0 2024-09-10T10:04:07.260 INFO:tasks.workunit.client.1.smithi107.stdout:3/114: mknod dc/dd/d15/c21 0 2024-09-10T10:04:07.262 INFO:tasks.workunit.client.1.smithi107.stdout:6/137: dwrite d0/f1d [0,4194304] 0 2024-09-10T10:04:07.267 INFO:tasks.workunit.client.1.smithi107.stdout:3/115: symlink dc/dd/d15/l22 0 2024-09-10T10:04:07.279 INFO:tasks.workunit.client.1.smithi107.stdout:6/138: dwrite d0/df/f2b [0,4194304] 0 2024-09-10T10:04:07.279 INFO:tasks.workunit.client.1.smithi107.stdout:3/116: dwrite dc/f10 [0,4194304] 0 2024-09-10T10:04:07.282 INFO:tasks.workunit.client.1.smithi107.stdout:4/154: dwrite d0/f1d [4194304,4194304] 0 2024-09-10T10:04:07.286 INFO:tasks.workunit.client.1.smithi107.stdout:4/155: symlink d0/d1f/l3c 0 2024-09-10T10:04:07.291 INFO:tasks.workunit.client.1.smithi107.stdout:4/156: getdents d0 0 2024-09-10T10:04:07.292 INFO:tasks.workunit.client.1.smithi107.stdout:4/157: read - d0/d1f/d20/f2b zero size 2024-09-10T10:04:07.293 INFO:tasks.workunit.client.1.smithi107.stdout:4/158: chown d0/fa 14601 1 2024-09-10T10:04:07.294 INFO:tasks.workunit.client.1.smithi107.stdout:4/159: chown d0/d1f/d20 23451371 1 2024-09-10T10:04:07.296 INFO:tasks.workunit.client.1.smithi107.stdout:4/160: mknod d0/d1f/d20/c3d 0 2024-09-10T10:04:07.299 INFO:tasks.workunit.client.1.smithi107.stdout:6/139: dwrite d0/fd [0,4194304] 0 2024-09-10T10:04:07.301 INFO:tasks.workunit.client.1.smithi107.stdout:4/161: getdents d0/d29 0 2024-09-10T10:04:07.303 INFO:tasks.workunit.client.1.smithi107.stdout:6/140: symlink d0/df/d14/d17/d24/l2d 0 2024-09-10T10:04:07.304 INFO:tasks.workunit.client.1.smithi107.stdout:6/141: stat d0 0 2024-09-10T10:04:07.304 INFO:tasks.workunit.client.1.smithi107.stdout:4/162: creat d0/d1f/d20/d2f/f3e x:0 0 0 2024-09-10T10:04:07.305 INFO:tasks.workunit.client.1.smithi107.stdout:6/142: write d0/df/f2b [134962,92676] 0 2024-09-10T10:04:07.306 INFO:tasks.workunit.client.1.smithi107.stdout:4/163: chown d0/d1f/f34 10576 1 2024-09-10T10:04:07.307 INFO:tasks.workunit.client.1.smithi107.stdout:6/143: readlink d0/df/d14/d17/d24/l2d 0 2024-09-10T10:04:07.308 INFO:tasks.workunit.client.1.smithi107.stdout:4/164: mkdir d0/d29/d3f 0 2024-09-10T10:04:07.310 INFO:tasks.workunit.client.1.smithi107.stdout:6/144: rename d0/df/l12 to d0/df/l2e 0 2024-09-10T10:04:07.310 INFO:tasks.workunit.client.1.smithi107.stdout:4/165: mkdir d0/d40 0 2024-09-10T10:04:07.311 INFO:tasks.workunit.client.1.smithi107.stdout:4/166: chown d0/fb 22 1 2024-09-10T10:04:07.312 INFO:tasks.workunit.client.1.smithi107.stdout:6/145: mknod d0/df/d14/d17/c2f 0 2024-09-10T10:04:07.312 INFO:tasks.workunit.client.1.smithi107.stdout:3/117: fdatasync dc/f10 0 2024-09-10T10:04:07.313 INFO:tasks.workunit.client.1.smithi107.stdout:4/167: write d0/f8 [3449506,91192] 0 2024-09-10T10:04:07.313 INFO:tasks.workunit.client.1.smithi107.stdout:3/118: chown dc/dd/cf 19461561 1 2024-09-10T10:04:07.314 INFO:tasks.workunit.client.1.smithi107.stdout:6/146: symlink d0/df/d14/d17/d24/l30 0 2024-09-10T10:04:07.316 INFO:tasks.workunit.client.1.smithi107.stdout:6/147: creat d0/df/f31 x:0 0 0 2024-09-10T10:04:07.317 INFO:tasks.workunit.client.1.smithi107.stdout:6/148: write d0/df/d14/f1f [177149,43617] 0 2024-09-10T10:04:07.322 INFO:tasks.workunit.client.1.smithi107.stdout:3/119: write f1 [4104573,127377] 0 2024-09-10T10:04:07.325 INFO:tasks.workunit.client.1.smithi107.stdout:3/120: mkdir dc/dd/d20/d23 0 2024-09-10T10:04:07.325 INFO:tasks.workunit.client.1.smithi107.stdout:6/149: dwrite d0/f8 [0,4194304] 0 2024-09-10T10:04:07.325 INFO:tasks.workunit.client.1.smithi107.stdout:3/121: stat dc 0 2024-09-10T10:04:07.328 INFO:tasks.workunit.client.1.smithi107.stdout:6/150: symlink d0/df/d14/l32 0 2024-09-10T10:04:07.329 INFO:tasks.workunit.client.1.smithi107.stdout:6/151: readlink d0/df/d14/l32 0 2024-09-10T10:04:07.334 INFO:tasks.workunit.client.1.smithi107.stdout:3/122: truncate f1 2293295 0 2024-09-10T10:04:07.334 INFO:tasks.workunit.client.1.smithi107.stdout:6/152: dread d0/f8 [0,4194304] 0 2024-09-10T10:04:07.335 INFO:tasks.workunit.client.1.smithi107.stdout:6/153: read - d0/df/d14/d21/f28 zero size 2024-09-10T10:04:07.335 INFO:tasks.workunit.client.1.smithi107.stdout:3/123: creat dc/f24 x:0 0 0 2024-09-10T10:04:07.337 INFO:tasks.workunit.client.1.smithi107.stdout:3/124: unlink dc/dd/l13 0 2024-09-10T10:04:07.343 INFO:tasks.workunit.client.1.smithi107.stdout:6/154: dwrite d0/df/d14/d21/f28 [0,4194304] 0 2024-09-10T10:04:07.354 INFO:tasks.workunit.client.1.smithi107.stdout:6/155: dwrite d0/df/d14/d17/f1c [0,4194304] 0 2024-09-10T10:04:07.358 INFO:tasks.workunit.client.1.smithi107.stdout:6/156: creat d0/df/d14/d21/f33 x:0 0 0 2024-09-10T10:04:07.358 INFO:tasks.workunit.client.1.smithi107.stdout:3/125: dwrite f1 [0,4194304] 0 2024-09-10T10:04:07.360 INFO:tasks.workunit.client.1.smithi107.stdout:3/126: chown dc/dd/cf 500 1 2024-09-10T10:04:07.363 INFO:tasks.workunit.client.1.smithi107.stdout:3/127: unlink dc/f10 0 2024-09-10T10:04:07.364 INFO:tasks.workunit.client.1.smithi107.stdout:3/128: write dc/dd/d15/f19 [6417964,126938] 0 2024-09-10T10:04:07.365 INFO:tasks.workunit.client.1.smithi107.stdout:3/129: write dc/dd/d15/f19 [7174238,12213] 0 2024-09-10T10:04:07.366 INFO:tasks.workunit.client.1.smithi107.stdout:3/130: chown dc/dd/cf 9286676 1 2024-09-10T10:04:07.366 INFO:tasks.workunit.client.1.smithi107.stdout:3/131: readlink dc/dd/d15/l22 0 2024-09-10T10:04:07.368 INFO:tasks.workunit.client.1.smithi107.stdout:3/132: mkdir dc/dd/d25 0 2024-09-10T10:04:07.368 INFO:tasks.workunit.client.1.smithi107.stdout:3/133: stat f1 0 2024-09-10T10:04:07.371 INFO:tasks.workunit.client.1.smithi107.stdout:3/134: mkdir dc/dd/d25/d26 0 2024-09-10T10:04:07.372 INFO:tasks.workunit.client.1.smithi107.stdout:3/135: truncate f7 1480597 0 2024-09-10T10:04:07.379 INFO:tasks.workunit.client.1.smithi107.stdout:3/136: truncate f7 1399135 0 2024-09-10T10:04:07.380 INFO:tasks.workunit.client.1.smithi107.stdout:3/137: creat dc/dd/f27 x:0 0 0 2024-09-10T10:04:07.383 INFO:tasks.workunit.client.1.smithi107.stdout:0/68: sync 2024-09-10T10:04:07.384 INFO:tasks.workunit.client.1.smithi107.stdout:1/172: sync 2024-09-10T10:04:07.384 INFO:tasks.workunit.client.1.smithi107.stdout:6/157: dread d0/df/d14/d21/f25 [0,4194304] 0 2024-09-10T10:04:07.385 INFO:tasks.workunit.client.1.smithi107.stdout:0/69: chown d6/fa 8511667 1 2024-09-10T10:04:07.386 INFO:tasks.workunit.client.1.smithi107.stdout:3/138: dwrite dc/dd/d1e/f1f [0,4194304] 0 2024-09-10T10:04:07.388 INFO:tasks.workunit.client.1.smithi107.stdout:3/139: chown dc/dd/d20/d23 246729 1 2024-09-10T10:04:07.389 INFO:tasks.workunit.client.1.smithi107.stdout:1/173: getdents d2 0 2024-09-10T10:04:07.402 INFO:tasks.workunit.client.1.smithi107.stdout:6/158: mknod d0/c34 0 2024-09-10T10:04:07.403 INFO:tasks.workunit.client.1.smithi107.stdout:1/174: mknod d2/d6/d24/c2c 0 2024-09-10T10:04:07.403 INFO:tasks.workunit.client.1.smithi107.stdout:6/159: dread - d0/df/f31 zero size 2024-09-10T10:04:07.406 INFO:tasks.workunit.client.1.smithi107.stdout:1/175: creat d2/d6/f2d x:0 0 0 2024-09-10T10:04:07.407 INFO:tasks.workunit.client.1.smithi107.stdout:6/160: stat d0/df/c11 0 2024-09-10T10:04:07.408 INFO:tasks.workunit.client.1.smithi107.stdout:3/140: dwrite f1 [4194304,4194304] 0 2024-09-10T10:04:07.408 INFO:tasks.workunit.client.1.smithi107.stdout:1/176: stat d2/d6/d24 0 2024-09-10T10:04:07.410 INFO:tasks.workunit.client.1.smithi107.stdout:0/70: dwrite d6/f7 [0,4194304] 0 2024-09-10T10:04:07.412 INFO:tasks.workunit.client.1.smithi107.stdout:6/161: write d0/df/d14/d21/f23 [1260196,83076] 0 2024-09-10T10:04:07.414 INFO:tasks.workunit.client.1.smithi107.stdout:0/71: dread d6/f10 [4194304,4194304] 0 2024-09-10T10:04:07.414 INFO:tasks.workunit.client.1.smithi107.stdout:6/162: fsync d0/f8 0 2024-09-10T10:04:07.416 INFO:tasks.workunit.client.1.smithi107.stdout:3/141: rename dc/dd/d15/c21 to dc/dd/d20/d23/c28 0 2024-09-10T10:04:07.416 INFO:tasks.workunit.client.1.smithi107.stdout:1/177: link d2/d6/f16 d2/d2a/f2e 0 2024-09-10T10:04:07.417 INFO:tasks.workunit.client.1.smithi107.stdout:1/178: read d2/ff [1391159,98099] 0 2024-09-10T10:04:07.419 INFO:tasks.workunit.client.1.smithi107.stdout:1/179: readlink d2/d6/l22 0 2024-09-10T10:04:07.420 INFO:tasks.workunit.client.1.smithi107.stdout:0/72: rmdir d6/df 0 2024-09-10T10:04:07.421 INFO:tasks.workunit.client.1.smithi107.stdout:0/73: stat d6/dc 0 2024-09-10T10:04:07.422 INFO:tasks.workunit.client.1.smithi107.stdout:3/142: fdatasync f7 0 2024-09-10T10:04:07.424 INFO:tasks.workunit.client.1.smithi107.stdout:6/163: dwrite d0/f2a [0,4194304] 0 2024-09-10T10:04:07.428 INFO:tasks.workunit.client.1.smithi107.stdout:6/164: rename d0/fa to d0/df/d14/f35 0 2024-09-10T10:04:07.430 INFO:tasks.workunit.client.1.smithi107.stdout:1/180: dread d2/d6/f1c [0,4194304] 0 2024-09-10T10:04:07.431 INFO:tasks.workunit.client.1.smithi107.stdout:3/143: dread f1 [4194304,4194304] 0 2024-09-10T10:04:07.432 INFO:tasks.workunit.client.1.smithi107.stdout:1/181: truncate d2/d6/f2d 691225 0 2024-09-10T10:04:07.432 INFO:tasks.workunit.client.1.smithi107.stdout:6/165: creat d0/df/d14/d17/f36 x:0 0 0 2024-09-10T10:04:07.436 INFO:tasks.workunit.client.1.smithi107.stdout:1/182: dread d2/d2a/f2e [0,4194304] 0 2024-09-10T10:04:07.441 INFO:tasks.workunit.client.1.smithi107.stdout:6/166: rmdir d0/df/d14 39 2024-09-10T10:04:07.441 INFO:tasks.workunit.client.1.smithi107.stdout:3/144: dwrite dc/dd/f17 [4194304,4194304] 0 2024-09-10T10:04:07.443 INFO:tasks.workunit.client.1.smithi107.stdout:1/183: getdents d2/d6 0 2024-09-10T10:04:07.445 INFO:tasks.workunit.client.1.smithi107.stdout:0/74: dwrite f2 [0,4194304] 0 2024-09-10T10:04:07.447 INFO:tasks.workunit.client.1.smithi107.stdout:6/167: symlink d0/l37 0 2024-09-10T10:04:07.450 INFO:tasks.workunit.client.1.smithi107.stdout:1/184: creat d2/d12/f2f x:0 0 0 2024-09-10T10:04:07.457 INFO:tasks.workunit.client.1.smithi107.stdout:3/145: dwrite dc/dd/d15/f19 [4194304,4194304] 0 2024-09-10T10:04:07.457 INFO:tasks.workunit.client.1.smithi107.stdout:6/168: symlink d0/df/l38 0 2024-09-10T10:04:07.457 INFO:tasks.workunit.client.1.smithi107.stdout:3/146: chown dc/dd/d15/l22 1 1 2024-09-10T10:04:07.459 INFO:tasks.workunit.client.1.smithi107.stdout:3/147: truncate f7 1791337 0 2024-09-10T10:04:07.459 INFO:tasks.workunit.client.1.smithi107.stdout:6/169: chown d0/df/d14/d17/d24/l30 1628152421 1 2024-09-10T10:04:07.462 INFO:tasks.workunit.client.1.smithi107.stdout:3/148: symlink dc/dd/d25/d26/l29 0 2024-09-10T10:04:07.465 INFO:tasks.workunit.client.1.smithi107.stdout:3/149: creat dc/dd/d15/f2a x:0 0 0 2024-09-10T10:04:07.465 INFO:tasks.workunit.client.1.smithi107.stdout:3/150: fdatasync dc/dd/d1e/f1f 0 2024-09-10T10:04:07.470 INFO:tasks.workunit.client.1.smithi107.stdout:3/151: link dc/dd/d15/l22 dc/dd/d25/l2b 0 2024-09-10T10:04:07.471 INFO:tasks.workunit.client.1.smithi107.stdout:3/152: write f1 [1283294,95673] 0 2024-09-10T10:04:07.474 INFO:tasks.workunit.client.0.smithi071.stdout:8/72: symlink d5/df/d16/l20 0 2024-09-10T10:04:07.475 INFO:tasks.workunit.client.1.smithi107.stdout:3/153: rename dc/dd/d15/l22 to dc/dd/d20/l2c 0 2024-09-10T10:04:07.476 INFO:tasks.workunit.client.0.smithi071.stdout:8/73: getdents d5/df/d1e 0 2024-09-10T10:04:07.476 INFO:tasks.workunit.client.0.smithi071.stdout:8/74: write d5/f19 [2558311,60658] 0 2024-09-10T10:04:07.479 INFO:tasks.workunit.client.0.smithi071.stdout:8/75: creat d5/df/d1e/f21 x:0 0 0 2024-09-10T10:04:07.479 INFO:tasks.workunit.client.1.smithi107.stdout:3/154: rename dc/dd/f1c to dc/dd/d1e/f2d 0 2024-09-10T10:04:07.485 INFO:tasks.workunit.client.1.smithi107.stdout:3/155: dwrite dc/dd/f12 [0,4194304] 0 2024-09-10T10:04:07.488 INFO:tasks.workunit.client.1.smithi107.stdout:3/156: creat dc/dd/d25/f2e x:0 0 0 2024-09-10T10:04:07.488 INFO:tasks.workunit.client.1.smithi107.stdout:3/157: write dc/dd/d15/f19 [8503001,75231] 0 2024-09-10T10:04:07.489 INFO:tasks.workunit.client.1.smithi107.stdout:3/158: write f1 [5818665,9343] 0 2024-09-10T10:04:07.545 INFO:tasks.workunit.client.1.smithi107.stdout:0/75: write d6/d8/fb [5249659,89412] 0 2024-09-10T10:04:07.547 INFO:tasks.workunit.client.1.smithi107.stdout:1/185: write d2/d6/fc [2336629,127055] 0 2024-09-10T10:04:07.550 INFO:tasks.workunit.client.1.smithi107.stdout:0/76: dread d6/fa [0,4194304] 0 2024-09-10T10:04:07.561 INFO:tasks.workunit.client.1.smithi107.stdout:3/159: readlink dc/dd/d20/l2c 0 2024-09-10T10:04:07.563 INFO:tasks.workunit.client.1.smithi107.stdout:3/160: mkdir dc/dd/d20/d23/d2f 0 2024-09-10T10:04:07.564 INFO:tasks.workunit.client.1.smithi107.stdout:1/186: write d2/f5 [432299,40426] 0 2024-09-10T10:04:07.565 INFO:tasks.workunit.client.1.smithi107.stdout:3/161: symlink dc/dd/l30 0 2024-09-10T10:04:07.568 INFO:tasks.workunit.client.1.smithi107.stdout:1/187: dread d2/d6/fa [0,4194304] 0 2024-09-10T10:04:07.568 INFO:tasks.workunit.client.1.smithi107.stdout:3/162: link dc/dd/f12 dc/dd/f31 0 2024-09-10T10:04:07.569 INFO:tasks.workunit.client.1.smithi107.stdout:3/163: truncate dc/dd/d25/f2e 28242 0 2024-09-10T10:04:07.571 INFO:tasks.workunit.client.1.smithi107.stdout:3/164: chown dc/dd/d20/l2c 1 1 2024-09-10T10:04:07.572 INFO:tasks.workunit.client.1.smithi107.stdout:3/165: read f1 [1609324,48232] 0 2024-09-10T10:04:07.572 INFO:tasks.workunit.client.1.smithi107.stdout:0/77: dread d6/d8/f9 [0,4194304] 0 2024-09-10T10:04:07.574 INFO:tasks.workunit.client.1.smithi107.stdout:3/166: creat dc/dd/d15/f32 x:0 0 0 2024-09-10T10:04:07.578 INFO:tasks.workunit.client.1.smithi107.stdout:0/78: dread d6/f7 [0,4194304] 0 2024-09-10T10:04:07.578 INFO:tasks.workunit.client.1.smithi107.stdout:1/188: dwrite d2/d12/f25 [0,4194304] 0 2024-09-10T10:04:07.580 INFO:tasks.workunit.client.1.smithi107.stdout:0/79: mknod d6/c11 0 2024-09-10T10:04:07.580 INFO:tasks.workunit.client.1.smithi107.stdout:1/189: write d2/d6/f2d [1270706,77649] 0 2024-09-10T10:04:07.580 INFO:tasks.workunit.client.1.smithi107.stdout:3/167: link c6 dc/dd/d20/d23/c33 0 2024-09-10T10:04:07.582 INFO:tasks.workunit.client.1.smithi107.stdout:3/168: readlink dc/dd/d20/l2c 0 2024-09-10T10:04:07.583 INFO:tasks.workunit.client.1.smithi107.stdout:3/169: chown dc/dd/f31 288269728 1 2024-09-10T10:04:07.587 INFO:tasks.workunit.client.1.smithi107.stdout:1/190: dread d2/d6/f1c [0,4194304] 0 2024-09-10T10:04:07.587 INFO:tasks.workunit.client.1.smithi107.stdout:0/80: dwrite d6/d8/fb [0,4194304] 0 2024-09-10T10:04:07.588 INFO:tasks.workunit.client.1.smithi107.stdout:1/191: write d2/f29 [1012199,2691] 0 2024-09-10T10:04:07.590 INFO:tasks.workunit.client.1.smithi107.stdout:3/170: dread dc/dd/f12 [0,4194304] 0 2024-09-10T10:04:07.591 INFO:tasks.workunit.client.1.smithi107.stdout:1/192: truncate d2/d12/f1a 636136 0 2024-09-10T10:04:07.592 INFO:tasks.workunit.client.1.smithi107.stdout:1/193: stat d2/d12/f2f 0 2024-09-10T10:04:07.593 INFO:tasks.workunit.client.1.smithi107.stdout:0/81: dread f2 [0,4194304] 0 2024-09-10T10:04:07.594 INFO:tasks.workunit.client.1.smithi107.stdout:3/171: rename c6 to dc/c34 0 2024-09-10T10:04:07.595 INFO:tasks.workunit.client.1.smithi107.stdout:1/194: creat d2/d12/f30 x:0 0 0 2024-09-10T10:04:07.597 INFO:tasks.workunit.client.1.smithi107.stdout:0/82: dread d6/f7 [0,4194304] 0 2024-09-10T10:04:07.598 INFO:tasks.workunit.client.1.smithi107.stdout:0/83: read d6/f7 [2843430,78500] 0 2024-09-10T10:04:07.598 INFO:tasks.workunit.client.1.smithi107.stdout:3/172: rename dc/dd/d15 to dc/dd/d1e/d35 0 2024-09-10T10:04:07.599 INFO:tasks.workunit.client.1.smithi107.stdout:1/195: creat d2/d12/f31 x:0 0 0 2024-09-10T10:04:07.599 INFO:tasks.workunit.client.1.smithi107.stdout:0/84: creat d6/f12 x:0 0 0 2024-09-10T10:04:07.600 INFO:tasks.workunit.client.1.smithi107.stdout:3/173: stat f2 0 2024-09-10T10:04:07.601 INFO:tasks.workunit.client.1.smithi107.stdout:1/196: creat d2/f32 x:0 0 0 2024-09-10T10:04:07.601 INFO:tasks.workunit.client.1.smithi107.stdout:0/85: write d6/d8/fb [4458226,124262] 0 2024-09-10T10:04:07.602 INFO:tasks.workunit.client.1.smithi107.stdout:3/174: symlink dc/dd/d25/l36 0 2024-09-10T10:04:07.603 INFO:tasks.workunit.client.1.smithi107.stdout:0/86: mknod d6/d8/c13 0 2024-09-10T10:04:07.604 INFO:tasks.workunit.client.1.smithi107.stdout:3/175: symlink dc/dd/l37 0 2024-09-10T10:04:07.606 INFO:tasks.workunit.client.1.smithi107.stdout:1/197: dread d2/d6/fc [0,4194304] 0 2024-09-10T10:04:07.608 INFO:tasks.workunit.client.1.smithi107.stdout:1/198: symlink d2/d2a/l33 0 2024-09-10T10:04:07.610 INFO:tasks.workunit.client.1.smithi107.stdout:1/199: mknod d2/d12/c34 0 2024-09-10T10:04:07.611 INFO:tasks.workunit.client.1.smithi107.stdout:0/87: truncate d6/f7 2388505 0 2024-09-10T10:04:07.612 INFO:tasks.workunit.client.1.smithi107.stdout:0/88: rename d6/dc to d6/d14 0 2024-09-10T10:04:07.613 INFO:tasks.workunit.client.1.smithi107.stdout:1/200: dread d2/f5 [0,4194304] 0 2024-09-10T10:04:07.614 INFO:tasks.workunit.client.1.smithi107.stdout:0/89: truncate d6/f12 142381 0 2024-09-10T10:04:07.614 INFO:tasks.workunit.client.1.smithi107.stdout:1/201: mkdir d2/d35 0 2024-09-10T10:04:07.616 INFO:tasks.workunit.client.1.smithi107.stdout:1/202: mkdir d2/d36 0 2024-09-10T10:04:07.617 INFO:tasks.workunit.client.1.smithi107.stdout:3/176: dwrite dc/dd/d1e/f2d [0,4194304] 0 2024-09-10T10:04:07.620 INFO:tasks.workunit.client.1.smithi107.stdout:3/177: dread dc/dd/d25/f2e [0,4194304] 0 2024-09-10T10:04:07.622 INFO:tasks.workunit.client.1.smithi107.stdout:0/90: write d6/f7 [2532081,117014] 0 2024-09-10T10:04:07.623 INFO:tasks.workunit.client.1.smithi107.stdout:3/178: fdatasync dc/dd/f27 0 2024-09-10T10:04:07.624 INFO:tasks.workunit.client.1.smithi107.stdout:0/91: write d6/f12 [1177857,2967] 0 2024-09-10T10:04:07.626 INFO:tasks.workunit.client.1.smithi107.stdout:3/179: symlink dc/l38 0 2024-09-10T10:04:07.626 INFO:tasks.workunit.client.1.smithi107.stdout:1/203: dwrite d2/d6/f1c [4194304,4194304] 0 2024-09-10T10:04:07.628 INFO:tasks.workunit.client.1.smithi107.stdout:3/180: mkdir dc/dd/d20/d23/d39 0 2024-09-10T10:04:07.629 INFO:tasks.workunit.client.1.smithi107.stdout:1/204: symlink d2/l37 0 2024-09-10T10:04:07.630 INFO:tasks.workunit.client.1.smithi107.stdout:3/181: fsync dc/dd/d1e/d35/f32 0 2024-09-10T10:04:07.632 INFO:tasks.workunit.client.1.smithi107.stdout:1/205: unlink d2/d12/c34 0 2024-09-10T10:04:07.632 INFO:tasks.workunit.client.1.smithi107.stdout:1/206: readlink d2/d6/l22 0 2024-09-10T10:04:07.633 INFO:tasks.workunit.client.1.smithi107.stdout:1/207: chown d2/l37 170387074 1 2024-09-10T10:04:07.634 INFO:tasks.workunit.client.1.smithi107.stdout:0/92: dwrite d6/d8/f9 [4194304,4194304] 0 2024-09-10T10:04:07.638 INFO:tasks.workunit.client.1.smithi107.stdout:1/208: symlink d2/d2a/l38 0 2024-09-10T10:04:07.639 INFO:tasks.workunit.client.1.smithi107.stdout:3/182: write f1 [3516041,74662] 0 2024-09-10T10:04:07.640 INFO:tasks.workunit.client.1.smithi107.stdout:0/93: dread d6/fa [0,4194304] 0 2024-09-10T10:04:07.640 INFO:tasks.workunit.client.1.smithi107.stdout:1/209: write d2/f21 [3042881,41412] 0 2024-09-10T10:04:07.643 INFO:tasks.workunit.client.1.smithi107.stdout:0/94: creat d6/d8/f15 x:0 0 0 2024-09-10T10:04:07.645 INFO:tasks.workunit.client.1.smithi107.stdout:3/183: creat dc/dd/d25/d26/f3a x:0 0 0 2024-09-10T10:04:07.645 INFO:tasks.workunit.client.1.smithi107.stdout:3/184: stat dc/l38 0 2024-09-10T10:04:07.645 INFO:tasks.workunit.client.1.smithi107.stdout:0/95: mknod d6/d14/c16 0 2024-09-10T10:04:07.647 INFO:tasks.workunit.client.1.smithi107.stdout:0/96: write d6/f7 [907382,35178] 0 2024-09-10T10:04:07.648 INFO:tasks.workunit.client.1.smithi107.stdout:3/185: mknod dc/dd/d20/c3b 0 2024-09-10T10:04:07.649 INFO:tasks.workunit.client.1.smithi107.stdout:1/210: dwrite d2/d6/f2d [0,4194304] 0 2024-09-10T10:04:07.649 INFO:tasks.workunit.client.1.smithi107.stdout:0/97: chown d6/f12 76 1 2024-09-10T10:04:07.651 INFO:tasks.workunit.client.1.smithi107.stdout:0/98: fdatasync d6/fa 0 2024-09-10T10:04:07.653 INFO:tasks.workunit.client.1.smithi107.stdout:1/211: rename d2/d12/f2f to d2/d36/f39 0 2024-09-10T10:04:07.654 INFO:tasks.workunit.client.1.smithi107.stdout:3/186: truncate f7 2318244 0 2024-09-10T10:04:07.656 INFO:tasks.workunit.client.1.smithi107.stdout:0/99: dread d6/f10 [0,4194304] 0 2024-09-10T10:04:07.656 INFO:tasks.workunit.client.1.smithi107.stdout:3/187: creat dc/dd/d1e/f3c x:0 0 0 2024-09-10T10:04:07.658 INFO:tasks.workunit.client.1.smithi107.stdout:0/100: write d6/d8/f15 [439720,120803] 0 2024-09-10T10:04:07.658 INFO:tasks.workunit.client.1.smithi107.stdout:1/212: link d2/d12/f1a d2/d35/f3a 0 2024-09-10T10:04:07.661 INFO:tasks.workunit.client.1.smithi107.stdout:3/188: getdents dc/dd/d1e/d35 0 2024-09-10T10:04:07.662 INFO:tasks.workunit.client.1.smithi107.stdout:3/189: write dc/dd/d1e/f2d [2256320,43980] 0 2024-09-10T10:04:07.662 INFO:tasks.workunit.client.1.smithi107.stdout:1/213: link d2/d12/f31 d2/d35/f3b 0 2024-09-10T10:04:07.664 INFO:tasks.workunit.client.1.smithi107.stdout:0/101: dread d6/d8/fb [0,4194304] 0 2024-09-10T10:04:07.664 INFO:tasks.workunit.client.1.smithi107.stdout:3/190: chown f1 102 1 2024-09-10T10:04:07.666 INFO:tasks.workunit.client.1.smithi107.stdout:0/102: mknod d6/d14/c17 0 2024-09-10T10:04:07.666 INFO:tasks.workunit.client.1.smithi107.stdout:3/191: fdatasync dc/dd/d25/d26/f3a 0 2024-09-10T10:04:07.669 INFO:tasks.workunit.client.1.smithi107.stdout:3/192: mkdir dc/dd/d25/d3d 0 2024-09-10T10:04:07.669 INFO:tasks.workunit.client.1.smithi107.stdout:1/214: dread d2/d6/f2d [0,4194304] 0 2024-09-10T10:04:07.671 INFO:tasks.workunit.client.1.smithi107.stdout:0/103: truncate d6/fa 1833028 0 2024-09-10T10:04:07.672 INFO:tasks.workunit.client.1.smithi107.stdout:1/215: creat d2/d12/f3c x:0 0 0 2024-09-10T10:04:07.673 INFO:tasks.workunit.client.1.smithi107.stdout:0/104: mkdir d6/d18 0 2024-09-10T10:04:07.674 INFO:tasks.workunit.client.1.smithi107.stdout:1/216: mknod d2/c3d 0 2024-09-10T10:04:07.675 INFO:tasks.workunit.client.1.smithi107.stdout:3/193: dwrite dc/dd/d1e/f2d [0,4194304] 0 2024-09-10T10:04:07.676 INFO:tasks.workunit.client.1.smithi107.stdout:1/217: truncate d2/d12/f30 407701 0 2024-09-10T10:04:07.678 INFO:tasks.workunit.client.1.smithi107.stdout:0/105: dread d6/f7 [0,4194304] 0 2024-09-10T10:04:07.678 INFO:tasks.workunit.client.1.smithi107.stdout:3/194: write dc/dd/d1e/f3c [993710,123193] 0 2024-09-10T10:04:07.679 INFO:tasks.workunit.client.1.smithi107.stdout:1/218: read d2/d12/f1e [5331194,15449] 0 2024-09-10T10:04:07.680 INFO:tasks.workunit.client.1.smithi107.stdout:0/106: symlink d6/d8/l19 0 2024-09-10T10:04:07.681 INFO:tasks.workunit.client.1.smithi107.stdout:0/107: chown l5 10 1 2024-09-10T10:04:07.682 INFO:tasks.workunit.client.1.smithi107.stdout:1/219: fsync d2/d6/f2d 0 2024-09-10T10:04:07.684 INFO:tasks.workunit.client.1.smithi107.stdout:3/195: creat dc/dd/d20/f3e x:0 0 0 2024-09-10T10:04:07.685 INFO:tasks.workunit.client.1.smithi107.stdout:3/196: readlink dc/dd/d20/l2c 0 2024-09-10T10:04:07.685 INFO:tasks.workunit.client.1.smithi107.stdout:0/108: mknod d6/c1a 0 2024-09-10T10:04:07.685 INFO:tasks.workunit.client.1.smithi107.stdout:3/197: chown dc/dd/c14 0 1 2024-09-10T10:04:07.686 INFO:tasks.workunit.client.1.smithi107.stdout:0/109: truncate d6/d8/f15 815749 0 2024-09-10T10:04:07.686 INFO:tasks.workunit.client.1.smithi107.stdout:1/220: creat d2/d12/f3e x:0 0 0 2024-09-10T10:04:07.688 INFO:tasks.workunit.client.1.smithi107.stdout:0/110: creat d6/d18/f1b x:0 0 0 2024-09-10T10:04:07.689 INFO:tasks.workunit.client.1.smithi107.stdout:0/111: read d6/d8/f9 [5419964,23245] 0 2024-09-10T10:04:07.696 INFO:tasks.workunit.client.1.smithi107.stdout:1/221: getdents d2 0 2024-09-10T10:04:07.697 INFO:tasks.workunit.client.1.smithi107.stdout:0/112: dwrite f4 [0,4194304] 0 2024-09-10T10:04:07.699 INFO:tasks.workunit.client.1.smithi107.stdout:3/198: truncate dc/dd/f17 3473683 0 2024-09-10T10:04:07.700 INFO:tasks.workunit.client.1.smithi107.stdout:0/113: rename d6/ld to d6/d8/l1c 0 2024-09-10T10:04:07.701 INFO:tasks.workunit.client.1.smithi107.stdout:1/222: creat d2/d35/f3f x:0 0 0 2024-09-10T10:04:07.704 INFO:tasks.workunit.client.1.smithi107.stdout:1/223: rename d2/d6/f16 to d2/d6/f40 0 2024-09-10T10:04:07.709 INFO:tasks.workunit.client.1.smithi107.stdout:3/199: dread f7 [0,4194304] 0 2024-09-10T10:04:07.710 INFO:tasks.workunit.client.1.smithi107.stdout:0/114: dwrite d6/d8/fb [0,4194304] 0 2024-09-10T10:04:07.710 INFO:tasks.workunit.client.1.smithi107.stdout:3/200: chown dc/f24 30934 1 2024-09-10T10:04:07.712 INFO:tasks.workunit.client.1.smithi107.stdout:3/201: chown dc/dd/f1d 2083548069 1 2024-09-10T10:04:07.712 INFO:tasks.workunit.client.1.smithi107.stdout:1/224: dread d2/f18 [0,4194304] 0 2024-09-10T10:04:07.712 INFO:tasks.workunit.client.1.smithi107.stdout:3/202: chown dc/dd/l37 5 1 2024-09-10T10:04:07.714 INFO:tasks.workunit.client.1.smithi107.stdout:1/225: creat d2/d2a/f41 x:0 0 0 2024-09-10T10:04:07.715 INFO:tasks.workunit.client.1.smithi107.stdout:1/226: write d2/d6/f1c [1311597,1404] 0 2024-09-10T10:04:07.721 INFO:tasks.workunit.client.1.smithi107.stdout:0/115: truncate f2 897508 0 2024-09-10T10:04:07.721 INFO:tasks.workunit.client.1.smithi107.stdout:3/203: dwrite dc/dd/d1e/d35/f19 [4194304,4194304] 0 2024-09-10T10:04:07.723 INFO:tasks.workunit.client.1.smithi107.stdout:3/204: fdatasync dc/dd/d1e/f3c 0 2024-09-10T10:04:07.723 INFO:tasks.workunit.client.1.smithi107.stdout:0/116: creat d6/f1d x:0 0 0 2024-09-10T10:04:07.724 INFO:tasks.workunit.client.1.smithi107.stdout:3/205: chown dc/dd/d20/d23/d2f 0 1 2024-09-10T10:04:07.725 INFO:tasks.workunit.client.1.smithi107.stdout:0/117: mknod d6/d8/c1e 0 2024-09-10T10:04:07.728 INFO:tasks.workunit.client.1.smithi107.stdout:0/118: unlink d6/d8/c13 0 2024-09-10T10:04:07.729 INFO:tasks.workunit.client.1.smithi107.stdout:3/206: creat dc/dd/d20/d23/d39/f3f x:0 0 0 2024-09-10T10:04:07.731 INFO:tasks.workunit.client.1.smithi107.stdout:1/227: truncate d2/f10 1819384 0 2024-09-10T10:04:07.732 INFO:tasks.workunit.client.0.smithi071.stdout:9/79: write d0/f9 [1083717,107203] 0 2024-09-10T10:04:07.732 INFO:tasks.workunit.client.1.smithi107.stdout:1/228: readlink d2/l1b 0 2024-09-10T10:04:07.734 INFO:tasks.workunit.client.0.smithi071.stdout:9/80: rmdir d0/dc 39 2024-09-10T10:04:07.734 INFO:tasks.workunit.client.1.smithi107.stdout:0/119: dread d6/d8/fb [0,4194304] 0 2024-09-10T10:04:07.735 INFO:tasks.workunit.client.1.smithi107.stdout:1/229: creat d2/d2a/f42 x:0 0 0 2024-09-10T10:04:07.736 INFO:tasks.workunit.client.1.smithi107.stdout:3/207: getdents dc/dd/d20/d23 0 2024-09-10T10:04:07.736 INFO:tasks.workunit.client.1.smithi107.stdout:1/230: fsync d2/d12/f3c 0 2024-09-10T10:04:07.737 INFO:tasks.workunit.client.1.smithi107.stdout:1/231: chown d2/d12/c28 0 1 2024-09-10T10:04:07.737 INFO:tasks.workunit.client.1.smithi107.stdout:3/208: chown dc/dd/d1e/d35/f2a 284 1 2024-09-10T10:04:07.738 INFO:tasks.workunit.client.1.smithi107.stdout:1/232: chown d2/d6/l1d 13266 1 2024-09-10T10:04:07.738 INFO:tasks.workunit.client.1.smithi107.stdout:1/233: chown d2/d6/d24/c2c 592 1 2024-09-10T10:04:07.738 INFO:tasks.workunit.client.0.smithi071.stdout:8/76: dwrite d5/fb [0,4194304] 0 2024-09-10T10:04:07.739 INFO:tasks.workunit.client.1.smithi107.stdout:0/120: rename d6/d14/c17 to d6/c1f 0 2024-09-10T10:04:07.739 INFO:tasks.workunit.client.0.smithi071.stdout:8/77: stat d5/fa 0 2024-09-10T10:04:07.739 INFO:tasks.workunit.client.0.smithi071.stdout:9/81: dread d0/f6 [0,4194304] 0 2024-09-10T10:04:07.741 INFO:tasks.workunit.client.1.smithi107.stdout:0/121: symlink d6/d8/l20 0 2024-09-10T10:04:07.741 INFO:tasks.workunit.client.0.smithi071.stdout:8/78: readlink d5/l15 0 2024-09-10T10:04:07.742 INFO:tasks.workunit.client.0.smithi071.stdout:8/79: write d5/fb [2574695,52532] 0 2024-09-10T10:04:07.743 INFO:tasks.workunit.client.1.smithi107.stdout:1/234: unlink d2/d6/f40 0 2024-09-10T10:04:07.743 INFO:tasks.workunit.client.0.smithi071.stdout:9/82: creat d0/db/f17 x:0 0 0 2024-09-10T10:04:07.744 INFO:tasks.workunit.client.0.smithi071.stdout:8/80: rmdir d5/df 39 2024-09-10T10:04:07.745 INFO:tasks.workunit.client.0.smithi071.stdout:9/83: rmdir d0 39 2024-09-10T10:04:07.745 INFO:tasks.workunit.client.1.smithi107.stdout:3/209: dwrite dc/dd/f27 [0,4194304] 0 2024-09-10T10:04:07.750 INFO:tasks.workunit.client.0.smithi071.stdout:9/84: dread d0/db/ff [0,4194304] 0 2024-09-10T10:04:07.754 INFO:tasks.workunit.client.0.smithi071.stdout:8/81: rmdir d5/df/d16/d1b 0 2024-09-10T10:04:07.754 INFO:tasks.workunit.client.1.smithi107.stdout:3/210: dread dc/dd/f1d [0,4194304] 0 2024-09-10T10:04:07.755 INFO:tasks.workunit.client.1.smithi107.stdout:0/122: dwrite d6/d18/f1b [0,4194304] 0 2024-09-10T10:04:07.755 INFO:tasks.workunit.client.0.smithi071.stdout:9/85: creat d0/db/f18 x:0 0 0 2024-09-10T10:04:07.758 INFO:tasks.workunit.client.0.smithi071.stdout:9/86: mknod d0/c19 0 2024-09-10T10:04:07.760 INFO:tasks.workunit.client.1.smithi107.stdout:3/211: rename dc/dd/c14 to dc/dd/d1e/c40 0 2024-09-10T10:04:07.761 INFO:tasks.workunit.client.1.smithi107.stdout:0/123: getdents d6/d14 0 2024-09-10T10:04:07.762 INFO:tasks.workunit.client.1.smithi107.stdout:3/212: mkdir dc/dd/d25/d26/d41 0 2024-09-10T10:04:07.764 INFO:tasks.workunit.client.1.smithi107.stdout:0/124: creat d6/d18/f21 x:0 0 0 2024-09-10T10:04:07.764 INFO:tasks.workunit.client.1.smithi107.stdout:3/213: write dc/f24 [1032529,53486] 0 2024-09-10T10:04:07.766 INFO:tasks.workunit.client.0.smithi071.stdout:9/87: dwrite d0/db/f15 [0,4194304] 0 2024-09-10T10:04:07.767 INFO:tasks.workunit.client.1.smithi107.stdout:3/214: chown dc/dd/d20/d23/c33 30413 1 2024-09-10T10:04:07.769 INFO:tasks.workunit.client.1.smithi107.stdout:3/215: mkdir dc/dd/d42 0 2024-09-10T10:04:07.769 INFO:tasks.workunit.client.0.smithi071.stdout:9/88: creat d0/dc/f1a x:0 0 0 2024-09-10T10:04:07.770 INFO:tasks.workunit.client.0.smithi071.stdout:9/89: stat d0/cd 0 2024-09-10T10:04:07.771 INFO:tasks.workunit.client.0.smithi071.stdout:9/90: chown d0/db/f18 10740643 1 2024-09-10T10:04:07.771 INFO:tasks.workunit.client.0.smithi071.stdout:9/91: fdatasync d0/db/f17 0 2024-09-10T10:04:07.774 INFO:tasks.workunit.client.1.smithi107.stdout:1/235: dread d2/f10 [0,4194304] 0 2024-09-10T10:04:07.776 INFO:tasks.workunit.client.1.smithi107.stdout:3/216: dread dc/dd/d1e/f3c [0,4194304] 0 2024-09-10T10:04:07.777 INFO:tasks.workunit.client.1.smithi107.stdout:3/217: chown dc/dd/f27 9582653 1 2024-09-10T10:04:07.779 INFO:tasks.workunit.client.1.smithi107.stdout:3/218: dread dc/dd/d25/f2e [0,4194304] 0 2024-09-10T10:04:07.780 INFO:tasks.workunit.client.1.smithi107.stdout:3/219: truncate dc/dd/d20/d23/d39/f3f 731383 0 2024-09-10T10:04:07.802 INFO:tasks.workunit.client.0.smithi071.stdout:9/92: rmdir d0/dc 39 2024-09-10T10:04:07.803 INFO:tasks.workunit.client.0.smithi071.stdout:9/93: dread - d0/dc/f1a zero size 2024-09-10T10:04:07.808 INFO:tasks.workunit.client.1.smithi107.stdout:1/236: creat d2/d2a/f43 x:0 0 0 2024-09-10T10:04:07.810 INFO:tasks.workunit.client.0.smithi071.stdout:9/94: dwrite d0/f16 [0,4194304] 0 2024-09-10T10:04:07.810 INFO:tasks.workunit.client.1.smithi107.stdout:1/237: unlink d2/d12/c28 0 2024-09-10T10:04:07.810 INFO:tasks.workunit.client.1.smithi107.stdout:1/238: fdatasync d2/f29 0 2024-09-10T10:04:07.811 INFO:tasks.workunit.client.0.smithi071.stdout:9/95: mkdir d0/db/d1b 0 2024-09-10T10:04:07.812 INFO:tasks.workunit.client.1.smithi107.stdout:1/239: write d2/f10 [260596,2733] 0 2024-09-10T10:04:07.813 INFO:tasks.workunit.client.0.smithi071.stdout:9/96: write d0/dc/f11 [2035061,129136] 0 2024-09-10T10:04:07.813 INFO:tasks.workunit.client.1.smithi107.stdout:1/240: write d2/f21 [1128979,85717] 0 2024-09-10T10:04:07.814 INFO:tasks.workunit.client.0.smithi071.stdout:9/97: write d0/db/f15 [3686820,100844] 0 2024-09-10T10:04:07.815 INFO:tasks.workunit.client.1.smithi107.stdout:1/241: symlink d2/d6/l44 0 2024-09-10T10:04:07.820 INFO:tasks.workunit.client.1.smithi107.stdout:1/242: dread - d2/d2a/f43 zero size 2024-09-10T10:04:07.822 INFO:tasks.workunit.client.0.smithi071.stdout:9/98: dwrite d0/db/f17 [0,4194304] 0 2024-09-10T10:04:07.827 INFO:tasks.workunit.client.0.smithi071.stdout:9/99: creat d0/dc/f1c x:0 0 0 2024-09-10T10:04:07.827 INFO:tasks.workunit.client.1.smithi107.stdout:1/243: dwrite d2/d6/fc [0,4194304] 0 2024-09-10T10:04:07.834 INFO:tasks.workunit.client.1.smithi107.stdout:1/244: dwrite d2/d12/f3e [0,4194304] 0 2024-09-10T10:04:07.836 INFO:tasks.workunit.client.1.smithi107.stdout:2/216: sync 2024-09-10T10:04:07.839 INFO:tasks.workunit.client.0.smithi071.stdout:9/100: getdents d0/dc 0 2024-09-10T10:04:07.844 INFO:tasks.workunit.client.0.smithi071.stdout:9/101: dread d0/f6 [0,4194304] 0 2024-09-10T10:04:07.844 INFO:tasks.workunit.client.1.smithi107.stdout:2/217: link d3/f3c d3/da/df/d20/f46 0 2024-09-10T10:04:07.844 INFO:tasks.workunit.client.0.smithi071.stdout:9/102: dread - d0/dc/f1a zero size 2024-09-10T10:04:07.846 INFO:tasks.workunit.client.1.smithi107.stdout:2/218: creat d3/d21/f47 x:0 0 0 2024-09-10T10:04:07.847 INFO:tasks.workunit.client.0.smithi071.stdout:9/103: mkdir d0/db/d1b/d1d 0 2024-09-10T10:04:07.848 INFO:tasks.workunit.client.0.smithi071.stdout:9/104: symlink d0/dc/l1e 0 2024-09-10T10:04:07.849 INFO:tasks.workunit.client.1.smithi107.stdout:2/219: creat d3/da/df/f48 x:0 0 0 2024-09-10T10:04:07.851 INFO:tasks.workunit.client.1.smithi107.stdout:2/220: creat d3/f49 x:0 0 0 2024-09-10T10:04:07.852 INFO:tasks.workunit.client.1.smithi107.stdout:2/221: stat d3/d21/l2b 0 2024-09-10T10:04:07.853 INFO:tasks.workunit.client.1.smithi107.stdout:2/222: mkdir d3/da/df/d20/d4a 0 2024-09-10T10:04:07.854 INFO:tasks.workunit.client.1.smithi107.stdout:1/245: dread d2/f21 [0,4194304] 0 2024-09-10T10:04:07.855 INFO:tasks.workunit.client.0.smithi071.stdout:9/105: dwrite d0/db/f15 [0,4194304] 0 2024-09-10T10:04:07.855 INFO:tasks.workunit.client.0.smithi071.stdout:9/106: chown d0/db 105798654 1 2024-09-10T10:04:07.856 INFO:tasks.workunit.client.1.smithi107.stdout:1/246: symlink d2/d2a/l45 0 2024-09-10T10:04:07.858 INFO:tasks.workunit.client.1.smithi107.stdout:1/247: unlink d2/d12/f30 0 2024-09-10T10:04:07.858 INFO:tasks.workunit.client.0.smithi071.stdout:9/107: creat d0/db/d1b/d1d/f1f x:0 0 0 2024-09-10T10:04:07.859 INFO:tasks.workunit.client.1.smithi107.stdout:1/248: rmdir d2 39 2024-09-10T10:04:07.860 INFO:tasks.workunit.client.1.smithi107.stdout:2/223: dwrite d3/d21/f32 [0,4194304] 0 2024-09-10T10:04:07.862 INFO:tasks.workunit.client.0.smithi071.stdout:9/108: dread d0/dc/f11 [0,4194304] 0 2024-09-10T10:04:07.863 INFO:tasks.workunit.client.1.smithi107.stdout:2/224: symlink d3/d21/d41/l4b 0 2024-09-10T10:04:07.863 INFO:tasks.workunit.client.1.smithi107.stdout:1/249: readlink d2/d2a/l38 0 2024-09-10T10:04:07.867 INFO:tasks.workunit.client.1.smithi107.stdout:2/225: symlink d3/d21/d41/l4c 0 2024-09-10T10:04:07.877 INFO:tasks.workunit.client.0.smithi071.stdout:9/109: fsync d0/db/d1b/d1d/f1f 0 2024-09-10T10:04:07.881 INFO:tasks.workunit.client.0.smithi071.stdout:9/110: dread d0/fa [0,4194304] 0 2024-09-10T10:04:07.881 INFO:tasks.workunit.client.1.smithi107.stdout:1/250: truncate d2/f10 826646 0 2024-09-10T10:04:07.882 INFO:tasks.workunit.client.1.smithi107.stdout:2/226: truncate d3/f31 3243222 0 2024-09-10T10:04:07.882 INFO:tasks.workunit.client.0.smithi071.stdout:9/111: mkdir d0/db/d20 0 2024-09-10T10:04:07.884 INFO:tasks.workunit.client.1.smithi107.stdout:1/251: rename d2/d36/f39 to d2/f46 0 2024-09-10T10:04:07.884 INFO:tasks.workunit.client.0.smithi071.stdout:9/112: mkdir d0/db/d20/d21 0 2024-09-10T10:04:07.884 INFO:tasks.workunit.client.0.smithi071.stdout:9/113: chown d0/db 20727 1 2024-09-10T10:04:07.885 INFO:tasks.workunit.client.1.smithi107.stdout:2/227: chown d3/l2d 1 1 2024-09-10T10:04:07.885 INFO:tasks.workunit.client.1.smithi107.stdout:1/252: write d2/d2a/f43 [890338,112381] 0 2024-09-10T10:04:07.887 INFO:tasks.workunit.client.1.smithi107.stdout:1/253: creat d2/d35/f47 x:0 0 0 2024-09-10T10:04:07.887 INFO:tasks.workunit.client.1.smithi107.stdout:1/254: write d2/f29 [1581618,126077] 0 2024-09-10T10:04:07.890 INFO:tasks.workunit.client.0.smithi071.stdout:9/114: dwrite d0/dc/f1a [0,4194304] 0 2024-09-10T10:04:07.892 INFO:tasks.workunit.client.1.smithi107.stdout:1/255: dread d2/d6/fa [0,4194304] 0 2024-09-10T10:04:07.894 INFO:tasks.workunit.client.1.smithi107.stdout:1/256: mknod d2/d36/c48 0 2024-09-10T10:04:07.895 INFO:tasks.workunit.client.0.smithi071.stdout:9/115: truncate d0/dc/f12 1807560 0 2024-09-10T10:04:07.896 INFO:tasks.workunit.client.1.smithi107.stdout:1/257: creat d2/f49 x:0 0 0 2024-09-10T10:04:07.896 INFO:tasks.workunit.client.0.smithi071.stdout:9/116: write d0/dc/f1c [940547,68642] 0 2024-09-10T10:04:07.896 INFO:tasks.workunit.client.1.smithi107.stdout:1/258: dread - d2/f46 zero size 2024-09-10T10:04:07.897 INFO:tasks.workunit.client.1.smithi107.stdout:1/259: fsync d2/d12/f3c 0 2024-09-10T10:04:07.898 INFO:tasks.workunit.client.0.smithi071.stdout:9/117: creat d0/db/f22 x:0 0 0 2024-09-10T10:04:07.900 INFO:tasks.workunit.client.1.smithi107.stdout:1/260: creat d2/d35/f4a x:0 0 0 2024-09-10T10:04:07.901 INFO:tasks.workunit.client.1.smithi107.stdout:2/228: dread d3/f11 [0,4194304] 0 2024-09-10T10:04:07.901 INFO:tasks.workunit.client.1.smithi107.stdout:1/261: mknod d2/d12/c4b 0 2024-09-10T10:04:07.903 INFO:tasks.workunit.client.1.smithi107.stdout:1/262: creat d2/f4c x:0 0 0 2024-09-10T10:04:07.905 INFO:tasks.workunit.client.1.smithi107.stdout:1/263: link d2/d12/f3e d2/d36/f4d 0 2024-09-10T10:04:07.906 INFO:tasks.workunit.client.1.smithi107.stdout:1/264: chown d2/f5 311066 1 2024-09-10T10:04:07.907 INFO:tasks.workunit.client.1.smithi107.stdout:1/265: creat d2/f4e x:0 0 0 2024-09-10T10:04:07.909 INFO:tasks.workunit.client.0.smithi071.stdout:9/118: unlink d0/dc/f11 0 2024-09-10T10:04:07.910 INFO:tasks.workunit.client.0.smithi071.stdout:9/119: chown d0/f6 508594113 1 2024-09-10T10:04:07.910 INFO:tasks.workunit.client.1.smithi107.stdout:1/266: write d2/d2a/f41 [764079,48624] 0 2024-09-10T10:04:07.912 INFO:tasks.workunit.client.0.smithi071.stdout:9/120: mknod d0/c23 0 2024-09-10T10:04:07.913 INFO:tasks.workunit.client.0.smithi071.stdout:9/121: chown d0/db/d1b/d1d 6023083 1 2024-09-10T10:04:07.913 INFO:tasks.workunit.client.0.smithi071.stdout:9/122: stat d0/f6 0 2024-09-10T10:04:07.913 INFO:tasks.workunit.client.1.smithi107.stdout:1/267: fdatasync d2/d2a/f41 0 2024-09-10T10:04:07.913 INFO:tasks.workunit.client.1.smithi107.stdout:2/229: truncate d3/da/f17 2344310 0 2024-09-10T10:04:07.915 INFO:tasks.workunit.client.1.smithi107.stdout:2/230: symlink d3/d21/d41/l4d 0 2024-09-10T10:04:07.916 INFO:tasks.workunit.client.0.smithi071.stdout:9/123: link d0/f16 d0/db/d1b/f24 0 2024-09-10T10:04:07.916 INFO:tasks.workunit.client.1.smithi107.stdout:1/268: dread d2/ff [0,4194304] 0 2024-09-10T10:04:07.918 INFO:tasks.workunit.client.1.smithi107.stdout:2/231: creat d3/da/df/d20/d36/d39/f4e x:0 0 0 2024-09-10T10:04:07.922 INFO:tasks.workunit.client.1.smithi107.stdout:1/269: dread d2/d12/f25 [0,4194304] 0 2024-09-10T10:04:07.922 INFO:tasks.workunit.client.0.smithi071.stdout:9/124: dwrite d0/f16 [0,4194304] 0 2024-09-10T10:04:07.924 INFO:tasks.workunit.client.0.smithi071.stdout:9/125: write d0/db/f15 [2116909,73348] 0 2024-09-10T10:04:07.926 INFO:tasks.workunit.client.1.smithi107.stdout:1/270: creat d2/d6/d24/f4f x:0 0 0 2024-09-10T10:04:07.927 INFO:tasks.workunit.client.1.smithi107.stdout:2/232: dwrite d3/da/df/f45 [0,4194304] 0 2024-09-10T10:04:07.932 INFO:tasks.workunit.client.1.smithi107.stdout:1/271: dread d2/d6/fc [4194304,4194304] 0 2024-09-10T10:04:07.936 INFO:tasks.workunit.client.1.smithi107.stdout:1/272: unlink d2/d35/f3a 0 2024-09-10T10:04:07.937 INFO:tasks.workunit.client.1.smithi107.stdout:1/273: fsync d2/d6/f2d 0 2024-09-10T10:04:07.941 INFO:tasks.workunit.client.0.smithi071.stdout:9/126: dwrite d0/dc/f1a [4194304,4194304] 0 2024-09-10T10:04:07.946 INFO:tasks.workunit.client.0.smithi071.stdout:9/127: creat d0/dc/f25 x:0 0 0 2024-09-10T10:04:07.946 INFO:tasks.workunit.client.1.smithi107.stdout:5/132: sync 2024-09-10T10:04:07.948 INFO:tasks.workunit.client.1.smithi107.stdout:5/133: creat de/d20/f29 x:0 0 0 2024-09-10T10:04:07.948 INFO:tasks.workunit.client.0.smithi071.stdout:9/128: mknod d0/c26 0 2024-09-10T10:04:07.948 INFO:tasks.workunit.client.1.smithi107.stdout:1/274: getdents d2/d35 0 2024-09-10T10:04:07.951 INFO:tasks.workunit.client.1.smithi107.stdout:1/275: unlink d2/f18 0 2024-09-10T10:04:07.953 INFO:tasks.workunit.client.1.smithi107.stdout:1/276: rename d2/d12/f25 to d2/d6/d24/f50 0 2024-09-10T10:04:07.954 INFO:tasks.workunit.client.1.smithi107.stdout:5/134: dwrite de/f16 [0,4194304] 0 2024-09-10T10:04:07.958 INFO:tasks.workunit.client.1.smithi107.stdout:1/277: getdents d2/d35 0 2024-09-10T10:04:07.960 INFO:tasks.workunit.client.1.smithi107.stdout:5/135: dwrite f8 [0,4194304] 0 2024-09-10T10:04:07.961 INFO:tasks.workunit.client.1.smithi107.stdout:2/233: dread d3/da/f17 [0,4194304] 0 2024-09-10T10:04:07.962 INFO:tasks.workunit.client.1.smithi107.stdout:1/278: write d2/d6/d24/f4f [536777,28782] 0 2024-09-10T10:04:07.964 INFO:tasks.workunit.client.0.smithi071.stdout:9/129: mkdir d0/dc/d27 0 2024-09-10T10:04:07.964 INFO:tasks.workunit.client.1.smithi107.stdout:1/279: mknod d2/d12/c51 0 2024-09-10T10:04:07.965 INFO:tasks.workunit.client.1.smithi107.stdout:2/234: mkdir d3/da/df/d20/d36/d4f 0 2024-09-10T10:04:07.967 INFO:tasks.workunit.client.0.smithi071.stdout:9/130: symlink d0/db/l28 0 2024-09-10T10:04:07.967 INFO:tasks.workunit.client.1.smithi107.stdout:1/280: creat d2/d6/f52 x:0 0 0 2024-09-10T10:04:07.968 INFO:tasks.workunit.client.1.smithi107.stdout:5/136: dwrite f8 [0,4194304] 0 2024-09-10T10:04:07.969 INFO:tasks.workunit.client.0.smithi071.stdout:9/131: creat d0/db/f29 x:0 0 0 2024-09-10T10:04:07.969 INFO:tasks.workunit.client.1.smithi107.stdout:5/137: readlink de/l1d 0 2024-09-10T10:04:07.969 INFO:tasks.workunit.client.1.smithi107.stdout:1/281: truncate d2/f4e 110533 0 2024-09-10T10:04:07.970 INFO:tasks.workunit.client.1.smithi107.stdout:5/138: dread - de/f28 zero size 2024-09-10T10:04:07.970 INFO:tasks.workunit.client.1.smithi107.stdout:2/235: truncate d3/da/d1e/f24 1205233 0 2024-09-10T10:04:07.972 INFO:tasks.workunit.client.1.smithi107.stdout:1/282: unlink d2/f5 0 2024-09-10T10:04:07.975 INFO:tasks.workunit.client.1.smithi107.stdout:1/283: symlink d2/d6/d24/l53 0 2024-09-10T10:04:07.976 INFO:tasks.workunit.client.0.smithi071.stdout:9/132: dwrite d0/f6 [0,4194304] 0 2024-09-10T10:04:07.977 INFO:tasks.workunit.client.1.smithi107.stdout:5/139: rename c5 to de/c2a 0 2024-09-10T10:04:07.979 INFO:tasks.workunit.client.1.smithi107.stdout:4/168: sync 2024-09-10T10:04:07.980 INFO:tasks.workunit.client.1.smithi107.stdout:9/230: sync 2024-09-10T10:04:07.980 INFO:tasks.workunit.client.1.smithi107.stdout:3/220: sync 2024-09-10T10:04:07.980 INFO:tasks.workunit.client.1.smithi107.stdout:7/158: sync 2024-09-10T10:04:07.980 INFO:tasks.workunit.client.1.smithi107.stdout:8/101: sync 2024-09-10T10:04:07.980 INFO:tasks.workunit.client.1.smithi107.stdout:0/125: sync 2024-09-10T10:04:07.980 INFO:tasks.workunit.client.1.smithi107.stdout:6/170: sync 2024-09-10T10:04:07.980 INFO:tasks.workunit.client.0.smithi071.stdout:9/133: symlink d0/dc/d27/l2a 0 2024-09-10T10:04:07.981 INFO:tasks.workunit.client.0.smithi071.stdout:9/134: readlink d0/dc/l1e 0 2024-09-10T10:04:07.982 INFO:tasks.workunit.client.1.smithi107.stdout:1/284: rename d2/ff to d2/d6/d24/f54 0 2024-09-10T10:04:07.983 INFO:tasks.workunit.client.1.smithi107.stdout:2/236: link d3/da/df/d20/f33 d3/da/df/d20/d36/d4f/f50 0 2024-09-10T10:04:07.985 INFO:tasks.workunit.client.0.smithi071.stdout:9/135: creat d0/db/d20/f2b x:0 0 0 2024-09-10T10:04:07.986 INFO:tasks.workunit.client.1.smithi107.stdout:0/126: symlink d6/d18/l22 0 2024-09-10T10:04:07.989 INFO:tasks.workunit.client.1.smithi107.stdout:9/231: dread - d5/d7/d1d/d41/f54 zero size 2024-09-10T10:04:07.989 INFO:tasks.workunit.client.0.smithi071.stdout:9/136: dread d0/dc/f1a [0,4194304] 0 2024-09-10T10:04:07.990 INFO:tasks.workunit.client.1.smithi107.stdout:1/285: dread - d2/d35/f3b zero size 2024-09-10T10:04:07.991 INFO:tasks.workunit.client.1.smithi107.stdout:6/171: symlink d0/l39 0 2024-09-10T10:04:07.992 INFO:tasks.workunit.client.0.smithi071.stdout:9/137: creat d0/dc/d27/f2c x:0 0 0 2024-09-10T10:04:07.992 INFO:tasks.workunit.client.1.smithi107.stdout:8/102: creat d5/f26 x:0 0 0 2024-09-10T10:04:07.997 INFO:tasks.workunit.client.1.smithi107.stdout:7/159: creat d0/d8/dc/f2d x:0 0 0 2024-09-10T10:04:07.997 INFO:tasks.workunit.client.1.smithi107.stdout:1/286: fdatasync d2/d2a/f43 0 2024-09-10T10:04:07.998 INFO:tasks.workunit.client.1.smithi107.stdout:9/232: stat d5/d7/d1d/d29/l4b 0 2024-09-10T10:04:07.998 INFO:tasks.workunit.client.1.smithi107.stdout:7/160: fdatasync d0/d8/f13 0 2024-09-10T10:04:07.999 INFO:tasks.workunit.client.1.smithi107.stdout:6/172: readlink d0/df/d14/d17/d24/l30 0 2024-09-10T10:04:07.999 INFO:tasks.workunit.client.0.smithi071.stdout:9/138: dwrite d0/db/d1b/d1d/f1f [0,4194304] 0 2024-09-10T10:04:08.000 INFO:tasks.workunit.client.1.smithi107.stdout:4/169: write d0/d29/f39 [573105,52189] 0 2024-09-10T10:04:08.001 INFO:tasks.workunit.client.1.smithi107.stdout:5/140: dwrite de/d20/f26 [0,4194304] 0 2024-09-10T10:04:08.003 INFO:tasks.workunit.client.1.smithi107.stdout:8/103: dread - d5/d8/dc/f16 zero size 2024-09-10T10:04:08.004 INFO:tasks.workunit.client.0.smithi071.stdout:9/139: getdents d0/db/d1b 0 2024-09-10T10:04:08.004 INFO:tasks.workunit.client.1.smithi107.stdout:9/233: dread - d5/f55 zero size 2024-09-10T10:04:08.006 INFO:tasks.workunit.client.1.smithi107.stdout:0/127: truncate d6/f12 1129721 0 2024-09-10T10:04:08.006 INFO:tasks.workunit.client.1.smithi107.stdout:4/170: stat d0/d1f/d20/f2c 0 2024-09-10T10:04:08.007 INFO:tasks.workunit.client.1.smithi107.stdout:5/141: mkdir de/d20/d2b 0 2024-09-10T10:04:08.007 INFO:tasks.workunit.client.1.smithi107.stdout:3/221: dwrite dc/dd/d1e/f2d [0,4194304] 0 2024-09-10T10:04:08.007 INFO:tasks.workunit.client.1.smithi107.stdout:1/287: creat d2/d36/f55 x:0 0 0 2024-09-10T10:04:08.007 INFO:tasks.workunit.client.1.smithi107.stdout:6/173: dread d0/df/d14/f1f [0,4194304] 0 2024-09-10T10:04:08.008 INFO:tasks.workunit.client.1.smithi107.stdout:7/161: mknod d0/d1b/c2e 0 2024-09-10T10:04:08.010 INFO:tasks.workunit.client.1.smithi107.stdout:8/104: write d5/d8/f20 [43162,35054] 0 2024-09-10T10:04:08.012 INFO:tasks.workunit.client.1.smithi107.stdout:9/234: creat d5/d7/d3c/d53/f5d x:0 0 0 2024-09-10T10:04:08.013 INFO:tasks.workunit.client.1.smithi107.stdout:1/288: write d2/d6/d24/f4f [1545497,102025] 0 2024-09-10T10:04:08.013 INFO:tasks.workunit.client.1.smithi107.stdout:7/162: rmdir d0/d8/dc 39 2024-09-10T10:04:08.014 INFO:tasks.workunit.client.0.smithi071.stdout:9/140: dwrite d0/dc/d27/f2c [0,4194304] 0 2024-09-10T10:04:08.015 INFO:tasks.workunit.client.1.smithi107.stdout:8/105: truncate d5/d8/fe 4813490 0 2024-09-10T10:04:08.015 INFO:tasks.workunit.client.1.smithi107.stdout:1/289: readlink d2/d6/l1d 0 2024-09-10T10:04:08.015 INFO:tasks.workunit.client.1.smithi107.stdout:9/235: stat d5/d7/d1d/d29/l4b 0 2024-09-10T10:04:08.017 INFO:tasks.workunit.client.1.smithi107.stdout:0/128: dread d6/f7 [0,4194304] 0 2024-09-10T10:04:08.018 INFO:tasks.workunit.client.1.smithi107.stdout:3/222: getdents dc/dd/d1e/d35 0 2024-09-10T10:04:08.019 INFO:tasks.workunit.client.1.smithi107.stdout:1/290: fdatasync d2/f21 0 2024-09-10T10:04:08.019 INFO:tasks.workunit.client.1.smithi107.stdout:5/142: getdents de/d20/d2b 0 2024-09-10T10:04:08.021 INFO:tasks.workunit.client.0.smithi071.stdout:9/141: getdents d0/db/d20 0 2024-09-10T10:04:08.022 INFO:tasks.workunit.client.1.smithi107.stdout:7/163: rename d0/d8/d9/f1c to d0/f2f 0 2024-09-10T10:04:08.024 INFO:tasks.workunit.client.1.smithi107.stdout:3/223: mknod dc/c43 0 2024-09-10T10:04:08.026 INFO:tasks.workunit.client.1.smithi107.stdout:2/237: dread f0 [4194304,4194304] 0 2024-09-10T10:04:08.028 INFO:tasks.workunit.client.1.smithi107.stdout:9/236: chown d5/d1e/f1f 929814 1 2024-09-10T10:04:08.032 INFO:tasks.workunit.client.1.smithi107.stdout:6/174: dwrite d0/df/d14/d17/f1a [0,4194304] 0 2024-09-10T10:04:08.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:07 smithi071 ceph-mon[27559]: pgmap v254: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 19 MiB/s wr, 378 op/s 2024-09-10T10:04:08.039 INFO:tasks.workunit.client.1.smithi107.stdout:8/106: symlink d5/d8/dc/d18/l27 0 2024-09-10T10:04:08.040 INFO:tasks.workunit.client.1.smithi107.stdout:4/171: write d0/f12 [1062295,99575] 0 2024-09-10T10:04:08.041 INFO:tasks.workunit.client.0.smithi071.stdout:9/142: write d0/dc/f12 [1581212,45255] 0 2024-09-10T10:04:08.045 INFO:tasks.workunit.client.1.smithi107.stdout:5/143: rename f6 to de/d20/f2c 0 2024-09-10T10:04:08.046 INFO:tasks.workunit.client.0.smithi071.stdout:9/143: creat d0/dc/f2d x:0 0 0 2024-09-10T10:04:08.050 INFO:tasks.workunit.client.1.smithi107.stdout:1/291: truncate d2/d12/f1e 351245 0 2024-09-10T10:04:08.050 INFO:tasks.workunit.client.1.smithi107.stdout:6/175: mknod d0/df/d14/d17/d24/c3a 0 2024-09-10T10:04:08.051 INFO:tasks.workunit.client.1.smithi107.stdout:0/129: write d6/fa [746801,23149] 0 2024-09-10T10:04:08.051 INFO:tasks.workunit.client.1.smithi107.stdout:9/237: dread - d5/d7/d1d/f47 zero size 2024-09-10T10:04:08.052 INFO:tasks.workunit.client.1.smithi107.stdout:9/238: chown d5/f5c 28351832 1 2024-09-10T10:04:08.053 INFO:tasks.workunit.client.1.smithi107.stdout:8/107: mknod d5/d8/dc/d18/c28 0 2024-09-10T10:04:08.053 INFO:tasks.workunit.client.1.smithi107.stdout:9/239: chown d5/d7/f9 30 1 2024-09-10T10:04:08.054 INFO:tasks.workunit.client.1.smithi107.stdout:8/108: dread - d5/d8/dc/d21/f25 zero size 2024-09-10T10:04:08.054 INFO:tasks.workunit.client.1.smithi107.stdout:5/144: creat de/f2d x:0 0 0 2024-09-10T10:04:08.056 INFO:tasks.workunit.client.1.smithi107.stdout:7/164: dread d0/f7 [0,4194304] 0 2024-09-10T10:04:08.057 INFO:tasks.workunit.client.1.smithi107.stdout:7/165: chown d0/f27 228 1 2024-09-10T10:04:08.058 INFO:tasks.workunit.client.1.smithi107.stdout:4/172: creat d0/d40/f41 x:0 0 0 2024-09-10T10:04:08.058 INFO:tasks.workunit.client.0.smithi071.stdout:9/144: getdents d0/dc 0 2024-09-10T10:04:08.059 INFO:tasks.workunit.client.1.smithi107.stdout:1/292: creat d2/d6/d24/f56 x:0 0 0 2024-09-10T10:04:08.060 INFO:tasks.workunit.client.1.smithi107.stdout:3/224: rmdir dc/dd/d25/d3d 0 2024-09-10T10:04:08.062 INFO:tasks.workunit.client.1.smithi107.stdout:9/240: fsync d5/d7/d1d/d3b/f4a 0 2024-09-10T10:04:08.063 INFO:tasks.workunit.client.1.smithi107.stdout:3/225: read dc/dd/d1e/d35/f19 [4527511,121067] 0 2024-09-10T10:04:08.063 INFO:tasks.workunit.client.1.smithi107.stdout:8/109: write d5/fb [3137065,23816] 0 2024-09-10T10:04:08.066 INFO:tasks.workunit.client.1.smithi107.stdout:0/130: rename f2 to d6/f23 0 2024-09-10T10:04:08.066 INFO:tasks.workunit.client.1.smithi107.stdout:4/173: dwrite d0/d1f/d20/f2c [0,4194304] 0 2024-09-10T10:04:08.066 INFO:tasks.workunit.client.0.smithi071.stdout:9/145: dwrite d0/db/f15 [4194304,4194304] 0 2024-09-10T10:04:08.067 INFO:tasks.workunit.client.0.smithi071.stdout:9/146: chown d0/dc/f2d 5197 1 2024-09-10T10:04:08.068 INFO:tasks.workunit.client.1.smithi107.stdout:0/131: write d6/f1d [151761,57497] 0 2024-09-10T10:04:08.068 INFO:tasks.workunit.client.0.smithi071.stdout:9/147: readlink d0/dc/d27/l2a 0 2024-09-10T10:04:08.069 INFO:tasks.workunit.client.1.smithi107.stdout:7/166: chown d0/d8/dc/d2c 15929792 1 2024-09-10T10:04:08.069 INFO:tasks.workunit.client.1.smithi107.stdout:4/174: write d0/f11 [1077964,80855] 0 2024-09-10T10:04:08.070 INFO:tasks.workunit.client.1.smithi107.stdout:7/167: chown d0/d8/f11 6 1 2024-09-10T10:04:08.070 INFO:tasks.workunit.client.1.smithi107.stdout:7/168: stat d0/d1b 0 2024-09-10T10:04:08.076 INFO:tasks.workunit.client.1.smithi107.stdout:8/110: mkdir d5/d8/dc/d21/d29 0 2024-09-10T10:04:08.076 INFO:tasks.workunit.client.1.smithi107.stdout:9/241: fsync d5/f31 0 2024-09-10T10:04:08.077 INFO:tasks.workunit.client.1.smithi107.stdout:2/238: write d3/f31 [1298994,93851] 0 2024-09-10T10:04:08.079 INFO:tasks.workunit.client.1.smithi107.stdout:3/226: rename dc/dd/d1e to dc/dd/d25/d26/d41/d44 0 2024-09-10T10:04:08.080 INFO:tasks.workunit.client.1.smithi107.stdout:7/169: dwrite d0/f2b [0,4194304] 0 2024-09-10T10:04:08.080 INFO:tasks.workunit.client.1.smithi107.stdout:2/239: write d3/da/d1e/d22/f34 [591119,98480] 0 2024-09-10T10:04:08.083 INFO:tasks.workunit.client.1.smithi107.stdout:7/170: write d0/fb [1421883,92026] 0 2024-09-10T10:04:08.083 INFO:tasks.workunit.client.1.smithi107.stdout:4/175: mknod d0/d40/c42 0 2024-09-10T10:04:08.084 INFO:tasks.workunit.client.1.smithi107.stdout:5/145: rmdir de 39 2024-09-10T10:04:08.142 INFO:tasks.workunit.client.1.smithi107.stdout:4/176: chown d0/d29/f39 55 1 2024-09-10T10:04:08.143 INFO:tasks.workunit.client.1.smithi107.stdout:6/176: getdents d0/df/d14/d21 0 2024-09-10T10:04:08.143 INFO:tasks.workunit.client.1.smithi107.stdout:9/242: chown d5/d7/d1d/d25/d50 524 1 2024-09-10T10:04:08.143 INFO:tasks.workunit.client.1.smithi107.stdout:7/171: creat d0/d8/d9/f30 x:0 0 0 2024-09-10T10:04:08.145 INFO:tasks.workunit.client.1.smithi107.stdout:8/111: dwrite d5/d8/f24 [0,4194304] 0 2024-09-10T10:04:08.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:07 smithi107 ceph-mon[34215]: pgmap v254: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 19 MiB/s wr, 378 op/s 2024-09-10T10:04:08.148 INFO:tasks.workunit.client.1.smithi107.stdout:0/132: truncate d6/f12 546591 0 2024-09-10T10:04:08.148 INFO:tasks.workunit.client.1.smithi107.stdout:4/177: mknod d0/c43 0 2024-09-10T10:04:08.149 INFO:tasks.workunit.client.1.smithi107.stdout:5/146: mknod de/c2e 0 2024-09-10T10:04:08.150 INFO:tasks.workunit.client.1.smithi107.stdout:6/177: creat d0/df/d14/d17/f3b x:0 0 0 2024-09-10T10:04:08.151 INFO:tasks.workunit.client.1.smithi107.stdout:8/112: mkdir d5/d8/d2a 0 2024-09-10T10:04:08.153 INFO:tasks.workunit.client.1.smithi107.stdout:4/178: creat d0/d29/f44 x:0 0 0 2024-09-10T10:04:08.153 INFO:tasks.workunit.client.1.smithi107.stdout:1/293: dwrite d2/d12/f3e [0,4194304] 0 2024-09-10T10:04:08.156 INFO:tasks.workunit.client.1.smithi107.stdout:6/178: stat d0/df/l2e 0 2024-09-10T10:04:08.156 INFO:tasks.workunit.client.1.smithi107.stdout:7/172: rename d0/d8/dc/f1a to d0/d8/f31 0 2024-09-10T10:04:08.160 INFO:tasks.workunit.client.1.smithi107.stdout:4/179: chown d0/d1f/d20/l3a 504355863 1 2024-09-10T10:04:08.160 INFO:tasks.workunit.client.1.smithi107.stdout:1/294: chown d2/d12/f31 2 1 2024-09-10T10:04:08.161 INFO:tasks.workunit.client.1.smithi107.stdout:7/173: chown d0/f2f 512653582 1 2024-09-10T10:04:08.164 INFO:tasks.workunit.client.1.smithi107.stdout:0/133: dread f4 [0,4194304] 0 2024-09-10T10:04:08.166 INFO:tasks.workunit.client.1.smithi107.stdout:1/295: creat d2/d35/f57 x:0 0 0 2024-09-10T10:04:08.166 INFO:tasks.workunit.client.1.smithi107.stdout:6/179: write d0/df/d14/f1f [6906,114379] 0 2024-09-10T10:04:08.166 INFO:tasks.workunit.client.1.smithi107.stdout:2/240: dwrite d3/f1f [0,4194304] 0 2024-09-10T10:04:08.169 INFO:tasks.workunit.client.1.smithi107.stdout:7/174: chown d0/d8/dc/f26 4690 1 2024-09-10T10:04:08.171 INFO:tasks.workunit.client.1.smithi107.stdout:0/134: chown d6/d14/c16 20348974 1 2024-09-10T10:04:08.172 INFO:tasks.workunit.client.1.smithi107.stdout:5/147: dwrite fc [0,4194304] 0 2024-09-10T10:04:08.172 INFO:tasks.workunit.client.1.smithi107.stdout:0/135: readlink l5 0 2024-09-10T10:04:08.174 INFO:tasks.workunit.client.1.smithi107.stdout:6/180: mknod d0/df/d14/d17/c3c 0 2024-09-10T10:04:08.175 INFO:tasks.workunit.client.1.smithi107.stdout:8/113: dwrite d5/ff [0,4194304] 0 2024-09-10T10:04:08.181 INFO:tasks.workunit.client.1.smithi107.stdout:2/241: rename d3/d8 to d3/d21/d41/d51 0 2024-09-10T10:04:08.181 INFO:tasks.workunit.client.1.smithi107.stdout:0/136: rename d6/d14 to d6/d14/d24 22 2024-09-10T10:04:08.181 INFO:tasks.workunit.client.1.smithi107.stdout:5/148: read de/f1b [2275,5200] 0 2024-09-10T10:04:08.183 INFO:tasks.workunit.client.1.smithi107.stdout:7/175: creat d0/d8/f32 x:0 0 0 2024-09-10T10:04:08.185 INFO:tasks.workunit.client.1.smithi107.stdout:4/180: link d0/d1f/d20/l2d d0/d1f/d20/l45 0 2024-09-10T10:04:08.188 INFO:tasks.workunit.client.1.smithi107.stdout:7/176: chown d0/f4 11848129 1 2024-09-10T10:04:08.188 INFO:tasks.workunit.client.1.smithi107.stdout:4/181: readlink d0/d29/l35 0 2024-09-10T10:04:08.189 INFO:tasks.workunit.client.1.smithi107.stdout:5/149: rename de/c15 to de/c2f 0 2024-09-10T10:04:08.189 INFO:tasks.workunit.client.1.smithi107.stdout:1/296: write d2/d2a/f2e [561627,117127] 0 2024-09-10T10:04:08.190 INFO:tasks.workunit.client.1.smithi107.stdout:7/177: fsync d0/d8/f11 0 2024-09-10T10:04:08.192 INFO:tasks.workunit.client.1.smithi107.stdout:8/114: rename d5/d8/dc/d18/c28 to d5/c2b 0 2024-09-10T10:04:08.192 INFO:tasks.workunit.client.1.smithi107.stdout:5/150: chown de/f28 39150 1 2024-09-10T10:04:08.193 INFO:tasks.workunit.client.1.smithi107.stdout:4/182: creat d0/d29/f46 x:0 0 0 2024-09-10T10:04:08.193 INFO:tasks.workunit.client.1.smithi107.stdout:6/181: getdents d0/df/d14/d17 0 2024-09-10T10:04:08.194 INFO:tasks.workunit.client.1.smithi107.stdout:0/137: dwrite d6/d18/f21 [0,4194304] 0 2024-09-10T10:04:08.194 INFO:tasks.workunit.client.1.smithi107.stdout:5/151: fdatasync de/f1e 0 2024-09-10T10:04:08.196 INFO:tasks.workunit.client.1.smithi107.stdout:7/178: write d0/d8/f18 [1452938,19111] 0 2024-09-10T10:04:08.198 INFO:tasks.workunit.client.1.smithi107.stdout:4/183: mkdir d0/d1f/d20/d47 0 2024-09-10T10:04:08.200 INFO:tasks.workunit.client.1.smithi107.stdout:8/115: symlink d5/d8/d2a/l2c 0 2024-09-10T10:04:08.200 INFO:tasks.workunit.client.1.smithi107.stdout:7/179: mknod d0/c33 0 2024-09-10T10:04:08.203 INFO:tasks.workunit.client.1.smithi107.stdout:4/184: mknod d0/c48 0 2024-09-10T10:04:08.204 INFO:tasks.workunit.client.1.smithi107.stdout:1/297: dread d2/d2a/f43 [0,4194304] 0 2024-09-10T10:04:08.205 INFO:tasks.workunit.client.1.smithi107.stdout:4/185: readlink d0/l22 0 2024-09-10T10:04:08.207 INFO:tasks.workunit.client.1.smithi107.stdout:8/116: symlink d5/l2d 0 2024-09-10T10:04:08.207 INFO:tasks.workunit.client.1.smithi107.stdout:4/186: readlink d0/lf 0 2024-09-10T10:04:08.208 INFO:tasks.workunit.client.1.smithi107.stdout:7/180: symlink d0/d8/d9/l34 0 2024-09-10T10:04:08.211 INFO:tasks.workunit.client.1.smithi107.stdout:7/181: readlink d0/d20/l23 0 2024-09-10T10:04:08.212 INFO:tasks.workunit.client.1.smithi107.stdout:5/152: dread de/d20/f27 [0,4194304] 0 2024-09-10T10:04:08.212 INFO:tasks.workunit.client.1.smithi107.stdout:0/138: dwrite d6/f1d [0,4194304] 0 2024-09-10T10:04:08.213 INFO:tasks.workunit.client.1.smithi107.stdout:6/182: dwrite d0/df/f2b [4194304,4194304] 0 2024-09-10T10:04:08.218 INFO:tasks.workunit.client.1.smithi107.stdout:7/182: mkdir d0/d20/d35 0 2024-09-10T10:04:08.219 INFO:tasks.workunit.client.1.smithi107.stdout:6/183: fsync d0/df/d14/d21/f23 0 2024-09-10T10:04:08.219 INFO:tasks.workunit.client.1.smithi107.stdout:2/242: dwrite d3/da/f17 [0,4194304] 0 2024-09-10T10:04:08.224 INFO:tasks.workunit.client.1.smithi107.stdout:2/243: write d3/da/f17 [5203454,123284] 0 2024-09-10T10:04:08.225 INFO:tasks.workunit.client.1.smithi107.stdout:8/117: dwrite d5/ff [0,4194304] 0 2024-09-10T10:04:08.225 INFO:tasks.workunit.client.1.smithi107.stdout:7/183: unlink d0/c33 0 2024-09-10T10:04:08.229 INFO:tasks.workunit.client.1.smithi107.stdout:0/139: dread d6/f1d [0,4194304] 0 2024-09-10T10:04:08.229 INFO:tasks.workunit.client.1.smithi107.stdout:8/118: fdatasync d5/d8/dc/f16 0 2024-09-10T10:04:08.229 INFO:tasks.workunit.client.1.smithi107.stdout:0/140: chown l5 1536 1 2024-09-10T10:04:08.229 INFO:tasks.workunit.client.1.smithi107.stdout:7/184: fsync d0/d8/f11 0 2024-09-10T10:04:08.229 INFO:tasks.workunit.client.1.smithi107.stdout:2/244: fdatasync d3/d21/f32 0 2024-09-10T10:04:08.232 INFO:tasks.workunit.client.1.smithi107.stdout:8/119: dread - d5/d8/dc/d1a/f1f zero size 2024-09-10T10:04:08.232 INFO:tasks.workunit.client.1.smithi107.stdout:0/141: rmdir d6/d8 39 2024-09-10T10:04:08.236 INFO:tasks.workunit.client.1.smithi107.stdout:4/187: truncate d0/d1f/d20/d2f/f33 1375177 0 2024-09-10T10:04:08.236 INFO:tasks.workunit.client.1.smithi107.stdout:0/142: fdatasync d6/d18/f21 0 2024-09-10T10:04:08.236 INFO:tasks.workunit.client.1.smithi107.stdout:5/153: dwrite de/d20/f27 [0,4194304] 0 2024-09-10T10:04:08.236 INFO:tasks.workunit.client.1.smithi107.stdout:7/185: write d0/d8/dc/f2a [385101,30017] 0 2024-09-10T10:04:08.238 INFO:tasks.workunit.client.1.smithi107.stdout:6/184: truncate d0/f2a 3874720 0 2024-09-10T10:04:08.239 INFO:tasks.workunit.client.1.smithi107.stdout:4/188: mknod d0/c49 0 2024-09-10T10:04:08.240 INFO:tasks.workunit.client.1.smithi107.stdout:2/245: dread d3/d21/f32 [0,4194304] 0 2024-09-10T10:04:08.241 INFO:tasks.workunit.client.1.smithi107.stdout:4/189: readlink d0/l22 0 2024-09-10T10:04:08.241 INFO:tasks.workunit.client.1.smithi107.stdout:0/143: unlink d6/d14/c16 0 2024-09-10T10:04:08.242 INFO:tasks.workunit.client.1.smithi107.stdout:7/186: creat d0/f36 x:0 0 0 2024-09-10T10:04:08.243 INFO:tasks.workunit.client.1.smithi107.stdout:0/144: chown d6/fa 14 1 2024-09-10T10:04:08.247 INFO:tasks.workunit.client.1.smithi107.stdout:8/120: getdents d5/d8/dc/d21 0 2024-09-10T10:04:08.250 INFO:tasks.workunit.client.1.smithi107.stdout:5/154: getdents de/d20 0 2024-09-10T10:04:08.250 INFO:tasks.workunit.client.1.smithi107.stdout:6/185: rename d0/df to d0/d3d 0 2024-09-10T10:04:08.251 INFO:tasks.workunit.client.1.smithi107.stdout:0/145: dread d6/fa [0,4194304] 0 2024-09-10T10:04:08.253 INFO:tasks.workunit.client.1.smithi107.stdout:5/155: rename de to de/d20/d30 22 2024-09-10T10:04:08.254 INFO:tasks.workunit.client.1.smithi107.stdout:6/186: write d0/f13 [1009715,7084] 0 2024-09-10T10:04:08.258 INFO:tasks.workunit.client.1.smithi107.stdout:7/187: dwrite d0/f2b [0,4194304] 0 2024-09-10T10:04:08.258 INFO:tasks.workunit.client.1.smithi107.stdout:8/121: unlink d5/d8/dc/d1a/l1b 0 2024-09-10T10:04:08.259 INFO:tasks.workunit.client.1.smithi107.stdout:6/187: rmdir d0/d3d/d14 39 2024-09-10T10:04:08.261 INFO:tasks.workunit.client.1.smithi107.stdout:8/122: truncate d5/f19 465660 0 2024-09-10T10:04:08.261 INFO:tasks.workunit.client.1.smithi107.stdout:5/156: creat de/f31 x:0 0 0 2024-09-10T10:04:08.263 INFO:tasks.workunit.client.1.smithi107.stdout:2/246: dread d3/da/df/d20/d36/d4f/f50 [0,4194304] 0 2024-09-10T10:04:08.264 INFO:tasks.workunit.client.1.smithi107.stdout:8/123: symlink d5/d8/dc/d18/l2e 0 2024-09-10T10:04:08.266 INFO:tasks.workunit.client.1.smithi107.stdout:2/247: chown d3/d21/f47 11109855 1 2024-09-10T10:04:08.268 INFO:tasks.workunit.client.1.smithi107.stdout:7/188: link d0/d8/f32 d0/d20/f37 0 2024-09-10T10:04:08.269 INFO:tasks.workunit.client.1.smithi107.stdout:4/190: truncate d0/d1f/d20/d2f/f33 948265 0 2024-09-10T10:04:08.272 INFO:tasks.workunit.client.1.smithi107.stdout:6/188: dwrite d0/d3d/f31 [0,4194304] 0 2024-09-10T10:04:08.274 INFO:tasks.workunit.client.1.smithi107.stdout:0/146: write d6/d8/f9 [1354782,30752] 0 2024-09-10T10:04:08.274 INFO:tasks.workunit.client.1.smithi107.stdout:4/191: mkdir d0/d4a 0 2024-09-10T10:04:08.276 INFO:tasks.workunit.client.1.smithi107.stdout:5/157: dwrite de/f25 [0,4194304] 0 2024-09-10T10:04:08.281 INFO:tasks.workunit.client.1.smithi107.stdout:5/158: write de/f1f [816308,47671] 0 2024-09-10T10:04:08.281 INFO:tasks.workunit.client.1.smithi107.stdout:4/192: chown d0/f10 848 1 2024-09-10T10:04:08.281 INFO:tasks.workunit.client.1.smithi107.stdout:5/159: readlink de/l1d 0 2024-09-10T10:04:08.282 INFO:tasks.workunit.client.1.smithi107.stdout:6/189: readlink d0/d3d/d14/l32 0 2024-09-10T10:04:08.283 INFO:tasks.workunit.client.1.smithi107.stdout:0/147: creat d6/d14/f25 x:0 0 0 2024-09-10T10:04:08.284 INFO:tasks.workunit.client.1.smithi107.stdout:8/124: truncate d5/ff 1441241 0 2024-09-10T10:04:08.284 INFO:tasks.workunit.client.1.smithi107.stdout:7/189: creat d0/d8/f38 x:0 0 0 2024-09-10T10:04:08.285 INFO:tasks.workunit.client.1.smithi107.stdout:2/248: write d3/f3c [3106241,4157] 0 2024-09-10T10:04:08.289 INFO:tasks.workunit.client.1.smithi107.stdout:4/193: dwrite d0/f1d [0,4194304] 0 2024-09-10T10:04:08.292 INFO:tasks.workunit.client.1.smithi107.stdout:5/160: getdents de/d20 0 2024-09-10T10:04:08.294 INFO:tasks.workunit.client.1.smithi107.stdout:2/249: mknod d3/da/c52 0 2024-09-10T10:04:08.296 INFO:tasks.workunit.client.1.smithi107.stdout:5/161: symlink de/d20/l32 0 2024-09-10T10:04:08.297 INFO:tasks.workunit.client.1.smithi107.stdout:6/190: creat d0/f3e x:0 0 0 2024-09-10T10:04:08.297 INFO:tasks.workunit.client.1.smithi107.stdout:7/190: link d0/ca d0/d20/c39 0 2024-09-10T10:04:08.300 INFO:tasks.workunit.client.1.smithi107.stdout:2/250: write d3/da/df/d20/f46 [2128698,5430] 0 2024-09-10T10:04:08.300 INFO:tasks.workunit.client.1.smithi107.stdout:4/194: creat d0/d29/d3f/f4b x:0 0 0 2024-09-10T10:04:08.300 INFO:tasks.workunit.client.1.smithi107.stdout:0/148: dread d6/f12 [0,4194304] 0 2024-09-10T10:04:08.301 INFO:tasks.workunit.client.1.smithi107.stdout:8/125: truncate d5/d8/f9 3385719 0 2024-09-10T10:04:08.302 INFO:tasks.workunit.client.1.smithi107.stdout:7/191: write d0/d8/f38 [845865,23473] 0 2024-09-10T10:04:08.303 INFO:tasks.workunit.client.1.smithi107.stdout:4/195: readlink d0/d29/l35 0 2024-09-10T10:04:08.303 INFO:tasks.workunit.client.1.smithi107.stdout:6/191: chown d0/d3d/d14/d21/f22 22 1 2024-09-10T10:04:08.304 INFO:tasks.workunit.client.1.smithi107.stdout:2/251: dread - d3/d21/d41/d51/f25 zero size 2024-09-10T10:04:08.305 INFO:tasks.workunit.client.1.smithi107.stdout:0/149: mknod d6/c26 0 2024-09-10T10:04:08.307 INFO:tasks.workunit.client.1.smithi107.stdout:8/126: creat d5/f2f x:0 0 0 2024-09-10T10:04:08.308 INFO:tasks.workunit.client.1.smithi107.stdout:2/252: dread - d3/f49 zero size 2024-09-10T10:04:08.308 INFO:tasks.workunit.client.1.smithi107.stdout:7/192: creat d0/d20/f3a x:0 0 0 2024-09-10T10:04:08.310 INFO:tasks.workunit.client.1.smithi107.stdout:6/192: mknod d0/d3d/d14/d17/d24/c3f 0 2024-09-10T10:04:08.310 INFO:tasks.workunit.client.1.smithi107.stdout:0/150: stat d6/f23 0 2024-09-10T10:04:08.311 INFO:tasks.workunit.client.1.smithi107.stdout:7/193: dread - d0/f36 zero size 2024-09-10T10:04:08.315 INFO:tasks.workunit.client.1.smithi107.stdout:5/162: dwrite de/d20/f29 [0,4194304] 0 2024-09-10T10:04:08.316 INFO:tasks.workunit.client.1.smithi107.stdout:8/127: chown d5/d8/dc/c22 37211449 1 2024-09-10T10:04:08.316 INFO:tasks.workunit.client.1.smithi107.stdout:4/196: dread d0/f1d [0,4194304] 0 2024-09-10T10:04:08.317 INFO:tasks.workunit.client.1.smithi107.stdout:2/253: write d3/da/d1e/d22/f34 [680876,11919] 0 2024-09-10T10:04:08.319 INFO:tasks.workunit.client.1.smithi107.stdout:8/128: readlink d5/d8/dc/d18/l2e 0 2024-09-10T10:04:08.321 INFO:tasks.workunit.client.1.smithi107.stdout:2/254: write d3/d21/f32 [1197613,16550] 0 2024-09-10T10:04:08.321 INFO:tasks.workunit.client.1.smithi107.stdout:4/197: creat d0/d1f/d20/f4c x:0 0 0 2024-09-10T10:04:08.321 INFO:tasks.workunit.client.1.smithi107.stdout:5/163: mknod de/d20/d2b/c33 0 2024-09-10T10:04:08.325 INFO:tasks.workunit.client.1.smithi107.stdout:5/164: chown de/c14 6308002 1 2024-09-10T10:04:08.328 INFO:tasks.workunit.client.1.smithi107.stdout:8/129: truncate d5/d8/dc/d21/f25 672575 0 2024-09-10T10:04:08.330 INFO:tasks.workunit.client.1.smithi107.stdout:8/130: chown d5/d8/dc/c22 119942 1 2024-09-10T10:04:08.330 INFO:tasks.workunit.client.1.smithi107.stdout:2/255: fdatasync d3/da/df/f15 0 2024-09-10T10:04:08.332 INFO:tasks.workunit.client.1.smithi107.stdout:0/151: dwrite d6/d18/f1b [0,4194304] 0 2024-09-10T10:04:08.332 INFO:tasks.workunit.client.1.smithi107.stdout:7/194: dwrite d0/f1e [0,4194304] 0 2024-09-10T10:04:08.333 INFO:tasks.workunit.client.1.smithi107.stdout:2/256: read d3/f1f [860026,38119] 0 2024-09-10T10:04:08.334 INFO:tasks.workunit.client.1.smithi107.stdout:7/195: chown d0/f36 1746552 1 2024-09-10T10:04:08.335 INFO:tasks.workunit.client.1.smithi107.stdout:7/196: dread - d0/d8/f32 zero size 2024-09-10T10:04:08.338 INFO:tasks.workunit.client.1.smithi107.stdout:2/257: truncate d3/da/d1e/f3f 767869 0 2024-09-10T10:04:08.342 INFO:tasks.workunit.client.1.smithi107.stdout:5/165: rename de/d20/c23 to de/d20/d2b/c34 0 2024-09-10T10:04:08.345 INFO:tasks.workunit.client.1.smithi107.stdout:5/166: write de/f25 [3066054,120389] 0 2024-09-10T10:04:08.347 INFO:tasks.workunit.client.1.smithi107.stdout:7/197: creat d0/d8/dc/d2c/f3b x:0 0 0 2024-09-10T10:04:08.349 INFO:tasks.workunit.client.1.smithi107.stdout:8/131: rename d5/d8/dc/d21/f25 to d5/d8/f30 0 2024-09-10T10:04:08.349 INFO:tasks.workunit.client.1.smithi107.stdout:0/152: dwrite d6/d8/f15 [0,4194304] 0 2024-09-10T10:04:08.352 INFO:tasks.workunit.client.1.smithi107.stdout:2/258: link d3/d21/f32 d3/da/df/d20/d4a/f53 0 2024-09-10T10:04:08.352 INFO:tasks.workunit.client.1.smithi107.stdout:5/167: truncate de/f28 208120 0 2024-09-10T10:04:08.353 INFO:tasks.workunit.client.1.smithi107.stdout:2/259: dread - d3/f49 zero size 2024-09-10T10:04:08.353 INFO:tasks.workunit.client.1.smithi107.stdout:0/153: write d6/d8/f9 [7344480,59205] 0 2024-09-10T10:04:08.355 INFO:tasks.workunit.client.1.smithi107.stdout:5/168: write de/d20/f26 [1737969,86659] 0 2024-09-10T10:04:08.356 INFO:tasks.workunit.client.1.smithi107.stdout:2/260: chown d3/da/d1e/d22 5795929 1 2024-09-10T10:04:08.360 INFO:tasks.workunit.client.1.smithi107.stdout:2/261: mkdir d3/da/d1e/d22/d54 0 2024-09-10T10:04:08.365 INFO:tasks.workunit.client.1.smithi107.stdout:2/262: write d3/da/f1d [4654423,90952] 0 2024-09-10T10:04:08.365 INFO:tasks.workunit.client.1.smithi107.stdout:4/198: dread d0/f4 [4194304,4194304] 0 2024-09-10T10:04:08.365 INFO:tasks.workunit.client.1.smithi107.stdout:5/169: link de/c2f de/c35 0 2024-09-10T10:04:08.367 INFO:tasks.workunit.client.1.smithi107.stdout:0/154: dwrite d6/f10 [0,4194304] 0 2024-09-10T10:04:08.367 INFO:tasks.workunit.client.1.smithi107.stdout:2/263: fdatasync d3/f3c 0 2024-09-10T10:04:08.368 INFO:tasks.workunit.client.1.smithi107.stdout:0/155: chown d6/c1a 1434 1 2024-09-10T10:04:08.369 INFO:tasks.workunit.client.1.smithi107.stdout:2/264: chown d3/f31 6948 1 2024-09-10T10:04:08.369 INFO:tasks.workunit.client.1.smithi107.stdout:7/198: write d0/f2f [247713,84690] 0 2024-09-10T10:04:08.369 INFO:tasks.workunit.client.1.smithi107.stdout:8/132: write d5/d8/fd [2102556,77221] 0 2024-09-10T10:04:08.369 INFO:tasks.workunit.client.1.smithi107.stdout:4/199: symlink d0/d29/l4d 0 2024-09-10T10:04:08.371 INFO:tasks.workunit.client.1.smithi107.stdout:4/200: write d0/f10 [4923182,76294] 0 2024-09-10T10:04:08.372 INFO:tasks.workunit.client.1.smithi107.stdout:0/156: creat d6/d8/f27 x:0 0 0 2024-09-10T10:04:08.373 INFO:tasks.workunit.client.1.smithi107.stdout:7/199: symlink d0/d1b/l3c 0 2024-09-10T10:04:08.374 INFO:tasks.workunit.client.1.smithi107.stdout:2/265: mkdir d3/d21/d41/d55 0 2024-09-10T10:04:08.375 INFO:tasks.workunit.client.1.smithi107.stdout:8/133: symlink d5/d8/dc/d1a/l31 0 2024-09-10T10:04:08.376 INFO:tasks.workunit.client.1.smithi107.stdout:4/201: symlink d0/d29/l4e 0 2024-09-10T10:04:08.376 INFO:tasks.workunit.client.1.smithi107.stdout:5/170: link c7 de/c36 0 2024-09-10T10:04:08.377 INFO:tasks.workunit.client.1.smithi107.stdout:7/200: mkdir d0/d8/d9/d3d 0 2024-09-10T10:04:08.378 INFO:tasks.workunit.client.1.smithi107.stdout:2/266: unlink d3/da/f1d 0 2024-09-10T10:04:08.378 INFO:tasks.workunit.client.1.smithi107.stdout:8/134: readlink d5/d8/d2a/l2c 0 2024-09-10T10:04:08.378 INFO:tasks.workunit.client.1.smithi107.stdout:4/202: stat d0/d1f/d20/d2f/f3e 0 2024-09-10T10:04:08.378 INFO:tasks.workunit.client.1.smithi107.stdout:0/157: dread d6/d18/f21 [0,4194304] 0 2024-09-10T10:04:08.379 INFO:tasks.workunit.client.1.smithi107.stdout:7/201: dread - d0/d8/d9/f30 zero size 2024-09-10T10:04:08.380 INFO:tasks.workunit.client.1.smithi107.stdout:4/203: mkdir d0/d1f/d20/d2f/d4f 0 2024-09-10T10:04:08.381 INFO:tasks.workunit.client.1.smithi107.stdout:5/171: link de/d20/f2c de/d20/f37 0 2024-09-10T10:04:08.382 INFO:tasks.workunit.client.1.smithi107.stdout:8/135: rename d5/d8/f30 to d5/d8/f32 0 2024-09-10T10:04:08.383 INFO:tasks.workunit.client.1.smithi107.stdout:8/136: write d5/fb [883750,17400] 0 2024-09-10T10:04:08.384 INFO:tasks.workunit.client.1.smithi107.stdout:0/158: dread f4 [0,4194304] 0 2024-09-10T10:04:08.384 INFO:tasks.workunit.client.1.smithi107.stdout:2/267: symlink d3/da/df/d20/d36/d4f/l56 0 2024-09-10T10:04:08.384 INFO:tasks.workunit.client.1.smithi107.stdout:7/202: symlink d0/d20/d35/l3e 0 2024-09-10T10:04:08.387 INFO:tasks.workunit.client.1.smithi107.stdout:0/159: write d6/f1d [2829933,75531] 0 2024-09-10T10:04:08.388 INFO:tasks.workunit.client.1.smithi107.stdout:5/172: link de/c2e de/d20/c38 0 2024-09-10T10:04:08.389 INFO:tasks.workunit.client.1.smithi107.stdout:8/137: symlink d5/d8/dc/d21/d29/l33 0 2024-09-10T10:04:08.389 INFO:tasks.workunit.client.1.smithi107.stdout:0/160: creat d6/d8/f28 x:0 0 0 2024-09-10T10:04:08.391 INFO:tasks.workunit.client.1.smithi107.stdout:5/173: creat de/d20/d2b/f39 x:0 0 0 2024-09-10T10:04:08.393 INFO:tasks.workunit.client.1.smithi107.stdout:2/268: dwrite d3/da/df/f15 [0,4194304] 0 2024-09-10T10:04:08.393 INFO:tasks.workunit.client.1.smithi107.stdout:0/161: rename d6/c26 to d6/d8/c29 0 2024-09-10T10:04:08.397 INFO:tasks.workunit.client.1.smithi107.stdout:7/203: rmdir d0/d8/d9 39 2024-09-10T10:04:08.400 INFO:tasks.workunit.client.1.smithi107.stdout:0/162: rename d6/d18/l22 to d6/d14/l2a 0 2024-09-10T10:04:08.400 INFO:tasks.workunit.client.1.smithi107.stdout:8/138: dwrite d5/d8/f20 [0,4194304] 0 2024-09-10T10:04:08.400 INFO:tasks.workunit.client.1.smithi107.stdout:4/204: truncate d0/d1f/d20/f2c 653251 0 2024-09-10T10:04:08.402 INFO:tasks.workunit.client.1.smithi107.stdout:5/174: dread de/f16 [0,4194304] 0 2024-09-10T10:04:08.406 INFO:tasks.workunit.client.1.smithi107.stdout:5/175: unlink de/d20/f27 0 2024-09-10T10:04:08.409 INFO:tasks.workunit.client.1.smithi107.stdout:5/176: symlink de/l3a 0 2024-09-10T10:04:08.410 INFO:tasks.workunit.client.1.smithi107.stdout:7/204: dread d0/d8/f13 [0,4194304] 0 2024-09-10T10:04:08.412 INFO:tasks.workunit.client.1.smithi107.stdout:7/205: fsync d0/d8/dc/d2c/f3b 0 2024-09-10T10:04:08.412 INFO:tasks.workunit.client.1.smithi107.stdout:5/177: creat de/f3b x:0 0 0 2024-09-10T10:04:08.412 INFO:tasks.workunit.client.1.smithi107.stdout:2/269: dwrite d3/f1f [0,4194304] 0 2024-09-10T10:04:08.413 INFO:tasks.workunit.client.1.smithi107.stdout:0/163: getdents d6/d14 0 2024-09-10T10:04:08.414 INFO:tasks.workunit.client.1.smithi107.stdout:5/178: readlink de/d20/l32 0 2024-09-10T10:04:08.417 INFO:tasks.workunit.client.1.smithi107.stdout:2/270: creat d3/da/df/d20/f57 x:0 0 0 2024-09-10T10:04:08.418 INFO:tasks.workunit.client.1.smithi107.stdout:5/179: mknod de/d20/c3c 0 2024-09-10T10:04:08.419 INFO:tasks.workunit.client.1.smithi107.stdout:2/271: chown d3/da/d1e/d40 84 1 2024-09-10T10:04:08.419 INFO:tasks.workunit.client.1.smithi107.stdout:7/206: creat d0/d8/dc/d2c/f3f x:0 0 0 2024-09-10T10:04:08.422 INFO:tasks.workunit.client.1.smithi107.stdout:5/180: chown fc 168688 1 2024-09-10T10:04:08.426 INFO:tasks.workunit.client.1.smithi107.stdout:4/205: dwrite d0/d1f/d20/f1e [0,4194304] 0 2024-09-10T10:04:08.426 INFO:tasks.workunit.client.1.smithi107.stdout:7/207: write d0/d8/dc/f26 [862408,28447] 0 2024-09-10T10:04:08.426 INFO:tasks.workunit.client.1.smithi107.stdout:5/181: mkdir de/d20/d3d 0 2024-09-10T10:04:08.428 INFO:tasks.workunit.client.1.smithi107.stdout:5/182: chown de/l3a 55 1 2024-09-10T10:04:08.429 INFO:tasks.workunit.client.1.smithi107.stdout:0/164: dwrite d6/d8/f9 [4194304,4194304] 0 2024-09-10T10:04:08.431 INFO:tasks.workunit.client.1.smithi107.stdout:2/272: rename d3/f3c to d3/da/df/d20/d36/d4f/f58 0 2024-09-10T10:04:08.432 INFO:tasks.workunit.client.1.smithi107.stdout:4/206: creat d0/d1f/d20/f50 x:0 0 0 2024-09-10T10:04:08.435 INFO:tasks.workunit.client.1.smithi107.stdout:5/183: creat de/d20/d2b/f3e x:0 0 0 2024-09-10T10:04:08.437 INFO:tasks.workunit.client.1.smithi107.stdout:4/207: creat d0/d1f/d20/f51 x:0 0 0 2024-09-10T10:04:08.439 INFO:tasks.workunit.client.1.smithi107.stdout:0/165: rename d6/d8/l19 to d6/d18/l2b 0 2024-09-10T10:04:08.441 INFO:tasks.workunit.client.1.smithi107.stdout:4/208: chown d0/c7 18929766 1 2024-09-10T10:04:08.444 INFO:tasks.workunit.client.1.smithi107.stdout:0/166: mknod d6/d14/c2c 0 2024-09-10T10:04:08.447 INFO:tasks.workunit.client.1.smithi107.stdout:4/209: rename d0/c16 to d0/d29/c52 0 2024-09-10T10:04:08.450 INFO:tasks.workunit.client.1.smithi107.stdout:0/167: creat d6/d14/f2d x:0 0 0 2024-09-10T10:04:08.450 INFO:tasks.workunit.client.1.smithi107.stdout:2/273: dwrite f0 [8388608,4194304] 0 2024-09-10T10:04:08.451 INFO:tasks.workunit.client.1.smithi107.stdout:5/184: dwrite de/f1f [0,4194304] 0 2024-09-10T10:04:08.453 INFO:tasks.workunit.client.1.smithi107.stdout:2/274: read d3/f11 [4150026,10477] 0 2024-09-10T10:04:08.454 INFO:tasks.workunit.client.1.smithi107.stdout:4/210: mkdir d0/d29/d53 0 2024-09-10T10:04:08.456 INFO:tasks.workunit.client.1.smithi107.stdout:5/185: write de/d20/f26 [1595757,117190] 0 2024-09-10T10:04:08.456 INFO:tasks.workunit.client.1.smithi107.stdout:0/168: mkdir d6/d18/d2e 0 2024-09-10T10:04:08.457 INFO:tasks.workunit.client.1.smithi107.stdout:7/208: dwrite d0/f7 [0,4194304] 0 2024-09-10T10:04:08.459 INFO:tasks.workunit.client.1.smithi107.stdout:4/211: write d0/d1f/d20/f50 [560327,16105] 0 2024-09-10T10:04:08.459 INFO:tasks.workunit.client.1.smithi107.stdout:2/275: write d3/d21/d41/f44 [2880491,89668] 0 2024-09-10T10:04:08.469 INFO:tasks.workunit.client.1.smithi107.stdout:5/186: link de/l1d de/d20/d3d/l3f 0 2024-09-10T10:04:08.470 INFO:tasks.workunit.client.1.smithi107.stdout:0/169: dwrite f4 [0,4194304] 0 2024-09-10T10:04:08.476 INFO:tasks.workunit.client.1.smithi107.stdout:5/187: mknod de/c40 0 2024-09-10T10:04:08.479 INFO:tasks.workunit.client.0.smithi071.stdout:2/0: sync 2024-09-10T10:04:08.479 INFO:tasks.workunit.client.0.smithi071.stdout:2/1: dwrite - no filename 2024-09-10T10:04:08.479 INFO:tasks.workunit.client.0.smithi071.stdout:2/2: unlink - no file 2024-09-10T10:04:08.479 INFO:tasks.workunit.client.0.smithi071.stdout:2/3: unlink - no file 2024-09-10T10:04:08.479 INFO:tasks.workunit.client.0.smithi071.stdout:2/4: unlink - no file 2024-09-10T10:04:08.482 INFO:tasks.workunit.client.1.smithi107.stdout:7/209: dwrite d0/d8/f31 [0,4194304] 0 2024-09-10T10:04:08.487 INFO:tasks.workunit.client.1.smithi107.stdout:7/210: fdatasync d0/d8/dc/f2a 0 2024-09-10T10:04:08.491 INFO:tasks.workunit.client.1.smithi107.stdout:4/212: dread d0/f8 [0,4194304] 0 2024-09-10T10:04:08.492 INFO:tasks.workunit.client.1.smithi107.stdout:7/211: read d0/d1b/f28 [139581,89261] 0 2024-09-10T10:04:08.493 INFO:tasks.workunit.client.1.smithi107.stdout:5/188: dwrite de/d20/d2b/f3e [0,4194304] 0 2024-09-10T10:04:08.494 INFO:tasks.workunit.client.1.smithi107.stdout:7/212: creat d0/f40 x:0 0 0 2024-09-10T10:04:08.498 INFO:tasks.workunit.client.0.smithi071.stdout:2/5: creat f0 x:0 0 0 2024-09-10T10:04:08.500 INFO:tasks.workunit.client.0.smithi071.stdout:2/6: creat f1 x:0 0 0 2024-09-10T10:04:08.500 INFO:tasks.workunit.client.1.smithi107.stdout:7/213: dwrite d0/d8/dc/f1f [0,4194304] 0 2024-09-10T10:04:08.501 INFO:tasks.workunit.client.0.smithi071.stdout:2/7: read - f1 zero size 2024-09-10T10:04:08.502 INFO:tasks.workunit.client.0.smithi071.stdout:2/8: chown f0 2075 1 2024-09-10T10:04:08.502 INFO:tasks.workunit.client.0.smithi071.stdout:2/9: read - f0 zero size 2024-09-10T10:04:08.505 INFO:tasks.workunit.client.1.smithi107.stdout:7/214: unlink d0/f1e 0 2024-09-10T10:04:08.506 INFO:tasks.workunit.client.0.smithi071.stdout:2/10: rename f0 to f2 0 2024-09-10T10:04:08.507 INFO:tasks.workunit.client.0.smithi071.stdout:2/11: write f1 [640255,60307] 0 2024-09-10T10:04:08.517 INFO:tasks.workunit.client.1.smithi107.stdout:0/170: dwrite d6/f23 [0,4194304] 0 2024-09-10T10:04:08.518 INFO:tasks.workunit.client.1.smithi107.stdout:0/171: read d6/d18/f1b [4148799,112628] 0 2024-09-10T10:04:08.523 INFO:tasks.workunit.client.0.smithi071.stdout:2/12: dread f1 [0,4194304] 0 2024-09-10T10:04:08.525 INFO:tasks.workunit.client.0.smithi071.stdout:2/13: write f2 [356816,36914] 0 2024-09-10T10:04:08.525 INFO:tasks.workunit.client.0.smithi071.stdout:2/14: stat f2 0 2024-09-10T10:04:08.527 INFO:tasks.workunit.client.0.smithi071.stdout:2/15: symlink l3 0 2024-09-10T10:04:08.527 INFO:tasks.workunit.client.1.smithi107.stdout:0/172: dwrite d6/d8/f27 [0,4194304] 0 2024-09-10T10:04:08.529 INFO:tasks.workunit.client.0.smithi071.stdout:1/20: sync 2024-09-10T10:04:08.529 INFO:tasks.workunit.client.0.smithi071.stdout:4/52: sync 2024-09-10T10:04:08.529 INFO:tasks.workunit.client.0.smithi071.stdout:9/148: sync 2024-09-10T10:04:08.529 INFO:tasks.workunit.client.0.smithi071.stdout:5/12: sync 2024-09-10T10:04:08.530 INFO:tasks.workunit.client.0.smithi071.stdout:3/32: sync 2024-09-10T10:04:08.530 INFO:tasks.workunit.client.0.smithi071.stdout:0/17: sync 2024-09-10T10:04:08.530 INFO:tasks.workunit.client.0.smithi071.stdout:6/1: sync 2024-09-10T10:04:08.530 INFO:tasks.workunit.client.0.smithi071.stdout:6/2: dwrite - no filename 2024-09-10T10:04:08.530 INFO:tasks.workunit.client.0.smithi071.stdout:7/28: sync 2024-09-10T10:04:08.530 INFO:tasks.workunit.client.0.smithi071.stdout:6/3: dread - no filename 2024-09-10T10:04:08.530 INFO:tasks.workunit.client.0.smithi071.stdout:6/4: link - no file 2024-09-10T10:04:08.530 INFO:tasks.workunit.client.0.smithi071.stdout:8/82: sync 2024-09-10T10:04:08.531 INFO:tasks.workunit.client.0.smithi071.stdout:7/29: stat f4 0 2024-09-10T10:04:08.531 INFO:tasks.workunit.client.0.smithi071.stdout:5/13: read - f2 zero size 2024-09-10T10:04:08.531 INFO:tasks.workunit.client.0.smithi071.stdout:1/21: fdatasync d1/f3 0 2024-09-10T10:04:08.532 INFO:tasks.workunit.client.0.smithi071.stdout:0/18: symlink la 0 2024-09-10T10:04:08.533 INFO:tasks.workunit.client.1.smithi107.stdout:5/189: dread f1 [0,4194304] 0 2024-09-10T10:04:08.534 INFO:tasks.workunit.client.0.smithi071.stdout:9/149: write d0/db/f29 [1019768,116098] 0 2024-09-10T10:04:08.534 INFO:tasks.workunit.client.1.smithi107.stdout:0/173: rename d6/d18 to d6/d8/d2f 0 2024-09-10T10:04:08.534 INFO:tasks.workunit.client.0.smithi071.stdout:3/33: creat d3/f7 x:0 0 0 2024-09-10T10:04:08.536 INFO:tasks.workunit.client.1.smithi107.stdout:5/190: mkdir de/d41 0 2024-09-10T10:04:08.536 INFO:tasks.workunit.client.1.smithi107.stdout:5/191: chown de 0 1 2024-09-10T10:04:08.537 INFO:tasks.workunit.client.1.smithi107.stdout:0/174: mkdir d6/d8/d2f/d2e/d30 0 2024-09-10T10:04:08.538 INFO:tasks.workunit.client.0.smithi071.stdout:6/5: creat f0 x:0 0 0 2024-09-10T10:04:08.538 INFO:tasks.workunit.client.1.smithi107.stdout:0/175: rename d6/d8/d2f to d6/d8/d2f/d31 22 2024-09-10T10:04:08.539 INFO:tasks.workunit.client.0.smithi071.stdout:8/83: creat d5/df/d16/f22 x:0 0 0 2024-09-10T10:04:08.539 INFO:tasks.workunit.client.0.smithi071.stdout:3/34: fsync f2 0 2024-09-10T10:04:08.540 INFO:tasks.workunit.client.0.smithi071.stdout:0/19: dread f3 [0,4194304] 0 2024-09-10T10:04:08.540 INFO:tasks.workunit.client.1.smithi107.stdout:0/176: dread d6/fa [0,4194304] 0 2024-09-10T10:04:08.541 INFO:tasks.workunit.client.1.smithi107.stdout:5/192: dread de/d20/f37 [0,4194304] 0 2024-09-10T10:04:08.541 INFO:tasks.workunit.client.0.smithi071.stdout:6/6: dread - f0 zero size 2024-09-10T10:04:08.543 INFO:tasks.workunit.client.0.smithi071.stdout:3/35: chown d3 0 1 2024-09-10T10:04:08.544 INFO:tasks.workunit.client.0.smithi071.stdout:2/16: dwrite f2 [0,4194304] 0 2024-09-10T10:04:08.545 INFO:tasks.workunit.client.0.smithi071.stdout:6/7: fdatasync f0 0 2024-09-10T10:04:08.549 INFO:tasks.workunit.client.0.smithi071.stdout:6/8: stat f0 0 2024-09-10T10:04:08.549 INFO:tasks.workunit.client.0.smithi071.stdout:2/17: fdatasync f1 0 2024-09-10T10:04:08.551 INFO:tasks.workunit.client.0.smithi071.stdout:3/36: truncate d3/f7 849406 0 2024-09-10T10:04:08.551 INFO:tasks.workunit.client.0.smithi071.stdout:8/84: rename d5/f7 to d5/df/d1d/f23 0 2024-09-10T10:04:08.555 INFO:tasks.workunit.client.0.smithi071.stdout:2/18: write f2 [3732134,67029] 0 2024-09-10T10:04:08.555 INFO:tasks.workunit.client.0.smithi071.stdout:6/9: creat f1 x:0 0 0 2024-09-10T10:04:08.559 INFO:tasks.workunit.client.1.smithi107.stdout:0/177: truncate d6/fa 1064830 0 2024-09-10T10:04:08.559 INFO:tasks.workunit.client.0.smithi071.stdout:1/22: dwrite d1/f3 [0,4194304] 0 2024-09-10T10:04:08.559 INFO:tasks.workunit.client.0.smithi071.stdout:7/30: dwrite f3 [0,4194304] 0 2024-09-10T10:04:08.561 INFO:tasks.workunit.client.0.smithi071.stdout:7/31: rmdir - no directory 2024-09-10T10:04:08.561 INFO:tasks.workunit.client.0.smithi071.stdout:3/37: write d3/f5 [4671708,66926] 0 2024-09-10T10:04:08.561 INFO:tasks.workunit.client.0.smithi071.stdout:2/19: symlink l4 0 2024-09-10T10:04:08.561 INFO:tasks.workunit.client.0.smithi071.stdout:5/14: dwrite f4 [0,4194304] 0 2024-09-10T10:04:08.562 INFO:tasks.workunit.client.0.smithi071.stdout:6/10: write f0 [735274,129757] 0 2024-09-10T10:04:08.563 INFO:tasks.workunit.client.1.smithi107.stdout:0/178: mkdir d6/d8/d2f/d2e/d32 0 2024-09-10T10:04:08.563 INFO:tasks.workunit.client.0.smithi071.stdout:8/85: mknod d5/df/c24 0 2024-09-10T10:04:08.563 INFO:tasks.workunit.client.1.smithi107.stdout:5/193: dwrite de/d20/f37 [4194304,4194304] 0 2024-09-10T10:04:08.564 INFO:tasks.workunit.client.0.smithi071.stdout:1/23: write d1/f3 [3928987,50438] 0 2024-09-10T10:04:08.565 INFO:tasks.workunit.client.1.smithi107.stdout:5/194: chown de/d20/c22 1 1 2024-09-10T10:04:08.565 INFO:tasks.workunit.client.1.smithi107.stdout:5/195: stat de/f1f 0 2024-09-10T10:04:08.569 INFO:tasks.workunit.client.1.smithi107.stdout:5/196: rmdir de/d20/d2b 39 2024-09-10T10:04:08.573 INFO:tasks.workunit.client.1.smithi107.stdout:5/197: write de/f16 [3139921,61595] 0 2024-09-10T10:04:08.574 INFO:tasks.workunit.client.0.smithi071.stdout:5/15: unlink f2 0 2024-09-10T10:04:08.575 INFO:tasks.workunit.client.0.smithi071.stdout:2/20: dread f2 [0,4194304] 0 2024-09-10T10:04:08.579 INFO:tasks.workunit.client.0.smithi071.stdout:1/24: creat d1/f4 x:0 0 0 2024-09-10T10:04:08.579 INFO:tasks.workunit.client.0.smithi071.stdout:7/32: dread f3 [0,4194304] 0 2024-09-10T10:04:08.580 INFO:tasks.workunit.client.0.smithi071.stdout:8/86: symlink d5/df/d1d/l25 0 2024-09-10T10:04:08.582 INFO:tasks.workunit.client.0.smithi071.stdout:3/38: dread d3/f7 [0,4194304] 0 2024-09-10T10:04:08.582 INFO:tasks.workunit.client.1.smithi107.stdout:5/198: getdents de/d20 0 2024-09-10T10:04:08.583 INFO:tasks.workunit.client.0.smithi071.stdout:8/87: dread - d5/f11 zero size 2024-09-10T10:04:08.583 INFO:tasks.workunit.client.0.smithi071.stdout:5/16: rename l3 to l5 0 2024-09-10T10:04:08.583 INFO:tasks.workunit.client.0.smithi071.stdout:6/11: dwrite f1 [0,4194304] 0 2024-09-10T10:04:08.584 INFO:tasks.workunit.client.0.smithi071.stdout:2/21: mknod c5 0 2024-09-10T10:04:08.586 INFO:tasks.workunit.client.0.smithi071.stdout:3/39: unlink d3/f7 0 2024-09-10T10:04:08.587 INFO:tasks.workunit.client.0.smithi071.stdout:2/22: chown l3 4 1 2024-09-10T10:04:08.587 INFO:tasks.workunit.client.0.smithi071.stdout:5/17: write f1 [117842,10540] 0 2024-09-10T10:04:08.590 INFO:tasks.workunit.client.0.smithi071.stdout:2/23: chown f1 19636 1 2024-09-10T10:04:08.593 INFO:tasks.workunit.client.0.smithi071.stdout:5/18: creat f6 x:0 0 0 2024-09-10T10:04:08.593 INFO:tasks.workunit.client.0.smithi071.stdout:6/12: dread f0 [0,4194304] 0 2024-09-10T10:04:08.594 INFO:tasks.workunit.client.0.smithi071.stdout:1/25: dread d1/f3 [0,4194304] 0 2024-09-10T10:04:08.595 INFO:tasks.workunit.client.0.smithi071.stdout:6/13: stat f1 0 2024-09-10T10:04:08.596 INFO:tasks.workunit.client.0.smithi071.stdout:2/24: symlink l6 0 2024-09-10T10:04:08.597 INFO:tasks.workunit.client.0.smithi071.stdout:3/40: link d3/f6 d3/f8 0 2024-09-10T10:04:08.597 INFO:tasks.workunit.client.0.smithi071.stdout:3/41: readlink - no filename 2024-09-10T10:04:08.598 INFO:tasks.workunit.client.0.smithi071.stdout:7/33: dwrite f4 [0,4194304] 0 2024-09-10T10:04:08.600 INFO:tasks.workunit.client.0.smithi071.stdout:6/14: unlink f0 0 2024-09-10T10:04:08.601 INFO:tasks.workunit.client.0.smithi071.stdout:8/88: dwrite d5/df/d16/f17 [0,4194304] 0 2024-09-10T10:04:08.602 INFO:tasks.workunit.client.0.smithi071.stdout:7/34: creat f6 x:0 0 0 2024-09-10T10:04:08.604 INFO:tasks.workunit.client.0.smithi071.stdout:6/15: symlink l2 0 2024-09-10T10:04:08.604 INFO:tasks.workunit.client.0.smithi071.stdout:1/26: dread d1/f3 [0,4194304] 0 2024-09-10T10:04:08.605 INFO:tasks.workunit.client.0.smithi071.stdout:7/35: creat f7 x:0 0 0 2024-09-10T10:04:08.608 INFO:tasks.workunit.client.0.smithi071.stdout:8/89: creat d5/df/d1d/f26 x:0 0 0 2024-09-10T10:04:08.608 INFO:tasks.workunit.client.0.smithi071.stdout:6/16: creat f3 x:0 0 0 2024-09-10T10:04:08.610 INFO:tasks.workunit.client.0.smithi071.stdout:1/27: rename d1/f4 to d1/f5 0 2024-09-10T10:04:08.613 INFO:tasks.workunit.client.0.smithi071.stdout:1/28: creat d1/f6 x:0 0 0 2024-09-10T10:04:08.615 INFO:tasks.workunit.client.0.smithi071.stdout:1/29: dread - d1/f6 zero size 2024-09-10T10:04:08.616 INFO:tasks.workunit.client.0.smithi071.stdout:6/17: dwrite f3 [0,4194304] 0 2024-09-10T10:04:08.617 INFO:tasks.workunit.client.0.smithi071.stdout:6/18: stat f1 0 2024-09-10T10:04:08.620 INFO:tasks.workunit.client.0.smithi071.stdout:1/30: dread d1/f3 [0,4194304] 0 2024-09-10T10:04:08.624 INFO:tasks.workunit.client.0.smithi071.stdout:1/31: fdatasync d1/f3 0 2024-09-10T10:04:08.625 INFO:tasks.workunit.client.0.smithi071.stdout:1/32: chown d1/f5 492178 1 2024-09-10T10:04:08.646 INFO:tasks.workunit.client.0.smithi071.stdout:7/36: fdatasync f4 0 2024-09-10T10:04:08.650 INFO:tasks.workunit.client.0.smithi071.stdout:7/37: symlink l8 0 2024-09-10T10:04:08.651 INFO:tasks.workunit.client.0.smithi071.stdout:7/38: write f4 [528224,84065] 0 2024-09-10T10:04:08.660 INFO:tasks.workunit.client.0.smithi071.stdout:7/39: dwrite f7 [0,4194304] 0 2024-09-10T10:04:08.677 INFO:tasks.workunit.client.0.smithi071.stdout:9/150: truncate d0/db/f17 387055 0 2024-09-10T10:04:08.679 INFO:tasks.workunit.client.0.smithi071.stdout:9/151: write d0/db/d1b/f24 [8086344,56444] 0 2024-09-10T10:04:08.684 INFO:tasks.workunit.client.0.smithi071.stdout:0/20: dwrite f3 [0,4194304] 0 2024-09-10T10:04:08.685 INFO:tasks.workunit.client.0.smithi071.stdout:0/21: write f7 [744463,125627] 0 2024-09-10T10:04:08.687 INFO:tasks.workunit.client.0.smithi071.stdout:2/25: getdents . 0 2024-09-10T10:04:08.687 INFO:tasks.workunit.client.0.smithi071.stdout:9/152: dread d0/f9 [0,4194304] 0 2024-09-10T10:04:08.688 INFO:tasks.workunit.client.0.smithi071.stdout:2/26: truncate f2 5052219 0 2024-09-10T10:04:08.690 INFO:tasks.workunit.client.0.smithi071.stdout:3/42: getdents d3 0 2024-09-10T10:04:08.690 INFO:tasks.workunit.client.0.smithi071.stdout:9/153: chown d0/db/f22 0 1 2024-09-10T10:04:08.690 INFO:tasks.workunit.client.0.smithi071.stdout:9/154: write d0/db/f22 [615872,130430] 0 2024-09-10T10:04:08.691 INFO:tasks.workunit.client.0.smithi071.stdout:0/22: dread f3 [0,4194304] 0 2024-09-10T10:04:08.692 INFO:tasks.workunit.client.0.smithi071.stdout:3/43: creat d3/f9 x:0 0 0 2024-09-10T10:04:08.694 INFO:tasks.workunit.client.0.smithi071.stdout:3/44: read d3/f5 [3356676,2831] 0 2024-09-10T10:04:08.694 INFO:tasks.workunit.client.0.smithi071.stdout:0/23: mknod cb 0 2024-09-10T10:04:08.696 INFO:tasks.workunit.client.0.smithi071.stdout:9/155: rename d0/f16 to d0/f2e 0 2024-09-10T10:04:08.699 INFO:tasks.workunit.client.0.smithi071.stdout:2/27: dwrite f2 [4194304,4194304] 0 2024-09-10T10:04:08.700 INFO:tasks.workunit.client.0.smithi071.stdout:2/28: chown l6 4936 1 2024-09-10T10:04:08.701 INFO:tasks.workunit.client.0.smithi071.stdout:0/24: dread f5 [0,4194304] 0 2024-09-10T10:04:08.701 INFO:tasks.workunit.client.0.smithi071.stdout:2/29: dread f1 [0,4194304] 0 2024-09-10T10:04:08.708 INFO:tasks.workunit.client.0.smithi071.stdout:2/30: dwrite f2 [4194304,4194304] 0 2024-09-10T10:04:08.709 INFO:tasks.workunit.client.0.smithi071.stdout:1/33: getdents d1 0 2024-09-10T10:04:08.709 INFO:tasks.workunit.client.0.smithi071.stdout:1/34: chown d1 29 1 2024-09-10T10:04:08.710 INFO:tasks.workunit.client.1.smithi107.stdout:3/227: sync 2024-09-10T10:04:08.710 INFO:tasks.workunit.client.0.smithi071.stdout:8/90: truncate d5/df/d1d/f23 1940561 0 2024-09-10T10:04:08.711 INFO:tasks.workunit.client.0.smithi071.stdout:6/19: truncate f1 2966760 0 2024-09-10T10:04:08.711 INFO:tasks.workunit.client.0.smithi071.stdout:8/91: rename d5 to d5/df/d1e/d27 22 2024-09-10T10:04:08.714 INFO:tasks.workunit.client.0.smithi071.stdout:2/31: rename l3 to l7 0 2024-09-10T10:04:08.714 INFO:tasks.workunit.client.1.smithi107.stdout:3/228: getdents dc/dd/d25 0 2024-09-10T10:04:08.716 INFO:tasks.workunit.client.1.smithi107.stdout:3/229: write dc/dd/f31 [4836504,4186] 0 2024-09-10T10:04:08.717 INFO:tasks.workunit.client.1.smithi107.stdout:3/230: fdatasync dc/dd/d25/d26/f3a 0 2024-09-10T10:04:08.719 INFO:tasks.workunit.client.1.smithi107.stdout:3/231: chown dc/dd/d25/d26/d41/d44/d35/c16 743531784 1 2024-09-10T10:04:08.721 INFO:tasks.workunit.client.1.smithi107.stdout:3/232: truncate f9 3223008 0 2024-09-10T10:04:08.723 INFO:tasks.workunit.client.1.smithi107.stdout:3/233: read - dc/dd/d25/d26/d41/d44/d35/f32 zero size 2024-09-10T10:04:08.741 INFO:tasks.workunit.client.1.smithi107.stdout:3/234: dread dc/dd/f31 [0,4194304] 0 2024-09-10T10:04:08.744 INFO:tasks.workunit.client.1.smithi107.stdout:3/235: rename dc/dd/d25 to dc/dd/d45 0 2024-09-10T10:04:08.747 INFO:tasks.workunit.client.1.smithi107.stdout:3/236: rename f2 to dc/dd/d20/d23/d39/f46 0 2024-09-10T10:04:08.750 INFO:tasks.workunit.client.1.smithi107.stdout:3/237: rename dc/dd/d45/d26/d41/d44/d35/c16 to dc/dd/d45/d26/c47 0 2024-09-10T10:04:08.750 INFO:tasks.workunit.client.1.smithi107.stdout:3/238: read - dc/dd/d20/f3e zero size 2024-09-10T10:04:08.754 INFO:tasks.workunit.client.1.smithi107.stdout:3/239: dwrite f1 [4194304,4194304] 0 2024-09-10T10:04:08.774 INFO:tasks.workunit.client.1.smithi107.stdout:3/240: dread dc/dd/d45/d26/d41/d44/f1f [0,4194304] 0 2024-09-10T10:04:08.776 INFO:tasks.workunit.client.0.smithi071.stdout:1/35: symlink d1/l7 0 2024-09-10T10:04:08.777 INFO:tasks.workunit.client.0.smithi071.stdout:6/20: mkdir d4 0 2024-09-10T10:04:08.777 INFO:tasks.workunit.client.0.smithi071.stdout:2/32: fdatasync f1 0 2024-09-10T10:04:08.778 INFO:tasks.workunit.client.1.smithi107.stdout:3/241: dread dc/dd/d45/d26/d41/d44/f2d [0,4194304] 0 2024-09-10T10:04:08.778 INFO:tasks.workunit.client.0.smithi071.stdout:7/40: truncate f3 132386 0 2024-09-10T10:04:08.780 INFO:tasks.workunit.client.0.smithi071.stdout:2/33: dread f1 [0,4194304] 0 2024-09-10T10:04:08.781 INFO:tasks.workunit.client.0.smithi071.stdout:9/156: dwrite d0/f6 [4194304,4194304] 0 2024-09-10T10:04:08.782 INFO:tasks.workunit.client.1.smithi107.stdout:3/242: rmdir dc/dd/d20/d23/d39 39 2024-09-10T10:04:08.783 INFO:tasks.workunit.client.0.smithi071.stdout:2/34: write f1 [156665,48880] 0 2024-09-10T10:04:08.784 INFO:tasks.workunit.client.0.smithi071.stdout:9/157: read - d0/db/d20/f2b zero size 2024-09-10T10:04:08.785 INFO:tasks.workunit.client.0.smithi071.stdout:2/35: read f2 [3204129,25038] 0 2024-09-10T10:04:08.787 INFO:tasks.workunit.client.0.smithi071.stdout:2/36: fdatasync f1 0 2024-09-10T10:04:08.787 INFO:tasks.workunit.client.0.smithi071.stdout:1/36: write d1/f6 [314502,104322] 0 2024-09-10T10:04:08.787 INFO:tasks.workunit.client.0.smithi071.stdout:7/41: dread f4 [0,4194304] 0 2024-09-10T10:04:08.788 INFO:tasks.workunit.client.0.smithi071.stdout:8/92: rename d5/f8 to d5/f28 0 2024-09-10T10:04:08.789 INFO:tasks.workunit.client.0.smithi071.stdout:9/158: write d0/f9 [6669709,8471] 0 2024-09-10T10:04:08.789 INFO:tasks.workunit.client.0.smithi071.stdout:3/45: dwrite d3/f6 [0,4194304] 0 2024-09-10T10:04:08.790 INFO:tasks.workunit.client.0.smithi071.stdout:2/37: truncate f1 995835 0 2024-09-10T10:04:08.790 INFO:tasks.workunit.client.0.smithi071.stdout:6/21: creat d4/f5 x:0 0 0 2024-09-10T10:04:08.790 INFO:tasks.workunit.client.1.smithi107.stdout:3/243: dread f7 [0,4194304] 0 2024-09-10T10:04:08.790 INFO:tasks.workunit.client.0.smithi071.stdout:3/46: stat d3 0 2024-09-10T10:04:08.791 INFO:tasks.workunit.client.0.smithi071.stdout:6/22: fdatasync d4/f5 0 2024-09-10T10:04:08.796 INFO:tasks.workunit.client.0.smithi071.stdout:7/42: read f3 [125223,72206] 0 2024-09-10T10:04:08.796 INFO:tasks.workunit.client.1.smithi107.stdout:3/244: getdents dc/dd/d20/d23/d39 0 2024-09-10T10:04:08.797 INFO:tasks.workunit.client.0.smithi071.stdout:3/47: creat d3/fa x:0 0 0 2024-09-10T10:04:08.797 INFO:tasks.workunit.client.1.smithi107.stdout:3/245: chown dc/dd/d45/d26 70646037 1 2024-09-10T10:04:08.799 INFO:tasks.workunit.client.0.smithi071.stdout:7/43: mkdir d9 0 2024-09-10T10:04:08.799 INFO:tasks.workunit.client.0.smithi071.stdout:6/23: creat d4/f6 x:0 0 0 2024-09-10T10:04:08.799 INFO:tasks.workunit.client.1.smithi107.stdout:3/246: symlink dc/dd/d45/l48 0 2024-09-10T10:04:08.801 INFO:tasks.workunit.client.0.smithi071.stdout:8/93: link d5/f19 d5/df/d16/f29 0 2024-09-10T10:04:08.801 INFO:tasks.workunit.client.1.smithi107.stdout:3/247: truncate dc/dd/d45/d26/d41/d44/f2d 4412417 0 2024-09-10T10:04:08.803 INFO:tasks.workunit.client.0.smithi071.stdout:2/38: dwrite f2 [4194304,4194304] 0 2024-09-10T10:04:08.805 INFO:tasks.workunit.client.0.smithi071.stdout:1/37: truncate d1/f3 2392475 0 2024-09-10T10:04:08.809 INFO:tasks.workunit.client.1.smithi107.stdout:3/248: truncate dc/dd/d45/d26/d41/d44/f2d 2155678 0 2024-09-10T10:04:08.810 INFO:tasks.workunit.client.0.smithi071.stdout:6/24: unlink d4/f5 0 2024-09-10T10:04:08.811 INFO:tasks.workunit.client.0.smithi071.stdout:3/48: dread d3/f5 [0,4194304] 0 2024-09-10T10:04:08.812 INFO:tasks.workunit.client.1.smithi107.stdout:3/249: mknod dc/dd/d45/d26/c49 0 2024-09-10T10:04:08.814 INFO:tasks.workunit.client.0.smithi071.stdout:6/25: symlink d4/l7 0 2024-09-10T10:04:08.815 INFO:tasks.workunit.client.0.smithi071.stdout:3/49: write f2 [3889928,43056] 0 2024-09-10T10:04:08.816 INFO:tasks.workunit.client.0.smithi071.stdout:8/94: dwrite d5/df/d1e/f21 [0,4194304] 0 2024-09-10T10:04:08.816 INFO:tasks.workunit.client.0.smithi071.stdout:7/44: write f3 [277522,58321] 0 2024-09-10T10:04:08.817 INFO:tasks.workunit.client.0.smithi071.stdout:6/26: rename d4 to d4/d8 22 2024-09-10T10:04:08.818 INFO:tasks.workunit.client.0.smithi071.stdout:3/50: mknod d3/cb 0 2024-09-10T10:04:08.819 INFO:tasks.workunit.client.0.smithi071.stdout:4/53: sync 2024-09-10T10:04:08.820 INFO:tasks.workunit.client.0.smithi071.stdout:2/39: dwrite f1 [0,4194304] 0 2024-09-10T10:04:08.821 INFO:tasks.workunit.client.0.smithi071.stdout:8/95: chown d5/f11 0 1 2024-09-10T10:04:08.821 INFO:tasks.workunit.client.0.smithi071.stdout:2/40: truncate f2 8628136 0 2024-09-10T10:04:08.822 INFO:tasks.workunit.client.0.smithi071.stdout:7/45: write f3 [197366,72223] 0 2024-09-10T10:04:08.822 INFO:tasks.workunit.client.0.smithi071.stdout:6/27: truncate d4/f6 1001140 0 2024-09-10T10:04:08.823 INFO:tasks.workunit.client.0.smithi071.stdout:3/51: mkdir d3/dc 0 2024-09-10T10:04:08.825 INFO:tasks.workunit.client.0.smithi071.stdout:4/54: mkdir db/d13 0 2024-09-10T10:04:08.825 INFO:tasks.workunit.client.0.smithi071.stdout:2/41: mkdir d8 0 2024-09-10T10:04:08.826 INFO:tasks.workunit.client.0.smithi071.stdout:1/38: dwrite d1/f6 [0,4194304] 0 2024-09-10T10:04:08.826 INFO:tasks.workunit.client.0.smithi071.stdout:8/96: symlink d5/df/d1e/l2a 0 2024-09-10T10:04:08.830 INFO:tasks.workunit.client.0.smithi071.stdout:7/46: getdents d9 0 2024-09-10T10:04:08.834 INFO:tasks.workunit.client.0.smithi071.stdout:2/42: fdatasync f2 0 2024-09-10T10:04:08.835 INFO:tasks.workunit.client.0.smithi071.stdout:3/52: rmdir d3/dc 0 2024-09-10T10:04:08.836 INFO:tasks.workunit.client.0.smithi071.stdout:8/97: dwrite d5/df/d16/f22 [0,4194304] 0 2024-09-10T10:04:08.837 INFO:tasks.workunit.client.0.smithi071.stdout:3/53: chown d3/f9 9938 1 2024-09-10T10:04:08.837 INFO:tasks.workunit.client.0.smithi071.stdout:4/55: rmdir db/d13 0 2024-09-10T10:04:08.838 INFO:tasks.workunit.client.0.smithi071.stdout:8/98: stat d5/df/d16 0 2024-09-10T10:04:08.838 INFO:tasks.workunit.client.0.smithi071.stdout:4/56: fdatasync db/f12 0 2024-09-10T10:04:08.838 INFO:tasks.workunit.client.0.smithi071.stdout:6/28: getdents d4 0 2024-09-10T10:04:08.839 INFO:tasks.workunit.client.0.smithi071.stdout:3/54: write d3/f6 [3326111,76454] 0 2024-09-10T10:04:08.839 INFO:tasks.workunit.client.0.smithi071.stdout:8/99: chown d5/f28 29 1 2024-09-10T10:04:08.840 INFO:tasks.workunit.client.0.smithi071.stdout:8/100: readlink d5/df/d1d/l25 0 2024-09-10T10:04:08.841 INFO:tasks.workunit.client.0.smithi071.stdout:7/47: creat d9/fa x:0 0 0 2024-09-10T10:04:08.841 INFO:tasks.workunit.client.0.smithi071.stdout:7/48: chown f4 491 1 2024-09-10T10:04:08.843 INFO:tasks.workunit.client.0.smithi071.stdout:4/57: mknod db/c14 0 2024-09-10T10:04:08.844 INFO:tasks.workunit.client.0.smithi071.stdout:4/58: fdatasync db/f12 0 2024-09-10T10:04:08.845 INFO:tasks.workunit.client.0.smithi071.stdout:3/55: creat d3/fd x:0 0 0 2024-09-10T10:04:08.846 INFO:tasks.workunit.client.0.smithi071.stdout:7/49: unlink f6 0 2024-09-10T10:04:08.848 INFO:tasks.workunit.client.0.smithi071.stdout:3/56: symlink d3/le 0 2024-09-10T10:04:08.850 INFO:tasks.workunit.client.0.smithi071.stdout:8/101: dwrite d5/fb [4194304,4194304] 0 2024-09-10T10:04:08.851 INFO:tasks.workunit.client.0.smithi071.stdout:3/57: rename d3/f5 to d3/ff 0 2024-09-10T10:04:08.853 INFO:tasks.workunit.client.0.smithi071.stdout:7/50: dread f7 [0,4194304] 0 2024-09-10T10:04:08.853 INFO:tasks.workunit.client.0.smithi071.stdout:3/58: mkdir d3/d10 0 2024-09-10T10:04:08.853 INFO:tasks.workunit.client.0.smithi071.stdout:7/51: chown l1 0 1 2024-09-10T10:04:08.855 INFO:tasks.workunit.client.0.smithi071.stdout:7/52: creat d9/fb x:0 0 0 2024-09-10T10:04:08.857 INFO:tasks.workunit.client.0.smithi071.stdout:3/59: link d3/f6 d3/d10/f11 0 2024-09-10T10:04:08.857 INFO:tasks.workunit.client.0.smithi071.stdout:3/60: fdatasync d3/f9 0 2024-09-10T10:04:08.858 INFO:tasks.workunit.client.0.smithi071.stdout:3/61: stat d3/le 0 2024-09-10T10:04:08.860 INFO:tasks.workunit.client.0.smithi071.stdout:3/62: mknod d3/d10/c12 0 2024-09-10T10:04:08.862 INFO:tasks.workunit.client.0.smithi071.stdout:3/63: rename d3/le to d3/l13 0 2024-09-10T10:04:08.863 INFO:tasks.workunit.client.0.smithi071.stdout:3/64: rename d3 to d3/d10/d14 22 2024-09-10T10:04:08.863 INFO:tasks.workunit.client.0.smithi071.stdout:7/53: dwrite f2 [0,4194304] 0 2024-09-10T10:04:08.865 INFO:tasks.workunit.client.0.smithi071.stdout:7/54: mknod d9/cc 0 2024-09-10T10:04:08.872 INFO:tasks.workunit.client.1.smithi107.stdout:9/243: sync 2024-09-10T10:04:08.875 INFO:tasks.workunit.client.1.smithi107.stdout:9/244: dread d5/d7/fe [0,4194304] 0 2024-09-10T10:04:08.878 INFO:tasks.workunit.client.1.smithi107.stdout:9/245: creat d5/d7/d3c/d53/d57/f5e x:0 0 0 2024-09-10T10:04:08.878 INFO:tasks.workunit.client.1.smithi107.stdout:3/250: dread dc/dd/d20/d23/d39/f46 [0,4194304] 0 2024-09-10T10:04:08.881 INFO:tasks.workunit.client.1.smithi107.stdout:3/251: mkdir dc/dd/d45/d26/d41/d44/d35/d4a 0 2024-09-10T10:04:08.883 INFO:tasks.workunit.client.1.smithi107.stdout:3/252: dread - dc/dd/d45/d26/d41/d44/d35/f2a zero size 2024-09-10T10:04:08.883 INFO:tasks.workunit.client.1.smithi107.stdout:9/246: getdents d5/d7/d3c 0 2024-09-10T10:04:08.885 INFO:tasks.workunit.client.0.smithi071.stdout:2/43: truncate f1 742593 0 2024-09-10T10:04:08.886 INFO:tasks.workunit.client.0.smithi071.stdout:2/44: chown l6 1947278 1 2024-09-10T10:04:08.886 INFO:tasks.workunit.client.0.smithi071.stdout:6/29: write f1 [784233,13868] 0 2024-09-10T10:04:08.887 INFO:tasks.workunit.client.0.smithi071.stdout:1/39: dwrite d1/f3 [0,4194304] 0 2024-09-10T10:04:08.887 INFO:tasks.workunit.client.1.smithi107.stdout:3/253: write dc/dd/f12 [2659381,109229] 0 2024-09-10T10:04:08.888 INFO:tasks.workunit.client.0.smithi071.stdout:4/59: truncate f1 2492412 0 2024-09-10T10:04:08.890 INFO:tasks.workunit.client.0.smithi071.stdout:6/30: getdents d4 0 2024-09-10T10:04:08.891 INFO:tasks.workunit.client.0.smithi071.stdout:1/40: symlink d1/l8 0 2024-09-10T10:04:08.893 INFO:tasks.workunit.client.0.smithi071.stdout:1/41: write d1/f6 [3153896,71834] 0 2024-09-10T10:04:08.894 INFO:tasks.workunit.client.1.smithi107.stdout:9/247: dwrite d5/d1e/f5b [0,4194304] 0 2024-09-10T10:04:08.894 INFO:tasks.workunit.client.0.smithi071.stdout:4/60: dread f3 [0,4194304] 0 2024-09-10T10:04:08.894 INFO:tasks.workunit.client.0.smithi071.stdout:1/42: stat d1/l8 0 2024-09-10T10:04:08.895 INFO:tasks.workunit.client.1.smithi107.stdout:9/248: readlink d5/d1e/l2b 0 2024-09-10T10:04:08.896 INFO:tasks.workunit.client.0.smithi071.stdout:6/31: dread f3 [0,4194304] 0 2024-09-10T10:04:08.898 INFO:tasks.workunit.client.0.smithi071.stdout:4/61: mkdir db/d15 0 2024-09-10T10:04:08.898 INFO:tasks.workunit.client.1.smithi107.stdout:9/249: mknod d5/d7/d1d/d25/d27/c5f 0 2024-09-10T10:04:08.898 INFO:tasks.workunit.client.0.smithi071.stdout:4/62: write db/f12 [757452,13809] 0 2024-09-10T10:04:08.904 INFO:tasks.workunit.client.0.smithi071.stdout:4/63: mknod db/c16 0 2024-09-10T10:04:08.905 INFO:tasks.workunit.client.0.smithi071.stdout:6/32: getdents d4 0 2024-09-10T10:04:08.906 INFO:tasks.workunit.client.0.smithi071.stdout:3/65: getdents d3/d10 0 2024-09-10T10:04:08.906 INFO:tasks.workunit.client.0.smithi071.stdout:7/55: rmdir d9 39 2024-09-10T10:04:08.907 INFO:tasks.workunit.client.0.smithi071.stdout:5/19: sync 2024-09-10T10:04:08.908 INFO:tasks.workunit.client.0.smithi071.stdout:6/33: rename d4 to d4/d9 22 2024-09-10T10:04:08.908 INFO:tasks.workunit.client.0.smithi071.stdout:8/102: dwrite d5/fd [0,4194304] 0 2024-09-10T10:04:08.908 INFO:tasks.workunit.client.0.smithi071.stdout:5/20: fdatasync f6 0 2024-09-10T10:04:08.910 INFO:tasks.workunit.client.1.smithi107.stdout:3/254: dwrite dc/dd/f1d [0,4194304] 0 2024-09-10T10:04:08.913 INFO:tasks.workunit.client.0.smithi071.stdout:3/66: unlink f2 0 2024-09-10T10:04:08.914 INFO:tasks.workunit.client.0.smithi071.stdout:1/43: getdents d1 0 2024-09-10T10:04:08.918 INFO:tasks.workunit.client.1.smithi107.stdout:9/250: write d5/f5c [1546671,97090] 0 2024-09-10T10:04:08.918 INFO:tasks.workunit.client.0.smithi071.stdout:6/34: dread d4/f6 [0,4194304] 0 2024-09-10T10:04:08.919 INFO:tasks.workunit.client.0.smithi071.stdout:5/21: symlink l7 0 2024-09-10T10:04:08.919 INFO:tasks.workunit.client.1.smithi107.stdout:3/255: link dc/dd/d20/d23/d39/f46 dc/dd/d45/d26/d41/d44/d35/f4b 0 2024-09-10T10:04:08.919 INFO:tasks.workunit.client.0.smithi071.stdout:7/56: symlink d9/ld 0 2024-09-10T10:04:08.919 INFO:tasks.workunit.client.0.smithi071.stdout:7/57: readlink l8 0 2024-09-10T10:04:08.920 INFO:tasks.workunit.client.0.smithi071.stdout:7/58: read f2 [761700,8536] 0 2024-09-10T10:04:08.922 INFO:tasks.workunit.client.1.smithi107.stdout:3/256: chown dc/dd/f17 1528 1 2024-09-10T10:04:08.924 INFO:tasks.workunit.client.0.smithi071.stdout:4/64: write f1 [1954995,14341] 0 2024-09-10T10:04:08.926 INFO:tasks.workunit.client.1.smithi107.stdout:3/257: creat dc/dd/d20/d23/d2f/f4c x:0 0 0 2024-09-10T10:04:08.926 INFO:tasks.workunit.client.0.smithi071.stdout:6/35: mkdir d4/da 0 2024-09-10T10:04:08.926 INFO:tasks.workunit.client.0.smithi071.stdout:1/44: creat d1/f9 x:0 0 0 2024-09-10T10:04:08.927 INFO:tasks.workunit.client.0.smithi071.stdout:7/59: creat d9/fe x:0 0 0 2024-09-10T10:04:08.929 INFO:tasks.workunit.client.0.smithi071.stdout:6/36: write f1 [1137139,114039] 0 2024-09-10T10:04:08.930 INFO:tasks.workunit.client.0.smithi071.stdout:1/45: write d1/f9 [719696,58606] 0 2024-09-10T10:04:08.931 INFO:tasks.workunit.client.1.smithi107.stdout:3/258: rename dc/dd/cf to dc/dd/d45/d26/d41/d44/d35/d4a/c4d 0 2024-09-10T10:04:08.931 INFO:tasks.workunit.client.0.smithi071.stdout:7/60: write d9/fb [449646,45667] 0 2024-09-10T10:04:08.931 INFO:tasks.workunit.client.0.smithi071.stdout:5/22: dwrite f4 [0,4194304] 0 2024-09-10T10:04:08.932 INFO:tasks.workunit.client.0.smithi071.stdout:2/45: truncate f1 4565 0 2024-09-10T10:04:08.933 INFO:tasks.workunit.client.1.smithi107.stdout:3/259: write dc/dd/d45/d26/d41/d44/f3c [646416,81018] 0 2024-09-10T10:04:08.933 INFO:tasks.workunit.client.0.smithi071.stdout:4/65: dread f9 [0,4194304] 0 2024-09-10T10:04:08.935 INFO:tasks.workunit.client.0.smithi071.stdout:5/23: creat f8 x:0 0 0 2024-09-10T10:04:08.936 INFO:tasks.workunit.client.0.smithi071.stdout:5/24: write f6 [876082,18299] 0 2024-09-10T10:04:08.937 INFO:tasks.workunit.client.0.smithi071.stdout:1/46: mknod d1/ca 0 2024-09-10T10:04:08.938 INFO:tasks.workunit.client.0.smithi071.stdout:6/37: getdents d4/da 0 2024-09-10T10:04:08.940 INFO:tasks.workunit.client.0.smithi071.stdout:5/25: mknod c9 0 2024-09-10T10:04:08.940 INFO:tasks.workunit.client.1.smithi107.stdout:3/260: read dc/dd/d45/d26/d41/d44/f2d [275680,88242] 0 2024-09-10T10:04:08.941 INFO:tasks.workunit.client.0.smithi071.stdout:2/46: getdents d8 0 2024-09-10T10:04:08.941 INFO:tasks.workunit.client.0.smithi071.stdout:4/66: mkdir db/d15/d17 0 2024-09-10T10:04:08.943 INFO:tasks.workunit.client.0.smithi071.stdout:4/67: truncate db/f12 1476081 0 2024-09-10T10:04:08.943 INFO:tasks.workunit.client.1.smithi107.stdout:3/261: creat dc/dd/d45/f4e x:0 0 0 2024-09-10T10:04:08.943 INFO:tasks.workunit.client.0.smithi071.stdout:5/26: unlink f1 0 2024-09-10T10:04:08.944 INFO:tasks.workunit.client.0.smithi071.stdout:6/38: dread d4/f6 [0,4194304] 0 2024-09-10T10:04:08.945 INFO:tasks.workunit.client.0.smithi071.stdout:5/27: symlink la 0 2024-09-10T10:04:08.946 INFO:tasks.workunit.client.1.smithi107.stdout:3/262: getdents dc 0 2024-09-10T10:04:08.946 INFO:tasks.workunit.client.0.smithi071.stdout:5/28: chown l7 1116 1 2024-09-10T10:04:08.947 INFO:tasks.workunit.client.0.smithi071.stdout:1/47: link d1/l8 d1/lb 0 2024-09-10T10:04:08.948 INFO:tasks.workunit.client.1.smithi107.stdout:3/263: write dc/dd/f31 [1616350,59962] 0 2024-09-10T10:04:08.948 INFO:tasks.workunit.client.0.smithi071.stdout:5/29: mknod cb 0 2024-09-10T10:04:08.951 INFO:tasks.workunit.client.0.smithi071.stdout:5/30: dread - f8 zero size 2024-09-10T10:04:08.951 INFO:tasks.workunit.client.0.smithi071.stdout:6/39: dread f1 [0,4194304] 0 2024-09-10T10:04:08.952 INFO:tasks.workunit.client.0.smithi071.stdout:5/31: mkdir dc 0 2024-09-10T10:04:08.953 INFO:tasks.workunit.client.0.smithi071.stdout:4/68: dwrite f3 [0,4194304] 0 2024-09-10T10:04:08.953 INFO:tasks.workunit.client.0.smithi071.stdout:6/40: fdatasync f1 0 2024-09-10T10:04:08.953 INFO:tasks.workunit.client.0.smithi071.stdout:5/32: dread - f8 zero size 2024-09-10T10:04:08.954 INFO:tasks.workunit.client.1.smithi107.stdout:3/264: dwrite dc/dd/f27 [0,4194304] 0 2024-09-10T10:04:08.955 INFO:tasks.workunit.client.0.smithi071.stdout:6/41: write f1 [3424312,86590] 0 2024-09-10T10:04:08.956 INFO:tasks.workunit.client.0.smithi071.stdout:1/48: dread d1/f3 [0,4194304] 0 2024-09-10T10:04:08.956 INFO:tasks.workunit.client.0.smithi071.stdout:4/69: unlink f1 0 2024-09-10T10:04:08.958 INFO:tasks.workunit.client.0.smithi071.stdout:4/70: write f4 [304119,53111] 0 2024-09-10T10:04:08.962 INFO:tasks.workunit.client.0.smithi071.stdout:6/42: write d4/f6 [1490473,81503] 0 2024-09-10T10:04:08.964 INFO:tasks.workunit.client.0.smithi071.stdout:6/43: chown l2 5 1 2024-09-10T10:04:08.964 INFO:tasks.workunit.client.0.smithi071.stdout:5/33: dwrite f6 [0,4194304] 0 2024-09-10T10:04:08.966 INFO:tasks.workunit.client.0.smithi071.stdout:4/71: creat db/d15/d17/f18 x:0 0 0 2024-09-10T10:04:08.966 INFO:tasks.workunit.client.0.smithi071.stdout:1/49: mknod d1/cc 0 2024-09-10T10:04:08.973 INFO:tasks.workunit.client.0.smithi071.stdout:4/72: dread f3 [0,4194304] 0 2024-09-10T10:04:08.973 INFO:tasks.workunit.client.0.smithi071.stdout:5/34: dwrite f6 [0,4194304] 0 2024-09-10T10:04:08.976 INFO:tasks.workunit.client.0.smithi071.stdout:6/44: creat d4/da/fb x:0 0 0 2024-09-10T10:04:08.981 INFO:tasks.workunit.client.0.smithi071.stdout:5/35: creat dc/fd x:0 0 0 2024-09-10T10:04:08.982 INFO:tasks.workunit.client.1.smithi107.stdout:3/265: dread f9 [0,4194304] 0 2024-09-10T10:04:08.983 INFO:tasks.workunit.client.1.smithi107.stdout:3/266: truncate dc/dd/d20/f3e 264254 0 2024-09-10T10:04:08.985 INFO:tasks.workunit.client.1.smithi107.stdout:3/267: creat dc/dd/f4f x:0 0 0 2024-09-10T10:04:08.986 INFO:tasks.workunit.client.1.smithi107.stdout:3/268: write dc/f24 [1467680,18471] 0 2024-09-10T10:04:08.987 INFO:tasks.workunit.client.1.smithi107.stdout:3/269: truncate dc/dd/d20/f3e 795935 0 2024-09-10T10:04:08.987 INFO:tasks.workunit.client.1.smithi107.stdout:3/270: truncate f7 5147014 0 2024-09-10T10:04:08.989 INFO:tasks.workunit.client.1.smithi107.stdout:3/271: creat dc/dd/d45/d26/f50 x:0 0 0 2024-09-10T10:04:08.990 INFO:tasks.workunit.client.1.smithi107.stdout:3/272: symlink dc/l51 0 2024-09-10T10:04:08.999 INFO:tasks.workunit.client.1.smithi107.stdout:3/273: truncate dc/dd/f27 1113948 0 2024-09-10T10:04:09.001 INFO:tasks.workunit.client.1.smithi107.stdout:3/274: mkdir dc/dd/d45/d26/d41/d44/d35/d52 0 2024-09-10T10:04:09.003 INFO:tasks.workunit.client.1.smithi107.stdout:3/275: creat dc/dd/d45/d26/d41/f53 x:0 0 0 2024-09-10T10:04:09.003 INFO:tasks.workunit.client.1.smithi107.stdout:3/276: mknod dc/dd/c54 0 2024-09-10T10:04:09.008 INFO:tasks.workunit.client.1.smithi107.stdout:3/277: truncate f1 6095943 0 2024-09-10T10:04:09.009 INFO:tasks.workunit.client.1.smithi107.stdout:3/278: mkdir dc/dd/d42/d55 0 2024-09-10T10:04:09.041 INFO:tasks.workunit.client.0.smithi071.stdout:9/159: sync 2024-09-10T10:04:09.042 INFO:tasks.workunit.client.0.smithi071.stdout:0/25: sync 2024-09-10T10:04:09.061 INFO:tasks.workunit.client.0.smithi071.stdout:5/36: creat dc/fe x:0 0 0 2024-09-10T10:04:09.061 INFO:tasks.workunit.client.0.smithi071.stdout:1/50: dwrite d1/f3 [4194304,4194304] 0 2024-09-10T10:04:09.063 INFO:tasks.workunit.client.0.smithi071.stdout:5/37: read - dc/fe zero size 2024-09-10T10:04:09.064 INFO:tasks.workunit.client.0.smithi071.stdout:0/26: unlink l6 0 2024-09-10T10:04:09.064 INFO:tasks.workunit.client.0.smithi071.stdout:1/51: write d1/f9 [537105,11934] 0 2024-09-10T10:04:09.066 INFO:tasks.workunit.client.0.smithi071.stdout:4/73: dwrite f3 [0,4194304] 0 2024-09-10T10:04:09.066 INFO:tasks.workunit.client.0.smithi071.stdout:6/45: dwrite f1 [0,4194304] 0 2024-09-10T10:04:09.067 INFO:tasks.workunit.client.0.smithi071.stdout:1/52: readlink d1/l8 0 2024-09-10T10:04:09.069 INFO:tasks.workunit.client.0.smithi071.stdout:1/53: write d1/f9 [1385149,126369] 0 2024-09-10T10:04:09.073 INFO:tasks.workunit.client.0.smithi071.stdout:9/160: getdents d0 0 2024-09-10T10:04:09.076 INFO:tasks.workunit.client.0.smithi071.stdout:0/27: link cb cc 0 2024-09-10T10:04:09.077 INFO:tasks.workunit.client.0.smithi071.stdout:6/46: dwrite d4/da/fb [0,4194304] 0 2024-09-10T10:04:09.082 INFO:tasks.workunit.client.0.smithi071.stdout:9/161: creat d0/db/d1b/d1d/f2f x:0 0 0 2024-09-10T10:04:09.083 INFO:tasks.workunit.client.0.smithi071.stdout:5/38: getdents dc 0 2024-09-10T10:04:09.083 INFO:tasks.workunit.client.0.smithi071.stdout:0/28: creat fd x:0 0 0 2024-09-10T10:04:09.084 INFO:tasks.workunit.client.0.smithi071.stdout:9/162: write d0/dc/d27/f2c [2510868,59038] 0 2024-09-10T10:04:09.084 INFO:tasks.workunit.client.0.smithi071.stdout:6/47: creat d4/da/fc x:0 0 0 2024-09-10T10:04:09.085 INFO:tasks.workunit.client.0.smithi071.stdout:0/29: write f9 [413920,76001] 0 2024-09-10T10:04:09.087 INFO:tasks.workunit.client.0.smithi071.stdout:5/39: mkdir dc/df 0 2024-09-10T10:04:09.087 INFO:tasks.workunit.client.0.smithi071.stdout:1/54: link d1/f6 d1/fd 0 2024-09-10T10:04:09.087 INFO:tasks.workunit.client.0.smithi071.stdout:5/40: fsync dc/fe 0 2024-09-10T10:04:09.088 INFO:tasks.workunit.client.0.smithi071.stdout:0/30: mknod ce 0 2024-09-10T10:04:09.088 INFO:tasks.workunit.client.0.smithi071.stdout:5/41: fsync f4 0 2024-09-10T10:04:09.089 INFO:tasks.workunit.client.0.smithi071.stdout:9/163: mkdir d0/db/d1b/d1d/d30 0 2024-09-10T10:04:09.089 INFO:tasks.workunit.client.0.smithi071.stdout:5/42: truncate f8 148262 0 2024-09-10T10:04:09.091 INFO:tasks.workunit.client.0.smithi071.stdout:0/31: creat ff x:0 0 0 2024-09-10T10:04:09.091 INFO:tasks.workunit.client.0.smithi071.stdout:5/43: rename c9 to dc/df/c10 0 2024-09-10T10:04:09.092 INFO:tasks.workunit.client.0.smithi071.stdout:9/164: symlink d0/db/d20/d21/l31 0 2024-09-10T10:04:09.093 INFO:tasks.workunit.client.0.smithi071.stdout:5/44: rmdir dc 39 2024-09-10T10:04:09.096 INFO:tasks.workunit.client.0.smithi071.stdout:1/55: rename d1/c2 to d1/ce 0 2024-09-10T10:04:09.100 INFO:tasks.workunit.client.0.smithi071.stdout:5/45: symlink dc/df/l11 0 2024-09-10T10:04:09.101 INFO:tasks.workunit.client.0.smithi071.stdout:9/165: getdents d0/db/d1b 0 2024-09-10T10:04:09.101 INFO:tasks.workunit.client.0.smithi071.stdout:4/74: truncate f3 4022785 0 2024-09-10T10:04:09.103 INFO:tasks.workunit.client.0.smithi071.stdout:5/46: creat dc/df/f12 x:0 0 0 2024-09-10T10:04:09.103 INFO:tasks.workunit.client.0.smithi071.stdout:1/56: dread d1/fd [0,4194304] 0 2024-09-10T10:04:09.103 INFO:tasks.workunit.client.0.smithi071.stdout:4/75: dread f9 [0,4194304] 0 2024-09-10T10:04:09.104 INFO:tasks.workunit.client.0.smithi071.stdout:9/166: mkdir d0/db/d20/d21/d32 0 2024-09-10T10:04:09.104 INFO:tasks.workunit.client.0.smithi071.stdout:6/48: truncate d4/f6 1346379 0 2024-09-10T10:04:09.105 INFO:tasks.workunit.client.0.smithi071.stdout:5/47: truncate dc/df/f12 110707 0 2024-09-10T10:04:09.105 INFO:tasks.workunit.client.0.smithi071.stdout:5/48: read f4 [859188,39038] 0 2024-09-10T10:04:09.107 INFO:tasks.workunit.client.0.smithi071.stdout:5/49: truncate dc/df/f12 1012721 0 2024-09-10T10:04:09.107 INFO:tasks.workunit.client.0.smithi071.stdout:4/76: symlink db/d15/d17/l19 0 2024-09-10T10:04:09.107 INFO:tasks.workunit.client.0.smithi071.stdout:0/32: truncate f9 340824 0 2024-09-10T10:04:09.107 INFO:tasks.workunit.client.0.smithi071.stdout:0/33: stat f8 0 2024-09-10T10:04:09.108 INFO:tasks.workunit.client.0.smithi071.stdout:9/167: dread d0/f2e [0,4194304] 0 2024-09-10T10:04:09.109 INFO:tasks.workunit.client.0.smithi071.stdout:5/50: creat dc/f13 x:0 0 0 2024-09-10T10:04:09.109 INFO:tasks.workunit.client.0.smithi071.stdout:9/168: rename d0 to d0/db/d20/d33 22 2024-09-10T10:04:09.110 INFO:tasks.workunit.client.0.smithi071.stdout:4/77: rename db/c14 to db/c1a 0 2024-09-10T10:04:09.111 INFO:tasks.workunit.client.0.smithi071.stdout:0/34: mknod c10 0 2024-09-10T10:04:09.114 INFO:tasks.workunit.client.0.smithi071.stdout:4/78: creat db/f1b x:0 0 0 2024-09-10T10:04:09.115 INFO:tasks.workunit.client.0.smithi071.stdout:0/35: mkdir d11 0 2024-09-10T10:04:09.117 INFO:tasks.workunit.client.0.smithi071.stdout:5/51: link dc/df/f12 dc/df/f14 0 2024-09-10T10:04:09.119 INFO:tasks.workunit.client.0.smithi071.stdout:4/79: symlink db/l1c 0 2024-09-10T10:04:09.120 INFO:tasks.workunit.client.0.smithi071.stdout:4/80: read f4 [249655,8716] 0 2024-09-10T10:04:09.121 INFO:tasks.workunit.client.0.smithi071.stdout:1/57: rename d1/ce to d1/cf 0 2024-09-10T10:04:09.121 INFO:tasks.workunit.client.0.smithi071.stdout:1/58: stat d1/f3 0 2024-09-10T10:04:09.122 INFO:tasks.workunit.client.0.smithi071.stdout:5/52: creat dc/f15 x:0 0 0 2024-09-10T10:04:09.123 INFO:tasks.workunit.client.0.smithi071.stdout:0/36: mknod d11/c12 0 2024-09-10T10:04:09.125 INFO:tasks.workunit.client.0.smithi071.stdout:5/53: mknod dc/c16 0 2024-09-10T10:04:09.127 INFO:tasks.workunit.client.0.smithi071.stdout:0/37: symlink d11/l13 0 2024-09-10T10:04:09.128 INFO:tasks.workunit.client.0.smithi071.stdout:0/38: readlink l4 0 2024-09-10T10:04:09.128 INFO:tasks.workunit.client.0.smithi071.stdout:9/169: truncate d0/db/f15 8132239 0 2024-09-10T10:04:09.129 INFO:tasks.workunit.client.0.smithi071.stdout:5/54: unlink l7 0 2024-09-10T10:04:09.129 INFO:tasks.workunit.client.0.smithi071.stdout:0/39: rmdir d11 39 2024-09-10T10:04:09.131 INFO:tasks.workunit.client.0.smithi071.stdout:9/170: creat d0/db/d20/d21/f34 x:0 0 0 2024-09-10T10:04:09.132 INFO:tasks.workunit.client.0.smithi071.stdout:5/55: mkdir dc/df/d17 0 2024-09-10T10:04:09.132 INFO:tasks.workunit.client.0.smithi071.stdout:1/59: link d1/lb d1/l10 0 2024-09-10T10:04:09.133 INFO:tasks.workunit.client.0.smithi071.stdout:0/40: dread f2 [0,4194304] 0 2024-09-10T10:04:09.136 INFO:tasks.workunit.client.0.smithi071.stdout:9/171: dread d0/db/f29 [0,4194304] 0 2024-09-10T10:04:09.136 INFO:tasks.workunit.client.0.smithi071.stdout:0/41: dread f9 [0,4194304] 0 2024-09-10T10:04:09.137 INFO:tasks.workunit.client.0.smithi071.stdout:1/60: dread d1/f6 [0,4194304] 0 2024-09-10T10:04:09.194 INFO:tasks.workunit.client.0.smithi071.stdout:8/103: sync 2024-09-10T10:04:09.199 INFO:tasks.workunit.client.1.smithi107.stdout:6/193: sync 2024-09-10T10:04:09.199 INFO:tasks.workunit.client.1.smithi107.stdout:8/139: sync 2024-09-10T10:04:09.199 INFO:tasks.workunit.client.1.smithi107.stdout:1/298: sync 2024-09-10T10:04:09.200 INFO:tasks.workunit.client.1.smithi107.stdout:6/194: chown d0/d3d/d14/d21/f33 321466013 1 2024-09-10T10:04:09.201 INFO:tasks.workunit.client.1.smithi107.stdout:1/299: creat d2/d12/f58 x:0 0 0 2024-09-10T10:04:09.202 INFO:tasks.workunit.client.1.smithi107.stdout:6/195: fdatasync d0/d3d/d14/d21/f22 0 2024-09-10T10:04:09.203 INFO:tasks.workunit.client.0.smithi071.stdout:5/56: dwrite f6 [0,4194304] 0 2024-09-10T10:04:09.204 INFO:tasks.workunit.client.1.smithi107.stdout:6/196: readlink d0/d3d/d14/l15 0 2024-09-10T10:04:09.206 INFO:tasks.workunit.client.0.smithi071.stdout:1/61: mknod d1/c11 0 2024-09-10T10:04:09.207 INFO:tasks.workunit.client.1.smithi107.stdout:8/140: dwrite d5/d8/fd [0,4194304] 0 2024-09-10T10:04:09.208 INFO:tasks.workunit.client.0.smithi071.stdout:8/104: mknod d5/df/d1d/c2b 0 2024-09-10T10:04:09.208 INFO:tasks.workunit.client.0.smithi071.stdout:5/57: creat dc/df/f18 x:0 0 0 2024-09-10T10:04:09.209 INFO:tasks.workunit.client.0.smithi071.stdout:5/58: chown dc/fe 1447 1 2024-09-10T10:04:09.210 INFO:tasks.workunit.client.0.smithi071.stdout:9/172: rename d0/dc/f12 to d0/db/d1b/d1d/f35 0 2024-09-10T10:04:09.211 INFO:tasks.workunit.client.1.smithi107.stdout:8/141: write d5/f19 [911605,87097] 0 2024-09-10T10:04:09.212 INFO:tasks.workunit.client.0.smithi071.stdout:0/42: dwrite f5 [4194304,4194304] 0 2024-09-10T10:04:09.212 INFO:tasks.workunit.client.0.smithi071.stdout:1/62: chown d1/l7 17 1 2024-09-10T10:04:09.214 INFO:tasks.workunit.client.1.smithi107.stdout:8/142: fdatasync d5/d8/f13 0 2024-09-10T10:04:09.215 INFO:tasks.workunit.client.0.smithi071.stdout:5/59: creat dc/df/f19 x:0 0 0 2024-09-10T10:04:09.217 INFO:tasks.workunit.client.0.smithi071.stdout:1/63: dread d1/f6 [0,4194304] 0 2024-09-10T10:04:09.217 INFO:tasks.workunit.client.0.smithi071.stdout:1/64: stat d1/cc 0 2024-09-10T10:04:09.217 INFO:tasks.workunit.client.1.smithi107.stdout:1/300: dwrite d2/d6/d24/f56 [0,4194304] 0 2024-09-10T10:04:09.218 INFO:tasks.workunit.client.0.smithi071.stdout:8/105: link d5/fe d5/df/d16/f2c 0 2024-09-10T10:04:09.220 INFO:tasks.workunit.client.1.smithi107.stdout:8/143: creat d5/d8/f34 x:0 0 0 2024-09-10T10:04:09.220 INFO:tasks.workunit.client.1.smithi107.stdout:6/197: dwrite d0/d3d/d14/d17/f3b [0,4194304] 0 2024-09-10T10:04:09.221 INFO:tasks.workunit.client.0.smithi071.stdout:5/60: rename dc/f15 to dc/f1a 0 2024-09-10T10:04:09.221 INFO:tasks.workunit.client.1.smithi107.stdout:8/144: read d5/d8/f20 [658913,86095] 0 2024-09-10T10:04:09.224 INFO:tasks.workunit.client.1.smithi107.stdout:1/301: mknod d2/d36/c59 0 2024-09-10T10:04:09.225 INFO:tasks.workunit.client.1.smithi107.stdout:1/302: chown d2/d6/d24 7 1 2024-09-10T10:04:09.226 INFO:tasks.workunit.client.1.smithi107.stdout:8/145: readlink d5/l17 0 2024-09-10T10:04:09.227 INFO:tasks.workunit.client.1.smithi107.stdout:8/146: chown d5/d8/dc/d1a 735 1 2024-09-10T10:04:09.228 INFO:tasks.workunit.client.1.smithi107.stdout:8/147: chown d5/d8/f34 19577116 1 2024-09-10T10:04:09.229 INFO:tasks.workunit.client.1.smithi107.stdout:1/303: mkdir d2/d12/d5a 0 2024-09-10T10:04:09.230 INFO:tasks.workunit.client.1.smithi107.stdout:1/304: read - d2/f49 zero size 2024-09-10T10:04:09.231 INFO:tasks.workunit.client.1.smithi107.stdout:6/198: creat d0/d3d/f40 x:0 0 0 2024-09-10T10:04:09.232 INFO:tasks.workunit.client.1.smithi107.stdout:8/148: mkdir d5/d8/d2a/d35 0 2024-09-10T10:04:09.233 INFO:tasks.workunit.client.1.smithi107.stdout:6/199: write d0/d3d/d14/d17/f3b [2839118,59146] 0 2024-09-10T10:04:09.235 INFO:tasks.workunit.client.0.smithi071.stdout:8/106: rmdir d5/df/d1d 39 2024-09-10T10:04:09.236 INFO:tasks.workunit.client.1.smithi107.stdout:1/305: link d2/f21 d2/d35/f5b 0 2024-09-10T10:04:09.237 INFO:tasks.workunit.client.1.smithi107.stdout:8/149: write d5/d8/f20 [1807201,102289] 0 2024-09-10T10:04:09.240 INFO:tasks.workunit.client.1.smithi107.stdout:1/306: rmdir d2/d6 39 2024-09-10T10:04:09.240 INFO:tasks.workunit.client.1.smithi107.stdout:8/150: write d5/ff [4979577,126031] 0 2024-09-10T10:04:09.241 INFO:tasks.workunit.client.0.smithi071.stdout:9/173: creat d0/dc/f36 x:0 0 0 2024-09-10T10:04:09.242 INFO:tasks.workunit.client.0.smithi071.stdout:9/174: fsync d0/db/f18 0 2024-09-10T10:04:09.242 INFO:tasks.workunit.client.1.smithi107.stdout:6/200: dwrite d0/f3e [0,4194304] 0 2024-09-10T10:04:09.243 INFO:tasks.workunit.client.0.smithi071.stdout:8/107: getdents d5/df/d1d 0 2024-09-10T10:04:09.243 INFO:tasks.workunit.client.1.smithi107.stdout:8/151: read d5/d8/f20 [2628091,63867] 0 2024-09-10T10:04:09.243 INFO:tasks.workunit.client.1.smithi107.stdout:1/307: truncate d2/d36/f4d 4602512 0 2024-09-10T10:04:09.244 INFO:tasks.workunit.client.0.smithi071.stdout:9/175: readlink d0/dc/d27/l2a 0 2024-09-10T10:04:09.245 INFO:tasks.workunit.client.0.smithi071.stdout:8/108: mkdir d5/df/d16/d2d 0 2024-09-10T10:04:09.245 INFO:tasks.workunit.client.0.smithi071.stdout:9/176: fsync d0/dc/d27/f2c 0 2024-09-10T10:04:09.246 INFO:tasks.workunit.client.1.smithi107.stdout:1/308: creat d2/d12/d5a/f5c x:0 0 0 2024-09-10T10:04:09.246 INFO:tasks.workunit.client.0.smithi071.stdout:9/177: chown d0/db/d20/d21/f34 2780 1 2024-09-10T10:04:09.247 INFO:tasks.workunit.client.0.smithi071.stdout:8/109: creat d5/df/d16/d2d/f2e x:0 0 0 2024-09-10T10:04:09.247 INFO:tasks.workunit.client.1.smithi107.stdout:8/152: rename d5/d8/dc/d21/d29 to d5/d8/dc/d18/d36 0 2024-09-10T10:04:09.248 INFO:tasks.workunit.client.1.smithi107.stdout:4/213: sync 2024-09-10T10:04:09.248 INFO:tasks.workunit.client.1.smithi107.stdout:7/215: sync 2024-09-10T10:04:09.248 INFO:tasks.workunit.client.1.smithi107.stdout:2/276: sync 2024-09-10T10:04:09.248 INFO:tasks.workunit.client.1.smithi107.stdout:0/179: sync 2024-09-10T10:04:09.248 INFO:tasks.workunit.client.1.smithi107.stdout:9/251: sync 2024-09-10T10:04:09.248 INFO:tasks.workunit.client.1.smithi107.stdout:5/199: sync 2024-09-10T10:04:09.248 INFO:tasks.workunit.client.1.smithi107.stdout:3/279: sync 2024-09-10T10:04:09.249 INFO:tasks.workunit.client.0.smithi071.stdout:8/110: chown d5/df/d1d/c2b 1147190 1 2024-09-10T10:04:09.250 INFO:tasks.workunit.client.1.smithi107.stdout:1/309: creat d2/d12/d5a/f5d x:0 0 0 2024-09-10T10:04:09.253 INFO:tasks.workunit.client.1.smithi107.stdout:4/214: dread - d0/d1f/d20/f51 zero size 2024-09-10T10:04:09.255 INFO:tasks.workunit.client.1.smithi107.stdout:2/277: fsync d3/da/df/f45 0 2024-09-10T10:04:09.260 INFO:tasks.workunit.client.1.smithi107.stdout:1/310: creat d2/d6/f5e x:0 0 0 2024-09-10T10:04:09.260 INFO:tasks.workunit.client.1.smithi107.stdout:6/201: dwrite d0/d3d/d14/d21/f23 [0,4194304] 0 2024-09-10T10:04:09.260 INFO:tasks.workunit.client.1.smithi107.stdout:9/252: read d5/d7/d1d/d3b/f4a [3541300,112783] 0 2024-09-10T10:04:09.261 INFO:tasks.workunit.client.1.smithi107.stdout:0/180: link d6/f7 d6/d8/d2f/f33 0 2024-09-10T10:04:09.262 INFO:tasks.workunit.client.1.smithi107.stdout:8/153: write d5/d8/f32 [1000230,76173] 0 2024-09-10T10:04:09.262 INFO:tasks.workunit.client.1.smithi107.stdout:2/278: mknod d3/da/d1e/d27/c59 0 2024-09-10T10:04:09.265 INFO:tasks.workunit.client.1.smithi107.stdout:7/216: rename d0/d8/dc/d2c/f3f to d0/d20/f41 0 2024-09-10T10:04:09.268 INFO:tasks.workunit.client.1.smithi107.stdout:8/154: write d5/f2f [381753,49786] 0 2024-09-10T10:04:09.273 INFO:tasks.workunit.client.1.smithi107.stdout:1/311: creat d2/d35/f5f x:0 0 0 2024-09-10T10:04:09.275 INFO:tasks.workunit.client.1.smithi107.stdout:7/217: rmdir d0/d8/dc 39 2024-09-10T10:04:09.275 INFO:tasks.workunit.client.1.smithi107.stdout:3/280: stat dc/dd/d45/d26/d41/d44/d35/f4b 0 2024-09-10T10:04:09.275 INFO:tasks.workunit.client.1.smithi107.stdout:9/253: creat d5/d7/d1d/d25/d27/f60 x:0 0 0 2024-09-10T10:04:09.275 INFO:tasks.workunit.client.1.smithi107.stdout:2/279: symlink d3/d21/d41/d55/l5a 0 2024-09-10T10:04:09.276 INFO:tasks.workunit.client.1.smithi107.stdout:1/312: chown d2/l37 3606 1 2024-09-10T10:04:09.277 INFO:tasks.workunit.client.1.smithi107.stdout:6/202: read d0/d3d/d14/f1f [300790,100685] 0 2024-09-10T10:04:09.278 INFO:tasks.workunit.client.1.smithi107.stdout:8/155: write d5/d8/dc/d1a/f1f [911114,126146] 0 2024-09-10T10:04:09.278 INFO:tasks.workunit.client.1.smithi107.stdout:4/215: dwrite d0/d1f/d20/f17 [0,4194304] 0 2024-09-10T10:04:09.282 INFO:tasks.workunit.client.1.smithi107.stdout:6/203: read d0/fd [818350,62970] 0 2024-09-10T10:04:09.283 INFO:tasks.workunit.client.0.smithi071.stdout:9/178: dwrite d0/f2e [4194304,4194304] 0 2024-09-10T10:04:09.284 INFO:tasks.workunit.client.1.smithi107.stdout:1/313: symlink d2/d12/l60 0 2024-09-10T10:04:09.289 INFO:tasks.workunit.client.1.smithi107.stdout:9/254: chown d5/d7/d1d/d25/d50/f56 1069 1 2024-09-10T10:04:09.289 INFO:tasks.workunit.client.0.smithi071.stdout:9/179: dwrite d0/db/f18 [0,4194304] 0 2024-09-10T10:04:09.290 INFO:tasks.workunit.client.0.smithi071.stdout:9/180: chown d0/db 907 1 2024-09-10T10:04:09.291 INFO:tasks.workunit.client.1.smithi107.stdout:7/218: fsync d0/d20/f37 0 2024-09-10T10:04:09.293 INFO:tasks.workunit.client.1.smithi107.stdout:4/216: mknod d0/c54 0 2024-09-10T10:04:09.294 INFO:tasks.workunit.client.1.smithi107.stdout:3/281: rmdir dc/dd/d45/d26/d41/d44/d35/d4a 39 2024-09-10T10:04:09.294 INFO:tasks.workunit.client.1.smithi107.stdout:2/280: mkdir d3/da/d1e/d27/d5b 0 2024-09-10T10:04:09.295 INFO:tasks.workunit.client.0.smithi071.stdout:9/181: dread d0/f9 [0,4194304] 0 2024-09-10T10:04:09.298 INFO:tasks.workunit.client.1.smithi107.stdout:8/156: rmdir d5/d8/dc/d18/d36 39 2024-09-10T10:04:09.299 INFO:tasks.workunit.client.1.smithi107.stdout:0/181: dwrite d6/f12 [0,4194304] 0 2024-09-10T10:04:09.300 INFO:tasks.workunit.client.1.smithi107.stdout:4/217: write d0/d1f/d20/f1e [221664,125677] 0 2024-09-10T10:04:09.304 INFO:tasks.workunit.client.1.smithi107.stdout:7/219: truncate d0/d20/f3a 1018952 0 2024-09-10T10:04:09.304 INFO:tasks.workunit.client.1.smithi107.stdout:9/255: dwrite d5/f5c [0,4194304] 0 2024-09-10T10:04:09.307 INFO:tasks.workunit.client.1.smithi107.stdout:6/204: creat d0/d3d/f41 x:0 0 0 2024-09-10T10:04:09.307 INFO:tasks.workunit.client.1.smithi107.stdout:3/282: mkdir dc/d56 0 2024-09-10T10:04:09.307 INFO:tasks.workunit.client.1.smithi107.stdout:4/218: dread - d0/d40/f41 zero size 2024-09-10T10:04:09.307 INFO:tasks.workunit.client.1.smithi107.stdout:2/281: unlink d3/da/d1e/d27/c30 0 2024-09-10T10:04:09.313 INFO:tasks.workunit.client.1.smithi107.stdout:1/314: dwrite d2/d6/d24/f56 [0,4194304] 0 2024-09-10T10:04:09.313 INFO:tasks.workunit.client.1.smithi107.stdout:2/282: truncate d3/da/df/d20/f57 685854 0 2024-09-10T10:04:09.313 INFO:tasks.workunit.client.1.smithi107.stdout:0/182: readlink d6/d8/d2f/l2b 0 2024-09-10T10:04:09.316 INFO:tasks.workunit.client.1.smithi107.stdout:2/283: read - d3/f49 zero size 2024-09-10T10:04:09.317 INFO:tasks.workunit.client.1.smithi107.stdout:4/219: creat d0/d1f/f55 x:0 0 0 2024-09-10T10:04:09.320 INFO:tasks.workunit.client.1.smithi107.stdout:1/315: creat d2/d35/f61 x:0 0 0 2024-09-10T10:04:09.320 INFO:tasks.workunit.client.1.smithi107.stdout:2/284: read d3/f1f [1423877,20620] 0 2024-09-10T10:04:09.320 INFO:tasks.workunit.client.1.smithi107.stdout:3/283: stat dc/dd/d45/d26/d41/d44/c40 0 2024-09-10T10:04:09.321 INFO:tasks.workunit.client.1.smithi107.stdout:8/157: rename d5/d8/dc/d18/d36 to d5/d8/dc/d21/d37 0 2024-09-10T10:04:09.321 INFO:tasks.workunit.client.1.smithi107.stdout:6/205: truncate d0/d3d/d14/d17/f3b 4566686 0 2024-09-10T10:04:09.322 INFO:tasks.workunit.client.1.smithi107.stdout:4/220: chown d0/d1f/d20/d2f/d4f 23322415 1 2024-09-10T10:04:09.323 INFO:tasks.workunit.client.1.smithi107.stdout:0/183: rename d6/d14/c2c to d6/d14/c34 0 2024-09-10T10:04:09.326 INFO:tasks.workunit.client.1.smithi107.stdout:8/158: truncate d5/d8/f13 422346 0 2024-09-10T10:04:09.327 INFO:tasks.workunit.client.1.smithi107.stdout:3/284: rmdir dc/dd/d45/d26/d41 39 2024-09-10T10:04:09.329 INFO:tasks.workunit.client.1.smithi107.stdout:9/256: link d5/d7/d1d/d25/d27/c36 d5/d7/d1d/c61 0 2024-09-10T10:04:09.333 INFO:tasks.workunit.client.1.smithi107.stdout:2/285: creat d3/da/d1e/d27/d5b/f5c x:0 0 0 2024-09-10T10:04:09.336 INFO:tasks.workunit.client.1.smithi107.stdout:9/257: creat d5/d7/d3c/d53/d57/f62 x:0 0 0 2024-09-10T10:04:09.337 INFO:tasks.workunit.client.1.smithi107.stdout:4/221: creat d0/d1f/d20/d47/f56 x:0 0 0 2024-09-10T10:04:09.338 INFO:tasks.workunit.client.1.smithi107.stdout:1/316: dwrite d2/d2a/f41 [0,4194304] 0 2024-09-10T10:04:09.338 INFO:tasks.workunit.client.1.smithi107.stdout:0/184: write d6/d8/d2f/f33 [929817,102293] 0 2024-09-10T10:04:09.340 INFO:tasks.workunit.client.1.smithi107.stdout:8/159: write d5/d8/f9 [1729920,9249] 0 2024-09-10T10:04:09.340 INFO:tasks.workunit.client.1.smithi107.stdout:2/286: rmdir d3/da/df/d20/d36/d4f 39 2024-09-10T10:04:09.342 INFO:tasks.workunit.client.1.smithi107.stdout:9/258: dread - d5/d7/d1d/d25/d27/f51 zero size 2024-09-10T10:04:09.343 INFO:tasks.workunit.client.1.smithi107.stdout:1/317: fdatasync d2/d35/f4a 0 2024-09-10T10:04:09.343 INFO:tasks.workunit.client.1.smithi107.stdout:3/285: rename dc/dd/d45/d26/d41/d44/d35/f32 to dc/dd/d20/d23/f57 0 2024-09-10T10:04:09.345 INFO:tasks.workunit.client.1.smithi107.stdout:8/160: write d5/d8/f9 [1295367,20600] 0 2024-09-10T10:04:09.345 INFO:tasks.workunit.client.1.smithi107.stdout:7/220: dread d0/f4 [0,4194304] 0 2024-09-10T10:04:09.349 INFO:tasks.workunit.client.1.smithi107.stdout:1/318: chown d2/d6/l1d 1980193 1 2024-09-10T10:04:09.350 INFO:tasks.workunit.client.0.smithi071.stdout:3/67: sync 2024-09-10T10:04:09.351 INFO:tasks.workunit.client.1.smithi107.stdout:0/185: rmdir d6/d8/d2f/d2e/d30 0 2024-09-10T10:04:09.353 INFO:tasks.workunit.client.1.smithi107.stdout:6/206: dread d0/d3d/d14/d21/f22 [0,4194304] 0 2024-09-10T10:04:09.353 INFO:tasks.workunit.client.1.smithi107.stdout:4/222: rename d0/d1f/d20/d2f to d0/d40/d57 0 2024-09-10T10:04:09.355 INFO:tasks.workunit.client.1.smithi107.stdout:1/319: rmdir d2 39 2024-09-10T10:04:09.355 INFO:tasks.workunit.client.1.smithi107.stdout:0/186: mkdir d6/d8/d2f/d35 0 2024-09-10T10:04:09.356 INFO:tasks.workunit.client.1.smithi107.stdout:3/286: mkdir dc/dd/d42/d55/d58 0 2024-09-10T10:04:09.356 INFO:tasks.workunit.client.1.smithi107.stdout:6/207: write d0/d3d/d14/d17/f3b [2546012,108316] 0 2024-09-10T10:04:09.356 INFO:tasks.workunit.client.1.smithi107.stdout:4/223: fsync d0/f1d 0 2024-09-10T10:04:09.358 INFO:tasks.workunit.client.1.smithi107.stdout:6/208: readlink d0/l37 0 2024-09-10T10:04:09.359 INFO:tasks.workunit.client.1.smithi107.stdout:2/287: dwrite d3/da/d1e/d27/f2e [0,4194304] 0 2024-09-10T10:04:09.361 INFO:tasks.workunit.client.1.smithi107.stdout:4/224: chown d0/d29/d3f/f4b 526895 1 2024-09-10T10:04:09.362 INFO:tasks.workunit.client.1.smithi107.stdout:7/221: link d0/d8/ld d0/d8/dc/d2c/l42 0 2024-09-10T10:04:09.362 INFO:tasks.workunit.client.1.smithi107.stdout:3/287: write dc/dd/d45/d26/d41/d44/f1f [436813,83941] 0 2024-09-10T10:04:09.364 INFO:tasks.workunit.client.1.smithi107.stdout:3/288: fsync dc/f24 0 2024-09-10T10:04:09.371 INFO:tasks.workunit.client.1.smithi107.stdout:1/320: truncate d2/f29 1702336 0 2024-09-10T10:04:09.375 INFO:tasks.workunit.client.1.smithi107.stdout:6/209: dwrite d0/f2c [0,4194304] 0 2024-09-10T10:04:09.376 INFO:tasks.workunit.client.1.smithi107.stdout:7/222: truncate d0/d8/dc/f1f 993533 0 2024-09-10T10:04:09.379 INFO:tasks.workunit.client.1.smithi107.stdout:4/225: dwrite d0/d1f/d20/f21 [0,4194304] 0 2024-09-10T10:04:09.380 INFO:tasks.workunit.client.1.smithi107.stdout:1/321: creat d2/d12/d5a/f62 x:0 0 0 2024-09-10T10:04:09.380 INFO:tasks.workunit.client.1.smithi107.stdout:6/210: mkdir d0/d3d/d14/d42 0 2024-09-10T10:04:09.381 INFO:tasks.workunit.client.1.smithi107.stdout:4/226: write d0/f10 [4727393,3007] 0 2024-09-10T10:04:09.384 INFO:tasks.workunit.client.1.smithi107.stdout:7/223: mknod d0/d20/d35/c43 0 2024-09-10T10:04:09.385 INFO:tasks.workunit.client.1.smithi107.stdout:1/322: dread - d2/d12/f31 zero size 2024-09-10T10:04:09.385 INFO:tasks.workunit.client.1.smithi107.stdout:3/289: dwrite dc/dd/d20/d23/f57 [0,4194304] 0 2024-09-10T10:04:09.388 INFO:tasks.workunit.client.1.smithi107.stdout:4/227: write d0/fb [691570,68504] 0 2024-09-10T10:04:09.388 INFO:tasks.workunit.client.1.smithi107.stdout:1/323: symlink d2/d12/l63 0 2024-09-10T10:04:09.393 INFO:tasks.workunit.client.1.smithi107.stdout:7/224: rename d0/d8/dc/f2a to d0/d20/f44 0 2024-09-10T10:04:09.393 INFO:tasks.workunit.client.1.smithi107.stdout:1/324: symlink d2/d6/d24/l64 0 2024-09-10T10:04:09.394 INFO:tasks.workunit.client.1.smithi107.stdout:1/325: write d2/d35/f3f [585731,17297] 0 2024-09-10T10:04:09.395 INFO:tasks.workunit.client.1.smithi107.stdout:4/228: creat d0/d40/d57/d4f/f58 x:0 0 0 2024-09-10T10:04:09.397 INFO:tasks.workunit.client.1.smithi107.stdout:4/229: read - d0/d40/d57/f3e zero size 2024-09-10T10:04:09.397 INFO:tasks.workunit.client.1.smithi107.stdout:3/290: dwrite dc/dd/d20/d23/f57 [0,4194304] 0 2024-09-10T10:04:09.404 INFO:tasks.workunit.client.1.smithi107.stdout:4/230: write d0/d1f/d20/f50 [1563176,80771] 0 2024-09-10T10:04:09.409 INFO:tasks.workunit.client.1.smithi107.stdout:6/211: dwrite d0/f2a [0,4194304] 0 2024-09-10T10:04:09.409 INFO:tasks.workunit.client.1.smithi107.stdout:1/326: dwrite d2/d6/f2d [0,4194304] 0 2024-09-10T10:04:09.409 INFO:tasks.workunit.client.1.smithi107.stdout:4/231: dread - d0/d1f/f2e zero size 2024-09-10T10:04:09.413 INFO:tasks.workunit.client.1.smithi107.stdout:7/225: write d0/d8/dc/f1f [1100810,126212] 0 2024-09-10T10:04:09.414 INFO:tasks.workunit.client.1.smithi107.stdout:4/232: unlink d0/d1f/f2e 0 2024-09-10T10:04:09.416 INFO:tasks.workunit.client.1.smithi107.stdout:7/226: readlink d0/d8/l15 0 2024-09-10T10:04:09.416 INFO:tasks.workunit.client.1.smithi107.stdout:4/233: stat d0/lf 0 2024-09-10T10:04:09.416 INFO:tasks.workunit.client.1.smithi107.stdout:6/212: rename d0/f2a to d0/d3d/d14/d21/f43 0 2024-09-10T10:04:09.422 INFO:tasks.workunit.client.1.smithi107.stdout:7/227: symlink d0/d20/l45 0 2024-09-10T10:04:09.423 INFO:tasks.workunit.client.1.smithi107.stdout:4/234: write d0/fb [2586477,46137] 0 2024-09-10T10:04:09.430 INFO:tasks.workunit.client.1.smithi107.stdout:1/327: dwrite d2/d6/f52 [0,4194304] 0 2024-09-10T10:04:09.432 INFO:tasks.workunit.client.1.smithi107.stdout:6/213: link d0/d3d/d14/d17/c2f d0/c44 0 2024-09-10T10:04:09.432 INFO:tasks.workunit.client.1.smithi107.stdout:4/235: mkdir d0/d29/d3f/d59 0 2024-09-10T10:04:09.433 INFO:tasks.workunit.client.1.smithi107.stdout:9/259: dread d5/d7/f9 [0,4194304] 0 2024-09-10T10:04:09.436 INFO:tasks.workunit.client.1.smithi107.stdout:3/291: dwrite dc/dd/d45/f2e [0,4194304] 0 2024-09-10T10:04:09.437 INFO:tasks.workunit.client.1.smithi107.stdout:4/236: chown d0/d29/d3f/f4b 171201973 1 2024-09-10T10:04:09.437 INFO:tasks.workunit.client.1.smithi107.stdout:1/328: truncate d2/d36/f55 368891 0 2024-09-10T10:04:09.440 INFO:tasks.workunit.client.1.smithi107.stdout:9/260: read - d5/d7/d1d/d25/d50/f56 zero size 2024-09-10T10:04:09.441 INFO:tasks.workunit.client.1.smithi107.stdout:6/214: truncate d0/d3d/d14/d21/f33 475665 0 2024-09-10T10:04:09.442 INFO:tasks.workunit.client.1.smithi107.stdout:3/292: mkdir dc/dd/d45/d26/d59 0 2024-09-10T10:04:09.448 INFO:tasks.workunit.client.1.smithi107.stdout:3/293: write dc/f24 [1625664,97410] 0 2024-09-10T10:04:09.448 INFO:tasks.workunit.client.1.smithi107.stdout:7/228: dwrite d0/d8/dc/f2d [0,4194304] 0 2024-09-10T10:04:09.451 INFO:tasks.workunit.client.1.smithi107.stdout:9/261: unlink d5/d7/d1d/d25/d27/l46 0 2024-09-10T10:04:09.454 INFO:tasks.workunit.client.1.smithi107.stdout:7/229: rmdir d0 39 2024-09-10T10:04:09.457 INFO:tasks.workunit.client.1.smithi107.stdout:6/215: rename d0/d3d/f31 to d0/f45 0 2024-09-10T10:04:09.458 INFO:tasks.workunit.client.1.smithi107.stdout:1/329: dwrite d2/d12/f31 [0,4194304] 0 2024-09-10T10:04:09.460 INFO:tasks.workunit.client.1.smithi107.stdout:4/237: dwrite d0/fb [0,4194304] 0 2024-09-10T10:04:09.461 INFO:tasks.workunit.client.1.smithi107.stdout:9/262: creat d5/d7/d1d/d25/d37/f63 x:0 0 0 2024-09-10T10:04:09.462 INFO:tasks.workunit.client.1.smithi107.stdout:7/230: symlink d0/d1b/l46 0 2024-09-10T10:04:09.464 INFO:tasks.workunit.client.1.smithi107.stdout:6/216: write d0/d3d/f40 [942649,114289] 0 2024-09-10T10:04:09.466 INFO:tasks.workunit.client.1.smithi107.stdout:9/263: write d5/d1e/f1f [4631583,18376] 0 2024-09-10T10:04:09.468 INFO:tasks.workunit.client.1.smithi107.stdout:7/231: write d0/d20/f44 [329635,8868] 0 2024-09-10T10:04:09.468 INFO:tasks.workunit.client.1.smithi107.stdout:3/294: write dc/dd/d45/d26/d41/d44/d35/f19 [1456809,3264] 0 2024-09-10T10:04:09.469 INFO:tasks.workunit.client.1.smithi107.stdout:6/217: mknod d0/d3d/d14/d17/d24/c46 0 2024-09-10T10:04:09.473 INFO:tasks.workunit.client.1.smithi107.stdout:7/232: unlink d0/d20/l23 0 2024-09-10T10:04:09.475 INFO:tasks.workunit.client.0.smithi071.stdout:2/47: sync 2024-09-10T10:04:09.475 INFO:tasks.workunit.client.0.smithi071.stdout:7/61: sync 2024-09-10T10:04:09.475 INFO:tasks.workunit.client.0.smithi071.stdout:6/49: sync 2024-09-10T10:04:09.477 INFO:tasks.workunit.client.1.smithi107.stdout:6/218: creat d0/d3d/d14/d17/f47 x:0 0 0 2024-09-10T10:04:09.478 INFO:tasks.workunit.client.1.smithi107.stdout:4/238: dwrite d0/d1f/d20/f30 [0,4194304] 0 2024-09-10T10:04:09.478 INFO:tasks.workunit.client.0.smithi071.stdout:7/62: write f3 [478916,129441] 0 2024-09-10T10:04:09.478 INFO:tasks.workunit.client.0.smithi071.stdout:6/50: write f1 [3224198,98790] 0 2024-09-10T10:04:09.486 INFO:tasks.workunit.client.0.smithi071.stdout:6/51: dwrite d4/da/fb [0,4194304] 0 2024-09-10T10:04:09.487 INFO:tasks.workunit.client.1.smithi107.stdout:7/233: mkdir d0/d8/dc/d2c/d47 0 2024-09-10T10:04:09.488 INFO:tasks.workunit.client.1.smithi107.stdout:3/295: dread dc/dd/d45/d26/d41/d44/f2d [0,4194304] 0 2024-09-10T10:04:09.488 INFO:tasks.workunit.client.1.smithi107.stdout:7/234: chown d0/d20 1019553 1 2024-09-10T10:04:09.489 INFO:tasks.workunit.client.1.smithi107.stdout:9/264: getdents d5/d7/d3c/d53/d57 0 2024-09-10T10:04:09.490 INFO:tasks.workunit.client.1.smithi107.stdout:6/219: symlink d0/d3d/d14/l48 0 2024-09-10T10:04:09.491 INFO:tasks.workunit.client.1.smithi107.stdout:4/239: dwrite d0/d1f/d20/f1e [0,4194304] 0 2024-09-10T10:04:09.493 INFO:tasks.workunit.client.1.smithi107.stdout:9/265: write d5/d7/f13 [4963004,41566] 0 2024-09-10T10:04:09.495 INFO:tasks.workunit.client.1.smithi107.stdout:6/220: mkdir d0/d3d/d14/d17/d49 0 2024-09-10T10:04:09.501 INFO:tasks.workunit.client.1.smithi107.stdout:4/240: link d0/lc d0/d29/l5a 0 2024-09-10T10:04:09.505 INFO:tasks.workunit.client.1.smithi107.stdout:4/241: write d0/d1f/d20/f1e [695397,9559] 0 2024-09-10T10:04:09.507 INFO:tasks.workunit.client.1.smithi107.stdout:7/235: dwrite d0/f4 [4194304,4194304] 0 2024-09-10T10:04:09.507 INFO:tasks.workunit.client.1.smithi107.stdout:1/330: dread d2/d6/fa [0,4194304] 0 2024-09-10T10:04:09.509 INFO:tasks.workunit.client.1.smithi107.stdout:9/266: rename d5/d7/d1d/f3e to d5/f64 0 2024-09-10T10:04:09.512 INFO:tasks.workunit.client.1.smithi107.stdout:3/296: dwrite dc/dd/d45/d26/d41/d44/d35/f2a [0,4194304] 0 2024-09-10T10:04:09.513 INFO:tasks.workunit.client.0.smithi071.stdout:9/182: rename d0/dc/f25 to d0/db/f37 0 2024-09-10T10:04:09.513 INFO:tasks.workunit.client.0.smithi071.stdout:2/48: rename d8 to d8/d9 22 2024-09-10T10:04:09.514 INFO:tasks.workunit.client.0.smithi071.stdout:3/68: readlink d3/l13 0 2024-09-10T10:04:09.514 INFO:tasks.workunit.client.0.smithi071.stdout:2/49: stat d8 0 2024-09-10T10:04:09.514 INFO:tasks.workunit.client.1.smithi107.stdout:1/331: readlink d2/d6/d24/l64 0 2024-09-10T10:04:09.514 INFO:tasks.workunit.client.1.smithi107.stdout:4/242: fdatasync d0/d40/d57/f3b 0 2024-09-10T10:04:09.514 INFO:tasks.workunit.client.1.smithi107.stdout:9/267: rename d5/d1e/f1f to d5/d7/d1d/d25/d50/f65 0 2024-09-10T10:04:09.516 INFO:tasks.workunit.client.1.smithi107.stdout:3/297: truncate dc/dd/d45/d26/f3a 938106 0 2024-09-10T10:04:09.517 INFO:tasks.workunit.client.0.smithi071.stdout:6/52: creat d4/fd x:0 0 0 2024-09-10T10:04:09.517 INFO:tasks.workunit.client.1.smithi107.stdout:9/268: readlink d5/d7/d1d/d25/d50/l2d 0 2024-09-10T10:04:09.517 INFO:tasks.workunit.client.0.smithi071.stdout:6/53: read - d4/da/fc zero size 2024-09-10T10:04:09.520 INFO:tasks.workunit.client.0.smithi071.stdout:2/50: mknod d8/ca 0 2024-09-10T10:04:09.520 INFO:tasks.workunit.client.1.smithi107.stdout:3/298: rmdir dc/dd/d20 39 2024-09-10T10:04:09.521 INFO:tasks.workunit.client.0.smithi071.stdout:3/69: getdents d3/d10 0 2024-09-10T10:04:09.521 INFO:tasks.workunit.client.1.smithi107.stdout:3/299: readlink dc/dd/l30 0 2024-09-10T10:04:09.522 INFO:tasks.workunit.client.1.smithi107.stdout:9/269: chown d5/d7/d1d/f3f 174388 1 2024-09-10T10:04:09.522 INFO:tasks.workunit.client.0.smithi071.stdout:9/183: creat d0/dc/f38 x:0 0 0 2024-09-10T10:04:09.523 INFO:tasks.workunit.client.0.smithi071.stdout:3/70: rmdir d3 39 2024-09-10T10:04:09.525 INFO:tasks.workunit.client.1.smithi107.stdout:9/270: mknod d5/c66 0 2024-09-10T10:04:09.525 INFO:tasks.workunit.client.1.smithi107.stdout:3/300: dread f9 [0,4194304] 0 2024-09-10T10:04:09.527 INFO:tasks.workunit.client.1.smithi107.stdout:9/271: write d5/f64 [1394978,88396] 0 2024-09-10T10:04:09.527 INFO:tasks.workunit.client.0.smithi071.stdout:9/184: dread d0/db/f17 [0,4194304] 0 2024-09-10T10:04:09.529 INFO:tasks.workunit.client.0.smithi071.stdout:3/71: mkdir d3/d15 0 2024-09-10T10:04:09.530 INFO:tasks.workunit.client.0.smithi071.stdout:4/81: sync 2024-09-10T10:04:09.530 INFO:tasks.workunit.client.0.smithi071.stdout:9/185: creat d0/db/f39 x:0 0 0 2024-09-10T10:04:09.531 INFO:tasks.workunit.client.1.smithi107.stdout:3/301: creat dc/dd/d45/d26/d41/d44/d35/d4a/f5a x:0 0 0 2024-09-10T10:04:09.532 INFO:tasks.workunit.client.1.smithi107.stdout:6/221: truncate d0/f3e 1852322 0 2024-09-10T10:04:09.532 INFO:tasks.workunit.client.0.smithi071.stdout:4/82: mkdir db/d1d 0 2024-09-10T10:04:09.532 INFO:tasks.workunit.client.1.smithi107.stdout:6/222: chown d0/f45 104328467 1 2024-09-10T10:04:09.535 INFO:tasks.workunit.client.0.smithi071.stdout:9/186: rename d0/dc/f36 to d0/db/d1b/d1d/f3a 0 2024-09-10T10:04:09.535 INFO:tasks.workunit.client.1.smithi107.stdout:4/243: truncate d0/d1f/d20/f50 1072937 0 2024-09-10T10:04:09.537 INFO:tasks.workunit.client.1.smithi107.stdout:3/302: mknod dc/dd/d20/d23/c5b 0 2024-09-10T10:04:09.537 INFO:tasks.workunit.client.0.smithi071.stdout:3/72: dwrite d3/fa [0,4194304] 0 2024-09-10T10:04:09.537 INFO:tasks.workunit.client.0.smithi071.stdout:9/187: write d0/db/f39 [3187,82201] 0 2024-09-10T10:04:09.538 INFO:tasks.workunit.client.1.smithi107.stdout:4/244: read d0/f11 [3066303,33347] 0 2024-09-10T10:04:09.538 INFO:tasks.workunit.client.1.smithi107.stdout:3/303: stat dc/dd/d45/d26/d41/d44/f3c 0 2024-09-10T10:04:09.539 INFO:tasks.workunit.client.0.smithi071.stdout:9/188: write d0/db/d20/d21/f34 [253690,124264] 0 2024-09-10T10:04:09.539 INFO:tasks.workunit.client.0.smithi071.stdout:4/83: mknod db/d1d/c1e 0 2024-09-10T10:04:09.540 INFO:tasks.workunit.client.0.smithi071.stdout:9/189: readlink d0/db/l14 0 2024-09-10T10:04:09.541 INFO:tasks.workunit.client.1.smithi107.stdout:6/223: dwrite d0/d3d/d14/d21/f33 [0,4194304] 0 2024-09-10T10:04:09.543 INFO:tasks.workunit.client.0.smithi071.stdout:4/84: creat db/d15/d17/f1f x:0 0 0 2024-09-10T10:04:09.544 INFO:tasks.workunit.client.1.smithi107.stdout:4/245: creat d0/d29/d3f/f5b x:0 0 0 2024-09-10T10:04:09.544 INFO:tasks.workunit.client.0.smithi071.stdout:9/190: mkdir d0/d3b 0 2024-09-10T10:04:09.546 INFO:tasks.workunit.client.0.smithi071.stdout:4/85: symlink db/d1d/l20 0 2024-09-10T10:04:09.547 INFO:tasks.workunit.client.0.smithi071.stdout:9/191: read d0/db/d1b/f24 [8160940,23825] 0 2024-09-10T10:04:09.547 INFO:tasks.workunit.client.0.smithi071.stdout:4/86: truncate db/f1b 406134 0 2024-09-10T10:04:09.549 INFO:tasks.workunit.client.0.smithi071.stdout:4/87: dread - db/d15/d17/f1f zero size 2024-09-10T10:04:09.549 INFO:tasks.workunit.client.0.smithi071.stdout:9/192: rmdir d0/db/d1b 39 2024-09-10T10:04:09.552 INFO:tasks.workunit.client.0.smithi071.stdout:4/88: mkdir db/d15/d17/d21 0 2024-09-10T10:04:09.553 INFO:tasks.workunit.client.0.smithi071.stdout:9/193: unlink d0/dc/f38 0 2024-09-10T10:04:09.556 INFO:tasks.workunit.client.0.smithi071.stdout:9/194: dread d0/db/f39 [0,4194304] 0 2024-09-10T10:04:09.556 INFO:tasks.workunit.client.0.smithi071.stdout:4/89: rename db/d15/d17/d21 to db/d15/d22 0 2024-09-10T10:04:09.557 INFO:tasks.workunit.client.0.smithi071.stdout:9/195: fsync d0/dc/f2d 0 2024-09-10T10:04:09.557 INFO:tasks.workunit.client.0.smithi071.stdout:9/196: read - d0/db/f37 zero size 2024-09-10T10:04:09.559 INFO:tasks.workunit.client.0.smithi071.stdout:9/197: mkdir d0/db/d20/d3c 0 2024-09-10T10:04:09.561 INFO:tasks.workunit.client.0.smithi071.stdout:9/198: write d0/db/f37 [890421,121535] 0 2024-09-10T10:04:09.561 INFO:tasks.workunit.client.0.smithi071.stdout:9/199: truncate d0/fa 4577854 0 2024-09-10T10:04:09.568 INFO:tasks.workunit.client.0.smithi071.stdout:9/200: dwrite d0/db/f15 [0,4194304] 0 2024-09-10T10:04:09.571 INFO:tasks.workunit.client.0.smithi071.stdout:9/201: mkdir d0/db/d1b/d1d/d3d 0 2024-09-10T10:04:09.576 INFO:tasks.workunit.client.0.smithi071.stdout:9/202: truncate d0/dc/d27/f2c 1161401 0 2024-09-10T10:04:09.578 INFO:tasks.workunit.client.0.smithi071.stdout:9/203: creat d0/d3b/f3e x:0 0 0 2024-09-10T10:04:09.580 INFO:tasks.workunit.client.0.smithi071.stdout:9/204: dread d0/db/f39 [0,4194304] 0 2024-09-10T10:04:09.581 INFO:tasks.workunit.client.0.smithi071.stdout:9/205: mknod d0/dc/c3f 0 2024-09-10T10:04:09.583 INFO:tasks.workunit.client.0.smithi071.stdout:9/206: creat d0/db/d1b/d1d/f40 x:0 0 0 2024-09-10T10:04:09.584 INFO:tasks.workunit.client.0.smithi071.stdout:9/207: chown d0/dc/d27/f2c 202259 1 2024-09-10T10:04:09.585 INFO:tasks.workunit.client.0.smithi071.stdout:9/208: creat d0/db/d20/d21/f41 x:0 0 0 2024-09-10T10:04:09.588 INFO:tasks.workunit.client.0.smithi071.stdout:9/209: link d0/db/d1b/d1d/f2f d0/f42 0 2024-09-10T10:04:09.588 INFO:tasks.workunit.client.1.smithi107.stdout:6/224: write d0/f19 [3443901,50099] 0 2024-09-10T10:04:09.589 INFO:tasks.workunit.client.1.smithi107.stdout:6/225: stat d0/f45 0 2024-09-10T10:04:09.590 INFO:tasks.workunit.client.0.smithi071.stdout:9/210: symlink d0/db/d20/l43 0 2024-09-10T10:04:09.590 INFO:tasks.workunit.client.1.smithi107.stdout:3/304: rename dc/dd/d20/d23/d39/f46 to dc/dd/d45/d26/d41/d44/d35/d4a/f5c 0 2024-09-10T10:04:09.592 INFO:tasks.workunit.client.0.smithi071.stdout:9/211: mkdir d0/d3b/d44 0 2024-09-10T10:04:09.596 INFO:tasks.workunit.client.1.smithi107.stdout:9/272: dread d5/f6 [0,4194304] 0 2024-09-10T10:04:09.596 INFO:tasks.workunit.client.1.smithi107.stdout:4/246: truncate d0/f11 5277103 0 2024-09-10T10:04:09.597 INFO:tasks.workunit.client.0.smithi071.stdout:9/212: rename d0/dc/f1c to d0/db/d20/d21/f45 0 2024-09-10T10:04:09.597 INFO:tasks.workunit.client.1.smithi107.stdout:6/226: truncate d0/d3d/d14/d21/f28 3476109 0 2024-09-10T10:04:09.597 INFO:tasks.workunit.client.1.smithi107.stdout:9/273: rename d5 to d5/d7/d1d/d29/d67 22 2024-09-10T10:04:09.598 INFO:tasks.workunit.client.0.smithi071.stdout:9/213: mkdir d0/db/d1b/d46 0 2024-09-10T10:04:09.599 INFO:tasks.workunit.client.1.smithi107.stdout:3/305: dwrite dc/dd/f27 [0,4194304] 0 2024-09-10T10:04:09.600 INFO:tasks.workunit.client.1.smithi107.stdout:4/247: rmdir d0/d1f/d20 39 2024-09-10T10:04:09.601 INFO:tasks.workunit.client.1.smithi107.stdout:4/248: readlink d0/d1f/l3c 0 2024-09-10T10:04:09.602 INFO:tasks.workunit.client.0.smithi071.stdout:9/214: write d0/db/d1b/d1d/f35 [1432842,40061] 0 2024-09-10T10:04:09.603 INFO:tasks.workunit.client.1.smithi107.stdout:6/227: rename d0/c34 to d0/d3d/d14/d17/d24/c4a 0 2024-09-10T10:04:09.603 INFO:tasks.workunit.client.1.smithi107.stdout:6/228: chown d0 7 1 2024-09-10T10:04:09.605 INFO:tasks.workunit.client.1.smithi107.stdout:9/274: unlink d5/d7/d1d/l23 0 2024-09-10T10:04:09.607 INFO:tasks.workunit.client.1.smithi107.stdout:3/306: symlink dc/dd/d42/d55/l5d 0 2024-09-10T10:04:09.608 INFO:tasks.workunit.client.0.smithi071.stdout:9/215: link d0/db/d1b/d1d/f40 d0/dc/d27/f47 0 2024-09-10T10:04:09.608 INFO:tasks.workunit.client.0.smithi071.stdout:9/216: stat d0/dc/f1a 0 2024-09-10T10:04:09.609 INFO:tasks.workunit.client.1.smithi107.stdout:6/229: mkdir d0/d3d/d14/d17/d4b 0 2024-09-10T10:04:09.611 INFO:tasks.workunit.client.1.smithi107.stdout:4/249: rename d0/d29/c52 to d0/d40/d57/c5c 0 2024-09-10T10:04:09.612 INFO:tasks.workunit.client.0.smithi071.stdout:9/217: rename d0/db/d1b/f24 to d0/d3b/f48 0 2024-09-10T10:04:09.614 INFO:tasks.workunit.client.1.smithi107.stdout:6/230: unlink d0/d3d/d14/d17/d24/c4a 0 2024-09-10T10:04:09.615 INFO:tasks.workunit.client.1.smithi107.stdout:3/307: dwrite dc/dd/d45/d26/f3a [0,4194304] 0 2024-09-10T10:04:09.617 INFO:tasks.workunit.client.1.smithi107.stdout:9/275: rename d5/d7/d1d/l2e to d5/d7/d1d/d29/l68 0 2024-09-10T10:04:09.619 INFO:tasks.workunit.client.1.smithi107.stdout:9/276: fdatasync d5/d1e/f5b 0 2024-09-10T10:04:09.622 INFO:tasks.workunit.client.1.smithi107.stdout:9/277: write d5/f31 [490959,54476] 0 2024-09-10T10:04:09.623 INFO:tasks.workunit.client.1.smithi107.stdout:6/231: link d0/d3d/d14/d17/d24/c46 d0/d3d/c4c 0 2024-09-10T10:04:09.626 INFO:tasks.workunit.client.1.smithi107.stdout:3/308: dwrite dc/f24 [0,4194304] 0 2024-09-10T10:04:09.628 INFO:tasks.workunit.client.1.smithi107.stdout:6/232: rename d0/f1d to d0/d3d/d14/d17/f4d 0 2024-09-10T10:04:09.629 INFO:tasks.workunit.client.1.smithi107.stdout:9/278: link d5/f55 d5/d7/d3c/d53/d57/f69 0 2024-09-10T10:04:09.630 INFO:tasks.workunit.client.1.smithi107.stdout:3/309: symlink dc/dd/d42/l5e 0 2024-09-10T10:04:09.630 INFO:tasks.workunit.client.1.smithi107.stdout:3/310: stat dc 0 2024-09-10T10:04:09.633 INFO:tasks.workunit.client.0.smithi071.stdout:0/43: sync 2024-09-10T10:04:09.634 INFO:tasks.workunit.client.0.smithi071.stdout:5/61: sync 2024-09-10T10:04:09.634 INFO:tasks.workunit.client.0.smithi071.stdout:1/65: sync 2024-09-10T10:04:09.634 INFO:tasks.workunit.client.0.smithi071.stdout:8/111: sync 2024-09-10T10:04:09.634 INFO:tasks.workunit.client.1.smithi107.stdout:6/233: creat d0/d3d/d14/d42/f4e x:0 0 0 2024-09-10T10:04:09.634 INFO:tasks.workunit.client.1.smithi107.stdout:6/234: chown d0/f2c 6417507 1 2024-09-10T10:04:09.635 INFO:tasks.workunit.client.0.smithi071.stdout:0/44: write f2 [4816483,77287] 0 2024-09-10T10:04:09.636 INFO:tasks.workunit.client.1.smithi107.stdout:4/250: getdents d0/d29 0 2024-09-10T10:04:09.637 INFO:tasks.workunit.client.1.smithi107.stdout:3/311: mkdir dc/dd/d45/d26/d59/d5f 0 2024-09-10T10:04:09.638 INFO:tasks.workunit.client.1.smithi107.stdout:9/279: creat d5/f6a x:0 0 0 2024-09-10T10:04:09.639 INFO:tasks.workunit.client.0.smithi071.stdout:1/66: symlink d1/l12 0 2024-09-10T10:04:09.639 INFO:tasks.workunit.client.1.smithi107.stdout:6/235: rmdir d0/d3d/d14/d21 39 2024-09-10T10:04:09.640 INFO:tasks.workunit.client.1.smithi107.stdout:6/236: write d0/d3d/f40 [1732443,60494] 0 2024-09-10T10:04:09.641 INFO:tasks.workunit.client.0.smithi071.stdout:8/112: mknod d5/c2f 0 2024-09-10T10:04:09.642 INFO:tasks.workunit.client.1.smithi107.stdout:3/312: creat dc/dd/d20/f60 x:0 0 0 2024-09-10T10:04:09.643 INFO:tasks.workunit.client.0.smithi071.stdout:5/62: dwrite dc/f13 [0,4194304] 0 2024-09-10T10:04:09.645 INFO:tasks.workunit.client.0.smithi071.stdout:0/45: creat d11/f14 x:0 0 0 2024-09-10T10:04:09.646 INFO:tasks.workunit.client.1.smithi107.stdout:6/237: dread d0/d3d/d14/d17/f3b [0,4194304] 0 2024-09-10T10:04:09.648 INFO:tasks.workunit.client.0.smithi071.stdout:1/67: fdatasync d1/f5 0 2024-09-10T10:04:09.650 INFO:tasks.workunit.client.1.smithi107.stdout:9/280: truncate d5/d1e/f5b 1330060 0 2024-09-10T10:04:09.651 INFO:tasks.workunit.client.1.smithi107.stdout:6/238: rename d0/d3d/d14 to d0/d3d/d14/d21/d4f 22 2024-09-10T10:04:09.651 INFO:tasks.workunit.client.0.smithi071.stdout:5/63: dwrite dc/f13 [0,4194304] 0 2024-09-10T10:04:09.652 INFO:tasks.workunit.client.0.smithi071.stdout:8/113: mkdir d5/d30 0 2024-09-10T10:04:09.652 INFO:tasks.workunit.client.0.smithi071.stdout:0/46: dread f5 [0,4194304] 0 2024-09-10T10:04:09.652 INFO:tasks.workunit.client.0.smithi071.stdout:5/64: chown f6 627 1 2024-09-10T10:04:09.653 INFO:tasks.workunit.client.1.smithi107.stdout:3/313: mknod dc/dd/d45/d26/d41/d44/d35/c61 0 2024-09-10T10:04:09.653 INFO:tasks.workunit.client.1.smithi107.stdout:6/239: write d0/d3d/f40 [1848653,123784] 0 2024-09-10T10:04:09.653 INFO:tasks.workunit.client.0.smithi071.stdout:0/47: truncate d11/f14 945370 0 2024-09-10T10:04:09.654 INFO:tasks.workunit.client.1.smithi107.stdout:6/240: chown d0 11056 1 2024-09-10T10:04:09.657 INFO:tasks.workunit.client.1.smithi107.stdout:3/314: unlink dc/dd/d20/d23/c28 0 2024-09-10T10:04:09.658 INFO:tasks.workunit.client.0.smithi071.stdout:5/65: creat dc/f1b x:0 0 0 2024-09-10T10:04:09.658 INFO:tasks.workunit.client.0.smithi071.stdout:6/54: sync 2024-09-10T10:04:09.660 INFO:tasks.workunit.client.0.smithi071.stdout:8/114: mkdir d5/df/d16/d2d/d31 0 2024-09-10T10:04:09.660 INFO:tasks.workunit.client.1.smithi107.stdout:6/241: dread d0/f2c [0,4194304] 0 2024-09-10T10:04:09.661 INFO:tasks.workunit.client.0.smithi071.stdout:5/66: write f8 [895096,54615] 0 2024-09-10T10:04:09.662 INFO:tasks.workunit.client.0.smithi071.stdout:0/48: dwrite f0 [0,4194304] 0 2024-09-10T10:04:09.663 INFO:tasks.workunit.client.0.smithi071.stdout:8/115: rename d5 to d5/df/d16/d2d/d32 22 2024-09-10T10:04:09.664 INFO:tasks.workunit.client.1.smithi107.stdout:3/315: creat dc/dd/d45/d26/d41/d44/d35/d52/f62 x:0 0 0 2024-09-10T10:04:09.664 INFO:tasks.workunit.client.1.smithi107.stdout:6/242: creat d0/d3d/d14/d21/f50 x:0 0 0 2024-09-10T10:04:09.666 INFO:tasks.workunit.client.0.smithi071.stdout:6/55: symlink d4/da/le 0 2024-09-10T10:04:09.667 INFO:tasks.workunit.client.0.smithi071.stdout:5/67: symlink dc/l1c 0 2024-09-10T10:04:09.668 INFO:tasks.workunit.client.1.smithi107.stdout:3/316: mkdir dc/dd/d45/d26/d41/d44/d63 0 2024-09-10T10:04:09.670 INFO:tasks.workunit.client.0.smithi071.stdout:0/49: rename f3 to d11/f15 0 2024-09-10T10:04:09.670 INFO:tasks.workunit.client.1.smithi107.stdout:4/251: dread d0/f10 [0,4194304] 0 2024-09-10T10:04:09.670 INFO:tasks.workunit.client.1.smithi107.stdout:6/243: mknod d0/d3d/d14/d17/c51 0 2024-09-10T10:04:09.671 INFO:tasks.workunit.client.0.smithi071.stdout:5/68: rename dc to dc/df/d17/d1d 22 2024-09-10T10:04:09.671 INFO:tasks.workunit.client.0.smithi071.stdout:6/56: mkdir d4/da/df 0 2024-09-10T10:04:09.672 INFO:tasks.workunit.client.1.smithi107.stdout:3/317: dread - dc/dd/d45/d26/d41/d44/d35/d4a/f5a zero size 2024-09-10T10:04:09.673 INFO:tasks.workunit.client.0.smithi071.stdout:7/63: truncate f7 1890478 0 2024-09-10T10:04:09.674 INFO:tasks.workunit.client.1.smithi107.stdout:3/318: creat dc/dd/d45/f64 x:0 0 0 2024-09-10T10:04:09.677 INFO:tasks.workunit.client.0.smithi071.stdout:8/116: creat d5/f33 x:0 0 0 2024-09-10T10:04:09.677 INFO:tasks.workunit.client.0.smithi071.stdout:2/51: write f1 [1015461,60370] 0 2024-09-10T10:04:09.678 INFO:tasks.workunit.client.0.smithi071.stdout:5/69: dwrite dc/f13 [0,4194304] 0 2024-09-10T10:04:09.680 INFO:tasks.workunit.client.0.smithi071.stdout:2/52: creat d8/fb x:0 0 0 2024-09-10T10:04:09.682 INFO:tasks.workunit.client.1.smithi107.stdout:4/252: dwrite d0/d40/d57/f3b [0,4194304] 0 2024-09-10T10:04:09.682 INFO:tasks.workunit.client.1.smithi107.stdout:9/281: dread d5/d7/fb [0,4194304] 0 2024-09-10T10:04:09.683 INFO:tasks.workunit.client.0.smithi071.stdout:6/57: symlink d4/da/df/l10 0 2024-09-10T10:04:09.685 INFO:tasks.workunit.client.1.smithi107.stdout:4/253: chown d0/d40/c42 295006 1 2024-09-10T10:04:09.686 INFO:tasks.workunit.client.0.smithi071.stdout:5/70: creat dc/df/f1e x:0 0 0 2024-09-10T10:04:09.688 INFO:tasks.workunit.client.1.smithi107.stdout:3/319: dwrite dc/dd/d45/f64 [0,4194304] 0 2024-09-10T10:04:09.688 INFO:tasks.workunit.client.0.smithi071.stdout:2/53: creat d8/fc x:0 0 0 2024-09-10T10:04:09.690 INFO:tasks.workunit.client.0.smithi071.stdout:6/58: dwrite d4/fd [0,4194304] 0 2024-09-10T10:04:09.698 INFO:tasks.workunit.client.1.smithi107.stdout:3/320: mknod dc/dd/d42/d55/d58/c65 0 2024-09-10T10:04:09.698 INFO:tasks.workunit.client.0.smithi071.stdout:3/73: dwrite d3/ff [0,4194304] 0 2024-09-10T10:04:09.698 INFO:tasks.workunit.client.0.smithi071.stdout:8/117: rmdir d5/df/d16/d2d/d31 0 2024-09-10T10:04:09.699 INFO:tasks.workunit.client.0.smithi071.stdout:3/74: chown d3/d10/f11 68432266 1 2024-09-10T10:04:09.700 INFO:tasks.workunit.client.1.smithi107.stdout:3/321: truncate dc/dd/d20/f3e 1304965 0 2024-09-10T10:04:09.701 INFO:tasks.workunit.client.0.smithi071.stdout:4/90: truncate f3 1652730 0 2024-09-10T10:04:09.701 INFO:tasks.workunit.client.0.smithi071.stdout:6/59: dread d4/da/fb [0,4194304] 0 2024-09-10T10:04:09.703 INFO:tasks.workunit.client.1.smithi107.stdout:4/254: link d0/d1f/d20/f21 d0/d1f/d20/f5d 0 2024-09-10T10:04:09.704 INFO:tasks.workunit.client.1.smithi107.stdout:9/282: getdents d5/d7/d1d/d25/d37 0 2024-09-10T10:04:09.705 INFO:tasks.workunit.client.0.smithi071.stdout:9/218: fsync d0/d3b/f3e 0 2024-09-10T10:04:09.705 INFO:tasks.workunit.client.1.smithi107.stdout:9/283: stat d5/d7/d3c 0 2024-09-10T10:04:09.707 INFO:tasks.workunit.client.0.smithi071.stdout:4/91: creat db/d1d/f23 x:0 0 0 2024-09-10T10:04:09.707 INFO:tasks.workunit.client.1.smithi107.stdout:6/244: truncate d0/d3d/d14/d17/f1a 3967710 0 2024-09-10T10:04:09.708 INFO:tasks.workunit.client.0.smithi071.stdout:3/75: dwrite d3/fd [0,4194304] 0 2024-09-10T10:04:09.708 INFO:tasks.workunit.client.0.smithi071.stdout:6/60: fsync d4/da/fb 0 2024-09-10T10:04:09.711 INFO:tasks.workunit.client.1.smithi107.stdout:9/284: chown d5/d7/d1d/d29/l68 33048591 1 2024-09-10T10:04:09.713 INFO:tasks.workunit.client.0.smithi071.stdout:8/118: rename d5/df/d16/l18 to d5/df/l34 0 2024-09-10T10:04:09.716 INFO:tasks.workunit.client.1.smithi107.stdout:3/322: dwrite dc/dd/d20/f3e [0,4194304] 0 2024-09-10T10:04:09.717 INFO:tasks.workunit.client.0.smithi071.stdout:4/92: chown db/lc 11 1 2024-09-10T10:04:09.717 INFO:tasks.workunit.client.1.smithi107.stdout:9/285: rmdir d5/d1e 39 2024-09-10T10:04:09.719 INFO:tasks.workunit.client.1.smithi107.stdout:4/255: dwrite d0/f12 [4194304,4194304] 0 2024-09-10T10:04:09.720 INFO:tasks.workunit.client.1.smithi107.stdout:3/323: chown dc/dd/c1b 391830 1 2024-09-10T10:04:09.724 INFO:tasks.workunit.client.0.smithi071.stdout:3/76: creat d3/d10/f16 x:0 0 0 2024-09-10T10:04:09.725 INFO:tasks.workunit.client.0.smithi071.stdout:6/61: creat d4/f11 x:0 0 0 2024-09-10T10:04:09.726 INFO:tasks.workunit.client.0.smithi071.stdout:6/62: readlink d4/l7 0 2024-09-10T10:04:09.726 INFO:tasks.workunit.client.1.smithi107.stdout:3/324: dread - dc/dd/d45/d26/d41/d44/d35/d52/f62 zero size 2024-09-10T10:04:09.726 INFO:tasks.workunit.client.0.smithi071.stdout:6/63: truncate d4/f11 919150 0 2024-09-10T10:04:09.728 INFO:tasks.workunit.client.0.smithi071.stdout:6/64: chown d4/da/le 1295 1 2024-09-10T10:04:09.728 INFO:tasks.workunit.client.1.smithi107.stdout:9/286: symlink d5/d7/l6b 0 2024-09-10T10:04:09.728 INFO:tasks.workunit.client.0.smithi071.stdout:6/65: write d4/fd [1895376,81821] 0 2024-09-10T10:04:09.729 INFO:tasks.workunit.client.1.smithi107.stdout:5/200: sync 2024-09-10T10:04:09.730 INFO:tasks.workunit.client.0.smithi071.stdout:4/93: mkdir db/d15/d17/d24 0 2024-09-10T10:04:09.731 INFO:tasks.workunit.client.1.smithi107.stdout:9/287: mkdir d5/d7/d1d/d3b/d6c 0 2024-09-10T10:04:09.733 INFO:tasks.workunit.client.1.smithi107.stdout:4/256: rename d0/d4a to d0/d1f/d5e 0 2024-09-10T10:04:09.733 INFO:tasks.workunit.client.0.smithi071.stdout:6/66: dread f3 [0,4194304] 0 2024-09-10T10:04:09.735 INFO:tasks.workunit.client.1.smithi107.stdout:9/288: unlink d5/d7/d1d/d25/d27/f49 0 2024-09-10T10:04:09.736 INFO:tasks.workunit.client.0.smithi071.stdout:3/77: creat d3/d15/f17 x:0 0 0 2024-09-10T10:04:09.736 INFO:tasks.workunit.client.1.smithi107.stdout:9/289: fsync d5/f64 0 2024-09-10T10:04:09.739 INFO:tasks.workunit.client.1.smithi107.stdout:9/290: fdatasync d5/f5c 0 2024-09-10T10:04:09.740 INFO:tasks.workunit.client.1.smithi107.stdout:3/325: rename dc/dd/d45/f2e to dc/dd/d45/d26/d41/d44/d35/f66 0 2024-09-10T10:04:09.741 INFO:tasks.workunit.client.1.smithi107.stdout:4/257: truncate d0/d29/f39 945573 0 2024-09-10T10:04:09.744 INFO:tasks.workunit.client.1.smithi107.stdout:9/291: unlink d5/d7/d1d/d41/f54 0 2024-09-10T10:04:09.750 INFO:tasks.workunit.client.1.smithi107.stdout:4/258: dwrite d0/d1f/d20/f2b [0,4194304] 0 2024-09-10T10:04:09.759 INFO:tasks.workunit.client.1.smithi107.stdout:5/201: dread de/d20/f26 [0,4194304] 0 2024-09-10T10:04:09.760 INFO:tasks.workunit.client.1.smithi107.stdout:4/259: dwrite d0/d29/d3f/f5b [0,4194304] 0 2024-09-10T10:04:09.764 INFO:tasks.workunit.client.1.smithi107.stdout:4/260: unlink d0/d40/d57/l36 0 2024-09-10T10:04:09.765 INFO:tasks.workunit.client.1.smithi107.stdout:5/202: creat de/d20/d3d/f42 x:0 0 0 2024-09-10T10:04:09.767 INFO:tasks.workunit.client.1.smithi107.stdout:4/261: write d0/d40/d57/f3b [5014469,126604] 0 2024-09-10T10:04:09.769 INFO:tasks.workunit.client.1.smithi107.stdout:5/203: creat de/d20/f43 x:0 0 0 2024-09-10T10:04:09.772 INFO:tasks.workunit.client.1.smithi107.stdout:6/245: truncate d0/d3d/f40 150318 0 2024-09-10T10:04:09.773 INFO:tasks.workunit.client.0.smithi071.stdout:4/94: creat db/d15/d17/d24/f25 x:0 0 0 2024-09-10T10:04:09.773 INFO:tasks.workunit.client.1.smithi107.stdout:4/262: truncate d0/d1f/d20/f5d 4049164 0 2024-09-10T10:04:09.775 INFO:tasks.workunit.client.0.smithi071.stdout:1/68: write d1/fd [1929716,4397] 0 2024-09-10T10:04:09.776 INFO:tasks.workunit.client.0.smithi071.stdout:8/119: rename d5/lc to d5/df/l35 0 2024-09-10T10:04:09.777 INFO:tasks.workunit.client.1.smithi107.stdout:4/263: rename d0/f4 to d0/d29/f5f 0 2024-09-10T10:04:09.777 INFO:tasks.workunit.client.0.smithi071.stdout:1/69: write d1/f5 [421073,52704] 0 2024-09-10T10:04:09.778 INFO:tasks.workunit.client.1.smithi107.stdout:4/264: chown d0/d40/c42 4 1 2024-09-10T10:04:09.780 INFO:tasks.workunit.client.0.smithi071.stdout:3/78: unlink d3/d10/f16 0 2024-09-10T10:04:09.780 INFO:tasks.workunit.client.1.smithi107.stdout:4/265: chown d0/c54 29 1 2024-09-10T10:04:09.783 INFO:tasks.workunit.client.0.smithi071.stdout:4/95: mkdir db/d15/d26 0 2024-09-10T10:04:09.784 INFO:tasks.workunit.client.0.smithi071.stdout:0/50: rmdir d11 39 2024-09-10T10:04:09.784 INFO:tasks.workunit.client.0.smithi071.stdout:3/79: dread d3/f8 [0,4194304] 0 2024-09-10T10:04:09.784 INFO:tasks.workunit.client.0.smithi071.stdout:0/51: stat l4 0 2024-09-10T10:04:09.784 INFO:tasks.workunit.client.0.smithi071.stdout:0/52: dread - fd zero size 2024-09-10T10:04:09.786 INFO:tasks.workunit.client.1.smithi107.stdout:3/326: write dc/f24 [4230877,99321] 0 2024-09-10T10:04:09.789 INFO:tasks.workunit.client.1.smithi107.stdout:3/327: creat dc/dd/d45/d26/d59/f67 x:0 0 0 2024-09-10T10:04:09.790 INFO:tasks.workunit.client.1.smithi107.stdout:3/328: stat dc/dd/f12 0 2024-09-10T10:04:09.791 INFO:tasks.workunit.client.1.smithi107.stdout:3/329: write dc/dd/d45/d26/d41/d44/d35/d52/f62 [553770,109616] 0 2024-09-10T10:04:09.792 INFO:tasks.workunit.client.0.smithi071.stdout:2/54: fsync d8/fb 0 2024-09-10T10:04:09.795 INFO:tasks.workunit.client.0.smithi071.stdout:5/71: rmdir dc 39 2024-09-10T10:04:09.796 INFO:tasks.workunit.client.1.smithi107.stdout:3/330: creat dc/dd/d42/d55/f68 x:0 0 0 2024-09-10T10:04:09.796 INFO:tasks.workunit.client.1.smithi107.stdout:9/292: write d5/d7/f13 [5245041,22636] 0 2024-09-10T10:04:09.797 INFO:tasks.workunit.client.0.smithi071.stdout:7/64: dwrite f2 [4194304,4194304] 0 2024-09-10T10:04:09.797 INFO:tasks.workunit.client.1.smithi107.stdout:5/204: rename de/d20/d2b/c34 to de/d20/d2b/c44 0 2024-09-10T10:04:09.798 INFO:tasks.workunit.client.0.smithi071.stdout:1/70: rename d1/l12 to d1/l13 0 2024-09-10T10:04:09.800 INFO:tasks.workunit.client.1.smithi107.stdout:3/331: mkdir dc/dd/d20/d23/d39/d69 0 2024-09-10T10:04:09.800 INFO:tasks.workunit.client.0.smithi071.stdout:0/53: rename f5 to d11/f16 0 2024-09-10T10:04:09.801 INFO:tasks.workunit.client.0.smithi071.stdout:0/54: chown d11/f14 55 1 2024-09-10T10:04:09.801 INFO:tasks.workunit.client.0.smithi071.stdout:0/55: dread - fd zero size 2024-09-10T10:04:09.802 INFO:tasks.workunit.client.1.smithi107.stdout:6/246: dwrite d0/d3d/d14/d21/f28 [0,4194304] 0 2024-09-10T10:04:09.803 INFO:tasks.workunit.client.0.smithi071.stdout:4/96: link db/d1d/c1e db/d15/d17/d24/c27 0 2024-09-10T10:04:09.804 INFO:tasks.workunit.client.1.smithi107.stdout:3/332: mkdir dc/dd/d45/d26/d41/d6a 0 2024-09-10T10:04:09.806 INFO:tasks.workunit.client.0.smithi071.stdout:5/72: stat dc/df/f18 0 2024-09-10T10:04:09.807 INFO:tasks.workunit.client.1.smithi107.stdout:5/205: rename de/c35 to de/d20/c45 0 2024-09-10T10:04:09.810 INFO:tasks.workunit.client.1.smithi107.stdout:4/266: dwrite d0/d40/d57/f33 [0,4194304] 0 2024-09-10T10:04:09.812 INFO:tasks.workunit.client.0.smithi071.stdout:0/56: creat d11/f17 x:0 0 0 2024-09-10T10:04:09.812 INFO:tasks.workunit.client.0.smithi071.stdout:0/57: fsync d11/f14 0 2024-09-10T10:04:09.813 INFO:tasks.workunit.client.0.smithi071.stdout:4/97: truncate f4 957633 0 2024-09-10T10:04:09.813 INFO:tasks.workunit.client.1.smithi107.stdout:5/206: write de/d20/f2c [6841809,82147] 0 2024-09-10T10:04:09.814 INFO:tasks.workunit.client.0.smithi071.stdout:9/219: truncate d0/db/d1b/d1d/f35 487994 0 2024-09-10T10:04:09.814 INFO:tasks.workunit.client.1.smithi107.stdout:3/333: getdents dc/dd/d20/d23 0 2024-09-10T10:04:09.815 INFO:tasks.workunit.client.0.smithi071.stdout:4/98: dread - db/d1d/f23 zero size 2024-09-10T10:04:09.815 INFO:tasks.workunit.client.1.smithi107.stdout:3/334: dread - dc/dd/d42/d55/f68 zero size 2024-09-10T10:04:09.816 INFO:tasks.workunit.client.0.smithi071.stdout:7/65: link d9/fb d9/ff 0 2024-09-10T10:04:09.817 INFO:tasks.workunit.client.1.smithi107.stdout:5/207: write de/d20/d3d/f42 [615031,75034] 0 2024-09-10T10:04:09.818 INFO:tasks.workunit.client.0.smithi071.stdout:0/58: dread f2 [0,4194304] 0 2024-09-10T10:04:09.819 INFO:tasks.workunit.client.0.smithi071.stdout:5/73: creat dc/df/d17/f1f x:0 0 0 2024-09-10T10:04:09.820 INFO:tasks.workunit.client.1.smithi107.stdout:4/267: creat d0/d1f/f60 x:0 0 0 2024-09-10T10:04:09.821 INFO:tasks.workunit.client.1.smithi107.stdout:4/268: write d0/fb [2709141,119664] 0 2024-09-10T10:04:09.822 INFO:tasks.workunit.client.0.smithi071.stdout:2/55: getdents d8 0 2024-09-10T10:04:09.823 INFO:tasks.workunit.client.0.smithi071.stdout:2/56: fdatasync f2 0 2024-09-10T10:04:09.825 INFO:tasks.workunit.client.1.smithi107.stdout:5/208: creat de/d41/f46 x:0 0 0 2024-09-10T10:04:09.825 INFO:tasks.workunit.client.1.smithi107.stdout:3/335: creat dc/dd/f6b x:0 0 0 2024-09-10T10:04:09.826 INFO:tasks.workunit.client.1.smithi107.stdout:4/269: creat d0/d40/d57/d4f/f61 x:0 0 0 2024-09-10T10:04:09.826 INFO:tasks.workunit.client.0.smithi071.stdout:7/66: creat d9/f10 x:0 0 0 2024-09-10T10:04:09.827 INFO:tasks.workunit.client.0.smithi071.stdout:5/74: dread f4 [0,4194304] 0 2024-09-10T10:04:09.827 INFO:tasks.workunit.client.0.smithi071.stdout:7/67: dread - d9/fe zero size 2024-09-10T10:04:09.828 INFO:tasks.workunit.client.1.smithi107.stdout:3/336: chown dc/dd/d20/c3b 40040663 1 2024-09-10T10:04:09.828 INFO:tasks.workunit.client.1.smithi107.stdout:5/209: chown de/d20/d2b/f39 109 1 2024-09-10T10:04:09.828 INFO:tasks.workunit.client.0.smithi071.stdout:9/220: creat d0/db/d20/d3c/f49 x:0 0 0 2024-09-10T10:04:09.829 INFO:tasks.workunit.client.0.smithi071.stdout:5/75: truncate dc/f1b 1028668 0 2024-09-10T10:04:09.829 INFO:tasks.workunit.client.1.smithi107.stdout:4/270: symlink d0/d40/l62 0 2024-09-10T10:04:09.829 INFO:tasks.workunit.client.1.smithi107.stdout:5/210: fdatasync f9 0 2024-09-10T10:04:09.830 INFO:tasks.workunit.client.1.smithi107.stdout:3/337: chown dc/dd/d45/d26/d41/d44/d63 1198236 1 2024-09-10T10:04:09.831 INFO:tasks.workunit.client.1.smithi107.stdout:5/211: stat de/d41 0 2024-09-10T10:04:09.831 INFO:tasks.workunit.client.1.smithi107.stdout:6/247: truncate d0/d3d/d14/f35 896746 0 2024-09-10T10:04:09.832 INFO:tasks.workunit.client.0.smithi071.stdout:2/57: dwrite f2 [4194304,4194304] 0 2024-09-10T10:04:09.833 INFO:tasks.workunit.client.0.smithi071.stdout:2/58: dread - d8/fb zero size 2024-09-10T10:04:09.834 INFO:tasks.workunit.client.0.smithi071.stdout:5/76: mknod dc/df/d17/c20 0 2024-09-10T10:04:09.834 INFO:tasks.workunit.client.0.smithi071.stdout:9/221: symlink d0/db/l4a 0 2024-09-10T10:04:09.835 INFO:tasks.workunit.client.1.smithi107.stdout:3/338: symlink dc/dd/d42/d55/d58/l6c 0 2024-09-10T10:04:09.835 INFO:tasks.workunit.client.1.smithi107.stdout:4/271: dread d0/d1f/d20/f17 [0,4194304] 0 2024-09-10T10:04:09.837 INFO:tasks.workunit.client.1.smithi107.stdout:6/248: mknod d0/d3d/d14/d17/d49/c52 0 2024-09-10T10:04:09.837 INFO:tasks.workunit.client.0.smithi071.stdout:2/59: chown d8/fb 13012049 1 2024-09-10T10:04:09.838 INFO:tasks.workunit.client.0.smithi071.stdout:5/77: creat dc/f21 x:0 0 0 2024-09-10T10:04:09.839 INFO:tasks.workunit.client.0.smithi071.stdout:2/60: dread - d8/fc zero size 2024-09-10T10:04:09.840 INFO:tasks.workunit.client.0.smithi071.stdout:7/68: dwrite f4 [0,4194304] 0 2024-09-10T10:04:09.840 INFO:tasks.workunit.client.1.smithi107.stdout:4/272: creat d0/d40/d57/f63 x:0 0 0 2024-09-10T10:04:09.841 INFO:tasks.workunit.client.0.smithi071.stdout:7/69: read - d9/fa zero size 2024-09-10T10:04:09.841 INFO:tasks.workunit.client.1.smithi107.stdout:4/273: truncate d0/d40/f41 758584 0 2024-09-10T10:04:09.842 INFO:tasks.workunit.client.1.smithi107.stdout:6/249: creat d0/d3d/d14/d21/f53 x:0 0 0 2024-09-10T10:04:09.842 INFO:tasks.workunit.client.1.smithi107.stdout:4/274: fdatasync d0/d1f/f60 0 2024-09-10T10:04:09.843 INFO:tasks.workunit.client.0.smithi071.stdout:5/78: mkdir dc/df/d17/d22 0 2024-09-10T10:04:09.843 INFO:tasks.workunit.client.1.smithi107.stdout:3/339: rename dc/dd/d45/d26/d41/d44/d35/d52/f62 to dc/dd/d45/f6d 0 2024-09-10T10:04:09.844 INFO:tasks.workunit.client.0.smithi071.stdout:5/79: stat dc/f1a 0 2024-09-10T10:04:09.846 INFO:tasks.workunit.client.0.smithi071.stdout:7/70: mkdir d9/d11 0 2024-09-10T10:04:09.847 INFO:tasks.workunit.client.1.smithi107.stdout:6/250: creat d0/d3d/d14/d17/d49/f54 x:0 0 0 2024-09-10T10:04:09.848 INFO:tasks.workunit.client.0.smithi071.stdout:7/71: dread - d9/fe zero size 2024-09-10T10:04:09.848 INFO:tasks.workunit.client.0.smithi071.stdout:9/222: dwrite d0/f2e [4194304,4194304] 0 2024-09-10T10:04:09.849 INFO:tasks.workunit.client.0.smithi071.stdout:2/61: link f1 d8/fd 0 2024-09-10T10:04:09.850 INFO:tasks.workunit.client.0.smithi071.stdout:7/72: write d9/fe [163967,8445] 0 2024-09-10T10:04:09.854 INFO:tasks.workunit.client.1.smithi107.stdout:3/340: dwrite dc/dd/f12 [0,4194304] 0 2024-09-10T10:04:09.855 INFO:tasks.workunit.client.1.smithi107.stdout:3/341: dread - dc/dd/d45/f4e zero size 2024-09-10T10:04:09.857 INFO:tasks.workunit.client.0.smithi071.stdout:9/223: dwrite d0/db/d20/f2b [0,4194304] 0 2024-09-10T10:04:09.857 INFO:tasks.workunit.client.0.smithi071.stdout:6/67: write d4/f6 [1882037,109771] 0 2024-09-10T10:04:09.859 INFO:tasks.workunit.client.0.smithi071.stdout:9/224: stat d0/db/d20/f2b 0 2024-09-10T10:04:09.859 INFO:tasks.workunit.client.0.smithi071.stdout:6/68: read - d4/da/fc zero size 2024-09-10T10:04:09.861 INFO:tasks.workunit.client.1.smithi107.stdout:5/212: dread f8 [0,4194304] 0 2024-09-10T10:04:09.863 INFO:tasks.workunit.client.0.smithi071.stdout:9/225: mkdir d0/db/d1b/d1d/d4b 0 2024-09-10T10:04:09.865 INFO:tasks.workunit.client.0.smithi071.stdout:6/69: symlink d4/da/df/l12 0 2024-09-10T10:04:09.869 INFO:tasks.workunit.client.1.smithi107.stdout:4/275: write d0/d29/f39 [113195,115508] 0 2024-09-10T10:04:09.869 INFO:tasks.workunit.client.0.smithi071.stdout:9/226: rename d0/db/f17 to d0/db/d1b/d1d/d4b/f4c 0 2024-09-10T10:04:09.870 INFO:tasks.workunit.client.1.smithi107.stdout:3/342: dwrite dc/dd/d45/d26/d59/f67 [0,4194304] 0 2024-09-10T10:04:09.872 INFO:tasks.workunit.client.0.smithi071.stdout:9/227: chown d0/f6 587708712 1 2024-09-10T10:04:09.873 INFO:tasks.workunit.client.0.smithi071.stdout:3/80: dwrite d3/d10/f11 [0,4194304] 0 2024-09-10T10:04:09.873 INFO:tasks.workunit.client.0.smithi071.stdout:0/59: fsync d11/f16 0 2024-09-10T10:04:09.875 INFO:tasks.workunit.client.0.smithi071.stdout:1/71: stat d1/l13 0 2024-09-10T10:04:09.877 INFO:tasks.workunit.client.0.smithi071.stdout:4/99: fsync f4 0 2024-09-10T10:04:09.877 INFO:tasks.workunit.client.1.smithi107.stdout:4/276: chown d0/d29/l5a 1879977552 1 2024-09-10T10:04:09.878 INFO:tasks.workunit.client.1.smithi107.stdout:5/213: dwrite de/f1e [0,4194304] 0 2024-09-10T10:04:09.878 INFO:tasks.workunit.client.0.smithi071.stdout:9/228: write d0/d3b/f48 [1841988,72334] 0 2024-09-10T10:04:09.878 INFO:tasks.workunit.client.1.smithi107.stdout:3/343: mkdir dc/dd/d20/d23/d6e 0 2024-09-10T10:04:09.879 INFO:tasks.workunit.client.1.smithi107.stdout:3/344: readlink dc/l51 0 2024-09-10T10:04:09.879 INFO:tasks.workunit.client.0.smithi071.stdout:6/70: dwrite d4/da/fb [4194304,4194304] 0 2024-09-10T10:04:09.881 INFO:tasks.workunit.client.0.smithi071.stdout:7/73: truncate d9/ff 15866 0 2024-09-10T10:04:09.882 INFO:tasks.workunit.client.1.smithi107.stdout:5/214: rmdir de/d41 39 2024-09-10T10:04:09.885 INFO:tasks.workunit.client.0.smithi071.stdout:9/229: read d0/db/d1b/d1d/f1f [485429,358] 0 2024-09-10T10:04:09.885 INFO:tasks.workunit.client.0.smithi071.stdout:0/60: rename f9 to d11/f18 0 2024-09-10T10:04:09.887 INFO:tasks.workunit.client.0.smithi071.stdout:1/72: dread d1/fd [0,4194304] 0 2024-09-10T10:04:09.889 INFO:tasks.workunit.client.1.smithi107.stdout:4/277: symlink d0/d29/d53/l64 0 2024-09-10T10:04:09.889 INFO:tasks.workunit.client.0.smithi071.stdout:0/61: chown la 155001697 1 2024-09-10T10:04:09.890 INFO:tasks.workunit.client.0.smithi071.stdout:4/100: dread db/f1b [0,4194304] 0 2024-09-10T10:04:09.893 INFO:tasks.workunit.client.1.smithi107.stdout:3/345: creat dc/dd/d45/d26/d41/d44/d63/f6f x:0 0 0 2024-09-10T10:04:09.894 INFO:tasks.workunit.client.1.smithi107.stdout:5/215: symlink de/d41/l47 0 2024-09-10T10:04:09.895 INFO:tasks.workunit.client.1.smithi107.stdout:5/216: fsync de/d41/f46 0 2024-09-10T10:04:09.897 INFO:tasks.workunit.client.1.smithi107.stdout:5/217: rmdir de/d20 39 2024-09-10T10:04:09.898 INFO:tasks.workunit.client.1.smithi107.stdout:4/278: link d0/d40/c42 d0/d40/c65 0 2024-09-10T10:04:09.898 INFO:tasks.workunit.client.0.smithi071.stdout:0/62: dread d11/f14 [0,4194304] 0 2024-09-10T10:04:09.899 INFO:tasks.workunit.client.0.smithi071.stdout:5/80: getdents dc/df/d17 0 2024-09-10T10:04:09.900 INFO:tasks.workunit.client.0.smithi071.stdout:3/81: rename d3/d10/f11 to d3/f18 0 2024-09-10T10:04:09.900 INFO:tasks.workunit.client.0.smithi071.stdout:7/74: dwrite f4 [0,4194304] 0 2024-09-10T10:04:09.901 INFO:tasks.workunit.client.1.smithi107.stdout:5/218: creat de/f48 x:0 0 0 2024-09-10T10:04:09.901 INFO:tasks.workunit.client.0.smithi071.stdout:1/73: symlink d1/l14 0 2024-09-10T10:04:09.902 INFO:tasks.workunit.client.0.smithi071.stdout:0/63: read - d11/f17 zero size 2024-09-10T10:04:09.903 INFO:tasks.workunit.client.1.smithi107.stdout:4/279: dread d0/f10 [0,4194304] 0 2024-09-10T10:04:09.904 INFO:tasks.workunit.client.0.smithi071.stdout:6/71: dwrite f3 [0,4194304] 0 2024-09-10T10:04:09.904 INFO:tasks.workunit.client.0.smithi071.stdout:2/62: fsync d8/fd 0 2024-09-10T10:04:09.905 INFO:tasks.workunit.client.1.smithi107.stdout:4/280: dread - d0/d29/f46 zero size 2024-09-10T10:04:09.906 INFO:tasks.workunit.client.0.smithi071.stdout:2/63: write f2 [3707488,101510] 0 2024-09-10T10:04:09.907 INFO:tasks.workunit.client.0.smithi071.stdout:4/101: rename db/d1d/c1e to db/d15/c28 0 2024-09-10T10:04:09.908 INFO:tasks.workunit.client.1.smithi107.stdout:3/346: creat dc/dd/d20/d23/d39/d69/f70 x:0 0 0 2024-09-10T10:04:09.908 INFO:tasks.workunit.client.1.smithi107.stdout:4/281: write d0/d40/f41 [1079176,13202] 0 2024-09-10T10:04:09.911 INFO:tasks.workunit.client.0.smithi071.stdout:3/82: symlink d3/d10/l19 0 2024-09-10T10:04:09.911 INFO:tasks.workunit.client.1.smithi107.stdout:3/347: creat dc/f71 x:0 0 0 2024-09-10T10:04:09.912 INFO:tasks.workunit.client.0.smithi071.stdout:0/64: symlink d11/l19 0 2024-09-10T10:04:09.912 INFO:tasks.workunit.client.1.smithi107.stdout:3/348: write dc/dd/f1d [203642,5450] 0 2024-09-10T10:04:09.913 INFO:tasks.workunit.client.1.smithi107.stdout:4/282: unlink d0/lc 0 2024-09-10T10:04:09.913 INFO:tasks.workunit.client.0.smithi071.stdout:0/65: rename d11 to d11/d1a 22 2024-09-10T10:04:09.914 INFO:tasks.workunit.client.1.smithi107.stdout:6/251: dread d0/d3d/d14/d17/f1a [0,4194304] 0 2024-09-10T10:04:09.915 INFO:tasks.workunit.client.1.smithi107.stdout:5/219: write de/f1b [490865,10630] 0 2024-09-10T10:04:09.916 INFO:tasks.workunit.client.0.smithi071.stdout:6/72: creat d4/da/f13 x:0 0 0 2024-09-10T10:04:09.916 INFO:tasks.workunit.client.0.smithi071.stdout:5/81: dwrite dc/df/f18 [0,4194304] 0 2024-09-10T10:04:09.918 INFO:tasks.workunit.client.1.smithi107.stdout:6/252: write d0/d3d/d14/d21/f23 [2298855,51326] 0 2024-09-10T10:04:09.920 INFO:tasks.workunit.client.1.smithi107.stdout:4/283: write d0/d29/f39 [304607,116471] 0 2024-09-10T10:04:09.920 INFO:tasks.workunit.client.0.smithi071.stdout:2/64: dwrite f1 [0,4194304] 0 2024-09-10T10:04:09.920 INFO:tasks.workunit.client.0.smithi071.stdout:7/75: truncate f7 1020845 0 2024-09-10T10:04:09.921 INFO:tasks.workunit.client.1.smithi107.stdout:5/220: mknod de/d41/c49 0 2024-09-10T10:04:09.922 INFO:tasks.workunit.client.1.smithi107.stdout:4/284: read - d0/d1f/d20/f51 zero size 2024-09-10T10:04:09.923 INFO:tasks.workunit.client.1.smithi107.stdout:6/253: mkdir d0/d3d/d14/d17/d49/d55 0 2024-09-10T10:04:09.924 INFO:tasks.workunit.client.1.smithi107.stdout:6/254: chown d0/d3d/d14/d17/d49 76194 1 2024-09-10T10:04:09.924 INFO:tasks.workunit.client.0.smithi071.stdout:3/83: symlink d3/l1a 0 2024-09-10T10:04:09.925 INFO:tasks.workunit.client.1.smithi107.stdout:3/349: rename dc/c43 to dc/dd/d20/d23/d39/d69/c72 0 2024-09-10T10:04:09.925 INFO:tasks.workunit.client.0.smithi071.stdout:1/74: creat d1/f15 x:0 0 0 2024-09-10T10:04:09.927 INFO:tasks.workunit.client.0.smithi071.stdout:0/66: stat cc 0 2024-09-10T10:04:09.927 INFO:tasks.workunit.client.1.smithi107.stdout:3/350: stat dc/dd/d45/l48 0 2024-09-10T10:04:09.928 INFO:tasks.workunit.client.0.smithi071.stdout:5/82: dread dc/df/f12 [0,4194304] 0 2024-09-10T10:04:09.928 INFO:tasks.workunit.client.0.smithi071.stdout:0/67: chown d11/f18 20 1 2024-09-10T10:04:09.929 INFO:tasks.workunit.client.1.smithi107.stdout:5/221: mkdir de/d4a 0 2024-09-10T10:04:09.929 INFO:tasks.workunit.client.0.smithi071.stdout:5/83: chown c0 23 1 2024-09-10T10:04:09.929 INFO:tasks.workunit.client.0.smithi071.stdout:5/84: chown dc/df/f1e 541004 1 2024-09-10T10:04:09.931 INFO:tasks.workunit.client.0.smithi071.stdout:6/73: unlink d4/f11 0 2024-09-10T10:04:09.932 INFO:tasks.workunit.client.1.smithi107.stdout:6/255: mkdir d0/d3d/d14/d17/d49/d55/d56 0 2024-09-10T10:04:09.932 INFO:tasks.workunit.client.0.smithi071.stdout:0/68: dread d11/f16 [0,4194304] 0 2024-09-10T10:04:09.934 INFO:tasks.workunit.client.0.smithi071.stdout:2/65: creat d8/fe x:0 0 0 2024-09-10T10:04:09.935 INFO:tasks.workunit.client.0.smithi071.stdout:0/69: write d11/f17 [1007604,50012] 0 2024-09-10T10:04:09.936 INFO:tasks.workunit.client.0.smithi071.stdout:5/85: dwrite f6 [0,4194304] 0 2024-09-10T10:04:09.936 INFO:tasks.workunit.client.0.smithi071.stdout:0/70: chown cb 7 1 2024-09-10T10:04:09.936 INFO:tasks.workunit.client.0.smithi071.stdout:0/71: stat ce 0 2024-09-10T10:04:09.937 INFO:tasks.workunit.client.0.smithi071.stdout:3/84: fdatasync d3/f6 0 2024-09-10T10:04:09.940 INFO:tasks.workunit.client.1.smithi107.stdout:4/285: dwrite d0/f8 [0,4194304] 0 2024-09-10T10:04:09.941 INFO:tasks.workunit.client.0.smithi071.stdout:1/75: write d1/f6 [2399674,4250] 0 2024-09-10T10:04:09.941 INFO:tasks.workunit.client.0.smithi071.stdout:2/66: dread f2 [4194304,4194304] 0 2024-09-10T10:04:09.941 INFO:tasks.workunit.client.0.smithi071.stdout:2/67: readlink l6 0 2024-09-10T10:04:09.943 INFO:tasks.workunit.client.0.smithi071.stdout:6/74: unlink d4/fd 0 2024-09-10T10:04:09.945 INFO:tasks.workunit.client.0.smithi071.stdout:4/102: link db/c16 db/d15/d17/d24/c29 0 2024-09-10T10:04:09.947 INFO:tasks.workunit.client.1.smithi107.stdout:5/222: dwrite de/f48 [0,4194304] 0 2024-09-10T10:04:09.947 INFO:tasks.workunit.client.1.smithi107.stdout:3/351: dwrite dc/dd/f1d [4194304,4194304] 0 2024-09-10T10:04:09.949 INFO:tasks.workunit.client.0.smithi071.stdout:2/68: dread f1 [0,4194304] 0 2024-09-10T10:04:09.951 INFO:tasks.workunit.client.0.smithi071.stdout:1/76: dwrite d1/f3 [4194304,4194304] 0 2024-09-10T10:04:09.952 INFO:tasks.workunit.client.0.smithi071.stdout:7/76: creat d9/d11/f12 x:0 0 0 2024-09-10T10:04:09.952 INFO:tasks.workunit.client.0.smithi071.stdout:0/72: write d11/f18 [1105886,19804] 0 2024-09-10T10:04:09.952 INFO:tasks.workunit.client.0.smithi071.stdout:3/85: creat d3/f1b x:0 0 0 2024-09-10T10:04:09.953 INFO:tasks.workunit.client.1.smithi107.stdout:3/352: readlink dc/l51 0 2024-09-10T10:04:09.956 INFO:tasks.workunit.client.0.smithi071.stdout:6/75: symlink d4/da/l14 0 2024-09-10T10:04:09.957 INFO:tasks.workunit.client.0.smithi071.stdout:4/103: creat db/f2a x:0 0 0 2024-09-10T10:04:09.958 INFO:tasks.workunit.client.1.smithi107.stdout:6/256: link d0/d3d/d14/c29 d0/d3d/c57 0 2024-09-10T10:04:09.958 INFO:tasks.workunit.client.0.smithi071.stdout:6/76: write d4/da/fc [255333,57666] 0 2024-09-10T10:04:09.958 INFO:tasks.workunit.client.0.smithi071.stdout:4/104: chown db/c10 2271699 1 2024-09-10T10:04:09.959 INFO:tasks.workunit.client.1.smithi107.stdout:3/353: fdatasync dc/dd/d20/d23/d2f/f4c 0 2024-09-10T10:04:09.959 INFO:tasks.workunit.client.0.smithi071.stdout:2/69: creat d8/ff x:0 0 0 2024-09-10T10:04:09.959 INFO:tasks.workunit.client.1.smithi107.stdout:6/257: chown d0/d3d/l2e 265 1 2024-09-10T10:04:09.961 INFO:tasks.workunit.client.0.smithi071.stdout:0/73: mknod d11/c1b 0 2024-09-10T10:04:09.962 INFO:tasks.workunit.client.1.smithi107.stdout:5/223: truncate de/d20/d3d/f42 1550423 0 2024-09-10T10:04:09.963 INFO:tasks.workunit.client.0.smithi071.stdout:3/86: mkdir d3/d1c 0 2024-09-10T10:04:09.965 INFO:tasks.workunit.client.0.smithi071.stdout:4/105: creat db/d15/d17/d24/f2b x:0 0 0 2024-09-10T10:04:09.966 INFO:tasks.workunit.client.0.smithi071.stdout:3/87: stat d3/f9 0 2024-09-10T10:04:09.966 INFO:tasks.workunit.client.0.smithi071.stdout:7/77: fdatasync d9/fb 0 2024-09-10T10:04:09.968 INFO:tasks.workunit.client.1.smithi107.stdout:3/354: creat dc/dd/d45/d26/d41/d44/d35/f73 x:0 0 0 2024-09-10T10:04:09.968 INFO:tasks.workunit.client.1.smithi107.stdout:5/224: read de/d20/d2b/f3e [4134856,128652] 0 2024-09-10T10:04:09.968 INFO:tasks.workunit.client.0.smithi071.stdout:5/86: link dc/df/c10 dc/df/d17/d22/c23 0 2024-09-10T10:04:09.969 INFO:tasks.workunit.client.1.smithi107.stdout:6/258: link d0/d3d/d14/d21/f22 d0/d3d/d14/f58 0 2024-09-10T10:04:09.969 INFO:tasks.workunit.client.1.smithi107.stdout:3/355: chown dc/dd/d45/d26/d41/d44/f2d 2045803 1 2024-09-10T10:04:09.970 INFO:tasks.workunit.client.1.smithi107.stdout:5/225: chown de/d20/c22 1075348106 1 2024-09-10T10:04:09.971 INFO:tasks.workunit.client.1.smithi107.stdout:3/356: read - dc/dd/d42/d55/f68 zero size 2024-09-10T10:04:09.971 INFO:tasks.workunit.client.0.smithi071.stdout:2/70: dread d8/fd [0,4194304] 0 2024-09-10T10:04:09.971 INFO:tasks.workunit.client.0.smithi071.stdout:1/77: rename d1/f5 to d1/f16 0 2024-09-10T10:04:09.971 INFO:tasks.workunit.client.0.smithi071.stdout:3/88: mknod d3/d10/c1d 0 2024-09-10T10:04:09.972 INFO:tasks.workunit.client.0.smithi071.stdout:4/106: write f9 [1188312,130816] 0 2024-09-10T10:04:09.973 INFO:tasks.workunit.client.0.smithi071.stdout:7/78: mknod d9/d11/c13 0 2024-09-10T10:04:09.973 INFO:tasks.workunit.client.0.smithi071.stdout:5/87: symlink dc/df/l24 0 2024-09-10T10:04:09.974 INFO:tasks.workunit.client.1.smithi107.stdout:3/357: mkdir dc/dd/d45/d26/d41/d74 0 2024-09-10T10:04:09.976 INFO:tasks.workunit.client.0.smithi071.stdout:7/79: unlink f3 0 2024-09-10T10:04:09.977 INFO:tasks.workunit.client.0.smithi071.stdout:0/74: dwrite d11/f16 [8388608,4194304] 0 2024-09-10T10:04:09.978 INFO:tasks.workunit.client.1.smithi107.stdout:4/286: dread d0/f1d [4194304,4194304] 0 2024-09-10T10:04:09.980 INFO:tasks.workunit.client.1.smithi107.stdout:3/358: rmdir dc/dd/d45/d26/d41/d6a 0 2024-09-10T10:04:09.981 INFO:tasks.workunit.client.0.smithi071.stdout:2/71: rename f1 to d8/f10 0 2024-09-10T10:04:09.982 INFO:tasks.workunit.client.0.smithi071.stdout:4/107: truncate f4 1554442 0 2024-09-10T10:04:09.983 INFO:tasks.workunit.client.0.smithi071.stdout:0/75: mknod d11/c1c 0 2024-09-10T10:04:09.984 INFO:tasks.workunit.client.1.smithi107.stdout:4/287: creat d0/d1f/f66 x:0 0 0 2024-09-10T10:04:09.984 INFO:tasks.workunit.client.0.smithi071.stdout:7/80: creat d9/d11/f14 x:0 0 0 2024-09-10T10:04:09.985 INFO:tasks.workunit.client.1.smithi107.stdout:3/359: creat dc/dd/f75 x:0 0 0 2024-09-10T10:04:09.987 INFO:tasks.workunit.client.0.smithi071.stdout:0/76: chown d11/f14 27 1 2024-09-10T10:04:09.988 INFO:tasks.workunit.client.1.smithi107.stdout:3/360: symlink dc/dd/d45/d26/l76 0 2024-09-10T10:04:09.989 INFO:tasks.workunit.client.0.smithi071.stdout:1/78: dread d1/f6 [0,4194304] 0 2024-09-10T10:04:09.989 INFO:tasks.workunit.client.0.smithi071.stdout:4/108: chown db/d15/d17/f1f 880 1 2024-09-10T10:04:09.990 INFO:tasks.workunit.client.1.smithi107.stdout:3/361: creat dc/dd/d45/f77 x:0 0 0 2024-09-10T10:04:09.991 INFO:tasks.workunit.client.0.smithi071.stdout:7/81: dread d9/ff [0,4194304] 0 2024-09-10T10:04:09.991 INFO:tasks.workunit.client.0.smithi071.stdout:3/89: dwrite d3/f6 [4194304,4194304] 0 2024-09-10T10:04:09.992 INFO:tasks.workunit.client.0.smithi071.stdout:5/88: dread f4 [0,4194304] 0 2024-09-10T10:04:09.992 INFO:tasks.workunit.client.0.smithi071.stdout:3/90: stat d3/fd 0 2024-09-10T10:04:09.994 INFO:tasks.workunit.client.0.smithi071.stdout:6/77: dread d4/da/fc [0,4194304] 0 2024-09-10T10:04:09.994 INFO:tasks.workunit.client.0.smithi071.stdout:0/77: chown fd 2 1 2024-09-10T10:04:09.995 INFO:tasks.workunit.client.0.smithi071.stdout:7/82: mkdir d9/d15 0 2024-09-10T10:04:09.996 INFO:tasks.workunit.client.0.smithi071.stdout:1/79: truncate d1/f9 2526764 0 2024-09-10T10:04:09.996 INFO:tasks.workunit.client.0.smithi071.stdout:0/78: readlink d11/l13 0 2024-09-10T10:04:09.996 INFO:tasks.workunit.client.0.smithi071.stdout:4/109: symlink db/d15/d22/l2c 0 2024-09-10T10:04:09.996 INFO:tasks.workunit.client.0.smithi071.stdout:3/91: stat d3/l1a 0 2024-09-10T10:04:09.999 INFO:tasks.workunit.client.0.smithi071.stdout:6/78: write f1 [2920866,9036] 0 2024-09-10T10:04:09.999 INFO:tasks.workunit.client.0.smithi071.stdout:3/92: chown d3/l1a 4 1 2024-09-10T10:04:10.001 INFO:tasks.workunit.client.0.smithi071.stdout:0/79: unlink d11/f16 0 2024-09-10T10:04:10.002 INFO:tasks.workunit.client.0.smithi071.stdout:5/89: creat dc/df/d17/d22/f25 x:0 0 0 2024-09-10T10:04:10.003 INFO:tasks.workunit.client.0.smithi071.stdout:0/80: fsync d11/f14 0 2024-09-10T10:04:10.004 INFO:tasks.workunit.client.0.smithi071.stdout:1/80: symlink d1/l17 0 2024-09-10T10:04:10.005 INFO:tasks.workunit.client.1.smithi107.stdout:5/226: truncate de/d20/f2c 1544205 0 2024-09-10T10:04:10.005 INFO:tasks.workunit.client.0.smithi071.stdout:6/79: mknod d4/da/df/c15 0 2024-09-10T10:04:10.005 INFO:tasks.workunit.client.0.smithi071.stdout:6/80: chown d4/da/df 1 1 2024-09-10T10:04:10.008 INFO:tasks.workunit.client.1.smithi107.stdout:4/288: symlink d0/d29/d3f/d59/l67 0 2024-09-10T10:04:10.009 INFO:tasks.workunit.client.1.smithi107.stdout:3/362: rmdir dc 39 2024-09-10T10:04:10.011 INFO:tasks.workunit.client.1.smithi107.stdout:4/289: rename d0/d40/d57/f63 to d0/d40/f68 0 2024-09-10T10:04:10.012 INFO:tasks.workunit.client.1.smithi107.stdout:3/363: unlink dc/f24 0 2024-09-10T10:04:10.013 INFO:tasks.workunit.client.1.smithi107.stdout:3/364: fsync dc/dd/d45/d26/f3a 0 2024-09-10T10:04:10.015 INFO:tasks.workunit.client.0.smithi071.stdout:3/93: symlink d3/d15/l1e 0 2024-09-10T10:04:10.015 INFO:tasks.workunit.client.1.smithi107.stdout:4/290: rename d0/d1f/d20/l2a to d0/d40/l69 0 2024-09-10T10:04:10.017 INFO:tasks.workunit.client.0.smithi071.stdout:4/110: rename db/d15/d17/l19 to db/d15/d17/d24/l2d 0 2024-09-10T10:04:10.018 INFO:tasks.workunit.client.1.smithi107.stdout:3/365: mkdir dc/dd/d45/d26/d59/d78 0 2024-09-10T10:04:10.019 INFO:tasks.workunit.client.0.smithi071.stdout:5/90: mknod dc/df/c26 0 2024-09-10T10:04:10.019 INFO:tasks.workunit.client.0.smithi071.stdout:4/111: dread - db/f2a zero size 2024-09-10T10:04:10.020 INFO:tasks.workunit.client.1.smithi107.stdout:4/291: dread d0/d40/d57/f3b [0,4194304] 0 2024-09-10T10:04:10.021 INFO:tasks.workunit.client.0.smithi071.stdout:3/94: dread d3/f18 [4194304,4194304] 0 2024-09-10T10:04:10.021 INFO:tasks.workunit.client.0.smithi071.stdout:0/81: mknod d11/c1d 0 2024-09-10T10:04:10.022 INFO:tasks.workunit.client.1.smithi107.stdout:3/366: creat dc/dd/d20/d23/d39/d69/f79 x:0 0 0 2024-09-10T10:04:10.023 INFO:tasks.workunit.client.1.smithi107.stdout:3/367: read - dc/dd/f75 zero size 2024-09-10T10:04:10.023 INFO:tasks.workunit.client.0.smithi071.stdout:6/81: write d4/da/fc [233704,68181] 0 2024-09-10T10:04:10.024 INFO:tasks.workunit.client.1.smithi107.stdout:4/292: unlink d0/d1f/d20/d47/f56 0 2024-09-10T10:04:10.025 INFO:tasks.workunit.client.1.smithi107.stdout:5/227: dread f9 [0,4194304] 0 2024-09-10T10:04:10.025 INFO:tasks.workunit.client.0.smithi071.stdout:6/82: fsync f1 0 2024-09-10T10:04:10.025 INFO:tasks.workunit.client.0.smithi071.stdout:8/120: sync 2024-09-10T10:04:10.026 INFO:tasks.workunit.client.0.smithi071.stdout:5/91: mknod dc/df/d17/c27 0 2024-09-10T10:04:10.027 INFO:tasks.workunit.client.1.smithi107.stdout:4/293: creat d0/d40/f6a x:0 0 0 2024-09-10T10:04:10.027 INFO:tasks.workunit.client.1.smithi107.stdout:4/294: readlink d0/l32 0 2024-09-10T10:04:10.028 INFO:tasks.workunit.client.0.smithi071.stdout:4/112: mknod db/d15/d22/c2e 0 2024-09-10T10:04:10.028 INFO:tasks.workunit.client.1.smithi107.stdout:3/368: dread f9 [0,4194304] 0 2024-09-10T10:04:10.028 INFO:tasks.workunit.client.1.smithi107.stdout:5/228: mkdir de/d20/d2b/d4b 0 2024-09-10T10:04:10.029 INFO:tasks.workunit.client.1.smithi107.stdout:5/229: fsync de/f28 0 2024-09-10T10:04:10.029 INFO:tasks.workunit.client.1.smithi107.stdout:3/369: chown dc/dd/d42/d55/d58 1009469 1 2024-09-10T10:04:10.029 INFO:tasks.workunit.client.1.smithi107.stdout:4/295: mkdir d0/d6b 0 2024-09-10T10:04:10.030 INFO:tasks.workunit.client.0.smithi071.stdout:3/95: mknod d3/d15/c1f 0 2024-09-10T10:04:10.030 INFO:tasks.workunit.client.0.smithi071.stdout:8/121: truncate d5/f11 957299 0 2024-09-10T10:04:10.031 INFO:tasks.workunit.client.0.smithi071.stdout:2/72: fsync d8/f10 0 2024-09-10T10:04:10.032 INFO:tasks.workunit.client.1.smithi107.stdout:3/370: creat dc/dd/d45/d26/d59/f7a x:0 0 0 2024-09-10T10:04:10.033 INFO:tasks.workunit.client.0.smithi071.stdout:8/122: read - d5/f10 zero size 2024-09-10T10:04:10.034 INFO:tasks.workunit.client.0.smithi071.stdout:6/83: rename d4/da/fc to d4/f16 0 2024-09-10T10:04:10.034 INFO:tasks.workunit.client.1.smithi107.stdout:4/296: creat d0/d6b/f6c x:0 0 0 2024-09-10T10:04:10.035 INFO:tasks.workunit.client.0.smithi071.stdout:0/82: dwrite d11/f14 [0,4194304] 0 2024-09-10T10:04:10.035 INFO:tasks.workunit.client.1.smithi107.stdout:4/297: readlink d0/d1f/l24 0 2024-09-10T10:04:10.037 INFO:tasks.workunit.client.0.smithi071.stdout:4/113: creat db/d15/d22/f2f x:0 0 0 2024-09-10T10:04:10.037 INFO:tasks.workunit.client.1.smithi107.stdout:3/371: rename dc/dd/d20/d23/d39/d69/f79 to dc/dd/d45/d26/d41/d44/d63/f7b 0 2024-09-10T10:04:10.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:09 smithi071 ceph-mon[27559]: pgmap v255: 65 pgs: 65 active+clean; 506 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 5.0 MiB/s rd, 47 MiB/s wr, 391 op/s 2024-09-10T10:04:10.040 INFO:tasks.workunit.client.0.smithi071.stdout:8/123: read d5/f19 [1000199,120688] 0 2024-09-10T10:04:10.041 INFO:tasks.workunit.client.0.smithi071.stdout:1/81: dwrite d1/fd [0,4194304] 0 2024-09-10T10:04:10.041 INFO:tasks.workunit.client.1.smithi107.stdout:3/372: creat dc/dd/d42/d55/d58/f7c x:0 0 0 2024-09-10T10:04:10.046 INFO:tasks.workunit.client.0.smithi071.stdout:5/92: dwrite f4 [0,4194304] 0 2024-09-10T10:04:10.049 INFO:tasks.workunit.client.0.smithi071.stdout:5/93: read - dc/f21 zero size 2024-09-10T10:04:10.052 INFO:tasks.workunit.client.0.smithi071.stdout:0/83: read d11/f15 [11113022,16072] 0 2024-09-10T10:04:10.052 INFO:tasks.workunit.client.1.smithi107.stdout:3/373: truncate f7 4166097 0 2024-09-10T10:04:10.053 INFO:tasks.workunit.client.0.smithi071.stdout:3/96: getdents d3/d15 0 2024-09-10T10:04:10.053 INFO:tasks.workunit.client.0.smithi071.stdout:6/84: dwrite d4/da/fb [4194304,4194304] 0 2024-09-10T10:04:10.055 INFO:tasks.workunit.client.1.smithi107.stdout:4/298: dread d0/d29/f5f [4194304,4194304] 0 2024-09-10T10:04:10.056 INFO:tasks.workunit.client.1.smithi107.stdout:3/374: mknod dc/dd/d45/d26/d41/d44/c7d 0 2024-09-10T10:04:10.056 INFO:tasks.workunit.client.0.smithi071.stdout:2/73: truncate d8/f10 2686658 0 2024-09-10T10:04:10.057 INFO:tasks.workunit.client.0.smithi071.stdout:1/82: dwrite d1/f16 [0,4194304] 0 2024-09-10T10:04:10.058 INFO:tasks.workunit.client.1.smithi107.stdout:4/299: write d0/d40/d57/f33 [1879702,130007] 0 2024-09-10T10:04:10.060 INFO:tasks.workunit.client.1.smithi107.stdout:3/375: mknod dc/dd/d42/c7e 0 2024-09-10T10:04:10.063 INFO:tasks.workunit.client.0.smithi071.stdout:6/85: dread f3 [0,4194304] 0 2024-09-10T10:04:10.063 INFO:tasks.workunit.client.0.smithi071.stdout:6/86: stat d4/da/le 0 2024-09-10T10:04:10.064 INFO:tasks.workunit.client.0.smithi071.stdout:5/94: creat dc/df/f28 x:0 0 0 2024-09-10T10:04:10.067 INFO:tasks.workunit.client.0.smithi071.stdout:3/97: mkdir d3/d20 0 2024-09-10T10:04:10.068 INFO:tasks.workunit.client.1.smithi107.stdout:3/376: link dc/l38 dc/dd/d45/d26/d41/d44/d35/d4a/l7f 0 2024-09-10T10:04:10.068 INFO:tasks.workunit.client.0.smithi071.stdout:3/98: readlink d3/d10/l19 0 2024-09-10T10:04:10.069 INFO:tasks.workunit.client.1.smithi107.stdout:4/300: dread d0/d1f/d20/f2c [0,4194304] 0 2024-09-10T10:04:10.070 INFO:tasks.workunit.client.0.smithi071.stdout:2/74: rename c5 to d8/c11 0 2024-09-10T10:04:10.071 INFO:tasks.workunit.client.0.smithi071.stdout:2/75: truncate d8/fb 957445 0 2024-09-10T10:04:10.071 INFO:tasks.workunit.client.0.smithi071.stdout:2/76: chown d8/fe 0 1 2024-09-10T10:04:10.072 INFO:tasks.workunit.client.1.smithi107.stdout:3/377: rename dc/f71 to dc/dd/d45/d26/d41/d74/f80 0 2024-09-10T10:04:10.072 INFO:tasks.workunit.client.0.smithi071.stdout:2/77: write d8/fb [877880,116257] 0 2024-09-10T10:04:10.074 INFO:tasks.workunit.client.0.smithi071.stdout:6/87: unlink d4/f16 0 2024-09-10T10:04:10.075 INFO:tasks.workunit.client.0.smithi071.stdout:6/88: write d4/da/fb [9363139,107271] 0 2024-09-10T10:04:10.075 INFO:tasks.workunit.client.0.smithi071.stdout:5/95: mkdir dc/df/d29 0 2024-09-10T10:04:10.076 INFO:tasks.workunit.client.0.smithi071.stdout:4/114: getdents db/d15 0 2024-09-10T10:04:10.077 INFO:tasks.workunit.client.0.smithi071.stdout:1/83: mknod d1/c18 0 2024-09-10T10:04:10.078 INFO:tasks.workunit.client.1.smithi107.stdout:5/230: dread de/d20/f2c [0,4194304] 0 2024-09-10T10:04:10.078 INFO:tasks.workunit.client.0.smithi071.stdout:1/84: write d1/f16 [1076435,18343] 0 2024-09-10T10:04:10.079 INFO:tasks.workunit.client.0.smithi071.stdout:6/89: symlink d4/da/l17 0 2024-09-10T10:04:10.081 INFO:tasks.workunit.client.0.smithi071.stdout:5/96: symlink dc/l2a 0 2024-09-10T10:04:10.081 INFO:tasks.workunit.client.0.smithi071.stdout:3/99: getdents d3/d15 0 2024-09-10T10:04:10.081 INFO:tasks.workunit.client.0.smithi071.stdout:6/90: truncate d4/da/f13 517198 0 2024-09-10T10:04:10.083 INFO:tasks.workunit.client.0.smithi071.stdout:5/97: write dc/f1b [56531,22757] 0 2024-09-10T10:04:10.084 INFO:tasks.workunit.client.1.smithi107.stdout:5/231: dwrite de/f1e [0,4194304] 0 2024-09-10T10:04:10.085 INFO:tasks.workunit.client.0.smithi071.stdout:6/91: read d4/f6 [1371923,102873] 0 2024-09-10T10:04:10.085 INFO:tasks.workunit.client.0.smithi071.stdout:2/78: unlink d8/fd 0 2024-09-10T10:04:10.085 INFO:tasks.workunit.client.0.smithi071.stdout:5/98: dread - dc/df/f1e zero size 2024-09-10T10:04:10.087 INFO:tasks.workunit.client.0.smithi071.stdout:5/99: write dc/f1b [525483,36978] 0 2024-09-10T10:04:10.088 INFO:tasks.workunit.client.1.smithi107.stdout:5/232: creat de/d20/d3d/f4c x:0 0 0 2024-09-10T10:04:10.089 INFO:tasks.workunit.client.0.smithi071.stdout:2/79: write d8/fe [704149,123912] 0 2024-09-10T10:04:10.090 INFO:tasks.workunit.client.0.smithi071.stdout:5/100: write f4 [4246313,123941] 0 2024-09-10T10:04:10.090 INFO:tasks.workunit.client.1.smithi107.stdout:5/233: chown de/d41 26 1 2024-09-10T10:04:10.090 INFO:tasks.workunit.client.1.smithi107.stdout:4/301: truncate d0/d29/d3f/f5b 3832624 0 2024-09-10T10:04:10.091 INFO:tasks.workunit.client.0.smithi071.stdout:2/80: write d8/fc [278150,51562] 0 2024-09-10T10:04:10.091 INFO:tasks.workunit.client.1.smithi107.stdout:5/234: dread - de/f3b zero size 2024-09-10T10:04:10.092 INFO:tasks.workunit.client.1.smithi107.stdout:5/235: chown de 14710004 1 2024-09-10T10:04:10.093 INFO:tasks.workunit.client.0.smithi071.stdout:8/124: truncate d5/df/d16/f22 837480 0 2024-09-10T10:04:10.096 INFO:tasks.workunit.client.0.smithi071.stdout:8/125: dread d5/df/d16/f2c [0,4194304] 0 2024-09-10T10:04:10.096 INFO:tasks.workunit.client.1.smithi107.stdout:3/378: dwrite f9 [0,4194304] 0 2024-09-10T10:04:10.096 INFO:tasks.workunit.client.0.smithi071.stdout:8/126: readlink d5/df/d1d/l25 0 2024-09-10T10:04:10.097 INFO:tasks.workunit.client.0.smithi071.stdout:8/127: chown d5/df/d16/d2d 133242342 1 2024-09-10T10:04:10.100 INFO:tasks.workunit.client.1.smithi107.stdout:3/379: symlink dc/dd/l81 0 2024-09-10T10:04:10.101 INFO:tasks.workunit.client.1.smithi107.stdout:4/302: write d0/f14 [773815,731] 0 2024-09-10T10:04:10.103 INFO:tasks.workunit.client.1.smithi107.stdout:5/236: dwrite f1 [0,4194304] 0 2024-09-10T10:04:10.104 INFO:tasks.workunit.client.0.smithi071.stdout:1/85: creat d1/f19 x:0 0 0 2024-09-10T10:04:10.104 INFO:tasks.workunit.client.1.smithi107.stdout:4/303: write d0/d29/d3f/f4b [240464,120901] 0 2024-09-10T10:04:10.105 INFO:tasks.workunit.client.1.smithi107.stdout:3/380: write dc/dd/d45/d26/d41/d44/f3c [1051782,98016] 0 2024-09-10T10:04:10.106 INFO:tasks.workunit.client.0.smithi071.stdout:4/115: getdents db/d15/d17/d24 0 2024-09-10T10:04:10.107 INFO:tasks.workunit.client.1.smithi107.stdout:5/237: chown de/d20/c22 89822 1 2024-09-10T10:04:10.109 INFO:tasks.workunit.client.1.smithi107.stdout:4/304: mkdir d0/d40/d6d 0 2024-09-10T10:04:10.109 INFO:tasks.workunit.client.1.smithi107.stdout:5/238: rmdir de/d20 39 2024-09-10T10:04:10.110 INFO:tasks.workunit.client.0.smithi071.stdout:1/86: dread d1/f16 [0,4194304] 0 2024-09-10T10:04:10.111 INFO:tasks.workunit.client.0.smithi071.stdout:1/87: truncate d1/f15 620230 0 2024-09-10T10:04:10.113 INFO:tasks.workunit.client.1.smithi107.stdout:4/305: chown d0/d29/d53 449 1 2024-09-10T10:04:10.114 INFO:tasks.workunit.client.1.smithi107.stdout:3/381: creat dc/dd/d45/d26/f82 x:0 0 0 2024-09-10T10:04:10.116 INFO:tasks.workunit.client.0.smithi071.stdout:4/116: dread db/f12 [0,4194304] 0 2024-09-10T10:04:10.117 INFO:tasks.workunit.client.1.smithi107.stdout:3/382: unlink dc/dd/l37 0 2024-09-10T10:04:10.118 INFO:tasks.workunit.client.0.smithi071.stdout:2/81: chown d8/f10 15583275 1 2024-09-10T10:04:10.119 INFO:tasks.workunit.client.0.smithi071.stdout:4/117: write db/d15/d17/d24/f25 [563042,65040] 0 2024-09-10T10:04:10.119 INFO:tasks.workunit.client.0.smithi071.stdout:0/84: mkdir d11/d1e 0 2024-09-10T10:04:10.121 INFO:tasks.workunit.client.1.smithi107.stdout:5/239: link de/l3a de/d20/l4d 0 2024-09-10T10:04:10.121 INFO:tasks.workunit.client.0.smithi071.stdout:3/100: dwrite d3/f6 [8388608,4194304] 0 2024-09-10T10:04:10.121 INFO:tasks.workunit.client.0.smithi071.stdout:1/88: dread d1/f3 [0,4194304] 0 2024-09-10T10:04:10.122 INFO:tasks.workunit.client.0.smithi071.stdout:3/101: write d3/ff [1555325,115407] 0 2024-09-10T10:04:10.123 INFO:tasks.workunit.client.0.smithi071.stdout:3/102: chown d3/l13 240605746 1 2024-09-10T10:04:10.124 INFO:tasks.workunit.client.1.smithi107.stdout:5/240: mkdir de/d4a/d4e 0 2024-09-10T10:04:10.128 INFO:tasks.workunit.client.1.smithi107.stdout:3/383: dwrite dc/dd/d45/d26/d41/d44/f1f [4194304,4194304] 0 2024-09-10T10:04:10.128 INFO:tasks.workunit.client.0.smithi071.stdout:2/82: symlink d8/l12 0 2024-09-10T10:04:10.130 INFO:tasks.workunit.client.1.smithi107.stdout:4/306: truncate d0/d1f/d20/f17 3567911 0 2024-09-10T10:04:10.134 INFO:tasks.workunit.client.1.smithi107.stdout:5/241: dread de/d20/f37 [0,4194304] 0 2024-09-10T10:04:10.134 INFO:tasks.workunit.client.0.smithi071.stdout:8/128: rename d5/df/d16/d2d to d5/d36 0 2024-09-10T10:04:10.135 INFO:tasks.workunit.client.1.smithi107.stdout:3/384: rmdir dc/dd/d20/d23/d39 39 2024-09-10T10:04:10.136 INFO:tasks.workunit.client.0.smithi071.stdout:6/92: getdents d4/da 0 2024-09-10T10:04:10.136 INFO:tasks.workunit.client.0.smithi071.stdout:6/93: readlink d4/da/le 0 2024-09-10T10:04:10.137 INFO:tasks.workunit.client.1.smithi107.stdout:3/385: unlink dc/dd/f6b 0 2024-09-10T10:04:10.138 INFO:tasks.workunit.client.0.smithi071.stdout:3/103: creat d3/f21 x:0 0 0 2024-09-10T10:04:10.138 INFO:tasks.workunit.client.1.smithi107.stdout:5/242: symlink de/d20/d2b/d4b/l4f 0 2024-09-10T10:04:10.138 INFO:tasks.workunit.client.1.smithi107.stdout:3/386: stat dc/dd/d20/c3b 0 2024-09-10T10:04:10.139 INFO:tasks.workunit.client.0.smithi071.stdout:5/101: truncate f4 795900 0 2024-09-10T10:04:10.139 INFO:tasks.workunit.client.0.smithi071.stdout:3/104: stat d3/d10/c1d 0 2024-09-10T10:04:10.139 INFO:tasks.workunit.client.0.smithi071.stdout:3/105: fsync d3/f9 0 2024-09-10T10:04:10.140 INFO:tasks.workunit.client.0.smithi071.stdout:5/102: chown dc/df/f12 352065 1 2024-09-10T10:04:10.141 INFO:tasks.workunit.client.1.smithi107.stdout:5/243: write de/d20/f26 [4841076,46670] 0 2024-09-10T10:04:10.141 INFO:tasks.workunit.client.1.smithi107.stdout:3/387: mknod dc/dd/d45/d26/d59/d78/c83 0 2024-09-10T10:04:10.142 INFO:tasks.workunit.client.0.smithi071.stdout:4/118: symlink db/d15/d26/l30 0 2024-09-10T10:04:10.144 INFO:tasks.workunit.client.1.smithi107.stdout:3/388: symlink dc/dd/d45/d26/d41/d74/l84 0 2024-09-10T10:04:10.144 INFO:tasks.workunit.client.0.smithi071.stdout:6/94: dwrite f1 [0,4194304] 0 2024-09-10T10:04:10.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:09 smithi107 ceph-mon[34215]: pgmap v255: 65 pgs: 65 active+clean; 506 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 5.0 MiB/s rd, 47 MiB/s wr, 391 op/s 2024-09-10T10:04:10.145 INFO:tasks.workunit.client.0.smithi071.stdout:5/103: rmdir dc 39 2024-09-10T10:04:10.146 INFO:tasks.workunit.client.1.smithi107.stdout:5/244: dread de/d20/f26 [0,4194304] 0 2024-09-10T10:04:10.148 INFO:tasks.workunit.client.0.smithi071.stdout:1/89: rename d1/c18 to d1/c1a 0 2024-09-10T10:04:10.149 INFO:tasks.workunit.client.0.smithi071.stdout:0/85: write d11/f18 [360460,63428] 0 2024-09-10T10:04:10.150 INFO:tasks.workunit.client.1.smithi107.stdout:3/389: creat dc/dd/d20/d23/d2f/f85 x:0 0 0 2024-09-10T10:04:10.150 INFO:tasks.workunit.client.0.smithi071.stdout:3/106: creat d3/d1c/f22 x:0 0 0 2024-09-10T10:04:10.151 INFO:tasks.workunit.client.1.smithi107.stdout:3/390: read - dc/dd/d20/f60 zero size 2024-09-10T10:04:10.151 INFO:tasks.workunit.client.0.smithi071.stdout:4/119: dwrite db/d15/d17/f18 [0,4194304] 0 2024-09-10T10:04:10.153 INFO:tasks.workunit.client.0.smithi071.stdout:5/104: truncate dc/f1a 1000164 0 2024-09-10T10:04:10.156 INFO:tasks.workunit.client.1.smithi107.stdout:3/391: unlink dc/dd/d45/d26/d41/d44/d35/f73 0 2024-09-10T10:04:10.159 INFO:tasks.workunit.client.0.smithi071.stdout:3/107: dwrite d3/fa [0,4194304] 0 2024-09-10T10:04:10.160 INFO:tasks.workunit.client.0.smithi071.stdout:3/108: dread - d3/f1b zero size 2024-09-10T10:04:10.161 INFO:tasks.workunit.client.0.smithi071.stdout:2/83: write f2 [1093119,26996] 0 2024-09-10T10:04:10.162 INFO:tasks.workunit.client.0.smithi071.stdout:3/109: write d3/d1c/f22 [561511,61978] 0 2024-09-10T10:04:10.166 INFO:tasks.workunit.client.1.smithi107.stdout:3/392: dwrite dc/dd/d45/f64 [0,4194304] 0 2024-09-10T10:04:10.167 INFO:tasks.workunit.client.1.smithi107.stdout:4/307: dread d0/fa [0,4194304] 0 2024-09-10T10:04:10.167 INFO:tasks.workunit.client.0.smithi071.stdout:5/105: creat dc/df/d17/f2b x:0 0 0 2024-09-10T10:04:10.168 INFO:tasks.workunit.client.0.smithi071.stdout:8/129: link d5/df/d1d/f23 d5/df/d1e/f37 0 2024-09-10T10:04:10.168 INFO:tasks.workunit.client.0.smithi071.stdout:8/130: chown d5 93 1 2024-09-10T10:04:10.168 INFO:tasks.workunit.client.0.smithi071.stdout:5/106: dread - dc/df/f19 zero size 2024-09-10T10:04:10.169 INFO:tasks.workunit.client.0.smithi071.stdout:5/107: read - dc/df/f28 zero size 2024-09-10T10:04:10.170 INFO:tasks.workunit.client.1.smithi107.stdout:4/308: mkdir d0/d29/d53/d6e 0 2024-09-10T10:04:10.171 INFO:tasks.workunit.client.0.smithi071.stdout:3/110: mknod d3/c23 0 2024-09-10T10:04:10.171 INFO:tasks.workunit.client.1.smithi107.stdout:3/393: creat dc/dd/d45/d26/d41/d44/d35/d52/f86 x:0 0 0 2024-09-10T10:04:10.172 INFO:tasks.workunit.client.0.smithi071.stdout:0/86: creat d11/d1e/f1f x:0 0 0 2024-09-10T10:04:10.173 INFO:tasks.workunit.client.1.smithi107.stdout:4/309: symlink d0/d1f/d20/l6f 0 2024-09-10T10:04:10.175 INFO:tasks.workunit.client.0.smithi071.stdout:6/95: link d4/da/df/l10 d4/da/df/l18 0 2024-09-10T10:04:10.175 INFO:tasks.workunit.client.1.smithi107.stdout:5/245: dread de/f25 [0,4194304] 0 2024-09-10T10:04:10.175 INFO:tasks.workunit.client.1.smithi107.stdout:3/394: chown dc/dd/d45/d26/c47 52 1 2024-09-10T10:04:10.176 INFO:tasks.workunit.client.0.smithi071.stdout:1/90: rename l0 to d1/l1b 0 2024-09-10T10:04:10.177 INFO:tasks.workunit.client.0.smithi071.stdout:3/111: dread d3/f18 [4194304,4194304] 0 2024-09-10T10:04:10.177 INFO:tasks.workunit.client.1.smithi107.stdout:4/310: getdents d0/d40/d6d 0 2024-09-10T10:04:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:8/131: mkdir d5/df/d1e/d38 0 2024-09-10T10:04:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:9/230: sync 2024-09-10T10:04:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:5/108: mknod dc/c2c 0 2024-09-10T10:04:10.179 INFO:tasks.workunit.client.1.smithi107.stdout:5/246: mknod de/d20/d3d/c50 0 2024-09-10T10:04:10.179 INFO:tasks.workunit.client.0.smithi071.stdout:5/109: read dc/f13 [625744,65331] 0 2024-09-10T10:04:10.180 INFO:tasks.workunit.client.0.smithi071.stdout:0/87: readlink d11/l13 0 2024-09-10T10:04:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:0/88: dread - ff zero size 2024-09-10T10:04:10.181 INFO:tasks.workunit.client.1.smithi107.stdout:4/311: unlink d0/d29/d53/l64 0 2024-09-10T10:04:10.181 INFO:tasks.workunit.client.0.smithi071.stdout:2/84: fsync f2 0 2024-09-10T10:04:10.182 INFO:tasks.workunit.client.0.smithi071.stdout:6/96: creat d4/f19 x:0 0 0 2024-09-10T10:04:10.183 INFO:tasks.workunit.client.0.smithi071.stdout:6/97: fsync f1 0 2024-09-10T10:04:10.183 INFO:tasks.workunit.client.1.smithi107.stdout:5/247: write de/f25 [48470,94157] 0 2024-09-10T10:04:10.184 INFO:tasks.workunit.client.0.smithi071.stdout:6/98: write d4/f19 [286414,51040] 0 2024-09-10T10:04:10.184 INFO:tasks.workunit.client.0.smithi071.stdout:3/112: unlink d3/d15/f17 0 2024-09-10T10:04:10.184 INFO:tasks.workunit.client.1.smithi107.stdout:4/312: creat d0/d1f/d20/f70 x:0 0 0 2024-09-10T10:04:10.185 INFO:tasks.workunit.client.0.smithi071.stdout:8/132: creat d5/d36/f39 x:0 0 0 2024-09-10T10:04:10.186 INFO:tasks.workunit.client.1.smithi107.stdout:5/248: symlink de/d20/d2b/d4b/l51 0 2024-09-10T10:04:10.186 INFO:tasks.workunit.client.1.smithi107.stdout:4/313: truncate d0/d40/d57/f3e 781436 0 2024-09-10T10:04:10.187 INFO:tasks.workunit.client.0.smithi071.stdout:5/110: dread dc/f13 [0,4194304] 0 2024-09-10T10:04:10.187 INFO:tasks.workunit.client.1.smithi107.stdout:5/249: dread - de/f31 zero size 2024-09-10T10:04:10.188 INFO:tasks.workunit.client.0.smithi071.stdout:5/111: fdatasync dc/f1b 0 2024-09-10T10:04:10.188 INFO:tasks.workunit.client.1.smithi107.stdout:4/314: write d0/d1f/f60 [710189,37825] 0 2024-09-10T10:04:10.188 INFO:tasks.workunit.client.1.smithi107.stdout:3/395: write dc/dd/f17 [4302548,60006] 0 2024-09-10T10:04:10.189 INFO:tasks.workunit.client.0.smithi071.stdout:6/99: dread f1 [0,4194304] 0 2024-09-10T10:04:10.190 INFO:tasks.workunit.client.0.smithi071.stdout:0/89: mknod d11/d1e/c20 0 2024-09-10T10:04:10.190 INFO:tasks.workunit.client.0.smithi071.stdout:6/100: chown l2 1478 1 2024-09-10T10:04:10.190 INFO:tasks.workunit.client.1.smithi107.stdout:4/315: mkdir d0/d40/d57/d71 0 2024-09-10T10:04:10.191 INFO:tasks.workunit.client.0.smithi071.stdout:0/90: write d11/f18 [1558309,91479] 0 2024-09-10T10:04:10.191 INFO:tasks.workunit.client.0.smithi071.stdout:6/101: read d4/da/fb [5153263,128797] 0 2024-09-10T10:04:10.191 INFO:tasks.workunit.client.0.smithi071.stdout:2/85: rmdir d8 39 2024-09-10T10:04:10.193 INFO:tasks.workunit.client.1.smithi107.stdout:3/396: rmdir dc/dd/d45/d26/d59/d78 39 2024-09-10T10:04:10.193 INFO:tasks.workunit.client.1.smithi107.stdout:4/316: write d0/d40/f68 [977058,72092] 0 2024-09-10T10:04:10.196 INFO:tasks.workunit.client.0.smithi071.stdout:9/231: creat d0/db/d1b/d1d/d3d/f4d x:0 0 0 2024-09-10T10:04:10.196 INFO:tasks.workunit.client.1.smithi107.stdout:3/397: mknod dc/dd/d20/d23/d39/c87 0 2024-09-10T10:04:10.197 INFO:tasks.workunit.client.0.smithi071.stdout:3/113: mkdir d3/d10/d24 0 2024-09-10T10:04:10.197 INFO:tasks.workunit.client.1.smithi107.stdout:3/398: chown dc/dd/d45 10244039 1 2024-09-10T10:04:10.198 INFO:tasks.workunit.client.1.smithi107.stdout:4/317: mkdir d0/d1f/d72 0 2024-09-10T10:04:10.198 INFO:tasks.workunit.client.0.smithi071.stdout:8/133: symlink d5/d36/l3a 0 2024-09-10T10:04:10.200 INFO:tasks.workunit.client.0.smithi071.stdout:4/120: getdents db/d15 0 2024-09-10T10:04:10.200 INFO:tasks.workunit.client.1.smithi107.stdout:4/318: creat d0/d1f/d5e/f73 x:0 0 0 2024-09-10T10:04:10.200 INFO:tasks.workunit.client.0.smithi071.stdout:4/121: write f9 [1794191,60520] 0 2024-09-10T10:04:10.201 INFO:tasks.workunit.client.0.smithi071.stdout:5/112: mknod dc/df/c2d 0 2024-09-10T10:04:10.201 INFO:tasks.workunit.client.1.smithi107.stdout:5/250: truncate de/f1f 1778616 0 2024-09-10T10:04:10.202 INFO:tasks.workunit.client.0.smithi071.stdout:5/113: dread - dc/f21 zero size 2024-09-10T10:04:10.202 INFO:tasks.workunit.client.0.smithi071.stdout:5/114: chown la 2307391 1 2024-09-10T10:04:10.202 INFO:tasks.workunit.client.0.smithi071.stdout:1/91: truncate d1/fd 1401937 0 2024-09-10T10:04:10.203 INFO:tasks.workunit.client.1.smithi107.stdout:4/319: chown d0/d1f/d20/l23 169249 1 2024-09-10T10:04:10.204 INFO:tasks.workunit.client.0.smithi071.stdout:1/92: dread d1/f15 [0,4194304] 0 2024-09-10T10:04:10.204 INFO:tasks.workunit.client.0.smithi071.stdout:0/91: readlink d11/l19 0 2024-09-10T10:04:10.204 INFO:tasks.workunit.client.1.smithi107.stdout:3/399: dwrite dc/dd/f75 [0,4194304] 0 2024-09-10T10:04:10.205 INFO:tasks.workunit.client.0.smithi071.stdout:6/102: unlink d4/da/l14 0 2024-09-10T10:04:10.206 INFO:tasks.workunit.client.0.smithi071.stdout:9/232: fdatasync d0/fa 0 2024-09-10T10:04:10.206 INFO:tasks.workunit.client.1.smithi107.stdout:5/251: unlink de/d20/f43 0 2024-09-10T10:04:10.207 INFO:tasks.workunit.client.0.smithi071.stdout:8/134: creat d5/df/d16/f3b x:0 0 0 2024-09-10T10:04:10.209 INFO:tasks.workunit.client.1.smithi107.stdout:5/252: creat de/d41/f52 x:0 0 0 2024-09-10T10:04:10.209 INFO:tasks.workunit.client.1.smithi107.stdout:4/320: write d0/fa [4179471,66733] 0 2024-09-10T10:04:10.209 INFO:tasks.workunit.client.0.smithi071.stdout:4/122: creat db/f31 x:0 0 0 2024-09-10T10:04:10.211 INFO:tasks.workunit.client.0.smithi071.stdout:9/233: dread d0/db/ff [0,4194304] 0 2024-09-10T10:04:10.212 INFO:tasks.workunit.client.0.smithi071.stdout:5/115: mknod dc/df/d17/d22/c2e 0 2024-09-10T10:04:10.213 INFO:tasks.workunit.client.0.smithi071.stdout:2/86: mkdir d8/d13 0 2024-09-10T10:04:10.213 INFO:tasks.workunit.client.1.smithi107.stdout:5/253: creat de/d4a/f53 x:0 0 0 2024-09-10T10:04:10.214 INFO:tasks.workunit.client.1.smithi107.stdout:4/321: creat d0/d40/d57/f74 x:0 0 0 2024-09-10T10:04:10.215 INFO:tasks.workunit.client.1.smithi107.stdout:3/400: dwrite dc/dd/d45/d26/d59/f7a [0,4194304] 0 2024-09-10T10:04:10.216 INFO:tasks.workunit.client.1.smithi107.stdout:5/254: chown de/d20/d2b/f3e 118 1 2024-09-10T10:04:10.216 INFO:tasks.workunit.client.0.smithi071.stdout:6/103: unlink d4/l7 0 2024-09-10T10:04:10.216 INFO:tasks.workunit.client.0.smithi071.stdout:3/114: creat d3/d10/d24/f25 x:0 0 0 2024-09-10T10:04:10.218 INFO:tasks.workunit.client.1.smithi107.stdout:4/322: write d0/fb [1126995,120975] 0 2024-09-10T10:04:10.219 INFO:tasks.workunit.client.0.smithi071.stdout:9/234: symlink d0/db/d1b/d1d/d3d/l4e 0 2024-09-10T10:04:10.220 INFO:tasks.workunit.client.1.smithi107.stdout:3/401: creat dc/dd/d45/f88 x:0 0 0 2024-09-10T10:04:10.221 INFO:tasks.workunit.client.0.smithi071.stdout:7/83: sync 2024-09-10T10:04:10.222 INFO:tasks.workunit.client.1.smithi107.stdout:5/255: dread de/d20/f26 [0,4194304] 0 2024-09-10T10:04:10.222 INFO:tasks.workunit.client.0.smithi071.stdout:2/87: creat d8/f14 x:0 0 0 2024-09-10T10:04:10.222 INFO:tasks.workunit.client.0.smithi071.stdout:7/84: dread d9/ff [0,4194304] 0 2024-09-10T10:04:10.223 INFO:tasks.workunit.client.0.smithi071.stdout:7/85: readlink d9/ld 0 2024-09-10T10:04:10.223 INFO:tasks.workunit.client.1.smithi107.stdout:4/323: rename d0/d29 to d0/d40/d75 0 2024-09-10T10:04:10.223 INFO:tasks.workunit.client.0.smithi071.stdout:5/116: creat dc/df/d17/d22/f2f x:0 0 0 2024-09-10T10:04:10.224 INFO:tasks.workunit.client.0.smithi071.stdout:1/93: symlink d1/l1c 0 2024-09-10T10:04:10.224 INFO:tasks.workunit.client.1.smithi107.stdout:3/402: chown dc/dd/d20/d23/c5b 70949197 1 2024-09-10T10:04:10.224 INFO:tasks.workunit.client.1.smithi107.stdout:5/256: write de/d41/f46 [201294,36711] 0 2024-09-10T10:04:10.225 INFO:tasks.workunit.client.0.smithi071.stdout:8/135: creat d5/d30/f3c x:0 0 0 2024-09-10T10:04:10.225 INFO:tasks.workunit.client.1.smithi107.stdout:4/324: mkdir d0/d40/d57/d76 0 2024-09-10T10:04:10.226 INFO:tasks.workunit.client.1.smithi107.stdout:3/403: chown dc/dd/d45/d26/f50 53 1 2024-09-10T10:04:10.226 INFO:tasks.workunit.client.1.smithi107.stdout:5/257: fdatasync f8 0 2024-09-10T10:04:10.227 INFO:tasks.workunit.client.0.smithi071.stdout:8/136: readlink d5/l15 0 2024-09-10T10:04:10.227 INFO:tasks.workunit.client.0.smithi071.stdout:3/115: mknod d3/d10/d24/c26 0 2024-09-10T10:04:10.227 INFO:tasks.workunit.client.0.smithi071.stdout:6/104: creat d4/f1a x:0 0 0 2024-09-10T10:04:10.228 INFO:tasks.workunit.client.0.smithi071.stdout:6/105: readlink d4/da/le 0 2024-09-10T10:04:10.228 INFO:tasks.workunit.client.0.smithi071.stdout:0/92: creat d11/f21 x:0 0 0 2024-09-10T10:04:10.229 INFO:tasks.workunit.client.0.smithi071.stdout:9/235: creat d0/db/d20/d21/f4f x:0 0 0 2024-09-10T10:04:10.230 INFO:tasks.workunit.client.0.smithi071.stdout:9/236: fsync d0/fa 0 2024-09-10T10:04:10.231 INFO:tasks.workunit.client.1.smithi107.stdout:5/258: symlink de/d20/d2b/d4b/l54 0 2024-09-10T10:04:10.231 INFO:tasks.workunit.client.1.smithi107.stdout:3/404: rmdir dc 39 2024-09-10T10:04:10.231 INFO:tasks.workunit.client.0.smithi071.stdout:2/88: dwrite d8/f14 [0,4194304] 0 2024-09-10T10:04:10.231 INFO:tasks.workunit.client.0.smithi071.stdout:4/123: link db/c11 db/d15/d17/d24/c32 0 2024-09-10T10:04:10.232 INFO:tasks.workunit.client.1.smithi107.stdout:5/259: write de/d20/d2b/f39 [733314,19412] 0 2024-09-10T10:04:10.233 INFO:tasks.workunit.client.1.smithi107.stdout:3/405: chown dc/dd/d20/d23 144 1 2024-09-10T10:04:10.235 INFO:tasks.workunit.client.1.smithi107.stdout:5/260: symlink de/d20/d2b/l55 0 2024-09-10T10:04:10.235 INFO:tasks.workunit.client.1.smithi107.stdout:5/261: write de/f28 [788038,94897] 0 2024-09-10T10:04:10.236 INFO:tasks.workunit.client.0.smithi071.stdout:3/116: creat d3/d10/d24/f27 x:0 0 0 2024-09-10T10:04:10.238 INFO:tasks.workunit.client.0.smithi071.stdout:6/106: creat d4/f1b x:0 0 0 2024-09-10T10:04:10.240 INFO:tasks.workunit.client.0.smithi071.stdout:7/86: symlink d9/d15/l16 0 2024-09-10T10:04:10.241 INFO:tasks.workunit.client.0.smithi071.stdout:3/117: readlink d3/d15/l1e 0 2024-09-10T10:04:10.242 INFO:tasks.workunit.client.0.smithi071.stdout:1/94: fdatasync d1/f6 0 2024-09-10T10:04:10.243 INFO:tasks.workunit.client.0.smithi071.stdout:7/87: fsync d9/fa 0 2024-09-10T10:04:10.244 INFO:tasks.workunit.client.0.smithi071.stdout:0/93: mkdir d11/d22 0 2024-09-10T10:04:10.245 INFO:tasks.workunit.client.1.smithi107.stdout:5/262: dwrite de/d41/f46 [0,4194304] 0 2024-09-10T10:04:10.245 INFO:tasks.workunit.client.0.smithi071.stdout:2/89: dread d8/f14 [0,4194304] 0 2024-09-10T10:04:10.245 INFO:tasks.workunit.client.0.smithi071.stdout:6/107: mkdir d4/d1c 0 2024-09-10T10:04:10.247 INFO:tasks.workunit.client.1.smithi107.stdout:3/406: dwrite dc/dd/d45/d26/d41/d44/d35/d4a/f5c [0,4194304] 0 2024-09-10T10:04:10.248 INFO:tasks.workunit.client.0.smithi071.stdout:5/117: dwrite dc/f13 [4194304,4194304] 0 2024-09-10T10:04:10.248 INFO:tasks.workunit.client.0.smithi071.stdout:9/237: dwrite d0/db/d20/f2b [0,4194304] 0 2024-09-10T10:04:10.249 INFO:tasks.workunit.client.0.smithi071.stdout:7/88: write d9/d11/f12 [704522,16120] 0 2024-09-10T10:04:10.250 INFO:tasks.workunit.client.0.smithi071.stdout:6/108: chown d4/da/l17 71598 1 2024-09-10T10:04:10.254 INFO:tasks.workunit.client.0.smithi071.stdout:3/118: rename d3/d10/d24/c26 to d3/d20/c28 0 2024-09-10T10:04:10.256 INFO:tasks.workunit.client.0.smithi071.stdout:1/95: dread d1/fd [0,4194304] 0 2024-09-10T10:04:10.258 INFO:tasks.workunit.client.1.smithi107.stdout:5/263: link de/c17 de/d20/d2b/d4b/c56 0 2024-09-10T10:04:10.258 INFO:tasks.workunit.client.0.smithi071.stdout:3/119: dread - d3/d10/d24/f25 zero size 2024-09-10T10:04:10.259 INFO:tasks.workunit.client.1.smithi107.stdout:3/407: getdents dc/dd/d45/d26 0 2024-09-10T10:04:10.260 INFO:tasks.workunit.client.0.smithi071.stdout:3/120: write d3/f9 [825423,740] 0 2024-09-10T10:04:10.261 INFO:tasks.workunit.client.1.smithi107.stdout:5/264: creat de/d20/d3d/f57 x:0 0 0 2024-09-10T10:04:10.261 INFO:tasks.workunit.client.0.smithi071.stdout:7/89: dwrite f4 [0,4194304] 0 2024-09-10T10:04:10.262 INFO:tasks.workunit.client.1.smithi107.stdout:5/265: write de/f1e [2362561,108687] 0 2024-09-10T10:04:10.262 INFO:tasks.workunit.client.0.smithi071.stdout:3/121: write d3/d1c/f22 [334549,56715] 0 2024-09-10T10:04:10.262 INFO:tasks.workunit.client.1.smithi107.stdout:5/266: fdatasync de/d4a/f53 0 2024-09-10T10:04:10.263 INFO:tasks.workunit.client.0.smithi071.stdout:5/118: mknod dc/df/d17/d22/c30 0 2024-09-10T10:04:10.264 INFO:tasks.workunit.client.1.smithi107.stdout:3/408: unlink dc/dd/d45/d26/d41/d44/d35/d52/f86 0 2024-09-10T10:04:10.268 INFO:tasks.workunit.client.1.smithi107.stdout:5/267: creat de/d20/d2b/d4b/f58 x:0 0 0 2024-09-10T10:04:10.268 INFO:tasks.workunit.client.1.smithi107.stdout:3/409: mknod dc/dd/d42/d55/c89 0 2024-09-10T10:04:10.269 INFO:tasks.workunit.client.0.smithi071.stdout:3/122: dwrite d3/fa [0,4194304] 0 2024-09-10T10:04:10.271 INFO:tasks.workunit.client.0.smithi071.stdout:3/123: write d3/f9 [663029,61034] 0 2024-09-10T10:04:10.273 INFO:tasks.workunit.client.0.smithi071.stdout:0/94: creat d11/d22/f23 x:0 0 0 2024-09-10T10:04:10.274 INFO:tasks.workunit.client.1.smithi107.stdout:3/410: symlink dc/dd/d45/d26/d41/l8a 0 2024-09-10T10:04:10.275 INFO:tasks.workunit.client.1.smithi107.stdout:3/411: stat dc/dd/d45/d26/l29 0 2024-09-10T10:04:10.276 INFO:tasks.workunit.client.0.smithi071.stdout:2/90: creat d8/d13/f15 x:0 0 0 2024-09-10T10:04:10.276 INFO:tasks.workunit.client.1.smithi107.stdout:5/268: dread de/f28 [0,4194304] 0 2024-09-10T10:04:10.277 INFO:tasks.workunit.client.1.smithi107.stdout:3/412: read - dc/dd/d20/d23/d2f/f4c zero size 2024-09-10T10:04:10.277 INFO:tasks.workunit.client.0.smithi071.stdout:6/109: mkdir d4/d1c/d1d 0 2024-09-10T10:04:10.279 INFO:tasks.workunit.client.1.smithi107.stdout:3/413: write dc/dd/d45/d26/d41/d44/f3c [838909,117430] 0 2024-09-10T10:04:10.279 INFO:tasks.workunit.client.1.smithi107.stdout:5/269: unlink de/d20/d3d/f57 0 2024-09-10T10:04:10.282 INFO:tasks.workunit.client.1.smithi107.stdout:3/414: mknod dc/dd/d20/d23/d39/d69/c8b 0 2024-09-10T10:04:10.286 INFO:tasks.workunit.client.1.smithi107.stdout:3/415: creat dc/dd/d20/d23/d39/d69/f8c x:0 0 0 2024-09-10T10:04:10.288 INFO:tasks.workunit.client.1.smithi107.stdout:3/416: write dc/dd/d20/d23/f57 [4475016,106936] 0 2024-09-10T10:04:10.289 INFO:tasks.workunit.client.0.smithi071.stdout:9/238: creat d0/db/d1b/d46/f50 x:0 0 0 2024-09-10T10:04:10.289 INFO:tasks.workunit.client.1.smithi107.stdout:3/417: write dc/dd/f12 [3908847,113027] 0 2024-09-10T10:04:10.290 INFO:tasks.workunit.client.0.smithi071.stdout:7/90: rename d9/cc to d9/d11/c17 0 2024-09-10T10:04:10.291 INFO:tasks.workunit.client.1.smithi107.stdout:3/418: fdatasync dc/dd/d42/d55/f68 0 2024-09-10T10:04:10.291 INFO:tasks.workunit.client.0.smithi071.stdout:6/110: truncate d4/f1a 528432 0 2024-09-10T10:04:10.291 INFO:tasks.workunit.client.0.smithi071.stdout:5/119: rmdir dc/df 39 2024-09-10T10:04:10.292 INFO:tasks.workunit.client.0.smithi071.stdout:0/95: creat d11/d1e/f24 x:0 0 0 2024-09-10T10:04:10.292 INFO:tasks.workunit.client.0.smithi071.stdout:2/91: mknod d8/d13/c16 0 2024-09-10T10:04:10.292 INFO:tasks.workunit.client.1.smithi107.stdout:3/419: mknod dc/dd/d20/d23/c8d 0 2024-09-10T10:04:10.295 INFO:tasks.workunit.client.1.smithi107.stdout:3/420: creat dc/dd/d45/d26/d59/d5f/f8e x:0 0 0 2024-09-10T10:04:10.295 INFO:tasks.workunit.client.0.smithi071.stdout:4/124: truncate db/d15/d17/f18 21217 0 2024-09-10T10:04:10.297 INFO:tasks.workunit.client.1.smithi107.stdout:3/421: creat dc/dd/d45/d26/d41/d74/f8f x:0 0 0 2024-09-10T10:04:10.298 INFO:tasks.workunit.client.0.smithi071.stdout:8/137: dwrite d5/df/d1e/f37 [0,4194304] 0 2024-09-10T10:04:10.298 INFO:tasks.workunit.client.1.smithi107.stdout:3/422: chown dc/dd/d45 925664 1 2024-09-10T10:04:10.300 INFO:tasks.workunit.client.1.smithi107.stdout:3/423: rmdir dc/dd/d45/d26/d59 39 2024-09-10T10:04:10.302 INFO:tasks.workunit.client.0.smithi071.stdout:4/125: dwrite db/d15/d17/d24/f2b [0,4194304] 0 2024-09-10T10:04:10.309 INFO:tasks.workunit.client.1.smithi107.stdout:5/270: rmdir de/d20 39 2024-09-10T10:04:10.310 INFO:tasks.workunit.client.1.smithi107.stdout:3/424: dread dc/dd/d45/d26/d41/d44/d35/f4b [0,4194304] 0 2024-09-10T10:04:10.312 INFO:tasks.workunit.client.1.smithi107.stdout:3/425: dread - dc/dd/d45/d26/d41/d44/d35/d4a/f5a zero size 2024-09-10T10:04:10.313 INFO:tasks.workunit.client.1.smithi107.stdout:3/426: readlink dc/dd/d20/l2c 0 2024-09-10T10:04:10.317 INFO:tasks.workunit.client.1.smithi107.stdout:5/271: dwrite f8 [0,4194304] 0 2024-09-10T10:04:10.319 INFO:tasks.workunit.client.1.smithi107.stdout:3/427: creat dc/dd/d45/d26/d59/f90 x:0 0 0 2024-09-10T10:04:10.320 INFO:tasks.workunit.client.1.smithi107.stdout:5/272: write de/d20/d2b/d4b/f58 [361521,90494] 0 2024-09-10T10:04:10.321 INFO:tasks.workunit.client.1.smithi107.stdout:5/273: chown de/c40 576168 1 2024-09-10T10:04:10.322 INFO:tasks.workunit.client.1.smithi107.stdout:3/428: mkdir dc/dd/d42/d55/d58/d91 0 2024-09-10T10:04:10.325 INFO:tasks.workunit.client.1.smithi107.stdout:5/274: read de/d20/d2b/f3e [3958614,110166] 0 2024-09-10T10:04:10.326 INFO:tasks.workunit.client.1.smithi107.stdout:3/429: creat dc/dd/d45/d26/d41/d44/d35/d52/f92 x:0 0 0 2024-09-10T10:04:10.327 INFO:tasks.workunit.client.1.smithi107.stdout:5/275: symlink de/d41/l59 0 2024-09-10T10:04:10.329 INFO:tasks.workunit.client.1.smithi107.stdout:5/276: chown de/d20/d2b/c44 404 1 2024-09-10T10:04:10.332 INFO:tasks.workunit.client.1.smithi107.stdout:5/277: chown de/d41/c49 384 1 2024-09-10T10:04:10.332 INFO:tasks.workunit.client.1.smithi107.stdout:3/430: link dc/dd/d20/d23/c8d dc/dd/d45/d26/d41/d44/d35/d4a/c93 0 2024-09-10T10:04:10.333 INFO:tasks.workunit.client.1.smithi107.stdout:3/431: stat dc/dd/d45/d26/d59 0 2024-09-10T10:04:10.334 INFO:tasks.workunit.client.1.smithi107.stdout:5/278: dread de/d20/f26 [0,4194304] 0 2024-09-10T10:04:10.335 INFO:tasks.workunit.client.1.smithi107.stdout:3/432: symlink dc/dd/d20/d23/l94 0 2024-09-10T10:04:10.336 INFO:tasks.workunit.client.1.smithi107.stdout:5/279: mknod de/d20/c5a 0 2024-09-10T10:04:10.338 INFO:tasks.workunit.client.1.smithi107.stdout:3/433: write dc/dd/d45/d26/f82 [956501,99267] 0 2024-09-10T10:04:10.338 INFO:tasks.workunit.client.1.smithi107.stdout:5/280: write de/d20/f26 [5797403,9797] 0 2024-09-10T10:04:10.341 INFO:tasks.workunit.client.1.smithi107.stdout:3/434: symlink dc/dd/d45/d26/d59/l95 0 2024-09-10T10:04:10.343 INFO:tasks.workunit.client.1.smithi107.stdout:3/435: write dc/dd/d45/d26/f3a [2676984,71797] 0 2024-09-10T10:04:10.345 INFO:tasks.workunit.client.1.smithi107.stdout:3/436: symlink dc/d56/l96 0 2024-09-10T10:04:10.347 INFO:tasks.workunit.client.1.smithi107.stdout:3/437: write dc/dd/f75 [3648598,86682] 0 2024-09-10T10:04:10.349 INFO:tasks.workunit.client.1.smithi107.stdout:3/438: mknod dc/dd/d42/c97 0 2024-09-10T10:04:10.349 INFO:tasks.workunit.client.1.smithi107.stdout:3/439: read dc/dd/f31 [3621955,110244] 0 2024-09-10T10:04:10.353 INFO:tasks.workunit.client.1.smithi107.stdout:3/440: mknod dc/dd/d45/d26/d59/c98 0 2024-09-10T10:04:10.355 INFO:tasks.workunit.client.1.smithi107.stdout:3/441: mkdir dc/dd/d45/d26/d99 0 2024-09-10T10:04:10.357 INFO:tasks.workunit.client.1.smithi107.stdout:3/442: mknod dc/dd/d45/d26/d41/c9a 0 2024-09-10T10:04:10.362 INFO:tasks.workunit.client.1.smithi107.stdout:3/443: rename dc/dd/d45/f88 to dc/dd/d45/d26/d41/d44/d35/f9b 0 2024-09-10T10:04:10.364 INFO:tasks.workunit.client.1.smithi107.stdout:3/444: mkdir dc/dd/d20/d23/d2f/d9c 0 2024-09-10T10:04:10.368 INFO:tasks.workunit.client.1.smithi107.stdout:3/445: dread dc/dd/d20/f3e [0,4194304] 0 2024-09-10T10:04:10.375 INFO:tasks.workunit.client.1.smithi107.stdout:3/446: dwrite dc/dd/d42/d55/d58/f7c [0,4194304] 0 2024-09-10T10:04:10.376 INFO:tasks.workunit.client.1.smithi107.stdout:3/447: chown dc/dd/d45/d26/d41/d44/d63/f6f 29710 1 2024-09-10T10:04:10.378 INFO:tasks.workunit.client.1.smithi107.stdout:3/448: rmdir dc/dd/d45/d26/d41 39 2024-09-10T10:04:10.383 INFO:tasks.workunit.client.1.smithi107.stdout:3/449: getdents dc/dd/d45/d26/d59 0 2024-09-10T10:04:10.387 INFO:tasks.workunit.client.1.smithi107.stdout:3/450: dread dc/dd/d45/d26/d41/d44/f2d [0,4194304] 0 2024-09-10T10:04:10.388 INFO:tasks.workunit.client.1.smithi107.stdout:3/451: chown dc/dd/d45/d26/d59/f7a 1041 1 2024-09-10T10:04:10.390 INFO:tasks.workunit.client.1.smithi107.stdout:3/452: write dc/dd/d45/d26/d41/d44/d35/f19 [8411974,63920] 0 2024-09-10T10:04:10.395 INFO:tasks.workunit.client.1.smithi107.stdout:3/453: dwrite dc/dd/d20/f3e [0,4194304] 0 2024-09-10T10:04:10.398 INFO:tasks.workunit.client.1.smithi107.stdout:3/454: write dc/dd/d45/d26/d41/d74/f80 [573120,124455] 0 2024-09-10T10:04:10.414 INFO:tasks.workunit.client.0.smithi071.stdout:3/124: rename d3/d10/c1d to d3/d1c/c29 0 2024-09-10T10:04:10.414 INFO:tasks.workunit.client.0.smithi071.stdout:7/91: mknod d9/d11/c18 0 2024-09-10T10:04:10.414 INFO:tasks.workunit.client.0.smithi071.stdout:3/125: dread - d3/d10/d24/f25 zero size 2024-09-10T10:04:10.415 INFO:tasks.workunit.client.0.smithi071.stdout:1/96: creat d1/f1d x:0 0 0 2024-09-10T10:04:10.415 INFO:tasks.workunit.client.0.smithi071.stdout:5/120: chown dc/df/d17/c20 255 1 2024-09-10T10:04:10.416 INFO:tasks.workunit.client.0.smithi071.stdout:9/239: mknod d0/db/d20/d21/c51 0 2024-09-10T10:04:10.417 INFO:tasks.workunit.client.0.smithi071.stdout:1/97: read d1/f9 [841288,29866] 0 2024-09-10T10:04:10.417 INFO:tasks.workunit.client.0.smithi071.stdout:1/98: chown d1/cc 1 1 2024-09-10T10:04:10.418 INFO:tasks.workunit.client.1.smithi107.stdout:3/455: dread dc/dd/f17 [0,4194304] 0 2024-09-10T10:04:10.418 INFO:tasks.workunit.client.0.smithi071.stdout:8/138: creat d5/df/d1d/f3d x:0 0 0 2024-09-10T10:04:10.419 INFO:tasks.workunit.client.1.smithi107.stdout:3/456: chown dc/dd/d45/l36 9197 1 2024-09-10T10:04:10.419 INFO:tasks.workunit.client.0.smithi071.stdout:8/139: dread - d5/f10 zero size 2024-09-10T10:04:10.419 INFO:tasks.workunit.client.0.smithi071.stdout:8/140: stat d5 0 2024-09-10T10:04:10.420 INFO:tasks.workunit.client.1.smithi107.stdout:3/457: write dc/dd/d45/f4e [649711,109783] 0 2024-09-10T10:04:10.421 INFO:tasks.workunit.client.0.smithi071.stdout:6/111: rename d4/da/df/c15 to d4/da/c1e 0 2024-09-10T10:04:10.421 INFO:tasks.workunit.client.0.smithi071.stdout:3/126: rmdir d3/d20 39 2024-09-10T10:04:10.421 INFO:tasks.workunit.client.0.smithi071.stdout:6/112: readlink d4/da/le 0 2024-09-10T10:04:10.422 INFO:tasks.workunit.client.0.smithi071.stdout:6/113: fsync d4/da/f13 0 2024-09-10T10:04:10.422 INFO:tasks.workunit.client.0.smithi071.stdout:7/92: truncate d9/ff 1029844 0 2024-09-10T10:04:10.425 INFO:tasks.workunit.client.1.smithi107.stdout:3/458: write dc/dd/f1d [722478,56720] 0 2024-09-10T10:04:10.427 INFO:tasks.workunit.client.1.smithi107.stdout:3/459: fsync dc/dd/d45/d26/d41/d44/f2d 0 2024-09-10T10:04:10.429 INFO:tasks.workunit.client.1.smithi107.stdout:3/460: rmdir dc/dd 39 2024-09-10T10:04:10.429 INFO:tasks.workunit.client.0.smithi071.stdout:9/240: rename d0/db/d20/d21/d32 to d0/db/d1b/d1d/d3d/d52 0 2024-09-10T10:04:10.430 INFO:tasks.workunit.client.0.smithi071.stdout:9/241: write d0/d3b/f48 [3089625,60104] 0 2024-09-10T10:04:10.431 INFO:tasks.workunit.client.1.smithi107.stdout:3/461: rmdir dc/dd/d45/d26 39 2024-09-10T10:04:10.433 INFO:tasks.workunit.client.1.smithi107.stdout:3/462: mknod dc/dd/d42/d55/c9d 0 2024-09-10T10:04:10.433 INFO:tasks.workunit.client.0.smithi071.stdout:6/114: mknod d4/da/c1f 0 2024-09-10T10:04:10.433 INFO:tasks.workunit.client.0.smithi071.stdout:6/115: chown d4/da/df 37 1 2024-09-10T10:04:10.434 INFO:tasks.workunit.client.0.smithi071.stdout:1/99: mkdir d1/d1e 0 2024-09-10T10:04:10.436 INFO:tasks.workunit.client.1.smithi107.stdout:3/463: getdents dc/dd/d45/d26 0 2024-09-10T10:04:10.438 INFO:tasks.workunit.client.1.smithi107.stdout:3/464: symlink dc/dd/d45/d26/d41/d44/d63/l9e 0 2024-09-10T10:04:10.440 INFO:tasks.workunit.client.1.smithi107.stdout:3/465: read - dc/dd/d45/d26/d41/d44/d63/f7b zero size 2024-09-10T10:04:10.440 INFO:tasks.workunit.client.0.smithi071.stdout:9/242: symlink d0/db/d1b/d46/l53 0 2024-09-10T10:04:10.442 INFO:tasks.workunit.client.1.smithi107.stdout:3/466: creat dc/dd/d45/d26/d41/d44/d35/d52/f9f x:0 0 0 2024-09-10T10:04:10.442 INFO:tasks.workunit.client.0.smithi071.stdout:5/121: creat dc/f31 x:0 0 0 2024-09-10T10:04:10.443 INFO:tasks.workunit.client.1.smithi107.stdout:3/467: dread - dc/dd/d20/d23/d2f/f4c zero size 2024-09-10T10:04:10.443 INFO:tasks.workunit.client.0.smithi071.stdout:6/116: mkdir d4/d20 0 2024-09-10T10:04:10.444 INFO:tasks.workunit.client.1.smithi107.stdout:3/468: write dc/dd/d45/d26/d59/f90 [426227,86231] 0 2024-09-10T10:04:10.444 INFO:tasks.workunit.client.0.smithi071.stdout:4/126: getdents db/d15/d22 0 2024-09-10T10:04:10.445 INFO:tasks.workunit.client.0.smithi071.stdout:1/100: fsync d1/f9 0 2024-09-10T10:04:10.446 INFO:tasks.workunit.client.0.smithi071.stdout:3/127: link d3/d15/c1f d3/d15/c2a 0 2024-09-10T10:04:10.447 INFO:tasks.workunit.client.0.smithi071.stdout:1/101: write d1/f1d [892827,12701] 0 2024-09-10T10:04:10.448 INFO:tasks.workunit.client.1.smithi107.stdout:3/469: getdents dc/dd/d45/d26/d41/d74 0 2024-09-10T10:04:10.448 INFO:tasks.workunit.client.0.smithi071.stdout:1/102: chown d1/f1d 18705642 1 2024-09-10T10:04:10.449 INFO:tasks.workunit.client.0.smithi071.stdout:9/243: rename d0/dc to d0/db/d1b/d1d/d30/d54 0 2024-09-10T10:04:10.449 INFO:tasks.workunit.client.0.smithi071.stdout:5/122: dwrite dc/f1b [0,4194304] 0 2024-09-10T10:04:10.449 INFO:tasks.workunit.client.0.smithi071.stdout:6/117: rename d4 to d4/d1c/d21 22 2024-09-10T10:04:10.450 INFO:tasks.workunit.client.1.smithi107.stdout:3/470: symlink dc/dd/d20/la0 0 2024-09-10T10:04:10.451 INFO:tasks.workunit.client.0.smithi071.stdout:5/123: write f6 [3156213,117737] 0 2024-09-10T10:04:10.453 INFO:tasks.workunit.client.1.smithi107.stdout:3/471: symlink dc/la1 0 2024-09-10T10:04:10.454 INFO:tasks.workunit.client.0.smithi071.stdout:3/128: unlink d3/d15/l1e 0 2024-09-10T10:04:10.456 INFO:tasks.workunit.client.0.smithi071.stdout:9/244: dread d0/fa [0,4194304] 0 2024-09-10T10:04:10.459 INFO:tasks.workunit.client.0.smithi071.stdout:5/124: dwrite dc/df/f28 [0,4194304] 0 2024-09-10T10:04:10.460 INFO:tasks.workunit.client.0.smithi071.stdout:3/129: fsync d3/f6 0 2024-09-10T10:04:10.464 INFO:tasks.workunit.client.0.smithi071.stdout:6/118: rmdir d4/d1c/d1d 0 2024-09-10T10:04:10.466 INFO:tasks.workunit.client.0.smithi071.stdout:9/245: fdatasync d0/db/d1b/d1d/d4b/f4c 0 2024-09-10T10:04:10.468 INFO:tasks.workunit.client.0.smithi071.stdout:6/119: stat d4/da/df/l10 0 2024-09-10T10:04:10.469 INFO:tasks.workunit.client.0.smithi071.stdout:5/125: dwrite dc/fd [0,4194304] 0 2024-09-10T10:04:10.469 INFO:tasks.workunit.client.0.smithi071.stdout:6/120: fdatasync d4/f19 0 2024-09-10T10:04:10.470 INFO:tasks.workunit.client.0.smithi071.stdout:9/246: dread d0/db/f29 [0,4194304] 0 2024-09-10T10:04:10.471 INFO:tasks.workunit.client.0.smithi071.stdout:5/126: truncate dc/df/f1e 679546 0 2024-09-10T10:04:10.472 INFO:tasks.workunit.client.0.smithi071.stdout:5/127: dread dc/df/f14 [0,4194304] 0 2024-09-10T10:04:10.472 INFO:tasks.workunit.client.0.smithi071.stdout:5/128: stat dc/f1b 0 2024-09-10T10:04:10.475 INFO:tasks.workunit.client.0.smithi071.stdout:9/247: unlink d0/db/f37 0 2024-09-10T10:04:10.476 INFO:tasks.workunit.client.0.smithi071.stdout:5/129: rmdir dc/df 39 2024-09-10T10:04:10.478 INFO:tasks.workunit.client.0.smithi071.stdout:9/248: chown d0/db/d1b/d1d/d30/d54/d27/f2c 1273892268 1 2024-09-10T10:04:10.480 INFO:tasks.workunit.client.0.smithi071.stdout:9/249: write d0/db/d1b/d1d/d30/d54/f2d [386958,102595] 0 2024-09-10T10:04:10.482 INFO:tasks.workunit.client.0.smithi071.stdout:5/130: creat dc/f32 x:0 0 0 2024-09-10T10:04:10.484 INFO:tasks.workunit.client.0.smithi071.stdout:9/250: creat d0/db/d20/f55 x:0 0 0 2024-09-10T10:04:10.485 INFO:tasks.workunit.client.0.smithi071.stdout:5/131: dread dc/f1a [0,4194304] 0 2024-09-10T10:04:10.487 INFO:tasks.workunit.client.0.smithi071.stdout:9/251: chown d0/db/d1b/d1d/d30/d54/l1e 1281 1 2024-09-10T10:04:10.488 INFO:tasks.workunit.client.0.smithi071.stdout:5/132: creat dc/df/f33 x:0 0 0 2024-09-10T10:04:10.489 INFO:tasks.workunit.client.0.smithi071.stdout:5/133: chown dc/df/f19 14 1 2024-09-10T10:04:10.489 INFO:tasks.workunit.client.0.smithi071.stdout:9/252: mknod d0/db/d1b/d1d/d4b/c56 0 2024-09-10T10:04:10.491 INFO:tasks.workunit.client.0.smithi071.stdout:5/134: creat dc/df/d17/f34 x:0 0 0 2024-09-10T10:04:10.492 INFO:tasks.workunit.client.0.smithi071.stdout:5/135: creat dc/df/d17/d22/f35 x:0 0 0 2024-09-10T10:04:10.497 INFO:tasks.workunit.client.0.smithi071.stdout:9/253: dwrite d0/db/d1b/d1d/f3a [0,4194304] 0 2024-09-10T10:04:10.497 INFO:tasks.workunit.client.0.smithi071.stdout:5/136: rename dc/f32 to dc/df/d17/f36 0 2024-09-10T10:04:10.498 INFO:tasks.workunit.client.0.smithi071.stdout:5/137: write dc/df/f19 [1016761,124914] 0 2024-09-10T10:04:10.498 INFO:tasks.workunit.client.0.smithi071.stdout:9/254: creat d0/db/d20/d3c/f57 x:0 0 0 2024-09-10T10:04:10.503 INFO:tasks.workunit.client.0.smithi071.stdout:9/255: creat d0/db/d1b/d1d/d30/d54/d27/f58 x:0 0 0 2024-09-10T10:04:10.505 INFO:tasks.workunit.client.0.smithi071.stdout:5/138: rename dc/l2a to dc/l37 0 2024-09-10T10:04:10.507 INFO:tasks.workunit.client.0.smithi071.stdout:5/139: write dc/df/d17/f2b [710570,30917] 0 2024-09-10T10:04:10.511 INFO:tasks.workunit.client.0.smithi071.stdout:5/140: creat dc/df/f38 x:0 0 0 2024-09-10T10:04:10.511 INFO:tasks.workunit.client.0.smithi071.stdout:9/256: dwrite d0/db/f22 [0,4194304] 0 2024-09-10T10:04:10.514 INFO:tasks.workunit.client.0.smithi071.stdout:5/141: symlink dc/df/d17/d22/l39 0 2024-09-10T10:04:10.514 INFO:tasks.workunit.client.0.smithi071.stdout:9/257: creat d0/db/d1b/d1d/d3d/d52/f59 x:0 0 0 2024-09-10T10:04:10.521 INFO:tasks.workunit.client.0.smithi071.stdout:9/258: dwrite d0/db/d20/d21/f4f [0,4194304] 0 2024-09-10T10:04:10.538 INFO:tasks.workunit.client.0.smithi071.stdout:3/130: getdents d3/d10 0 2024-09-10T10:04:10.538 INFO:tasks.workunit.client.0.smithi071.stdout:1/103: fsync d1/f1d 0 2024-09-10T10:04:10.542 INFO:tasks.workunit.client.0.smithi071.stdout:1/104: creat d1/f1f x:0 0 0 2024-09-10T10:04:10.546 INFO:tasks.workunit.client.0.smithi071.stdout:8/141: write d5/df/d16/f22 [174901,95197] 0 2024-09-10T10:04:10.547 INFO:tasks.workunit.client.0.smithi071.stdout:1/105: rename d1/lb to d1/l20 0 2024-09-10T10:04:10.547 INFO:tasks.workunit.client.0.smithi071.stdout:0/96: dwrite d11/f15 [4194304,4194304] 0 2024-09-10T10:04:10.548 INFO:tasks.workunit.client.0.smithi071.stdout:8/142: fdatasync d5/f28 0 2024-09-10T10:04:10.550 INFO:tasks.workunit.client.0.smithi071.stdout:8/143: write d5/f11 [246605,64342] 0 2024-09-10T10:04:10.554 INFO:tasks.workunit.client.0.smithi071.stdout:0/97: dwrite d11/d1e/f24 [0,4194304] 0 2024-09-10T10:04:10.554 INFO:tasks.workunit.client.0.smithi071.stdout:1/106: mkdir d1/d21 0 2024-09-10T10:04:10.555 INFO:tasks.workunit.client.0.smithi071.stdout:1/107: readlink d1/l14 0 2024-09-10T10:04:10.555 INFO:tasks.workunit.client.0.smithi071.stdout:1/108: write d1/f19 [693853,41251] 0 2024-09-10T10:04:10.557 INFO:tasks.workunit.client.0.smithi071.stdout:4/127: write db/f1b [754378,113701] 0 2024-09-10T10:04:10.558 INFO:tasks.workunit.client.0.smithi071.stdout:4/128: write f9 [2681882,17140] 0 2024-09-10T10:04:10.558 INFO:tasks.workunit.client.0.smithi071.stdout:0/98: rename d11/f21 to d11/d22/f25 0 2024-09-10T10:04:10.559 INFO:tasks.workunit.client.0.smithi071.stdout:4/129: write f9 [705576,71946] 0 2024-09-10T10:04:10.564 INFO:tasks.workunit.client.0.smithi071.stdout:0/99: write d11/f17 [1478774,54222] 0 2024-09-10T10:04:10.564 INFO:tasks.workunit.client.0.smithi071.stdout:3/131: write d3/f18 [10926429,36722] 0 2024-09-10T10:04:10.565 INFO:tasks.workunit.client.0.smithi071.stdout:0/100: dread - d11/d22/f23 zero size 2024-09-10T10:04:10.565 INFO:tasks.workunit.client.0.smithi071.stdout:1/109: rename d1/l14 to d1/d21/l22 0 2024-09-10T10:04:10.566 INFO:tasks.workunit.client.0.smithi071.stdout:0/101: write f7 [261744,10634] 0 2024-09-10T10:04:10.566 INFO:tasks.workunit.client.0.smithi071.stdout:4/130: symlink db/d15/d17/l33 0 2024-09-10T10:04:10.567 INFO:tasks.workunit.client.0.smithi071.stdout:4/131: write db/f2a [299819,27046] 0 2024-09-10T10:04:10.570 INFO:tasks.workunit.client.0.smithi071.stdout:3/132: mkdir d3/d10/d24/d2b 0 2024-09-10T10:04:10.572 INFO:tasks.workunit.client.0.smithi071.stdout:0/102: symlink d11/d1e/l26 0 2024-09-10T10:04:10.572 INFO:tasks.workunit.client.0.smithi071.stdout:6/121: write d4/da/fb [1567301,72499] 0 2024-09-10T10:04:10.574 INFO:tasks.workunit.client.0.smithi071.stdout:6/122: stat d4/da/le 0 2024-09-10T10:04:10.575 INFO:tasks.workunit.client.0.smithi071.stdout:4/132: dwrite db/d1d/f23 [0,4194304] 0 2024-09-10T10:04:10.576 INFO:tasks.workunit.client.0.smithi071.stdout:0/103: truncate d11/d1e/f1f 798584 0 2024-09-10T10:04:10.576 INFO:tasks.workunit.client.0.smithi071.stdout:3/133: creat d3/d20/f2c x:0 0 0 2024-09-10T10:04:10.577 INFO:tasks.workunit.client.0.smithi071.stdout:6/123: write d4/da/f13 [1229882,124323] 0 2024-09-10T10:04:10.578 INFO:tasks.workunit.client.0.smithi071.stdout:0/104: fdatasync d11/f14 0 2024-09-10T10:04:10.579 INFO:tasks.workunit.client.0.smithi071.stdout:0/105: write f0 [559944,38445] 0 2024-09-10T10:04:10.579 INFO:tasks.workunit.client.0.smithi071.stdout:4/133: mknod db/d1d/c34 0 2024-09-10T10:04:10.580 INFO:tasks.workunit.client.0.smithi071.stdout:4/134: dread - db/d15/d22/f2f zero size 2024-09-10T10:04:10.585 INFO:tasks.workunit.client.0.smithi071.stdout:0/106: creat d11/d1e/f27 x:0 0 0 2024-09-10T10:04:10.585 INFO:tasks.workunit.client.0.smithi071.stdout:0/107: dread - f8 zero size 2024-09-10T10:04:10.587 INFO:tasks.workunit.client.0.smithi071.stdout:3/134: link d3/f21 d3/d10/f2d 0 2024-09-10T10:04:10.588 INFO:tasks.workunit.client.0.smithi071.stdout:5/142: truncate dc/df/f28 3451371 0 2024-09-10T10:04:10.588 INFO:tasks.workunit.client.0.smithi071.stdout:6/124: mknod d4/d20/c22 0 2024-09-10T10:04:10.588 INFO:tasks.workunit.client.0.smithi071.stdout:5/143: chown dc/f21 0 1 2024-09-10T10:04:10.589 INFO:tasks.workunit.client.0.smithi071.stdout:0/108: dread d11/f14 [0,4194304] 0 2024-09-10T10:04:10.590 INFO:tasks.workunit.client.0.smithi071.stdout:3/135: mknod d3/d20/c2e 0 2024-09-10T10:04:10.592 INFO:tasks.workunit.client.0.smithi071.stdout:6/125: unlink d4/da/df/l18 0 2024-09-10T10:04:10.593 INFO:tasks.workunit.client.0.smithi071.stdout:7/93: write d9/fb [155345,67903] 0 2024-09-10T10:04:10.594 INFO:tasks.workunit.client.0.smithi071.stdout:0/109: mknod d11/c28 0 2024-09-10T10:04:10.596 INFO:tasks.workunit.client.0.smithi071.stdout:6/126: symlink d4/l23 0 2024-09-10T10:04:10.599 INFO:tasks.workunit.client.0.smithi071.stdout:9/259: dwrite d0/db/d1b/d1d/f35 [0,4194304] 0 2024-09-10T10:04:10.601 INFO:tasks.workunit.client.0.smithi071.stdout:0/110: creat d11/d22/f29 x:0 0 0 2024-09-10T10:04:10.601 INFO:tasks.workunit.client.0.smithi071.stdout:5/144: dwrite dc/f1a [0,4194304] 0 2024-09-10T10:04:10.602 INFO:tasks.workunit.client.0.smithi071.stdout:3/136: dwrite d3/fd [0,4194304] 0 2024-09-10T10:04:10.602 INFO:tasks.workunit.client.0.smithi071.stdout:6/127: mknod d4/da/c24 0 2024-09-10T10:04:10.604 INFO:tasks.workunit.client.0.smithi071.stdout:3/137: read d3/ff [2566236,720] 0 2024-09-10T10:04:10.607 INFO:tasks.workunit.client.0.smithi071.stdout:9/260: unlink d0/db/d20/d21/f45 0 2024-09-10T10:04:10.609 INFO:tasks.workunit.client.0.smithi071.stdout:0/111: fdatasync d11/d22/f25 0 2024-09-10T10:04:10.610 INFO:tasks.workunit.client.0.smithi071.stdout:7/94: getdents d9 0 2024-09-10T10:04:10.611 INFO:tasks.workunit.client.0.smithi071.stdout:0/112: write f0 [209880,13123] 0 2024-09-10T10:04:10.612 INFO:tasks.workunit.client.0.smithi071.stdout:5/145: mknod dc/c3a 0 2024-09-10T10:04:10.612 INFO:tasks.workunit.client.0.smithi071.stdout:0/113: fsync fd 0 2024-09-10T10:04:10.613 INFO:tasks.workunit.client.0.smithi071.stdout:3/138: mkdir d3/d15/d2f 0 2024-09-10T10:04:10.613 INFO:tasks.workunit.client.0.smithi071.stdout:1/110: dwrite d1/fd [0,4194304] 0 2024-09-10T10:04:10.618 INFO:tasks.workunit.client.0.smithi071.stdout:6/128: link f1 d4/f25 0 2024-09-10T10:04:10.620 INFO:tasks.workunit.client.0.smithi071.stdout:7/95: creat d9/f19 x:0 0 0 2024-09-10T10:04:10.622 INFO:tasks.workunit.client.0.smithi071.stdout:5/146: creat dc/df/f3b x:0 0 0 2024-09-10T10:04:10.624 INFO:tasks.workunit.client.0.smithi071.stdout:0/114: rename d11/f15 to d11/d22/f2a 0 2024-09-10T10:04:10.625 INFO:tasks.workunit.client.0.smithi071.stdout:7/96: dread d9/d11/f12 [0,4194304] 0 2024-09-10T10:04:10.625 INFO:tasks.workunit.client.0.smithi071.stdout:6/129: creat d4/d20/f26 x:0 0 0 2024-09-10T10:04:10.627 INFO:tasks.workunit.client.0.smithi071.stdout:3/139: dread d3/ff [0,4194304] 0 2024-09-10T10:04:10.627 INFO:tasks.workunit.client.0.smithi071.stdout:1/111: mknod d1/c23 0 2024-09-10T10:04:10.630 INFO:tasks.workunit.client.0.smithi071.stdout:6/130: unlink d4/f6 0 2024-09-10T10:04:10.631 INFO:tasks.workunit.client.0.smithi071.stdout:6/131: chown d4/d20/f26 55415 1 2024-09-10T10:04:10.633 INFO:tasks.workunit.client.0.smithi071.stdout:6/132: unlink d4/f1a 0 2024-09-10T10:04:10.633 INFO:tasks.workunit.client.0.smithi071.stdout:3/140: dwrite d3/d10/d24/f25 [0,4194304] 0 2024-09-10T10:04:10.634 INFO:tasks.workunit.client.0.smithi071.stdout:6/133: fdatasync d4/da/f13 0 2024-09-10T10:04:10.634 INFO:tasks.workunit.client.1.smithi107.stdout:8/161: sync 2024-09-10T10:04:10.635 INFO:tasks.workunit.client.0.smithi071.stdout:3/141: mkdir d3/d20/d30 0 2024-09-10T10:04:10.637 INFO:tasks.workunit.client.0.smithi071.stdout:3/142: rmdir d3/d1c 39 2024-09-10T10:04:10.639 INFO:tasks.workunit.client.0.smithi071.stdout:7/97: dread d9/ff [0,4194304] 0 2024-09-10T10:04:10.658 INFO:tasks.workunit.client.0.smithi071.stdout:5/147: fsync dc/df/f28 0 2024-09-10T10:04:10.659 INFO:tasks.workunit.client.0.smithi071.stdout:5/148: write dc/df/f1e [884021,82930] 0 2024-09-10T10:04:10.660 INFO:tasks.workunit.client.0.smithi071.stdout:2/92: sync 2024-09-10T10:04:10.661 INFO:tasks.workunit.client.1.smithi107.stdout:8/162: dread d5/d8/f9 [0,4194304] 0 2024-09-10T10:04:10.663 INFO:tasks.workunit.client.0.smithi071.stdout:0/115: rmdir d11/d22 39 2024-09-10T10:04:10.664 INFO:tasks.workunit.client.0.smithi071.stdout:5/149: dread dc/fd [0,4194304] 0 2024-09-10T10:04:10.666 INFO:tasks.workunit.client.0.smithi071.stdout:0/116: mknod d11/d1e/c2b 0 2024-09-10T10:04:10.666 INFO:tasks.workunit.client.0.smithi071.stdout:2/93: dwrite d8/ff [0,4194304] 0 2024-09-10T10:04:10.667 INFO:tasks.workunit.client.0.smithi071.stdout:2/94: readlink d8/l12 0 2024-09-10T10:04:10.668 INFO:tasks.workunit.client.1.smithi107.stdout:8/163: dwrite d5/f2f [0,4194304] 0 2024-09-10T10:04:10.668 INFO:tasks.workunit.client.1.smithi107.stdout:8/164: chown d5/d8/d2a/l2c 12090370 1 2024-09-10T10:04:10.669 INFO:tasks.workunit.client.0.smithi071.stdout:5/150: write dc/df/d17/d22/f35 [980608,115329] 0 2024-09-10T10:04:10.674 INFO:tasks.workunit.client.0.smithi071.stdout:7/98: truncate d9/d11/f12 764006 0 2024-09-10T10:04:10.674 INFO:tasks.workunit.client.0.smithi071.stdout:5/151: chown dc/df/d17/c20 1022236 1 2024-09-10T10:04:10.674 INFO:tasks.workunit.client.0.smithi071.stdout:2/95: write d8/d13/f15 [32734,46860] 0 2024-09-10T10:04:10.674 INFO:tasks.workunit.client.1.smithi107.stdout:8/165: creat d5/f38 x:0 0 0 2024-09-10T10:04:10.676 INFO:tasks.workunit.client.0.smithi071.stdout:1/112: write d1/f16 [1798361,25729] 0 2024-09-10T10:04:10.676 INFO:tasks.workunit.client.0.smithi071.stdout:5/152: chown dc/df/f38 59 1 2024-09-10T10:04:10.678 INFO:tasks.workunit.client.0.smithi071.stdout:5/153: fsync f8 0 2024-09-10T10:04:10.678 INFO:tasks.workunit.client.0.smithi071.stdout:2/96: symlink d8/l17 0 2024-09-10T10:04:10.679 INFO:tasks.workunit.client.0.smithi071.stdout:0/117: dwrite d11/f17 [0,4194304] 0 2024-09-10T10:04:10.680 INFO:tasks.workunit.client.0.smithi071.stdout:1/113: unlink d1/f15 0 2024-09-10T10:04:10.681 INFO:tasks.workunit.client.0.smithi071.stdout:5/154: write dc/df/f1e [1682827,76930] 0 2024-09-10T10:04:10.681 INFO:tasks.workunit.client.0.smithi071.stdout:1/114: fdatasync d1/f9 0 2024-09-10T10:04:10.681 INFO:tasks.workunit.client.1.smithi107.stdout:8/166: dwrite d5/f26 [0,4194304] 0 2024-09-10T10:04:10.683 INFO:tasks.workunit.client.0.smithi071.stdout:2/97: symlink d8/l18 0 2024-09-10T10:04:10.683 INFO:tasks.workunit.client.1.smithi107.stdout:8/167: write d5/d8/f24 [4061160,70031] 0 2024-09-10T10:04:10.686 INFO:tasks.workunit.client.1.smithi107.stdout:8/168: symlink d5/d8/l39 0 2024-09-10T10:04:10.690 INFO:tasks.workunit.client.0.smithi071.stdout:1/115: dwrite d1/f19 [0,4194304] 0 2024-09-10T10:04:10.692 INFO:tasks.workunit.client.0.smithi071.stdout:2/98: rename d8/d13/c16 to d8/c19 0 2024-09-10T10:04:10.695 INFO:tasks.workunit.client.0.smithi071.stdout:1/116: write d1/f16 [1200580,37368] 0 2024-09-10T10:04:10.695 INFO:tasks.workunit.client.1.smithi107.stdout:8/169: dwrite d5/f19 [0,4194304] 0 2024-09-10T10:04:10.697 INFO:tasks.workunit.client.0.smithi071.stdout:5/155: dread dc/df/d17/d22/f35 [0,4194304] 0 2024-09-10T10:04:10.697 INFO:tasks.workunit.client.0.smithi071.stdout:1/117: creat d1/d21/f24 x:0 0 0 2024-09-10T10:04:10.698 INFO:tasks.workunit.client.0.smithi071.stdout:2/99: dread d8/fc [0,4194304] 0 2024-09-10T10:04:10.698 INFO:tasks.workunit.client.0.smithi071.stdout:5/156: write dc/df/d17/f1f [791297,72805] 0 2024-09-10T10:04:10.705 INFO:tasks.workunit.client.0.smithi071.stdout:7/99: write d9/d11/f12 [93719,32626] 0 2024-09-10T10:04:10.707 INFO:tasks.workunit.client.0.smithi071.stdout:1/118: dwrite d1/f9 [0,4194304] 0 2024-09-10T10:04:10.709 INFO:tasks.workunit.client.0.smithi071.stdout:7/100: stat d9/d15/l16 0 2024-09-10T10:04:10.710 INFO:tasks.workunit.client.0.smithi071.stdout:2/100: dwrite d8/d13/f15 [0,4194304] 0 2024-09-10T10:04:10.712 INFO:tasks.workunit.client.0.smithi071.stdout:2/101: dread d8/fc [0,4194304] 0 2024-09-10T10:04:10.713 INFO:tasks.workunit.client.0.smithi071.stdout:7/101: truncate f7 1981483 0 2024-09-10T10:04:10.715 INFO:tasks.workunit.client.0.smithi071.stdout:2/102: creat d8/f1a x:0 0 0 2024-09-10T10:04:10.716 INFO:tasks.workunit.client.0.smithi071.stdout:2/103: stat d8/f1a 0 2024-09-10T10:04:10.716 INFO:tasks.workunit.client.0.smithi071.stdout:7/102: mkdir d9/d1a 0 2024-09-10T10:04:10.716 INFO:tasks.workunit.client.0.smithi071.stdout:1/119: dwrite d1/f16 [0,4194304] 0 2024-09-10T10:04:10.718 INFO:tasks.workunit.client.0.smithi071.stdout:1/120: write d1/f1f [104704,94412] 0 2024-09-10T10:04:10.722 INFO:tasks.workunit.client.0.smithi071.stdout:7/103: mknod d9/d11/c1b 0 2024-09-10T10:04:10.723 INFO:tasks.workunit.client.0.smithi071.stdout:7/104: readlink l8 0 2024-09-10T10:04:10.724 INFO:tasks.workunit.client.0.smithi071.stdout:2/104: truncate f2 7262822 0 2024-09-10T10:04:10.725 INFO:tasks.workunit.client.0.smithi071.stdout:1/121: creat d1/d1e/f25 x:0 0 0 2024-09-10T10:04:10.726 INFO:tasks.workunit.client.0.smithi071.stdout:2/105: write d8/f1a [463359,21489] 0 2024-09-10T10:04:10.726 INFO:tasks.workunit.client.0.smithi071.stdout:1/122: write d1/f1f [745822,499] 0 2024-09-10T10:04:10.732 INFO:tasks.workunit.client.0.smithi071.stdout:1/123: dwrite d1/d1e/f25 [0,4194304] 0 2024-09-10T10:04:10.733 INFO:tasks.workunit.client.0.smithi071.stdout:1/124: read d1/f3 [6351665,42034] 0 2024-09-10T10:04:10.740 INFO:tasks.workunit.client.0.smithi071.stdout:1/125: dread d1/f6 [0,4194304] 0 2024-09-10T10:04:10.740 INFO:tasks.workunit.client.0.smithi071.stdout:7/105: truncate f7 1671831 0 2024-09-10T10:04:10.741 INFO:tasks.workunit.client.0.smithi071.stdout:1/126: chown d1/d21/f24 0 1 2024-09-10T10:04:10.743 INFO:tasks.workunit.client.0.smithi071.stdout:7/106: link f4 d9/d1a/f1c 0 2024-09-10T10:04:10.744 INFO:tasks.workunit.client.0.smithi071.stdout:1/127: mknod d1/c26 0 2024-09-10T10:04:10.744 INFO:tasks.workunit.client.0.smithi071.stdout:5/157: dwrite dc/df/f14 [0,4194304] 0 2024-09-10T10:04:10.745 INFO:tasks.workunit.client.0.smithi071.stdout:5/158: fdatasync dc/f13 0 2024-09-10T10:04:10.746 INFO:tasks.workunit.client.0.smithi071.stdout:7/107: unlink d9/d11/c1b 0 2024-09-10T10:04:10.747 INFO:tasks.workunit.client.0.smithi071.stdout:7/108: chown d9/d15 655324880 1 2024-09-10T10:04:10.748 INFO:tasks.workunit.client.0.smithi071.stdout:7/109: readlink l8 0 2024-09-10T10:04:10.751 INFO:tasks.workunit.client.0.smithi071.stdout:5/159: rename dc/df/d17/d22/f25 to dc/f3c 0 2024-09-10T10:04:10.751 INFO:tasks.workunit.client.0.smithi071.stdout:1/128: dwrite d1/f1f [0,4194304] 0 2024-09-10T10:04:10.751 INFO:tasks.workunit.client.0.smithi071.stdout:7/110: mkdir d9/d1a/d1d 0 2024-09-10T10:04:10.752 INFO:tasks.workunit.client.0.smithi071.stdout:5/160: fsync dc/f1a 0 2024-09-10T10:04:10.752 INFO:tasks.workunit.client.0.smithi071.stdout:7/111: chown d9/d15/l16 10696075 1 2024-09-10T10:04:10.753 INFO:tasks.workunit.client.0.smithi071.stdout:7/112: chown d9/d1a 11893263 1 2024-09-10T10:04:10.753 INFO:tasks.workunit.client.0.smithi071.stdout:7/113: write f2 [2903449,24160] 0 2024-09-10T10:04:10.757 INFO:tasks.workunit.client.0.smithi071.stdout:7/114: creat d9/d1a/d1d/f1e x:0 0 0 2024-09-10T10:04:10.759 INFO:tasks.workunit.client.0.smithi071.stdout:1/129: truncate d1/f9 3871717 0 2024-09-10T10:04:10.760 INFO:tasks.workunit.client.0.smithi071.stdout:1/130: chown d1/f16 9 1 2024-09-10T10:04:10.762 INFO:tasks.workunit.client.0.smithi071.stdout:1/131: unlink d1/c26 0 2024-09-10T10:04:10.763 INFO:tasks.workunit.client.0.smithi071.stdout:7/115: dwrite d9/fa [0,4194304] 0 2024-09-10T10:04:10.766 INFO:tasks.workunit.client.0.smithi071.stdout:8/144: sync 2024-09-10T10:04:10.766 INFO:tasks.workunit.client.0.smithi071.stdout:1/132: rmdir d1/d1e 39 2024-09-10T10:04:10.768 INFO:tasks.workunit.client.0.smithi071.stdout:8/145: read - d5/d36/f39 zero size 2024-09-10T10:04:10.769 INFO:tasks.workunit.client.0.smithi071.stdout:7/116: fdatasync f7 0 2024-09-10T10:04:10.770 INFO:tasks.workunit.client.0.smithi071.stdout:1/133: mknod d1/c27 0 2024-09-10T10:04:10.770 INFO:tasks.workunit.client.0.smithi071.stdout:5/161: read dc/df/d17/f2b [621681,23484] 0 2024-09-10T10:04:10.771 INFO:tasks.workunit.client.0.smithi071.stdout:5/162: chown dc/fd 759712975 1 2024-09-10T10:04:10.773 INFO:tasks.workunit.client.0.smithi071.stdout:5/163: write dc/df/f3b [358213,87565] 0 2024-09-10T10:04:10.780 INFO:tasks.workunit.client.0.smithi071.stdout:5/164: dwrite f6 [0,4194304] 0 2024-09-10T10:04:10.789 INFO:tasks.workunit.client.1.smithi107.stdout:0/187: sync 2024-09-10T10:04:10.792 INFO:tasks.workunit.client.1.smithi107.stdout:0/188: mknod d6/c36 0 2024-09-10T10:04:10.792 INFO:tasks.workunit.client.0.smithi071.stdout:1/134: rename d1/f1d to d1/d21/f28 0 2024-09-10T10:04:10.794 INFO:tasks.workunit.client.1.smithi107.stdout:0/189: unlink l3 0 2024-09-10T10:04:10.795 INFO:tasks.workunit.client.0.smithi071.stdout:7/117: write f7 [1514486,97934] 0 2024-09-10T10:04:10.797 INFO:tasks.workunit.client.0.smithi071.stdout:5/165: mknod dc/df/c3d 0 2024-09-10T10:04:10.798 INFO:tasks.workunit.client.0.smithi071.stdout:5/166: stat dc/df/d17/f34 0 2024-09-10T10:04:10.798 INFO:tasks.workunit.client.0.smithi071.stdout:5/167: chown dc/f3c 383098671 1 2024-09-10T10:04:10.800 INFO:tasks.workunit.client.0.smithi071.stdout:7/118: mkdir d9/d15/d1f 0 2024-09-10T10:04:10.802 INFO:tasks.workunit.client.0.smithi071.stdout:5/168: write dc/df/d17/f2b [881605,86395] 0 2024-09-10T10:04:10.802 INFO:tasks.workunit.client.0.smithi071.stdout:1/135: creat d1/f29 x:0 0 0 2024-09-10T10:04:10.803 INFO:tasks.workunit.client.1.smithi107.stdout:0/190: dwrite d6/d14/f2d [0,4194304] 0 2024-09-10T10:04:10.804 INFO:tasks.workunit.client.1.smithi107.stdout:0/191: write d6/f12 [2946204,48658] 0 2024-09-10T10:04:10.804 INFO:tasks.workunit.client.1.smithi107.stdout:0/192: stat d6 0 2024-09-10T10:04:10.805 INFO:tasks.workunit.client.1.smithi107.stdout:0/193: write d6/d8/f28 [282655,22080] 0 2024-09-10T10:04:10.806 INFO:tasks.workunit.client.1.smithi107.stdout:0/194: chown d6/f1d 144202327 1 2024-09-10T10:04:10.806 INFO:tasks.workunit.client.1.smithi107.stdout:0/195: fsync d6/f7 0 2024-09-10T10:04:10.808 INFO:tasks.workunit.client.0.smithi071.stdout:8/146: dwrite d5/f28 [8388608,4194304] 0 2024-09-10T10:04:10.808 INFO:tasks.workunit.client.0.smithi071.stdout:7/119: link l8 d9/d1a/l20 0 2024-09-10T10:04:10.813 INFO:tasks.workunit.client.0.smithi071.stdout:5/169: dwrite dc/f1a [4194304,4194304] 0 2024-09-10T10:04:10.814 INFO:tasks.workunit.client.1.smithi107.stdout:0/196: dwrite d6/f7 [0,4194304] 0 2024-09-10T10:04:10.815 INFO:tasks.workunit.client.0.smithi071.stdout:1/136: dwrite d1/f1f [0,4194304] 0 2024-09-10T10:04:10.819 INFO:tasks.workunit.client.0.smithi071.stdout:7/120: rename d9/d11/c17 to d9/d15/d1f/c21 0 2024-09-10T10:04:10.819 INFO:tasks.workunit.client.1.smithi107.stdout:0/197: rename d6/f1d to d6/d8/d2f/d2e/d32/f37 0 2024-09-10T10:04:10.821 INFO:tasks.workunit.client.1.smithi107.stdout:0/198: write d6/f23 [4400375,62485] 0 2024-09-10T10:04:10.824 INFO:tasks.workunit.client.0.smithi071.stdout:5/170: mkdir dc/df/d3e 0 2024-09-10T10:04:10.824 INFO:tasks.workunit.client.0.smithi071.stdout:8/147: getdents d5/d30 0 2024-09-10T10:04:10.826 INFO:tasks.workunit.client.0.smithi071.stdout:8/148: chown d5/df/d1e/f37 12254 1 2024-09-10T10:04:10.827 INFO:tasks.workunit.client.0.smithi071.stdout:1/137: symlink d1/d1e/l2a 0 2024-09-10T10:04:10.828 INFO:tasks.workunit.client.1.smithi107.stdout:0/199: dwrite d6/f12 [0,4194304] 0 2024-09-10T10:04:10.829 INFO:tasks.workunit.client.0.smithi071.stdout:7/121: rename d9/ld to d9/d15/l22 0 2024-09-10T10:04:10.829 INFO:tasks.workunit.client.1.smithi107.stdout:0/200: chown d6/d8/d2f/l2b 2578495 1 2024-09-10T10:04:10.830 INFO:tasks.workunit.client.0.smithi071.stdout:5/171: dread dc/df/f14 [0,4194304] 0 2024-09-10T10:04:10.832 INFO:tasks.workunit.client.1.smithi107.stdout:0/201: chown d6/c1f 22 1 2024-09-10T10:04:10.833 INFO:tasks.workunit.client.0.smithi071.stdout:8/149: rename d5/fb to d5/df/d16/f3e 0 2024-09-10T10:04:10.833 INFO:tasks.workunit.client.0.smithi071.stdout:7/122: symlink d9/d15/d1f/l23 0 2024-09-10T10:04:10.836 INFO:tasks.workunit.client.0.smithi071.stdout:8/150: fdatasync d5/f19 0 2024-09-10T10:04:10.838 INFO:tasks.workunit.client.0.smithi071.stdout:5/172: creat dc/df/d29/f3f x:0 0 0 2024-09-10T10:04:10.838 INFO:tasks.workunit.client.0.smithi071.stdout:1/138: link d1/l17 d1/l2b 0 2024-09-10T10:04:10.840 INFO:tasks.workunit.client.0.smithi071.stdout:7/123: link d9/f10 d9/d11/f24 0 2024-09-10T10:04:10.841 INFO:tasks.workunit.client.0.smithi071.stdout:1/139: write d1/f6 [2060235,68840] 0 2024-09-10T10:04:10.844 INFO:tasks.workunit.client.1.smithi107.stdout:0/202: fsync d6/d8/d2f/d2e/d32/f37 0 2024-09-10T10:04:10.845 INFO:tasks.workunit.client.0.smithi071.stdout:5/173: dwrite dc/f13 [0,4194304] 0 2024-09-10T10:04:10.846 INFO:tasks.workunit.client.1.smithi107.stdout:0/203: mknod d6/d8/c38 0 2024-09-10T10:04:10.847 INFO:tasks.workunit.client.1.smithi107.stdout:0/204: chown d6/d14/c34 15911513 1 2024-09-10T10:04:10.849 INFO:tasks.workunit.client.1.smithi107.stdout:0/205: readlink d6/d8/l1c 0 2024-09-10T10:04:10.850 INFO:tasks.workunit.client.0.smithi071.stdout:5/174: write dc/df/d17/f36 [534169,6518] 0 2024-09-10T10:04:10.851 INFO:tasks.workunit.client.0.smithi071.stdout:7/124: dwrite d9/d11/f14 [0,4194304] 0 2024-09-10T10:04:10.852 INFO:tasks.workunit.client.1.smithi107.stdout:0/206: unlink d6/d14/c34 0 2024-09-10T10:04:10.852 INFO:tasks.workunit.client.1.smithi107.stdout:0/207: chown d6/d14/f2d 2954 1 2024-09-10T10:04:10.853 INFO:tasks.workunit.client.0.smithi071.stdout:1/140: dwrite d1/fd [0,4194304] 0 2024-09-10T10:04:10.855 INFO:tasks.workunit.client.0.smithi071.stdout:5/175: unlink dc/df/d17/f36 0 2024-09-10T10:04:10.859 INFO:tasks.workunit.client.0.smithi071.stdout:5/176: chown dc/df/c10 321611 1 2024-09-10T10:04:10.864 INFO:tasks.workunit.client.0.smithi071.stdout:1/141: rename d1/f6 to d1/f2c 0 2024-09-10T10:04:10.865 INFO:tasks.workunit.client.0.smithi071.stdout:1/142: write d1/d1e/f25 [3481829,23195] 0 2024-09-10T10:04:10.867 INFO:tasks.workunit.client.0.smithi071.stdout:1/143: symlink d1/d21/l2d 0 2024-09-10T10:04:10.869 INFO:tasks.workunit.client.0.smithi071.stdout:1/144: write d1/d1e/f25 [4536677,2181] 0 2024-09-10T10:04:10.872 INFO:tasks.workunit.client.0.smithi071.stdout:1/145: dread d1/f3 [4194304,4194304] 0 2024-09-10T10:04:10.874 INFO:tasks.workunit.client.0.smithi071.stdout:1/146: fsync d1/f9 0 2024-09-10T10:04:10.879 INFO:tasks.workunit.client.0.smithi071.stdout:1/147: dwrite d1/d1e/f25 [0,4194304] 0 2024-09-10T10:04:10.881 INFO:tasks.workunit.client.0.smithi071.stdout:7/125: fdatasync d9/d11/f14 0 2024-09-10T10:04:10.883 INFO:tasks.workunit.client.0.smithi071.stdout:1/148: creat d1/f2e x:0 0 0 2024-09-10T10:04:10.885 INFO:tasks.workunit.client.0.smithi071.stdout:1/149: mkdir d1/d21/d2f 0 2024-09-10T10:04:10.886 INFO:tasks.workunit.client.1.smithi107.stdout:0/208: dread f4 [0,4194304] 0 2024-09-10T10:04:10.886 INFO:tasks.workunit.client.1.smithi107.stdout:0/209: chown d6/d14 243 1 2024-09-10T10:04:10.887 INFO:tasks.workunit.client.1.smithi107.stdout:0/210: write d6/d14/f2d [4234520,75490] 0 2024-09-10T10:04:10.887 INFO:tasks.workunit.client.0.smithi071.stdout:1/150: mkdir d1/d21/d2f/d30 0 2024-09-10T10:04:10.888 INFO:tasks.workunit.client.0.smithi071.stdout:1/151: fsync d1/f16 0 2024-09-10T10:04:10.890 INFO:tasks.workunit.client.0.smithi071.stdout:7/126: dread d9/fe [0,4194304] 0 2024-09-10T10:04:10.892 INFO:tasks.workunit.client.0.smithi071.stdout:7/127: mknod d9/c25 0 2024-09-10T10:04:10.893 INFO:tasks.workunit.client.0.smithi071.stdout:7/128: write f7 [1141964,94480] 0 2024-09-10T10:04:10.893 INFO:tasks.workunit.client.0.smithi071.stdout:7/129: stat c5 0 2024-09-10T10:04:10.893 INFO:tasks.workunit.client.1.smithi107.stdout:0/211: dwrite d6/d8/d2f/f33 [0,4194304] 0 2024-09-10T10:04:10.894 INFO:tasks.workunit.client.1.smithi107.stdout:3/472: sync 2024-09-10T10:04:10.894 INFO:tasks.workunit.client.1.smithi107.stdout:7/236: sync 2024-09-10T10:04:10.895 INFO:tasks.workunit.client.1.smithi107.stdout:9/293: sync 2024-09-10T10:04:10.895 INFO:tasks.workunit.client.1.smithi107.stdout:6/259: sync 2024-09-10T10:04:10.895 INFO:tasks.workunit.client.1.smithi107.stdout:2/288: sync 2024-09-10T10:04:10.895 INFO:tasks.workunit.client.1.smithi107.stdout:5/281: sync 2024-09-10T10:04:10.895 INFO:tasks.workunit.client.1.smithi107.stdout:8/170: sync 2024-09-10T10:04:10.895 INFO:tasks.workunit.client.1.smithi107.stdout:1/332: sync 2024-09-10T10:04:10.895 INFO:tasks.workunit.client.1.smithi107.stdout:4/325: sync 2024-09-10T10:04:10.896 INFO:tasks.workunit.client.1.smithi107.stdout:0/212: symlink d6/d8/d2f/d2e/d32/l39 0 2024-09-10T10:04:10.897 INFO:tasks.workunit.client.1.smithi107.stdout:3/473: readlink dc/dd/d20/la0 0 2024-09-10T10:04:10.898 INFO:tasks.workunit.client.1.smithi107.stdout:7/237: dread - d0/d8/d9/f30 zero size 2024-09-10T10:04:10.899 INFO:tasks.workunit.client.1.smithi107.stdout:0/213: chown d6/d8/f28 3 1 2024-09-10T10:04:10.900 INFO:tasks.workunit.client.1.smithi107.stdout:8/171: creat d5/d8/dc/d21/f3a x:0 0 0 2024-09-10T10:04:10.904 INFO:tasks.workunit.client.1.smithi107.stdout:2/289: creat d3/d21/d41/f5d x:0 0 0 2024-09-10T10:04:10.904 INFO:tasks.workunit.client.0.smithi071.stdout:7/130: dread f7 [0,4194304] 0 2024-09-10T10:04:10.905 INFO:tasks.workunit.client.1.smithi107.stdout:4/326: rename d0/d40/d75/d53/d6e to d0/d40/d57/d76/d77 0 2024-09-10T10:04:10.905 INFO:tasks.workunit.client.1.smithi107.stdout:9/294: rmdir d5/d1e 39 2024-09-10T10:04:10.906 INFO:tasks.workunit.client.0.smithi071.stdout:7/131: symlink d9/l26 0 2024-09-10T10:04:10.907 INFO:tasks.workunit.client.0.smithi071.stdout:7/132: dread d9/fb [0,4194304] 0 2024-09-10T10:04:10.908 INFO:tasks.workunit.client.1.smithi107.stdout:8/172: mknod d5/d8/c3b 0 2024-09-10T10:04:10.908 INFO:tasks.workunit.client.0.smithi071.stdout:7/133: dread d9/fb [0,4194304] 0 2024-09-10T10:04:10.909 INFO:tasks.workunit.client.1.smithi107.stdout:6/260: dwrite d0/f13 [0,4194304] 0 2024-09-10T10:04:10.909 INFO:tasks.workunit.client.0.smithi071.stdout:7/134: read d9/d11/f14 [1229426,60777] 0 2024-09-10T10:04:10.911 INFO:tasks.workunit.client.0.smithi071.stdout:7/135: mknod d9/d11/c27 0 2024-09-10T10:04:10.913 INFO:tasks.workunit.client.1.smithi107.stdout:3/474: symlink dc/dd/d42/d55/d58/d91/la2 0 2024-09-10T10:04:10.914 INFO:tasks.workunit.client.0.smithi071.stdout:7/136: dread d9/fb [0,4194304] 0 2024-09-10T10:04:10.916 INFO:tasks.workunit.client.1.smithi107.stdout:7/238: dwrite d0/f40 [0,4194304] 0 2024-09-10T10:04:10.916 INFO:tasks.workunit.client.1.smithi107.stdout:9/295: symlink d5/d7/d1d/d41/l6d 0 2024-09-10T10:04:10.917 INFO:tasks.workunit.client.1.smithi107.stdout:0/214: dwrite d6/d8/d2f/f21 [0,4194304] 0 2024-09-10T10:04:10.920 INFO:tasks.workunit.client.1.smithi107.stdout:8/173: unlink d5/c1c 0 2024-09-10T10:04:10.921 INFO:tasks.workunit.client.1.smithi107.stdout:1/333: truncate d2/d35/f3f 394061 0 2024-09-10T10:04:10.923 INFO:tasks.workunit.client.0.smithi071.stdout:7/137: dwrite d9/d11/f14 [0,4194304] 0 2024-09-10T10:04:10.923 INFO:tasks.workunit.client.1.smithi107.stdout:1/334: stat d2/l1f 0 2024-09-10T10:04:10.925 INFO:tasks.workunit.client.1.smithi107.stdout:8/174: chown d5/d8/dc 192293205 1 2024-09-10T10:04:10.926 INFO:tasks.workunit.client.1.smithi107.stdout:7/239: mknod d0/d8/d9/c48 0 2024-09-10T10:04:10.926 INFO:tasks.workunit.client.1.smithi107.stdout:5/282: dwrite de/d20/f37 [0,4194304] 0 2024-09-10T10:04:10.926 INFO:tasks.workunit.client.1.smithi107.stdout:2/290: write d3/da/df/d20/d4a/f53 [3581718,125541] 0 2024-09-10T10:04:10.927 INFO:tasks.workunit.client.0.smithi071.stdout:7/138: creat d9/f28 x:0 0 0 2024-09-10T10:04:10.927 INFO:tasks.workunit.client.1.smithi107.stdout:1/335: truncate d2/d2a/f41 5003789 0 2024-09-10T10:04:10.928 INFO:tasks.workunit.client.0.smithi071.stdout:7/139: read - d9/d1a/d1d/f1e zero size 2024-09-10T10:04:10.929 INFO:tasks.workunit.client.1.smithi107.stdout:0/215: mknod d6/d8/d2f/d2e/d32/c3a 0 2024-09-10T10:04:10.930 INFO:tasks.workunit.client.1.smithi107.stdout:9/296: symlink d5/d7/d1d/d25/d50/l6e 0 2024-09-10T10:04:10.932 INFO:tasks.workunit.client.1.smithi107.stdout:1/336: mkdir d2/d12/d65 0 2024-09-10T10:04:10.936 INFO:tasks.workunit.client.1.smithi107.stdout:1/337: chown d2/d12/f3c 1 1 2024-09-10T10:04:10.936 INFO:tasks.workunit.client.1.smithi107.stdout:5/283: dread de/d41/f46 [0,4194304] 0 2024-09-10T10:04:10.938 INFO:tasks.workunit.client.1.smithi107.stdout:1/338: stat d2/d35/f5b 0 2024-09-10T10:04:10.939 INFO:tasks.workunit.client.1.smithi107.stdout:2/291: mknod d3/d21/d41/c5e 0 2024-09-10T10:04:10.939 INFO:tasks.workunit.client.1.smithi107.stdout:0/216: read d6/f23 [2271265,41211] 0 2024-09-10T10:04:10.940 INFO:tasks.workunit.client.1.smithi107.stdout:1/339: dread - d2/d35/f61 zero size 2024-09-10T10:04:10.941 INFO:tasks.workunit.client.1.smithi107.stdout:9/297: dread d5/d7/d1d/d25/d50/f32 [0,4194304] 0 2024-09-10T10:04:10.944 INFO:tasks.workunit.client.1.smithi107.stdout:0/217: chown d6/d8/f9 4 1 2024-09-10T10:04:10.944 INFO:tasks.workunit.client.1.smithi107.stdout:1/340: mknod d2/d36/c66 0 2024-09-10T10:04:10.945 INFO:tasks.workunit.client.1.smithi107.stdout:2/292: write d3/f3d [871896,81628] 0 2024-09-10T10:04:10.945 INFO:tasks.workunit.client.1.smithi107.stdout:8/175: getdents d5/d8/dc/d21 0 2024-09-10T10:04:10.945 INFO:tasks.workunit.client.1.smithi107.stdout:9/298: write d5/d7/d1d/d25/d27/f51 [382644,33739] 0 2024-09-10T10:04:10.946 INFO:tasks.workunit.client.1.smithi107.stdout:3/475: dread f1 [0,4194304] 0 2024-09-10T10:04:10.946 INFO:tasks.workunit.client.1.smithi107.stdout:8/176: write d5/f26 [3713986,52952] 0 2024-09-10T10:04:10.950 INFO:tasks.workunit.client.1.smithi107.stdout:9/299: symlink d5/d7/d1d/l6f 0 2024-09-10T10:04:10.952 INFO:tasks.workunit.client.1.smithi107.stdout:3/476: creat dc/dd/d20/d23/d39/fa3 x:0 0 0 2024-09-10T10:04:10.953 INFO:tasks.workunit.client.1.smithi107.stdout:1/341: getdents d2/d6 0 2024-09-10T10:04:10.954 INFO:tasks.workunit.client.1.smithi107.stdout:9/300: write d5/f35 [1346137,16421] 0 2024-09-10T10:04:10.955 INFO:tasks.workunit.client.1.smithi107.stdout:2/293: rename d3/da/d1e/d22 to d3/da/d1e/d5f 0 2024-09-10T10:04:10.957 INFO:tasks.workunit.client.1.smithi107.stdout:3/477: dread dc/dd/d45/d26/d59/f7a [0,4194304] 0 2024-09-10T10:04:10.957 INFO:tasks.workunit.client.1.smithi107.stdout:1/342: mkdir d2/d6/d67 0 2024-09-10T10:04:10.959 INFO:tasks.workunit.client.1.smithi107.stdout:8/177: getdents d5/d8/dc 0 2024-09-10T10:04:10.961 INFO:tasks.workunit.client.1.smithi107.stdout:9/301: rename d5/d7/d3c/d53/d57/f5e to d5/d7/d1d/d41/f70 0 2024-09-10T10:04:10.961 INFO:tasks.workunit.client.1.smithi107.stdout:2/294: fdatasync d3/da/df/d20/d4a/f53 0 2024-09-10T10:04:10.961 INFO:tasks.workunit.client.1.smithi107.stdout:3/478: write dc/dd/d45/d26/d59/d5f/f8e [496279,309] 0 2024-09-10T10:04:10.963 INFO:tasks.workunit.client.0.smithi071.stdout:7/140: write f4 [4485345,37311] 0 2024-09-10T10:04:10.964 INFO:tasks.workunit.client.1.smithi107.stdout:3/479: write dc/dd/d20/d23/d2f/f85 [1019997,125406] 0 2024-09-10T10:04:10.964 INFO:tasks.workunit.client.1.smithi107.stdout:4/327: truncate d0/d1f/d20/f30 2636238 0 2024-09-10T10:04:10.966 INFO:tasks.workunit.client.1.smithi107.stdout:1/343: unlink d2/d12/l63 0 2024-09-10T10:04:10.966 INFO:tasks.workunit.client.0.smithi071.stdout:7/141: symlink d9/d15/d1f/l29 0 2024-09-10T10:04:10.967 INFO:tasks.workunit.client.1.smithi107.stdout:8/178: creat d5/d8/dc/d21/f3c x:0 0 0 2024-09-10T10:04:10.968 INFO:tasks.workunit.client.1.smithi107.stdout:9/302: creat d5/d7/d1d/d41/f71 x:0 0 0 2024-09-10T10:04:10.969 INFO:tasks.workunit.client.0.smithi071.stdout:7/142: link d9/d11/f12 d9/d15/d1f/f2a 0 2024-09-10T10:04:10.969 INFO:tasks.workunit.client.1.smithi107.stdout:0/218: getdents d6/d8/d2f/d2e/d32 0 2024-09-10T10:04:10.970 INFO:tasks.workunit.client.0.smithi071.stdout:7/143: write d9/d1a/f1c [3871399,32837] 0 2024-09-10T10:04:10.971 INFO:tasks.workunit.client.1.smithi107.stdout:3/480: write dc/dd/d45/d26/d59/f7a [2170146,88849] 0 2024-09-10T10:04:10.973 INFO:tasks.workunit.client.1.smithi107.stdout:8/179: rmdir d5/d8/d2a 39 2024-09-10T10:04:10.973 INFO:tasks.workunit.client.1.smithi107.stdout:3/481: stat dc/dd/d45/l36 0 2024-09-10T10:04:10.974 INFO:tasks.workunit.client.1.smithi107.stdout:4/328: dwrite d0/d40/d57/f33 [0,4194304] 0 2024-09-10T10:04:10.975 INFO:tasks.workunit.client.1.smithi107.stdout:9/303: creat d5/d7/d3c/f72 x:0 0 0 2024-09-10T10:04:10.976 INFO:tasks.workunit.client.1.smithi107.stdout:0/219: rmdir d6/d8/d2f 39 2024-09-10T10:04:10.977 INFO:tasks.workunit.client.1.smithi107.stdout:5/284: write de/f1f [152885,81884] 0 2024-09-10T10:04:10.977 INFO:tasks.workunit.client.0.smithi071.stdout:7/144: write d9/d11/f24 [1027587,56132] 0 2024-09-10T10:04:10.978 INFO:tasks.workunit.client.1.smithi107.stdout:1/344: symlink d2/l68 0 2024-09-10T10:04:10.978 INFO:tasks.workunit.client.1.smithi107.stdout:4/329: dread - d0/d40/d57/d4f/f58 zero size 2024-09-10T10:04:10.978 INFO:tasks.workunit.client.1.smithi107.stdout:9/304: read - d5/d7/d3c/d53/d57/f62 zero size 2024-09-10T10:04:10.978 INFO:tasks.workunit.client.1.smithi107.stdout:5/285: stat de/d41/l59 0 2024-09-10T10:04:10.979 INFO:tasks.workunit.client.0.smithi071.stdout:7/145: symlink d9/d1a/d1d/l2b 0 2024-09-10T10:04:10.979 INFO:tasks.workunit.client.1.smithi107.stdout:3/482: rmdir dc/dd/d42/d55 39 2024-09-10T10:04:10.980 INFO:tasks.workunit.client.1.smithi107.stdout:5/286: chown de/d20/d2b/d4b/l51 98883747 1 2024-09-10T10:04:10.980 INFO:tasks.workunit.client.0.smithi071.stdout:7/146: write d9/f19 [190086,65189] 0 2024-09-10T10:04:10.980 INFO:tasks.workunit.client.1.smithi107.stdout:3/483: write dc/dd/d20/f3e [58623,109673] 0 2024-09-10T10:04:10.982 INFO:tasks.workunit.client.1.smithi107.stdout:3/484: write dc/dd/d20/f60 [111018,70426] 0 2024-09-10T10:04:10.987 INFO:tasks.workunit.client.1.smithi107.stdout:4/330: symlink d0/d6b/l78 0 2024-09-10T10:04:10.987 INFO:tasks.workunit.client.0.smithi071.stdout:7/147: dwrite d9/d11/f14 [0,4194304] 0 2024-09-10T10:04:10.990 INFO:tasks.workunit.client.0.smithi071.stdout:7/148: mkdir d9/d2c 0 2024-09-10T10:04:10.990 INFO:tasks.workunit.client.0.smithi071.stdout:4/135: sync 2024-09-10T10:04:10.991 INFO:tasks.workunit.client.1.smithi107.stdout:9/305: chown d5/d1e/l2b 883181 1 2024-09-10T10:04:10.991 INFO:tasks.workunit.client.0.smithi071.stdout:7/149: readlink d9/d15/l22 0 2024-09-10T10:04:10.992 INFO:tasks.workunit.client.1.smithi107.stdout:1/345: dwrite d2/d6/fc [0,4194304] 0 2024-09-10T10:04:10.992 INFO:tasks.workunit.client.0.smithi071.stdout:4/136: mknod db/d15/d17/c35 0 2024-09-10T10:04:10.994 INFO:tasks.workunit.client.0.smithi071.stdout:4/137: creat db/d1d/f36 x:0 0 0 2024-09-10T10:04:10.995 INFO:tasks.workunit.client.1.smithi107.stdout:8/180: rename d5/d8/dc/d18/l2e to d5/l3d 0 2024-09-10T10:04:10.995 INFO:tasks.workunit.client.1.smithi107.stdout:4/331: mknod d0/d1f/d20/c79 0 2024-09-10T10:04:10.996 INFO:tasks.workunit.client.1.smithi107.stdout:9/306: chown d5/d7/fe 4278512 1 2024-09-10T10:04:10.998 INFO:tasks.workunit.client.1.smithi107.stdout:3/485: mknod dc/dd/d42/d55/d58/d91/ca4 0 2024-09-10T10:04:10.999 INFO:tasks.workunit.client.1.smithi107.stdout:1/346: creat d2/d6/d24/f69 x:0 0 0 2024-09-10T10:04:11.000 INFO:tasks.workunit.client.0.smithi071.stdout:7/150: dwrite d9/fe [0,4194304] 0 2024-09-10T10:04:11.001 INFO:tasks.workunit.client.1.smithi107.stdout:5/287: creat de/f5b x:0 0 0 2024-09-10T10:04:11.001 INFO:tasks.workunit.client.1.smithi107.stdout:0/220: link d6/c11 d6/d8/d2f/d35/c3b 0 2024-09-10T10:04:11.001 INFO:tasks.workunit.client.1.smithi107.stdout:2/295: dwrite d3/da/df/d20/d36/d4f/f50 [0,4194304] 0 2024-09-10T10:04:11.001 INFO:tasks.workunit.client.1.smithi107.stdout:3/486: read f7 [2039123,32973] 0 2024-09-10T10:04:11.004 INFO:tasks.workunit.client.1.smithi107.stdout:8/181: creat d5/d8/dc/d21/f3e x:0 0 0 2024-09-10T10:04:11.005 INFO:tasks.workunit.client.0.smithi071.stdout:7/151: mknod d9/d15/c2d 0 2024-09-10T10:04:11.005 INFO:tasks.workunit.client.0.smithi071.stdout:4/138: dwrite db/d1d/f36 [0,4194304] 0 2024-09-10T10:04:11.008 INFO:tasks.workunit.client.0.smithi071.stdout:7/152: readlink l1 0 2024-09-10T10:04:11.008 INFO:tasks.workunit.client.1.smithi107.stdout:2/296: chown d3/d21/d41/f5d 127516 1 2024-09-10T10:04:11.012 INFO:tasks.workunit.client.1.smithi107.stdout:9/307: rename d5/d7/d1d/c45 to d5/d7/d1d/d41/c73 0 2024-09-10T10:04:11.015 INFO:tasks.workunit.client.1.smithi107.stdout:0/221: mkdir d6/d8/d2f/d35/d3c 0 2024-09-10T10:04:11.015 INFO:tasks.workunit.client.1.smithi107.stdout:1/347: dwrite d2/d35/f47 [0,4194304] 0 2024-09-10T10:04:11.016 INFO:tasks.workunit.client.0.smithi071.stdout:7/153: dwrite d9/d11/f14 [0,4194304] 0 2024-09-10T10:04:11.017 INFO:tasks.workunit.client.1.smithi107.stdout:8/182: mkdir d5/d8/dc/d21/d37/d3f 0 2024-09-10T10:04:11.017 INFO:tasks.workunit.client.1.smithi107.stdout:0/222: chown d6/d8/d2f/d2e 1033072 1 2024-09-10T10:04:11.018 INFO:tasks.workunit.client.1.smithi107.stdout:5/288: dread de/f1e [0,4194304] 0 2024-09-10T10:04:11.022 INFO:tasks.workunit.client.1.smithi107.stdout:9/308: chown d5/d7/d1d/d25/d50/c4c 2379944 1 2024-09-10T10:04:11.023 INFO:tasks.workunit.client.1.smithi107.stdout:4/332: dwrite d0/d40/d75/f44 [0,4194304] 0 2024-09-10T10:04:11.024 INFO:tasks.workunit.client.0.smithi071.stdout:4/139: dread db/d15/d17/d24/f25 [0,4194304] 0 2024-09-10T10:04:11.024 INFO:tasks.workunit.client.1.smithi107.stdout:5/289: mkdir de/d4a/d5c 0 2024-09-10T10:04:11.024 INFO:tasks.workunit.client.1.smithi107.stdout:8/183: rename d5/d8 to d5/d8/dc/d40 22 2024-09-10T10:04:11.025 INFO:tasks.workunit.client.0.smithi071.stdout:7/154: dwrite d9/fe [0,4194304] 0 2024-09-10T10:04:11.025 INFO:tasks.workunit.client.1.smithi107.stdout:0/223: write d6/d14/f2d [3231124,59852] 0 2024-09-10T10:04:11.025 INFO:tasks.workunit.client.1.smithi107.stdout:1/348: chown d2/d35/f5b 136944 1 2024-09-10T10:04:11.026 INFO:tasks.workunit.client.1.smithi107.stdout:1/349: chown d2/d36 42 1 2024-09-10T10:04:11.027 INFO:tasks.workunit.client.1.smithi107.stdout:1/350: fsync d2/d12/f3e 0 2024-09-10T10:04:11.028 INFO:tasks.workunit.client.1.smithi107.stdout:2/297: getdents d3/d21 0 2024-09-10T10:04:11.029 INFO:tasks.workunit.client.0.smithi071.stdout:7/155: creat d9/d15/d1f/f2e x:0 0 0 2024-09-10T10:04:11.031 INFO:tasks.workunit.client.1.smithi107.stdout:8/184: write d5/f2f [2076427,8884] 0 2024-09-10T10:04:11.031 INFO:tasks.workunit.client.1.smithi107.stdout:9/309: read d5/f5c [4302660,122136] 0 2024-09-10T10:04:11.031 INFO:tasks.workunit.client.1.smithi107.stdout:1/351: chown d2/f32 2 1 2024-09-10T10:04:11.031 INFO:tasks.workunit.client.1.smithi107.stdout:0/224: readlink d6/d8/d2f/d2e/d32/l39 0 2024-09-10T10:04:11.032 INFO:tasks.workunit.client.0.smithi071.stdout:7/156: symlink d9/l2f 0 2024-09-10T10:04:11.034 INFO:tasks.workunit.client.1.smithi107.stdout:5/290: creat de/d20/f5d x:0 0 0 2024-09-10T10:04:11.036 INFO:tasks.workunit.client.1.smithi107.stdout:4/333: rename d0/d1f/l24 to d0/d1f/l7a 0 2024-09-10T10:04:11.037 INFO:tasks.workunit.client.0.smithi071.stdout:7/157: creat d9/d1a/f30 x:0 0 0 2024-09-10T10:04:11.038 INFO:tasks.workunit.client.1.smithi107.stdout:5/291: write de/f25 [4873428,9048] 0 2024-09-10T10:04:11.040 INFO:tasks.workunit.client.0.smithi071.stdout:7/158: unlink d9/d1a/f1c 0 2024-09-10T10:04:11.041 INFO:tasks.workunit.client.1.smithi107.stdout:4/334: write d0/d1f/d20/f70 [604809,128993] 0 2024-09-10T10:04:11.042 INFO:tasks.workunit.client.0.smithi071.stdout:7/159: creat d9/d15/d1f/f31 x:0 0 0 2024-09-10T10:04:11.042 INFO:tasks.workunit.client.1.smithi107.stdout:5/292: write de/f48 [4382867,10064] 0 2024-09-10T10:04:11.043 INFO:tasks.workunit.client.0.smithi071.stdout:7/160: fdatasync d9/f28 0 2024-09-10T10:04:11.044 INFO:tasks.workunit.client.1.smithi107.stdout:1/352: dwrite d2/d12/d5a/f5d [0,4194304] 0 2024-09-10T10:04:11.045 INFO:tasks.workunit.client.0.smithi071.stdout:7/161: chown d9/d15/d1f/c21 23549553 1 2024-09-10T10:04:11.046 INFO:tasks.workunit.client.0.smithi071.stdout:7/162: truncate f7 2330881 0 2024-09-10T10:04:11.047 INFO:tasks.workunit.client.1.smithi107.stdout:3/487: write dc/dd/d45/d26/d41/d44/f2d [587317,24232] 0 2024-09-10T10:04:11.047 INFO:tasks.workunit.client.0.smithi071.stdout:7/163: fsync d9/d1a/d1d/f1e 0 2024-09-10T10:04:11.047 INFO:tasks.workunit.client.1.smithi107.stdout:9/310: unlink d5/d7/d3c/f72 0 2024-09-10T10:04:11.048 INFO:tasks.workunit.client.1.smithi107.stdout:8/185: write d5/d8/f20 [334352,79273] 0 2024-09-10T10:04:11.051 INFO:tasks.workunit.client.1.smithi107.stdout:2/298: dwrite d3/da/df/d20/d36/d4f/f50 [0,4194304] 0 2024-09-10T10:04:11.055 INFO:tasks.workunit.client.1.smithi107.stdout:5/293: mkdir de/d20/d2b/d4b/d5e 0 2024-09-10T10:04:11.055 INFO:tasks.workunit.client.1.smithi107.stdout:4/335: symlink d0/d40/d57/d76/l7b 0 2024-09-10T10:04:11.056 INFO:tasks.workunit.client.1.smithi107.stdout:3/488: write dc/dd/d45/d26/d41/f53 [661447,38436] 0 2024-09-10T10:04:11.057 INFO:tasks.workunit.client.1.smithi107.stdout:0/225: truncate d6/d8/d2f/d2e/d32/f37 3858033 0 2024-09-10T10:04:11.059 INFO:tasks.workunit.client.1.smithi107.stdout:2/299: mknod d3/d21/c60 0 2024-09-10T10:04:11.060 INFO:tasks.workunit.client.1.smithi107.stdout:9/311: write d5/d7/d1d/d41/f70 [434538,84831] 0 2024-09-10T10:04:11.061 INFO:tasks.workunit.client.1.smithi107.stdout:8/186: creat d5/d8/dc/d21/f41 x:0 0 0 2024-09-10T10:04:11.061 INFO:tasks.workunit.client.1.smithi107.stdout:5/294: dread de/d20/d2b/f39 [0,4194304] 0 2024-09-10T10:04:11.063 INFO:tasks.workunit.client.1.smithi107.stdout:4/336: unlink d0/d1f/d20/l6f 0 2024-09-10T10:04:11.064 INFO:tasks.workunit.client.1.smithi107.stdout:0/226: mknod d6/d14/c3d 0 2024-09-10T10:04:11.066 INFO:tasks.workunit.client.1.smithi107.stdout:3/489: rename f9 to dc/dd/d20/d23/d39/fa5 0 2024-09-10T10:04:11.067 INFO:tasks.workunit.client.1.smithi107.stdout:1/353: creat d2/f6a x:0 0 0 2024-09-10T10:04:11.068 INFO:tasks.workunit.client.1.smithi107.stdout:2/300: mknod d3/d21/d41/c61 0 2024-09-10T10:04:11.070 INFO:tasks.workunit.client.1.smithi107.stdout:5/295: mknod de/d41/c5f 0 2024-09-10T10:04:11.073 INFO:tasks.workunit.client.1.smithi107.stdout:4/337: rename d0/c54 to d0/d40/d75/d3f/d59/c7c 0 2024-09-10T10:04:11.074 INFO:tasks.workunit.client.1.smithi107.stdout:3/490: dread dc/dd/d20/f3e [0,4194304] 0 2024-09-10T10:04:11.074 INFO:tasks.workunit.client.1.smithi107.stdout:0/227: mkdir d6/d8/d3e 0 2024-09-10T10:04:11.077 INFO:tasks.workunit.client.1.smithi107.stdout:4/338: chown d0/d1f/f60 2318195 1 2024-09-10T10:04:11.079 INFO:tasks.workunit.client.1.smithi107.stdout:1/354: rename d2/d2a to d2/d12/d65/d6b 0 2024-09-10T10:04:11.081 INFO:tasks.workunit.client.1.smithi107.stdout:9/312: dwrite d5/d7/d1d/f3f [4194304,4194304] 0 2024-09-10T10:04:11.082 INFO:tasks.workunit.client.1.smithi107.stdout:2/301: dwrite d3/f31 [0,4194304] 0 2024-09-10T10:04:11.082 INFO:tasks.workunit.client.1.smithi107.stdout:3/491: dread - dc/dd/d45/d26/d41/d44/d35/d52/f9f zero size 2024-09-10T10:04:11.083 INFO:tasks.workunit.client.1.smithi107.stdout:5/296: getdents de/d4a/d5c 0 2024-09-10T10:04:11.087 INFO:tasks.workunit.client.1.smithi107.stdout:1/355: truncate d2/d35/f61 1034978 0 2024-09-10T10:04:11.090 INFO:tasks.workunit.client.1.smithi107.stdout:9/313: symlink d5/d7/d3c/l74 0 2024-09-10T10:04:11.090 INFO:tasks.workunit.client.0.smithi071.stdout:7/164: rmdir d9/d1a 39 2024-09-10T10:04:11.091 INFO:tasks.workunit.client.1.smithi107.stdout:4/339: link d0/l32 d0/d40/d75/d3f/l7d 0 2024-09-10T10:04:11.092 INFO:tasks.workunit.client.1.smithi107.stdout:1/356: fsync d2/d12/d65/d6b/f41 0 2024-09-10T10:04:11.093 INFO:tasks.workunit.client.1.smithi107.stdout:0/228: dwrite d6/f10 [0,4194304] 0 2024-09-10T10:04:11.095 INFO:tasks.workunit.client.0.smithi071.stdout:7/165: getdents d9 0 2024-09-10T10:04:11.096 INFO:tasks.workunit.client.1.smithi107.stdout:4/340: unlink d0/c49 0 2024-09-10T10:04:11.097 INFO:tasks.workunit.client.1.smithi107.stdout:1/357: fsync d2/d6/f2d 0 2024-09-10T10:04:11.097 INFO:tasks.workunit.client.1.smithi107.stdout:5/297: rename de/d20/f29 to de/d20/d2b/f60 0 2024-09-10T10:04:11.100 INFO:tasks.workunit.client.0.smithi071.stdout:7/166: dread d9/fe [0,4194304] 0 2024-09-10T10:04:11.100 INFO:tasks.workunit.client.1.smithi107.stdout:9/314: symlink d5/d7/d1d/d25/d50/l75 0 2024-09-10T10:04:11.102 INFO:tasks.workunit.client.0.smithi071.stdout:7/167: truncate d9/d1a/d1d/f1e 407836 0 2024-09-10T10:04:11.102 INFO:tasks.workunit.client.1.smithi107.stdout:1/358: unlink d2/d6/d24/l64 0 2024-09-10T10:04:11.103 INFO:tasks.workunit.client.1.smithi107.stdout:5/298: mknod de/d41/c61 0 2024-09-10T10:04:11.104 INFO:tasks.workunit.client.0.smithi071.stdout:7/168: rmdir d9/d15/d1f 39 2024-09-10T10:04:11.105 INFO:tasks.workunit.client.1.smithi107.stdout:3/492: dwrite dc/dd/d45/d26/d41/d44/f3c [0,4194304] 0 2024-09-10T10:04:11.107 INFO:tasks.workunit.client.1.smithi107.stdout:8/187: dread d5/d8/f24 [0,4194304] 0 2024-09-10T10:04:11.107 INFO:tasks.workunit.client.1.smithi107.stdout:1/359: chown d2/l37 1971814 1 2024-09-10T10:04:11.108 INFO:tasks.workunit.client.1.smithi107.stdout:3/493: chown dc/dd/d42 18169329 1 2024-09-10T10:04:11.109 INFO:tasks.workunit.client.0.smithi071.stdout:7/169: link d9/d11/c27 d9/d11/c32 0 2024-09-10T10:04:11.109 INFO:tasks.workunit.client.1.smithi107.stdout:1/360: dread - d2/d35/f5f zero size 2024-09-10T10:04:11.110 INFO:tasks.workunit.client.1.smithi107.stdout:4/341: rename d0/d1f/l7a to d0/d40/d75/d53/l7e 0 2024-09-10T10:04:11.110 INFO:tasks.workunit.client.1.smithi107.stdout:3/494: readlink dc/dd/d20/d23/l94 0 2024-09-10T10:04:11.111 INFO:tasks.workunit.client.0.smithi071.stdout:7/170: rmdir d9/d15 39 2024-09-10T10:04:11.112 INFO:tasks.workunit.client.1.smithi107.stdout:3/495: read - dc/dd/d45/f77 zero size 2024-09-10T10:04:11.113 INFO:tasks.workunit.client.1.smithi107.stdout:5/299: symlink de/d4a/d4e/l62 0 2024-09-10T10:04:11.113 INFO:tasks.workunit.client.1.smithi107.stdout:9/315: link d5/d7/d1d/d29/l68 d5/d1e/l76 0 2024-09-10T10:04:11.114 INFO:tasks.workunit.client.1.smithi107.stdout:3/496: stat dc/dd/d45/f4e 0 2024-09-10T10:04:11.115 INFO:tasks.workunit.client.1.smithi107.stdout:4/342: rename d0/d1f/d20/l23 to d0/d40/l7f 0 2024-09-10T10:04:11.115 INFO:tasks.workunit.client.1.smithi107.stdout:5/300: write de/f5b [880902,88507] 0 2024-09-10T10:04:11.116 INFO:tasks.workunit.client.1.smithi107.stdout:8/188: mkdir d5/d42 0 2024-09-10T10:04:11.117 INFO:tasks.workunit.client.0.smithi071.stdout:7/171: rename d9/c25 to d9/d2c/c33 0 2024-09-10T10:04:11.117 INFO:tasks.workunit.client.1.smithi107.stdout:8/189: readlink d5/d8/dc/d21/d37/l33 0 2024-09-10T10:04:11.118 INFO:tasks.workunit.client.1.smithi107.stdout:1/361: symlink d2/d12/d65/d6b/l6c 0 2024-09-10T10:04:11.119 INFO:tasks.workunit.client.1.smithi107.stdout:5/301: creat de/d4a/f63 x:0 0 0 2024-09-10T10:04:11.120 INFO:tasks.workunit.client.0.smithi071.stdout:7/172: creat d9/f34 x:0 0 0 2024-09-10T10:04:11.121 INFO:tasks.workunit.client.0.smithi071.stdout:7/173: chown d9/d11/c13 279092049 1 2024-09-10T10:04:11.122 INFO:tasks.workunit.client.1.smithi107.stdout:1/362: write d2/d35/f61 [535290,114273] 0 2024-09-10T10:04:11.126 INFO:tasks.workunit.client.1.smithi107.stdout:2/302: dread d3/da/df/d20/d36/d4f/f58 [0,4194304] 0 2024-09-10T10:04:11.127 INFO:tasks.workunit.client.1.smithi107.stdout:3/497: dwrite dc/dd/d45/d26/d59/f7a [0,4194304] 0 2024-09-10T10:04:11.128 INFO:tasks.workunit.client.0.smithi071.stdout:7/174: rename d9/d15/d1f/f2e to d9/d1a/f35 0 2024-09-10T10:04:11.130 INFO:tasks.workunit.client.0.smithi071.stdout:6/134: sync 2024-09-10T10:04:11.130 INFO:tasks.workunit.client.0.smithi071.stdout:9/261: sync 2024-09-10T10:04:11.130 INFO:tasks.workunit.client.1.smithi107.stdout:9/316: link d5/d7/d3c/d53/c5a d5/d7/c77 0 2024-09-10T10:04:11.131 INFO:tasks.workunit.client.1.smithi107.stdout:8/190: getdents d5/d8 0 2024-09-10T10:04:11.131 INFO:tasks.workunit.client.0.smithi071.stdout:7/175: mknod d9/d15/c36 0 2024-09-10T10:04:11.132 INFO:tasks.workunit.client.0.smithi071.stdout:6/135: creat d4/f27 x:0 0 0 2024-09-10T10:04:11.132 INFO:tasks.workunit.client.1.smithi107.stdout:1/363: symlink d2/d12/d65/l6d 0 2024-09-10T10:04:11.133 INFO:tasks.workunit.client.0.smithi071.stdout:6/136: truncate d4/d20/f26 564364 0 2024-09-10T10:04:11.133 INFO:tasks.workunit.client.1.smithi107.stdout:0/229: dread d6/d8/f27 [0,4194304] 0 2024-09-10T10:04:11.134 INFO:tasks.workunit.client.0.smithi071.stdout:9/262: creat d0/d3b/d44/f5a x:0 0 0 2024-09-10T10:04:11.134 INFO:tasks.workunit.client.0.smithi071.stdout:7/176: chown d9/d11/c32 0 1 2024-09-10T10:04:11.135 INFO:tasks.workunit.client.1.smithi107.stdout:3/498: symlink dc/dd/d45/d26/d41/d44/d35/d4a/la6 0 2024-09-10T10:04:11.135 INFO:tasks.workunit.client.1.smithi107.stdout:5/302: getdents de/d20/d2b/d4b 0 2024-09-10T10:04:11.136 INFO:tasks.workunit.client.0.smithi071.stdout:6/137: creat d4/f28 x:0 0 0 2024-09-10T10:04:11.136 INFO:tasks.workunit.client.0.smithi071.stdout:7/177: mknod d9/d11/c37 0 2024-09-10T10:04:11.137 INFO:tasks.workunit.client.1.smithi107.stdout:8/191: creat d5/d8/dc/d1a/f43 x:0 0 0 2024-09-10T10:04:11.137 INFO:tasks.workunit.client.1.smithi107.stdout:2/303: mkdir d3/da/df/d62 0 2024-09-10T10:04:11.139 INFO:tasks.workunit.client.1.smithi107.stdout:3/499: write dc/dd/d45/d26/d41/d44/d35/f2a [487009,28652] 0 2024-09-10T10:04:11.139 INFO:tasks.workunit.client.1.smithi107.stdout:8/192: fsync d5/d8/f13 0 2024-09-10T10:04:11.140 INFO:tasks.workunit.client.0.smithi071.stdout:6/138: getdents d4/d20 0 2024-09-10T10:04:11.142 INFO:tasks.workunit.client.1.smithi107.stdout:9/317: dread d5/d7/d1d/d25/d37/f52 [0,4194304] 0 2024-09-10T10:04:11.142 INFO:tasks.workunit.client.1.smithi107.stdout:0/230: truncate d6/d8/d2f/f1b 101713 0 2024-09-10T10:04:11.142 INFO:tasks.workunit.client.1.smithi107.stdout:2/304: fsync d3/da/f17 0 2024-09-10T10:04:11.145 INFO:tasks.workunit.client.0.smithi071.stdout:6/139: getdents d4/da 0 2024-09-10T10:04:11.145 INFO:tasks.workunit.client.1.smithi107.stdout:8/193: write d5/d8/f9 [4236826,127634] 0 2024-09-10T10:04:11.146 INFO:tasks.workunit.client.1.smithi107.stdout:0/231: write d6/f12 [2142977,94423] 0 2024-09-10T10:04:11.146 INFO:tasks.workunit.client.1.smithi107.stdout:1/364: creat d2/d12/d65/d6b/f6e x:0 0 0 2024-09-10T10:04:11.148 INFO:tasks.workunit.client.0.smithi071.stdout:9/263: dread d0/db/d1b/d1d/d4b/f4c [0,4194304] 0 2024-09-10T10:04:11.148 INFO:tasks.workunit.client.1.smithi107.stdout:5/303: dread de/d20/f26 [0,4194304] 0 2024-09-10T10:04:11.149 INFO:tasks.workunit.client.0.smithi071.stdout:9/264: readlink d0/db/d1b/d1d/d3d/l4e 0 2024-09-10T10:04:11.149 INFO:tasks.workunit.client.0.smithi071.stdout:6/140: getdents d4/d1c 0 2024-09-10T10:04:11.150 INFO:tasks.workunit.client.0.smithi071.stdout:6/141: readlink l2 0 2024-09-10T10:04:11.150 INFO:tasks.workunit.client.0.smithi071.stdout:6/142: fdatasync d4/d20/f26 0 2024-09-10T10:04:11.150 INFO:tasks.workunit.client.1.smithi107.stdout:3/500: creat dc/dd/d20/d23/d2f/d9c/fa7 x:0 0 0 2024-09-10T10:04:11.153 INFO:tasks.workunit.client.0.smithi071.stdout:6/143: symlink d4/d20/l29 0 2024-09-10T10:04:11.153 INFO:tasks.workunit.client.1.smithi107.stdout:5/304: symlink de/d41/l64 0 2024-09-10T10:04:11.154 INFO:tasks.workunit.client.0.smithi071.stdout:9/265: getdents d0/d3b/d44 0 2024-09-10T10:04:11.155 INFO:tasks.workunit.client.1.smithi107.stdout:4/343: dwrite d0/d1f/d20/f5d [0,4194304] 0 2024-09-10T10:04:11.156 INFO:tasks.workunit.client.0.smithi071.stdout:7/178: dwrite d9/d11/f12 [0,4194304] 0 2024-09-10T10:04:11.156 INFO:tasks.workunit.client.1.smithi107.stdout:0/232: chown d6/d8/d2f/f1b 12 1 2024-09-10T10:04:11.156 INFO:tasks.workunit.client.0.smithi071.stdout:9/266: unlink d0/db/d20/f55 0 2024-09-10T10:04:11.157 INFO:tasks.workunit.client.1.smithi107.stdout:9/318: getdents d5 0 2024-09-10T10:04:11.157 INFO:tasks.workunit.client.0.smithi071.stdout:9/267: readlink d0/db/d20/l43 0 2024-09-10T10:04:11.160 INFO:tasks.workunit.client.0.smithi071.stdout:7/179: symlink d9/d1a/l38 0 2024-09-10T10:04:11.160 INFO:tasks.workunit.client.1.smithi107.stdout:8/194: creat d5/d8/dc/d18/f44 x:0 0 0 2024-09-10T10:04:11.162 INFO:tasks.workunit.client.0.smithi071.stdout:9/268: rename d0/db/d1b/d1d/d3d to d0/db/d1b/d1d/d5b 0 2024-09-10T10:04:11.162 INFO:tasks.workunit.client.1.smithi107.stdout:0/233: stat d6/d8/f15 0 2024-09-10T10:04:11.163 INFO:tasks.workunit.client.1.smithi107.stdout:9/319: write d5/f35 [1405108,86877] 0 2024-09-10T10:04:11.163 INFO:tasks.workunit.client.0.smithi071.stdout:7/180: write d9/f28 [851085,39671] 0 2024-09-10T10:04:11.164 INFO:tasks.workunit.client.1.smithi107.stdout:2/305: dwrite d3/f3d [0,4194304] 0 2024-09-10T10:04:11.164 INFO:tasks.workunit.client.1.smithi107.stdout:3/501: write dc/dd/d45/d26/d41/d44/d35/f2a [5157811,51823] 0 2024-09-10T10:04:11.164 INFO:tasks.workunit.client.0.smithi071.stdout:9/269: dread - d0/db/d1b/d1d/d5b/d52/f59 zero size 2024-09-10T10:04:11.164 INFO:tasks.workunit.client.0.smithi071.stdout:7/181: readlink d9/d15/l16 0 2024-09-10T10:04:11.166 INFO:tasks.workunit.client.0.smithi071.stdout:9/270: truncate d0/d3b/f3e 351343 0 2024-09-10T10:04:11.167 INFO:tasks.workunit.client.1.smithi107.stdout:0/234: chown d6/d8/f9 16497512 1 2024-09-10T10:04:11.167 INFO:tasks.workunit.client.1.smithi107.stdout:5/305: write de/f1e [1919820,97775] 0 2024-09-10T10:04:11.168 INFO:tasks.workunit.client.0.smithi071.stdout:7/182: dread d9/ff [0,4194304] 0 2024-09-10T10:04:11.169 INFO:tasks.workunit.client.1.smithi107.stdout:2/306: chown d3/f31 25 1 2024-09-10T10:04:11.169 INFO:tasks.workunit.client.1.smithi107.stdout:1/365: dwrite d2/d12/d65/d6b/f6e [0,4194304] 0 2024-09-10T10:04:11.171 INFO:tasks.workunit.client.0.smithi071.stdout:7/183: chown d9/d2c/c33 0 1 2024-09-10T10:04:11.171 INFO:tasks.workunit.client.1.smithi107.stdout:2/307: fdatasync f0 0 2024-09-10T10:04:11.171 INFO:tasks.workunit.client.1.smithi107.stdout:3/502: chown dc/dd/d42/d55/d58/d91/ca4 8854 1 2024-09-10T10:04:11.174 INFO:tasks.workunit.client.1.smithi107.stdout:4/344: dread d0/f14 [0,4194304] 0 2024-09-10T10:04:11.174 INFO:tasks.workunit.client.0.smithi071.stdout:7/184: mkdir d9/d1a/d1d/d39 0 2024-09-10T10:04:11.176 INFO:tasks.workunit.client.1.smithi107.stdout:0/235: creat d6/d8/d2f/d2e/f3f x:0 0 0 2024-09-10T10:04:11.176 INFO:tasks.workunit.client.1.smithi107.stdout:4/345: truncate d0/d40/d75/f44 4262136 0 2024-09-10T10:04:11.178 INFO:tasks.workunit.client.1.smithi107.stdout:2/308: creat d3/d21/d41/f63 x:0 0 0 2024-09-10T10:04:11.178 INFO:tasks.workunit.client.1.smithi107.stdout:1/366: dread d2/d35/f47 [0,4194304] 0 2024-09-10T10:04:11.179 INFO:tasks.workunit.client.1.smithi107.stdout:1/367: chown d2/d12/c51 14 1 2024-09-10T10:04:11.179 INFO:tasks.workunit.client.1.smithi107.stdout:8/195: rmdir d5/d8/dc/d21/d37/d3f 0 2024-09-10T10:04:11.180 INFO:tasks.workunit.client.1.smithi107.stdout:8/196: write d5/f2f [4256445,44967] 0 2024-09-10T10:04:11.181 INFO:tasks.workunit.client.1.smithi107.stdout:9/320: creat d5/d7/f78 x:0 0 0 2024-09-10T10:04:11.183 INFO:tasks.workunit.client.1.smithi107.stdout:3/503: rename dc/dd/d20/d23/d2f/f4c to dc/dd/d20/d23/d39/d69/fa8 0 2024-09-10T10:04:11.184 INFO:tasks.workunit.client.1.smithi107.stdout:0/236: creat d6/d14/f40 x:0 0 0 2024-09-10T10:04:11.187 INFO:tasks.workunit.client.1.smithi107.stdout:3/504: write dc/dd/d20/d23/d39/fa3 [540234,10656] 0 2024-09-10T10:04:11.187 INFO:tasks.workunit.client.1.smithi107.stdout:1/368: dwrite d2/d35/f61 [0,4194304] 0 2024-09-10T10:04:11.187 INFO:tasks.workunit.client.1.smithi107.stdout:8/197: mkdir d5/d8/dc/d21/d45 0 2024-09-10T10:04:11.189 INFO:tasks.workunit.client.1.smithi107.stdout:2/309: getdents d3/da/d1e/d40 0 2024-09-10T10:04:11.189 INFO:tasks.workunit.client.1.smithi107.stdout:8/198: readlink d5/d8/dc/d21/d37/l33 0 2024-09-10T10:04:11.189 INFO:tasks.workunit.client.1.smithi107.stdout:3/505: readlink dc/dd/d42/d55/d58/d91/la2 0 2024-09-10T10:04:11.192 INFO:tasks.workunit.client.1.smithi107.stdout:1/369: creat d2/d12/d5a/f6f x:0 0 0 2024-09-10T10:04:11.192 INFO:tasks.workunit.client.1.smithi107.stdout:3/506: chown dc/dd/d20/d23/d39/d69/c8b 0 1 2024-09-10T10:04:11.193 INFO:tasks.workunit.client.1.smithi107.stdout:0/237: creat d6/d8/d2f/d35/d3c/f41 x:0 0 0 2024-09-10T10:04:11.194 INFO:tasks.workunit.client.1.smithi107.stdout:9/321: rmdir d5/d7/d1d/d3b/d6c 0 2024-09-10T10:04:11.194 INFO:tasks.workunit.client.1.smithi107.stdout:0/238: fsync d6/d8/d2f/f33 0 2024-09-10T10:04:11.195 INFO:tasks.workunit.client.1.smithi107.stdout:8/199: creat d5/d8/dc/d1a/f46 x:0 0 0 2024-09-10T10:04:11.196 INFO:tasks.workunit.client.1.smithi107.stdout:8/200: fdatasync d5/f26 0 2024-09-10T10:04:11.197 INFO:tasks.workunit.client.1.smithi107.stdout:2/310: creat d3/d21/d41/d55/f64 x:0 0 0 2024-09-10T10:04:11.197 INFO:tasks.workunit.client.1.smithi107.stdout:4/346: getdents d0/d6b 0 2024-09-10T10:04:11.198 INFO:tasks.workunit.client.1.smithi107.stdout:4/347: dread - d0/d1f/d20/f51 zero size 2024-09-10T10:04:11.199 INFO:tasks.workunit.client.1.smithi107.stdout:1/370: creat d2/d12/d5a/f70 x:0 0 0 2024-09-10T10:04:11.199 INFO:tasks.workunit.client.1.smithi107.stdout:4/348: write d0/d1f/d20/f70 [676458,102253] 0 2024-09-10T10:04:11.199 INFO:tasks.workunit.client.1.smithi107.stdout:1/371: stat d2/d12 0 2024-09-10T10:04:11.201 INFO:tasks.workunit.client.1.smithi107.stdout:4/349: write d0/d1f/d20/f5d [4675442,61812] 0 2024-09-10T10:04:11.201 INFO:tasks.workunit.client.1.smithi107.stdout:1/372: write d2/d12/f31 [4960841,10097] 0 2024-09-10T10:04:11.201 INFO:tasks.workunit.client.1.smithi107.stdout:5/306: dread de/f1f [0,4194304] 0 2024-09-10T10:04:11.202 INFO:tasks.workunit.client.1.smithi107.stdout:4/350: stat d0/fb 0 2024-09-10T10:04:11.204 INFO:tasks.workunit.client.1.smithi107.stdout:1/373: write d2/d6/d24/f56 [3215743,34951] 0 2024-09-10T10:04:11.205 INFO:tasks.workunit.client.1.smithi107.stdout:9/322: unlink d5/d7/d1d/d29/l68 0 2024-09-10T10:04:11.206 INFO:tasks.workunit.client.1.smithi107.stdout:0/239: mknod d6/d8/d3e/c42 0 2024-09-10T10:04:11.206 INFO:tasks.workunit.client.1.smithi107.stdout:3/507: fsync dc/dd/d20/d23/d39/fa3 0 2024-09-10T10:04:11.206 INFO:tasks.workunit.client.1.smithi107.stdout:9/323: truncate d5/d7/d1d/f47 5060 0 2024-09-10T10:04:11.207 INFO:tasks.workunit.client.1.smithi107.stdout:8/201: truncate d5/d8/f13 210944 0 2024-09-10T10:04:11.210 INFO:tasks.workunit.client.0.smithi071.stdout:9/271: dwrite d0/db/d1b/d1d/d4b/f4c [0,4194304] 0 2024-09-10T10:04:11.210 INFO:tasks.workunit.client.0.smithi071.stdout:9/272: fsync d0/db/f22 0 2024-09-10T10:04:11.212 INFO:tasks.workunit.client.0.smithi071.stdout:9/273: mkdir d0/d3b/d5c 0 2024-09-10T10:04:11.214 INFO:tasks.workunit.client.0.smithi071.stdout:9/274: stat d0/db/d1b/d1d/d4b/c56 0 2024-09-10T10:04:11.216 INFO:tasks.workunit.client.0.smithi071.stdout:9/275: getdents d0/db/d20/d3c 0 2024-09-10T10:04:11.219 INFO:tasks.workunit.client.0.smithi071.stdout:9/276: dread d0/fa [0,4194304] 0 2024-09-10T10:04:11.220 INFO:tasks.workunit.client.0.smithi071.stdout:9/277: stat d0/cd 0 2024-09-10T10:04:11.221 INFO:tasks.workunit.client.1.smithi107.stdout:6/261: sync 2024-09-10T10:04:11.221 INFO:tasks.workunit.client.1.smithi107.stdout:7/240: sync 2024-09-10T10:04:11.222 INFO:tasks.workunit.client.1.smithi107.stdout:4/351: mkdir d0/d1f/d20/d80 0 2024-09-10T10:04:11.223 INFO:tasks.workunit.client.0.smithi071.stdout:9/278: creat d0/db/d1b/d1d/d5b/d52/f5d x:0 0 0 2024-09-10T10:04:11.225 INFO:tasks.workunit.client.0.smithi071.stdout:9/279: mknod d0/d3b/d44/c5e 0 2024-09-10T10:04:11.227 INFO:tasks.workunit.client.1.smithi107.stdout:0/240: mkdir d6/d8/d3e/d43 0 2024-09-10T10:04:11.227 INFO:tasks.workunit.client.1.smithi107.stdout:4/352: write d0/d1f/f60 [1227865,95603] 0 2024-09-10T10:04:11.227 INFO:tasks.workunit.client.1.smithi107.stdout:8/202: chown d5/c2b 71553960 1 2024-09-10T10:04:11.227 INFO:tasks.workunit.client.1.smithi107.stdout:7/241: write d0/d8/f38 [1464334,76201] 0 2024-09-10T10:04:11.229 INFO:tasks.workunit.client.0.smithi071.stdout:9/280: link d0/db/f29 d0/d3b/d44/f5f 0 2024-09-10T10:04:11.229 INFO:tasks.workunit.client.0.smithi071.stdout:9/281: chown d0/d3b/d44/f5a 9 1 2024-09-10T10:04:11.231 INFO:tasks.workunit.client.1.smithi107.stdout:9/324: creat d5/d7/d1d/d25/f79 x:0 0 0 2024-09-10T10:04:11.232 INFO:tasks.workunit.client.1.smithi107.stdout:7/242: dread - d0/d8/f32 zero size 2024-09-10T10:04:11.234 INFO:tasks.workunit.client.1.smithi107.stdout:8/203: chown d5/f2f 30 1 2024-09-10T10:04:11.234 INFO:tasks.workunit.client.0.smithi071.stdout:9/282: dwrite d0/d3b/f48 [0,4194304] 0 2024-09-10T10:04:11.235 INFO:tasks.workunit.client.1.smithi107.stdout:1/374: truncate d2/d12/f1e 37458 0 2024-09-10T10:04:11.236 INFO:tasks.workunit.client.1.smithi107.stdout:2/311: dread d3/d21/f32 [0,4194304] 0 2024-09-10T10:04:11.236 INFO:tasks.workunit.client.1.smithi107.stdout:3/508: dwrite dc/dd/d20/d23/d39/d69/f70 [0,4194304] 0 2024-09-10T10:04:11.238 INFO:tasks.workunit.client.1.smithi107.stdout:8/204: readlink d5/d8/dc/d1a/l31 0 2024-09-10T10:04:11.240 INFO:tasks.workunit.client.1.smithi107.stdout:4/353: stat d0/d40/d75/f46 0 2024-09-10T10:04:11.242 INFO:tasks.workunit.client.1.smithi107.stdout:1/375: fdatasync d2/d12/d65/d6b/f6e 0 2024-09-10T10:04:11.246 INFO:tasks.workunit.client.1.smithi107.stdout:9/325: creat d5/d7/d3c/d53/d57/f7a x:0 0 0 2024-09-10T10:04:11.247 INFO:tasks.workunit.client.0.smithi071.stdout:9/283: dread d0/db/f18 [0,4194304] 0 2024-09-10T10:04:11.248 INFO:tasks.workunit.client.0.smithi071.stdout:9/284: stat d0/db/d1b/d46/l53 0 2024-09-10T10:04:11.250 INFO:tasks.workunit.client.1.smithi107.stdout:3/509: fdatasync dc/dd/d45/d26/d41/d44/d35/f9b 0 2024-09-10T10:04:11.250 INFO:tasks.workunit.client.1.smithi107.stdout:6/262: truncate d0/d3d/d14/d17/f1c 187156 0 2024-09-10T10:04:11.251 INFO:tasks.workunit.client.0.smithi071.stdout:9/285: write d0/db/d1b/d1d/d30/d54/f1a [9275758,10572] 0 2024-09-10T10:04:11.252 INFO:tasks.workunit.client.1.smithi107.stdout:2/312: dwrite d3/f31 [0,4194304] 0 2024-09-10T10:04:11.254 INFO:tasks.workunit.client.0.smithi071.stdout:9/286: mkdir d0/db/d1b/d1d/d5b/d60 0 2024-09-10T10:04:11.255 INFO:tasks.workunit.client.1.smithi107.stdout:9/326: symlink d5/d7/d1d/d25/d50/l7b 0 2024-09-10T10:04:11.255 INFO:tasks.workunit.client.1.smithi107.stdout:7/243: rename d0/d8/dc/d2c/l42 to d0/d8/l49 0 2024-09-10T10:04:11.256 INFO:tasks.workunit.client.1.smithi107.stdout:3/510: write dc/dd/d45/d26/d41/f53 [872250,121729] 0 2024-09-10T10:04:11.261 INFO:tasks.workunit.client.0.smithi071.stdout:9/287: dwrite d0/db/d1b/d1d/f35 [4194304,4194304] 0 2024-09-10T10:04:11.263 INFO:tasks.workunit.client.1.smithi107.stdout:8/205: rename d5/d8/dc/d21/d45 to d5/d8/d2a/d47 0 2024-09-10T10:04:11.266 INFO:tasks.workunit.client.1.smithi107.stdout:0/241: dwrite d6/d8/d2f/d2e/d32/f37 [4194304,4194304] 0 2024-09-10T10:04:11.266 INFO:tasks.workunit.client.1.smithi107.stdout:9/327: creat d5/d7/d3c/d53/f7c x:0 0 0 2024-09-10T10:04:11.267 INFO:tasks.workunit.client.1.smithi107.stdout:7/244: write d0/d8/dc/f26 [1027767,104539] 0 2024-09-10T10:04:11.267 INFO:tasks.workunit.client.1.smithi107.stdout:2/313: symlink d3/da/d1e/d27/d5b/l65 0 2024-09-10T10:04:11.271 INFO:tasks.workunit.client.1.smithi107.stdout:0/242: chown d6/d8/f28 600702536 1 2024-09-10T10:04:11.273 INFO:tasks.workunit.client.0.smithi071.stdout:9/288: write d0/db/f39 [451980,64995] 0 2024-09-10T10:04:11.275 INFO:tasks.workunit.client.1.smithi107.stdout:6/263: dwrite d0/d3d/d14/d21/f25 [0,4194304] 0 2024-09-10T10:04:11.276 INFO:tasks.workunit.client.0.smithi071.stdout:9/289: rename d0/db/d1b/d1d/d30 to d0/db/d1b/d1d/d30/d54/d27/d61 22 2024-09-10T10:04:11.276 INFO:tasks.workunit.client.1.smithi107.stdout:9/328: chown d5/d7/d1d/f4d 2616 1 2024-09-10T10:04:11.276 INFO:tasks.workunit.client.1.smithi107.stdout:7/245: creat d0/d1b/f4a x:0 0 0 2024-09-10T10:04:11.278 INFO:tasks.workunit.client.1.smithi107.stdout:9/329: dread - d5/d7/d3c/d53/f7c zero size 2024-09-10T10:04:11.278 INFO:tasks.workunit.client.1.smithi107.stdout:6/264: chown d0/d3d/d14/f58 232455 1 2024-09-10T10:04:11.279 INFO:tasks.workunit.client.0.smithi071.stdout:9/290: fsync d0/db/d1b/d1d/d30/d54/d27/f47 0 2024-09-10T10:04:11.281 INFO:tasks.workunit.client.1.smithi107.stdout:8/206: rename d5/d8/dc/d21/d37 to d5/d8/dc/d21/d48 0 2024-09-10T10:04:11.281 INFO:tasks.workunit.client.0.smithi071.stdout:9/291: write d0/db/d1b/d46/f50 [212564,18906] 0 2024-09-10T10:04:11.282 INFO:tasks.workunit.client.1.smithi107.stdout:0/243: mknod d6/d8/d3e/c44 0 2024-09-10T10:04:11.285 INFO:tasks.workunit.client.1.smithi107.stdout:2/314: rename d3/d21/d41/d51 to d3/da/d66 0 2024-09-10T10:04:11.286 INFO:tasks.workunit.client.0.smithi071.stdout:9/292: getdents d0/db/d1b/d1d/d30/d54 0 2024-09-10T10:04:11.287 INFO:tasks.workunit.client.1.smithi107.stdout:1/376: dread d2/d6/d24/f54 [0,4194304] 0 2024-09-10T10:04:11.292 INFO:tasks.workunit.client.1.smithi107.stdout:0/244: unlink d6/d8/d3e/c44 0 2024-09-10T10:04:11.294 INFO:tasks.workunit.client.1.smithi107.stdout:7/246: dwrite d0/f40 [0,4194304] 0 2024-09-10T10:04:11.295 INFO:tasks.workunit.client.0.smithi071.stdout:9/293: symlink d0/db/d1b/d1d/d5b/d60/l62 0 2024-09-10T10:04:11.295 INFO:tasks.workunit.client.1.smithi107.stdout:1/377: mkdir d2/d12/d71 0 2024-09-10T10:04:11.296 INFO:tasks.workunit.client.1.smithi107.stdout:4/354: dread d0/f1d [0,4194304] 0 2024-09-10T10:04:11.299 INFO:tasks.workunit.client.1.smithi107.stdout:2/315: read d3/da/df/d20/d36/d4f/f58 [586613,13074] 0 2024-09-10T10:04:11.299 INFO:tasks.workunit.client.1.smithi107.stdout:3/511: dwrite f7 [4194304,4194304] 0 2024-09-10T10:04:11.302 INFO:tasks.workunit.client.1.smithi107.stdout:6/265: dwrite d0/d3d/d14/d21/f28 [0,4194304] 0 2024-09-10T10:04:11.306 INFO:tasks.workunit.client.1.smithi107.stdout:9/330: truncate d5/d7/f9 667251 0 2024-09-10T10:04:11.309 INFO:tasks.workunit.client.1.smithi107.stdout:3/512: write dc/dd/d45/d26/d41/d44/d35/f19 [7129798,27225] 0 2024-09-10T10:04:11.310 INFO:tasks.workunit.client.1.smithi107.stdout:1/378: creat d2/d12/d65/f72 x:0 0 0 2024-09-10T10:04:11.310 INFO:tasks.workunit.client.0.smithi071.stdout:3/143: sync 2024-09-10T10:04:11.310 INFO:tasks.workunit.client.0.smithi071.stdout:2/106: sync 2024-09-10T10:04:11.310 INFO:tasks.workunit.client.0.smithi071.stdout:4/140: sync 2024-09-10T10:04:11.311 INFO:tasks.workunit.client.0.smithi071.stdout:0/118: sync 2024-09-10T10:04:11.311 INFO:tasks.workunit.client.0.smithi071.stdout:8/151: sync 2024-09-10T10:04:11.311 INFO:tasks.workunit.client.0.smithi071.stdout:5/177: sync 2024-09-10T10:04:11.311 INFO:tasks.workunit.client.0.smithi071.stdout:0/119: fdatasync f0 0 2024-09-10T10:04:11.311 INFO:tasks.workunit.client.0.smithi071.stdout:2/107: stat d8/d13 0 2024-09-10T10:04:11.313 INFO:tasks.workunit.client.0.smithi071.stdout:1/152: sync 2024-09-10T10:04:11.313 INFO:tasks.workunit.client.1.smithi107.stdout:0/245: dwrite d6/f10 [4194304,4194304] 0 2024-09-10T10:04:11.313 INFO:tasks.workunit.client.1.smithi107.stdout:4/355: mknod d0/d40/d6d/c81 0 2024-09-10T10:04:11.315 INFO:tasks.workunit.client.0.smithi071.stdout:2/108: truncate d8/d13/f15 5189955 0 2024-09-10T10:04:11.315 INFO:tasks.workunit.client.1.smithi107.stdout:7/247: link d0/d8/l15 d0/d8/dc/l4b 0 2024-09-10T10:04:11.317 INFO:tasks.workunit.client.0.smithi071.stdout:1/153: truncate d1/f1f 5002253 0 2024-09-10T10:04:11.317 INFO:tasks.workunit.client.1.smithi107.stdout:0/246: write d6/d8/d2f/d35/d3c/f41 [144944,9552] 0 2024-09-10T10:04:11.317 INFO:tasks.workunit.client.1.smithi107.stdout:7/248: chown d0/d1b/f28 507 1 2024-09-10T10:04:11.318 INFO:tasks.workunit.client.1.smithi107.stdout:2/316: rename d3/d21/d41/l4d to d3/da/df/d20/d36/l67 0 2024-09-10T10:04:11.321 INFO:tasks.workunit.client.0.smithi071.stdout:4/141: dwrite f9 [0,4194304] 0 2024-09-10T10:04:11.322 INFO:tasks.workunit.client.1.smithi107.stdout:9/331: rename d5/d7/d1d/d25/d50/c4c to d5/d7/d3c/d53/c7d 0 2024-09-10T10:04:11.323 INFO:tasks.workunit.client.1.smithi107.stdout:0/247: dread d6/d8/f28 [0,4194304] 0 2024-09-10T10:04:11.325 INFO:tasks.workunit.client.0.smithi071.stdout:5/178: dwrite dc/df/f19 [0,4194304] 0 2024-09-10T10:04:11.326 INFO:tasks.workunit.client.1.smithi107.stdout:2/317: mknod d3/da/df/d20/d36/d4f/c68 0 2024-09-10T10:04:11.329 INFO:tasks.workunit.client.1.smithi107.stdout:4/356: dwrite d0/d1f/f34 [0,4194304] 0 2024-09-10T10:04:11.329 INFO:tasks.workunit.client.0.smithi071.stdout:1/154: dread d1/d21/f28 [0,4194304] 0 2024-09-10T10:04:11.330 INFO:tasks.workunit.client.1.smithi107.stdout:7/249: dread d0/d20/f44 [0,4194304] 0 2024-09-10T10:04:11.331 INFO:tasks.workunit.client.1.smithi107.stdout:1/379: rename d2/d36/f55 to d2/d12/d5a/f73 0 2024-09-10T10:04:11.331 INFO:tasks.workunit.client.1.smithi107.stdout:9/332: mknod d5/d7/d1d/d41/c7e 0 2024-09-10T10:04:11.335 INFO:tasks.workunit.client.0.smithi071.stdout:5/179: dwrite dc/df/d29/f3f [0,4194304] 0 2024-09-10T10:04:11.336 INFO:tasks.workunit.client.0.smithi071.stdout:5/180: dread - dc/df/f33 zero size 2024-09-10T10:04:11.337 INFO:tasks.workunit.client.1.smithi107.stdout:7/250: write d0/d8/d9/ff [1272629,37536] 0 2024-09-10T10:04:11.340 INFO:tasks.workunit.client.1.smithi107.stdout:4/357: mkdir d0/d82 0 2024-09-10T10:04:11.341 INFO:tasks.workunit.client.1.smithi107.stdout:0/248: creat d6/f45 x:0 0 0 2024-09-10T10:04:11.343 INFO:tasks.workunit.client.1.smithi107.stdout:9/333: mknod d5/d7/d1d/d29/c7f 0 2024-09-10T10:04:11.343 INFO:tasks.workunit.client.1.smithi107.stdout:6/266: dwrite d0/fd [0,4194304] 0 2024-09-10T10:04:11.346 INFO:tasks.workunit.client.1.smithi107.stdout:0/249: write d6/d8/f9 [3218241,33691] 0 2024-09-10T10:04:11.347 INFO:tasks.workunit.client.1.smithi107.stdout:6/267: write d0/d3d/f41 [431475,82135] 0 2024-09-10T10:04:11.347 INFO:tasks.workunit.client.1.smithi107.stdout:7/251: rename d0/d20/f37 to d0/d8/d9/f4c 0 2024-09-10T10:04:11.348 INFO:tasks.workunit.client.1.smithi107.stdout:7/252: chown d0/d1b/l46 2608 1 2024-09-10T10:04:11.349 INFO:tasks.workunit.client.1.smithi107.stdout:7/253: fdatasync d0/f40 0 2024-09-10T10:04:11.350 INFO:tasks.workunit.client.0.smithi071.stdout:9/294: creat d0/d3b/d44/f63 x:0 0 0 2024-09-10T10:04:11.353 INFO:tasks.workunit.client.1.smithi107.stdout:1/380: creat d2/d12/d65/d6b/f74 x:0 0 0 2024-09-10T10:04:11.353 INFO:tasks.workunit.client.1.smithi107.stdout:7/254: unlink d0/d20/l45 0 2024-09-10T10:04:11.354 INFO:tasks.workunit.client.1.smithi107.stdout:9/334: write d5/d7/d1d/d25/d50/f28 [670582,126058] 0 2024-09-10T10:04:11.355 INFO:tasks.workunit.client.1.smithi107.stdout:4/358: getdents d0/d82 0 2024-09-10T10:04:11.356 INFO:tasks.workunit.client.1.smithi107.stdout:1/381: chown d2/d12/f31 40291 1 2024-09-10T10:04:11.357 INFO:tasks.workunit.client.0.smithi071.stdout:1/155: rename d1/f16 to d1/d21/d2f/d30/f31 0 2024-09-10T10:04:11.357 INFO:tasks.workunit.client.1.smithi107.stdout:7/255: chown d0/f2b 1570493331 1 2024-09-10T10:04:11.358 INFO:tasks.workunit.client.0.smithi071.stdout:9/295: rmdir d0/db/d1b/d1d/d30/d54/d27 39 2024-09-10T10:04:11.358 INFO:tasks.workunit.client.1.smithi107.stdout:0/250: mknod d6/c46 0 2024-09-10T10:04:11.358 INFO:tasks.workunit.client.1.smithi107.stdout:4/359: dread - d0/d40/d57/d4f/f61 zero size 2024-09-10T10:04:11.359 INFO:tasks.workunit.client.1.smithi107.stdout:9/335: fsync d5/d7/d1d/f47 0 2024-09-10T10:04:11.359 INFO:tasks.workunit.client.1.smithi107.stdout:6/268: link d0/d3d/d14/d21/l27 d0/d3d/d14/d21/l59 0 2024-09-10T10:04:11.359 INFO:tasks.workunit.client.0.smithi071.stdout:3/144: creat d3/d1c/f31 x:0 0 0 2024-09-10T10:04:11.359 INFO:tasks.workunit.client.0.smithi071.stdout:8/152: getdents d5/d30 0 2024-09-10T10:04:11.360 INFO:tasks.workunit.client.1.smithi107.stdout:3/513: dread dc/dd/f1d [0,4194304] 0 2024-09-10T10:04:11.360 INFO:tasks.workunit.client.1.smithi107.stdout:1/382: write d2/d12/d5a/f5d [4968974,56885] 0 2024-09-10T10:04:11.360 INFO:tasks.workunit.client.0.smithi071.stdout:8/153: truncate d5/d30/f3c 204279 0 2024-09-10T10:04:11.362 INFO:tasks.workunit.client.1.smithi107.stdout:4/360: stat d0/d40/d75 0 2024-09-10T10:04:11.363 INFO:tasks.workunit.client.0.smithi071.stdout:1/156: rmdir d1/d1e 39 2024-09-10T10:04:11.363 INFO:tasks.workunit.client.1.smithi107.stdout:7/256: mkdir d0/d1b/d4d 0 2024-09-10T10:04:11.365 INFO:tasks.workunit.client.1.smithi107.stdout:1/383: creat d2/d12/d71/f75 x:0 0 0 2024-09-10T10:04:11.365 INFO:tasks.workunit.client.0.smithi071.stdout:9/296: creat d0/db/d20/d3c/f64 x:0 0 0 2024-09-10T10:04:11.365 INFO:tasks.workunit.client.1.smithi107.stdout:6/269: chown d0/d3d/d14/d17/l1e 2763719 1 2024-09-10T10:04:11.366 INFO:tasks.workunit.client.0.smithi071.stdout:9/297: write d0/db/d20/d3c/f49 [313544,90714] 0 2024-09-10T10:04:11.367 INFO:tasks.workunit.client.1.smithi107.stdout:7/257: write d0/d20/f44 [731435,24266] 0 2024-09-10T10:04:11.367 INFO:tasks.workunit.client.0.smithi071.stdout:1/157: dread d1/f9 [0,4194304] 0 2024-09-10T10:04:11.368 INFO:tasks.workunit.client.0.smithi071.stdout:5/181: getdents dc/df/d17/d22 0 2024-09-10T10:04:11.370 INFO:tasks.workunit.client.0.smithi071.stdout:9/298: creat d0/db/d1b/d1d/d30/f65 x:0 0 0 2024-09-10T10:04:11.371 INFO:tasks.workunit.client.0.smithi071.stdout:5/182: readlink dc/l37 0 2024-09-10T10:04:11.371 INFO:tasks.workunit.client.1.smithi107.stdout:1/384: symlink d2/d6/d24/l76 0 2024-09-10T10:04:11.372 INFO:tasks.workunit.client.1.smithi107.stdout:6/270: write d0/d3d/d14/d21/f43 [2094301,37326] 0 2024-09-10T10:04:11.372 INFO:tasks.workunit.client.1.smithi107.stdout:0/251: dwrite d6/d8/f15 [0,4194304] 0 2024-09-10T10:04:11.373 INFO:tasks.workunit.client.1.smithi107.stdout:0/252: stat d6/d8/f28 0 2024-09-10T10:04:11.374 INFO:tasks.workunit.client.0.smithi071.stdout:1/158: link d1/f2c d1/f32 0 2024-09-10T10:04:11.374 INFO:tasks.workunit.client.1.smithi107.stdout:2/318: dread d3/d21/f3a [0,4194304] 0 2024-09-10T10:04:11.376 INFO:tasks.workunit.client.1.smithi107.stdout:6/271: chown d0/d3d/d14/d17/c20 21 1 2024-09-10T10:04:11.376 INFO:tasks.workunit.client.0.smithi071.stdout:1/159: creat d1/d21/d2f/d30/f33 x:0 0 0 2024-09-10T10:04:11.376 INFO:tasks.workunit.client.1.smithi107.stdout:6/272: readlink d0/l39 0 2024-09-10T10:04:11.377 INFO:tasks.workunit.client.1.smithi107.stdout:2/319: chown d3/da/d1e/d27/d5b/l65 44 1 2024-09-10T10:04:11.378 INFO:tasks.workunit.client.1.smithi107.stdout:0/253: symlink d6/d8/d2f/d2e/l47 0 2024-09-10T10:04:11.378 INFO:tasks.workunit.client.1.smithi107.stdout:4/361: dread d0/d1f/d20/f50 [0,4194304] 0 2024-09-10T10:04:11.379 INFO:tasks.workunit.client.0.smithi071.stdout:9/299: link d0/f9 d0/db/d1b/d1d/d30/d54/d27/f66 0 2024-09-10T10:04:11.380 INFO:tasks.workunit.client.1.smithi107.stdout:6/273: write d0/f8 [5549618,4337] 0 2024-09-10T10:04:11.381 INFO:tasks.workunit.client.1.smithi107.stdout:2/320: write d3/da/df/f15 [2528090,107385] 0 2024-09-10T10:04:11.383 INFO:tasks.workunit.client.0.smithi071.stdout:9/300: creat d0/db/d1b/d1d/d5b/d52/f67 x:0 0 0 2024-09-10T10:04:11.383 INFO:tasks.workunit.client.1.smithi107.stdout:4/362: symlink d0/d82/l83 0 2024-09-10T10:04:11.386 INFO:tasks.workunit.client.0.smithi071.stdout:9/301: creat d0/d3b/f68 x:0 0 0 2024-09-10T10:04:11.387 INFO:tasks.workunit.client.0.smithi071.stdout:1/160: dwrite d1/f32 [0,4194304] 0 2024-09-10T10:04:11.389 INFO:tasks.workunit.client.0.smithi071.stdout:1/161: write d1/d21/d2f/d30/f33 [320519,97588] 0 2024-09-10T10:04:11.389 INFO:tasks.workunit.client.0.smithi071.stdout:9/302: mknod d0/db/d1b/d1d/d5b/c69 0 2024-09-10T10:04:11.394 INFO:tasks.workunit.client.0.smithi071.stdout:9/303: unlink d0/db/d20/d3c/f49 0 2024-09-10T10:04:11.396 INFO:tasks.workunit.client.1.smithi107.stdout:3/514: truncate dc/dd/d45/d26/d59/d5f/f8e 99407 0 2024-09-10T10:04:11.398 INFO:tasks.workunit.client.1.smithi107.stdout:3/515: fsync dc/dd/d20/d23/d39/d69/fa8 0 2024-09-10T10:04:11.399 INFO:tasks.workunit.client.1.smithi107.stdout:1/385: write d2/d12/f1e [862720,78797] 0 2024-09-10T10:04:11.400 INFO:tasks.workunit.client.1.smithi107.stdout:6/274: write d0/d3d/d14/f35 [521078,15400] 0 2024-09-10T10:04:11.404 INFO:tasks.workunit.client.1.smithi107.stdout:1/386: unlink d2/d6/l44 0 2024-09-10T10:04:11.406 INFO:tasks.workunit.client.1.smithi107.stdout:3/516: creat dc/dd/d45/d26/d41/d44/d35/d4a/fa9 x:0 0 0 2024-09-10T10:04:11.411 INFO:tasks.workunit.client.1.smithi107.stdout:9/336: dwrite d5/d7/f9 [0,4194304] 0 2024-09-10T10:04:11.413 INFO:tasks.workunit.client.1.smithi107.stdout:1/387: creat d2/d6/d67/f77 x:0 0 0 2024-09-10T10:04:11.416 INFO:tasks.workunit.client.1.smithi107.stdout:4/363: dread d0/d1f/d20/f17 [0,4194304] 0 2024-09-10T10:04:11.417 INFO:tasks.workunit.client.1.smithi107.stdout:6/275: dwrite d0/d3d/d14/d42/f4e [0,4194304] 0 2024-09-10T10:04:11.418 INFO:tasks.workunit.client.0.smithi071.stdout:3/145: rmdir d3 39 2024-09-10T10:04:11.419 INFO:tasks.workunit.client.0.smithi071.stdout:0/120: truncate f2 10452996 0 2024-09-10T10:04:11.420 INFO:tasks.workunit.client.1.smithi107.stdout:4/364: fdatasync d0/f1d 0 2024-09-10T10:04:11.421 INFO:tasks.workunit.client.0.smithi071.stdout:3/146: chown d3/c4 3593 1 2024-09-10T10:04:11.422 INFO:tasks.workunit.client.1.smithi107.stdout:9/337: creat d5/d7/d1d/d25/d37/f80 x:0 0 0 2024-09-10T10:04:11.425 INFO:tasks.workunit.client.1.smithi107.stdout:3/517: rename dc/dd/d20/d23/c33 to dc/dd/d45/d26/d41/d44/d35/d52/caa 0 2024-09-10T10:04:11.426 INFO:tasks.workunit.client.0.smithi071.stdout:0/121: truncate d11/d22/f25 247634 0 2024-09-10T10:04:11.427 INFO:tasks.workunit.client.1.smithi107.stdout:4/365: creat d0/d40/d6d/f84 x:0 0 0 2024-09-10T10:04:11.428 INFO:tasks.workunit.client.1.smithi107.stdout:1/388: write d2/d35/f5b [184425,85244] 0 2024-09-10T10:04:11.432 INFO:tasks.workunit.client.0.smithi071.stdout:1/162: write d1/f19 [4684430,34039] 0 2024-09-10T10:04:11.434 INFO:tasks.workunit.client.1.smithi107.stdout:1/389: write d2/d12/f3e [333441,79601] 0 2024-09-10T10:04:11.435 INFO:tasks.workunit.client.0.smithi071.stdout:2/109: dwrite f2 [0,4194304] 0 2024-09-10T10:04:11.435 INFO:tasks.workunit.client.0.smithi071.stdout:9/304: write d0/d3b/d44/f5f [379345,45169] 0 2024-09-10T10:04:11.435 INFO:tasks.workunit.client.0.smithi071.stdout:3/147: dwrite d3/f1b [0,4194304] 0 2024-09-10T10:04:11.436 INFO:tasks.workunit.client.0.smithi071.stdout:4/142: dwrite f3 [0,4194304] 0 2024-09-10T10:04:11.438 INFO:tasks.workunit.client.0.smithi071.stdout:3/148: fdatasync d3/d10/d24/f27 0 2024-09-10T10:04:11.438 INFO:tasks.workunit.client.1.smithi107.stdout:4/366: truncate d0/f1d 2575017 0 2024-09-10T10:04:11.439 INFO:tasks.workunit.client.0.smithi071.stdout:1/163: mkdir d1/d21/d34 0 2024-09-10T10:04:11.440 INFO:tasks.workunit.client.0.smithi071.stdout:3/149: write d3/d20/f2c [396226,28547] 0 2024-09-10T10:04:11.441 INFO:tasks.workunit.client.1.smithi107.stdout:6/276: dread d0/d3d/d14/d21/f28 [0,4194304] 0 2024-09-10T10:04:11.442 INFO:tasks.workunit.client.0.smithi071.stdout:3/150: fdatasync d3/f18 0 2024-09-10T10:04:11.444 INFO:tasks.workunit.client.1.smithi107.stdout:9/338: dwrite d5/d7/d1d/d25/d27/f51 [0,4194304] 0 2024-09-10T10:04:11.446 INFO:tasks.workunit.client.0.smithi071.stdout:2/110: dwrite f2 [0,4194304] 0 2024-09-10T10:04:11.446 INFO:tasks.workunit.client.0.smithi071.stdout:4/143: creat db/d15/d17/f37 x:0 0 0 2024-09-10T10:04:11.446 INFO:tasks.workunit.client.0.smithi071.stdout:9/305: mkdir d0/d3b/d5c/d6a 0 2024-09-10T10:04:11.446 INFO:tasks.workunit.client.1.smithi107.stdout:6/277: chown d0/d3d/d14/d17/d24 804071 1 2024-09-10T10:04:11.447 INFO:tasks.workunit.client.0.smithi071.stdout:4/144: stat la 0 2024-09-10T10:04:11.447 INFO:tasks.workunit.client.0.smithi071.stdout:4/145: write db/f2a [399380,5162] 0 2024-09-10T10:04:11.448 INFO:tasks.workunit.client.1.smithi107.stdout:3/518: dwrite dc/dd/d45/d26/d41/d44/d35/d4a/f5a [0,4194304] 0 2024-09-10T10:04:11.448 INFO:tasks.workunit.client.0.smithi071.stdout:9/306: dread - d0/db/d1b/d1d/d5b/d52/f59 zero size 2024-09-10T10:04:11.450 INFO:tasks.workunit.client.0.smithi071.stdout:4/146: write f3 [3565483,84509] 0 2024-09-10T10:04:11.453 INFO:tasks.workunit.client.0.smithi071.stdout:2/111: mknod d8/c1b 0 2024-09-10T10:04:11.453 INFO:tasks.workunit.client.1.smithi107.stdout:6/278: write d0/f2c [2473118,79329] 0 2024-09-10T10:04:11.455 INFO:tasks.workunit.client.1.smithi107.stdout:9/339: mknod d5/d7/d3c/d53/c81 0 2024-09-10T10:04:11.455 INFO:tasks.workunit.client.0.smithi071.stdout:1/164: dwrite d1/f3 [4194304,4194304] 0 2024-09-10T10:04:11.456 INFO:tasks.workunit.client.0.smithi071.stdout:1/165: readlink d1/l1c 0 2024-09-10T10:04:11.459 INFO:tasks.workunit.client.1.smithi107.stdout:4/367: dwrite d0/d40/d57/f33 [0,4194304] 0 2024-09-10T10:04:11.461 INFO:tasks.workunit.client.0.smithi071.stdout:9/307: rename d0/db/d1b/d1d/d30/d54/d27/f47 to d0/db/d1b/d1d/d5b/d52/f6b 0 2024-09-10T10:04:11.461 INFO:tasks.workunit.client.0.smithi071.stdout:4/147: creat db/d1d/f38 x:0 0 0 2024-09-10T10:04:11.465 INFO:tasks.workunit.client.0.smithi071.stdout:2/112: dwrite f2 [0,4194304] 0 2024-09-10T10:04:11.466 INFO:tasks.workunit.client.0.smithi071.stdout:1/166: write d1/d1e/f25 [2718474,120043] 0 2024-09-10T10:04:11.467 INFO:tasks.workunit.client.0.smithi071.stdout:4/148: creat db/d15/d22/f39 x:0 0 0 2024-09-10T10:04:11.470 INFO:tasks.workunit.client.1.smithi107.stdout:4/368: dwrite d0/d40/d57/f3e [0,4194304] 0 2024-09-10T10:04:11.470 INFO:tasks.workunit.client.0.smithi071.stdout:4/149: stat db/d15/d17/d24 0 2024-09-10T10:04:11.474 INFO:tasks.workunit.client.0.smithi071.stdout:2/113: creat d8/d13/f1c x:0 0 0 2024-09-10T10:04:11.475 INFO:tasks.workunit.client.1.smithi107.stdout:6/279: rename d0/d3d/f2b to d0/d3d/d14/d17/d49/f5a 0 2024-09-10T10:04:11.482 INFO:tasks.workunit.client.0.smithi071.stdout:1/167: dwrite d1/d21/d2f/d30/f33 [0,4194304] 0 2024-09-10T10:04:11.482 INFO:tasks.workunit.client.0.smithi071.stdout:2/114: mknod d8/d13/c1d 0 2024-09-10T10:04:11.484 INFO:tasks.workunit.client.1.smithi107.stdout:4/369: creat d0/d1f/d20/d47/f85 x:0 0 0 2024-09-10T10:04:11.489 INFO:tasks.workunit.client.1.smithi107.stdout:6/280: dread d0/d3d/d14/d21/f25 [0,4194304] 0 2024-09-10T10:04:11.490 INFO:tasks.workunit.client.1.smithi107.stdout:6/281: write d0/d3d/d14/d21/f22 [2504953,67068] 0 2024-09-10T10:04:11.491 INFO:tasks.workunit.client.0.smithi071.stdout:0/122: truncate d11/d1e/f24 2289462 0 2024-09-10T10:04:11.497 INFO:tasks.workunit.client.0.smithi071.stdout:2/115: mknod d8/c1e 0 2024-09-10T10:04:11.498 INFO:tasks.workunit.client.0.smithi071.stdout:2/116: chown d8/ff 451950588 1 2024-09-10T10:04:11.499 INFO:tasks.workunit.client.1.smithi107.stdout:6/282: creat d0/d3d/d14/d17/d4b/f5b x:0 0 0 2024-09-10T10:04:11.499 INFO:tasks.workunit.client.0.smithi071.stdout:0/123: dwrite f7 [0,4194304] 0 2024-09-10T10:04:11.499 INFO:tasks.workunit.client.0.smithi071.stdout:4/150: link db/c16 db/c3a 0 2024-09-10T10:04:11.501 INFO:tasks.workunit.client.1.smithi107.stdout:4/370: dwrite d0/f12 [4194304,4194304] 0 2024-09-10T10:04:11.502 INFO:tasks.workunit.client.0.smithi071.stdout:1/168: mkdir d1/d35 0 2024-09-10T10:04:11.503 INFO:tasks.workunit.client.1.smithi107.stdout:4/371: stat d0/d1f/d20/f70 0 2024-09-10T10:04:11.503 INFO:tasks.workunit.client.0.smithi071.stdout:1/169: dread - d1/f2e zero size 2024-09-10T10:04:11.505 INFO:tasks.workunit.client.0.smithi071.stdout:1/170: chown d1/f19 4084390 1 2024-09-10T10:04:11.506 INFO:tasks.workunit.client.0.smithi071.stdout:2/117: symlink d8/d13/l1f 0 2024-09-10T10:04:11.507 INFO:tasks.workunit.client.0.smithi071.stdout:6/144: sync 2024-09-10T10:04:11.507 INFO:tasks.workunit.client.0.smithi071.stdout:0/124: rmdir d11/d22 39 2024-09-10T10:04:11.510 INFO:tasks.workunit.client.0.smithi071.stdout:4/151: dwrite f3 [0,4194304] 0 2024-09-10T10:04:11.510 INFO:tasks.workunit.client.0.smithi071.stdout:6/145: readlink d4/da/df/l12 0 2024-09-10T10:04:11.510 INFO:tasks.workunit.client.0.smithi071.stdout:1/171: mknod d1/d21/d2f/c36 0 2024-09-10T10:04:11.511 INFO:tasks.workunit.client.0.smithi071.stdout:6/146: truncate d4/f25 5209903 0 2024-09-10T10:04:11.513 INFO:tasks.workunit.client.0.smithi071.stdout:2/118: write d8/f14 [2045635,1105] 0 2024-09-10T10:04:11.514 INFO:tasks.workunit.client.0.smithi071.stdout:4/152: creat db/d15/d22/f3b x:0 0 0 2024-09-10T10:04:11.514 INFO:tasks.workunit.client.1.smithi107.stdout:1/390: dread d2/d12/d65/d6b/f41 [0,4194304] 0 2024-09-10T10:04:11.516 INFO:tasks.workunit.client.1.smithi107.stdout:3/519: dread dc/dd/d45/d26/d41/d44/f2d [0,4194304] 0 2024-09-10T10:04:11.516 INFO:tasks.workunit.client.0.smithi071.stdout:0/125: rename ff to d11/d22/f2c 0 2024-09-10T10:04:11.517 INFO:tasks.workunit.client.1.smithi107.stdout:1/391: creat d2/d36/f78 x:0 0 0 2024-09-10T10:04:11.519 INFO:tasks.workunit.client.0.smithi071.stdout:3/151: truncate d3/f6 8210945 0 2024-09-10T10:04:11.523 INFO:tasks.workunit.client.0.smithi071.stdout:4/153: creat db/d15/d26/f3c x:0 0 0 2024-09-10T10:04:11.524 INFO:tasks.workunit.client.0.smithi071.stdout:4/154: truncate db/d15/d17/d24/f25 1550973 0 2024-09-10T10:04:11.525 INFO:tasks.workunit.client.0.smithi071.stdout:0/126: rename d11/d1e/f27 to d11/d1e/f2d 0 2024-09-10T10:04:11.525 INFO:tasks.workunit.client.0.smithi071.stdout:4/155: readlink db/d15/d22/l2c 0 2024-09-10T10:04:11.526 INFO:tasks.workunit.client.1.smithi107.stdout:1/392: dwrite d2/d12/d65/d6b/f2e [0,4194304] 0 2024-09-10T10:04:11.526 INFO:tasks.workunit.client.0.smithi071.stdout:4/156: chown f9 1950886 1 2024-09-10T10:04:11.526 INFO:tasks.workunit.client.0.smithi071.stdout:4/157: readlink db/d15/d26/l30 0 2024-09-10T10:04:11.527 INFO:tasks.workunit.client.0.smithi071.stdout:4/158: stat db/cd 0 2024-09-10T10:04:11.527 INFO:tasks.workunit.client.0.smithi071.stdout:1/172: creat d1/f37 x:0 0 0 2024-09-10T10:04:11.527 INFO:tasks.workunit.client.0.smithi071.stdout:4/159: write db/d1d/f36 [270534,123613] 0 2024-09-10T10:04:11.529 INFO:tasks.workunit.client.0.smithi071.stdout:4/160: stat db/d15/d26 0 2024-09-10T10:04:11.529 INFO:tasks.workunit.client.1.smithi107.stdout:1/393: symlink d2/d12/d71/l79 0 2024-09-10T10:04:11.530 INFO:tasks.workunit.client.0.smithi071.stdout:4/161: fdatasync db/d15/d26/f3c 0 2024-09-10T10:04:11.531 INFO:tasks.workunit.client.0.smithi071.stdout:0/127: unlink d11/d1e/f1f 0 2024-09-10T10:04:11.534 INFO:tasks.workunit.client.0.smithi071.stdout:4/162: write db/d15/d17/f1f [320920,82657] 0 2024-09-10T10:04:11.534 INFO:tasks.workunit.client.0.smithi071.stdout:3/152: mknod d3/d10/d24/d2b/c32 0 2024-09-10T10:04:11.534 INFO:tasks.workunit.client.0.smithi071.stdout:1/173: mknod d1/d21/c38 0 2024-09-10T10:04:11.536 INFO:tasks.workunit.client.1.smithi107.stdout:1/394: dwrite d2/d35/f5b [0,4194304] 0 2024-09-10T10:04:11.537 INFO:tasks.workunit.client.0.smithi071.stdout:9/308: dwrite d0/db/f15 [4194304,4194304] 0 2024-09-10T10:04:11.538 INFO:tasks.workunit.client.0.smithi071.stdout:2/119: dread d8/fb [0,4194304] 0 2024-09-10T10:04:11.539 INFO:tasks.workunit.client.0.smithi071.stdout:1/174: creat d1/d21/d2f/f39 x:0 0 0 2024-09-10T10:04:11.540 INFO:tasks.workunit.client.1.smithi107.stdout:1/395: creat d2/d12/d5a/f7a x:0 0 0 2024-09-10T10:04:11.540 INFO:tasks.workunit.client.0.smithi071.stdout:1/175: dread - d1/f2e zero size 2024-09-10T10:04:11.541 INFO:tasks.workunit.client.0.smithi071.stdout:3/153: mknod d3/d20/d30/c33 0 2024-09-10T10:04:11.542 INFO:tasks.workunit.client.0.smithi071.stdout:0/128: dread d11/f14 [0,4194304] 0 2024-09-10T10:04:11.542 INFO:tasks.workunit.client.0.smithi071.stdout:1/176: write d1/f2e [191828,36355] 0 2024-09-10T10:04:11.543 INFO:tasks.workunit.client.0.smithi071.stdout:4/163: link db/f1b db/d15/d17/f3d 0 2024-09-10T10:04:11.545 INFO:tasks.workunit.client.0.smithi071.stdout:4/164: chown db/d15/d17/f37 12 1 2024-09-10T10:04:11.545 INFO:tasks.workunit.client.0.smithi071.stdout:3/154: chown d3/d20/c28 5811839 1 2024-09-10T10:04:11.545 INFO:tasks.workunit.client.0.smithi071.stdout:0/129: creat d11/d22/f2e x:0 0 0 2024-09-10T10:04:11.546 INFO:tasks.workunit.client.0.smithi071.stdout:0/130: dread - d11/d1e/f2d zero size 2024-09-10T10:04:11.547 INFO:tasks.workunit.client.0.smithi071.stdout:3/155: mkdir d3/d15/d34 0 2024-09-10T10:04:11.549 INFO:tasks.workunit.client.0.smithi071.stdout:4/165: truncate db/f12 1475024 0 2024-09-10T10:04:11.551 INFO:tasks.workunit.client.0.smithi071.stdout:0/131: symlink d11/l2f 0 2024-09-10T10:04:11.552 INFO:tasks.workunit.client.0.smithi071.stdout:3/156: creat d3/d15/d2f/f35 x:0 0 0 2024-09-10T10:04:11.553 INFO:tasks.workunit.client.0.smithi071.stdout:4/166: rename db/le to db/d15/d22/l3e 0 2024-09-10T10:04:11.558 INFO:tasks.workunit.client.0.smithi071.stdout:0/132: dwrite fd [0,4194304] 0 2024-09-10T10:04:11.559 INFO:tasks.workunit.client.0.smithi071.stdout:3/157: dread d3/d10/d24/f25 [0,4194304] 0 2024-09-10T10:04:11.560 INFO:tasks.workunit.client.0.smithi071.stdout:0/133: mkdir d11/d30 0 2024-09-10T10:04:11.563 INFO:tasks.workunit.client.0.smithi071.stdout:3/158: creat d3/f36 x:0 0 0 2024-09-10T10:04:11.565 INFO:tasks.workunit.client.0.smithi071.stdout:6/147: dread d4/da/fb [4194304,4194304] 0 2024-09-10T10:04:11.566 INFO:tasks.workunit.client.0.smithi071.stdout:3/159: symlink d3/d15/d2f/l37 0 2024-09-10T10:04:11.568 INFO:tasks.workunit.client.0.smithi071.stdout:3/160: truncate d3/d10/d24/f27 565126 0 2024-09-10T10:04:11.568 INFO:tasks.workunit.client.0.smithi071.stdout:0/134: dread d11/f14 [0,4194304] 0 2024-09-10T10:04:11.568 INFO:tasks.workunit.client.0.smithi071.stdout:6/148: symlink d4/da/df/l2a 0 2024-09-10T10:04:11.570 INFO:tasks.workunit.client.0.smithi071.stdout:3/161: write d3/d1c/f31 [586584,19023] 0 2024-09-10T10:04:11.570 INFO:tasks.workunit.client.0.smithi071.stdout:6/149: readlink d4/da/df/l10 0 2024-09-10T10:04:11.571 INFO:tasks.workunit.client.0.smithi071.stdout:2/120: dread d8/f10 [0,4194304] 0 2024-09-10T10:04:11.572 INFO:tasks.workunit.client.0.smithi071.stdout:3/162: stat d3/d10/d24/d2b/c32 0 2024-09-10T10:04:11.572 INFO:tasks.workunit.client.1.smithi107.stdout:6/283: fsync d0/d3d/d14/d17/d4b/f5b 0 2024-09-10T10:04:11.573 INFO:tasks.workunit.client.0.smithi071.stdout:0/135: mkdir d11/d22/d31 0 2024-09-10T10:04:11.573 INFO:tasks.workunit.client.0.smithi071.stdout:2/121: chown d8/f1a 15826503 1 2024-09-10T10:04:11.573 INFO:tasks.workunit.client.1.smithi107.stdout:4/372: write d0/d1f/d20/f30 [2157543,86063] 0 2024-09-10T10:04:11.575 INFO:tasks.workunit.client.0.smithi071.stdout:6/150: mknod d4/d20/c2b 0 2024-09-10T10:04:11.575 INFO:tasks.workunit.client.1.smithi107.stdout:6/284: creat d0/d3d/d14/d17/d4b/f5c x:0 0 0 2024-09-10T10:04:11.577 INFO:tasks.workunit.client.0.smithi071.stdout:3/163: dread d3/fd [0,4194304] 0 2024-09-10T10:04:11.578 INFO:tasks.workunit.client.1.smithi107.stdout:6/285: mknod d0/d3d/d14/c5d 0 2024-09-10T10:04:11.578 INFO:tasks.workunit.client.1.smithi107.stdout:4/373: dread d0/d40/d75/f44 [0,4194304] 0 2024-09-10T10:04:11.579 INFO:tasks.workunit.client.0.smithi071.stdout:2/122: dwrite d8/d13/f15 [0,4194304] 0 2024-09-10T10:04:11.581 INFO:tasks.workunit.client.0.smithi071.stdout:2/123: write d8/f14 [351883,118263] 0 2024-09-10T10:04:11.581 INFO:tasks.workunit.client.1.smithi107.stdout:4/374: mknod d0/d40/d57/c86 0 2024-09-10T10:04:11.582 INFO:tasks.workunit.client.0.smithi071.stdout:0/136: mknod d11/c32 0 2024-09-10T10:04:11.582 INFO:tasks.workunit.client.0.smithi071.stdout:2/124: chown d8/l18 59309135 1 2024-09-10T10:04:11.584 INFO:tasks.workunit.client.0.smithi071.stdout:3/164: symlink d3/d20/d30/l38 0 2024-09-10T10:04:11.584 INFO:tasks.workunit.client.1.smithi107.stdout:4/375: symlink d0/d40/d6d/l87 0 2024-09-10T10:04:11.585 INFO:tasks.workunit.client.1.smithi107.stdout:4/376: readlink d0/d1f/l3c 0 2024-09-10T10:04:11.585 INFO:tasks.workunit.client.0.smithi071.stdout:6/151: getdents d4/d1c 0 2024-09-10T10:04:11.585 INFO:tasks.workunit.client.1.smithi107.stdout:6/286: link d0/d3d/d14/d17/c51 d0/d3d/d14/d17/d49/d55/d56/c5e 0 2024-09-10T10:04:11.586 INFO:tasks.workunit.client.1.smithi107.stdout:4/377: dread - d0/d6b/f6c zero size 2024-09-10T10:04:11.587 INFO:tasks.workunit.client.1.smithi107.stdout:6/287: dread - d0/d3d/d14/d17/d4b/f5c zero size 2024-09-10T10:04:11.591 INFO:tasks.workunit.client.1.smithi107.stdout:4/378: rename d0/d40/d57/c86 to d0/d40/d75/c88 0 2024-09-10T10:04:11.591 INFO:tasks.workunit.client.0.smithi071.stdout:6/152: rename d4/f1b to d4/da/df/f2c 0 2024-09-10T10:04:11.591 INFO:tasks.workunit.client.0.smithi071.stdout:4/167: rmdir db/d15/d26 39 2024-09-10T10:04:11.591 INFO:tasks.workunit.client.0.smithi071.stdout:4/168: readlink db/d15/d17/d24/l2d 0 2024-09-10T10:04:11.593 INFO:tasks.workunit.client.1.smithi107.stdout:4/379: symlink d0/d40/l89 0 2024-09-10T10:04:11.595 INFO:tasks.workunit.client.1.smithi107.stdout:4/380: read d0/d1f/f34 [119390,123643] 0 2024-09-10T10:04:11.595 INFO:tasks.workunit.client.1.smithi107.stdout:6/288: dwrite d0/d3d/d14/d17/f47 [0,4194304] 0 2024-09-10T10:04:11.596 INFO:tasks.workunit.client.0.smithi071.stdout:0/137: dread d11/f18 [0,4194304] 0 2024-09-10T10:04:11.597 INFO:tasks.workunit.client.1.smithi107.stdout:6/289: fdatasync d0/d3d/d14/d17/d4b/f5c 0 2024-09-10T10:04:11.597 INFO:tasks.workunit.client.0.smithi071.stdout:0/138: write d11/f14 [4953451,38628] 0 2024-09-10T10:04:11.598 INFO:tasks.workunit.client.1.smithi107.stdout:6/290: chown d0/d3d 1726 1 2024-09-10T10:04:11.599 INFO:tasks.workunit.client.1.smithi107.stdout:6/291: chown d0/d3d/d14/c29 30 1 2024-09-10T10:04:11.599 INFO:tasks.workunit.client.0.smithi071.stdout:6/153: symlink d4/da/l2d 0 2024-09-10T10:04:11.600 INFO:tasks.workunit.client.0.smithi071.stdout:4/169: creat db/d15/d17/f3f x:0 0 0 2024-09-10T10:04:11.601 INFO:tasks.workunit.client.0.smithi071.stdout:4/170: rename db/d15 to db/d15/d22/d40 22 2024-09-10T10:04:11.602 INFO:tasks.workunit.client.0.smithi071.stdout:2/125: getdents d8 0 2024-09-10T10:04:11.603 INFO:tasks.workunit.client.0.smithi071.stdout:2/126: fdatasync d8/ff 0 2024-09-10T10:04:11.603 INFO:tasks.workunit.client.1.smithi107.stdout:6/292: rename d0/d3d/d14/d17/d4b/f5b to d0/d3d/d14/d21/f5f 0 2024-09-10T10:04:11.604 INFO:tasks.workunit.client.0.smithi071.stdout:6/154: mkdir d4/da/df/d2e 0 2024-09-10T10:04:11.604 INFO:tasks.workunit.client.0.smithi071.stdout:6/155: chown d4/da/l2d 478 1 2024-09-10T10:04:11.605 INFO:tasks.workunit.client.0.smithi071.stdout:4/171: symlink db/l41 0 2024-09-10T10:04:11.606 INFO:tasks.workunit.client.1.smithi107.stdout:6/293: mkdir d0/d3d/d14/d17/d24/d60 0 2024-09-10T10:04:11.606 INFO:tasks.workunit.client.0.smithi071.stdout:9/309: truncate d0/db/ff 1926652 0 2024-09-10T10:04:11.606 INFO:tasks.workunit.client.0.smithi071.stdout:0/139: mknod d11/d30/c33 0 2024-09-10T10:04:11.606 INFO:tasks.workunit.client.0.smithi071.stdout:6/156: dread - d4/da/df/f2c zero size 2024-09-10T10:04:11.607 INFO:tasks.workunit.client.1.smithi107.stdout:6/294: write d0/d3d/d14/f1f [512214,74701] 0 2024-09-10T10:04:11.608 INFO:tasks.workunit.client.0.smithi071.stdout:9/310: stat d0/d3b/d44/f5a 0 2024-09-10T10:04:11.609 INFO:tasks.workunit.client.0.smithi071.stdout:1/177: truncate d1/fd 1354380 0 2024-09-10T10:04:11.610 INFO:tasks.workunit.client.0.smithi071.stdout:4/172: symlink db/d15/d22/l42 0 2024-09-10T10:04:11.610 INFO:tasks.workunit.client.0.smithi071.stdout:1/178: stat d1/d1e/f25 0 2024-09-10T10:04:11.611 INFO:tasks.workunit.client.0.smithi071.stdout:2/127: dwrite d8/fe [0,4194304] 0 2024-09-10T10:04:11.613 INFO:tasks.workunit.client.0.smithi071.stdout:1/179: fdatasync d1/d21/f24 0 2024-09-10T10:04:11.613 INFO:tasks.workunit.client.0.smithi071.stdout:4/173: dread - db/d1d/f38 zero size 2024-09-10T10:04:11.613 INFO:tasks.workunit.client.0.smithi071.stdout:2/128: dread - d8/d13/f1c zero size 2024-09-10T10:04:11.614 INFO:tasks.workunit.client.0.smithi071.stdout:4/174: write f9 [4323638,110216] 0 2024-09-10T10:04:11.615 INFO:tasks.workunit.client.0.smithi071.stdout:9/311: unlink d0/db/d1b/d1d/f2f 0 2024-09-10T10:04:11.616 INFO:tasks.workunit.client.0.smithi071.stdout:4/175: dread - db/d15/d17/f3f zero size 2024-09-10T10:04:11.616 INFO:tasks.workunit.client.1.smithi107.stdout:6/295: truncate d0/d3d/d14/d17/f3b 1325431 0 2024-09-10T10:04:11.619 INFO:tasks.workunit.client.1.smithi107.stdout:6/296: write d0/d3d/d14/f35 [552454,15029] 0 2024-09-10T10:04:11.620 INFO:tasks.workunit.client.0.smithi071.stdout:1/180: dwrite d1/f37 [0,4194304] 0 2024-09-10T10:04:11.622 INFO:tasks.workunit.client.0.smithi071.stdout:2/129: creat d8/f20 x:0 0 0 2024-09-10T10:04:11.623 INFO:tasks.workunit.client.1.smithi107.stdout:6/297: rename d0/d3d/d14/d17/c3c to d0/d3d/d14/d17/d24/c61 0 2024-09-10T10:04:11.625 INFO:tasks.workunit.client.1.smithi107.stdout:6/298: truncate d0/d3d/d14/d21/f53 859827 0 2024-09-10T10:04:11.628 INFO:tasks.workunit.client.0.smithi071.stdout:1/181: dwrite d1/d1e/f25 [4194304,4194304] 0 2024-09-10T10:04:11.629 INFO:tasks.workunit.client.1.smithi107.stdout:6/299: symlink d0/d3d/d14/d17/d49/d55/l62 0 2024-09-10T10:04:11.629 INFO:tasks.workunit.client.0.smithi071.stdout:2/130: unlink d8/l18 0 2024-09-10T10:04:11.631 INFO:tasks.workunit.client.0.smithi071.stdout:4/176: mkdir db/d15/d26/d43 0 2024-09-10T10:04:11.633 INFO:tasks.workunit.client.1.smithi107.stdout:6/300: getdents d0/d3d/d14/d17/d49 0 2024-09-10T10:04:11.633 INFO:tasks.workunit.client.0.smithi071.stdout:1/182: dread d1/f19 [0,4194304] 0 2024-09-10T10:04:11.635 INFO:tasks.workunit.client.0.smithi071.stdout:2/131: symlink d8/l21 0 2024-09-10T10:04:11.635 INFO:tasks.workunit.client.0.smithi071.stdout:2/132: stat l6 0 2024-09-10T10:04:11.635 INFO:tasks.workunit.client.0.smithi071.stdout:1/183: read d1/f2e [124030,85068] 0 2024-09-10T10:04:11.636 INFO:tasks.workunit.client.0.smithi071.stdout:2/133: chown d8/d13/f15 1 1 2024-09-10T10:04:11.636 INFO:tasks.workunit.client.0.smithi071.stdout:1/184: read d1/f9 [1694602,53849] 0 2024-09-10T10:04:11.638 INFO:tasks.workunit.client.0.smithi071.stdout:9/312: getdents d0/d3b/d44 0 2024-09-10T10:04:11.638 INFO:tasks.workunit.client.1.smithi107.stdout:6/301: getdents d0/d3d/d14/d17/d49/d55/d56 0 2024-09-10T10:04:11.638 INFO:tasks.workunit.client.0.smithi071.stdout:3/165: write d3/f18 [8856436,17849] 0 2024-09-10T10:04:11.641 INFO:tasks.workunit.client.0.smithi071.stdout:4/177: link db/f2a db/d15/d26/d43/f44 0 2024-09-10T10:04:11.643 INFO:tasks.workunit.client.1.smithi107.stdout:6/302: dread d0/d3d/d14/d17/f47 [0,4194304] 0 2024-09-10T10:04:11.644 INFO:tasks.workunit.client.0.smithi071.stdout:2/134: dwrite d8/f14 [0,4194304] 0 2024-09-10T10:04:11.644 INFO:tasks.workunit.client.0.smithi071.stdout:3/166: read d3/f6 [6701465,70622] 0 2024-09-10T10:04:11.645 INFO:tasks.workunit.client.0.smithi071.stdout:2/135: rename d8 to d8/d13/d22 22 2024-09-10T10:04:11.645 INFO:tasks.workunit.client.0.smithi071.stdout:3/167: truncate d3/d1c/f22 1089600 0 2024-09-10T10:04:11.646 INFO:tasks.workunit.client.0.smithi071.stdout:2/136: write d8/d13/f15 [1584396,20370] 0 2024-09-10T10:04:11.647 INFO:tasks.workunit.client.1.smithi107.stdout:6/303: dread d0/d3d/d14/d21/f28 [0,4194304] 0 2024-09-10T10:04:11.649 INFO:tasks.workunit.client.1.smithi107.stdout:6/304: chown d0/d3d/d14/d21/f50 8072435 1 2024-09-10T10:04:11.650 INFO:tasks.workunit.client.0.smithi071.stdout:1/185: mknod d1/c3a 0 2024-09-10T10:04:11.651 INFO:tasks.workunit.client.0.smithi071.stdout:1/186: stat d1/d21/f24 0 2024-09-10T10:04:11.653 INFO:tasks.workunit.client.1.smithi107.stdout:6/305: rename d0/d3d/d14/l48 to d0/d3d/d14/l63 0 2024-09-10T10:04:11.653 INFO:tasks.workunit.client.0.smithi071.stdout:9/313: creat d0/d3b/d5c/d6a/f6c x:0 0 0 2024-09-10T10:04:11.653 INFO:tasks.workunit.client.0.smithi071.stdout:9/314: chown d0/db/d1b/d1d 1 1 2024-09-10T10:04:11.654 INFO:tasks.workunit.client.1.smithi107.stdout:6/306: chown d0/d3d/d14/d17/c20 43 1 2024-09-10T10:04:11.654 INFO:tasks.workunit.client.0.smithi071.stdout:3/168: mkdir d3/d20/d39 0 2024-09-10T10:04:11.657 INFO:tasks.workunit.client.1.smithi107.stdout:6/307: creat d0/d3d/f64 x:0 0 0 2024-09-10T10:04:11.657 INFO:tasks.workunit.client.0.smithi071.stdout:4/178: mknod db/d15/d26/d43/c45 0 2024-09-10T10:04:11.658 INFO:tasks.workunit.client.0.smithi071.stdout:0/140: truncate d11/f17 3289599 0 2024-09-10T10:04:11.659 INFO:tasks.workunit.client.1.smithi107.stdout:6/308: rmdir d0/d3d/d14/d42 39 2024-09-10T10:04:11.659 INFO:tasks.workunit.client.0.smithi071.stdout:9/315: symlink d0/d3b/d5c/d6a/l6d 0 2024-09-10T10:04:11.659 INFO:tasks.workunit.client.0.smithi071.stdout:0/141: chown cb 314482 1 2024-09-10T10:04:11.662 INFO:tasks.workunit.client.0.smithi071.stdout:0/142: dread - d11/d22/f29 zero size 2024-09-10T10:04:11.664 INFO:tasks.workunit.client.0.smithi071.stdout:6/157: dwrite f1 [4194304,4194304] 0 2024-09-10T10:04:11.665 INFO:tasks.workunit.client.0.smithi071.stdout:3/169: write d3/f18 [2967134,97189] 0 2024-09-10T10:04:11.666 INFO:tasks.workunit.client.1.smithi107.stdout:6/309: truncate d0/d3d/d14/d42/f4e 3433414 0 2024-09-10T10:04:11.667 INFO:tasks.workunit.client.0.smithi071.stdout:3/170: chown d3/d20/c28 21 1 2024-09-10T10:04:11.668 INFO:tasks.workunit.client.0.smithi071.stdout:4/179: dwrite db/d1d/f23 [0,4194304] 0 2024-09-10T10:04:11.669 INFO:tasks.workunit.client.1.smithi107.stdout:6/310: write d0/d3d/d14/d17/f4d [1587083,62765] 0 2024-09-10T10:04:11.669 INFO:tasks.workunit.client.1.smithi107.stdout:6/311: chown d0/d3d/d14 40672 1 2024-09-10T10:04:11.670 INFO:tasks.workunit.client.0.smithi071.stdout:4/180: write f3 [4906173,72556] 0 2024-09-10T10:04:11.670 INFO:tasks.workunit.client.0.smithi071.stdout:0/143: symlink d11/d30/l34 0 2024-09-10T10:04:11.674 INFO:tasks.workunit.client.0.smithi071.stdout:6/158: creat d4/f2f x:0 0 0 2024-09-10T10:04:11.674 INFO:tasks.workunit.client.0.smithi071.stdout:0/144: chown f8 460 1 2024-09-10T10:04:11.674 INFO:tasks.workunit.client.1.smithi107.stdout:6/312: symlink d0/d3d/d14/l65 0 2024-09-10T10:04:11.676 INFO:tasks.workunit.client.1.smithi107.stdout:6/313: symlink d0/d3d/d14/d17/l66 0 2024-09-10T10:04:11.677 INFO:tasks.workunit.client.0.smithi071.stdout:1/187: getdents d1/d1e 0 2024-09-10T10:04:11.679 INFO:tasks.workunit.client.0.smithi071.stdout:4/181: write db/d15/d17/f37 [259586,31263] 0 2024-09-10T10:04:11.681 INFO:tasks.workunit.client.0.smithi071.stdout:3/171: dwrite d3/d1c/f22 [0,4194304] 0 2024-09-10T10:04:11.683 INFO:tasks.workunit.client.1.smithi107.stdout:6/314: link d0/d3d/d14/d17/d49/d55/l62 d0/d3d/d14/d21/l67 0 2024-09-10T10:04:11.683 INFO:tasks.workunit.client.0.smithi071.stdout:6/159: symlink d4/da/df/l30 0 2024-09-10T10:04:11.685 INFO:tasks.workunit.client.0.smithi071.stdout:7/185: sync 2024-09-10T10:04:11.685 INFO:tasks.workunit.client.0.smithi071.stdout:8/154: sync 2024-09-10T10:04:11.685 INFO:tasks.workunit.client.0.smithi071.stdout:4/182: creat db/f46 x:0 0 0 2024-09-10T10:04:11.685 INFO:tasks.workunit.client.0.smithi071.stdout:9/316: dwrite d0/db/d20/d3c/f57 [0,4194304] 0 2024-09-10T10:04:11.686 INFO:tasks.workunit.client.1.smithi107.stdout:6/315: mknod d0/d3d/d14/d42/c68 0 2024-09-10T10:04:11.686 INFO:tasks.workunit.client.0.smithi071.stdout:8/155: fdatasync d5/f10 0 2024-09-10T10:04:11.686 INFO:tasks.workunit.client.0.smithi071.stdout:7/186: stat d9/d1a/f35 0 2024-09-10T10:04:11.688 INFO:tasks.workunit.client.0.smithi071.stdout:0/145: unlink d11/d22/f2a 0 2024-09-10T10:04:11.688 INFO:tasks.workunit.client.0.smithi071.stdout:8/156: write d5/df/d16/f22 [1358826,119171] 0 2024-09-10T10:04:11.689 INFO:tasks.workunit.client.1.smithi107.stdout:6/316: creat d0/d3d/d14/d17/d24/d60/f69 x:0 0 0 2024-09-10T10:04:11.689 INFO:tasks.workunit.client.0.smithi071.stdout:0/146: chown f0 103 1 2024-09-10T10:04:11.689 INFO:tasks.workunit.client.0.smithi071.stdout:3/172: mkdir d3/d20/d30/d3a 0 2024-09-10T10:04:11.692 INFO:tasks.workunit.client.0.smithi071.stdout:6/160: unlink d4/da/c1e 0 2024-09-10T10:04:11.693 INFO:tasks.workunit.client.1.smithi107.stdout:6/317: symlink d0/d3d/d14/d17/d49/d55/l6a 0 2024-09-10T10:04:11.693 INFO:tasks.workunit.client.0.smithi071.stdout:1/188: rename d1/d21/l22 to d1/d21/d2f/d30/l3b 0 2024-09-10T10:04:11.697 INFO:tasks.workunit.client.0.smithi071.stdout:7/187: symlink d9/d2c/l3a 0 2024-09-10T10:04:11.697 INFO:tasks.workunit.client.1.smithi107.stdout:6/318: link d0/d3d/d14/d21/f50 d0/d3d/d14/d17/d24/d60/f6b 0 2024-09-10T10:04:11.697 INFO:tasks.workunit.client.0.smithi071.stdout:3/173: symlink d3/d1c/l3b 0 2024-09-10T10:04:11.701 INFO:tasks.workunit.client.0.smithi071.stdout:6/161: symlink d4/da/df/l31 0 2024-09-10T10:04:11.702 INFO:tasks.workunit.client.0.smithi071.stdout:6/162: dread - d4/f27 zero size 2024-09-10T10:04:11.703 INFO:tasks.workunit.client.0.smithi071.stdout:1/189: truncate d1/f2e 5356 0 2024-09-10T10:04:11.703 INFO:tasks.workunit.client.0.smithi071.stdout:7/188: creat d9/d11/f3b x:0 0 0 2024-09-10T10:04:11.706 INFO:tasks.workunit.client.0.smithi071.stdout:8/157: creat d5/df/d1e/d38/f3f x:0 0 0 2024-09-10T10:04:11.707 INFO:tasks.workunit.client.0.smithi071.stdout:1/190: rmdir d1/d1e 39 2024-09-10T10:04:11.708 INFO:tasks.workunit.client.0.smithi071.stdout:1/191: read - d1/d21/f24 zero size 2024-09-10T10:04:11.709 INFO:tasks.workunit.client.1.smithi107.stdout:6/319: write d0/d3d/d14/d17/f3b [1830056,116663] 0 2024-09-10T10:04:11.710 INFO:tasks.workunit.client.0.smithi071.stdout:9/317: dread - d0/db/d1b/d1d/d30/f65 zero size 2024-09-10T10:04:11.710 INFO:tasks.workunit.client.1.smithi107.stdout:6/320: read - d0/d3d/d14/d17/d24/d60/f69 zero size 2024-09-10T10:04:11.711 INFO:tasks.workunit.client.0.smithi071.stdout:7/189: rename d9/d15/c36 to d9/d1a/d1d/d39/c3c 0 2024-09-10T10:04:11.711 INFO:tasks.workunit.client.0.smithi071.stdout:0/147: link d11/d1e/c2b d11/d30/c35 0 2024-09-10T10:04:11.713 INFO:tasks.workunit.client.0.smithi071.stdout:6/163: creat d4/da/df/d2e/f32 x:0 0 0 2024-09-10T10:04:11.713 INFO:tasks.workunit.client.1.smithi107.stdout:6/321: unlink d0/d3d/d14/d17/f4d 0 2024-09-10T10:04:11.715 INFO:tasks.workunit.client.1.smithi107.stdout:6/322: write d0/d3d/d14/d21/f33 [867484,31495] 0 2024-09-10T10:04:11.719 INFO:tasks.workunit.client.0.smithi071.stdout:7/190: write d9/ff [1082568,103861] 0 2024-09-10T10:04:11.721 INFO:tasks.workunit.client.0.smithi071.stdout:0/148: symlink d11/d30/l36 0 2024-09-10T10:04:11.722 INFO:tasks.workunit.client.0.smithi071.stdout:3/174: dread d3/f18 [4194304,4194304] 0 2024-09-10T10:04:11.722 INFO:tasks.workunit.client.0.smithi071.stdout:0/149: chown d11 14 1 2024-09-10T10:04:11.723 INFO:tasks.workunit.client.1.smithi107.stdout:6/323: dwrite d0/d3d/d14/d17/d24/d60/f69 [0,4194304] 0 2024-09-10T10:04:11.723 INFO:tasks.workunit.client.0.smithi071.stdout:8/158: dread d5/df/d1e/f21 [0,4194304] 0 2024-09-10T10:04:11.723 INFO:tasks.workunit.client.0.smithi071.stdout:9/318: mkdir d0/db/d1b/d1d/d30/d54/d27/d6e 0 2024-09-10T10:04:11.725 INFO:tasks.workunit.client.1.smithi107.stdout:6/324: mknod d0/d3d/d14/d21/c6c 0 2024-09-10T10:04:11.726 INFO:tasks.workunit.client.1.smithi107.stdout:6/325: write d0/d3d/d14/d21/f22 [2530738,71522] 0 2024-09-10T10:04:11.729 INFO:tasks.workunit.client.1.smithi107.stdout:6/326: symlink d0/d3d/d14/d17/d49/d55/d56/l6d 0 2024-09-10T10:04:11.730 INFO:tasks.workunit.client.1.smithi107.stdout:6/327: dread - d0/d3d/d14/d17/d4b/f5c zero size 2024-09-10T10:04:11.732 INFO:tasks.workunit.client.0.smithi071.stdout:7/191: chown d9/f19 21695 1 2024-09-10T10:04:11.733 INFO:tasks.workunit.client.0.smithi071.stdout:1/192: rmdir d1/d21/d34 0 2024-09-10T10:04:11.735 INFO:tasks.workunit.client.0.smithi071.stdout:0/150: chown d11/c1d 3426 1 2024-09-10T10:04:11.735 INFO:tasks.workunit.client.0.smithi071.stdout:3/175: mkdir d3/d1c/d3c 0 2024-09-10T10:04:11.747 INFO:tasks.workunit.client.1.smithi107.stdout:6/328: dwrite d0/d3d/d14/d17/f1c [0,4194304] 0 2024-09-10T10:04:11.753 INFO:tasks.workunit.client.1.smithi107.stdout:6/329: dread d0/d3d/d14/f58 [0,4194304] 0 2024-09-10T10:04:11.755 INFO:tasks.workunit.client.1.smithi107.stdout:6/330: unlink d0/d3d/d14/d17/l1e 0 2024-09-10T10:04:11.758 INFO:tasks.workunit.client.1.smithi107.stdout:6/331: rename d0/d3d/d14/d17/d49/f54 to d0/d3d/d14/d17/d4b/f6e 0 2024-09-10T10:04:11.760 INFO:tasks.workunit.client.1.smithi107.stdout:6/332: truncate d0/d3d/d14/d21/f22 4750313 0 2024-09-10T10:04:11.762 INFO:tasks.workunit.client.1.smithi107.stdout:6/333: read d0/d3d/d14/f1f [179269,69848] 0 2024-09-10T10:04:11.768 INFO:tasks.workunit.client.1.smithi107.stdout:6/334: write d0/d3d/d14/d42/f4e [3520147,90692] 0 2024-09-10T10:04:11.772 INFO:tasks.workunit.client.1.smithi107.stdout:6/335: dread d0/d3d/d14/d17/f47 [0,4194304] 0 2024-09-10T10:04:11.773 INFO:tasks.workunit.client.1.smithi107.stdout:6/336: creat d0/d3d/d14/d17/d24/f6f x:0 0 0 2024-09-10T10:04:11.775 INFO:tasks.workunit.client.1.smithi107.stdout:6/337: mkdir d0/d70 0 2024-09-10T10:04:11.776 INFO:tasks.workunit.client.1.smithi107.stdout:6/338: symlink d0/d3d/d14/d42/l71 0 2024-09-10T10:04:11.778 INFO:tasks.workunit.client.1.smithi107.stdout:6/339: rename d0/d3d/d14/d17/d24/c3f to d0/d70/c72 0 2024-09-10T10:04:11.784 INFO:tasks.workunit.client.1.smithi107.stdout:6/340: truncate d0/d3d/d14/d21/f28 1533297 0 2024-09-10T10:04:11.789 INFO:tasks.workunit.client.1.smithi107.stdout:6/341: dwrite d0/d3d/d14/d21/f25 [0,4194304] 0 2024-09-10T10:04:11.791 INFO:tasks.workunit.client.1.smithi107.stdout:6/342: mkdir d0/d3d/d14/d17/d49/d55/d73 0 2024-09-10T10:04:11.797 INFO:tasks.workunit.client.1.smithi107.stdout:6/343: dwrite d0/f13 [0,4194304] 0 2024-09-10T10:04:11.801 INFO:tasks.workunit.client.1.smithi107.stdout:6/344: dread d0/d3d/f40 [0,4194304] 0 2024-09-10T10:04:11.805 INFO:tasks.workunit.client.1.smithi107.stdout:6/345: rename d0/d3d/d14/f35 to d0/d3d/d14/d17/d49/d55/d73/f74 0 2024-09-10T10:04:11.805 INFO:tasks.workunit.client.1.smithi107.stdout:6/346: chown d0/d3d/d14/d17/l66 151 1 2024-09-10T10:04:11.807 INFO:tasks.workunit.client.1.smithi107.stdout:6/347: chown d0/d3d/d14/d17/c2f 5842474 1 2024-09-10T10:04:11.809 INFO:tasks.workunit.client.1.smithi107.stdout:6/348: creat d0/d3d/d14/d17/d49/d55/d73/f75 x:0 0 0 2024-09-10T10:04:11.811 INFO:tasks.workunit.client.1.smithi107.stdout:6/349: mkdir d0/d76 0 2024-09-10T10:04:11.812 INFO:tasks.workunit.client.1.smithi107.stdout:6/350: write d0/f45 [291349,64581] 0 2024-09-10T10:04:11.817 INFO:tasks.workunit.client.1.smithi107.stdout:6/351: dwrite d0/d3d/d14/f58 [0,4194304] 0 2024-09-10T10:04:11.819 INFO:tasks.workunit.client.1.smithi107.stdout:6/352: creat d0/d3d/d14/d17/d49/d55/d73/f77 x:0 0 0 2024-09-10T10:04:11.823 INFO:tasks.workunit.client.0.smithi071.stdout:8/159: rmdir d5/d36 39 2024-09-10T10:04:11.824 INFO:tasks.workunit.client.1.smithi107.stdout:6/353: dread d0/d3d/d14/d21/f22 [0,4194304] 0 2024-09-10T10:04:11.826 INFO:tasks.workunit.client.0.smithi071.stdout:7/192: dwrite d9/d11/f3b [0,4194304] 0 2024-09-10T10:04:11.826 INFO:tasks.workunit.client.1.smithi107.stdout:6/354: mknod d0/d3d/d14/d17/d24/c78 0 2024-09-10T10:04:11.827 INFO:tasks.workunit.client.0.smithi071.stdout:6/164: dread f3 [0,4194304] 0 2024-09-10T10:04:11.828 INFO:tasks.workunit.client.0.smithi071.stdout:8/160: chown d5/df/d1d/f3d 179034936 1 2024-09-10T10:04:11.829 INFO:tasks.workunit.client.1.smithi107.stdout:6/355: unlink d0/c44 0 2024-09-10T10:04:11.829 INFO:tasks.workunit.client.0.smithi071.stdout:1/193: dread d1/f2c [0,4194304] 0 2024-09-10T10:04:11.830 INFO:tasks.workunit.client.0.smithi071.stdout:6/165: chown d4/d20 6121 1 2024-09-10T10:04:11.831 INFO:tasks.workunit.client.1.smithi107.stdout:6/356: creat d0/d76/f79 x:0 0 0 2024-09-10T10:04:11.832 INFO:tasks.workunit.client.1.smithi107.stdout:6/357: chown d0/d3d/d14/d17 194804062 1 2024-09-10T10:04:11.832 INFO:tasks.workunit.client.0.smithi071.stdout:7/193: read d9/fe [3114311,93954] 0 2024-09-10T10:04:11.832 INFO:tasks.workunit.client.0.smithi071.stdout:8/161: chown d5/df/d1d/c2b 431533 1 2024-09-10T10:04:11.833 INFO:tasks.workunit.client.0.smithi071.stdout:6/166: fdatasync d4/da/df/d2e/f32 0 2024-09-10T10:04:11.834 INFO:tasks.workunit.client.0.smithi071.stdout:8/162: chown d5/df/d1e 895 1 2024-09-10T10:04:11.834 INFO:tasks.workunit.client.1.smithi107.stdout:5/307: sync 2024-09-10T10:04:11.835 INFO:tasks.workunit.client.0.smithi071.stdout:9/319: dwrite d0/fa [4194304,4194304] 0 2024-09-10T10:04:11.835 INFO:tasks.workunit.client.0.smithi071.stdout:8/163: truncate d5/f10 699808 0 2024-09-10T10:04:11.836 INFO:tasks.workunit.client.0.smithi071.stdout:8/164: dread - d5/f33 zero size 2024-09-10T10:04:11.837 INFO:tasks.workunit.client.1.smithi107.stdout:5/308: mkdir de/d20/d65 0 2024-09-10T10:04:11.837 INFO:tasks.workunit.client.0.smithi071.stdout:6/167: creat d4/da/f33 x:0 0 0 2024-09-10T10:04:11.838 INFO:tasks.workunit.client.1.smithi107.stdout:5/309: truncate de/d41/f52 393573 0 2024-09-10T10:04:11.838 INFO:tasks.workunit.client.0.smithi071.stdout:0/151: link l4 d11/l37 0 2024-09-10T10:04:11.839 INFO:tasks.workunit.client.0.smithi071.stdout:3/176: truncate d3/fd 4130798 0 2024-09-10T10:04:11.841 INFO:tasks.workunit.client.0.smithi071.stdout:8/165: write d5/d36/f2e [269383,11262] 0 2024-09-10T10:04:11.843 INFO:tasks.workunit.client.0.smithi071.stdout:6/168: link d4/d20/c22 d4/da/df/d2e/c34 0 2024-09-10T10:04:11.844 INFO:tasks.workunit.client.0.smithi071.stdout:9/320: getdents d0/d3b 0 2024-09-10T10:04:11.845 INFO:tasks.workunit.client.1.smithi107.stdout:5/310: dwrite de/d41/f46 [0,4194304] 0 2024-09-10T10:04:11.846 INFO:tasks.workunit.client.0.smithi071.stdout:3/177: getdents d3/d20/d30 0 2024-09-10T10:04:11.848 INFO:tasks.workunit.client.0.smithi071.stdout:8/166: link d5/df/l34 d5/l40 0 2024-09-10T10:04:11.849 INFO:tasks.workunit.client.1.smithi107.stdout:5/311: symlink de/d4a/d5c/l66 0 2024-09-10T10:04:11.850 INFO:tasks.workunit.client.1.smithi107.stdout:5/312: write de/f5b [274291,15343] 0 2024-09-10T10:04:11.851 INFO:tasks.workunit.client.1.smithi107.stdout:5/313: write de/d41/f46 [1614566,35689] 0 2024-09-10T10:04:11.854 INFO:tasks.workunit.client.0.smithi071.stdout:8/167: readlink d5/df/l35 0 2024-09-10T10:04:11.857 INFO:tasks.workunit.client.0.smithi071.stdout:6/169: dwrite d4/da/df/d2e/f32 [0,4194304] 0 2024-09-10T10:04:11.859 INFO:tasks.workunit.client.0.smithi071.stdout:3/178: dread d3/f1b [0,4194304] 0 2024-09-10T10:04:11.860 INFO:tasks.workunit.client.0.smithi071.stdout:9/321: dwrite d0/db/d1b/d1d/d5b/d52/f5d [0,4194304] 0 2024-09-10T10:04:11.861 INFO:tasks.workunit.client.0.smithi071.stdout:6/170: dread d4/d20/f26 [0,4194304] 0 2024-09-10T10:04:11.862 INFO:tasks.workunit.client.1.smithi107.stdout:5/314: dwrite de/f28 [0,4194304] 0 2024-09-10T10:04:11.864 INFO:tasks.workunit.client.0.smithi071.stdout:6/171: write d4/f28 [914696,110551] 0 2024-09-10T10:04:11.864 INFO:tasks.workunit.client.0.smithi071.stdout:1/194: dread d1/d21/d2f/d30/f31 [0,4194304] 0 2024-09-10T10:04:11.867 INFO:tasks.workunit.client.1.smithi107.stdout:5/315: getdents de/d4a 0 2024-09-10T10:04:11.870 INFO:tasks.workunit.client.1.smithi107.stdout:6/358: dread d0/d3d/d14/d17/d49/f5a [0,4194304] 0 2024-09-10T10:04:11.871 INFO:tasks.workunit.client.0.smithi071.stdout:6/172: mknod d4/da/c35 0 2024-09-10T10:04:11.872 INFO:tasks.workunit.client.0.smithi071.stdout:1/195: readlink d1/l1b 0 2024-09-10T10:04:11.874 INFO:tasks.workunit.client.0.smithi071.stdout:1/196: write d1/d21/d2f/d30/f33 [3171224,85477] 0 2024-09-10T10:04:11.875 INFO:tasks.workunit.client.0.smithi071.stdout:9/322: rename d0/db/d1b/d1d/d30/d54/l1e to d0/d3b/l6f 0 2024-09-10T10:04:11.876 INFO:tasks.workunit.client.1.smithi107.stdout:5/316: rename de/d20/d2b/d4b/l54 to de/l67 0 2024-09-10T10:04:11.876 INFO:tasks.workunit.client.0.smithi071.stdout:1/197: dread d1/f32 [0,4194304] 0 2024-09-10T10:04:11.877 INFO:tasks.workunit.client.0.smithi071.stdout:3/179: write d3/d10/f2d [380947,68050] 0 2024-09-10T10:04:11.878 INFO:tasks.workunit.client.0.smithi071.stdout:6/173: symlink d4/d1c/l36 0 2024-09-10T10:04:11.878 INFO:tasks.workunit.client.0.smithi071.stdout:5/183: sync 2024-09-10T10:04:11.881 INFO:tasks.workunit.client.0.smithi071.stdout:3/180: mknod d3/d20/d30/c3d 0 2024-09-10T10:04:11.882 INFO:tasks.workunit.client.0.smithi071.stdout:6/174: mknod d4/da/df/c37 0 2024-09-10T10:04:11.882 INFO:tasks.workunit.client.1.smithi107.stdout:5/317: link de/c2f de/d41/c68 0 2024-09-10T10:04:11.883 INFO:tasks.workunit.client.0.smithi071.stdout:5/184: write dc/df/f14 [3824966,122717] 0 2024-09-10T10:04:11.884 INFO:tasks.workunit.client.0.smithi071.stdout:6/175: read d4/da/f13 [177763,52499] 0 2024-09-10T10:04:11.884 INFO:tasks.workunit.client.0.smithi071.stdout:3/181: mkdir d3/d1c/d3e 0 2024-09-10T10:04:11.885 INFO:tasks.workunit.client.1.smithi107.stdout:6/359: dread d0/d3d/d14/d17/d49/f5a [4194304,4194304] 0 2024-09-10T10:04:11.885 INFO:tasks.workunit.client.0.smithi071.stdout:5/185: write dc/df/f19 [3327179,54858] 0 2024-09-10T10:04:11.886 INFO:tasks.workunit.client.1.smithi107.stdout:5/318: mknod de/d20/d2b/d4b/d5e/c69 0 2024-09-10T10:04:11.886 INFO:tasks.workunit.client.0.smithi071.stdout:6/176: write d4/da/f13 [2333081,81888] 0 2024-09-10T10:04:11.886 INFO:tasks.workunit.client.1.smithi107.stdout:5/319: fdatasync de/f2d 0 2024-09-10T10:04:11.888 INFO:tasks.workunit.client.0.smithi071.stdout:3/182: creat d3/d20/f3f x:0 0 0 2024-09-10T10:04:11.888 INFO:tasks.workunit.client.0.smithi071.stdout:6/177: creat d4/f38 x:0 0 0 2024-09-10T10:04:11.889 INFO:tasks.workunit.client.0.smithi071.stdout:6/178: write d4/f27 [595857,34590] 0 2024-09-10T10:04:11.890 INFO:tasks.workunit.client.0.smithi071.stdout:6/179: dread - d4/f38 zero size 2024-09-10T10:04:11.890 INFO:tasks.workunit.client.1.smithi107.stdout:5/320: creat de/d20/f6a x:0 0 0 2024-09-10T10:04:11.891 INFO:tasks.workunit.client.0.smithi071.stdout:5/186: rename dc/df/d17/d22/c23 to dc/c40 0 2024-09-10T10:04:11.893 INFO:tasks.workunit.client.1.smithi107.stdout:6/360: dwrite d0/d3d/d14/d17/f36 [0,4194304] 0 2024-09-10T10:04:11.893 INFO:tasks.workunit.client.0.smithi071.stdout:6/180: mknod d4/da/c39 0 2024-09-10T10:04:11.894 INFO:tasks.workunit.client.1.smithi107.stdout:6/361: dread - d0/d3d/d14/d17/d24/f6f zero size 2024-09-10T10:04:11.894 INFO:tasks.workunit.client.0.smithi071.stdout:3/183: symlink d3/d20/d39/l40 0 2024-09-10T10:04:11.896 INFO:tasks.workunit.client.1.smithi107.stdout:6/362: creat d0/d3d/d14/d42/f7a x:0 0 0 2024-09-10T10:04:11.898 INFO:tasks.workunit.client.1.smithi107.stdout:5/321: rename de/d20/c24 to de/d4a/d4e/c6b 0 2024-09-10T10:04:11.898 INFO:tasks.workunit.client.1.smithi107.stdout:6/363: fdatasync d0/d3d/d14/d21/f22 0 2024-09-10T10:04:11.899 INFO:tasks.workunit.client.0.smithi071.stdout:5/187: rename dc/df/c10 to dc/df/d29/c41 0 2024-09-10T10:04:11.899 INFO:tasks.workunit.client.0.smithi071.stdout:5/188: write dc/df/f3b [1227213,46587] 0 2024-09-10T10:04:11.901 INFO:tasks.workunit.client.0.smithi071.stdout:3/184: creat d3/f41 x:0 0 0 2024-09-10T10:04:11.901 INFO:tasks.workunit.client.1.smithi107.stdout:5/322: mknod de/d20/d2b/d4b/d5e/c6c 0 2024-09-10T10:04:11.901 INFO:tasks.workunit.client.1.smithi107.stdout:6/364: write d0/d3d/d14/f1f [1430145,76773] 0 2024-09-10T10:04:11.903 INFO:tasks.workunit.client.1.smithi107.stdout:5/323: mkdir de/d4a/d5c/d6d 0 2024-09-10T10:04:11.904 INFO:tasks.workunit.client.1.smithi107.stdout:6/365: creat d0/d76/f7b x:0 0 0 2024-09-10T10:04:11.904 INFO:tasks.workunit.client.0.smithi071.stdout:3/185: unlink d3/d10/l19 0 2024-09-10T10:04:11.905 INFO:tasks.workunit.client.1.smithi107.stdout:6/366: chown d0/d3d/d14/d42/f7a 612608 1 2024-09-10T10:04:11.906 INFO:tasks.workunit.client.0.smithi071.stdout:3/186: mkdir d3/d20/d30/d42 0 2024-09-10T10:04:11.907 INFO:tasks.workunit.client.1.smithi107.stdout:5/324: rename de/d20/d3d/f42 to de/d20/d65/f6e 0 2024-09-10T10:04:11.908 INFO:tasks.workunit.client.0.smithi071.stdout:3/187: symlink d3/d15/d34/l43 0 2024-09-10T10:04:11.910 INFO:tasks.workunit.client.1.smithi107.stdout:6/367: symlink d0/d3d/d14/l7c 0 2024-09-10T10:04:11.912 INFO:tasks.workunit.client.0.smithi071.stdout:6/181: write f3 [2838412,71257] 0 2024-09-10T10:04:11.912 INFO:tasks.workunit.client.1.smithi107.stdout:5/325: link f1 de/d20/d3d/f6f 0 2024-09-10T10:04:11.913 INFO:tasks.workunit.client.0.smithi071.stdout:9/323: dwrite d0/db/ff [0,4194304] 0 2024-09-10T10:04:11.915 INFO:tasks.workunit.client.0.smithi071.stdout:6/182: mkdir d4/da/df/d2e/d3a 0 2024-09-10T10:04:11.917 INFO:tasks.workunit.client.1.smithi107.stdout:6/368: mkdir d0/d3d/d14/d17/d49/d55/d73/d7d 0 2024-09-10T10:04:11.917 INFO:tasks.workunit.client.0.smithi071.stdout:6/183: truncate d4/da/df/f2c 73512 0 2024-09-10T10:04:11.918 INFO:tasks.workunit.client.1.smithi107.stdout:6/369: dread - d0/d3d/d14/d17/d49/d55/d73/f75 zero size 2024-09-10T10:04:11.918 INFO:tasks.workunit.client.1.smithi107.stdout:5/326: creat de/d4a/d4e/f70 x:0 0 0 2024-09-10T10:04:11.921 INFO:tasks.workunit.client.0.smithi071.stdout:9/324: dwrite d0/f6 [0,4194304] 0 2024-09-10T10:04:11.921 INFO:tasks.workunit.client.1.smithi107.stdout:5/327: creat de/d20/d2b/d4b/f71 x:0 0 0 2024-09-10T10:04:11.922 INFO:tasks.workunit.client.0.smithi071.stdout:9/325: chown d0/db/f18 6695759 1 2024-09-10T10:04:11.922 INFO:tasks.workunit.client.1.smithi107.stdout:6/370: dread d0/d3d/f41 [0,4194304] 0 2024-09-10T10:04:11.923 INFO:tasks.workunit.client.0.smithi071.stdout:6/184: link d4/da/df/f2c d4/da/df/d2e/f3b 0 2024-09-10T10:04:11.924 INFO:tasks.workunit.client.1.smithi107.stdout:5/328: fdatasync de/d20/d65/f6e 0 2024-09-10T10:04:11.925 INFO:tasks.workunit.client.0.smithi071.stdout:6/185: symlink d4/d20/l3c 0 2024-09-10T10:04:11.926 INFO:tasks.workunit.client.0.smithi071.stdout:6/186: write d4/f19 [1067217,79543] 0 2024-09-10T10:04:11.927 INFO:tasks.workunit.client.0.smithi071.stdout:9/326: getdents d0/db/d1b/d1d/d30/d54/d27 0 2024-09-10T10:04:11.929 INFO:tasks.workunit.client.0.smithi071.stdout:6/187: creat d4/d1c/f3d x:0 0 0 2024-09-10T10:04:11.929 INFO:tasks.workunit.client.0.smithi071.stdout:6/188: dread - d4/da/f33 zero size 2024-09-10T10:04:11.930 INFO:tasks.workunit.client.1.smithi107.stdout:5/329: rename de/d20/l4d to de/d20/d2b/d4b/l72 0 2024-09-10T10:04:11.930 INFO:tasks.workunit.client.0.smithi071.stdout:9/327: creat d0/db/d1b/d1d/d5b/f70 x:0 0 0 2024-09-10T10:04:11.930 INFO:tasks.workunit.client.0.smithi071.stdout:6/189: truncate d4/f28 1499270 0 2024-09-10T10:04:11.932 INFO:tasks.workunit.client.1.smithi107.stdout:5/330: creat de/d4a/d5c/d6d/f73 x:0 0 0 2024-09-10T10:04:11.934 INFO:tasks.workunit.client.1.smithi107.stdout:5/331: truncate de/d20/d2b/f60 5187941 0 2024-09-10T10:04:11.935 INFO:tasks.workunit.client.1.smithi107.stdout:5/332: mknod de/d20/d2b/d4b/c74 0 2024-09-10T10:04:11.938 INFO:tasks.workunit.client.0.smithi071.stdout:6/190: dwrite d4/da/df/f2c [0,4194304] 0 2024-09-10T10:04:11.941 INFO:tasks.workunit.client.0.smithi071.stdout:6/191: write d4/da/fb [5601416,43145] 0 2024-09-10T10:04:11.944 INFO:tasks.workunit.client.1.smithi107.stdout:6/371: getdents d0/d3d/d14 0 2024-09-10T10:04:11.944 INFO:tasks.workunit.client.1.smithi107.stdout:5/333: truncate f1 2200880 0 2024-09-10T10:04:11.948 INFO:tasks.workunit.client.1.smithi107.stdout:5/334: symlink de/d20/d2b/d4b/d5e/l75 0 2024-09-10T10:04:11.951 INFO:tasks.workunit.client.1.smithi107.stdout:6/372: dwrite d0/d3d/d14/d42/f7a [0,4194304] 0 2024-09-10T10:04:11.955 INFO:tasks.workunit.client.1.smithi107.stdout:6/373: creat d0/d3d/d14/d17/d49/f7e x:0 0 0 2024-09-10T10:04:11.956 INFO:tasks.workunit.client.1.smithi107.stdout:5/335: link de/d20/c3c de/c76 0 2024-09-10T10:04:11.957 INFO:tasks.workunit.client.0.smithi071.stdout:9/328: dread d0/db/d1b/d1d/f3a [0,4194304] 0 2024-09-10T10:04:11.957 INFO:tasks.workunit.client.1.smithi107.stdout:6/374: write d0/d3d/d14/d21/f23 [655109,80550] 0 2024-09-10T10:04:11.959 INFO:tasks.workunit.client.1.smithi107.stdout:6/375: creat d0/d3d/d14/d21/f7f x:0 0 0 2024-09-10T10:04:11.961 INFO:tasks.workunit.client.0.smithi071.stdout:9/329: rename d0/c19 to d0/db/d1b/d1d/d5b/c71 0 2024-09-10T10:04:11.961 INFO:tasks.workunit.client.1.smithi107.stdout:6/376: fsync d0/d3d/d14/d21/f5f 0 2024-09-10T10:04:11.962 INFO:tasks.workunit.client.0.smithi071.stdout:9/330: mkdir d0/d3b/d72 0 2024-09-10T10:04:11.964 INFO:tasks.workunit.client.0.smithi071.stdout:9/331: mknod d0/d3b/d5c/d6a/c73 0 2024-09-10T10:04:11.964 INFO:tasks.workunit.client.1.smithi107.stdout:6/377: link d0/f13 d0/d76/f80 0 2024-09-10T10:04:11.968 INFO:tasks.workunit.client.1.smithi107.stdout:6/378: rename d0/d3d/d14/d21/l67 to d0/d3d/d14/d17/d24/d60/l81 0 2024-09-10T10:04:11.968 INFO:tasks.workunit.client.1.smithi107.stdout:6/379: readlink d0/d3d/d14/l63 0 2024-09-10T10:04:11.971 INFO:tasks.workunit.client.1.smithi107.stdout:6/380: link d0/d3d/d14/d17/d49/f5a d0/d3d/d14/d17/d49/d55/d73/f82 0 2024-09-10T10:04:11.973 INFO:tasks.workunit.client.1.smithi107.stdout:6/381: mkdir d0/d3d/d14/d21/d83 0 2024-09-10T10:04:11.976 INFO:tasks.workunit.client.1.smithi107.stdout:6/382: creat d0/d3d/d14/d17/d49/d55/d56/f84 x:0 0 0 2024-09-10T10:04:11.976 INFO:tasks.workunit.client.1.smithi107.stdout:5/336: dread de/d20/d2b/f3e [0,4194304] 0 2024-09-10T10:04:11.977 INFO:tasks.workunit.client.1.smithi107.stdout:5/337: dread de/f1f [0,4194304] 0 2024-09-10T10:04:11.979 INFO:tasks.workunit.client.1.smithi107.stdout:5/338: chown de/c36 25747704 1 2024-09-10T10:04:11.981 INFO:tasks.workunit.client.0.smithi071.stdout:9/332: dread d0/db/d1b/d1d/f1f [0,4194304] 0 2024-09-10T10:04:11.981 INFO:tasks.workunit.client.1.smithi107.stdout:5/339: mknod de/d20/d2b/d4b/c77 0 2024-09-10T10:04:11.984 INFO:tasks.workunit.client.1.smithi107.stdout:6/383: truncate d0/d3d/d14/d17/f3b 1155720 0 2024-09-10T10:04:11.985 INFO:tasks.workunit.client.0.smithi071.stdout:9/333: dread d0/f2e [0,4194304] 0 2024-09-10T10:04:11.986 INFO:tasks.workunit.client.0.smithi071.stdout:9/334: stat d0/db/d20/d21 0 2024-09-10T10:04:11.987 INFO:tasks.workunit.client.1.smithi107.stdout:5/340: dwrite de/d4a/d4e/f70 [0,4194304] 0 2024-09-10T10:04:11.989 INFO:tasks.workunit.client.1.smithi107.stdout:6/384: creat d0/d3d/d14/d17/d49/d55/d73/d7d/f85 x:0 0 0 2024-09-10T10:04:11.989 INFO:tasks.workunit.client.1.smithi107.stdout:5/341: mknod de/d4a/d4e/c78 0 2024-09-10T10:04:11.990 INFO:tasks.workunit.client.0.smithi071.stdout:9/335: rename d0/db/d1b/d1d/d30/d54/f2d to d0/d3b/d5c/f74 0 2024-09-10T10:04:11.992 INFO:tasks.workunit.client.1.smithi107.stdout:6/385: creat d0/d3d/d14/d21/d83/f86 x:0 0 0 2024-09-10T10:04:11.996 INFO:tasks.workunit.client.1.smithi107.stdout:6/386: stat d0/d3d/d14/d17/d24/d60/l81 0 2024-09-10T10:04:11.996 INFO:tasks.workunit.client.1.smithi107.stdout:5/342: dwrite de/d20/f5d [0,4194304] 0 2024-09-10T10:04:11.996 INFO:tasks.workunit.client.1.smithi107.stdout:6/387: readlink d0/l37 0 2024-09-10T10:04:11.997 INFO:tasks.workunit.client.1.smithi107.stdout:5/343: chown de/d20/f5d 4 1 2024-09-10T10:04:11.998 INFO:tasks.workunit.client.1.smithi107.stdout:5/344: write de/d20/d2b/d4b/f58 [1103929,17341] 0 2024-09-10T10:04:12.000 INFO:tasks.workunit.client.1.smithi107.stdout:5/345: write de/f25 [773602,37807] 0 2024-09-10T10:04:12.000 INFO:tasks.workunit.client.1.smithi107.stdout:6/388: mknod d0/d3d/d14/c87 0 2024-09-10T10:04:12.003 INFO:tasks.workunit.client.1.smithi107.stdout:6/389: write d0/d3d/d14/d21/f33 [486344,128508] 0 2024-09-10T10:04:12.003 INFO:tasks.workunit.client.1.smithi107.stdout:5/346: mkdir de/d20/d65/d79 0 2024-09-10T10:04:12.008 INFO:tasks.workunit.client.1.smithi107.stdout:6/390: dwrite d0/f2c [4194304,4194304] 0 2024-09-10T10:04:12.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:11 smithi071 ceph-mon[27559]: pgmap v256: 65 pgs: 65 active+clean; 697 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 7.4 MiB/s rd, 78 MiB/s wr, 341 op/s 2024-09-10T10:04:12.091 INFO:tasks.workunit.client.0.smithi071.stdout:2/137: sync 2024-09-10T10:04:12.101 INFO:tasks.workunit.client.0.smithi071.stdout:2/138: dwrite d8/f10 [0,4194304] 0 2024-09-10T10:04:12.102 INFO:tasks.workunit.client.0.smithi071.stdout:2/139: rmdir d8/d13 39 2024-09-10T10:04:12.103 INFO:tasks.workunit.client.0.smithi071.stdout:2/140: fsync d8/fe 0 2024-09-10T10:04:12.103 INFO:tasks.workunit.client.0.smithi071.stdout:2/141: readlink d8/l12 0 2024-09-10T10:04:12.105 INFO:tasks.workunit.client.0.smithi071.stdout:2/142: unlink l7 0 2024-09-10T10:04:12.106 INFO:tasks.workunit.client.0.smithi071.stdout:2/143: stat d8/ca 0 2024-09-10T10:04:12.109 INFO:tasks.workunit.client.1.smithi107.stdout:5/347: dread de/d20/d2b/d4b/f58 [0,4194304] 0 2024-09-10T10:04:12.112 INFO:tasks.workunit.client.0.smithi071.stdout:2/144: truncate d8/f10 2086573 0 2024-09-10T10:04:12.112 INFO:tasks.workunit.client.1.smithi107.stdout:5/348: readlink de/l19 0 2024-09-10T10:04:12.113 INFO:tasks.workunit.client.1.smithi107.stdout:5/349: write de/f5b [1148429,102958] 0 2024-09-10T10:04:12.114 INFO:tasks.workunit.client.1.smithi107.stdout:6/391: fdatasync d0/d3d/d14/d17/d49/d55/d73/f82 0 2024-09-10T10:04:12.115 INFO:tasks.workunit.client.0.smithi071.stdout:2/145: mknod d8/d13/c23 0 2024-09-10T10:04:12.115 INFO:tasks.workunit.client.1.smithi107.stdout:5/350: write de/d4a/f53 [675501,38477] 0 2024-09-10T10:04:12.116 INFO:tasks.workunit.client.0.smithi071.stdout:2/146: dread d8/fb [0,4194304] 0 2024-09-10T10:04:12.118 INFO:tasks.workunit.client.0.smithi071.stdout:2/147: mkdir d8/d24 0 2024-09-10T10:04:12.119 INFO:tasks.workunit.client.0.smithi071.stdout:2/148: stat d8/c1e 0 2024-09-10T10:04:12.120 INFO:tasks.workunit.client.0.smithi071.stdout:2/149: write f2 [4977917,45940] 0 2024-09-10T10:04:12.121 INFO:tasks.workunit.client.1.smithi107.stdout:6/392: rename d0/d3d/d14/d17/d49/d55/d73/d7d to d0/d3d/d14/d42/d88 0 2024-09-10T10:04:12.121 INFO:tasks.workunit.client.1.smithi107.stdout:5/351: dwrite de/f48 [0,4194304] 0 2024-09-10T10:04:12.122 INFO:tasks.workunit.client.0.smithi071.stdout:2/150: creat d8/d13/f25 x:0 0 0 2024-09-10T10:04:12.122 INFO:tasks.workunit.client.0.smithi071.stdout:2/151: chown d8/f20 5286 1 2024-09-10T10:04:12.124 INFO:tasks.workunit.client.1.smithi107.stdout:6/393: symlink d0/d3d/d14/d17/d4b/l89 0 2024-09-10T10:04:12.125 INFO:tasks.workunit.client.1.smithi107.stdout:5/352: mknod de/d20/d2b/d4b/c7a 0 2024-09-10T10:04:12.126 INFO:tasks.workunit.client.1.smithi107.stdout:6/394: mkdir d0/d3d/d14/d21/d8a 0 2024-09-10T10:04:12.128 INFO:tasks.workunit.client.1.smithi107.stdout:5/353: link de/d20/d2b/d4b/c77 de/d20/d2b/c7b 0 2024-09-10T10:04:12.131 INFO:tasks.workunit.client.0.smithi071.stdout:2/152: getdents d8 0 2024-09-10T10:04:12.131 INFO:tasks.workunit.client.0.smithi071.stdout:2/153: stat d8/l12 0 2024-09-10T10:04:12.132 INFO:tasks.workunit.client.0.smithi071.stdout:2/154: rmdir d8/d13 39 2024-09-10T10:04:12.132 INFO:tasks.workunit.client.0.smithi071.stdout:2/155: readlink l4 0 2024-09-10T10:04:12.134 INFO:tasks.workunit.client.0.smithi071.stdout:2/156: truncate d8/fc 549534 0 2024-09-10T10:04:12.135 INFO:tasks.workunit.client.1.smithi107.stdout:5/354: dwrite de/d20/d2b/f39 [0,4194304] 0 2024-09-10T10:04:12.137 INFO:tasks.workunit.client.0.smithi071.stdout:2/157: creat d8/f26 x:0 0 0 2024-09-10T10:04:12.139 INFO:tasks.workunit.client.0.smithi071.stdout:2/158: fsync d8/fb 0 2024-09-10T10:04:12.141 INFO:tasks.workunit.client.0.smithi071.stdout:4/183: sync 2024-09-10T10:04:12.141 INFO:tasks.workunit.client.1.smithi107.stdout:5/355: creat de/d20/f7c x:0 0 0 2024-09-10T10:04:12.142 INFO:tasks.workunit.client.0.smithi071.stdout:4/184: creat db/d15/d17/f47 x:0 0 0 2024-09-10T10:04:12.143 INFO:tasks.workunit.client.0.smithi071.stdout:2/159: mknod d8/d13/c27 0 2024-09-10T10:04:12.143 INFO:tasks.workunit.client.1.smithi107.stdout:5/356: creat de/d20/d65/d79/f7d x:0 0 0 2024-09-10T10:04:12.143 INFO:tasks.workunit.client.0.smithi071.stdout:2/160: truncate d8/f26 911353 0 2024-09-10T10:04:12.144 INFO:tasks.workunit.client.1.smithi107.stdout:5/357: chown de/d4a/d5c/d6d 4831 1 2024-09-10T10:04:12.144 INFO:tasks.workunit.client.0.smithi071.stdout:2/161: truncate d8/f26 1346476 0 2024-09-10T10:04:12.145 INFO:tasks.workunit.client.0.smithi071.stdout:4/185: rename la to db/d15/d17/d24/l48 0 2024-09-10T10:04:12.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:11 smithi107 ceph-mon[34215]: pgmap v256: 65 pgs: 65 active+clean; 697 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 7.4 MiB/s rd, 78 MiB/s wr, 341 op/s 2024-09-10T10:04:12.147 INFO:tasks.workunit.client.0.smithi071.stdout:4/186: unlink db/d15/d17/f37 0 2024-09-10T10:04:12.148 INFO:tasks.workunit.client.0.smithi071.stdout:4/187: dread - db/d15/d22/f2f zero size 2024-09-10T10:04:12.148 INFO:tasks.workunit.client.0.smithi071.stdout:2/162: creat d8/f28 x:0 0 0 2024-09-10T10:04:12.148 INFO:tasks.workunit.client.0.smithi071.stdout:4/188: chown db/d15/d22/l42 1384105 1 2024-09-10T10:04:12.150 INFO:tasks.workunit.client.1.smithi107.stdout:5/358: rename de/d20/d65 to de/d4a/d7e 0 2024-09-10T10:04:12.151 INFO:tasks.workunit.client.0.smithi071.stdout:2/163: read f2 [5193308,61208] 0 2024-09-10T10:04:12.151 INFO:tasks.workunit.client.1.smithi107.stdout:5/359: read de/f25 [478999,21588] 0 2024-09-10T10:04:12.152 INFO:tasks.workunit.client.1.smithi107.stdout:5/360: chown de/d20/d2b/d4b/d5e/c6c 14 1 2024-09-10T10:04:12.153 INFO:tasks.workunit.client.0.smithi071.stdout:2/164: stat d8/c1e 0 2024-09-10T10:04:12.153 INFO:tasks.workunit.client.0.smithi071.stdout:2/165: fdatasync d8/fb 0 2024-09-10T10:04:12.154 INFO:tasks.workunit.client.1.smithi107.stdout:5/361: chown de/d20/d2b/d4b/c77 11308715 1 2024-09-10T10:04:12.154 INFO:tasks.workunit.client.0.smithi071.stdout:4/189: dwrite db/f46 [0,4194304] 0 2024-09-10T10:04:12.155 INFO:tasks.workunit.client.0.smithi071.stdout:2/166: dread - d8/f28 zero size 2024-09-10T10:04:12.156 INFO:tasks.workunit.client.0.smithi071.stdout:2/167: truncate d8/f26 2007746 0 2024-09-10T10:04:12.156 INFO:tasks.workunit.client.1.smithi107.stdout:5/362: rmdir de/d4a/d4e 39 2024-09-10T10:04:12.157 INFO:tasks.workunit.client.0.smithi071.stdout:2/168: dread - d8/d13/f1c zero size 2024-09-10T10:04:12.160 INFO:tasks.workunit.client.1.smithi107.stdout:5/363: mknod de/c7f 0 2024-09-10T10:04:12.161 INFO:tasks.workunit.client.0.smithi071.stdout:4/190: dwrite db/d1d/f36 [0,4194304] 0 2024-09-10T10:04:12.162 INFO:tasks.workunit.client.0.smithi071.stdout:4/191: dread - db/d15/d17/f3f zero size 2024-09-10T10:04:12.163 INFO:tasks.workunit.client.0.smithi071.stdout:2/169: truncate d8/f26 1315809 0 2024-09-10T10:04:12.165 INFO:tasks.workunit.client.0.smithi071.stdout:2/170: write d8/d13/f1c [717688,125911] 0 2024-09-10T10:04:12.165 INFO:tasks.workunit.client.1.smithi107.stdout:5/364: creat de/d20/f80 x:0 0 0 2024-09-10T10:04:12.165 INFO:tasks.workunit.client.0.smithi071.stdout:4/192: creat db/d15/d17/d24/f49 x:0 0 0 2024-09-10T10:04:12.169 INFO:tasks.workunit.client.0.smithi071.stdout:2/171: getdents d8/d24 0 2024-09-10T10:04:12.172 INFO:tasks.workunit.client.1.smithi107.stdout:5/365: dread de/d41/f46 [0,4194304] 0 2024-09-10T10:04:12.172 INFO:tasks.workunit.client.0.smithi071.stdout:2/172: chown d8/fe 79 1 2024-09-10T10:04:12.173 INFO:tasks.workunit.client.1.smithi107.stdout:5/366: creat de/d4a/f81 x:0 0 0 2024-09-10T10:04:12.176 INFO:tasks.workunit.client.1.smithi107.stdout:5/367: mknod de/d4a/c82 0 2024-09-10T10:04:12.176 INFO:tasks.workunit.client.0.smithi071.stdout:2/173: rename d8/c1b to d8/d24/c29 0 2024-09-10T10:04:12.182 INFO:tasks.workunit.client.0.smithi071.stdout:2/174: dwrite d8/f1a [0,4194304] 0 2024-09-10T10:04:12.183 INFO:tasks.workunit.client.1.smithi107.stdout:5/368: truncate de/f16 3406559 0 2024-09-10T10:04:12.183 INFO:tasks.workunit.client.0.smithi071.stdout:2/175: chown d8/d13/c23 785 1 2024-09-10T10:04:12.188 INFO:tasks.workunit.client.0.smithi071.stdout:2/176: rename d8/d13/c1d to d8/c2a 0 2024-09-10T10:04:12.191 INFO:tasks.workunit.client.0.smithi071.stdout:4/193: dread db/d15/d17/d24/f2b [0,4194304] 0 2024-09-10T10:04:12.192 INFO:tasks.workunit.client.0.smithi071.stdout:2/177: dread d8/d13/f15 [0,4194304] 0 2024-09-10T10:04:12.194 INFO:tasks.workunit.client.0.smithi071.stdout:2/178: creat d8/d13/f2b x:0 0 0 2024-09-10T10:04:12.196 INFO:tasks.workunit.client.0.smithi071.stdout:2/179: write d8/f20 [667509,75806] 0 2024-09-10T10:04:12.198 INFO:tasks.workunit.client.0.smithi071.stdout:4/194: dwrite db/d15/d26/f3c [0,4194304] 0 2024-09-10T10:04:12.201 INFO:tasks.workunit.client.0.smithi071.stdout:4/195: creat db/d15/d22/f4a x:0 0 0 2024-09-10T10:04:12.203 INFO:tasks.workunit.client.0.smithi071.stdout:4/196: mkdir db/d15/d4b 0 2024-09-10T10:04:12.204 INFO:tasks.workunit.client.0.smithi071.stdout:4/197: write db/d15/d17/f1f [89288,101270] 0 2024-09-10T10:04:12.210 INFO:tasks.workunit.client.0.smithi071.stdout:4/198: dwrite db/d1d/f23 [0,4194304] 0 2024-09-10T10:04:12.212 INFO:tasks.workunit.client.1.smithi107.stdout:5/369: dread de/d20/f26 [0,4194304] 0 2024-09-10T10:04:12.213 INFO:tasks.workunit.client.0.smithi071.stdout:4/199: symlink db/d15/d26/d43/l4c 0 2024-09-10T10:04:12.215 INFO:tasks.workunit.client.0.smithi071.stdout:4/200: write db/d15/d17/d24/f25 [628849,104143] 0 2024-09-10T10:04:12.220 INFO:tasks.workunit.client.1.smithi107.stdout:5/370: dwrite de/f28 [0,4194304] 0 2024-09-10T10:04:12.221 INFO:tasks.workunit.client.0.smithi071.stdout:4/201: dwrite db/d1d/f38 [0,4194304] 0 2024-09-10T10:04:12.228 INFO:tasks.workunit.client.1.smithi107.stdout:5/371: dwrite de/d20/d2b/f60 [0,4194304] 0 2024-09-10T10:04:12.229 INFO:tasks.workunit.client.1.smithi107.stdout:5/372: chown de/d20/d2b 64 1 2024-09-10T10:04:12.230 INFO:tasks.workunit.client.0.smithi071.stdout:4/202: rename db/d15/d22 to db/d15/d26/d43/d4d 0 2024-09-10T10:04:12.232 INFO:tasks.workunit.client.0.smithi071.stdout:4/203: mkdir db/d15/d17/d4e 0 2024-09-10T10:04:12.235 INFO:tasks.workunit.client.0.smithi071.stdout:4/204: creat db/d15/d4b/f4f x:0 0 0 2024-09-10T10:04:12.238 INFO:tasks.workunit.client.0.smithi071.stdout:4/205: truncate db/d15/d17/f18 551457 0 2024-09-10T10:04:12.240 INFO:tasks.workunit.client.0.smithi071.stdout:4/206: creat db/d15/d26/d43/f50 x:0 0 0 2024-09-10T10:04:12.242 INFO:tasks.workunit.client.0.smithi071.stdout:4/207: write db/d15/d17/d24/f2b [1460463,129340] 0 2024-09-10T10:04:12.243 INFO:tasks.workunit.client.0.smithi071.stdout:4/208: mkdir db/d51 0 2024-09-10T10:04:12.254 INFO:tasks.workunit.client.1.smithi107.stdout:5/373: dwrite de/d20/d3d/f6f [0,4194304] 0 2024-09-10T10:04:12.258 INFO:tasks.workunit.client.1.smithi107.stdout:5/374: unlink de/d41/c61 0 2024-09-10T10:04:12.259 INFO:tasks.workunit.client.1.smithi107.stdout:5/375: write de/d4a/d5c/d6d/f73 [632240,109313] 0 2024-09-10T10:04:12.259 INFO:tasks.workunit.client.1.smithi107.stdout:5/376: readlink de/d20/d2b/d4b/l4f 0 2024-09-10T10:04:12.265 INFO:tasks.workunit.client.1.smithi107.stdout:5/377: rename de/d20/d2b/d4b/l4f to de/d4a/d4e/l83 0 2024-09-10T10:04:12.267 INFO:tasks.workunit.client.1.smithi107.stdout:5/378: symlink de/l84 0 2024-09-10T10:04:12.269 INFO:tasks.workunit.client.1.smithi107.stdout:5/379: unlink de/d20/c22 0 2024-09-10T10:04:12.269 INFO:tasks.workunit.client.1.smithi107.stdout:5/380: chown de/d4a/d7e/d79 5 1 2024-09-10T10:04:12.272 INFO:tasks.workunit.client.1.smithi107.stdout:5/381: dread de/f48 [0,4194304] 0 2024-09-10T10:04:12.273 INFO:tasks.workunit.client.1.smithi107.stdout:5/382: write de/d41/f46 [5131475,34748] 0 2024-09-10T10:04:12.277 INFO:tasks.workunit.client.0.smithi071.stdout:7/194: sync 2024-09-10T10:04:12.279 INFO:tasks.workunit.client.1.smithi107.stdout:5/383: dwrite de/d41/f52 [0,4194304] 0 2024-09-10T10:04:12.283 INFO:tasks.workunit.client.1.smithi107.stdout:5/384: rmdir de 39 2024-09-10T10:04:12.287 INFO:tasks.workunit.client.1.smithi107.stdout:5/385: dread de/d41/f52 [0,4194304] 0 2024-09-10T10:04:12.289 INFO:tasks.workunit.client.1.smithi107.stdout:5/386: creat de/d4a/f85 x:0 0 0 2024-09-10T10:04:12.289 INFO:tasks.workunit.client.0.smithi071.stdout:7/195: chown d9/ff 14656835 1 2024-09-10T10:04:12.291 INFO:tasks.workunit.client.0.smithi071.stdout:7/196: rmdir d9/d11 39 2024-09-10T10:04:12.293 INFO:tasks.workunit.client.1.smithi107.stdout:5/387: dread f1 [0,4194304] 0 2024-09-10T10:04:12.294 INFO:tasks.workunit.client.1.smithi107.stdout:5/388: dread - de/d4a/d7e/d79/f7d zero size 2024-09-10T10:04:12.294 INFO:tasks.workunit.client.0.smithi071.stdout:4/209: dwrite db/d15/d26/d43/d4d/f39 [0,4194304] 0 2024-09-10T10:04:12.294 INFO:tasks.workunit.client.0.smithi071.stdout:7/197: creat d9/d1a/d1d/d39/f3d x:0 0 0 2024-09-10T10:04:12.296 INFO:tasks.workunit.client.1.smithi107.stdout:5/389: mknod de/d20/c86 0 2024-09-10T10:04:12.298 INFO:tasks.workunit.client.1.smithi107.stdout:5/390: read de/f16 [2997119,100721] 0 2024-09-10T10:04:12.299 INFO:tasks.workunit.client.1.smithi107.stdout:5/391: readlink de/d4a/d4e/l62 0 2024-09-10T10:04:12.301 INFO:tasks.workunit.client.1.smithi107.stdout:5/392: mknod de/c87 0 2024-09-10T10:04:12.303 INFO:tasks.workunit.client.1.smithi107.stdout:5/393: dread de/d20/d2b/f60 [4194304,4194304] 0 2024-09-10T10:04:12.305 INFO:tasks.workunit.client.1.smithi107.stdout:5/394: creat de/d20/d3d/f88 x:0 0 0 2024-09-10T10:04:12.306 INFO:tasks.workunit.client.1.smithi107.stdout:5/395: mkdir de/d4a/d4e/d89 0 2024-09-10T10:04:12.308 INFO:tasks.workunit.client.1.smithi107.stdout:5/396: unlink de/d41/l59 0 2024-09-10T10:04:12.312 INFO:tasks.workunit.client.1.smithi107.stdout:5/397: dwrite de/d4a/d7e/f6e [0,4194304] 0 2024-09-10T10:04:12.315 INFO:tasks.workunit.client.1.smithi107.stdout:5/398: symlink de/d20/d2b/d4b/d5e/l8a 0 2024-09-10T10:04:12.316 INFO:tasks.workunit.client.1.smithi107.stdout:5/399: fsync de/f25 0 2024-09-10T10:04:12.319 INFO:tasks.workunit.client.1.smithi107.stdout:5/400: read de/f1e [2081903,7124] 0 2024-09-10T10:04:12.320 INFO:tasks.workunit.client.1.smithi107.stdout:5/401: write de/f2d [821784,43124] 0 2024-09-10T10:04:12.323 INFO:tasks.workunit.client.1.smithi107.stdout:5/402: rename de/c2e to de/d4a/d4e/d89/c8b 0 2024-09-10T10:04:12.324 INFO:tasks.workunit.client.1.smithi107.stdout:5/403: mkdir de/d20/d2b/d4b/d8c 0 2024-09-10T10:04:12.329 INFO:tasks.workunit.client.1.smithi107.stdout:5/404: dwrite de/f5b [0,4194304] 0 2024-09-10T10:04:12.329 INFO:tasks.workunit.client.1.smithi107.stdout:5/405: fsync de/d20/f7c 0 2024-09-10T10:04:12.331 INFO:tasks.workunit.client.1.smithi107.stdout:5/406: write de/f1f [2120392,55033] 0 2024-09-10T10:04:12.337 INFO:tasks.workunit.client.1.smithi107.stdout:8/207: sync 2024-09-10T10:04:12.337 INFO:tasks.workunit.client.1.smithi107.stdout:7/258: sync 2024-09-10T10:04:12.338 INFO:tasks.workunit.client.1.smithi107.stdout:5/407: dwrite de/f31 [0,4194304] 0 2024-09-10T10:04:12.343 INFO:tasks.workunit.client.1.smithi107.stdout:8/208: dread d5/d8/dc/d1a/f1f [0,4194304] 0 2024-09-10T10:04:12.344 INFO:tasks.workunit.client.1.smithi107.stdout:7/259: mknod d0/d8/dc/d2c/d47/c4e 0 2024-09-10T10:04:12.344 INFO:tasks.workunit.client.0.smithi071.stdout:4/210: symlink db/d15/l52 0 2024-09-10T10:04:12.347 INFO:tasks.workunit.client.0.smithi071.stdout:7/198: creat d9/f3e x:0 0 0 2024-09-10T10:04:12.348 INFO:tasks.workunit.client.0.smithi071.stdout:7/199: write d9/f3e [493786,86100] 0 2024-09-10T10:04:12.350 INFO:tasks.workunit.client.0.smithi071.stdout:7/200: creat d9/d15/d1f/f3f x:0 0 0 2024-09-10T10:04:12.351 INFO:tasks.workunit.client.0.smithi071.stdout:7/201: fdatasync d9/d15/d1f/f31 0 2024-09-10T10:04:12.351 INFO:tasks.workunit.client.0.smithi071.stdout:7/202: chown d9/d1a/d1d 154794359 1 2024-09-10T10:04:12.355 INFO:tasks.workunit.client.1.smithi107.stdout:8/209: truncate d5/ff 5105287 0 2024-09-10T10:04:12.356 INFO:tasks.workunit.client.0.smithi071.stdout:4/211: dread f4 [0,4194304] 0 2024-09-10T10:04:12.359 INFO:tasks.workunit.client.0.smithi071.stdout:7/203: dwrite d9/fa [0,4194304] 0 2024-09-10T10:04:12.361 INFO:tasks.workunit.client.1.smithi107.stdout:8/210: link d5/d8/l23 d5/l49 0 2024-09-10T10:04:12.361 INFO:tasks.workunit.client.0.smithi071.stdout:7/204: fsync d9/d11/f24 0 2024-09-10T10:04:12.362 INFO:tasks.workunit.client.0.smithi071.stdout:4/212: dread db/f2a [0,4194304] 0 2024-09-10T10:04:12.364 INFO:tasks.workunit.client.0.smithi071.stdout:7/205: mkdir d9/d15/d40 0 2024-09-10T10:04:12.367 INFO:tasks.workunit.client.1.smithi107.stdout:5/408: dread f9 [0,4194304] 0 2024-09-10T10:04:12.367 INFO:tasks.workunit.client.1.smithi107.stdout:7/260: dread d0/f2b [0,4194304] 0 2024-09-10T10:04:12.371 INFO:tasks.workunit.client.0.smithi071.stdout:7/206: rename d9/fb to d9/d15/f41 0 2024-09-10T10:04:12.371 INFO:tasks.workunit.client.1.smithi107.stdout:5/409: getdents de/d20/d2b/d4b/d8c 0 2024-09-10T10:04:12.373 INFO:tasks.workunit.client.0.smithi071.stdout:4/213: dread db/f1b [0,4194304] 0 2024-09-10T10:04:12.373 INFO:tasks.workunit.client.0.smithi071.stdout:7/207: creat d9/d1a/d1d/d39/f42 x:0 0 0 2024-09-10T10:04:12.376 INFO:tasks.workunit.client.1.smithi107.stdout:5/410: creat de/d4a/d4e/f8d x:0 0 0 2024-09-10T10:04:12.376 INFO:tasks.workunit.client.1.smithi107.stdout:8/211: link d5/ff d5/f4a 0 2024-09-10T10:04:12.376 INFO:tasks.workunit.client.1.smithi107.stdout:7/261: dwrite d0/d8/f13 [0,4194304] 0 2024-09-10T10:04:12.376 INFO:tasks.workunit.client.0.smithi071.stdout:7/208: symlink d9/d2c/l43 0 2024-09-10T10:04:12.377 INFO:tasks.workunit.client.1.smithi107.stdout:8/212: chown d5/d8/dc/d18 1 1 2024-09-10T10:04:12.377 INFO:tasks.workunit.client.0.smithi071.stdout:4/214: creat db/d51/f53 x:0 0 0 2024-09-10T10:04:12.378 INFO:tasks.workunit.client.1.smithi107.stdout:8/213: dread - d5/d8/dc/f16 zero size 2024-09-10T10:04:12.379 INFO:tasks.workunit.client.1.smithi107.stdout:5/411: creat de/d4a/d5c/f8e x:0 0 0 2024-09-10T10:04:12.379 INFO:tasks.workunit.client.0.smithi071.stdout:4/215: stat db/c1a 0 2024-09-10T10:04:12.382 INFO:tasks.workunit.client.0.smithi071.stdout:4/216: chown db/d15/d26/d43/d4d/l3e 4 1 2024-09-10T10:04:12.384 INFO:tasks.workunit.client.1.smithi107.stdout:7/262: dwrite d0/d8/f38 [0,4194304] 0 2024-09-10T10:04:12.386 INFO:tasks.workunit.client.0.smithi071.stdout:4/217: rename db/d15/d26/d43/d4d/l2c to db/d15/d26/d43/d4d/l54 0 2024-09-10T10:04:12.388 INFO:tasks.workunit.client.0.smithi071.stdout:4/218: creat db/f55 x:0 0 0 2024-09-10T10:04:12.389 INFO:tasks.workunit.client.1.smithi107.stdout:7/263: truncate d0/d8/dc/f1f 1920151 0 2024-09-10T10:04:12.389 INFO:tasks.workunit.client.1.smithi107.stdout:8/214: rename d5/d8/fd to d5/d8/dc/d18/f4b 0 2024-09-10T10:04:12.389 INFO:tasks.workunit.client.1.smithi107.stdout:0/254: sync 2024-09-10T10:04:12.389 INFO:tasks.workunit.client.1.smithi107.stdout:2/321: sync 2024-09-10T10:04:12.389 INFO:tasks.workunit.client.1.smithi107.stdout:3/520: sync 2024-09-10T10:04:12.389 INFO:tasks.workunit.client.1.smithi107.stdout:6/395: sync 2024-09-10T10:04:12.390 INFO:tasks.workunit.client.1.smithi107.stdout:9/340: sync 2024-09-10T10:04:12.390 INFO:tasks.workunit.client.1.smithi107.stdout:1/396: sync 2024-09-10T10:04:12.390 INFO:tasks.workunit.client.1.smithi107.stdout:4/381: sync 2024-09-10T10:04:12.392 INFO:tasks.workunit.client.0.smithi071.stdout:4/219: mknod db/d15/d17/d24/c56 0 2024-09-10T10:04:12.392 INFO:tasks.workunit.client.0.smithi071.stdout:4/220: dread - db/d15/d4b/f4f zero size 2024-09-10T10:04:12.393 INFO:tasks.workunit.client.0.smithi071.stdout:7/209: truncate f2 7378021 0 2024-09-10T10:04:12.394 INFO:tasks.workunit.client.0.smithi071.stdout:0/152: sync 2024-09-10T10:04:12.394 INFO:tasks.workunit.client.0.smithi071.stdout:7/210: write d9/d1a/f30 [410928,27039] 0 2024-09-10T10:04:12.394 INFO:tasks.workunit.client.1.smithi107.stdout:3/521: stat dc/l38 0 2024-09-10T10:04:12.395 INFO:tasks.workunit.client.1.smithi107.stdout:9/341: dread - d5/d7/d3c/d53/d57/f62 zero size 2024-09-10T10:04:12.396 INFO:tasks.workunit.client.1.smithi107.stdout:5/412: dwrite de/d20/d3d/f6f [0,4194304] 0 2024-09-10T10:04:12.396 INFO:tasks.workunit.client.1.smithi107.stdout:1/397: dread d2/f4e [0,4194304] 0 2024-09-10T10:04:12.396 INFO:tasks.workunit.client.0.smithi071.stdout:0/153: creat d11/d1e/f38 x:0 0 0 2024-09-10T10:04:12.397 INFO:tasks.workunit.client.1.smithi107.stdout:7/264: creat d0/d8/dc/f4f x:0 0 0 2024-09-10T10:04:12.399 INFO:tasks.workunit.client.0.smithi071.stdout:4/221: rename l7 to db/d15/l57 0 2024-09-10T10:04:12.400 INFO:tasks.workunit.client.0.smithi071.stdout:7/211: symlink d9/d15/d40/l44 0 2024-09-10T10:04:12.401 INFO:tasks.workunit.client.0.smithi071.stdout:4/222: creat db/d15/d4b/f58 x:0 0 0 2024-09-10T10:04:12.402 INFO:tasks.workunit.client.1.smithi107.stdout:5/413: write f1 [3134909,27903] 0 2024-09-10T10:04:12.402 INFO:tasks.workunit.client.0.smithi071.stdout:0/154: creat d11/d22/d31/f39 x:0 0 0 2024-09-10T10:04:12.403 INFO:tasks.workunit.client.0.smithi071.stdout:0/155: chown d11 93276793 1 2024-09-10T10:04:12.403 INFO:tasks.workunit.client.0.smithi071.stdout:4/223: symlink db/d51/l59 0 2024-09-10T10:04:12.405 INFO:tasks.workunit.client.1.smithi107.stdout:6/396: truncate d0/d3d/d14/d17/d49/d55/d56/f84 33319 0 2024-09-10T10:04:12.406 INFO:tasks.workunit.client.1.smithi107.stdout:0/255: link d6/d14/l2a d6/d14/l48 0 2024-09-10T10:04:12.406 INFO:tasks.workunit.client.1.smithi107.stdout:2/322: dwrite d3/da/df/f45 [0,4194304] 0 2024-09-10T10:04:12.408 INFO:tasks.workunit.client.1.smithi107.stdout:8/215: dread d5/d8/f32 [0,4194304] 0 2024-09-10T10:04:12.409 INFO:tasks.workunit.client.1.smithi107.stdout:3/522: getdents dc/dd/d42/d55 0 2024-09-10T10:04:12.409 INFO:tasks.workunit.client.0.smithi071.stdout:7/212: dwrite d9/fe [0,4194304] 0 2024-09-10T10:04:12.410 INFO:tasks.workunit.client.1.smithi107.stdout:8/216: read - d5/d8/dc/d1a/f46 zero size 2024-09-10T10:04:12.413 INFO:tasks.workunit.client.1.smithi107.stdout:8/217: readlink d5/d8/d2a/l2c 0 2024-09-10T10:04:12.413 INFO:tasks.workunit.client.1.smithi107.stdout:2/323: mknod d3/c69 0 2024-09-10T10:04:12.414 INFO:tasks.workunit.client.1.smithi107.stdout:7/265: link d0/d8/d9/c48 d0/d8/d9/d3d/c50 0 2024-09-10T10:04:12.417 INFO:tasks.workunit.client.1.smithi107.stdout:7/266: write d0/d8/f38 [319501,129534] 0 2024-09-10T10:04:12.417 INFO:tasks.workunit.client.0.smithi071.stdout:0/156: rmdir d11 39 2024-09-10T10:04:12.418 INFO:tasks.workunit.client.1.smithi107.stdout:5/414: getdents de/d4a/d4e 0 2024-09-10T10:04:12.418 INFO:tasks.workunit.client.0.smithi071.stdout:7/213: dwrite d9/f34 [0,4194304] 0 2024-09-10T10:04:12.420 INFO:tasks.workunit.client.1.smithi107.stdout:3/523: mkdir dc/dd/d45/d26/d41/d44/d35/dab 0 2024-09-10T10:04:12.420 INFO:tasks.workunit.client.0.smithi071.stdout:7/214: write d9/d1a/f30 [80328,53491] 0 2024-09-10T10:04:12.421 INFO:tasks.workunit.client.1.smithi107.stdout:3/524: chown dc/dd/f27 1 1 2024-09-10T10:04:12.421 INFO:tasks.workunit.client.0.smithi071.stdout:0/157: stat d11/l2f 0 2024-09-10T10:04:12.422 INFO:tasks.workunit.client.1.smithi107.stdout:4/382: dread d0/d40/d75/f39 [0,4194304] 0 2024-09-10T10:04:12.423 INFO:tasks.workunit.client.1.smithi107.stdout:5/415: rmdir de 39 2024-09-10T10:04:12.423 INFO:tasks.workunit.client.1.smithi107.stdout:7/267: rmdir d0/d8/d9 39 2024-09-10T10:04:12.424 INFO:tasks.workunit.client.1.smithi107.stdout:3/525: write dc/dd/d45/d26/d59/f90 [413056,80325] 0 2024-09-10T10:04:12.424 INFO:tasks.workunit.client.1.smithi107.stdout:8/218: mknod d5/d8/d2a/d35/c4c 0 2024-09-10T10:04:12.425 INFO:tasks.workunit.client.1.smithi107.stdout:4/383: chown d0/d1f/d20/f30 34051939 1 2024-09-10T10:04:12.425 INFO:tasks.workunit.client.0.smithi071.stdout:0/158: mknod d11/d22/c3a 0 2024-09-10T10:04:12.426 INFO:tasks.workunit.client.0.smithi071.stdout:7/215: mknod d9/c45 0 2024-09-10T10:04:12.427 INFO:tasks.workunit.client.1.smithi107.stdout:2/324: dread d3/f11 [0,4194304] 0 2024-09-10T10:04:12.428 INFO:tasks.workunit.client.1.smithi107.stdout:8/219: truncate d5/f38 26357 0 2024-09-10T10:04:12.428 INFO:tasks.workunit.client.1.smithi107.stdout:7/268: symlink d0/d20/l51 0 2024-09-10T10:04:12.429 INFO:tasks.workunit.client.1.smithi107.stdout:7/269: fsync d0/f7 0 2024-09-10T10:04:12.430 INFO:tasks.workunit.client.1.smithi107.stdout:3/526: write dc/dd/d45/d26/d59/f67 [651692,129022] 0 2024-09-10T10:04:12.430 INFO:tasks.workunit.client.1.smithi107.stdout:4/384: mkdir d0/d40/d6d/d8a 0 2024-09-10T10:04:12.431 INFO:tasks.workunit.client.0.smithi071.stdout:4/224: dread db/f12 [0,4194304] 0 2024-09-10T10:04:12.431 INFO:tasks.workunit.client.0.smithi071.stdout:0/159: rename d11/l13 to d11/d1e/l3b 0 2024-09-10T10:04:12.435 INFO:tasks.workunit.client.0.smithi071.stdout:0/160: creat d11/d30/f3c x:0 0 0 2024-09-10T10:04:12.435 INFO:tasks.workunit.client.1.smithi107.stdout:5/416: symlink de/d20/d2b/l8f 0 2024-09-10T10:04:12.435 INFO:tasks.workunit.client.1.smithi107.stdout:9/342: truncate d5/f6 816533 0 2024-09-10T10:04:12.436 INFO:tasks.workunit.client.0.smithi071.stdout:7/216: dwrite d9/f34 [0,4194304] 0 2024-09-10T10:04:12.436 INFO:tasks.workunit.client.1.smithi107.stdout:5/417: read de/f28 [1351841,112630] 0 2024-09-10T10:04:12.437 INFO:tasks.workunit.client.0.smithi071.stdout:7/217: read d9/d1a/d1d/f1e [248738,67637] 0 2024-09-10T10:04:12.437 INFO:tasks.workunit.client.1.smithi107.stdout:8/220: write d5/d8/f32 [2073759,10870] 0 2024-09-10T10:04:12.438 INFO:tasks.workunit.client.0.smithi071.stdout:4/225: rename db/d51 to db/d15/d17/d4e/d5a 0 2024-09-10T10:04:12.438 INFO:tasks.workunit.client.1.smithi107.stdout:5/418: write de/d4a/f63 [716616,65481] 0 2024-09-10T10:04:12.438 INFO:tasks.workunit.client.1.smithi107.stdout:7/270: mknod d0/d20/d35/c52 0 2024-09-10T10:04:12.439 INFO:tasks.workunit.client.0.smithi071.stdout:0/161: truncate f8 791064 0 2024-09-10T10:04:12.440 INFO:tasks.workunit.client.1.smithi107.stdout:5/419: chown de/d41/c49 116 1 2024-09-10T10:04:12.440 INFO:tasks.workunit.client.1.smithi107.stdout:2/325: unlink d3/l1b 0 2024-09-10T10:04:12.441 INFO:tasks.workunit.client.0.smithi071.stdout:7/218: mknod d9/d11/c46 0 2024-09-10T10:04:12.442 INFO:tasks.workunit.client.1.smithi107.stdout:4/385: dread d0/d40/f41 [0,4194304] 0 2024-09-10T10:04:12.442 INFO:tasks.workunit.client.0.smithi071.stdout:0/162: symlink d11/d22/d31/l3d 0 2024-09-10T10:04:12.444 INFO:tasks.workunit.client.1.smithi107.stdout:3/527: rename dc/dd/d45/d26/d99 to dc/dd/d20/d23/d39/dac 0 2024-09-10T10:04:12.444 INFO:tasks.workunit.client.0.smithi071.stdout:0/163: dread - d11/d22/d31/f39 zero size 2024-09-10T10:04:12.445 INFO:tasks.workunit.client.0.smithi071.stdout:7/219: symlink d9/d15/l47 0 2024-09-10T10:04:12.446 INFO:tasks.workunit.client.1.smithi107.stdout:3/528: fsync dc/dd/d20/f60 0 2024-09-10T10:04:12.446 INFO:tasks.workunit.client.1.smithi107.stdout:8/221: creat d5/d8/dc/d1a/f4d x:0 0 0 2024-09-10T10:04:12.447 INFO:tasks.workunit.client.0.smithi071.stdout:0/164: chown d11/d30/f3c 72 1 2024-09-10T10:04:12.449 INFO:tasks.workunit.client.1.smithi107.stdout:2/326: symlink d3/da/d66/l6a 0 2024-09-10T10:04:12.449 INFO:tasks.workunit.client.0.smithi071.stdout:4/226: dwrite db/f1b [0,4194304] 0 2024-09-10T10:04:12.449 INFO:tasks.workunit.client.1.smithi107.stdout:1/398: dread d2/d12/f3e [0,4194304] 0 2024-09-10T10:04:12.450 INFO:tasks.workunit.client.0.smithi071.stdout:7/220: symlink d9/d15/l48 0 2024-09-10T10:04:12.452 INFO:tasks.workunit.client.0.smithi071.stdout:4/227: unlink db/f31 0 2024-09-10T10:04:12.452 INFO:tasks.workunit.client.1.smithi107.stdout:8/222: mknod d5/d8/d2a/c4e 0 2024-09-10T10:04:12.453 INFO:tasks.workunit.client.1.smithi107.stdout:3/529: read dc/dd/d20/d23/d39/f3f [652141,11218] 0 2024-09-10T10:04:12.454 INFO:tasks.workunit.client.1.smithi107.stdout:9/343: creat d5/d7/d1d/f82 x:0 0 0 2024-09-10T10:04:12.455 INFO:tasks.workunit.client.0.smithi071.stdout:4/228: creat db/d15/d17/d4e/f5b x:0 0 0 2024-09-10T10:04:12.455 INFO:tasks.workunit.client.1.smithi107.stdout:2/327: mknod d3/da/d1e/d27/d5b/c6b 0 2024-09-10T10:04:12.455 INFO:tasks.workunit.client.1.smithi107.stdout:3/530: readlink dc/dd/d45/l2b 0 2024-09-10T10:04:12.456 INFO:tasks.workunit.client.0.smithi071.stdout:4/229: dread - db/d15/d17/d4e/d5a/f53 zero size 2024-09-10T10:04:12.457 INFO:tasks.workunit.client.1.smithi107.stdout:5/420: rename de/d20/f6a to de/f90 0 2024-09-10T10:04:12.457 INFO:tasks.workunit.client.0.smithi071.stdout:4/230: write db/d15/d17/f3d [1862679,68192] 0 2024-09-10T10:04:12.458 INFO:tasks.workunit.client.0.smithi071.stdout:5/189: sync 2024-09-10T10:04:12.458 INFO:tasks.workunit.client.0.smithi071.stdout:1/198: sync 2024-09-10T10:04:12.458 INFO:tasks.workunit.client.0.smithi071.stdout:3/188: sync 2024-09-10T10:04:12.458 INFO:tasks.workunit.client.0.smithi071.stdout:6/192: sync 2024-09-10T10:04:12.458 INFO:tasks.workunit.client.0.smithi071.stdout:8/168: sync 2024-09-10T10:04:12.459 INFO:tasks.workunit.client.0.smithi071.stdout:9/336: sync 2024-09-10T10:04:12.460 INFO:tasks.workunit.client.0.smithi071.stdout:4/231: read - db/d15/d17/f47 zero size 2024-09-10T10:04:12.461 INFO:tasks.workunit.client.0.smithi071.stdout:6/193: chown f1 140342 1 2024-09-10T10:04:12.461 INFO:tasks.workunit.client.0.smithi071.stdout:6/194: readlink d4/da/le 0 2024-09-10T10:04:12.462 INFO:tasks.workunit.client.0.smithi071.stdout:1/199: mknod d1/d21/d2f/c3c 0 2024-09-10T10:04:12.463 INFO:tasks.workunit.client.0.smithi071.stdout:5/190: mknod dc/df/d17/c42 0 2024-09-10T10:04:12.463 INFO:tasks.workunit.client.0.smithi071.stdout:6/195: fsync d4/da/f33 0 2024-09-10T10:04:12.463 INFO:tasks.workunit.client.1.smithi107.stdout:8/223: mkdir d5/d8/dc/d18/d4f 0 2024-09-10T10:04:12.465 INFO:tasks.workunit.client.0.smithi071.stdout:9/337: mkdir d0/db/d20/d3c/d75 0 2024-09-10T10:04:12.465 INFO:tasks.workunit.client.0.smithi071.stdout:5/191: write dc/f13 [291454,121257] 0 2024-09-10T10:04:12.465 INFO:tasks.workunit.client.1.smithi107.stdout:3/531: symlink dc/dd/d42/d55/d58/d91/lad 0 2024-09-10T10:04:12.465 INFO:tasks.workunit.client.1.smithi107.stdout:1/399: dwrite d2/f10 [0,4194304] 0 2024-09-10T10:04:12.466 INFO:tasks.workunit.client.0.smithi071.stdout:5/192: fdatasync dc/df/f19 0 2024-09-10T10:04:12.468 INFO:tasks.workunit.client.1.smithi107.stdout:9/344: truncate d5/d7/d1d/d25/d37/f63 53259 0 2024-09-10T10:04:12.469 INFO:tasks.workunit.client.1.smithi107.stdout:5/421: rmdir de/d4a/d4e 39 2024-09-10T10:04:12.469 INFO:tasks.workunit.client.1.smithi107.stdout:8/224: read - d5/d8/dc/d21/f3c zero size 2024-09-10T10:04:12.470 INFO:tasks.workunit.client.1.smithi107.stdout:1/400: mkdir d2/d35/d7b 0 2024-09-10T10:04:12.471 INFO:tasks.workunit.client.1.smithi107.stdout:1/401: write d2/d6/f5e [664632,45876] 0 2024-09-10T10:04:12.473 INFO:tasks.workunit.client.0.smithi071.stdout:4/232: link db/f55 db/d15/d4b/f5c 0 2024-09-10T10:04:12.473 INFO:tasks.workunit.client.1.smithi107.stdout:0/256: dread d6/d8/fb [0,4194304] 0 2024-09-10T10:04:12.474 INFO:tasks.workunit.client.1.smithi107.stdout:1/402: chown d2/d12/d5a/f5c 7906 1 2024-09-10T10:04:12.474 INFO:tasks.workunit.client.1.smithi107.stdout:8/225: write d5/d8/dc/d18/f44 [8668,65618] 0 2024-09-10T10:04:12.475 INFO:tasks.workunit.client.0.smithi071.stdout:0/165: rmdir d11/d30 39 2024-09-10T10:04:12.476 INFO:tasks.workunit.client.0.smithi071.stdout:0/166: chown f8 41 1 2024-09-10T10:04:12.476 INFO:tasks.workunit.client.1.smithi107.stdout:9/345: mkdir d5/d7/d1d/d41/d83 0 2024-09-10T10:04:12.478 INFO:tasks.workunit.client.1.smithi107.stdout:7/271: dread d0/d8/dc/f2d [0,4194304] 0 2024-09-10T10:04:12.478 INFO:tasks.workunit.client.1.smithi107.stdout:2/328: link d3/da/df/d20/d4a/f53 d3/f6c 0 2024-09-10T10:04:12.479 INFO:tasks.workunit.client.1.smithi107.stdout:9/346: fdatasync d5/d7/f78 0 2024-09-10T10:04:12.480 INFO:tasks.workunit.client.1.smithi107.stdout:1/403: write d2/d6/fc [480627,8714] 0 2024-09-10T10:04:12.481 INFO:tasks.workunit.client.1.smithi107.stdout:1/404: readlink d2/d12/d65/d6b/l6c 0 2024-09-10T10:04:12.482 INFO:tasks.workunit.client.0.smithi071.stdout:5/193: unlink dc/df/f18 0 2024-09-10T10:04:12.484 INFO:tasks.workunit.client.1.smithi107.stdout:0/257: mknod d6/d8/d3e/d43/c49 0 2024-09-10T10:04:12.484 INFO:tasks.workunit.client.1.smithi107.stdout:4/386: dread d0/d1f/d20/f30 [0,4194304] 0 2024-09-10T10:04:12.484 INFO:tasks.workunit.client.1.smithi107.stdout:9/347: chown d5/ca 1488918 1 2024-09-10T10:04:12.484 INFO:tasks.workunit.client.0.smithi071.stdout:9/338: rename d0/db/d20/d21/f41 to d0/db/d20/d3c/f76 0 2024-09-10T10:04:12.485 INFO:tasks.workunit.client.1.smithi107.stdout:1/405: dread - d2/f6a zero size 2024-09-10T10:04:12.485 INFO:tasks.workunit.client.0.smithi071.stdout:6/196: mkdir d4/da/df/d2e/d3a/d3e 0 2024-09-10T10:04:12.486 INFO:tasks.workunit.client.0.smithi071.stdout:9/339: chown d0/d3b/d5c/f74 599022 1 2024-09-10T10:04:12.486 INFO:tasks.workunit.client.0.smithi071.stdout:7/221: dread d9/d11/f14 [0,4194304] 0 2024-09-10T10:04:12.487 INFO:tasks.workunit.client.0.smithi071.stdout:6/197: chown d4/d20/l3c 235850 1 2024-09-10T10:04:12.491 INFO:tasks.workunit.client.0.smithi071.stdout:3/189: dread d3/fa [0,4194304] 0 2024-09-10T10:04:12.491 INFO:tasks.workunit.client.1.smithi107.stdout:9/348: dread - d5/d7/d1d/d25/d50/f56 zero size 2024-09-10T10:04:12.491 INFO:tasks.workunit.client.1.smithi107.stdout:7/272: symlink d0/d8/d9/l53 0 2024-09-10T10:04:12.493 INFO:tasks.workunit.client.0.smithi071.stdout:5/194: write dc/df/d17/d22/f35 [1035327,110147] 0 2024-09-10T10:04:12.495 INFO:tasks.workunit.client.1.smithi107.stdout:2/329: mkdir d3/d6d 0 2024-09-10T10:04:12.495 INFO:tasks.workunit.client.0.smithi071.stdout:1/200: dread d1/d1e/f25 [0,4194304] 0 2024-09-10T10:04:12.496 INFO:tasks.workunit.client.1.smithi107.stdout:8/226: getdents d5/d42 0 2024-09-10T10:04:12.497 INFO:tasks.workunit.client.0.smithi071.stdout:9/340: mknod d0/d3b/d5c/c77 0 2024-09-10T10:04:12.498 INFO:tasks.workunit.client.0.smithi071.stdout:7/222: dread d9/f10 [0,4194304] 0 2024-09-10T10:04:12.500 INFO:tasks.workunit.client.1.smithi107.stdout:2/330: fsync d3/d21/d41/f5d 0 2024-09-10T10:04:12.501 INFO:tasks.workunit.client.1.smithi107.stdout:7/273: read d0/f7 [1828659,98096] 0 2024-09-10T10:04:12.501 INFO:tasks.workunit.client.0.smithi071.stdout:3/190: creat d3/d15/d34/f44 x:0 0 0 2024-09-10T10:04:12.502 INFO:tasks.workunit.client.1.smithi107.stdout:1/406: symlink d2/d35/d7b/l7c 0 2024-09-10T10:04:12.503 INFO:tasks.workunit.client.0.smithi071.stdout:3/191: dread - d3/d20/f3f zero size 2024-09-10T10:04:12.503 INFO:tasks.workunit.client.1.smithi107.stdout:3/532: dread dc/dd/f17 [0,4194304] 0 2024-09-10T10:04:12.503 INFO:tasks.workunit.client.1.smithi107.stdout:4/387: write d0/d1f/d20/f2c [1249796,15387] 0 2024-09-10T10:04:12.503 INFO:tasks.workunit.client.0.smithi071.stdout:5/195: rename dc/df/f12 to dc/df/d3e/f43 0 2024-09-10T10:04:12.505 INFO:tasks.workunit.client.0.smithi071.stdout:4/233: link db/cd db/d15/d17/d4e/c5d 0 2024-09-10T10:04:12.505 INFO:tasks.workunit.client.0.smithi071.stdout:7/223: mkdir d9/d2c/d49 0 2024-09-10T10:04:12.506 INFO:tasks.workunit.client.0.smithi071.stdout:5/196: fdatasync dc/f13 0 2024-09-10T10:04:12.507 INFO:tasks.workunit.client.0.smithi071.stdout:9/341: dwrite d0/d3b/d5c/d6a/f6c [0,4194304] 0 2024-09-10T10:04:12.507 INFO:tasks.workunit.client.0.smithi071.stdout:3/192: write d3/f9 [40938,45183] 0 2024-09-10T10:04:12.508 INFO:tasks.workunit.client.1.smithi107.stdout:0/258: dwrite d6/f45 [0,4194304] 0 2024-09-10T10:04:12.508 INFO:tasks.workunit.client.0.smithi071.stdout:4/234: chown db/d15/d4b/f4f 0 1 2024-09-10T10:04:12.510 INFO:tasks.workunit.client.0.smithi071.stdout:7/224: symlink d9/d1a/d1d/l4a 0 2024-09-10T10:04:12.510 INFO:tasks.workunit.client.0.smithi071.stdout:4/235: chown db/d15/d17/l33 710 1 2024-09-10T10:04:12.510 INFO:tasks.workunit.client.0.smithi071.stdout:5/197: truncate dc/f31 330684 0 2024-09-10T10:04:12.511 INFO:tasks.workunit.client.0.smithi071.stdout:9/342: creat d0/db/d1b/f78 x:0 0 0 2024-09-10T10:04:12.512 INFO:tasks.workunit.client.0.smithi071.stdout:3/193: truncate d3/d15/d34/f44 1039371 0 2024-09-10T10:04:12.514 INFO:tasks.workunit.client.0.smithi071.stdout:4/236: write db/d15/d17/d4e/d5a/f53 [119195,95879] 0 2024-09-10T10:04:12.514 INFO:tasks.workunit.client.1.smithi107.stdout:8/227: truncate d5/d8/dc/d18/f4b 4479481 0 2024-09-10T10:04:12.514 INFO:tasks.workunit.client.1.smithi107.stdout:9/349: dwrite d5/d7/d1d/d3b/f4a [4194304,4194304] 0 2024-09-10T10:04:12.514 INFO:tasks.workunit.client.1.smithi107.stdout:2/331: creat d3/da/df/d20/d36/d39/f6e x:0 0 0 2024-09-10T10:04:12.515 INFO:tasks.workunit.client.1.smithi107.stdout:1/407: rename d2/d12/d65/d6b/l6c to d2/d12/d5a/l7d 0 2024-09-10T10:04:12.515 INFO:tasks.workunit.client.0.smithi071.stdout:7/225: fdatasync d9/d11/f14 0 2024-09-10T10:04:12.515 INFO:tasks.workunit.client.1.smithi107.stdout:5/422: dread de/f16 [0,4194304] 0 2024-09-10T10:04:12.516 INFO:tasks.workunit.client.0.smithi071.stdout:4/237: write db/d15/d17/d24/f49 [382704,126076] 0 2024-09-10T10:04:12.516 INFO:tasks.workunit.client.0.smithi071.stdout:7/226: write d9/f3e [1159908,37204] 0 2024-09-10T10:04:12.517 INFO:tasks.workunit.client.1.smithi107.stdout:1/408: stat d2/l37 0 2024-09-10T10:04:12.519 INFO:tasks.workunit.client.0.smithi071.stdout:5/198: creat dc/df/d17/d22/f44 x:0 0 0 2024-09-10T10:04:12.519 INFO:tasks.workunit.client.1.smithi107.stdout:9/350: dread - d5/d7/d1d/d25/d37/f80 zero size 2024-09-10T10:04:12.519 INFO:tasks.workunit.client.1.smithi107.stdout:1/409: stat d2/d12/d65/d6b/f43 0 2024-09-10T10:04:12.520 INFO:tasks.workunit.client.1.smithi107.stdout:1/410: dread - d2/d36/f78 zero size 2024-09-10T10:04:12.520 INFO:tasks.workunit.client.0.smithi071.stdout:3/194: fsync d3/d10/d24/f25 0 2024-09-10T10:04:12.523 INFO:tasks.workunit.client.1.smithi107.stdout:1/411: chown d2/d6/fa 1623 1 2024-09-10T10:04:12.524 INFO:tasks.workunit.client.1.smithi107.stdout:2/332: mkdir d3/d21/d41/d55/d6f 0 2024-09-10T10:04:12.526 INFO:tasks.workunit.client.0.smithi071.stdout:6/198: truncate d4/da/fb 5762691 0 2024-09-10T10:04:12.527 INFO:tasks.workunit.client.0.smithi071.stdout:4/238: unlink db/d15/d17/d24/c56 0 2024-09-10T10:04:12.527 INFO:tasks.workunit.client.0.smithi071.stdout:6/199: chown d4/da/c39 10 1 2024-09-10T10:04:12.528 INFO:tasks.workunit.client.0.smithi071.stdout:0/167: dread f0 [0,4194304] 0 2024-09-10T10:04:12.528 INFO:tasks.workunit.client.0.smithi071.stdout:1/201: truncate d1/f3 3648254 0 2024-09-10T10:04:12.529 INFO:tasks.workunit.client.1.smithi107.stdout:1/412: chown d2/d12/f31 0 1 2024-09-10T10:04:12.530 INFO:tasks.workunit.client.0.smithi071.stdout:7/227: unlink d9/d11/f3b 0 2024-09-10T10:04:12.531 INFO:tasks.workunit.client.1.smithi107.stdout:2/333: mknod d3/da/d66/c70 0 2024-09-10T10:04:12.536 INFO:tasks.workunit.client.1.smithi107.stdout:0/259: dwrite d6/f7 [0,4194304] 0 2024-09-10T10:04:12.537 INFO:tasks.workunit.client.0.smithi071.stdout:0/168: symlink d11/d22/d31/l3e 0 2024-09-10T10:04:12.538 INFO:tasks.workunit.client.1.smithi107.stdout:5/423: creat de/d20/f91 x:0 0 0 2024-09-10T10:04:12.538 INFO:tasks.workunit.client.0.smithi071.stdout:3/195: creat d3/d20/d30/d3a/f45 x:0 0 0 2024-09-10T10:04:12.538 INFO:tasks.workunit.client.0.smithi071.stdout:3/196: chown d3/d1c 2421226 1 2024-09-10T10:04:12.540 INFO:tasks.workunit.client.0.smithi071.stdout:6/200: mknod d4/da/df/d2e/d3a/d3e/c3f 0 2024-09-10T10:04:12.540 INFO:tasks.workunit.client.0.smithi071.stdout:9/343: getdents d0/db/d1b/d1d/d4b 0 2024-09-10T10:04:12.541 INFO:tasks.workunit.client.0.smithi071.stdout:1/202: dread d1/f19 [0,4194304] 0 2024-09-10T10:04:12.541 INFO:tasks.workunit.client.0.smithi071.stdout:7/228: symlink d9/d15/l4b 0 2024-09-10T10:04:12.542 INFO:tasks.workunit.client.0.smithi071.stdout:0/169: symlink d11/d22/l3f 0 2024-09-10T10:04:12.545 INFO:tasks.workunit.client.0.smithi071.stdout:3/197: symlink d3/d15/d2f/l46 0 2024-09-10T10:04:12.545 INFO:tasks.workunit.client.0.smithi071.stdout:7/229: write d9/d15/d1f/f31 [912671,90221] 0 2024-09-10T10:04:12.545 INFO:tasks.workunit.client.1.smithi107.stdout:0/260: chown d6/d8/fb 51321246 1 2024-09-10T10:04:12.546 INFO:tasks.workunit.client.1.smithi107.stdout:1/413: write d2/d6/f5e [675417,90248] 0 2024-09-10T10:04:12.547 INFO:tasks.workunit.client.0.smithi071.stdout:6/201: mkdir d4/da/df/d2e/d3a/d40 0 2024-09-10T10:04:12.547 INFO:tasks.workunit.client.0.smithi071.stdout:9/344: symlink d0/db/d1b/d1d/d5b/d52/l79 0 2024-09-10T10:04:12.548 INFO:tasks.workunit.client.1.smithi107.stdout:9/351: link d5/d1e/l76 d5/d7/d1d/d25/d37/l84 0 2024-09-10T10:04:12.548 INFO:tasks.workunit.client.0.smithi071.stdout:0/170: mkdir d11/d22/d40 0 2024-09-10T10:04:12.548 INFO:tasks.workunit.client.1.smithi107.stdout:5/424: rmdir de/d41 39 2024-09-10T10:04:12.549 INFO:tasks.workunit.client.0.smithi071.stdout:6/202: write f1 [7480269,55011] 0 2024-09-10T10:04:12.550 INFO:tasks.workunit.client.0.smithi071.stdout:3/198: mknod d3/d20/d30/d3a/c47 0 2024-09-10T10:04:12.550 INFO:tasks.workunit.client.0.smithi071.stdout:1/203: dread d1/d1e/f25 [4194304,4194304] 0 2024-09-10T10:04:12.551 INFO:tasks.workunit.client.0.smithi071.stdout:9/345: dread d0/d3b/f3e [0,4194304] 0 2024-09-10T10:04:12.553 INFO:tasks.workunit.client.1.smithi107.stdout:7/274: dwrite d0/f2b [0,4194304] 0 2024-09-10T10:04:12.556 INFO:tasks.workunit.client.1.smithi107.stdout:2/334: creat d3/da/df/d20/d36/f71 x:0 0 0 2024-09-10T10:04:12.559 INFO:tasks.workunit.client.1.smithi107.stdout:8/228: dwrite d5/d8/f24 [4194304,4194304] 0 2024-09-10T10:04:12.559 INFO:tasks.workunit.client.1.smithi107.stdout:5/425: fdatasync de/d20/d3d/f4c 0 2024-09-10T10:04:12.560 INFO:tasks.workunit.client.1.smithi107.stdout:3/533: dwrite dc/dd/d45/d26/d41/d44/d35/d4a/f5c [4194304,4194304] 0 2024-09-10T10:04:12.560 INFO:tasks.workunit.client.0.smithi071.stdout:6/203: dwrite d4/da/f13 [0,4194304] 0 2024-09-10T10:04:12.562 INFO:tasks.workunit.client.0.smithi071.stdout:7/230: rmdir d9/d11 39 2024-09-10T10:04:12.566 INFO:tasks.workunit.client.1.smithi107.stdout:2/335: symlink d3/d6d/l72 0 2024-09-10T10:04:12.568 INFO:tasks.workunit.client.1.smithi107.stdout:0/261: creat d6/f4a x:0 0 0 2024-09-10T10:04:12.571 INFO:tasks.workunit.client.1.smithi107.stdout:2/336: stat d3/da/d1e/d27/c59 0 2024-09-10T10:04:12.573 INFO:tasks.workunit.client.1.smithi107.stdout:5/426: unlink de/d20/d3d/c50 0 2024-09-10T10:04:12.573 INFO:tasks.workunit.client.1.smithi107.stdout:6/397: sync 2024-09-10T10:04:12.573 INFO:tasks.workunit.client.1.smithi107.stdout:4/388: dread d0/d40/d75/f5f [0,4194304] 0 2024-09-10T10:04:12.574 INFO:tasks.workunit.client.1.smithi107.stdout:2/337: chown d3/d21/d41/f63 26390994 1 2024-09-10T10:04:12.575 INFO:tasks.workunit.client.1.smithi107.stdout:9/352: rename d5/d7/d3c/d53/f7c to d5/f85 0 2024-09-10T10:04:12.578 INFO:tasks.workunit.client.1.smithi107.stdout:0/262: write d6/d14/f2d [581942,98677] 0 2024-09-10T10:04:12.578 INFO:tasks.workunit.client.1.smithi107.stdout:8/229: mknod d5/d8/dc/d21/c50 0 2024-09-10T10:04:12.581 INFO:tasks.workunit.client.1.smithi107.stdout:7/275: dread d0/f2f [0,4194304] 0 2024-09-10T10:04:12.583 INFO:tasks.workunit.client.1.smithi107.stdout:1/414: dwrite d2/d35/f4a [0,4194304] 0 2024-09-10T10:04:12.584 INFO:tasks.workunit.client.1.smithi107.stdout:9/353: creat d5/d7/d1d/d29/f86 x:0 0 0 2024-09-10T10:04:12.584 INFO:tasks.workunit.client.1.smithi107.stdout:0/263: read d6/f23 [3439184,13789] 0 2024-09-10T10:04:12.586 INFO:tasks.workunit.client.1.smithi107.stdout:2/338: mknod d3/d6d/c73 0 2024-09-10T10:04:12.589 INFO:tasks.workunit.client.1.smithi107.stdout:5/427: rename de/d20/d2b/d4b/d5e/c6c to de/d41/c92 0 2024-09-10T10:04:12.589 INFO:tasks.workunit.client.1.smithi107.stdout:7/276: creat d0/d20/d35/f54 x:0 0 0 2024-09-10T10:04:12.589 INFO:tasks.workunit.client.1.smithi107.stdout:1/415: mkdir d2/d12/d7e 0 2024-09-10T10:04:12.590 INFO:tasks.workunit.client.1.smithi107.stdout:5/428: rmdir de 39 2024-09-10T10:04:12.591 INFO:tasks.workunit.client.1.smithi107.stdout:7/277: dread - d0/d8/dc/f4f zero size 2024-09-10T10:04:12.591 INFO:tasks.workunit.client.1.smithi107.stdout:1/416: chown d2/d6/fc 2 1 2024-09-10T10:04:12.592 INFO:tasks.workunit.client.1.smithi107.stdout:0/264: creat d6/d8/d3e/d43/f4b x:0 0 0 2024-09-10T10:04:12.595 INFO:tasks.workunit.client.1.smithi107.stdout:9/354: rename d5/d7/d1d/d25 to d5/d7/d3c/d53/d57/d87 0 2024-09-10T10:04:12.595 INFO:tasks.workunit.client.1.smithi107.stdout:2/339: getdents d3/da/df/d62 0 2024-09-10T10:04:12.598 INFO:tasks.workunit.client.1.smithi107.stdout:1/417: creat d2/d12/d7e/f7f x:0 0 0 2024-09-10T10:04:12.599 INFO:tasks.workunit.client.1.smithi107.stdout:8/230: dread d5/d8/f9 [0,4194304] 0 2024-09-10T10:04:12.599 INFO:tasks.workunit.client.1.smithi107.stdout:5/429: truncate de/d4a/f63 805349 0 2024-09-10T10:04:12.600 INFO:tasks.workunit.client.1.smithi107.stdout:9/355: write d5/f5c [2254410,101874] 0 2024-09-10T10:04:12.600 INFO:tasks.workunit.client.1.smithi107.stdout:7/278: rename d0/d8/dc/f2d to d0/d8/d9/d3d/f55 0 2024-09-10T10:04:12.601 INFO:tasks.workunit.client.1.smithi107.stdout:8/231: fdatasync d5/d8/dc/f16 0 2024-09-10T10:04:12.602 INFO:tasks.workunit.client.1.smithi107.stdout:2/340: chown d3/da/df/d20/d36/d4f/l56 967 1 2024-09-10T10:04:12.603 INFO:tasks.workunit.client.1.smithi107.stdout:1/418: mknod d2/d12/d65/c80 0 2024-09-10T10:04:12.603 INFO:tasks.workunit.client.1.smithi107.stdout:4/389: write d0/f1d [1895404,105055] 0 2024-09-10T10:04:12.604 INFO:tasks.workunit.client.1.smithi107.stdout:9/356: readlink d5/d7/d1d/d29/l4b 0 2024-09-10T10:04:12.606 INFO:tasks.workunit.client.0.smithi071.stdout:2/180: sync 2024-09-10T10:04:12.607 INFO:tasks.workunit.client.1.smithi107.stdout:5/430: creat de/d20/d2b/d4b/d5e/f93 x:0 0 0 2024-09-10T10:04:12.607 INFO:tasks.workunit.client.1.smithi107.stdout:9/357: chown d5/d7/d1d/d41/d83 26 1 2024-09-10T10:04:12.608 INFO:tasks.workunit.client.1.smithi107.stdout:1/419: mkdir d2/d6/d24/d81 0 2024-09-10T10:04:12.608 INFO:tasks.workunit.client.1.smithi107.stdout:4/390: fsync d0/d1f/d20/f2c 0 2024-09-10T10:04:12.612 INFO:tasks.workunit.client.1.smithi107.stdout:3/534: dread dc/dd/d42/d55/d58/f7c [0,4194304] 0 2024-09-10T10:04:12.612 INFO:tasks.workunit.client.1.smithi107.stdout:8/232: getdents d5/d8/dc/d21 0 2024-09-10T10:04:12.613 INFO:tasks.workunit.client.1.smithi107.stdout:1/420: mknod d2/d35/c82 0 2024-09-10T10:04:12.613 INFO:tasks.workunit.client.1.smithi107.stdout:4/391: read - d0/d40/d57/d4f/f58 zero size 2024-09-10T10:04:12.613 INFO:tasks.workunit.client.1.smithi107.stdout:0/265: dwrite d6/d8/d2f/d35/d3c/f41 [0,4194304] 0 2024-09-10T10:04:12.614 INFO:tasks.workunit.client.1.smithi107.stdout:9/358: rmdir d5/d7/d3c 39 2024-09-10T10:04:12.615 INFO:tasks.workunit.client.1.smithi107.stdout:5/431: creat de/d20/d2b/d4b/d5e/f94 x:0 0 0 2024-09-10T10:04:12.616 INFO:tasks.workunit.client.1.smithi107.stdout:7/279: dread d0/fb [0,4194304] 0 2024-09-10T10:04:12.617 INFO:tasks.workunit.client.1.smithi107.stdout:1/421: mknod d2/d6/c83 0 2024-09-10T10:04:12.619 INFO:tasks.workunit.client.1.smithi107.stdout:0/266: read d6/d8/d2f/f33 [2096806,73332] 0 2024-09-10T10:04:12.622 INFO:tasks.workunit.client.0.smithi071.stdout:4/239: write db/f55 [403369,67722] 0 2024-09-10T10:04:12.622 INFO:tasks.workunit.client.1.smithi107.stdout:9/359: fdatasync d5/d7/d3c/d53/d57/d87/d50/f65 0 2024-09-10T10:04:12.623 INFO:tasks.workunit.client.1.smithi107.stdout:1/422: read d2/d35/f5b [349114,92015] 0 2024-09-10T10:04:12.623 INFO:tasks.workunit.client.1.smithi107.stdout:2/341: dwrite d3/da/df/d20/d36/d39/f4e [0,4194304] 0 2024-09-10T10:04:12.623 INFO:tasks.workunit.client.1.smithi107.stdout:5/432: creat de/d20/d3d/f95 x:0 0 0 2024-09-10T10:04:12.624 INFO:tasks.workunit.client.0.smithi071.stdout:0/171: readlink l4 0 2024-09-10T10:04:12.625 INFO:tasks.workunit.client.0.smithi071.stdout:3/199: symlink d3/d20/d30/l48 0 2024-09-10T10:04:12.625 INFO:tasks.workunit.client.1.smithi107.stdout:8/233: symlink d5/d8/dc/d18/d4f/l51 0 2024-09-10T10:04:12.626 INFO:tasks.workunit.client.1.smithi107.stdout:5/433: write f8 [1634985,42954] 0 2024-09-10T10:04:12.626 INFO:tasks.workunit.client.0.smithi071.stdout:1/204: dwrite d1/d21/d2f/f39 [0,4194304] 0 2024-09-10T10:04:12.627 INFO:tasks.workunit.client.0.smithi071.stdout:5/199: dread dc/f13 [4194304,4194304] 0 2024-09-10T10:04:12.628 INFO:tasks.workunit.client.0.smithi071.stdout:0/172: write d11/d22/f2e [7963,94654] 0 2024-09-10T10:04:12.628 INFO:tasks.workunit.client.1.smithi107.stdout:3/535: mknod dc/dd/d45/d26/d41/d44/d35/cae 0 2024-09-10T10:04:12.629 INFO:tasks.workunit.client.0.smithi071.stdout:5/200: fsync dc/f1a 0 2024-09-10T10:04:12.630 INFO:tasks.workunit.client.0.smithi071.stdout:7/231: symlink d9/d1a/l4c 0 2024-09-10T10:04:12.630 INFO:tasks.workunit.client.0.smithi071.stdout:1/205: stat d1/l1b 0 2024-09-10T10:04:12.630 INFO:tasks.workunit.client.0.smithi071.stdout:6/204: unlink d4/da/le 0 2024-09-10T10:04:12.631 INFO:tasks.workunit.client.0.smithi071.stdout:2/181: rename l4 to d8/d13/l2c 0 2024-09-10T10:04:12.631 INFO:tasks.workunit.client.0.smithi071.stdout:5/201: readlink dc/l37 0 2024-09-10T10:04:12.631 INFO:tasks.workunit.client.1.smithi107.stdout:7/280: mkdir d0/d8/d56 0 2024-09-10T10:04:12.631 INFO:tasks.workunit.client.0.smithi071.stdout:0/173: rmdir d11 39 2024-09-10T10:04:12.632 INFO:tasks.workunit.client.0.smithi071.stdout:6/205: fsync d4/f38 0 2024-09-10T10:04:12.633 INFO:tasks.workunit.client.0.smithi071.stdout:7/232: creat d9/d1a/f4d x:0 0 0 2024-09-10T10:04:12.633 INFO:tasks.workunit.client.0.smithi071.stdout:6/206: fsync d4/f2f 0 2024-09-10T10:04:12.635 INFO:tasks.workunit.client.0.smithi071.stdout:6/207: stat d4/da/c35 0 2024-09-10T10:04:12.636 INFO:tasks.workunit.client.0.smithi071.stdout:1/206: mkdir d1/d21/d3d 0 2024-09-10T10:04:12.636 INFO:tasks.workunit.client.1.smithi107.stdout:1/423: dread d2/d6/d24/f4f [0,4194304] 0 2024-09-10T10:04:12.638 INFO:tasks.workunit.client.0.smithi071.stdout:4/240: read db/d15/d17/d24/f25 [539348,123897] 0 2024-09-10T10:04:12.638 INFO:tasks.workunit.client.0.smithi071.stdout:2/182: fsync d8/d13/f15 0 2024-09-10T10:04:12.639 INFO:tasks.workunit.client.0.smithi071.stdout:3/200: rename d3/d15 to d3/d49 0 2024-09-10T10:04:12.640 INFO:tasks.workunit.client.1.smithi107.stdout:0/267: creat d6/d8/d2f/d2e/d32/f4c x:0 0 0 2024-09-10T10:04:12.641 INFO:tasks.workunit.client.0.smithi071.stdout:7/233: symlink d9/d1a/d1d/l4e 0 2024-09-10T10:04:12.642 INFO:tasks.workunit.client.1.smithi107.stdout:8/234: rmdir d5/d8/dc/d21/d48 39 2024-09-10T10:04:12.643 INFO:tasks.workunit.client.1.smithi107.stdout:1/424: chown d2/d12/f3e 902979 1 2024-09-10T10:04:12.643 INFO:tasks.workunit.client.0.smithi071.stdout:7/234: stat d9/d15/l16 0 2024-09-10T10:04:12.644 INFO:tasks.workunit.client.1.smithi107.stdout:7/281: dwrite d0/d1b/f4a [0,4194304] 0 2024-09-10T10:04:12.644 INFO:tasks.workunit.client.0.smithi071.stdout:1/207: chown d1/l20 40225069 1 2024-09-10T10:04:12.645 INFO:tasks.workunit.client.1.smithi107.stdout:1/425: dread - d2/d6/d67/f77 zero size 2024-09-10T10:04:12.645 INFO:tasks.workunit.client.1.smithi107.stdout:5/434: link de/d41/f46 de/d4a/d5c/d6d/f96 0 2024-09-10T10:04:12.646 INFO:tasks.workunit.client.0.smithi071.stdout:4/241: rmdir db/d15/d17 39 2024-09-10T10:04:12.647 INFO:tasks.workunit.client.1.smithi107.stdout:3/536: truncate dc/dd/d45/d26/d59/f90 611329 0 2024-09-10T10:04:12.648 INFO:tasks.workunit.client.1.smithi107.stdout:2/342: rename d3/da/df/c38 to d3/da/df/d20/d36/c74 0 2024-09-10T10:04:12.648 INFO:tasks.workunit.client.1.smithi107.stdout:7/282: write d0/d8/f31 [571363,38488] 0 2024-09-10T10:04:12.649 INFO:tasks.workunit.client.0.smithi071.stdout:5/202: dread dc/df/f1e [0,4194304] 0 2024-09-10T10:04:12.649 INFO:tasks.workunit.client.0.smithi071.stdout:0/174: dwrite d11/d22/f2c [0,4194304] 0 2024-09-10T10:04:12.650 INFO:tasks.workunit.client.1.smithi107.stdout:8/235: mkdir d5/d8/dc/d21/d52 0 2024-09-10T10:04:12.650 INFO:tasks.workunit.client.0.smithi071.stdout:3/201: mkdir d3/d20/d30/d42/d4a 0 2024-09-10T10:04:12.653 INFO:tasks.workunit.client.1.smithi107.stdout:5/435: mknod de/d4a/d7e/d79/c97 0 2024-09-10T10:04:12.654 INFO:tasks.workunit.client.1.smithi107.stdout:4/392: dread d0/f8 [0,4194304] 0 2024-09-10T10:04:12.655 INFO:tasks.workunit.client.0.smithi071.stdout:4/242: truncate db/f12 899755 0 2024-09-10T10:04:12.656 INFO:tasks.workunit.client.1.smithi107.stdout:0/268: rename d6/d8/fb to d6/d8/d2f/d2e/f4d 0 2024-09-10T10:04:12.658 INFO:tasks.workunit.client.0.smithi071.stdout:4/243: chown db/d15/d26/d43/d4d/l3e 31670 1 2024-09-10T10:04:12.658 INFO:tasks.workunit.client.0.smithi071.stdout:6/208: link d4/d20/c22 d4/d1c/c41 0 2024-09-10T10:04:12.659 INFO:tasks.workunit.client.1.smithi107.stdout:1/426: dwrite d2/d12/f58 [0,4194304] 0 2024-09-10T10:04:12.660 INFO:tasks.workunit.client.1.smithi107.stdout:2/343: unlink d3/c3e 0 2024-09-10T10:04:12.660 INFO:tasks.workunit.client.0.smithi071.stdout:7/235: dwrite d9/d1a/f35 [0,4194304] 0 2024-09-10T10:04:12.661 INFO:tasks.workunit.client.0.smithi071.stdout:3/202: write d3/f6 [1378504,111520] 0 2024-09-10T10:04:12.661 INFO:tasks.workunit.client.1.smithi107.stdout:7/283: mkdir d0/d57 0 2024-09-10T10:04:12.661 INFO:tasks.workunit.client.1.smithi107.stdout:2/344: chown d3/da/d1e/d40 26 1 2024-09-10T10:04:12.669 INFO:tasks.workunit.client.1.smithi107.stdout:8/236: rename d5/d8/fe to d5/d8/d2a/d47/f53 0 2024-09-10T10:04:12.670 INFO:tasks.workunit.client.0.smithi071.stdout:3/203: dwrite d3/f21 [0,4194304] 0 2024-09-10T10:04:12.670 INFO:tasks.workunit.client.1.smithi107.stdout:9/360: write d5/d7/d3c/d53/d57/f69 [236408,24978] 0 2024-09-10T10:04:12.670 INFO:tasks.workunit.client.1.smithi107.stdout:4/393: symlink d0/d40/d57/d76/l8b 0 2024-09-10T10:04:12.672 INFO:tasks.workunit.client.1.smithi107.stdout:7/284: unlink d0/f40 0 2024-09-10T10:04:12.673 INFO:tasks.workunit.client.0.smithi071.stdout:0/175: rename f8 to d11/d22/d31/f41 0 2024-09-10T10:04:12.673 INFO:tasks.workunit.client.1.smithi107.stdout:5/436: mknod de/d4a/c98 0 2024-09-10T10:04:12.673 INFO:tasks.workunit.client.1.smithi107.stdout:1/427: creat d2/d36/f84 x:0 0 0 2024-09-10T10:04:12.674 INFO:tasks.workunit.client.0.smithi071.stdout:4/244: chown db/d15/d17/d24/c29 347349162 1 2024-09-10T10:04:12.675 INFO:tasks.workunit.client.0.smithi071.stdout:7/236: fdatasync f4 0 2024-09-10T10:04:12.676 INFO:tasks.workunit.client.1.smithi107.stdout:7/285: chown d0/d1b/l46 13017 1 2024-09-10T10:04:12.679 INFO:tasks.workunit.client.1.smithi107.stdout:7/286: truncate d0/d20/f41 700096 0 2024-09-10T10:04:12.680 INFO:tasks.workunit.client.0.smithi071.stdout:6/209: rename d4/d20/f26 to d4/d1c/f42 0 2024-09-10T10:04:12.680 INFO:tasks.workunit.client.0.smithi071.stdout:3/204: dwrite d3/f8 [4194304,4194304] 0 2024-09-10T10:04:12.681 INFO:tasks.workunit.client.1.smithi107.stdout:5/437: dread de/d20/d2b/f39 [0,4194304] 0 2024-09-10T10:04:12.681 INFO:tasks.workunit.client.1.smithi107.stdout:3/537: dread dc/dd/d20/d23/d39/fa5 [0,4194304] 0 2024-09-10T10:04:12.682 INFO:tasks.workunit.client.0.smithi071.stdout:4/245: mkdir db/d5e 0 2024-09-10T10:04:12.683 INFO:tasks.workunit.client.0.smithi071.stdout:6/210: write d4/f27 [319964,71112] 0 2024-09-10T10:04:12.683 INFO:tasks.workunit.client.0.smithi071.stdout:3/205: readlink d3/d20/d39/l40 0 2024-09-10T10:04:12.683 INFO:tasks.workunit.client.1.smithi107.stdout:8/237: creat d5/d8/d2a/d47/f54 x:0 0 0 2024-09-10T10:04:12.684 INFO:tasks.workunit.client.0.smithi071.stdout:0/176: symlink d11/d1e/l42 0 2024-09-10T10:04:12.685 INFO:tasks.workunit.client.1.smithi107.stdout:4/394: mkdir d0/d1f/d20/d47/d8c 0 2024-09-10T10:04:12.686 INFO:tasks.workunit.client.0.smithi071.stdout:7/237: dwrite d9/d15/d1f/f31 [0,4194304] 0 2024-09-10T10:04:12.687 INFO:tasks.workunit.client.0.smithi071.stdout:4/246: fdatasync db/d15/d17/d24/f49 0 2024-09-10T10:04:12.688 INFO:tasks.workunit.client.0.smithi071.stdout:0/177: write d11/d22/f2c [3126409,5901] 0 2024-09-10T10:04:12.689 INFO:tasks.workunit.client.1.smithi107.stdout:1/428: symlink d2/d12/l85 0 2024-09-10T10:04:12.689 INFO:tasks.workunit.client.1.smithi107.stdout:0/269: dread f4 [0,4194304] 0 2024-09-10T10:04:12.690 INFO:tasks.workunit.client.1.smithi107.stdout:1/429: dread - d2/f4c zero size 2024-09-10T10:04:12.691 INFO:tasks.workunit.client.1.smithi107.stdout:5/438: rmdir de/d41 39 2024-09-10T10:04:12.694 INFO:tasks.workunit.client.1.smithi107.stdout:7/287: dwrite d0/f27 [0,4194304] 0 2024-09-10T10:04:12.694 INFO:tasks.workunit.client.1.smithi107.stdout:0/270: stat d6/d8/d3e 0 2024-09-10T10:04:12.696 INFO:tasks.workunit.client.0.smithi071.stdout:7/238: mkdir d9/d2c/d4f 0 2024-09-10T10:04:12.696 INFO:tasks.workunit.client.0.smithi071.stdout:1/208: write d1/f3 [2025483,45439] 0 2024-09-10T10:04:12.697 INFO:tasks.workunit.client.1.smithi107.stdout:3/538: creat dc/dd/d20/d23/d39/faf x:0 0 0 2024-09-10T10:04:12.698 INFO:tasks.workunit.client.0.smithi071.stdout:4/247: rmdir db/d15/d17 39 2024-09-10T10:04:12.702 INFO:tasks.workunit.client.0.smithi071.stdout:6/211: dwrite d4/f27 [0,4194304] 0 2024-09-10T10:04:12.703 INFO:tasks.workunit.client.0.smithi071.stdout:3/206: dread d3/d1c/f22 [0,4194304] 0 2024-09-10T10:04:12.704 INFO:tasks.workunit.client.0.smithi071.stdout:0/178: write d11/d22/d31/f41 [930442,8298] 0 2024-09-10T10:04:12.704 INFO:tasks.workunit.client.1.smithi107.stdout:4/395: mkdir d0/d40/d57/d76/d77/d8d 0 2024-09-10T10:04:12.705 INFO:tasks.workunit.client.0.smithi071.stdout:5/203: dwrite f4 [0,4194304] 0 2024-09-10T10:04:12.708 INFO:tasks.workunit.client.1.smithi107.stdout:9/361: creat d5/d1e/f88 x:0 0 0 2024-09-10T10:04:12.709 INFO:tasks.workunit.client.0.smithi071.stdout:1/209: creat d1/d21/d2f/f3e x:0 0 0 2024-09-10T10:04:12.709 INFO:tasks.workunit.client.0.smithi071.stdout:7/239: dread d9/f10 [0,4194304] 0 2024-09-10T10:04:12.711 INFO:tasks.workunit.client.1.smithi107.stdout:7/288: dwrite d0/d8/f38 [0,4194304] 0 2024-09-10T10:04:12.712 INFO:tasks.workunit.client.0.smithi071.stdout:4/248: dread db/f55 [0,4194304] 0 2024-09-10T10:04:12.714 INFO:tasks.workunit.client.0.smithi071.stdout:5/204: unlink f8 0 2024-09-10T10:04:12.714 INFO:tasks.workunit.client.0.smithi071.stdout:6/212: dread f3 [0,4194304] 0 2024-09-10T10:04:12.715 INFO:tasks.workunit.client.0.smithi071.stdout:6/213: write d4/f25 [7251950,71983] 0 2024-09-10T10:04:12.716 INFO:tasks.workunit.client.0.smithi071.stdout:6/214: truncate d4/da/f13 4310350 0 2024-09-10T10:04:12.719 INFO:tasks.workunit.client.0.smithi071.stdout:3/207: symlink d3/d10/d24/l4b 0 2024-09-10T10:04:12.720 INFO:tasks.workunit.client.0.smithi071.stdout:6/215: dread d4/f25 [4194304,4194304] 0 2024-09-10T10:04:12.721 INFO:tasks.workunit.client.0.smithi071.stdout:3/208: chown d3/d20/f3f 543529369 1 2024-09-10T10:04:12.721 INFO:tasks.workunit.client.0.smithi071.stdout:6/216: read - d4/f2f zero size 2024-09-10T10:04:12.724 INFO:tasks.workunit.client.0.smithi071.stdout:5/205: unlink dc/df/c3d 0 2024-09-10T10:04:12.725 INFO:tasks.workunit.client.1.smithi107.stdout:1/430: dwrite d2/d12/d65/d6b/f74 [0,4194304] 0 2024-09-10T10:04:12.727 INFO:tasks.workunit.client.1.smithi107.stdout:2/345: dread d3/f3d [0,4194304] 0 2024-09-10T10:04:12.729 INFO:tasks.workunit.client.1.smithi107.stdout:3/539: truncate dc/dd/d45/f4e 1761902 0 2024-09-10T10:04:12.729 INFO:tasks.workunit.client.0.smithi071.stdout:3/209: creat d3/d49/f4c x:0 0 0 2024-09-10T10:04:12.730 INFO:tasks.workunit.client.0.smithi071.stdout:6/217: fdatasync d4/d1c/f42 0 2024-09-10T10:04:12.731 INFO:tasks.workunit.client.1.smithi107.stdout:7/289: dwrite d0/d8/f13 [0,4194304] 0 2024-09-10T10:04:12.731 INFO:tasks.workunit.client.1.smithi107.stdout:4/396: truncate d0/d40/d57/d4f/f61 251992 0 2024-09-10T10:04:12.733 INFO:tasks.workunit.client.0.smithi071.stdout:5/206: creat dc/df/d17/d22/f45 x:0 0 0 2024-09-10T10:04:12.733 INFO:tasks.workunit.client.1.smithi107.stdout:8/238: write d5/ff [4052234,42518] 0 2024-09-10T10:04:12.734 INFO:tasks.workunit.client.1.smithi107.stdout:0/271: dwrite d6/d14/f2d [0,4194304] 0 2024-09-10T10:04:12.734 INFO:tasks.workunit.client.1.smithi107.stdout:1/431: symlink d2/l86 0 2024-09-10T10:04:12.735 INFO:tasks.workunit.client.0.smithi071.stdout:7/240: rename d9/d1a/d1d/l4e to d9/d15/l50 0 2024-09-10T10:04:12.737 INFO:tasks.workunit.client.0.smithi071.stdout:3/210: symlink d3/d10/l4d 0 2024-09-10T10:04:12.737 INFO:tasks.workunit.client.0.smithi071.stdout:6/218: dread d4/f27 [0,4194304] 0 2024-09-10T10:04:12.738 INFO:tasks.workunit.client.1.smithi107.stdout:2/346: creat d3/d21/d41/d55/d6f/f75 x:0 0 0 2024-09-10T10:04:12.738 INFO:tasks.workunit.client.0.smithi071.stdout:6/219: dread - d4/d1c/f3d zero size 2024-09-10T10:04:12.739 INFO:tasks.workunit.client.1.smithi107.stdout:3/540: creat dc/d56/fb0 x:0 0 0 2024-09-10T10:04:12.740 INFO:tasks.workunit.client.1.smithi107.stdout:1/432: rmdir d2/d12/d7e 39 2024-09-10T10:04:12.741 INFO:tasks.workunit.client.1.smithi107.stdout:0/272: symlink d6/d8/d2f/d2e/d32/l4e 0 2024-09-10T10:04:12.741 INFO:tasks.workunit.client.1.smithi107.stdout:3/541: stat dc/dd/d45/d26/d41/d44/d35/f9b 0 2024-09-10T10:04:12.741 INFO:tasks.workunit.client.1.smithi107.stdout:1/433: write d2/f6a [365124,53747] 0 2024-09-10T10:04:12.743 INFO:tasks.workunit.client.0.smithi071.stdout:4/249: rename f4 to db/d15/d4b/f5f 0 2024-09-10T10:04:12.743 INFO:tasks.workunit.client.1.smithi107.stdout:7/290: creat d0/d57/f58 x:0 0 0 2024-09-10T10:04:12.744 INFO:tasks.workunit.client.1.smithi107.stdout:8/239: creat d5/d8/dc/d21/d48/f55 x:0 0 0 2024-09-10T10:04:12.745 INFO:tasks.workunit.client.1.smithi107.stdout:8/240: write d5/f38 [883803,139] 0 2024-09-10T10:04:12.746 INFO:tasks.workunit.client.1.smithi107.stdout:8/241: write d5/ff [4373570,72566] 0 2024-09-10T10:04:12.746 INFO:tasks.workunit.client.1.smithi107.stdout:4/397: rename d0/d40/d57/c5c to d0/d40/d75/d3f/d59/c8e 0 2024-09-10T10:04:12.747 INFO:tasks.workunit.client.1.smithi107.stdout:0/273: mkdir d6/d8/d2f/d35/d4f 0 2024-09-10T10:04:12.748 INFO:tasks.workunit.client.1.smithi107.stdout:1/434: mknod d2/d35/c87 0 2024-09-10T10:04:12.749 INFO:tasks.workunit.client.0.smithi071.stdout:1/210: write d1/f32 [993663,124746] 0 2024-09-10T10:04:12.749 INFO:tasks.workunit.client.1.smithi107.stdout:3/542: creat dc/d56/fb1 x:0 0 0 2024-09-10T10:04:12.749 INFO:tasks.workunit.client.0.smithi071.stdout:3/211: link d3/d10/d24/f25 d3/d10/d24/d2b/f4e 0 2024-09-10T10:04:12.750 INFO:tasks.workunit.client.1.smithi107.stdout:7/291: creat d0/d8/dc/f59 x:0 0 0 2024-09-10T10:04:12.752 INFO:tasks.workunit.client.1.smithi107.stdout:4/398: fdatasync d0/d1f/d20/f17 0 2024-09-10T10:04:12.752 INFO:tasks.workunit.client.1.smithi107.stdout:3/543: dread - dc/dd/d45/f77 zero size 2024-09-10T10:04:12.753 INFO:tasks.workunit.client.0.smithi071.stdout:5/207: dwrite dc/f3c [0,4194304] 0 2024-09-10T10:04:12.753 INFO:tasks.workunit.client.0.smithi071.stdout:3/212: rmdir d3/d49/d2f 39 2024-09-10T10:04:12.753 INFO:tasks.workunit.client.1.smithi107.stdout:0/274: creat d6/d8/d3e/f50 x:0 0 0 2024-09-10T10:04:12.754 INFO:tasks.workunit.client.1.smithi107.stdout:1/435: symlink d2/d6/d24/l88 0 2024-09-10T10:04:12.755 INFO:tasks.workunit.client.1.smithi107.stdout:2/347: creat d3/da/df/d20/d36/f76 x:0 0 0 2024-09-10T10:04:12.756 INFO:tasks.workunit.client.0.smithi071.stdout:1/211: mkdir d1/d3f 0 2024-09-10T10:04:12.756 INFO:tasks.workunit.client.0.smithi071.stdout:5/208: mknod dc/df/d3e/c46 0 2024-09-10T10:04:12.757 INFO:tasks.workunit.client.1.smithi107.stdout:3/544: chown dc/dd/d45/d26/d41/d44/d35/d52/f92 7 1 2024-09-10T10:04:12.757 INFO:tasks.workunit.client.1.smithi107.stdout:4/399: symlink d0/d40/d75/d3f/d59/l8f 0 2024-09-10T10:04:12.758 INFO:tasks.workunit.client.1.smithi107.stdout:7/292: mknod d0/d1b/d4d/c5a 0 2024-09-10T10:04:12.759 INFO:tasks.workunit.client.0.smithi071.stdout:3/213: mkdir d3/d49/d4f 0 2024-09-10T10:04:12.759 INFO:tasks.workunit.client.1.smithi107.stdout:8/242: creat d5/d8/dc/d21/f56 x:0 0 0 2024-09-10T10:04:12.760 INFO:tasks.workunit.client.1.smithi107.stdout:4/400: dread - d0/d1f/d20/d47/f85 zero size 2024-09-10T10:04:12.763 INFO:tasks.workunit.client.1.smithi107.stdout:4/401: chown d0/d1f/d20/f70 50359579 1 2024-09-10T10:04:12.763 INFO:tasks.workunit.client.1.smithi107.stdout:0/275: rename d6/c11 to d6/d8/d2f/d35/c51 0 2024-09-10T10:04:12.764 INFO:tasks.workunit.client.0.smithi071.stdout:5/209: mknod dc/df/d17/c47 0 2024-09-10T10:04:12.764 INFO:tasks.workunit.client.1.smithi107.stdout:2/348: truncate d3/d21/f32 2680867 0 2024-09-10T10:04:12.766 INFO:tasks.workunit.client.0.smithi071.stdout:3/214: unlink d3/d1c/f31 0 2024-09-10T10:04:12.766 INFO:tasks.workunit.client.1.smithi107.stdout:8/243: creat d5/d8/d2a/d35/f57 x:0 0 0 2024-09-10T10:04:12.772 INFO:tasks.workunit.client.0.smithi071.stdout:5/210: mkdir dc/df/d29/d48 0 2024-09-10T10:04:12.772 INFO:tasks.workunit.client.1.smithi107.stdout:4/402: mkdir d0/d1f/d90 0 2024-09-10T10:04:12.773 INFO:tasks.workunit.client.1.smithi107.stdout:0/276: creat d6/d8/d2f/d2e/f52 x:0 0 0 2024-09-10T10:04:12.773 INFO:tasks.workunit.client.1.smithi107.stdout:7/293: dwrite d0/d8/d9/f30 [0,4194304] 0 2024-09-10T10:04:12.773 INFO:tasks.workunit.client.1.smithi107.stdout:4/403: chown d0/d1f/d20/f30 266345856 1 2024-09-10T10:04:12.773 INFO:tasks.workunit.client.1.smithi107.stdout:8/244: mknod d5/d8/d2a/d35/c58 0 2024-09-10T10:04:12.773 INFO:tasks.workunit.client.0.smithi071.stdout:3/215: mknod d3/d20/d39/c50 0 2024-09-10T10:04:12.774 INFO:tasks.workunit.client.0.smithi071.stdout:1/212: creat d1/f40 x:0 0 0 2024-09-10T10:04:12.774 INFO:tasks.workunit.client.0.smithi071.stdout:7/241: truncate d9/fa 1780873 0 2024-09-10T10:04:12.774 INFO:tasks.workunit.client.1.smithi107.stdout:9/362: dread d5/d7/d1d/d41/f48 [0,4194304] 0 2024-09-10T10:04:12.775 INFO:tasks.workunit.client.0.smithi071.stdout:0/179: dread f2 [0,4194304] 0 2024-09-10T10:04:12.775 INFO:tasks.workunit.client.1.smithi107.stdout:2/349: link d3/da/df/f48 d3/da/df/d20/d4a/f77 0 2024-09-10T10:04:12.775 INFO:tasks.workunit.client.0.smithi071.stdout:5/211: chown dc/df/d29/c41 0 1 2024-09-10T10:04:12.777 INFO:tasks.workunit.client.1.smithi107.stdout:0/277: mknod d6/d8/d2f/d35/c53 0 2024-09-10T10:04:12.778 INFO:tasks.workunit.client.1.smithi107.stdout:4/404: creat d0/d82/f91 x:0 0 0 2024-09-10T10:04:12.779 INFO:tasks.workunit.client.1.smithi107.stdout:0/278: write d6/d14/f40 [10456,75888] 0 2024-09-10T10:04:12.781 INFO:tasks.workunit.client.1.smithi107.stdout:7/294: mknod d0/d1b/d4d/c5b 0 2024-09-10T10:04:12.781 INFO:tasks.workunit.client.0.smithi071.stdout:4/250: truncate db/d15/d26/f3c 2956840 0 2024-09-10T10:04:12.782 INFO:tasks.workunit.client.0.smithi071.stdout:0/180: readlink d11/d30/l34 0 2024-09-10T10:04:12.782 INFO:tasks.workunit.client.0.smithi071.stdout:5/212: symlink dc/df/l49 0 2024-09-10T10:04:12.783 INFO:tasks.workunit.client.1.smithi107.stdout:7/295: fsync d0/d1b/f4a 0 2024-09-10T10:04:12.784 INFO:tasks.workunit.client.0.smithi071.stdout:6/220: dread d4/f25 [0,4194304] 0 2024-09-10T10:04:12.785 INFO:tasks.workunit.client.0.smithi071.stdout:3/216: link d3/d20/f2c d3/d20/d30/f51 0 2024-09-10T10:04:12.785 INFO:tasks.workunit.client.1.smithi107.stdout:2/350: write d3/da/df/d20/d36/d4f/f58 [2127078,65977] 0 2024-09-10T10:04:12.786 INFO:tasks.workunit.client.1.smithi107.stdout:4/405: symlink d0/d1f/d20/d80/l92 0 2024-09-10T10:04:12.786 INFO:tasks.workunit.client.1.smithi107.stdout:0/279: getdents d6/d8/d2f/d35/d4f 0 2024-09-10T10:04:12.787 INFO:tasks.workunit.client.0.smithi071.stdout:0/181: symlink d11/d30/l43 0 2024-09-10T10:04:12.787 INFO:tasks.workunit.client.0.smithi071.stdout:6/221: write d4/d1c/f42 [1016172,91567] 0 2024-09-10T10:04:12.787 INFO:tasks.workunit.client.0.smithi071.stdout:4/251: write db/d15/d17/d24/f49 [307185,120007] 0 2024-09-10T10:04:12.788 INFO:tasks.workunit.client.1.smithi107.stdout:8/245: dwrite d5/d8/dc/d1a/f1f [0,4194304] 0 2024-09-10T10:04:12.788 INFO:tasks.workunit.client.0.smithi071.stdout:5/213: dread dc/f31 [0,4194304] 0 2024-09-10T10:04:12.789 INFO:tasks.workunit.client.1.smithi107.stdout:2/351: chown d3/da/d1e/d5f 0 1 2024-09-10T10:04:12.789 INFO:tasks.workunit.client.1.smithi107.stdout:7/296: mkdir d0/d8/d5c 0 2024-09-10T10:04:12.791 INFO:tasks.workunit.client.0.smithi071.stdout:7/242: creat d9/d15/f51 x:0 0 0 2024-09-10T10:04:12.791 INFO:tasks.workunit.client.0.smithi071.stdout:1/213: link d1/cf d1/d21/d2f/c41 0 2024-09-10T10:04:12.791 INFO:tasks.workunit.client.0.smithi071.stdout:4/252: truncate db/d15/d17/d24/f25 1702748 0 2024-09-10T10:04:12.792 INFO:tasks.workunit.client.1.smithi107.stdout:2/352: stat d3/d21/f3a 0 2024-09-10T10:04:12.793 INFO:tasks.workunit.client.0.smithi071.stdout:8/169: sync 2024-09-10T10:04:12.794 INFO:tasks.workunit.client.0.smithi071.stdout:8/170: chown d5/df/d1d/f26 959584 1 2024-09-10T10:04:12.795 INFO:tasks.workunit.client.0.smithi071.stdout:1/214: rmdir d1/d21/d2f/d30 39 2024-09-10T10:04:12.796 INFO:tasks.workunit.client.1.smithi107.stdout:8/246: creat d5/d8/d2a/d35/f59 x:0 0 0 2024-09-10T10:04:12.797 INFO:tasks.workunit.client.0.smithi071.stdout:5/214: mkdir dc/d4a 0 2024-09-10T10:04:12.800 INFO:tasks.workunit.client.1.smithi107.stdout:0/280: dwrite d6/d8/f9 [4194304,4194304] 0 2024-09-10T10:04:12.800 INFO:tasks.workunit.client.1.smithi107.stdout:7/297: mkdir d0/d8/d56/d5d 0 2024-09-10T10:04:12.800 INFO:tasks.workunit.client.0.smithi071.stdout:7/243: unlink d9/d1a/d1d/l4a 0 2024-09-10T10:04:12.801 INFO:tasks.workunit.client.1.smithi107.stdout:8/247: chown d5/d8/l15 12549 1 2024-09-10T10:04:12.802 INFO:tasks.workunit.client.1.smithi107.stdout:0/281: symlink d6/d14/l54 0 2024-09-10T10:04:12.802 INFO:tasks.workunit.client.0.smithi071.stdout:3/217: rename d3/d20/d30/d3a/c47 to d3/d49/d2f/c52 0 2024-09-10T10:04:12.804 INFO:tasks.workunit.client.0.smithi071.stdout:0/182: creat d11/d22/d40/f44 x:0 0 0 2024-09-10T10:04:12.805 INFO:tasks.workunit.client.0.smithi071.stdout:8/171: creat d5/d36/f41 x:0 0 0 2024-09-10T10:04:12.806 INFO:tasks.workunit.client.0.smithi071.stdout:1/215: mkdir d1/d21/d42 0 2024-09-10T10:04:12.808 INFO:tasks.workunit.client.1.smithi107.stdout:0/282: write d6/f23 [5137031,53711] 0 2024-09-10T10:04:12.810 INFO:tasks.workunit.client.1.smithi107.stdout:8/248: truncate d5/d8/f34 309019 0 2024-09-10T10:04:12.810 INFO:tasks.workunit.client.1.smithi107.stdout:9/363: dwrite d5/d7/d1d/d41/f48 [0,4194304] 0 2024-09-10T10:04:12.811 INFO:tasks.workunit.client.1.smithi107.stdout:0/283: write d6/f23 [2797640,2385] 0 2024-09-10T10:04:12.813 INFO:tasks.workunit.client.0.smithi071.stdout:7/244: creat d9/d1a/f52 x:0 0 0 2024-09-10T10:04:12.814 INFO:tasks.workunit.client.1.smithi107.stdout:0/284: write d6/d8/f9 [8996847,51726] 0 2024-09-10T10:04:12.816 INFO:tasks.workunit.client.0.smithi071.stdout:3/218: creat d3/d20/d39/f53 x:0 0 0 2024-09-10T10:04:12.816 INFO:tasks.workunit.client.1.smithi107.stdout:9/364: rmdir d5/d7 39 2024-09-10T10:04:12.817 INFO:tasks.workunit.client.1.smithi107.stdout:7/298: dwrite d0/d8/d9/f30 [0,4194304] 0 2024-09-10T10:04:12.824 INFO:tasks.workunit.client.0.smithi071.stdout:4/253: rmdir db/d5e 0 2024-09-10T10:04:12.825 INFO:tasks.workunit.client.1.smithi107.stdout:7/299: creat d0/d20/d35/f5e x:0 0 0 2024-09-10T10:04:12.825 INFO:tasks.workunit.client.0.smithi071.stdout:6/222: getdents d4/da/df 0 2024-09-10T10:04:12.827 INFO:tasks.workunit.client.0.smithi071.stdout:7/245: mknod d9/d1a/d1d/c53 0 2024-09-10T10:04:12.828 INFO:tasks.workunit.client.0.smithi071.stdout:0/183: dread d11/f14 [0,4194304] 0 2024-09-10T10:04:12.828 INFO:tasks.workunit.client.0.smithi071.stdout:7/246: write d9/d15/d1f/f31 [2458724,106446] 0 2024-09-10T10:04:12.828 INFO:tasks.workunit.client.1.smithi107.stdout:0/285: dwrite d6/d8/f27 [0,4194304] 0 2024-09-10T10:04:12.829 INFO:tasks.workunit.client.1.smithi107.stdout:2/353: dread d3/da/df/d20/f33 [0,4194304] 0 2024-09-10T10:04:12.831 INFO:tasks.workunit.client.0.smithi071.stdout:1/216: creat d1/d3f/f43 x:0 0 0 2024-09-10T10:04:12.832 INFO:tasks.workunit.client.1.smithi107.stdout:7/300: dread - d0/d8/f32 zero size 2024-09-10T10:04:12.833 INFO:tasks.workunit.client.1.smithi107.stdout:2/354: fdatasync d3/d21/f47 0 2024-09-10T10:04:12.833 INFO:tasks.workunit.client.0.smithi071.stdout:9/346: sync 2024-09-10T10:04:12.834 INFO:tasks.workunit.client.0.smithi071.stdout:5/215: creat dc/f4b x:0 0 0 2024-09-10T10:04:12.834 INFO:tasks.workunit.client.0.smithi071.stdout:5/216: fdatasync dc/df/f3b 0 2024-09-10T10:04:12.835 INFO:tasks.workunit.client.0.smithi071.stdout:9/347: write d0/d3b/d5c/d6a/f6c [2113267,30737] 0 2024-09-10T10:04:12.836 INFO:tasks.workunit.client.1.smithi107.stdout:7/301: dread - d0/d20/d35/f54 zero size 2024-09-10T10:04:12.837 INFO:tasks.workunit.client.1.smithi107.stdout:9/365: getdents d5/d7/d1d/d3b 0 2024-09-10T10:04:12.837 INFO:tasks.workunit.client.0.smithi071.stdout:9/348: read d0/db/d1b/d1d/f1f [536164,124994] 0 2024-09-10T10:04:12.838 INFO:tasks.workunit.client.1.smithi107.stdout:9/366: read d5/f55 [149285,71794] 0 2024-09-10T10:04:12.838 INFO:tasks.workunit.client.0.smithi071.stdout:6/223: mkdir d4/da/df/d2e/d3a/d43 0 2024-09-10T10:04:12.841 INFO:tasks.workunit.client.0.smithi071.stdout:7/247: fdatasync d9/d11/f24 0 2024-09-10T10:04:12.841 INFO:tasks.workunit.client.0.smithi071.stdout:0/184: creat d11/d30/f45 x:0 0 0 2024-09-10T10:04:12.842 INFO:tasks.workunit.client.1.smithi107.stdout:8/249: dwrite d5/d8/f13 [0,4194304] 0 2024-09-10T10:04:12.843 INFO:tasks.workunit.client.0.smithi071.stdout:5/217: dwrite dc/f3c [4194304,4194304] 0 2024-09-10T10:04:12.844 INFO:tasks.workunit.client.0.smithi071.stdout:8/172: dread d5/df/d16/f3e [4194304,4194304] 0 2024-09-10T10:04:12.845 INFO:tasks.workunit.client.0.smithi071.stdout:8/173: fsync d5/f11 0 2024-09-10T10:04:12.846 INFO:tasks.workunit.client.0.smithi071.stdout:9/349: mkdir d0/db/d1b/d1d/d5b/d60/d7a 0 2024-09-10T10:04:12.846 INFO:tasks.workunit.client.0.smithi071.stdout:1/217: mknod d1/d21/d42/c44 0 2024-09-10T10:04:12.849 INFO:tasks.workunit.client.0.smithi071.stdout:6/224: mknod d4/da/df/d2e/d3a/c44 0 2024-09-10T10:04:12.850 INFO:tasks.workunit.client.1.smithi107.stdout:4/406: dread d0/d40/d57/f3e [0,4194304] 0 2024-09-10T10:04:12.851 INFO:tasks.workunit.client.1.smithi107.stdout:9/367: creat d5/d7/d3c/d53/d57/d87/f89 x:0 0 0 2024-09-10T10:04:12.851 INFO:tasks.workunit.client.0.smithi071.stdout:6/225: write d4/f28 [80082,48416] 0 2024-09-10T10:04:12.852 INFO:tasks.workunit.client.0.smithi071.stdout:5/218: dwrite dc/f1a [4194304,4194304] 0 2024-09-10T10:04:12.853 INFO:tasks.workunit.client.1.smithi107.stdout:0/286: dread d6/d14/f2d [0,4194304] 0 2024-09-10T10:04:12.855 INFO:tasks.workunit.client.0.smithi071.stdout:5/219: dread dc/df/f1e [0,4194304] 0 2024-09-10T10:04:12.855 INFO:tasks.workunit.client.0.smithi071.stdout:6/226: dread f3 [0,4194304] 0 2024-09-10T10:04:12.857 INFO:tasks.workunit.client.0.smithi071.stdout:8/174: creat d5/df/d1e/d38/f42 x:0 0 0 2024-09-10T10:04:12.860 INFO:tasks.workunit.client.0.smithi071.stdout:9/350: creat d0/db/d20/d3c/f7b x:0 0 0 2024-09-10T10:04:12.860 INFO:tasks.workunit.client.0.smithi071.stdout:3/219: write d3/d10/d24/f25 [3119268,38400] 0 2024-09-10T10:04:12.861 INFO:tasks.workunit.client.0.smithi071.stdout:3/220: chown d3/d10/d24 371874 1 2024-09-10T10:04:12.861 INFO:tasks.workunit.client.0.smithi071.stdout:9/351: write d0/d3b/f68 [101079,29896] 0 2024-09-10T10:04:12.862 INFO:tasks.workunit.client.0.smithi071.stdout:9/352: dread - d0/db/d20/d3c/f7b zero size 2024-09-10T10:04:12.863 INFO:tasks.workunit.client.0.smithi071.stdout:3/221: read d3/f8 [351443,109700] 0 2024-09-10T10:04:12.863 INFO:tasks.workunit.client.1.smithi107.stdout:2/355: write d3/da/df/d20/d4a/f53 [2393545,80561] 0 2024-09-10T10:04:12.864 INFO:tasks.workunit.client.1.smithi107.stdout:8/250: dwrite d5/d8/dc/d21/f3e [0,4194304] 0 2024-09-10T10:04:12.865 INFO:tasks.workunit.client.0.smithi071.stdout:7/248: mknod d9/d2c/d4f/c54 0 2024-09-10T10:04:12.866 INFO:tasks.workunit.client.1.smithi107.stdout:4/407: mknod d0/d1f/c93 0 2024-09-10T10:04:12.867 INFO:tasks.workunit.client.0.smithi071.stdout:6/227: mkdir d4/da/df/d2e/d3a/d3e/d45 0 2024-09-10T10:04:12.868 INFO:tasks.workunit.client.1.smithi107.stdout:9/368: dwrite d5/f31 [0,4194304] 0 2024-09-10T10:04:12.869 INFO:tasks.workunit.client.1.smithi107.stdout:2/356: chown d3/d21/c60 53142738 1 2024-09-10T10:04:12.869 INFO:tasks.workunit.client.1.smithi107.stdout:8/251: truncate d5/d8/dc/f16 24410 0 2024-09-10T10:04:12.869 INFO:tasks.workunit.client.0.smithi071.stdout:8/175: creat d5/d30/f43 x:0 0 0 2024-09-10T10:04:12.873 INFO:tasks.workunit.client.0.smithi071.stdout:3/222: dwrite d3/f8 [0,4194304] 0 2024-09-10T10:04:12.873 INFO:tasks.workunit.client.0.smithi071.stdout:9/353: dwrite d0/db/d1b/d1d/d30/d54/f1a [8388608,4194304] 0 2024-09-10T10:04:12.873 INFO:tasks.workunit.client.1.smithi107.stdout:8/252: chown d5/d8/dc/d1a/f4d 174 1 2024-09-10T10:04:12.875 INFO:tasks.workunit.client.1.smithi107.stdout:4/408: creat d0/d1f/d90/f94 x:0 0 0 2024-09-10T10:04:12.876 INFO:tasks.workunit.client.1.smithi107.stdout:4/409: write d0/d1f/d20/f51 [678090,127399] 0 2024-09-10T10:04:12.877 INFO:tasks.workunit.client.0.smithi071.stdout:3/223: chown d3/d10/d24/d2b/f4e 49916215 1 2024-09-10T10:04:12.877 INFO:tasks.workunit.client.1.smithi107.stdout:2/357: mkdir d3/da/df/d78 0 2024-09-10T10:04:12.878 INFO:tasks.workunit.client.0.smithi071.stdout:7/249: mkdir d9/d15/d55 0 2024-09-10T10:04:12.879 INFO:tasks.workunit.client.1.smithi107.stdout:4/410: fsync d0/d40/d75/f39 0 2024-09-10T10:04:12.880 INFO:tasks.workunit.client.1.smithi107.stdout:2/358: mkdir d3/d21/d79 0 2024-09-10T10:04:12.881 INFO:tasks.workunit.client.1.smithi107.stdout:2/359: fsync d3/d21/d41/d55/d6f/f75 0 2024-09-10T10:04:12.881 INFO:tasks.workunit.client.0.smithi071.stdout:5/220: rename dc/df/d17/c42 to dc/c4c 0 2024-09-10T10:04:12.882 INFO:tasks.workunit.client.0.smithi071.stdout:6/228: dwrite d4/f19 [0,4194304] 0 2024-09-10T10:04:12.884 INFO:tasks.workunit.client.0.smithi071.stdout:9/354: symlink d0/db/d1b/d1d/d5b/d52/l7c 0 2024-09-10T10:04:12.884 INFO:tasks.workunit.client.1.smithi107.stdout:4/411: mknod d0/d40/d57/d71/c95 0 2024-09-10T10:04:12.885 INFO:tasks.workunit.client.0.smithi071.stdout:1/218: getdents d1/d21/d2f/d30 0 2024-09-10T10:04:12.885 INFO:tasks.workunit.client.1.smithi107.stdout:4/412: dread - d0/d1f/d20/d47/f85 zero size 2024-09-10T10:04:12.887 INFO:tasks.workunit.client.1.smithi107.stdout:7/302: dread d0/f4 [4194304,4194304] 0 2024-09-10T10:04:12.888 INFO:tasks.workunit.client.0.smithi071.stdout:3/224: creat d3/d20/d30/d42/d4a/f54 x:0 0 0 2024-09-10T10:04:12.891 INFO:tasks.workunit.client.0.smithi071.stdout:6/229: creat d4/da/df/d2e/d3a/d3e/d45/f46 x:0 0 0 2024-09-10T10:04:12.892 INFO:tasks.workunit.client.0.smithi071.stdout:3/225: readlink d3/d20/d39/l40 0 2024-09-10T10:04:12.896 INFO:tasks.workunit.client.0.smithi071.stdout:1/219: mknod d1/d21/d2f/c45 0 2024-09-10T10:04:12.896 INFO:tasks.workunit.client.0.smithi071.stdout:5/221: dwrite dc/f21 [0,4194304] 0 2024-09-10T10:04:12.897 INFO:tasks.workunit.client.0.smithi071.stdout:6/230: creat d4/da/df/f47 x:0 0 0 2024-09-10T10:04:12.901 INFO:tasks.workunit.client.0.smithi071.stdout:9/355: dwrite d0/d3b/d44/f5a [0,4194304] 0 2024-09-10T10:04:12.902 INFO:tasks.workunit.client.0.smithi071.stdout:5/222: creat dc/df/f4d x:0 0 0 2024-09-10T10:04:12.906 INFO:tasks.workunit.client.0.smithi071.stdout:3/226: dread d3/d1c/f22 [0,4194304] 0 2024-09-10T10:04:12.906 INFO:tasks.workunit.client.0.smithi071.stdout:0/185: truncate f7 44070 0 2024-09-10T10:04:12.909 INFO:tasks.workunit.client.0.smithi071.stdout:9/356: creat d0/db/d1b/d1d/d30/f7d x:0 0 0 2024-09-10T10:04:12.911 INFO:tasks.workunit.client.0.smithi071.stdout:2/183: sync 2024-09-10T10:04:12.914 INFO:tasks.workunit.client.0.smithi071.stdout:1/220: dwrite d1/f29 [0,4194304] 0 2024-09-10T10:04:12.914 INFO:tasks.workunit.client.1.smithi107.stdout:0/287: truncate d6/d8/f15 1589240 0 2024-09-10T10:04:12.917 INFO:tasks.workunit.client.0.smithi071.stdout:3/227: symlink d3/d49/d4f/l55 0 2024-09-10T10:04:12.918 INFO:tasks.workunit.client.0.smithi071.stdout:6/231: dwrite d4/d1c/f42 [0,4194304] 0 2024-09-10T10:04:12.920 INFO:tasks.workunit.client.0.smithi071.stdout:0/186: link d11/d1e/l42 d11/l46 0 2024-09-10T10:04:12.920 INFO:tasks.workunit.client.0.smithi071.stdout:5/223: dwrite f6 [0,4194304] 0 2024-09-10T10:04:12.921 INFO:tasks.workunit.client.0.smithi071.stdout:2/184: creat d8/d24/f2d x:0 0 0 2024-09-10T10:04:12.922 INFO:tasks.workunit.client.0.smithi071.stdout:8/176: dread d5/df/d1d/f23 [0,4194304] 0 2024-09-10T10:04:12.926 INFO:tasks.workunit.client.0.smithi071.stdout:3/228: mknod d3/d49/d34/c56 0 2024-09-10T10:04:12.926 INFO:tasks.workunit.client.1.smithi107.stdout:4/413: dread d0/d40/d57/f33 [0,4194304] 0 2024-09-10T10:04:12.927 INFO:tasks.workunit.client.0.smithi071.stdout:3/229: write d3/f41 [19705,44669] 0 2024-09-10T10:04:12.928 INFO:tasks.workunit.client.1.smithi107.stdout:2/360: dread d3/da/df/d20/d36/d4f/f58 [0,4194304] 0 2024-09-10T10:04:12.928 INFO:tasks.workunit.client.0.smithi071.stdout:9/357: getdents d0/d3b/d5c/d6a 0 2024-09-10T10:04:12.936 INFO:tasks.workunit.client.1.smithi107.stdout:2/361: dread d3/da/d1e/d5f/f34 [0,4194304] 0 2024-09-10T10:04:12.936 INFO:tasks.workunit.client.0.smithi071.stdout:5/224: symlink dc/d4a/l4e 0 2024-09-10T10:04:12.937 INFO:tasks.workunit.client.0.smithi071.stdout:7/250: truncate d9/f3e 581970 0 2024-09-10T10:04:12.939 INFO:tasks.workunit.client.0.smithi071.stdout:6/232: read d4/f28 [77187,63990] 0 2024-09-10T10:04:12.940 INFO:tasks.workunit.client.1.smithi107.stdout:2/362: rename d3/d21/c42 to d3/da/d1e/d5f/c7a 0 2024-09-10T10:04:12.941 INFO:tasks.workunit.client.0.smithi071.stdout:4/254: write db/d15/d26/f3c [530972,101534] 0 2024-09-10T10:04:12.942 INFO:tasks.workunit.client.0.smithi071.stdout:2/185: rename d8/f26 to d8/d24/f2e 0 2024-09-10T10:04:12.944 INFO:tasks.workunit.client.1.smithi107.stdout:2/363: rmdir d3/d21/d41 39 2024-09-10T10:04:12.944 INFO:tasks.workunit.client.0.smithi071.stdout:0/187: fsync f7 0 2024-09-10T10:04:12.947 INFO:tasks.workunit.client.1.smithi107.stdout:2/364: mknod d3/da/d1e/d27/d5b/c7b 0 2024-09-10T10:04:12.947 INFO:tasks.workunit.client.0.smithi071.stdout:1/221: getdents d1/d21 0 2024-09-10T10:04:12.947 INFO:tasks.workunit.client.0.smithi071.stdout:2/186: write d8/fe [2234801,14206] 0 2024-09-10T10:04:12.947 INFO:tasks.workunit.client.0.smithi071.stdout:4/255: dread - db/d15/d4b/f58 zero size 2024-09-10T10:04:12.948 INFO:tasks.workunit.client.1.smithi107.stdout:2/365: write d3/f11 [3147102,10377] 0 2024-09-10T10:04:12.949 INFO:tasks.workunit.client.0.smithi071.stdout:7/251: dwrite d9/f19 [0,4194304] 0 2024-09-10T10:04:12.949 INFO:tasks.workunit.client.0.smithi071.stdout:2/187: chown d8/d24/f2d 62 1 2024-09-10T10:04:12.951 INFO:tasks.workunit.client.1.smithi107.stdout:4/414: dwrite d0/d1f/d20/f50 [0,4194304] 0 2024-09-10T10:04:12.952 INFO:tasks.workunit.client.0.smithi071.stdout:3/230: rename d3/f6 to d3/d1c/f57 0 2024-09-10T10:04:12.952 INFO:tasks.workunit.client.0.smithi071.stdout:7/252: write d9/d1a/f30 [1219171,35374] 0 2024-09-10T10:04:12.952 INFO:tasks.workunit.client.0.smithi071.stdout:2/188: truncate d8/f28 690990 0 2024-09-10T10:04:12.955 INFO:tasks.workunit.client.1.smithi107.stdout:2/366: dread d3/da/df/d20/d36/d4f/f58 [0,4194304] 0 2024-09-10T10:04:12.956 INFO:tasks.workunit.client.1.smithi107.stdout:4/415: creat d0/d6b/f96 x:0 0 0 2024-09-10T10:04:12.957 INFO:tasks.workunit.client.1.smithi107.stdout:2/367: write d3/da/df/f45 [683,94738] 0 2024-09-10T10:04:12.963 INFO:tasks.workunit.client.1.smithi107.stdout:4/416: rename d0/d6b/l78 to d0/d40/d57/d4f/l97 0 2024-09-10T10:04:12.964 INFO:tasks.workunit.client.0.smithi071.stdout:1/222: write d1/d1e/f25 [3132946,44998] 0 2024-09-10T10:04:12.964 INFO:tasks.workunit.client.0.smithi071.stdout:5/225: link dc/df/l11 dc/df/d29/l4f 0 2024-09-10T10:04:12.965 INFO:tasks.workunit.client.1.smithi107.stdout:2/368: mkdir d3/d21/d41/d55/d6f/d7c 0 2024-09-10T10:04:12.965 INFO:tasks.workunit.client.0.smithi071.stdout:4/256: dwrite db/d1d/f36 [0,4194304] 0 2024-09-10T10:04:12.966 INFO:tasks.workunit.client.0.smithi071.stdout:8/177: truncate d5/d30/f3c 91677 0 2024-09-10T10:04:12.967 INFO:tasks.workunit.client.0.smithi071.stdout:2/189: mknod d8/d13/c2f 0 2024-09-10T10:04:12.968 INFO:tasks.workunit.client.1.smithi107.stdout:2/369: creat d3/da/d1e/d5f/d54/f7d x:0 0 0 2024-09-10T10:04:12.969 INFO:tasks.workunit.client.0.smithi071.stdout:5/226: truncate dc/df/d17/d22/f45 297492 0 2024-09-10T10:04:12.970 INFO:tasks.workunit.client.0.smithi071.stdout:8/178: truncate d5/df/d1d/f26 779286 0 2024-09-10T10:04:12.970 INFO:tasks.workunit.client.0.smithi071.stdout:5/227: dread - dc/fe zero size 2024-09-10T10:04:12.971 INFO:tasks.workunit.client.0.smithi071.stdout:4/257: creat db/d15/d17/f60 x:0 0 0 2024-09-10T10:04:12.972 INFO:tasks.workunit.client.1.smithi107.stdout:2/370: creat d3/d21/d79/f7e x:0 0 0 2024-09-10T10:04:12.972 INFO:tasks.workunit.client.0.smithi071.stdout:9/358: dread d0/db/d1b/d1d/f35 [0,4194304] 0 2024-09-10T10:04:12.972 INFO:tasks.workunit.client.0.smithi071.stdout:4/258: write f3 [5703146,11963] 0 2024-09-10T10:04:12.973 INFO:tasks.workunit.client.0.smithi071.stdout:7/253: link d9/d15/d1f/f3f d9/d2c/f56 0 2024-09-10T10:04:12.973 INFO:tasks.workunit.client.1.smithi107.stdout:2/371: stat d3/da/df/d20/d36/d4f 0 2024-09-10T10:04:12.974 INFO:tasks.workunit.client.0.smithi071.stdout:7/254: fdatasync d9/d11/f14 0 2024-09-10T10:04:12.974 INFO:tasks.workunit.client.0.smithi071.stdout:0/188: link d11/d30/l43 d11/l47 0 2024-09-10T10:04:12.977 INFO:tasks.workunit.client.0.smithi071.stdout:5/228: creat dc/d4a/f50 x:0 0 0 2024-09-10T10:04:12.978 INFO:tasks.workunit.client.0.smithi071.stdout:5/229: chown dc/l37 1010 1 2024-09-10T10:04:12.979 INFO:tasks.workunit.client.0.smithi071.stdout:5/230: fdatasync dc/df/f4d 0 2024-09-10T10:04:12.980 INFO:tasks.workunit.client.0.smithi071.stdout:4/259: mkdir db/d1d/d61 0 2024-09-10T10:04:12.982 INFO:tasks.workunit.client.0.smithi071.stdout:9/359: creat d0/db/d20/f7e x:0 0 0 2024-09-10T10:04:12.982 INFO:tasks.workunit.client.0.smithi071.stdout:2/190: mknod d8/c30 0 2024-09-10T10:04:12.982 INFO:tasks.workunit.client.1.smithi107.stdout:2/372: rename d3/d21/d41 to d3/da/df/d62/d7f 0 2024-09-10T10:04:12.983 INFO:tasks.workunit.client.1.smithi107.stdout:4/417: write d0/d40/d75/d3f/f5b [1909772,29143] 0 2024-09-10T10:04:12.984 INFO:tasks.workunit.client.0.smithi071.stdout:4/260: write db/d1d/f36 [870427,124656] 0 2024-09-10T10:04:12.985 INFO:tasks.workunit.client.0.smithi071.stdout:3/231: write d3/d20/f2c [602547,40260] 0 2024-09-10T10:04:12.985 INFO:tasks.workunit.client.0.smithi071.stdout:0/189: dwrite d11/d22/f25 [0,4194304] 0 2024-09-10T10:04:12.986 INFO:tasks.workunit.client.1.smithi107.stdout:2/373: truncate d3/da/df/d62/d7f/d55/f64 880664 0 2024-09-10T10:04:12.987 INFO:tasks.workunit.client.0.smithi071.stdout:0/190: fsync d11/d22/f23 0 2024-09-10T10:04:12.987 INFO:tasks.workunit.client.0.smithi071.stdout:7/255: rename d9/d15/f41 to d9/d1a/d1d/f57 0 2024-09-10T10:04:12.987 INFO:tasks.workunit.client.1.smithi107.stdout:2/374: dread - d3/da/df/d20/d36/f76 zero size 2024-09-10T10:04:12.991 INFO:tasks.workunit.client.1.smithi107.stdout:4/418: write d0/d1f/f34 [7856390,42414] 0 2024-09-10T10:04:12.992 INFO:tasks.workunit.client.1.smithi107.stdout:4/419: write d0/d40/d75/f39 [2295127,15790] 0 2024-09-10T10:04:12.994 INFO:tasks.workunit.client.1.smithi107.stdout:2/375: write d3/da/df/f48 [582694,56774] 0 2024-09-10T10:04:12.994 INFO:tasks.workunit.client.1.smithi107.stdout:4/420: fsync d0/d40/f6a 0 2024-09-10T10:04:12.995 INFO:tasks.workunit.client.0.smithi071.stdout:7/256: dwrite d9/d15/d1f/f31 [0,4194304] 0 2024-09-10T10:04:12.995 INFO:tasks.workunit.client.0.smithi071.stdout:6/233: dread d4/da/df/d2e/f32 [0,4194304] 0 2024-09-10T10:04:12.996 INFO:tasks.workunit.client.0.smithi071.stdout:6/234: stat d4/da/df/l2a 0 2024-09-10T10:04:12.998 INFO:tasks.workunit.client.1.smithi107.stdout:4/421: creat d0/d40/d57/d76/d77/f98 x:0 0 0 2024-09-10T10:04:13.000 INFO:tasks.workunit.client.0.smithi071.stdout:4/261: creat db/f62 x:0 0 0 2024-09-10T10:04:13.001 INFO:tasks.workunit.client.0.smithi071.stdout:4/262: fsync db/d15/d17/f3f 0 2024-09-10T10:04:13.001 INFO:tasks.workunit.client.0.smithi071.stdout:0/191: creat d11/d22/d40/f48 x:0 0 0 2024-09-10T10:04:13.002 INFO:tasks.workunit.client.0.smithi071.stdout:0/192: stat d11/d22/l3f 0 2024-09-10T10:04:13.003 INFO:tasks.workunit.client.1.smithi107.stdout:4/422: link d0/cd d0/d40/d75/d3f/d59/c99 0 2024-09-10T10:04:13.003 INFO:tasks.workunit.client.0.smithi071.stdout:5/231: mknod dc/df/d29/d48/c51 0 2024-09-10T10:04:13.004 INFO:tasks.workunit.client.0.smithi071.stdout:2/191: rmdir d8 39 2024-09-10T10:04:13.005 INFO:tasks.workunit.client.0.smithi071.stdout:1/223: truncate d1/d21/d2f/f39 816230 0 2024-09-10T10:04:13.006 INFO:tasks.workunit.client.0.smithi071.stdout:8/179: link d5/df/d1d/c2b d5/c44 0 2024-09-10T10:04:13.008 INFO:tasks.workunit.client.0.smithi071.stdout:3/232: mkdir d3/d1c/d3c/d58 0 2024-09-10T10:04:13.011 INFO:tasks.workunit.client.0.smithi071.stdout:4/263: write db/d15/d26/d43/f44 [422980,7393] 0 2024-09-10T10:04:13.013 INFO:tasks.workunit.client.0.smithi071.stdout:7/257: mkdir d9/d15/d55/d58 0 2024-09-10T10:04:13.014 INFO:tasks.workunit.client.1.smithi107.stdout:4/423: truncate d0/d1f/f60 722970 0 2024-09-10T10:04:13.015 INFO:tasks.workunit.client.0.smithi071.stdout:5/232: dwrite dc/df/d17/d22/f2f [0,4194304] 0 2024-09-10T10:04:13.015 INFO:tasks.workunit.client.0.smithi071.stdout:4/264: chown db/d1d/d61 135 1 2024-09-10T10:04:13.015 INFO:tasks.workunit.client.0.smithi071.stdout:7/258: fsync d9/d1a/f52 0 2024-09-10T10:04:13.017 INFO:tasks.workunit.client.1.smithi107.stdout:4/424: mknod d0/d40/d57/d76/d77/d8d/c9a 0 2024-09-10T10:04:13.020 INFO:tasks.workunit.client.0.smithi071.stdout:9/360: truncate d0/f6 3612413 0 2024-09-10T10:04:13.020 INFO:tasks.workunit.client.0.smithi071.stdout:5/233: truncate dc/df/f4d 955464 0 2024-09-10T10:04:13.021 INFO:tasks.workunit.client.1.smithi107.stdout:2/376: dread d3/da/df/f15 [0,4194304] 0 2024-09-10T10:04:13.025 INFO:tasks.workunit.client.0.smithi071.stdout:7/259: creat d9/d11/f59 x:0 0 0 2024-09-10T10:04:13.025 INFO:tasks.workunit.client.0.smithi071.stdout:1/224: dwrite d1/f37 [4194304,4194304] 0 2024-09-10T10:04:13.025 INFO:tasks.workunit.client.1.smithi107.stdout:2/377: creat d3/da/df/d78/f80 x:0 0 0 2024-09-10T10:04:13.027 INFO:tasks.workunit.client.0.smithi071.stdout:3/233: dread d3/f21 [0,4194304] 0 2024-09-10T10:04:13.027 INFO:tasks.workunit.client.0.smithi071.stdout:9/361: creat d0/d3b/d5c/f7f x:0 0 0 2024-09-10T10:04:13.027 INFO:tasks.workunit.client.1.smithi107.stdout:2/378: write d3/da/df/f15 [1837508,61910] 0 2024-09-10T10:04:13.028 INFO:tasks.workunit.client.0.smithi071.stdout:4/265: fsync db/d15/d4b/f5f 0 2024-09-10T10:04:13.029 INFO:tasks.workunit.client.0.smithi071.stdout:2/192: truncate d8/f28 393207 0 2024-09-10T10:04:13.030 INFO:tasks.workunit.client.0.smithi071.stdout:5/234: rename dc/df/f4d to dc/df/d3e/f52 0 2024-09-10T10:04:13.031 INFO:tasks.workunit.client.0.smithi071.stdout:3/234: truncate d3/d49/d2f/f35 917099 0 2024-09-10T10:04:13.033 INFO:tasks.workunit.client.1.smithi107.stdout:4/425: dread d0/d1f/d20/f2c [0,4194304] 0 2024-09-10T10:04:13.035 INFO:tasks.workunit.client.0.smithi071.stdout:3/235: chown d3/f8 319526786 1 2024-09-10T10:04:13.039 INFO:tasks.workunit.client.0.smithi071.stdout:4/266: creat db/d15/d26/f63 x:0 0 0 2024-09-10T10:04:13.040 INFO:tasks.workunit.client.0.smithi071.stdout:5/235: unlink dc/f1a 0 2024-09-10T10:04:13.043 INFO:tasks.workunit.client.0.smithi071.stdout:0/193: dwrite d11/f17 [0,4194304] 0 2024-09-10T10:04:13.045 INFO:tasks.workunit.client.0.smithi071.stdout:3/236: creat d3/d20/d30/d42/d4a/f59 x:0 0 0 2024-09-10T10:04:13.046 INFO:tasks.workunit.client.0.smithi071.stdout:4/267: write db/f62 [934890,67278] 0 2024-09-10T10:04:13.048 INFO:tasks.workunit.client.0.smithi071.stdout:3/237: truncate d3/f36 654317 0 2024-09-10T10:04:13.050 INFO:tasks.workunit.client.0.smithi071.stdout:9/362: dwrite d0/db/d20/d3c/f64 [0,4194304] 0 2024-09-10T10:04:13.050 INFO:tasks.workunit.client.0.smithi071.stdout:8/180: dread d5/df/d16/f29 [8388608,4194304] 0 2024-09-10T10:04:13.051 INFO:tasks.workunit.client.0.smithi071.stdout:1/225: creat d1/d21/d2f/f46 x:0 0 0 2024-09-10T10:04:13.051 INFO:tasks.workunit.client.0.smithi071.stdout:3/238: stat d3/d10 0 2024-09-10T10:04:13.052 INFO:tasks.workunit.client.0.smithi071.stdout:8/181: write d5/f33 [249322,76738] 0 2024-09-10T10:04:13.054 INFO:tasks.workunit.client.0.smithi071.stdout:0/194: write f0 [4493000,58954] 0 2024-09-10T10:04:13.055 INFO:tasks.workunit.client.0.smithi071.stdout:5/236: mkdir dc/d53 0 2024-09-10T10:04:13.057 INFO:tasks.workunit.client.1.smithi107.stdout:4/426: rename d0/d6b/f6c to d0/d1f/d20/d47/f9b 0 2024-09-10T10:04:13.057 INFO:tasks.workunit.client.0.smithi071.stdout:9/363: mknod d0/db/d1b/d1d/c80 0 2024-09-10T10:04:13.059 INFO:tasks.workunit.client.0.smithi071.stdout:3/239: rename d3/f9 to d3/d10/d24/d2b/f5a 0 2024-09-10T10:04:13.065 INFO:tasks.workunit.client.0.smithi071.stdout:0/195: creat d11/d22/d31/f49 x:0 0 0 2024-09-10T10:04:13.066 INFO:tasks.workunit.client.1.smithi107.stdout:4/427: mknod d0/d40/d57/d4f/c9c 0 2024-09-10T10:04:13.068 INFO:tasks.workunit.client.0.smithi071.stdout:1/226: dwrite d1/d21/d2f/d30/f31 [0,4194304] 0 2024-09-10T10:04:13.068 INFO:tasks.workunit.client.0.smithi071.stdout:2/193: write d8/f28 [959365,104176] 0 2024-09-10T10:04:13.069 INFO:tasks.workunit.client.1.smithi107.stdout:4/428: mkdir d0/d6b/d9d 0 2024-09-10T10:04:13.073 INFO:tasks.workunit.client.1.smithi107.stdout:4/429: dread d0/d40/d57/f33 [0,4194304] 0 2024-09-10T10:04:13.075 INFO:tasks.workunit.client.1.smithi107.stdout:4/430: truncate d0/d40/f6a 633740 0 2024-09-10T10:04:13.076 INFO:tasks.workunit.client.1.smithi107.stdout:4/431: read d0/d1f/d20/f70 [414169,5292] 0 2024-09-10T10:04:13.077 INFO:tasks.workunit.client.0.smithi071.stdout:0/196: creat d11/d22/d40/f4a x:0 0 0 2024-09-10T10:04:13.077 INFO:tasks.workunit.client.1.smithi107.stdout:4/432: chown d0/d40/d57/d71/c95 89 1 2024-09-10T10:04:13.080 INFO:tasks.workunit.client.0.smithi071.stdout:4/268: write db/d15/d17/f18 [933469,124410] 0 2024-09-10T10:04:13.080 INFO:tasks.workunit.client.0.smithi071.stdout:8/182: rename d5/df/d16/f22 to d5/f45 0 2024-09-10T10:04:13.080 INFO:tasks.workunit.client.0.smithi071.stdout:9/364: dwrite d0/d3b/d5c/f74 [0,4194304] 0 2024-09-10T10:04:13.082 INFO:tasks.workunit.client.0.smithi071.stdout:2/194: symlink d8/l31 0 2024-09-10T10:04:13.084 INFO:tasks.workunit.client.1.smithi107.stdout:2/379: symlink d3/da/df/d20/d36/l81 0 2024-09-10T10:04:13.085 INFO:tasks.workunit.client.1.smithi107.stdout:2/380: dread - d3/da/df/d20/d36/f76 zero size 2024-09-10T10:04:13.085 INFO:tasks.workunit.client.0.smithi071.stdout:5/237: rename dc/df/l49 to dc/df/d29/d48/l54 0 2024-09-10T10:04:13.088 INFO:tasks.workunit.client.0.smithi071.stdout:4/269: read db/d15/d26/d43/f44 [29835,63380] 0 2024-09-10T10:04:13.089 INFO:tasks.workunit.client.0.smithi071.stdout:5/238: read dc/df/f1e [1678198,99958] 0 2024-09-10T10:04:13.090 INFO:tasks.workunit.client.0.smithi071.stdout:3/240: dwrite d3/d1c/f57 [4194304,4194304] 0 2024-09-10T10:04:13.090 INFO:tasks.workunit.client.0.smithi071.stdout:8/183: symlink d5/df/d1e/l46 0 2024-09-10T10:04:13.092 INFO:tasks.workunit.client.1.smithi107.stdout:2/381: dread d3/da/df/f48 [0,4194304] 0 2024-09-10T10:04:13.092 INFO:tasks.workunit.client.0.smithi071.stdout:1/227: dwrite d1/d3f/f43 [0,4194304] 0 2024-09-10T10:04:13.095 INFO:tasks.workunit.client.0.smithi071.stdout:4/270: write db/d1d/f23 [4298980,90888] 0 2024-09-10T10:04:13.096 INFO:tasks.workunit.client.0.smithi071.stdout:5/239: write dc/df/d17/d22/f35 [551863,38983] 0 2024-09-10T10:04:13.096 INFO:tasks.workunit.client.0.smithi071.stdout:9/365: symlink d0/db/d1b/d46/l81 0 2024-09-10T10:04:13.097 INFO:tasks.workunit.client.1.smithi107.stdout:4/433: symlink d0/d1f/d20/l9e 0 2024-09-10T10:04:13.097 INFO:tasks.workunit.client.0.smithi071.stdout:3/241: mknod d3/d1c/d3c/c5b 0 2024-09-10T10:04:13.098 INFO:tasks.workunit.client.1.smithi107.stdout:4/434: dread - d0/d1f/d20/d47/f85 zero size 2024-09-10T10:04:13.100 INFO:tasks.workunit.client.0.smithi071.stdout:1/228: unlink d1/f2c 0 2024-09-10T10:04:13.101 INFO:tasks.workunit.client.0.smithi071.stdout:0/197: rename fd to d11/d30/f4b 0 2024-09-10T10:04:13.102 INFO:tasks.workunit.client.1.smithi107.stdout:4/435: mknod d0/d40/d75/d3f/c9f 0 2024-09-10T10:04:13.104 INFO:tasks.workunit.client.0.smithi071.stdout:5/240: unlink la 0 2024-09-10T10:04:13.104 INFO:tasks.workunit.client.1.smithi107.stdout:4/436: write d0/d40/d57/f33 [3744746,30722] 0 2024-09-10T10:04:13.105 INFO:tasks.workunit.client.1.smithi107.stdout:4/437: readlink d0/d82/l83 0 2024-09-10T10:04:13.105 INFO:tasks.workunit.client.0.smithi071.stdout:1/229: dread d1/d1e/f25 [4194304,4194304] 0 2024-09-10T10:04:13.106 INFO:tasks.workunit.client.1.smithi107.stdout:4/438: write d0/d40/d75/f46 [5460,108583] 0 2024-09-10T10:04:13.108 INFO:tasks.workunit.client.0.smithi071.stdout:9/366: creat d0/db/d20/d3c/f82 x:0 0 0 2024-09-10T10:04:13.108 INFO:tasks.workunit.client.1.smithi107.stdout:4/439: creat d0/d40/d57/d4f/fa0 x:0 0 0 2024-09-10T10:04:13.109 INFO:tasks.workunit.client.1.smithi107.stdout:4/440: chown d0/d1f/d20/f5d 1976 1 2024-09-10T10:04:13.112 INFO:tasks.workunit.client.0.smithi071.stdout:4/271: rename db/f2a to db/d15/d4b/f64 0 2024-09-10T10:04:13.116 INFO:tasks.workunit.client.0.smithi071.stdout:9/367: chown d0/cd 110 1 2024-09-10T10:04:13.116 INFO:tasks.workunit.client.0.smithi071.stdout:2/195: link d8/l21 d8/d13/l32 0 2024-09-10T10:04:13.120 INFO:tasks.workunit.client.0.smithi071.stdout:5/241: symlink dc/d53/l55 0 2024-09-10T10:04:13.120 INFO:tasks.workunit.client.1.smithi107.stdout:4/441: dwrite d0/d1f/d20/f51 [0,4194304] 0 2024-09-10T10:04:13.120 INFO:tasks.workunit.client.1.smithi107.stdout:4/442: fdatasync d0/d1f/f55 0 2024-09-10T10:04:13.121 INFO:tasks.workunit.client.0.smithi071.stdout:8/184: getdents d5/df/d1d 0 2024-09-10T10:04:13.121 INFO:tasks.workunit.client.1.smithi107.stdout:4/443: fdatasync d0/d40/d75/d3f/f4b 0 2024-09-10T10:04:13.122 INFO:tasks.workunit.client.0.smithi071.stdout:1/230: symlink d1/d21/d3d/l47 0 2024-09-10T10:04:13.125 INFO:tasks.workunit.client.0.smithi071.stdout:1/231: read d1/f37 [1095640,60909] 0 2024-09-10T10:04:13.126 INFO:tasks.workunit.client.0.smithi071.stdout:2/196: read d8/ff [1961027,17103] 0 2024-09-10T10:04:13.130 INFO:tasks.workunit.client.1.smithi107.stdout:4/444: rename d0/d40/d75/d3f to d0/d40/d57/d76/d77/da1 0 2024-09-10T10:04:13.131 INFO:tasks.workunit.client.0.smithi071.stdout:3/242: truncate d3/d1c/f57 2042678 0 2024-09-10T10:04:13.132 INFO:tasks.workunit.client.0.smithi071.stdout:9/368: mknod d0/db/d20/d3c/d75/c83 0 2024-09-10T10:04:13.133 INFO:tasks.workunit.client.0.smithi071.stdout:0/198: truncate d11/d22/d31/f41 366704 0 2024-09-10T10:04:13.135 INFO:tasks.workunit.client.0.smithi071.stdout:2/197: mkdir d8/d13/d33 0 2024-09-10T10:04:13.141 INFO:tasks.workunit.client.0.smithi071.stdout:5/242: truncate f4 3712811 0 2024-09-10T10:04:13.141 INFO:tasks.workunit.client.0.smithi071.stdout:3/243: dwrite d3/d49/f4c [0,4194304] 0 2024-09-10T10:04:13.141 INFO:tasks.workunit.client.0.smithi071.stdout:4/272: getdents db/d15/d17/d4e 0 2024-09-10T10:04:13.143 INFO:tasks.workunit.client.0.smithi071.stdout:0/199: rmdir d11/d30 39 2024-09-10T10:04:13.147 INFO:tasks.workunit.client.0.smithi071.stdout:1/232: chown d1/fd 894313561 1 2024-09-10T10:04:13.152 INFO:tasks.workunit.client.0.smithi071.stdout:0/200: creat d11/d22/d31/f4c x:0 0 0 2024-09-10T10:04:13.153 INFO:tasks.workunit.client.0.smithi071.stdout:8/185: getdents d5/df 0 2024-09-10T10:04:13.154 INFO:tasks.workunit.client.0.smithi071.stdout:8/186: chown d5/df/d1d/f23 47973200 1 2024-09-10T10:04:13.154 INFO:tasks.workunit.client.0.smithi071.stdout:4/273: creat db/d15/d17/d4e/d5a/f65 x:0 0 0 2024-09-10T10:04:13.154 INFO:tasks.workunit.client.0.smithi071.stdout:2/198: mknod d8/d13/d33/c34 0 2024-09-10T10:04:13.155 INFO:tasks.workunit.client.0.smithi071.stdout:4/274: read db/f55 [302810,97920] 0 2024-09-10T10:04:13.155 INFO:tasks.workunit.client.0.smithi071.stdout:4/275: fdatasync f9 0 2024-09-10T10:04:13.156 INFO:tasks.workunit.client.1.smithi107.stdout:4/445: dread d0/d40/d57/d76/d77/da1/f5b [0,4194304] 0 2024-09-10T10:04:13.157 INFO:tasks.workunit.client.0.smithi071.stdout:3/244: truncate d3/ff 408337 0 2024-09-10T10:04:13.158 INFO:tasks.workunit.client.1.smithi107.stdout:4/446: truncate d0/d1f/d20/f17 1900813 0 2024-09-10T10:04:13.159 INFO:tasks.workunit.client.0.smithi071.stdout:8/187: rmdir d5/df/d1e/d38 39 2024-09-10T10:04:13.159 INFO:tasks.workunit.client.0.smithi071.stdout:0/201: read d11/d30/f4b [3092857,14865] 0 2024-09-10T10:04:13.160 INFO:tasks.workunit.client.0.smithi071.stdout:2/199: mknod d8/d13/c35 0 2024-09-10T10:04:13.160 INFO:tasks.workunit.client.0.smithi071.stdout:9/369: dread d0/db/d20/d21/f4f [0,4194304] 0 2024-09-10T10:04:13.161 INFO:tasks.workunit.client.0.smithi071.stdout:0/202: dread d11/d22/f2e [0,4194304] 0 2024-09-10T10:04:13.161 INFO:tasks.workunit.client.0.smithi071.stdout:2/200: write d8/fe [1139649,33697] 0 2024-09-10T10:04:13.163 INFO:tasks.workunit.client.0.smithi071.stdout:0/203: fsync d11/d22/d31/f4c 0 2024-09-10T10:04:13.163 INFO:tasks.workunit.client.0.smithi071.stdout:9/370: write d0/db/d1b/d1d/d5b/d52/f5d [4000172,51901] 0 2024-09-10T10:04:13.163 INFO:tasks.workunit.client.0.smithi071.stdout:5/243: link dc/df/d17/d22/c2e dc/df/d17/d22/c56 0 2024-09-10T10:04:13.165 INFO:tasks.workunit.client.0.smithi071.stdout:3/245: mknod d3/d1c/d3c/c5c 0 2024-09-10T10:04:13.165 INFO:tasks.workunit.client.1.smithi107.stdout:4/447: dwrite d0/d40/d57/d4f/fa0 [0,4194304] 0 2024-09-10T10:04:13.166 INFO:tasks.workunit.client.0.smithi071.stdout:8/188: symlink d5/df/d16/l47 0 2024-09-10T10:04:13.167 INFO:tasks.workunit.client.0.smithi071.stdout:8/189: chown d5/df/d1d 1737480 1 2024-09-10T10:04:13.172 INFO:tasks.workunit.client.0.smithi071.stdout:9/371: dwrite d0/db/d20/d3c/f7b [0,4194304] 0 2024-09-10T10:04:13.174 INFO:tasks.workunit.client.0.smithi071.stdout:4/276: link db/f46 db/d15/d26/d43/f66 0 2024-09-10T10:04:13.174 INFO:tasks.workunit.client.0.smithi071.stdout:2/201: creat d8/d13/d33/f36 x:0 0 0 2024-09-10T10:04:13.175 INFO:tasks.workunit.client.1.smithi107.stdout:4/448: truncate d0/f12 6752533 0 2024-09-10T10:04:13.176 INFO:tasks.workunit.client.0.smithi071.stdout:5/244: creat dc/df/f57 x:0 0 0 2024-09-10T10:04:13.176 INFO:tasks.workunit.client.0.smithi071.stdout:9/372: truncate d0/db/d20/d3c/f82 372132 0 2024-09-10T10:04:13.177 INFO:tasks.workunit.client.0.smithi071.stdout:5/245: chown dc/c40 31884167 1 2024-09-10T10:04:13.178 INFO:tasks.workunit.client.0.smithi071.stdout:1/233: rename d1/l8 to d1/d21/l48 0 2024-09-10T10:04:13.180 INFO:tasks.workunit.client.0.smithi071.stdout:4/277: unlink db/d15/d26/d43/d4d/l42 0 2024-09-10T10:04:13.180 INFO:tasks.workunit.client.0.smithi071.stdout:4/278: chown db/d15/d26/d43/f50 497 1 2024-09-10T10:04:13.181 INFO:tasks.workunit.client.0.smithi071.stdout:8/190: creat d5/df/d1e/d38/f48 x:0 0 0 2024-09-10T10:04:13.182 INFO:tasks.workunit.client.0.smithi071.stdout:0/204: truncate d11/d1e/f24 1189797 0 2024-09-10T10:04:13.186 INFO:tasks.workunit.client.0.smithi071.stdout:9/373: symlink d0/db/d1b/d1d/d30/d54/l84 0 2024-09-10T10:04:13.186 INFO:tasks.workunit.client.0.smithi071.stdout:9/374: readlink d0/db/d20/d21/l31 0 2024-09-10T10:04:13.187 INFO:tasks.workunit.client.0.smithi071.stdout:9/375: write d0/d3b/d44/f5f [1332898,43164] 0 2024-09-10T10:04:13.190 INFO:tasks.workunit.client.0.smithi071.stdout:8/191: dread d5/d30/f3c [0,4194304] 0 2024-09-10T10:04:13.190 INFO:tasks.workunit.client.0.smithi071.stdout:0/205: rmdir d11/d22/d40 39 2024-09-10T10:04:13.191 INFO:tasks.workunit.client.0.smithi071.stdout:0/206: write d11/d22/f23 [50307,101846] 0 2024-09-10T10:04:13.193 INFO:tasks.workunit.client.0.smithi071.stdout:9/376: rmdir d0/db/d20/d3c/d75 39 2024-09-10T10:04:13.194 INFO:tasks.workunit.client.0.smithi071.stdout:8/192: mkdir d5/d36/d49 0 2024-09-10T10:04:13.195 INFO:tasks.workunit.client.0.smithi071.stdout:1/234: getdents d1/d35 0 2024-09-10T10:04:13.197 INFO:tasks.workunit.client.0.smithi071.stdout:8/193: mknod d5/df/d1e/d38/c4a 0 2024-09-10T10:04:13.199 INFO:tasks.workunit.client.0.smithi071.stdout:8/194: chown d5/df/d1d/f23 0 1 2024-09-10T10:04:13.200 INFO:tasks.workunit.client.0.smithi071.stdout:1/235: fsync d1/d1e/f25 0 2024-09-10T10:04:13.203 INFO:tasks.workunit.client.0.smithi071.stdout:0/207: dwrite d11/d22/d40/f48 [0,4194304] 0 2024-09-10T10:04:13.205 INFO:tasks.workunit.client.0.smithi071.stdout:9/377: rename d0/c23 to d0/db/d20/d3c/c85 0 2024-09-10T10:04:13.205 INFO:tasks.workunit.client.0.smithi071.stdout:2/202: write d8/d24/f2e [418680,108736] 0 2024-09-10T10:04:13.206 INFO:tasks.workunit.client.0.smithi071.stdout:1/236: rmdir d1/d21/d2f/d30 39 2024-09-10T10:04:13.211 INFO:tasks.workunit.client.0.smithi071.stdout:0/208: dwrite d11/d22/f29 [0,4194304] 0 2024-09-10T10:04:13.214 INFO:tasks.workunit.client.0.smithi071.stdout:8/195: link d5/df/d1e/l46 d5/d30/l4b 0 2024-09-10T10:04:13.217 INFO:tasks.workunit.client.0.smithi071.stdout:2/203: rename d8/c2a to d8/d24/c37 0 2024-09-10T10:04:13.218 INFO:tasks.workunit.client.0.smithi071.stdout:4/279: dread db/d15/d17/f3d [0,4194304] 0 2024-09-10T10:04:13.219 INFO:tasks.workunit.client.0.smithi071.stdout:2/204: write d8/d24/f2d [455351,67640] 0 2024-09-10T10:04:13.221 INFO:tasks.workunit.client.0.smithi071.stdout:4/280: fdatasync db/d15/d17/f3f 0 2024-09-10T10:04:13.221 INFO:tasks.workunit.client.0.smithi071.stdout:4/281: stat db/d15/d4b 0 2024-09-10T10:04:13.222 INFO:tasks.workunit.client.0.smithi071.stdout:0/209: unlink d11/d1e/f24 0 2024-09-10T10:04:13.224 INFO:tasks.workunit.client.0.smithi071.stdout:9/378: dwrite d0/f2e [0,4194304] 0 2024-09-10T10:04:13.224 INFO:tasks.workunit.client.0.smithi071.stdout:4/282: write db/d15/d26/f3c [2440952,124550] 0 2024-09-10T10:04:13.225 INFO:tasks.workunit.client.0.smithi071.stdout:0/210: readlink la 0 2024-09-10T10:04:13.225 INFO:tasks.workunit.client.0.smithi071.stdout:4/283: stat db/f1b 0 2024-09-10T10:04:13.227 INFO:tasks.workunit.client.0.smithi071.stdout:0/211: chown d11/d30/f4b 499550 1 2024-09-10T10:04:13.227 INFO:tasks.workunit.client.0.smithi071.stdout:9/379: stat d0/db/d1b/d1d/d30/d54/d27/f58 0 2024-09-10T10:04:13.227 INFO:tasks.workunit.client.0.smithi071.stdout:1/237: rename d1/d21/l48 to d1/l49 0 2024-09-10T10:04:13.228 INFO:tasks.workunit.client.0.smithi071.stdout:2/205: mkdir d8/d38 0 2024-09-10T10:04:13.229 INFO:tasks.workunit.client.0.smithi071.stdout:2/206: stat d8/fb 0 2024-09-10T10:04:13.233 INFO:tasks.workunit.client.0.smithi071.stdout:4/284: dwrite db/d1d/f23 [0,4194304] 0 2024-09-10T10:04:13.233 INFO:tasks.workunit.client.0.smithi071.stdout:0/212: rename d11/d1e/l42 to d11/d30/l4d 0 2024-09-10T10:04:13.234 INFO:tasks.workunit.client.0.smithi071.stdout:4/285: readlink db/d1d/l20 0 2024-09-10T10:04:13.235 INFO:tasks.workunit.client.0.smithi071.stdout:9/380: fsync d0/db/d1b/d1d/d30/d54/d27/f2c 0 2024-09-10T10:04:13.237 INFO:tasks.workunit.client.0.smithi071.stdout:9/381: fdatasync d0/db/d1b/d1d/d30/d54/f1a 0 2024-09-10T10:04:13.239 INFO:tasks.workunit.client.0.smithi071.stdout:4/286: mknod db/d15/d26/d43/d4d/c67 0 2024-09-10T10:04:13.239 INFO:tasks.workunit.client.0.smithi071.stdout:0/213: dread d11/d22/d31/f41 [0,4194304] 0 2024-09-10T10:04:13.240 INFO:tasks.workunit.client.0.smithi071.stdout:9/382: fsync d0/db/d20/d3c/f76 0 2024-09-10T10:04:13.241 INFO:tasks.workunit.client.0.smithi071.stdout:4/287: readlink db/d15/d17/d24/l2d 0 2024-09-10T10:04:13.241 INFO:tasks.workunit.client.0.smithi071.stdout:8/196: dread d5/f28 [4194304,4194304] 0 2024-09-10T10:04:13.243 INFO:tasks.workunit.client.0.smithi071.stdout:9/383: truncate d0/d3b/d44/f5f 1929353 0 2024-09-10T10:04:13.244 INFO:tasks.workunit.client.0.smithi071.stdout:4/288: unlink f9 0 2024-09-10T10:04:13.246 INFO:tasks.workunit.client.0.smithi071.stdout:8/197: creat d5/df/d1e/d38/f4c x:0 0 0 2024-09-10T10:04:13.247 INFO:tasks.workunit.client.0.smithi071.stdout:9/384: creat d0/d3b/f86 x:0 0 0 2024-09-10T10:04:13.248 INFO:tasks.workunit.client.0.smithi071.stdout:0/214: creat d11/d22/f4e x:0 0 0 2024-09-10T10:04:13.249 INFO:tasks.workunit.client.0.smithi071.stdout:9/385: dread - d0/db/d1b/d1d/d5b/f70 zero size 2024-09-10T10:04:13.252 INFO:tasks.workunit.client.0.smithi071.stdout:4/289: dwrite db/d15/d26/f63 [0,4194304] 0 2024-09-10T10:04:13.255 INFO:tasks.workunit.client.0.smithi071.stdout:4/290: fdatasync db/d15/d26/d43/d4d/f3b 0 2024-09-10T10:04:13.257 INFO:tasks.workunit.client.0.smithi071.stdout:8/198: dwrite d5/fa [0,4194304] 0 2024-09-10T10:04:13.257 INFO:tasks.workunit.client.0.smithi071.stdout:9/386: getdents d0/db/d1b/d1d/d30 0 2024-09-10T10:04:13.258 INFO:tasks.workunit.client.0.smithi071.stdout:4/291: symlink db/d15/d17/d24/l68 0 2024-09-10T10:04:13.262 INFO:tasks.workunit.client.0.smithi071.stdout:8/199: symlink d5/l4d 0 2024-09-10T10:04:13.263 INFO:tasks.workunit.client.0.smithi071.stdout:1/238: dread d1/f3 [0,4194304] 0 2024-09-10T10:04:13.264 INFO:tasks.workunit.client.0.smithi071.stdout:0/215: truncate d11/d22/d40/f48 491463 0 2024-09-10T10:04:13.264 INFO:tasks.workunit.client.0.smithi071.stdout:1/239: chown d1/d21/d3d 3393 1 2024-09-10T10:04:13.265 INFO:tasks.workunit.client.0.smithi071.stdout:9/387: creat d0/f87 x:0 0 0 2024-09-10T10:04:13.266 INFO:tasks.workunit.client.0.smithi071.stdout:8/200: rename d5/c2f to d5/d30/c4e 0 2024-09-10T10:04:13.266 INFO:tasks.workunit.client.0.smithi071.stdout:9/388: chown d0/db/d1b/d1d/f35 13772343 1 2024-09-10T10:04:13.267 INFO:tasks.workunit.client.0.smithi071.stdout:1/240: fsync d1/d21/d2f/d30/f33 0 2024-09-10T10:04:13.268 INFO:tasks.workunit.client.0.smithi071.stdout:9/389: chown d0/d3b/d44 180622 1 2024-09-10T10:04:13.269 INFO:tasks.workunit.client.0.smithi071.stdout:9/390: fsync d0/db/f15 0 2024-09-10T10:04:13.270 INFO:tasks.workunit.client.0.smithi071.stdout:9/391: fsync d0/d3b/f86 0 2024-09-10T10:04:13.272 INFO:tasks.workunit.client.0.smithi071.stdout:1/241: truncate d1/fd 1071732 0 2024-09-10T10:04:13.276 INFO:tasks.workunit.client.0.smithi071.stdout:8/201: dwrite d5/df/d1d/f23 [0,4194304] 0 2024-09-10T10:04:13.280 INFO:tasks.workunit.client.0.smithi071.stdout:0/216: rename d11/d22/d40/f48 to d11/d22/f4f 0 2024-09-10T10:04:13.283 INFO:tasks.workunit.client.0.smithi071.stdout:4/292: dread db/d15/d17/d24/f2b [0,4194304] 0 2024-09-10T10:04:13.284 INFO:tasks.workunit.client.0.smithi071.stdout:9/392: dwrite d0/db/d20/f7e [0,4194304] 0 2024-09-10T10:04:13.285 INFO:tasks.workunit.client.0.smithi071.stdout:1/242: dwrite d1/f29 [0,4194304] 0 2024-09-10T10:04:13.286 INFO:tasks.workunit.client.0.smithi071.stdout:4/293: chown db/d15/d17/d24/f25 2145225 1 2024-09-10T10:04:13.289 INFO:tasks.workunit.client.0.smithi071.stdout:0/217: link d11/d22/d31/f49 d11/d30/f50 0 2024-09-10T10:04:13.289 INFO:tasks.workunit.client.0.smithi071.stdout:4/294: write db/d15/d26/d43/d4d/f39 [2219068,66751] 0 2024-09-10T10:04:13.290 INFO:tasks.workunit.client.0.smithi071.stdout:1/243: mkdir d1/d21/d3d/d4a 0 2024-09-10T10:04:13.294 INFO:tasks.workunit.client.0.smithi071.stdout:9/393: creat d0/db/d1b/d1d/d30/d54/d27/d6e/f88 x:0 0 0 2024-09-10T10:04:13.297 INFO:tasks.workunit.client.0.smithi071.stdout:9/394: fsync d0/db/d20/d3c/f76 0 2024-09-10T10:04:13.299 INFO:tasks.workunit.client.0.smithi071.stdout:1/244: truncate d1/d21/d2f/f39 1459523 0 2024-09-10T10:04:13.302 INFO:tasks.workunit.client.0.smithi071.stdout:4/295: dwrite f3 [0,4194304] 0 2024-09-10T10:04:13.302 INFO:tasks.workunit.client.0.smithi071.stdout:0/218: dwrite d11/d1e/f2d [0,4194304] 0 2024-09-10T10:04:13.302 INFO:tasks.workunit.client.0.smithi071.stdout:1/245: mknod d1/d21/d3d/c4b 0 2024-09-10T10:04:13.305 INFO:tasks.workunit.client.0.smithi071.stdout:0/219: rename d11/d22/c3a to d11/d1e/c51 0 2024-09-10T10:04:13.307 INFO:tasks.workunit.client.0.smithi071.stdout:9/395: link d0/db/d1b/d1d/d30/d54/d27/f58 d0/d3b/d44/f89 0 2024-09-10T10:04:13.307 INFO:tasks.workunit.client.0.smithi071.stdout:1/246: mknod d1/d21/d3d/d4a/c4c 0 2024-09-10T10:04:13.307 INFO:tasks.workunit.client.0.smithi071.stdout:0/220: write d11/d30/f3c [338355,50823] 0 2024-09-10T10:04:13.308 INFO:tasks.workunit.client.0.smithi071.stdout:4/296: dread db/d15/d4b/f5f [0,4194304] 0 2024-09-10T10:04:13.308 INFO:tasks.workunit.client.0.smithi071.stdout:0/221: chown d11/f18 38730 1 2024-09-10T10:04:13.311 INFO:tasks.workunit.client.0.smithi071.stdout:9/396: write d0/db/d1b/d1d/d30/d54/f1a [1232745,2167] 0 2024-09-10T10:04:13.314 INFO:tasks.workunit.client.0.smithi071.stdout:4/297: read db/d1d/f38 [1327563,74539] 0 2024-09-10T10:04:13.317 INFO:tasks.workunit.client.0.smithi071.stdout:1/247: dread d1/d3f/f43 [0,4194304] 0 2024-09-10T10:04:13.318 INFO:tasks.workunit.client.0.smithi071.stdout:9/397: rename d0/db/d1b/d1d/d5b/d52 to d0/db/d1b/d1d/d30/d54/d27/d6e/d8a 0 2024-09-10T10:04:13.319 INFO:tasks.workunit.client.0.smithi071.stdout:8/202: dread d5/df/d16/f29 [0,4194304] 0 2024-09-10T10:04:13.320 INFO:tasks.workunit.client.0.smithi071.stdout:8/203: dread - d5/d36/f41 zero size 2024-09-10T10:04:13.321 INFO:tasks.workunit.client.0.smithi071.stdout:9/398: dread - d0/db/d1b/d1d/d5b/f4d zero size 2024-09-10T10:04:13.322 INFO:tasks.workunit.client.0.smithi071.stdout:4/298: dwrite db/d1d/f36 [0,4194304] 0 2024-09-10T10:04:13.322 INFO:tasks.workunit.client.0.smithi071.stdout:8/204: chown d5/df/d1e/d38/f4c 4 1 2024-09-10T10:04:13.323 INFO:tasks.workunit.client.0.smithi071.stdout:9/399: chown d0/db/d1b/d1d/d30/d54/d27/d6e/f88 170067762 1 2024-09-10T10:04:13.325 INFO:tasks.workunit.client.0.smithi071.stdout:4/299: symlink db/d15/d4b/l69 0 2024-09-10T10:04:13.327 INFO:tasks.workunit.client.0.smithi071.stdout:9/400: unlink d0/f9 0 2024-09-10T10:04:13.329 INFO:tasks.workunit.client.0.smithi071.stdout:4/300: rmdir db/d15/d17/d4e 39 2024-09-10T10:04:13.329 INFO:tasks.workunit.client.0.smithi071.stdout:9/401: dread - d0/db/d1b/d1d/d30/d54/d27/d6e/f88 zero size 2024-09-10T10:04:13.341 INFO:tasks.workunit.client.0.smithi071.stdout:8/205: truncate d5/df/d1e/f21 3350488 0 2024-09-10T10:04:13.346 INFO:tasks.workunit.client.0.smithi071.stdout:9/402: truncate d0/db/d1b/d1d/f35 2353487 0 2024-09-10T10:04:13.348 INFO:tasks.workunit.client.0.smithi071.stdout:8/206: creat d5/d36/d49/f4f x:0 0 0 2024-09-10T10:04:13.349 INFO:tasks.workunit.client.0.smithi071.stdout:9/403: rename d0/db/f18 to d0/db/d1b/d1d/d4b/f8b 0 2024-09-10T10:04:13.352 INFO:tasks.workunit.client.0.smithi071.stdout:4/301: dwrite db/d15/d26/d43/f44 [0,4194304] 0 2024-09-10T10:04:13.356 INFO:tasks.workunit.client.0.smithi071.stdout:9/404: chown d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f6b 24 1 2024-09-10T10:04:13.357 INFO:tasks.workunit.client.0.smithi071.stdout:4/302: unlink db/d1d/f23 0 2024-09-10T10:04:13.358 INFO:tasks.workunit.client.0.smithi071.stdout:8/207: dwrite d5/df/d1d/f23 [0,4194304] 0 2024-09-10T10:04:13.358 INFO:tasks.workunit.client.0.smithi071.stdout:9/405: chown d0/db/d20/d21 426 1 2024-09-10T10:04:13.360 INFO:tasks.workunit.client.0.smithi071.stdout:4/303: truncate db/d15/d4b/f58 218737 0 2024-09-10T10:04:13.365 INFO:tasks.workunit.client.0.smithi071.stdout:4/304: mkdir db/d1d/d61/d6a 0 2024-09-10T10:04:13.367 INFO:tasks.workunit.client.0.smithi071.stdout:9/406: dwrite d0/d3b/d44/f63 [0,4194304] 0 2024-09-10T10:04:13.368 INFO:tasks.workunit.client.0.smithi071.stdout:8/208: dwrite d5/df/d16/f17 [0,4194304] 0 2024-09-10T10:04:13.370 INFO:tasks.workunit.client.0.smithi071.stdout:9/407: dread - d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f67 zero size 2024-09-10T10:04:13.371 INFO:tasks.workunit.client.0.smithi071.stdout:8/209: fsync d5/df/d16/f3e 0 2024-09-10T10:04:13.374 INFO:tasks.workunit.client.0.smithi071.stdout:4/305: rename db/d15/d26/d43/d4d/l54 to db/d1d/l6b 0 2024-09-10T10:04:13.376 INFO:tasks.workunit.client.0.smithi071.stdout:8/210: symlink d5/df/d1e/l50 0 2024-09-10T10:04:13.378 INFO:tasks.workunit.client.0.smithi071.stdout:8/211: symlink d5/d36/l51 0 2024-09-10T10:04:13.379 INFO:tasks.workunit.client.0.smithi071.stdout:8/212: readlink d5/df/d1d/l25 0 2024-09-10T10:04:13.382 INFO:tasks.workunit.client.0.smithi071.stdout:8/213: mkdir d5/df/d1e/d38/d52 0 2024-09-10T10:04:13.383 INFO:tasks.workunit.client.0.smithi071.stdout:4/306: dwrite db/d15/d17/d24/f25 [0,4194304] 0 2024-09-10T10:04:13.384 INFO:tasks.workunit.client.0.smithi071.stdout:8/214: rename d5/df/d16 to d5/df/d16/d53 22 2024-09-10T10:04:13.384 INFO:tasks.workunit.client.0.smithi071.stdout:4/307: chown db/d15/d4b/f5f 52903490 1 2024-09-10T10:04:13.385 INFO:tasks.workunit.client.0.smithi071.stdout:8/215: dread - d5/df/d1e/d38/f4c zero size 2024-09-10T10:04:13.386 INFO:tasks.workunit.client.0.smithi071.stdout:4/308: fdatasync db/f55 0 2024-09-10T10:04:13.386 INFO:tasks.workunit.client.0.smithi071.stdout:8/216: read - d5/df/d1e/d38/f48 zero size 2024-09-10T10:04:13.386 INFO:tasks.workunit.client.0.smithi071.stdout:8/217: stat d5/c14 0 2024-09-10T10:04:13.388 INFO:tasks.workunit.client.0.smithi071.stdout:8/218: write d5/d30/f43 [11543,94290] 0 2024-09-10T10:04:13.395 INFO:tasks.workunit.client.0.smithi071.stdout:4/309: write db/f12 [388368,53365] 0 2024-09-10T10:04:13.396 INFO:tasks.workunit.client.0.smithi071.stdout:4/310: chown db/d15/d17/f47 2003 1 2024-09-10T10:04:13.397 INFO:tasks.workunit.client.0.smithi071.stdout:4/311: write db/d15/d17/d24/f49 [1242559,56546] 0 2024-09-10T10:04:13.398 INFO:tasks.workunit.client.0.smithi071.stdout:4/312: chown db/d1d 2808 1 2024-09-10T10:04:13.400 INFO:tasks.workunit.client.0.smithi071.stdout:4/313: truncate db/d15/d17/f18 1190653 0 2024-09-10T10:04:13.401 INFO:tasks.workunit.client.0.smithi071.stdout:9/408: dread d0/db/f22 [0,4194304] 0 2024-09-10T10:04:13.402 INFO:tasks.workunit.client.0.smithi071.stdout:9/409: chown d0/db/d1b/d1d/d5b/c71 1321400229 1 2024-09-10T10:04:13.403 INFO:tasks.workunit.client.0.smithi071.stdout:9/410: write d0/db/f29 [251849,90850] 0 2024-09-10T10:04:13.404 INFO:tasks.workunit.client.0.smithi071.stdout:4/314: write db/d15/d4b/f5f [2039990,106433] 0 2024-09-10T10:04:13.407 INFO:tasks.workunit.client.0.smithi071.stdout:4/315: creat db/d1d/d61/d6a/f6c x:0 0 0 2024-09-10T10:04:13.408 INFO:tasks.workunit.client.0.smithi071.stdout:9/411: getdents d0/db/d1b/d46 0 2024-09-10T10:04:13.408 INFO:tasks.workunit.client.0.smithi071.stdout:4/316: dread - db/d15/d26/d43/d4d/f2f zero size 2024-09-10T10:04:13.411 INFO:tasks.workunit.client.0.smithi071.stdout:9/412: mkdir d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c 0 2024-09-10T10:04:13.412 INFO:tasks.workunit.client.0.smithi071.stdout:9/413: chown d0/db/d1b/d1d/d5b/c69 12065716 1 2024-09-10T10:04:13.414 INFO:tasks.workunit.client.0.smithi071.stdout:4/317: dwrite db/f55 [0,4194304] 0 2024-09-10T10:04:13.414 INFO:tasks.workunit.client.0.smithi071.stdout:9/414: read d0/db/d1b/d1d/f35 [490031,1602] 0 2024-09-10T10:04:13.416 INFO:tasks.workunit.client.0.smithi071.stdout:9/415: read d0/db/d20/f7e [747738,86623] 0 2024-09-10T10:04:13.417 INFO:tasks.workunit.client.0.smithi071.stdout:9/416: dread - d0/db/d1b/f78 zero size 2024-09-10T10:04:13.420 INFO:tasks.workunit.client.0.smithi071.stdout:9/417: fdatasync d0/db/d1b/d1d/d30/f7d 0 2024-09-10T10:04:13.421 INFO:tasks.workunit.client.0.smithi071.stdout:4/318: truncate db/d15/d26/d43/d4d/f39 2205053 0 2024-09-10T10:04:13.423 INFO:tasks.workunit.client.0.smithi071.stdout:4/319: truncate db/d15/d4b/f5f 2756091 0 2024-09-10T10:04:13.425 INFO:tasks.workunit.client.0.smithi071.stdout:9/418: dwrite d0/d3b/f68 [0,4194304] 0 2024-09-10T10:04:13.429 INFO:tasks.workunit.client.0.smithi071.stdout:9/419: creat d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f8d x:0 0 0 2024-09-10T10:04:13.431 INFO:tasks.workunit.client.0.smithi071.stdout:9/420: mknod d0/db/d1b/d1d/d5b/d60/c8e 0 2024-09-10T10:04:13.433 INFO:tasks.workunit.client.0.smithi071.stdout:9/421: creat d0/d3b/f8f x:0 0 0 2024-09-10T10:04:13.433 INFO:tasks.workunit.client.0.smithi071.stdout:4/320: truncate db/d15/d17/d24/f49 1005124 0 2024-09-10T10:04:13.434 INFO:tasks.workunit.client.0.smithi071.stdout:9/422: fdatasync d0/db/ff 0 2024-09-10T10:04:13.435 INFO:tasks.workunit.client.0.smithi071.stdout:9/423: write d0/db/d20/d3c/f76 [428336,80523] 0 2024-09-10T10:04:13.436 INFO:tasks.workunit.client.0.smithi071.stdout:4/321: creat db/d15/d17/d4e/f6d x:0 0 0 2024-09-10T10:04:13.437 INFO:tasks.workunit.client.0.smithi071.stdout:9/424: write d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f59 [734266,409] 0 2024-09-10T10:04:13.438 INFO:tasks.workunit.client.0.smithi071.stdout:4/322: write db/d15/d26/d43/d4d/f3b [7848,34666] 0 2024-09-10T10:04:13.439 INFO:tasks.workunit.client.0.smithi071.stdout:4/323: fsync db/d15/d17/f3f 0 2024-09-10T10:04:13.441 INFO:tasks.workunit.client.0.smithi071.stdout:4/324: chown db/d15/d17/d4e/c5d 31834475 1 2024-09-10T10:04:13.441 INFO:tasks.workunit.client.0.smithi071.stdout:9/425: truncate d0/db/d1b/d1d/d30/d54/d27/f66 1672058 0 2024-09-10T10:04:13.442 INFO:tasks.workunit.client.0.smithi071.stdout:4/325: rmdir db/d15/d26/d43/d4d 39 2024-09-10T10:04:13.444 INFO:tasks.workunit.client.0.smithi071.stdout:9/426: rename d0/db/d20/f7e to d0/d3b/f90 0 2024-09-10T10:04:13.445 INFO:tasks.workunit.client.0.smithi071.stdout:4/326: rename db/c10 to db/c6e 0 2024-09-10T10:04:13.446 INFO:tasks.workunit.client.0.smithi071.stdout:4/327: truncate db/d15/d4b/f5c 5149078 0 2024-09-10T10:04:13.449 INFO:tasks.workunit.client.0.smithi071.stdout:9/427: mknod d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/c91 0 2024-09-10T10:04:13.450 INFO:tasks.workunit.client.0.smithi071.stdout:9/428: chown d0/d3b/d5c/d6a/f6c 280448 1 2024-09-10T10:04:13.451 INFO:tasks.workunit.client.0.smithi071.stdout:4/328: creat db/d15/d17/f6f x:0 0 0 2024-09-10T10:04:13.456 INFO:tasks.workunit.client.0.smithi071.stdout:9/429: truncate d0/d3b/d44/f63 511305 0 2024-09-10T10:04:13.456 INFO:tasks.workunit.client.0.smithi071.stdout:9/430: fsync d0/d3b/d44/f5f 0 2024-09-10T10:04:13.462 INFO:tasks.workunit.client.0.smithi071.stdout:9/431: truncate d0/db/d20/d3c/f64 196651 0 2024-09-10T10:04:13.464 INFO:tasks.workunit.client.0.smithi071.stdout:9/432: creat d0/db/d1b/d1d/d30/d54/d27/d6e/f92 x:0 0 0 2024-09-10T10:04:13.467 INFO:tasks.workunit.client.0.smithi071.stdout:9/433: link d0/db/d20/l43 d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/l93 0 2024-09-10T10:04:13.472 INFO:tasks.workunit.client.0.smithi071.stdout:9/434: write d0/d3b/f90 [2231821,98680] 0 2024-09-10T10:04:13.473 INFO:tasks.workunit.client.0.smithi071.stdout:9/435: read - d0/db/d1b/d1d/d30/d54/d27/d6e/f92 zero size 2024-09-10T10:04:13.477 INFO:tasks.workunit.client.0.smithi071.stdout:9/436: write d0/db/d1b/d1d/f35 [1708213,105128] 0 2024-09-10T10:04:13.478 INFO:tasks.workunit.client.0.smithi071.stdout:9/437: dread - d0/f42 zero size 2024-09-10T10:04:13.481 INFO:tasks.workunit.client.0.smithi071.stdout:9/438: creat d0/db/d1b/d1d/d30/d54/f94 x:0 0 0 2024-09-10T10:04:13.481 INFO:tasks.workunit.client.0.smithi071.stdout:9/439: stat d0/d3b 0 2024-09-10T10:04:13.485 INFO:tasks.workunit.client.0.smithi071.stdout:9/440: dread d0/db/f22 [0,4194304] 0 2024-09-10T10:04:13.486 INFO:tasks.workunit.client.0.smithi071.stdout:9/441: dread - d0/d3b/f86 zero size 2024-09-10T10:04:13.493 INFO:tasks.workunit.client.0.smithi071.stdout:9/442: dwrite d0/db/d20/d3c/f82 [0,4194304] 0 2024-09-10T10:04:13.494 INFO:tasks.workunit.client.0.smithi071.stdout:9/443: chown d0/db/d1b/d46/l81 530 1 2024-09-10T10:04:13.496 INFO:tasks.workunit.client.0.smithi071.stdout:9/444: dread d0/db/d1b/d1d/d30/d54/d27/f66 [0,4194304] 0 2024-09-10T10:04:13.498 INFO:tasks.workunit.client.0.smithi071.stdout:9/445: mknod d0/d3b/d72/c95 0 2024-09-10T10:04:13.499 INFO:tasks.workunit.client.0.smithi071.stdout:9/446: read - d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f8d zero size 2024-09-10T10:04:13.499 INFO:tasks.workunit.client.0.smithi071.stdout:9/447: dread - d0/d3b/d5c/f7f zero size 2024-09-10T10:04:13.501 INFO:tasks.workunit.client.0.smithi071.stdout:9/448: mkdir d0/d3b/d5c/d6a/d96 0 2024-09-10T10:04:13.503 INFO:tasks.workunit.client.0.smithi071.stdout:7/260: sync 2024-09-10T10:04:13.503 INFO:tasks.workunit.client.0.smithi071.stdout:6/235: sync 2024-09-10T10:04:13.505 INFO:tasks.workunit.client.0.smithi071.stdout:7/261: creat d9/d1a/d1d/f5a x:0 0 0 2024-09-10T10:04:13.508 INFO:tasks.workunit.client.0.smithi071.stdout:6/236: creat d4/da/df/d2e/d3a/d3e/d45/f48 x:0 0 0 2024-09-10T10:04:13.509 INFO:tasks.workunit.client.0.smithi071.stdout:7/262: readlink d9/d1a/l4c 0 2024-09-10T10:04:13.509 INFO:tasks.workunit.client.0.smithi071.stdout:6/237: readlink d4/da/df/l12 0 2024-09-10T10:04:13.510 INFO:tasks.workunit.client.0.smithi071.stdout:6/238: chown d4/f25 1204 1 2024-09-10T10:04:13.510 INFO:tasks.workunit.client.0.smithi071.stdout:7/263: mknod d9/d2c/d49/c5b 0 2024-09-10T10:04:13.511 INFO:tasks.workunit.client.0.smithi071.stdout:7/264: write d9/d1a/d1d/f5a [571884,45342] 0 2024-09-10T10:04:13.512 INFO:tasks.workunit.client.0.smithi071.stdout:6/239: creat d4/da/df/d2e/d3a/d43/f49 x:0 0 0 2024-09-10T10:04:13.514 INFO:tasks.workunit.client.0.smithi071.stdout:7/265: creat d9/d15/d55/d58/f5c x:0 0 0 2024-09-10T10:04:13.514 INFO:tasks.workunit.client.0.smithi071.stdout:7/266: chown d9/d15/d1f/l29 14268146 1 2024-09-10T10:04:13.515 INFO:tasks.workunit.client.0.smithi071.stdout:6/240: creat d4/da/df/d2e/d3a/d3e/f4a x:0 0 0 2024-09-10T10:04:13.517 INFO:tasks.workunit.client.0.smithi071.stdout:6/241: write d4/da/df/d2e/d3a/d3e/f4a [602337,44382] 0 2024-09-10T10:04:13.517 INFO:tasks.workunit.client.0.smithi071.stdout:9/449: dread d0/db/d1b/d1d/d30/d54/d27/f2c [0,4194304] 0 2024-09-10T10:04:13.518 INFO:tasks.workunit.client.0.smithi071.stdout:7/267: unlink d9/d1a/d1d/d39/c3c 0 2024-09-10T10:04:13.518 INFO:tasks.workunit.client.0.smithi071.stdout:7/268: chown d9/d2c/d49 107 1 2024-09-10T10:04:13.519 INFO:tasks.workunit.client.0.smithi071.stdout:9/450: creat d0/d3b/f97 x:0 0 0 2024-09-10T10:04:13.521 INFO:tasks.workunit.client.0.smithi071.stdout:9/451: rmdir d0/db/d1b/d1d/d30/d54/d27/d6e/d8a 39 2024-09-10T10:04:13.522 INFO:tasks.workunit.client.0.smithi071.stdout:7/269: rename d9/d11/f24 to d9/d15/f5d 0 2024-09-10T10:04:13.524 INFO:tasks.workunit.client.0.smithi071.stdout:9/452: creat d0/db/d1b/d1d/d5b/d60/f98 x:0 0 0 2024-09-10T10:04:13.525 INFO:tasks.workunit.client.0.smithi071.stdout:7/270: mknod d9/c5e 0 2024-09-10T10:04:13.526 INFO:tasks.workunit.client.0.smithi071.stdout:9/453: creat d0/d3b/d5c/d6a/f99 x:0 0 0 2024-09-10T10:04:13.527 INFO:tasks.workunit.client.0.smithi071.stdout:7/271: creat d9/d11/f5f x:0 0 0 2024-09-10T10:04:13.544 INFO:tasks.workunit.client.0.smithi071.stdout:9/454: write d0/db/d1b/d1d/d4b/f8b [1824373,50066] 0 2024-09-10T10:04:13.544 INFO:tasks.workunit.client.0.smithi071.stdout:7/272: creat d9/d15/d40/f60 x:0 0 0 2024-09-10T10:04:13.546 INFO:tasks.workunit.client.0.smithi071.stdout:7/273: creat d9/d1a/d1d/f61 x:0 0 0 2024-09-10T10:04:13.546 INFO:tasks.workunit.client.0.smithi071.stdout:7/274: dread - d9/d15/d40/f60 zero size 2024-09-10T10:04:13.621 INFO:tasks.workunit.client.0.smithi071.stdout:7/275: rename d9/f28 to d9/d2c/d49/f62 0 2024-09-10T10:04:13.621 INFO:tasks.workunit.client.0.smithi071.stdout:9/455: creat d0/db/d1b/d1d/d30/d54/d27/d6e/f9a x:0 0 0 2024-09-10T10:04:13.623 INFO:tasks.workunit.client.0.smithi071.stdout:9/456: dread - d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f8d zero size 2024-09-10T10:04:13.624 INFO:tasks.workunit.client.0.smithi071.stdout:9/457: chown d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/l79 236211188 1 2024-09-10T10:04:13.625 INFO:tasks.workunit.client.0.smithi071.stdout:7/276: fsync d9/d1a/d1d/f61 0 2024-09-10T10:04:13.626 INFO:tasks.workunit.client.0.smithi071.stdout:7/277: mknod d9/d2c/d4f/c63 0 2024-09-10T10:04:13.627 INFO:tasks.workunit.client.0.smithi071.stdout:9/458: unlink d0/db/d1b/d1d/d30/d54/d27/f58 0 2024-09-10T10:04:13.628 INFO:tasks.workunit.client.0.smithi071.stdout:9/459: write d0/db/d20/d3c/f82 [1201935,47255] 0 2024-09-10T10:04:13.631 INFO:tasks.workunit.client.0.smithi071.stdout:7/278: getdents d9/d2c/d4f 0 2024-09-10T10:04:13.631 INFO:tasks.workunit.client.0.smithi071.stdout:7/279: chown d9/d2c/d4f/c54 417810862 1 2024-09-10T10:04:13.632 INFO:tasks.workunit.client.0.smithi071.stdout:7/280: readlink d9/d1a/l38 0 2024-09-10T10:04:13.634 INFO:tasks.workunit.client.0.smithi071.stdout:7/281: symlink d9/d2c/d49/l64 0 2024-09-10T10:04:13.634 INFO:tasks.workunit.client.0.smithi071.stdout:9/460: truncate d0/db/d20/d3c/f82 4160649 0 2024-09-10T10:04:13.635 INFO:tasks.workunit.client.0.smithi071.stdout:9/461: fdatasync d0/db/d20/d21/f34 0 2024-09-10T10:04:13.637 INFO:tasks.workunit.client.0.smithi071.stdout:7/282: creat d9/d15/d1f/f65 x:0 0 0 2024-09-10T10:04:13.638 INFO:tasks.workunit.client.0.smithi071.stdout:7/283: fdatasync d9/d1a/d1d/d39/f42 0 2024-09-10T10:04:13.640 INFO:tasks.workunit.client.0.smithi071.stdout:7/284: truncate d9/d15/f51 918008 0 2024-09-10T10:04:13.641 INFO:tasks.workunit.client.0.smithi071.stdout:9/462: dwrite d0/d3b/d5c/d6a/f6c [4194304,4194304] 0 2024-09-10T10:04:13.647 INFO:tasks.workunit.client.0.smithi071.stdout:9/463: rename d0/db/d1b/d46/f50 to d0/db/d20/d3c/d75/f9b 0 2024-09-10T10:04:13.648 INFO:tasks.workunit.client.0.smithi071.stdout:9/464: chown d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c 5072 1 2024-09-10T10:04:13.650 INFO:tasks.workunit.client.0.smithi071.stdout:9/465: creat d0/db/d20/d3c/d75/f9c x:0 0 0 2024-09-10T10:04:13.651 INFO:tasks.workunit.client.0.smithi071.stdout:7/285: dwrite d9/fa [0,4194304] 0 2024-09-10T10:04:13.653 INFO:tasks.workunit.client.0.smithi071.stdout:7/286: mkdir d9/d1a/d1d/d39/d66 0 2024-09-10T10:04:13.654 INFO:tasks.workunit.client.0.smithi071.stdout:7/287: stat d9/c5e 0 2024-09-10T10:04:13.655 INFO:tasks.workunit.client.0.smithi071.stdout:9/466: dread d0/db/d20/d21/f34 [0,4194304] 0 2024-09-10T10:04:13.657 INFO:tasks.workunit.client.0.smithi071.stdout:7/288: rename d9/d2c/d49/c5b to d9/d15/d55/c67 0 2024-09-10T10:04:13.657 INFO:tasks.workunit.client.0.smithi071.stdout:9/467: truncate d0/f2e 731951 0 2024-09-10T10:04:13.660 INFO:tasks.workunit.client.0.smithi071.stdout:7/289: creat d9/d15/d1f/f68 x:0 0 0 2024-09-10T10:04:13.662 INFO:tasks.workunit.client.0.smithi071.stdout:7/290: rename d9/d15/d55/d58 to d9/d15/d55/d58/d69 22 2024-09-10T10:04:13.663 INFO:tasks.workunit.client.0.smithi071.stdout:7/291: dread - d9/d11/f59 zero size 2024-09-10T10:04:13.664 INFO:tasks.workunit.client.0.smithi071.stdout:9/468: dwrite d0/d3b/d5c/f74 [0,4194304] 0 2024-09-10T10:04:13.668 INFO:tasks.workunit.client.0.smithi071.stdout:7/292: rename d9/d15/l48 to d9/d1a/d1d/l6a 0 2024-09-10T10:04:13.670 INFO:tasks.workunit.client.0.smithi071.stdout:5/246: sync 2024-09-10T10:04:13.670 INFO:tasks.workunit.client.0.smithi071.stdout:0/222: sync 2024-09-10T10:04:13.670 INFO:tasks.workunit.client.0.smithi071.stdout:8/219: sync 2024-09-10T10:04:13.670 INFO:tasks.workunit.client.0.smithi071.stdout:2/207: sync 2024-09-10T10:04:13.670 INFO:tasks.workunit.client.0.smithi071.stdout:6/242: sync 2024-09-10T10:04:13.670 INFO:tasks.workunit.client.0.smithi071.stdout:1/248: sync 2024-09-10T10:04:13.671 INFO:tasks.workunit.client.0.smithi071.stdout:4/329: sync 2024-09-10T10:04:13.671 INFO:tasks.workunit.client.0.smithi071.stdout:3/246: sync 2024-09-10T10:04:13.673 INFO:tasks.workunit.client.0.smithi071.stdout:4/330: dread - db/d15/d4b/f4f zero size 2024-09-10T10:04:13.674 INFO:tasks.workunit.client.0.smithi071.stdout:9/469: rmdir d0/db/d1b/d1d/d5b/d60/d7a 0 2024-09-10T10:04:13.674 INFO:tasks.workunit.client.0.smithi071.stdout:8/220: fsync d5/df/d1e/d38/f42 0 2024-09-10T10:04:13.676 INFO:tasks.workunit.client.0.smithi071.stdout:1/249: readlink d1/d21/d2f/d30/l3b 0 2024-09-10T10:04:13.676 INFO:tasks.workunit.client.0.smithi071.stdout:5/247: mknod dc/df/d17/d22/c58 0 2024-09-10T10:04:13.678 INFO:tasks.workunit.client.0.smithi071.stdout:6/243: read d4/da/df/d2e/d3a/d3e/f4a [373119,27626] 0 2024-09-10T10:04:13.679 INFO:tasks.workunit.client.0.smithi071.stdout:4/331: fsync db/f1b 0 2024-09-10T10:04:13.680 INFO:tasks.workunit.client.0.smithi071.stdout:3/247: truncate d3/d49/d34/f44 2013843 0 2024-09-10T10:04:13.681 INFO:tasks.workunit.client.0.smithi071.stdout:9/470: write d0/db/d1b/d1d/d5b/f4d [523088,31683] 0 2024-09-10T10:04:13.681 INFO:tasks.workunit.client.0.smithi071.stdout:8/221: chown d5/d30/l4b 160 1 2024-09-10T10:04:13.682 INFO:tasks.workunit.client.0.smithi071.stdout:1/250: write d1/d21/d2f/d30/f33 [4239740,36708] 0 2024-09-10T10:04:13.683 INFO:tasks.workunit.client.0.smithi071.stdout:2/208: rename d8/l21 to d8/l39 0 2024-09-10T10:04:13.684 INFO:tasks.workunit.client.0.smithi071.stdout:7/293: dwrite d9/d11/f59 [0,4194304] 0 2024-09-10T10:04:13.684 INFO:tasks.workunit.client.0.smithi071.stdout:6/244: creat d4/d1c/f4b x:0 0 0 2024-09-10T10:04:13.685 INFO:tasks.workunit.client.0.smithi071.stdout:5/248: truncate dc/df/d17/f2b 1155200 0 2024-09-10T10:04:13.687 INFO:tasks.workunit.client.0.smithi071.stdout:2/209: write d8/d13/f2b [182767,77753] 0 2024-09-10T10:04:13.688 INFO:tasks.workunit.client.0.smithi071.stdout:7/294: stat d9/d11/f12 0 2024-09-10T10:04:13.688 INFO:tasks.workunit.client.0.smithi071.stdout:9/471: fdatasync d0/db/d1b/d1d/d5b/f70 0 2024-09-10T10:04:13.689 INFO:tasks.workunit.client.0.smithi071.stdout:8/222: readlink d5/l40 0 2024-09-10T10:04:13.691 INFO:tasks.workunit.client.0.smithi071.stdout:2/210: readlink l6 0 2024-09-10T10:04:13.694 INFO:tasks.workunit.client.0.smithi071.stdout:3/248: dread d3/d49/d34/f44 [0,4194304] 0 2024-09-10T10:04:13.695 INFO:tasks.workunit.client.0.smithi071.stdout:5/249: fsync dc/df/f14 0 2024-09-10T10:04:13.695 INFO:tasks.workunit.client.0.smithi071.stdout:7/295: stat d9/d11/c32 0 2024-09-10T10:04:13.696 INFO:tasks.workunit.client.0.smithi071.stdout:9/472: read d0/db/d20/d21/f34 [328535,53768] 0 2024-09-10T10:04:13.696 INFO:tasks.workunit.client.0.smithi071.stdout:0/223: dwrite d11/d22/f2e [0,4194304] 0 2024-09-10T10:04:13.701 INFO:tasks.workunit.client.0.smithi071.stdout:2/211: truncate d8/ff 508534 0 2024-09-10T10:04:13.701 INFO:tasks.workunit.client.0.smithi071.stdout:1/251: getdents d1 0 2024-09-10T10:04:13.701 INFO:tasks.workunit.client.0.smithi071.stdout:7/296: write d9/ff [992971,51696] 0 2024-09-10T10:04:13.703 INFO:tasks.workunit.client.0.smithi071.stdout:5/250: read dc/df/f19 [1070181,120762] 0 2024-09-10T10:04:13.703 INFO:tasks.workunit.client.0.smithi071.stdout:4/332: dwrite db/d1d/f36 [0,4194304] 0 2024-09-10T10:04:13.709 INFO:tasks.workunit.client.0.smithi071.stdout:7/297: symlink d9/d1a/l6b 0 2024-09-10T10:04:13.710 INFO:tasks.workunit.client.0.smithi071.stdout:5/251: write dc/df/f38 [1002565,11300] 0 2024-09-10T10:04:13.713 INFO:tasks.workunit.client.0.smithi071.stdout:9/473: getdents d0/db/d1b/d1d/d5b 0 2024-09-10T10:04:13.713 INFO:tasks.workunit.client.0.smithi071.stdout:7/298: fsync d9/fa 0 2024-09-10T10:04:13.715 INFO:tasks.workunit.client.0.smithi071.stdout:3/249: dread d3/fa [0,4194304] 0 2024-09-10T10:04:13.715 INFO:tasks.workunit.client.0.smithi071.stdout:5/252: rmdir dc/df/d29/d48 39 2024-09-10T10:04:13.717 INFO:tasks.workunit.client.0.smithi071.stdout:7/299: unlink d9/d11/f12 0 2024-09-10T10:04:13.720 INFO:tasks.workunit.client.0.smithi071.stdout:9/474: mknod d0/db/d1b/d46/c9d 0 2024-09-10T10:04:13.720 INFO:tasks.workunit.client.0.smithi071.stdout:0/224: dwrite d11/d22/d31/f39 [0,4194304] 0 2024-09-10T10:04:13.720 INFO:tasks.workunit.client.0.smithi071.stdout:1/252: dread d1/d3f/f43 [0,4194304] 0 2024-09-10T10:04:13.720 INFO:tasks.workunit.client.0.smithi071.stdout:3/250: mkdir d3/d20/d30/d5d 0 2024-09-10T10:04:13.722 INFO:tasks.workunit.client.0.smithi071.stdout:1/253: dread - d1/d21/f24 zero size 2024-09-10T10:04:13.723 INFO:tasks.workunit.client.0.smithi071.stdout:6/245: dread d4/f27 [0,4194304] 0 2024-09-10T10:04:13.723 INFO:tasks.workunit.client.0.smithi071.stdout:9/475: mknod d0/d3b/d72/c9e 0 2024-09-10T10:04:13.724 INFO:tasks.workunit.client.0.smithi071.stdout:5/253: rename dc/d4a/f50 to dc/f59 0 2024-09-10T10:04:13.724 INFO:tasks.workunit.client.0.smithi071.stdout:6/246: chown d4/f2f 1 1 2024-09-10T10:04:13.726 INFO:tasks.workunit.client.0.smithi071.stdout:9/476: write d0/db/d1b/d1d/d30/d54/f94 [461909,104625] 0 2024-09-10T10:04:13.727 INFO:tasks.workunit.client.0.smithi071.stdout:5/254: mkdir dc/df/d3e/d5a 0 2024-09-10T10:04:13.730 INFO:tasks.workunit.client.0.smithi071.stdout:6/247: creat d4/da/df/d2e/d3a/d43/f4c x:0 0 0 2024-09-10T10:04:13.731 INFO:tasks.workunit.client.0.smithi071.stdout:5/255: creat dc/d4a/f5b x:0 0 0 2024-09-10T10:04:13.732 INFO:tasks.workunit.client.0.smithi071.stdout:8/223: dread d5/df/d16/f3e [0,4194304] 0 2024-09-10T10:04:13.732 INFO:tasks.workunit.client.0.smithi071.stdout:3/251: dwrite d3/d10/d24/f25 [0,4194304] 0 2024-09-10T10:04:13.733 INFO:tasks.workunit.client.0.smithi071.stdout:5/256: fdatasync dc/df/f14 0 2024-09-10T10:04:13.734 INFO:tasks.workunit.client.0.smithi071.stdout:6/248: creat d4/d1c/f4d x:0 0 0 2024-09-10T10:04:13.735 INFO:tasks.workunit.client.0.smithi071.stdout:9/477: getdents d0/d3b/d5c/d6a 0 2024-09-10T10:04:13.735 INFO:tasks.workunit.client.0.smithi071.stdout:3/252: write d3/d20/d30/f51 [902545,73255] 0 2024-09-10T10:04:13.736 INFO:tasks.workunit.client.0.smithi071.stdout:8/224: symlink d5/df/d1e/d38/l54 0 2024-09-10T10:04:13.737 INFO:tasks.workunit.client.0.smithi071.stdout:9/478: dread - d0/d3b/f8f zero size 2024-09-10T10:04:13.737 INFO:tasks.workunit.client.0.smithi071.stdout:9/479: readlink d0/db/l28 0 2024-09-10T10:04:13.740 INFO:tasks.workunit.client.0.smithi071.stdout:9/480: truncate d0/f42 367830 0 2024-09-10T10:04:13.740 INFO:tasks.workunit.client.0.smithi071.stdout:5/257: link dc/df/d17/d22/c30 dc/d4a/c5c 0 2024-09-10T10:04:13.743 INFO:tasks.workunit.client.0.smithi071.stdout:8/225: dread d5/f19 [0,4194304] 0 2024-09-10T10:04:13.744 INFO:tasks.workunit.client.0.smithi071.stdout:0/225: dread f2 [0,4194304] 0 2024-09-10T10:04:13.744 INFO:tasks.workunit.client.0.smithi071.stdout:5/258: mknod dc/d53/c5d 0 2024-09-10T10:04:13.744 INFO:tasks.workunit.client.0.smithi071.stdout:9/481: mkdir d0/db/d1b/d1d/d5b/d9f 0 2024-09-10T10:04:13.746 INFO:tasks.workunit.client.0.smithi071.stdout:5/259: read - dc/f4b zero size 2024-09-10T10:04:13.746 INFO:tasks.workunit.client.0.smithi071.stdout:8/226: dread - d5/df/d1e/d38/f3f zero size 2024-09-10T10:04:13.747 INFO:tasks.workunit.client.0.smithi071.stdout:0/226: mkdir d11/d30/d52 0 2024-09-10T10:04:13.747 INFO:tasks.workunit.client.0.smithi071.stdout:6/249: dwrite d4/da/df/d2e/f32 [4194304,4194304] 0 2024-09-10T10:04:13.747 INFO:tasks.workunit.client.0.smithi071.stdout:3/253: dwrite d3/f8 [0,4194304] 0 2024-09-10T10:04:13.750 INFO:tasks.workunit.client.0.smithi071.stdout:3/254: write d3/d20/f2c [124412,103151] 0 2024-09-10T10:04:13.753 INFO:tasks.workunit.client.0.smithi071.stdout:8/227: dread d5/df/d16/f3e [0,4194304] 0 2024-09-10T10:04:13.754 INFO:tasks.workunit.client.0.smithi071.stdout:5/260: rename dc/df/d17/f34 to dc/df/d3e/d5a/f5e 0 2024-09-10T10:04:13.755 INFO:tasks.workunit.client.0.smithi071.stdout:0/227: creat d11/d30/d52/f53 x:0 0 0 2024-09-10T10:04:13.755 INFO:tasks.workunit.client.0.smithi071.stdout:5/261: write dc/df/f14 [1485731,31164] 0 2024-09-10T10:04:13.756 INFO:tasks.workunit.client.0.smithi071.stdout:5/262: fdatasync dc/df/f38 0 2024-09-10T10:04:13.757 INFO:tasks.workunit.client.0.smithi071.stdout:5/263: fdatasync dc/df/f33 0 2024-09-10T10:04:13.757 INFO:tasks.workunit.client.0.smithi071.stdout:5/264: readlink dc/d4a/l4e 0 2024-09-10T10:04:13.760 INFO:tasks.workunit.client.0.smithi071.stdout:6/250: link d4/da/c1f d4/d20/c4e 0 2024-09-10T10:04:13.760 INFO:tasks.workunit.client.0.smithi071.stdout:8/228: symlink d5/l55 0 2024-09-10T10:04:13.762 INFO:tasks.workunit.client.1.smithi107.stdout:6/398: sync 2024-09-10T10:04:13.762 INFO:tasks.workunit.client.1.smithi107.stdout:5/439: sync 2024-09-10T10:04:13.763 INFO:tasks.workunit.client.0.smithi071.stdout:8/229: unlink d5/df/d1d/f26 0 2024-09-10T10:04:13.764 INFO:tasks.workunit.client.0.smithi071.stdout:3/255: getdents d3/d20/d39 0 2024-09-10T10:04:13.764 INFO:tasks.workunit.client.1.smithi107.stdout:5/440: chown de/d20/d2b/c33 32805158 1 2024-09-10T10:04:13.765 INFO:tasks.workunit.client.0.smithi071.stdout:8/230: write d5/d36/f39 [210559,49589] 0 2024-09-10T10:04:13.765 INFO:tasks.workunit.client.0.smithi071.stdout:5/265: creat dc/df/d29/f5f x:0 0 0 2024-09-10T10:04:13.769 INFO:tasks.workunit.client.0.smithi071.stdout:5/266: truncate dc/df/d17/d22/f44 424609 0 2024-09-10T10:04:13.772 INFO:tasks.workunit.client.0.smithi071.stdout:8/231: mknod d5/df/d1e/c56 0 2024-09-10T10:04:13.773 INFO:tasks.workunit.client.0.smithi071.stdout:3/256: dread d3/d10/d24/f25 [0,4194304] 0 2024-09-10T10:04:13.777 INFO:tasks.workunit.client.0.smithi071.stdout:4/333: truncate db/d15/d26/f3c 95266 0 2024-09-10T10:04:13.778 INFO:tasks.workunit.client.0.smithi071.stdout:4/334: chown db/d15/d17/d4e 369257311 1 2024-09-10T10:04:13.778 INFO:tasks.workunit.client.0.smithi071.stdout:4/335: read - db/d1d/d61/d6a/f6c zero size 2024-09-10T10:04:13.780 INFO:tasks.workunit.client.0.smithi071.stdout:8/232: mkdir d5/df/d57 0 2024-09-10T10:04:13.781 INFO:tasks.workunit.client.0.smithi071.stdout:8/233: write d5/f28 [238847,122098] 0 2024-09-10T10:04:13.782 INFO:tasks.workunit.client.0.smithi071.stdout:5/267: fdatasync f4 0 2024-09-10T10:04:13.782 INFO:tasks.workunit.client.0.smithi071.stdout:8/234: dread - d5/d36/d49/f4f zero size 2024-09-10T10:04:13.783 INFO:tasks.workunit.client.0.smithi071.stdout:7/300: write d9/d2c/f56 [422045,76239] 0 2024-09-10T10:04:13.783 INFO:tasks.workunit.client.0.smithi071.stdout:4/336: creat db/d1d/d61/f70 x:0 0 0 2024-09-10T10:04:13.785 INFO:tasks.workunit.client.0.smithi071.stdout:7/301: write d9/d1a/f4d [309900,37654] 0 2024-09-10T10:04:13.786 INFO:tasks.workunit.client.0.smithi071.stdout:8/235: write d5/f28 [1469548,41249] 0 2024-09-10T10:04:13.788 INFO:tasks.workunit.client.0.smithi071.stdout:1/254: write d1/f19 [1436804,13363] 0 2024-09-10T10:04:13.789 INFO:tasks.workunit.client.0.smithi071.stdout:4/337: symlink db/d15/d26/l71 0 2024-09-10T10:04:13.789 INFO:tasks.workunit.client.1.smithi107.stdout:6/399: dread d0/d76/f80 [0,4194304] 0 2024-09-10T10:04:13.791 INFO:tasks.workunit.client.0.smithi071.stdout:4/338: truncate db/d15/d17/f47 734274 0 2024-09-10T10:04:13.793 INFO:tasks.workunit.client.1.smithi107.stdout:6/400: rename d0/d3d/d14/d17/f1c to d0/d3d/d14/d42/f8b 0 2024-09-10T10:04:13.793 INFO:tasks.workunit.client.1.smithi107.stdout:6/401: readlink d0/d3d/l2e 0 2024-09-10T10:04:13.794 INFO:tasks.workunit.client.1.smithi107.stdout:5/441: dread f1 [0,4194304] 0 2024-09-10T10:04:13.794 INFO:tasks.workunit.client.1.smithi107.stdout:5/442: dread - de/f90 zero size 2024-09-10T10:04:13.796 INFO:tasks.workunit.client.0.smithi071.stdout:7/302: getdents d9/d11 0 2024-09-10T10:04:13.797 INFO:tasks.workunit.client.0.smithi071.stdout:7/303: write d9/d1a/f35 [3913015,57309] 0 2024-09-10T10:04:13.798 INFO:tasks.workunit.client.0.smithi071.stdout:4/339: getdents db/d15 0 2024-09-10T10:04:13.798 INFO:tasks.workunit.client.1.smithi107.stdout:5/443: mkdir de/d4a/d4e/d89/d99 0 2024-09-10T10:04:13.803 INFO:tasks.workunit.client.0.smithi071.stdout:0/228: truncate f0 30974 0 2024-09-10T10:04:13.803 INFO:tasks.workunit.client.1.smithi107.stdout:5/444: dread de/d20/d2b/d4b/f58 [0,4194304] 0 2024-09-10T10:04:13.806 INFO:tasks.workunit.client.1.smithi107.stdout:5/445: mkdir de/d20/d2b/d4b/d5e/d9a 0 2024-09-10T10:04:13.807 INFO:tasks.workunit.client.0.smithi071.stdout:9/482: dwrite d0/d3b/d44/f89 [0,4194304] 0 2024-09-10T10:04:13.807 INFO:tasks.workunit.client.1.smithi107.stdout:5/446: chown de/d4a/d5c/f8e 5807516 1 2024-09-10T10:04:13.809 INFO:tasks.workunit.client.0.smithi071.stdout:9/483: write d0/fa [3899998,121401] 0 2024-09-10T10:04:13.811 INFO:tasks.workunit.client.1.smithi107.stdout:5/447: creat de/f9b x:0 0 0 2024-09-10T10:04:13.812 INFO:tasks.workunit.client.0.smithi071.stdout:0/229: dwrite d11/d22/f2e [0,4194304] 0 2024-09-10T10:04:13.813 INFO:tasks.workunit.client.0.smithi071.stdout:9/484: stat d0/d3b/d72/c9e 0 2024-09-10T10:04:13.815 INFO:tasks.workunit.client.0.smithi071.stdout:8/236: chown d5/df/d1e/d38 1 1 2024-09-10T10:04:13.816 INFO:tasks.workunit.client.0.smithi071.stdout:7/304: read d9/d15/d1f/f3f [74808,68199] 0 2024-09-10T10:04:13.817 INFO:tasks.workunit.client.0.smithi071.stdout:9/485: write d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f8d [1020941,108026] 0 2024-09-10T10:04:13.817 INFO:tasks.workunit.client.0.smithi071.stdout:7/305: chown f4 84 1 2024-09-10T10:04:13.821 INFO:tasks.workunit.client.1.smithi107.stdout:5/448: dread de/d4a/f53 [0,4194304] 0 2024-09-10T10:04:13.823 INFO:tasks.workunit.client.0.smithi071.stdout:9/486: readlink d0/db/d20/l43 0 2024-09-10T10:04:13.823 INFO:tasks.workunit.client.0.smithi071.stdout:8/237: dwrite d5/f10 [0,4194304] 0 2024-09-10T10:04:13.824 INFO:tasks.workunit.client.0.smithi071.stdout:7/306: unlink d9/d15/d40/f60 0 2024-09-10T10:04:13.825 INFO:tasks.workunit.client.0.smithi071.stdout:4/340: link db/d15/d26/f3c db/d15/d17/f72 0 2024-09-10T10:04:13.829 INFO:tasks.workunit.client.0.smithi071.stdout:9/487: read d0/d3b/d44/f5a [1983933,59541] 0 2024-09-10T10:04:13.831 INFO:tasks.workunit.client.1.smithi107.stdout:5/449: dwrite de/d20/d2b/d4b/f58 [0,4194304] 0 2024-09-10T10:04:13.832 INFO:tasks.workunit.client.1.smithi107.stdout:5/450: stat de/d4a/d4e/l62 0 2024-09-10T10:04:13.833 INFO:tasks.workunit.client.0.smithi071.stdout:8/238: mknod d5/df/d16/c58 0 2024-09-10T10:04:13.835 INFO:tasks.workunit.client.1.smithi107.stdout:5/451: mkdir de/d9c 0 2024-09-10T10:04:13.836 INFO:tasks.workunit.client.0.smithi071.stdout:4/341: unlink db/d1d/l6b 0 2024-09-10T10:04:13.837 INFO:tasks.workunit.client.1.smithi107.stdout:5/452: fdatasync de/d20/d2b/f60 0 2024-09-10T10:04:13.838 INFO:tasks.workunit.client.0.smithi071.stdout:9/488: unlink d0/db/d20/d3c/f76 0 2024-09-10T10:04:13.838 INFO:tasks.workunit.client.0.smithi071.stdout:4/342: chown db/d15/d17/f47 185712 1 2024-09-10T10:04:13.841 INFO:tasks.workunit.client.1.smithi107.stdout:5/453: unlink de/c17 0 2024-09-10T10:04:13.843 INFO:tasks.workunit.client.0.smithi071.stdout:4/343: unlink db/d15/d17/f1f 0 2024-09-10T10:04:13.844 INFO:tasks.workunit.client.0.smithi071.stdout:0/230: dread d11/d22/f2c [0,4194304] 0 2024-09-10T10:04:13.845 INFO:tasks.workunit.client.0.smithi071.stdout:8/239: dwrite d5/df/d16/f17 [0,4194304] 0 2024-09-10T10:04:13.850 INFO:tasks.workunit.client.1.smithi107.stdout:5/454: truncate de/d4a/d7e/f6e 465045 0 2024-09-10T10:04:13.850 INFO:tasks.workunit.client.1.smithi107.stdout:5/455: stat de/c12 0 2024-09-10T10:04:13.853 INFO:tasks.workunit.client.0.smithi071.stdout:2/212: sync 2024-09-10T10:04:13.854 INFO:tasks.workunit.client.0.smithi071.stdout:9/489: dwrite d0/db/d1b/d1d/d30/f7d [0,4194304] 0 2024-09-10T10:04:13.856 INFO:tasks.workunit.client.0.smithi071.stdout:7/307: dwrite f2 [0,4194304] 0 2024-09-10T10:04:13.860 INFO:tasks.workunit.client.0.smithi071.stdout:0/231: dread d11/f17 [0,4194304] 0 2024-09-10T10:04:13.860 INFO:tasks.workunit.client.0.smithi071.stdout:4/344: link db/c11 db/d15/d26/d43/c73 0 2024-09-10T10:04:13.861 INFO:tasks.workunit.client.0.smithi071.stdout:8/240: dread d5/f19 [0,4194304] 0 2024-09-10T10:04:13.862 INFO:tasks.workunit.client.0.smithi071.stdout:2/213: dread d8/d13/f2b [0,4194304] 0 2024-09-10T10:04:13.866 INFO:tasks.workunit.client.0.smithi071.stdout:7/308: creat d9/d15/f6c x:0 0 0 2024-09-10T10:04:13.868 INFO:tasks.workunit.client.0.smithi071.stdout:2/214: unlink d8/fc 0 2024-09-10T10:04:13.871 INFO:tasks.workunit.client.0.smithi071.stdout:7/309: getdents d9/d2c/d4f 0 2024-09-10T10:04:13.871 INFO:tasks.workunit.client.0.smithi071.stdout:2/215: rename d8/ca to d8/d38/c3a 0 2024-09-10T10:04:13.873 INFO:tasks.workunit.client.0.smithi071.stdout:8/241: link d5/df/d1e/d38/f48 d5/df/d1d/f59 0 2024-09-10T10:04:13.876 INFO:tasks.workunit.client.0.smithi071.stdout:4/345: link db/d15/d26/d43/d4d/c2e db/d15/d17/c74 0 2024-09-10T10:04:13.876 INFO:tasks.workunit.client.0.smithi071.stdout:2/216: dread d8/f28 [0,4194304] 0 2024-09-10T10:04:13.879 INFO:tasks.workunit.client.0.smithi071.stdout:2/217: mknod d8/c3b 0 2024-09-10T10:04:13.880 INFO:tasks.workunit.client.0.smithi071.stdout:7/310: rename d9/fe to d9/d15/d1f/f6d 0 2024-09-10T10:04:13.881 INFO:tasks.workunit.client.0.smithi071.stdout:7/311: stat d9/f34 0 2024-09-10T10:04:13.885 INFO:tasks.workunit.client.0.smithi071.stdout:0/232: dwrite f0 [0,4194304] 0 2024-09-10T10:04:13.885 INFO:tasks.workunit.client.0.smithi071.stdout:8/242: rmdir d5/df/d1e/d38 39 2024-09-10T10:04:13.890 INFO:tasks.workunit.client.0.smithi071.stdout:0/233: dread - d11/d22/d40/f4a zero size 2024-09-10T10:04:13.890 INFO:tasks.workunit.client.0.smithi071.stdout:4/346: dwrite db/d15/d26/d43/f44 [0,4194304] 0 2024-09-10T10:04:13.890 INFO:tasks.workunit.client.0.smithi071.stdout:9/490: dread d0/db/d20/d3c/f57 [0,4194304] 0 2024-09-10T10:04:13.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:13 smithi107 ceph-mon[34215]: pgmap v257: 65 pgs: 65 active+clean; 986 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 126 MiB/s wr, 357 op/s 2024-09-10T10:04:13.895 INFO:tasks.workunit.client.0.smithi071.stdout:0/234: mknod d11/d22/d31/c54 0 2024-09-10T10:04:13.896 INFO:tasks.workunit.client.0.smithi071.stdout:2/218: dwrite d8/f14 [0,4194304] 0 2024-09-10T10:04:13.899 INFO:tasks.workunit.client.0.smithi071.stdout:4/347: creat db/d15/d17/f75 x:0 0 0 2024-09-10T10:04:13.899 INFO:tasks.workunit.client.0.smithi071.stdout:7/312: dwrite d9/d15/f51 [0,4194304] 0 2024-09-10T10:04:13.901 INFO:tasks.workunit.client.0.smithi071.stdout:0/235: rmdir d11/d30 39 2024-09-10T10:04:13.902 INFO:tasks.workunit.client.0.smithi071.stdout:8/243: dread d5/f10 [0,4194304] 0 2024-09-10T10:04:13.903 INFO:tasks.workunit.client.0.smithi071.stdout:7/313: chown d9/d1a/l4c 16260196 1 2024-09-10T10:04:13.903 INFO:tasks.workunit.client.0.smithi071.stdout:4/348: creat db/d1d/d61/f76 x:0 0 0 2024-09-10T10:04:13.904 INFO:tasks.workunit.client.0.smithi071.stdout:2/219: creat d8/d13/d33/f3c x:0 0 0 2024-09-10T10:04:13.904 INFO:tasks.workunit.client.0.smithi071.stdout:8/244: chown d5/fe 1319 1 2024-09-10T10:04:13.907 INFO:tasks.workunit.client.0.smithi071.stdout:8/245: chown d5/df/d16/l47 0 1 2024-09-10T10:04:13.909 INFO:tasks.workunit.client.0.smithi071.stdout:7/314: getdents d9/d11 0 2024-09-10T10:04:13.910 INFO:tasks.workunit.client.0.smithi071.stdout:2/220: rename d8/c3b to d8/d13/c3d 0 2024-09-10T10:04:13.910 INFO:tasks.workunit.client.0.smithi071.stdout:0/236: dwrite d11/d22/f4e [0,4194304] 0 2024-09-10T10:04:13.912 INFO:tasks.workunit.client.0.smithi071.stdout:7/315: creat d9/d15/d55/f6e x:0 0 0 2024-09-10T10:04:13.916 INFO:tasks.workunit.client.0.smithi071.stdout:8/246: dwrite d5/f11 [0,4194304] 0 2024-09-10T10:04:13.916 INFO:tasks.workunit.client.0.smithi071.stdout:8/247: stat d5/f33 0 2024-09-10T10:04:13.916 INFO:tasks.workunit.client.0.smithi071.stdout:7/316: rmdir d9/d1a/d1d/d39 39 2024-09-10T10:04:13.919 INFO:tasks.workunit.client.0.smithi071.stdout:6/251: sync 2024-09-10T10:04:13.920 INFO:tasks.workunit.client.0.smithi071.stdout:2/221: rename d8/d13/l32 to d8/d13/d33/l3e 0 2024-09-10T10:04:13.921 INFO:tasks.workunit.client.0.smithi071.stdout:6/252: chown d4/da/df/d2e/d3a/d43 5108471 1 2024-09-10T10:04:13.923 INFO:tasks.workunit.client.0.smithi071.stdout:8/248: link d5/fa d5/df/d57/f5a 0 2024-09-10T10:04:13.924 INFO:tasks.workunit.client.0.smithi071.stdout:7/317: dwrite f2 [4194304,4194304] 0 2024-09-10T10:04:13.925 INFO:tasks.workunit.client.0.smithi071.stdout:7/318: readlink d9/d15/l16 0 2024-09-10T10:04:13.926 INFO:tasks.workunit.client.0.smithi071.stdout:6/253: rename d4/da/l2d to d4/da/df/l4f 0 2024-09-10T10:04:13.927 INFO:tasks.workunit.client.0.smithi071.stdout:4/349: rmdir db/d15/d17 39 2024-09-10T10:04:13.927 INFO:tasks.workunit.client.0.smithi071.stdout:6/254: write d4/d1c/f4d [957816,28259] 0 2024-09-10T10:04:13.929 INFO:tasks.workunit.client.0.smithi071.stdout:6/255: write d4/d1c/f42 [3445459,62146] 0 2024-09-10T10:04:13.929 INFO:tasks.workunit.client.0.smithi071.stdout:8/249: write d5/f19 [3277142,35122] 0 2024-09-10T10:04:13.930 INFO:tasks.workunit.client.0.smithi071.stdout:7/319: mkdir d9/d11/d6f 0 2024-09-10T10:04:13.934 INFO:tasks.workunit.client.0.smithi071.stdout:2/222: dread d8/fb [0,4194304] 0 2024-09-10T10:04:13.934 INFO:tasks.workunit.client.0.smithi071.stdout:4/350: chown db/d15/d26 1018839 1 2024-09-10T10:04:13.935 INFO:tasks.workunit.client.0.smithi071.stdout:9/491: dwrite d0/d3b/f48 [0,4194304] 0 2024-09-10T10:04:13.937 INFO:tasks.workunit.client.0.smithi071.stdout:6/256: link d4/da/f33 d4/da/df/f50 0 2024-09-10T10:04:13.937 INFO:tasks.workunit.client.0.smithi071.stdout:2/223: fsync d8/fb 0 2024-09-10T10:04:13.938 INFO:tasks.workunit.client.0.smithi071.stdout:8/250: creat d5/df/f5b x:0 0 0 2024-09-10T10:04:13.941 INFO:tasks.workunit.client.0.smithi071.stdout:4/351: mkdir db/d15/d26/d43/d4d/d77 0 2024-09-10T10:04:13.941 INFO:tasks.workunit.client.0.smithi071.stdout:7/320: dwrite d9/fa [0,4194304] 0 2024-09-10T10:04:13.942 INFO:tasks.workunit.client.0.smithi071.stdout:2/224: symlink d8/d24/l3f 0 2024-09-10T10:04:13.945 INFO:tasks.workunit.client.0.smithi071.stdout:8/251: symlink d5/d30/l5c 0 2024-09-10T10:04:13.948 INFO:tasks.workunit.client.0.smithi071.stdout:4/352: creat db/d15/d26/d43/d4d/f78 x:0 0 0 2024-09-10T10:04:13.949 INFO:tasks.workunit.client.0.smithi071.stdout:2/225: creat d8/d13/d33/f40 x:0 0 0 2024-09-10T10:04:13.949 INFO:tasks.workunit.client.0.smithi071.stdout:7/321: mkdir d9/d70 0 2024-09-10T10:04:13.950 INFO:tasks.workunit.client.0.smithi071.stdout:8/252: symlink d5/d36/l5d 0 2024-09-10T10:04:13.951 INFO:tasks.workunit.client.0.smithi071.stdout:9/492: dread d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f8d [0,4194304] 0 2024-09-10T10:04:13.951 INFO:tasks.workunit.client.0.smithi071.stdout:6/257: dwrite d4/da/df/f2c [0,4194304] 0 2024-09-10T10:04:13.954 INFO:tasks.workunit.client.0.smithi071.stdout:9/493: write d0/d3b/f90 [5084478,57039] 0 2024-09-10T10:04:13.956 INFO:tasks.workunit.client.0.smithi071.stdout:0/237: dwrite d11/d22/d31/f41 [0,4194304] 0 2024-09-10T10:04:13.959 INFO:tasks.workunit.client.0.smithi071.stdout:2/226: mkdir d8/d13/d33/d41 0 2024-09-10T10:04:13.960 INFO:tasks.workunit.client.0.smithi071.stdout:9/494: write d0/f87 [115490,57157] 0 2024-09-10T10:04:13.961 INFO:tasks.workunit.client.0.smithi071.stdout:6/258: write d4/da/f33 [953476,70335] 0 2024-09-10T10:04:13.962 INFO:tasks.workunit.client.0.smithi071.stdout:7/322: rename d9/d2c/d49/l64 to d9/d2c/d49/l71 0 2024-09-10T10:04:13.965 INFO:tasks.workunit.client.0.smithi071.stdout:8/253: truncate d5/df/d1d/f59 450584 0 2024-09-10T10:04:13.967 INFO:tasks.workunit.client.0.smithi071.stdout:7/323: truncate d9/d15/f6c 303624 0 2024-09-10T10:04:13.967 INFO:tasks.workunit.client.0.smithi071.stdout:0/238: symlink d11/d22/l55 0 2024-09-10T10:04:13.967 INFO:tasks.workunit.client.0.smithi071.stdout:4/353: dwrite db/d15/d26/d43/d4d/f4a [0,4194304] 0 2024-09-10T10:04:13.970 INFO:tasks.workunit.client.0.smithi071.stdout:6/259: mkdir d4/da/df/d2e/d3a/d51 0 2024-09-10T10:04:13.971 INFO:tasks.workunit.client.0.smithi071.stdout:6/260: stat d4/d20/c2b 0 2024-09-10T10:04:13.975 INFO:tasks.workunit.client.0.smithi071.stdout:5/268: sync 2024-09-10T10:04:13.975 INFO:tasks.workunit.client.0.smithi071.stdout:3/257: sync 2024-09-10T10:04:13.975 INFO:tasks.workunit.client.0.smithi071.stdout:7/324: symlink d9/d11/d6f/l72 0 2024-09-10T10:04:13.975 INFO:tasks.workunit.client.0.smithi071.stdout:1/255: sync 2024-09-10T10:04:13.978 INFO:tasks.workunit.client.0.smithi071.stdout:4/354: link db/d15/d26/d43/d4d/c67 db/d1d/d61/d6a/c79 0 2024-09-10T10:04:13.979 INFO:tasks.workunit.client.0.smithi071.stdout:5/269: creat dc/d53/f60 x:0 0 0 2024-09-10T10:04:13.980 INFO:tasks.workunit.client.0.smithi071.stdout:0/239: dwrite d11/f18 [0,4194304] 0 2024-09-10T10:04:13.981 INFO:tasks.workunit.client.0.smithi071.stdout:3/258: mknod d3/d10/d24/c5e 0 2024-09-10T10:04:13.981 INFO:tasks.workunit.client.0.smithi071.stdout:7/325: dread - d9/d1a/d1d/d39/f3d zero size 2024-09-10T10:04:13.984 INFO:tasks.workunit.client.0.smithi071.stdout:5/270: mkdir dc/d4a/d61 0 2024-09-10T10:04:13.988 INFO:tasks.workunit.client.0.smithi071.stdout:0/240: mknod d11/d30/d52/c56 0 2024-09-10T10:04:13.988 INFO:tasks.workunit.client.0.smithi071.stdout:9/495: write d0/d3b/f3e [1244050,128490] 0 2024-09-10T10:04:13.989 INFO:tasks.workunit.client.0.smithi071.stdout:0/241: chown d11/d22/l55 450757 1 2024-09-10T10:04:13.990 INFO:tasks.workunit.client.0.smithi071.stdout:9/496: chown d0/db/d20/l43 1 1 2024-09-10T10:04:13.991 INFO:tasks.workunit.client.0.smithi071.stdout:0/242: fdatasync d11/d22/d40/f4a 0 2024-09-10T10:04:13.994 INFO:tasks.workunit.client.0.smithi071.stdout:7/326: link d9/d15/l50 d9/d11/d6f/l73 0 2024-09-10T10:04:13.996 INFO:tasks.workunit.client.0.smithi071.stdout:5/271: getdents dc/df/d3e/d5a 0 2024-09-10T10:04:13.997 INFO:tasks.workunit.client.0.smithi071.stdout:9/497: mkdir d0/da0 0 2024-09-10T10:04:13.998 INFO:tasks.workunit.client.0.smithi071.stdout:4/355: write db/f46 [3884302,126319] 0 2024-09-10T10:04:13.999 INFO:tasks.workunit.client.0.smithi071.stdout:2/227: dwrite d8/ff [0,4194304] 0 2024-09-10T10:04:14.001 INFO:tasks.workunit.client.0.smithi071.stdout:3/259: write d3/ff [1331674,65057] 0 2024-09-10T10:04:14.003 INFO:tasks.workunit.client.0.smithi071.stdout:8/254: dwrite d5/df/d57/f5a [0,4194304] 0 2024-09-10T10:04:14.004 INFO:tasks.workunit.client.0.smithi071.stdout:7/327: mkdir d9/d15/d1f/d74 0 2024-09-10T10:04:14.005 INFO:tasks.workunit.client.0.smithi071.stdout:2/228: chown d8/f28 3 1 2024-09-10T10:04:14.006 INFO:tasks.workunit.client.0.smithi071.stdout:5/272: write dc/df/d17/d22/f44 [1025035,94720] 0 2024-09-10T10:04:14.007 INFO:tasks.workunit.client.0.smithi071.stdout:9/498: fdatasync d0/d3b/d44/f63 0 2024-09-10T10:04:14.009 INFO:tasks.workunit.client.0.smithi071.stdout:0/243: truncate d11/d1e/f2d 1706217 0 2024-09-10T10:04:14.009 INFO:tasks.workunit.client.0.smithi071.stdout:7/328: stat d9/d2c/l43 0 2024-09-10T10:04:14.009 INFO:tasks.workunit.client.0.smithi071.stdout:1/256: dwrite d1/f37 [8388608,4194304] 0 2024-09-10T10:04:14.009 INFO:tasks.workunit.client.0.smithi071.stdout:3/260: creat d3/d20/d30/f5f x:0 0 0 2024-09-10T10:04:14.014 INFO:tasks.workunit.client.0.smithi071.stdout:5/273: symlink dc/df/d3e/l62 0 2024-09-10T10:04:14.016 INFO:tasks.workunit.client.0.smithi071.stdout:9/499: mknod d0/db/d20/d21/ca1 0 2024-09-10T10:04:14.020 INFO:tasks.workunit.client.1.smithi107.stdout:9/369: sync 2024-09-10T10:04:14.020 INFO:tasks.workunit.client.1.smithi107.stdout:8/253: sync 2024-09-10T10:04:14.020 INFO:tasks.workunit.client.1.smithi107.stdout:7/303: sync 2024-09-10T10:04:14.020 INFO:tasks.workunit.client.1.smithi107.stdout:3/545: sync 2024-09-10T10:04:14.021 INFO:tasks.workunit.client.1.smithi107.stdout:1/436: sync 2024-09-10T10:04:14.021 INFO:tasks.workunit.client.1.smithi107.stdout:7/304: dread - d0/f36 zero size 2024-09-10T10:04:14.022 INFO:tasks.workunit.client.0.smithi071.stdout:1/257: link d1/d21/d2f/d30/f31 d1/d21/f4d 0 2024-09-10T10:04:14.022 INFO:tasks.workunit.client.0.smithi071.stdout:8/255: dwrite d5/d36/f39 [0,4194304] 0 2024-09-10T10:04:14.023 INFO:tasks.workunit.client.1.smithi107.stdout:1/437: write d2/d12/d5a/f70 [68920,21979] 0 2024-09-10T10:04:14.023 INFO:tasks.workunit.client.1.smithi107.stdout:7/305: chown d0/d20/f44 2840 1 2024-09-10T10:04:14.024 INFO:tasks.workunit.client.0.smithi071.stdout:9/500: write d0/db/d1b/f78 [639437,114034] 0 2024-09-10T10:04:14.024 INFO:tasks.workunit.client.1.smithi107.stdout:3/546: symlink dc/dd/d20/lb2 0 2024-09-10T10:04:14.027 INFO:tasks.workunit.client.0.smithi071.stdout:5/274: link dc/df/d17/d22/f44 dc/df/d3e/f63 0 2024-09-10T10:04:14.027 INFO:tasks.workunit.client.0.smithi071.stdout:7/329: truncate d9/d15/d1f/f2a 2779621 0 2024-09-10T10:04:14.027 INFO:tasks.workunit.client.0.smithi071.stdout:0/244: dwrite d11/f14 [0,4194304] 0 2024-09-10T10:04:14.028 INFO:tasks.workunit.client.1.smithi107.stdout:1/438: fsync d2/d6/d67/f77 0 2024-09-10T10:04:14.029 INFO:tasks.workunit.client.1.smithi107.stdout:7/306: unlink d0/d1b/f4a 0 2024-09-10T10:04:14.029 INFO:tasks.workunit.client.0.smithi071.stdout:3/261: dwrite d3/d20/d30/d42/d4a/f59 [0,4194304] 0 2024-09-10T10:04:14.034 INFO:tasks.workunit.client.0.smithi071.stdout:1/258: creat d1/d1e/f4e x:0 0 0 2024-09-10T10:04:14.034 INFO:tasks.workunit.client.1.smithi107.stdout:9/370: dwrite f3 [0,4194304] 0 2024-09-10T10:04:14.035 INFO:tasks.workunit.client.1.smithi107.stdout:7/307: truncate d0/d8/f11 1538561 0 2024-09-10T10:04:14.036 INFO:tasks.workunit.client.1.smithi107.stdout:6/402: sync 2024-09-10T10:04:14.036 INFO:tasks.workunit.client.1.smithi107.stdout:2/382: sync 2024-09-10T10:04:14.036 INFO:tasks.workunit.client.1.smithi107.stdout:0/288: sync 2024-09-10T10:04:14.036 INFO:tasks.workunit.client.1.smithi107.stdout:4/449: sync 2024-09-10T10:04:14.036 INFO:tasks.workunit.client.1.smithi107.stdout:1/439: fdatasync d2/d36/f4d 0 2024-09-10T10:04:14.037 INFO:tasks.workunit.client.0.smithi071.stdout:9/501: symlink d0/db/d1b/d46/la2 0 2024-09-10T10:04:14.037 INFO:tasks.workunit.client.0.smithi071.stdout:0/245: write d11/d22/f29 [4582130,53013] 0 2024-09-10T10:04:14.037 INFO:tasks.workunit.client.0.smithi071.stdout:7/330: symlink d9/d15/d40/l75 0 2024-09-10T10:04:14.038 INFO:tasks.workunit.client.0.smithi071.stdout:1/259: unlink d1/d21/d2f/d30/f31 0 2024-09-10T10:04:14.039 INFO:tasks.workunit.client.0.smithi071.stdout:3/262: read d3/d20/d30/f51 [473485,77668] 0 2024-09-10T10:04:14.040 INFO:tasks.workunit.client.0.smithi071.stdout:5/275: mknod dc/d4a/d61/c64 0 2024-09-10T10:04:14.042 INFO:tasks.workunit.client.1.smithi107.stdout:4/450: dread - d0/d6b/f96 zero size 2024-09-10T10:04:14.045 INFO:tasks.workunit.client.0.smithi071.stdout:3/263: mkdir d3/d20/d30/d42/d4a/d60 0 2024-09-10T10:04:14.045 INFO:tasks.workunit.client.1.smithi107.stdout:8/254: dwrite d5/d8/f20 [4194304,4194304] 0 2024-09-10T10:04:14.045 INFO:tasks.workunit.client.1.smithi107.stdout:9/371: write d5/d7/d3c/d53/d57/d87/d50/f28 [1688351,101668] 0 2024-09-10T10:04:14.046 INFO:tasks.workunit.client.0.smithi071.stdout:1/260: rename d1/d21/d2f/f3e to d1/d21/d3d/f4f 0 2024-09-10T10:04:14.048 INFO:tasks.workunit.client.1.smithi107.stdout:2/383: rmdir d3/da/df 39 2024-09-10T10:04:14.053 INFO:tasks.workunit.client.0.smithi071.stdout:0/246: dwrite d11/d22/f23 [0,4194304] 0 2024-09-10T10:04:14.054 INFO:tasks.workunit.client.1.smithi107.stdout:1/440: write d2/d6/d24/f69 [269488,73207] 0 2024-09-10T10:04:14.054 INFO:tasks.workunit.client.0.smithi071.stdout:2/229: dread d8/f10 [0,4194304] 0 2024-09-10T10:04:14.054 INFO:tasks.workunit.client.1.smithi107.stdout:7/308: dread d0/d1b/f28 [0,4194304] 0 2024-09-10T10:04:14.055 INFO:tasks.workunit.client.0.smithi071.stdout:5/276: dwrite dc/df/d29/f5f [0,4194304] 0 2024-09-10T10:04:14.057 INFO:tasks.workunit.client.0.smithi071.stdout:5/277: stat dc/df/l24 0 2024-09-10T10:04:14.057 INFO:tasks.workunit.client.0.smithi071.stdout:1/261: creat d1/d21/d42/f50 x:0 0 0 2024-09-10T10:04:14.058 INFO:tasks.workunit.client.0.smithi071.stdout:0/247: write d11/d22/f29 [156380,121520] 0 2024-09-10T10:04:14.058 INFO:tasks.workunit.client.1.smithi107.stdout:0/289: dwrite d6/d8/d2f/d2e/d32/f37 [8388608,4194304] 0 2024-09-10T10:04:14.059 INFO:tasks.workunit.client.1.smithi107.stdout:2/384: creat d3/da/df/d20/f82 x:0 0 0 2024-09-10T10:04:14.061 INFO:tasks.workunit.client.1.smithi107.stdout:7/309: chown d0/d8/f38 3 1 2024-09-10T10:04:14.064 INFO:tasks.workunit.client.1.smithi107.stdout:9/372: creat d5/d7/d3c/d53/d57/f8a x:0 0 0 2024-09-10T10:04:14.065 INFO:tasks.workunit.client.1.smithi107.stdout:3/547: dwrite dc/dd/d45/d26/d41/d44/d35/f66 [0,4194304] 0 2024-09-10T10:04:14.065 INFO:tasks.workunit.client.0.smithi071.stdout:1/262: truncate d1/f2e 535746 0 2024-09-10T10:04:14.066 INFO:tasks.workunit.client.0.smithi071.stdout:2/230: symlink d8/d13/l42 0 2024-09-10T10:04:14.066 INFO:tasks.workunit.client.1.smithi107.stdout:8/255: truncate d5/d8/dc/d1a/f43 482374 0 2024-09-10T10:04:14.067 INFO:tasks.workunit.client.1.smithi107.stdout:0/290: mknod d6/d14/c55 0 2024-09-10T10:04:14.070 INFO:tasks.workunit.client.1.smithi107.stdout:4/451: dwrite d0/d1f/d20/d47/f9b [0,4194304] 0 2024-09-10T10:04:14.071 INFO:tasks.workunit.client.0.smithi071.stdout:8/256: dwrite f3 [4194304,4194304] 0 2024-09-10T10:04:14.072 INFO:tasks.workunit.client.0.smithi071.stdout:3/264: getdents d3/d20 0 2024-09-10T10:04:14.073 INFO:tasks.workunit.client.1.smithi107.stdout:1/441: mkdir d2/d89 0 2024-09-10T10:04:14.074 INFO:tasks.workunit.client.1.smithi107.stdout:2/385: creat d3/da/df/d20/d36/d4f/f83 x:0 0 0 2024-09-10T10:04:14.075 INFO:tasks.workunit.client.1.smithi107.stdout:9/373: fdatasync d5/d7/d1d/d41/f71 0 2024-09-10T10:04:14.078 INFO:tasks.workunit.client.1.smithi107.stdout:4/452: truncate d0/d1f/d20/f30 3648295 0 2024-09-10T10:04:14.079 INFO:tasks.workunit.client.0.smithi071.stdout:5/278: dwrite dc/df/d17/f1f [0,4194304] 0 2024-09-10T10:04:14.081 INFO:tasks.workunit.client.0.smithi071.stdout:2/231: write d8/f10 [2885015,87463] 0 2024-09-10T10:04:14.084 INFO:tasks.workunit.client.0.smithi071.stdout:1/263: dwrite d1/d1e/f4e [0,4194304] 0 2024-09-10T10:04:14.085 INFO:tasks.workunit.client.0.smithi071.stdout:1/264: readlink d1/l1c 0 2024-09-10T10:04:14.088 INFO:tasks.workunit.client.1.smithi107.stdout:9/374: chown d5/d7/d3c/d53/d57/d87/d50/l33 69 1 2024-09-10T10:04:14.089 INFO:tasks.workunit.client.1.smithi107.stdout:4/453: fdatasync d0/d1f/f55 0 2024-09-10T10:04:14.090 INFO:tasks.workunit.client.0.smithi071.stdout:3/265: rename d3/d1c/d3c/c5b to d3/d20/d30/d42/d4a/c61 0 2024-09-10T10:04:14.091 INFO:tasks.workunit.client.0.smithi071.stdout:0/248: getdents d11/d22/d40 0 2024-09-10T10:04:14.093 INFO:tasks.workunit.client.0.smithi071.stdout:3/266: write d3/d20/d30/f5f [567212,89299] 0 2024-09-10T10:04:14.093 INFO:tasks.workunit.client.1.smithi107.stdout:7/310: getdents d0 0 2024-09-10T10:04:14.094 INFO:tasks.workunit.client.0.smithi071.stdout:8/257: write d5/df/d1e/d38/f42 [915035,116821] 0 2024-09-10T10:04:14.094 INFO:tasks.workunit.client.1.smithi107.stdout:3/548: getdents dc/dd/d45/d26/d59/d5f 0 2024-09-10T10:04:14.094 INFO:tasks.workunit.client.1.smithi107.stdout:9/375: dread d5/d7/d3c/d53/d57/d87/d37/f63 [0,4194304] 0 2024-09-10T10:04:14.095 INFO:tasks.workunit.client.0.smithi071.stdout:2/232: link d8/d13/d33/f40 d8/d13/d33/d41/f43 0 2024-09-10T10:04:14.096 INFO:tasks.workunit.client.1.smithi107.stdout:1/442: dwrite d2/d12/f3e [4194304,4194304] 0 2024-09-10T10:04:14.099 INFO:tasks.workunit.client.0.smithi071.stdout:3/267: truncate d3/f41 399355 0 2024-09-10T10:04:14.099 INFO:tasks.workunit.client.0.smithi071.stdout:5/279: dwrite dc/df/f3b [0,4194304] 0 2024-09-10T10:04:14.101 INFO:tasks.workunit.client.1.smithi107.stdout:1/443: chown d2/d36/c48 220454771 1 2024-09-10T10:04:14.101 INFO:tasks.workunit.client.1.smithi107.stdout:4/454: creat d0/d40/d75/d53/fa2 x:0 0 0 2024-09-10T10:04:14.101 INFO:tasks.workunit.client.0.smithi071.stdout:2/233: write d8/f28 [385999,75562] 0 2024-09-10T10:04:14.102 INFO:tasks.workunit.client.1.smithi107.stdout:8/256: dread d5/d8/f32 [0,4194304] 0 2024-09-10T10:04:14.102 INFO:tasks.workunit.client.0.smithi071.stdout:8/258: rename d5/df/d16 to d5/df/d16/d5e 22 2024-09-10T10:04:14.104 INFO:tasks.workunit.client.1.smithi107.stdout:3/549: fsync dc/dd/d20/d23/d39/faf 0 2024-09-10T10:04:14.104 INFO:tasks.workunit.client.1.smithi107.stdout:7/311: write d0/d8/d9/d3d/f55 [2844391,81634] 0 2024-09-10T10:04:14.104 INFO:tasks.workunit.client.1.smithi107.stdout:8/257: fdatasync d5/d8/f24 0 2024-09-10T10:04:14.105 INFO:tasks.workunit.client.0.smithi071.stdout:8/259: fdatasync d5/f10 0 2024-09-10T10:04:14.105 INFO:tasks.workunit.client.0.smithi071.stdout:0/249: dwrite d11/d22/d40/f44 [0,4194304] 0 2024-09-10T10:04:14.106 INFO:tasks.workunit.client.1.smithi107.stdout:4/455: stat d0/c1a 0 2024-09-10T10:04:14.106 INFO:tasks.workunit.client.1.smithi107.stdout:9/376: dread - d5/d7/d3c/d53/f5d zero size 2024-09-10T10:04:14.108 INFO:tasks.workunit.client.0.smithi071.stdout:2/234: rename d8/d13/c23 to d8/d13/c44 0 2024-09-10T10:04:14.109 INFO:tasks.workunit.client.0.smithi071.stdout:2/235: dread - d8/d13/d33/d41/f43 zero size 2024-09-10T10:04:14.109 INFO:tasks.workunit.client.1.smithi107.stdout:7/312: write d0/d8/d9/d3d/f55 [2984201,79878] 0 2024-09-10T10:04:14.110 INFO:tasks.workunit.client.0.smithi071.stdout:3/268: link d3/d49/f4c d3/d20/d39/f62 0 2024-09-10T10:04:14.110 INFO:tasks.workunit.client.1.smithi107.stdout:3/550: creat dc/dd/d42/d55/fb3 x:0 0 0 2024-09-10T10:04:14.111 INFO:tasks.workunit.client.0.smithi071.stdout:8/260: unlink d5/df/d16/f2c 0 2024-09-10T10:04:14.112 INFO:tasks.workunit.client.1.smithi107.stdout:1/444: symlink d2/d12/d65/d6b/l8a 0 2024-09-10T10:04:14.112 INFO:tasks.workunit.client.1.smithi107.stdout:0/291: dread d6/d8/d2f/d2e/f4d [4194304,4194304] 0 2024-09-10T10:04:14.114 INFO:tasks.workunit.client.0.smithi071.stdout:5/280: unlink dc/df/d29/d48/l54 0 2024-09-10T10:04:14.114 INFO:tasks.workunit.client.1.smithi107.stdout:4/456: mknod d0/d1f/d72/ca3 0 2024-09-10T10:04:14.117 INFO:tasks.workunit.client.0.smithi071.stdout:2/236: unlink d8/d13/l42 0 2024-09-10T10:04:14.118 INFO:tasks.workunit.client.1.smithi107.stdout:1/445: mkdir d2/d35/d7b/d8b 0 2024-09-10T10:04:14.118 INFO:tasks.workunit.client.1.smithi107.stdout:4/457: dread - d0/d1f/d20/f4c zero size 2024-09-10T10:04:14.119 INFO:tasks.workunit.client.0.smithi071.stdout:0/250: mknod d11/d22/c57 0 2024-09-10T10:04:14.119 INFO:tasks.workunit.client.1.smithi107.stdout:3/551: creat dc/dd/d20/d23/d2f/fb4 x:0 0 0 2024-09-10T10:04:14.119 INFO:tasks.workunit.client.1.smithi107.stdout:1/446: stat d2/d12/d71 0 2024-09-10T10:04:14.120 INFO:tasks.workunit.client.1.smithi107.stdout:1/447: chown d2/d35 715082150 1 2024-09-10T10:04:14.121 INFO:tasks.workunit.client.0.smithi071.stdout:0/251: rmdir d11/d22/d40 39 2024-09-10T10:04:14.122 INFO:tasks.workunit.client.0.smithi071.stdout:0/252: readlink d11/d22/l55 0 2024-09-10T10:04:14.123 INFO:tasks.workunit.client.0.smithi071.stdout:0/253: write d11/d22/f23 [3448751,118428] 0 2024-09-10T10:04:14.123 INFO:tasks.workunit.client.0.smithi071.stdout:8/261: creat d5/df/f5f x:0 0 0 2024-09-10T10:04:14.124 INFO:tasks.workunit.client.0.smithi071.stdout:0/254: dread - d11/d30/f45 zero size 2024-09-10T10:04:14.124 INFO:tasks.workunit.client.0.smithi071.stdout:2/237: rename d8/c19 to d8/d24/c45 0 2024-09-10T10:04:14.126 INFO:tasks.workunit.client.1.smithi107.stdout:0/292: mkdir d6/d8/d2f/d2e/d32/d56 0 2024-09-10T10:04:14.128 INFO:tasks.workunit.client.1.smithi107.stdout:4/458: symlink d0/d1f/d20/d47/la4 0 2024-09-10T10:04:14.128 INFO:tasks.workunit.client.1.smithi107.stdout:0/293: write d6/f45 [3322937,70256] 0 2024-09-10T10:04:14.128 INFO:tasks.workunit.client.0.smithi071.stdout:2/238: unlink d8/fe 0 2024-09-10T10:04:14.129 INFO:tasks.workunit.client.0.smithi071.stdout:8/262: mknod d5/df/c60 0 2024-09-10T10:04:14.131 INFO:tasks.workunit.client.0.smithi071.stdout:2/239: symlink d8/d13/d33/d41/l46 0 2024-09-10T10:04:14.131 INFO:tasks.workunit.client.1.smithi107.stdout:3/552: creat dc/dd/d45/fb5 x:0 0 0 2024-09-10T10:04:14.134 INFO:tasks.workunit.client.0.smithi071.stdout:2/240: mkdir d8/d38/d47 0 2024-09-10T10:04:14.134 INFO:tasks.workunit.client.0.smithi071.stdout:8/263: getdents d5/d36 0 2024-09-10T10:04:14.136 INFO:tasks.workunit.client.1.smithi107.stdout:3/553: symlink dc/dd/d42/d55/d58/d91/lb6 0 2024-09-10T10:04:14.136 INFO:tasks.workunit.client.1.smithi107.stdout:4/459: dwrite d0/d40/d75/f5f [0,4194304] 0 2024-09-10T10:04:14.137 INFO:tasks.workunit.client.0.smithi071.stdout:8/264: creat d5/d36/d49/f61 x:0 0 0 2024-09-10T10:04:14.138 INFO:tasks.workunit.client.0.smithi071.stdout:2/241: read f2 [2975197,10586] 0 2024-09-10T10:04:14.140 INFO:tasks.workunit.client.1.smithi107.stdout:3/554: unlink dc/dd/d42/l5e 0 2024-09-10T10:04:14.140 INFO:tasks.workunit.client.1.smithi107.stdout:4/460: write d0/d40/d57/d76/d77/da1/f5b [3186411,75250] 0 2024-09-10T10:04:14.141 INFO:tasks.workunit.client.1.smithi107.stdout:4/461: readlink d0/d1f/l3c 0 2024-09-10T10:04:14.141 INFO:tasks.workunit.client.0.smithi071.stdout:0/255: dread d11/d22/f4f [0,4194304] 0 2024-09-10T10:04:14.144 INFO:tasks.workunit.client.0.smithi071.stdout:2/242: creat d8/f48 x:0 0 0 2024-09-10T10:04:14.145 INFO:tasks.workunit.client.0.smithi071.stdout:0/256: creat d11/d1e/f58 x:0 0 0 2024-09-10T10:04:14.145 INFO:tasks.workunit.client.0.smithi071.stdout:8/265: dwrite d5/f33 [0,4194304] 0 2024-09-10T10:04:14.146 INFO:tasks.workunit.client.0.smithi071.stdout:6/261: sync 2024-09-10T10:04:14.148 INFO:tasks.workunit.client.0.smithi071.stdout:8/266: chown d5/df/d1d 1942 1 2024-09-10T10:04:14.148 INFO:tasks.workunit.client.1.smithi107.stdout:3/555: link dc/dd/c54 dc/dd/d42/d55/d58/cb7 0 2024-09-10T10:04:14.149 INFO:tasks.workunit.client.0.smithi071.stdout:2/243: mkdir d8/d13/d49 0 2024-09-10T10:04:14.150 INFO:tasks.workunit.client.1.smithi107.stdout:9/377: dread d5/d7/d3c/d53/d57/d87/d27/f51 [0,4194304] 0 2024-09-10T10:04:14.150 INFO:tasks.workunit.client.1.smithi107.stdout:4/462: dwrite d0/d40/f68 [0,4194304] 0 2024-09-10T10:04:14.154 INFO:tasks.workunit.client.0.smithi071.stdout:0/257: symlink d11/d22/d40/l59 0 2024-09-10T10:04:14.155 INFO:tasks.workunit.client.0.smithi071.stdout:2/244: mkdir d8/d4a 0 2024-09-10T10:04:14.157 INFO:tasks.workunit.client.1.smithi107.stdout:2/386: truncate d3/da/df/d20/f46 2274322 0 2024-09-10T10:04:14.158 INFO:tasks.workunit.client.1.smithi107.stdout:2/387: chown d3/da/d1e 1132 1 2024-09-10T10:04:14.160 INFO:tasks.workunit.client.1.smithi107.stdout:4/463: rename d0/d1f/d20/c3d to d0/d40/ca5 0 2024-09-10T10:04:14.162 INFO:tasks.workunit.client.0.smithi071.stdout:2/245: dwrite d8/f1a [0,4194304] 0 2024-09-10T10:04:14.163 INFO:tasks.workunit.client.1.smithi107.stdout:5/456: sync 2024-09-10T10:04:14.163 INFO:tasks.workunit.client.1.smithi107.stdout:2/388: creat d3/da/df/d20/d36/d39/f84 x:0 0 0 2024-09-10T10:04:14.166 INFO:tasks.workunit.client.1.smithi107.stdout:0/294: dread d6/f12 [0,4194304] 0 2024-09-10T10:04:14.167 INFO:tasks.workunit.client.1.smithi107.stdout:3/556: rename dc/dd/d45/d26/d59/f90 to dc/dd/d45/d26/d41/d44/fb8 0 2024-09-10T10:04:14.170 INFO:tasks.workunit.client.0.smithi071.stdout:3/269: dread d3/d49/f4c [0,4194304] 0 2024-09-10T10:04:14.171 INFO:tasks.workunit.client.0.smithi071.stdout:3/270: stat d3/d49/d34/f44 0 2024-09-10T10:04:14.171 INFO:tasks.workunit.client.0.smithi071.stdout:1/265: mkdir d1/d21/d3d/d4a/d51 0 2024-09-10T10:04:14.172 INFO:tasks.workunit.client.0.smithi071.stdout:3/271: fdatasync d3/d20/d30/d42/d4a/f54 0 2024-09-10T10:04:14.172 INFO:tasks.workunit.client.1.smithi107.stdout:5/457: symlink de/d20/d2b/l9d 0 2024-09-10T10:04:14.173 INFO:tasks.workunit.client.0.smithi071.stdout:2/246: creat d8/d4a/f4b x:0 0 0 2024-09-10T10:04:14.173 INFO:tasks.workunit.client.1.smithi107.stdout:5/458: read - de/f90 zero size 2024-09-10T10:04:14.174 INFO:tasks.workunit.client.0.smithi071.stdout:2/247: fdatasync d8/ff 0 2024-09-10T10:04:14.174 INFO:tasks.workunit.client.1.smithi107.stdout:8/258: truncate d5/d8/f20 4428830 0 2024-09-10T10:04:14.176 INFO:tasks.workunit.client.1.smithi107.stdout:8/259: write d5/d8/d2a/d47/f54 [471013,95500] 0 2024-09-10T10:04:14.177 INFO:tasks.workunit.client.1.smithi107.stdout:2/389: rename d3/da/df/d62/d7f/d55/d6f to d3/da/df/d62/d7f/d55/d85 0 2024-09-10T10:04:14.177 INFO:tasks.workunit.client.0.smithi071.stdout:2/248: mknod d8/d13/d33/c4c 0 2024-09-10T10:04:14.178 INFO:tasks.workunit.client.1.smithi107.stdout:2/390: fsync d3/da/df/d20/d36/d4f/f83 0 2024-09-10T10:04:14.178 INFO:tasks.workunit.client.0.smithi071.stdout:2/249: read d8/ff [924763,95251] 0 2024-09-10T10:04:14.179 INFO:tasks.workunit.client.0.smithi071.stdout:1/266: getdents d1/d35 0 2024-09-10T10:04:14.179 INFO:tasks.workunit.client.1.smithi107.stdout:7/313: truncate d0/d20/f3a 451350 0 2024-09-10T10:04:14.179 INFO:tasks.workunit.client.0.smithi071.stdout:1/267: write d1/f40 [190912,100401] 0 2024-09-10T10:04:14.181 INFO:tasks.workunit.client.0.smithi071.stdout:2/250: mkdir d8/d13/d33/d41/d4d 0 2024-09-10T10:04:14.182 INFO:tasks.workunit.client.0.smithi071.stdout:5/281: write dc/df/d3e/f63 [1232415,89136] 0 2024-09-10T10:04:14.182 INFO:tasks.workunit.client.0.smithi071.stdout:2/251: dread - d8/d13/d33/d41/f43 zero size 2024-09-10T10:04:14.183 INFO:tasks.workunit.client.1.smithi107.stdout:5/459: link de/f90 de/d4a/d4e/d89/f9e 0 2024-09-10T10:04:14.183 INFO:tasks.workunit.client.1.smithi107.stdout:2/391: symlink d3/da/df/d62/l86 0 2024-09-10T10:04:14.186 INFO:tasks.workunit.client.1.smithi107.stdout:4/464: getdents d0/d40/d57/d76/d77/da1/d59 0 2024-09-10T10:04:14.186 INFO:tasks.workunit.client.1.smithi107.stdout:0/295: dwrite d6/f12 [0,4194304] 0 2024-09-10T10:04:14.187 INFO:tasks.workunit.client.0.smithi071.stdout:1/268: write d1/d21/f24 [626525,131067] 0 2024-09-10T10:04:14.188 INFO:tasks.workunit.client.1.smithi107.stdout:7/314: fdatasync d0/d8/d9/f4c 0 2024-09-10T10:04:14.189 INFO:tasks.workunit.client.1.smithi107.stdout:8/260: creat d5/f5a x:0 0 0 2024-09-10T10:04:14.190 INFO:tasks.workunit.client.1.smithi107.stdout:3/557: getdents dc/dd/d20/d23/d2f 0 2024-09-10T10:04:14.191 INFO:tasks.workunit.client.1.smithi107.stdout:7/315: stat d0/d8/dc/d2c 0 2024-09-10T10:04:14.192 INFO:tasks.workunit.client.1.smithi107.stdout:3/558: dread - dc/dd/d45/d26/d41/d44/d35/f9b zero size 2024-09-10T10:04:14.192 INFO:tasks.workunit.client.0.smithi071.stdout:5/282: mknod dc/df/d29/c65 0 2024-09-10T10:04:14.192 INFO:tasks.workunit.client.1.smithi107.stdout:2/392: write d3/da/df/d20/d4a/f77 [1536984,36129] 0 2024-09-10T10:04:14.193 INFO:tasks.workunit.client.0.smithi071.stdout:2/252: getdents d8/d38/d47 0 2024-09-10T10:04:14.195 INFO:tasks.workunit.client.1.smithi107.stdout:9/378: dread d5/f64 [0,4194304] 0 2024-09-10T10:04:14.195 INFO:tasks.workunit.client.1.smithi107.stdout:9/379: chown d5 313 1 2024-09-10T10:04:14.196 INFO:tasks.workunit.client.1.smithi107.stdout:4/465: symlink d0/d40/d6d/la6 0 2024-09-10T10:04:14.196 INFO:tasks.workunit.client.0.smithi071.stdout:3/272: dread d3/d20/d30/f51 [0,4194304] 0 2024-09-10T10:04:14.196 INFO:tasks.workunit.client.0.smithi071.stdout:6/262: dread d4/f19 [0,4194304] 0 2024-09-10T10:04:14.197 INFO:tasks.workunit.client.0.smithi071.stdout:1/269: dread d1/f2e [0,4194304] 0 2024-09-10T10:04:14.198 INFO:tasks.workunit.client.0.smithi071.stdout:6/263: readlink d4/d20/l29 0 2024-09-10T10:04:14.198 INFO:tasks.workunit.client.1.smithi107.stdout:3/559: dread dc/dd/d45/f6d [0,4194304] 0 2024-09-10T10:04:14.199 INFO:tasks.workunit.client.1.smithi107.stdout:8/261: mkdir d5/d8/d5b 0 2024-09-10T10:04:14.202 INFO:tasks.workunit.client.1.smithi107.stdout:8/262: truncate d5/d8/dc/d21/f56 76686 0 2024-09-10T10:04:14.202 INFO:tasks.workunit.client.0.smithi071.stdout:1/270: write d1/d3f/f43 [1236280,5493] 0 2024-09-10T10:04:14.203 INFO:tasks.workunit.client.1.smithi107.stdout:7/316: symlink d0/d20/d35/l5f 0 2024-09-10T10:04:14.204 INFO:tasks.workunit.client.0.smithi071.stdout:6/264: link d4/da/df/l2a d4/da/df/d2e/d3a/d3e/d45/l52 0 2024-09-10T10:04:14.205 INFO:tasks.workunit.client.1.smithi107.stdout:7/317: fsync d0/d8/d9/d3d/f55 0 2024-09-10T10:04:14.206 INFO:tasks.workunit.client.0.smithi071.stdout:2/253: dwrite f2 [4194304,4194304] 0 2024-09-10T10:04:14.208 INFO:tasks.workunit.client.1.smithi107.stdout:5/460: dread de/d20/d2b/d4b/f58 [0,4194304] 0 2024-09-10T10:04:14.208 INFO:tasks.workunit.client.1.smithi107.stdout:4/466: symlink d0/d40/d57/d76/d77/da1/la7 0 2024-09-10T10:04:14.209 INFO:tasks.workunit.client.0.smithi071.stdout:5/283: rmdir dc 39 2024-09-10T10:04:14.209 INFO:tasks.workunit.client.0.smithi071.stdout:6/265: dread - d4/da/df/d2e/d3a/d3e/d45/f48 zero size 2024-09-10T10:04:14.211 INFO:tasks.workunit.client.0.smithi071.stdout:3/273: write d3/d49/d34/f44 [1856662,123335] 0 2024-09-10T10:04:14.217 INFO:tasks.workunit.client.1.smithi107.stdout:4/467: dread d0/d40/d57/d4f/fa0 [0,4194304] 0 2024-09-10T10:04:14.217 INFO:tasks.workunit.client.1.smithi107.stdout:2/393: creat d3/da/df/d20/d4a/f87 x:0 0 0 2024-09-10T10:04:14.217 INFO:tasks.workunit.client.0.smithi071.stdout:2/254: link d8/d13/c27 d8/d38/d47/c4e 0 2024-09-10T10:04:14.217 INFO:tasks.workunit.client.0.smithi071.stdout:1/271: dwrite d1/f19 [0,4194304] 0 2024-09-10T10:04:14.217 INFO:tasks.workunit.client.0.smithi071.stdout:6/266: write d4/f28 [801518,90394] 0 2024-09-10T10:04:14.217 INFO:tasks.workunit.client.0.smithi071.stdout:3/274: write d3/d49/d34/f44 [2375718,80826] 0 2024-09-10T10:04:14.218 INFO:tasks.workunit.client.0.smithi071.stdout:2/255: mknod d8/d13/c4f 0 2024-09-10T10:04:14.218 INFO:tasks.workunit.client.1.smithi107.stdout:7/318: write d0/d8/f32 [975628,17776] 0 2024-09-10T10:04:14.221 INFO:tasks.workunit.client.0.smithi071.stdout:3/275: dread d3/d10/d24/f27 [0,4194304] 0 2024-09-10T10:04:14.223 INFO:tasks.workunit.client.0.smithi071.stdout:1/272: creat d1/d21/d3d/d4a/d51/f52 x:0 0 0 2024-09-10T10:04:14.224 INFO:tasks.workunit.client.1.smithi107.stdout:0/296: getdents d6/d8/d2f 0 2024-09-10T10:04:14.225 INFO:tasks.workunit.client.0.smithi071.stdout:6/267: getdents d4/da/df/d2e/d3a/d51 0 2024-09-10T10:04:14.226 INFO:tasks.workunit.client.0.smithi071.stdout:2/256: dwrite d8/f14 [0,4194304] 0 2024-09-10T10:04:14.226 INFO:tasks.workunit.client.0.smithi071.stdout:6/268: chown d4/d1c/f3d 497828865 1 2024-09-10T10:04:14.227 INFO:tasks.workunit.client.1.smithi107.stdout:2/394: mknod d3/da/df/d78/c88 0 2024-09-10T10:04:14.228 INFO:tasks.workunit.client.1.smithi107.stdout:2/395: chown d3/da/df/d62/d7f/d55/l5a 8995662 1 2024-09-10T10:04:14.228 INFO:tasks.workunit.client.1.smithi107.stdout:9/380: creat d5/d7/f8b x:0 0 0 2024-09-10T10:04:14.228 INFO:tasks.workunit.client.0.smithi071.stdout:1/273: creat d1/d1e/f53 x:0 0 0 2024-09-10T10:04:14.229 INFO:tasks.workunit.client.0.smithi071.stdout:3/276: link d3/d20/d39/f53 d3/d20/f63 0 2024-09-10T10:04:14.229 INFO:tasks.workunit.client.0.smithi071.stdout:2/257: rmdir d8/d13/d33/d41 39 2024-09-10T10:04:14.230 INFO:tasks.workunit.client.1.smithi107.stdout:0/297: dread d6/d8/d2f/f1b [0,4194304] 0 2024-09-10T10:04:14.231 INFO:tasks.workunit.client.1.smithi107.stdout:0/298: readlink d6/d8/l20 0 2024-09-10T10:04:14.233 INFO:tasks.workunit.client.0.smithi071.stdout:1/274: mknod d1/d21/d3d/d4a/c54 0 2024-09-10T10:04:14.233 INFO:tasks.workunit.client.1.smithi107.stdout:5/461: rename de/d20/d2b/d4b/l72 to de/d4a/d4e/d89/d99/l9f 0 2024-09-10T10:04:14.237 INFO:tasks.workunit.client.1.smithi107.stdout:9/381: dwrite d5/d7/d3c/d53/d57/d87/d37/f80 [0,4194304] 0 2024-09-10T10:04:14.239 INFO:tasks.workunit.client.0.smithi071.stdout:6/269: dwrite d4/da/df/d2e/d3a/d3e/f4a [0,4194304] 0 2024-09-10T10:04:14.239 INFO:tasks.workunit.client.0.smithi071.stdout:1/275: creat d1/d21/d2f/d30/f55 x:0 0 0 2024-09-10T10:04:14.239 INFO:tasks.workunit.client.1.smithi107.stdout:2/396: creat d3/da/df/d62/f89 x:0 0 0 2024-09-10T10:04:14.240 INFO:tasks.workunit.client.0.smithi071.stdout:6/270: fsync d4/d1c/f4d 0 2024-09-10T10:04:14.241 INFO:tasks.workunit.client.1.smithi107.stdout:3/560: getdents dc/d56 0 2024-09-10T10:04:14.242 INFO:tasks.workunit.client.1.smithi107.stdout:3/561: chown dc/dd/d20/f3e 469758780 1 2024-09-10T10:04:14.243 INFO:tasks.workunit.client.1.smithi107.stdout:7/319: link d0/d20/d35/f5e d0/d8/d9/d3d/f60 0 2024-09-10T10:04:14.244 INFO:tasks.workunit.client.0.smithi071.stdout:6/271: creat d4/da/df/f53 x:0 0 0 2024-09-10T10:04:14.245 INFO:tasks.workunit.client.1.smithi107.stdout:8/263: getdents d5/d8/d2a 0 2024-09-10T10:04:14.245 INFO:tasks.workunit.client.0.smithi071.stdout:2/258: fdatasync d8/f14 0 2024-09-10T10:04:14.246 INFO:tasks.workunit.client.1.smithi107.stdout:4/468: truncate d0/d40/d57/d4f/fa0 707168 0 2024-09-10T10:04:14.246 INFO:tasks.workunit.client.0.smithi071.stdout:2/259: chown f2 0 1 2024-09-10T10:04:14.247 INFO:tasks.workunit.client.1.smithi107.stdout:0/299: symlink d6/d8/d2f/d35/d4f/l57 0 2024-09-10T10:04:14.249 INFO:tasks.workunit.client.1.smithi107.stdout:2/397: read d3/da/df/d20/d36/d4f/f50 [978792,57953] 0 2024-09-10T10:04:14.251 INFO:tasks.workunit.client.1.smithi107.stdout:7/320: fdatasync d0/d20/d35/f54 0 2024-09-10T10:04:14.251 INFO:tasks.workunit.client.1.smithi107.stdout:8/264: chown d5/d8/dc/c22 500829548 1 2024-09-10T10:04:14.251 INFO:tasks.workunit.client.0.smithi071.stdout:5/284: dread dc/f1b [0,4194304] 0 2024-09-10T10:04:14.252 INFO:tasks.workunit.client.1.smithi107.stdout:0/300: read d6/f12 [2549746,50563] 0 2024-09-10T10:04:14.252 INFO:tasks.workunit.client.1.smithi107.stdout:5/462: mknod de/d41/ca0 0 2024-09-10T10:04:14.253 INFO:tasks.workunit.client.0.smithi071.stdout:3/277: truncate d3/d1c/f57 3641422 0 2024-09-10T10:04:14.253 INFO:tasks.workunit.client.1.smithi107.stdout:9/382: dwrite d5/d7/d1d/d41/f71 [0,4194304] 0 2024-09-10T10:04:14.254 INFO:tasks.workunit.client.1.smithi107.stdout:3/562: truncate dc/dd/d45/d26/d41/d44/d63/f6f 734035 0 2024-09-10T10:04:14.256 INFO:tasks.workunit.client.0.smithi071.stdout:2/260: dwrite d8/ff [0,4194304] 0 2024-09-10T10:04:14.256 INFO:tasks.workunit.client.0.smithi071.stdout:6/272: dwrite d4/da/df/d2e/d3a/d3e/f4a [0,4194304] 0 2024-09-10T10:04:14.256 INFO:tasks.workunit.client.0.smithi071.stdout:3/278: symlink d3/d49/d34/l64 0 2024-09-10T10:04:14.257 INFO:tasks.workunit.client.1.smithi107.stdout:0/301: readlink d6/d8/d2f/d2e/d32/l39 0 2024-09-10T10:04:14.257 INFO:tasks.workunit.client.1.smithi107.stdout:5/463: truncate de/d20/d3d/f4c 937251 0 2024-09-10T10:04:14.259 INFO:tasks.workunit.client.1.smithi107.stdout:2/398: rename d3/da/df/d62 to d3/da/d1e/d40/d8a 0 2024-09-10T10:04:14.261 INFO:tasks.workunit.client.1.smithi107.stdout:8/265: creat d5/d8/dc/d18/d4f/f5c x:0 0 0 2024-09-10T10:04:14.264 INFO:tasks.workunit.client.0.smithi071.stdout:2/261: stat d8/d13/d33/d41/l46 0 2024-09-10T10:04:14.265 INFO:tasks.workunit.client.0.smithi071.stdout:2/262: fsync d8/d13/f1c 0 2024-09-10T10:04:14.265 INFO:tasks.workunit.client.1.smithi107.stdout:3/563: symlink dc/dd/d20/d23/d39/dac/lb9 0 2024-09-10T10:04:14.269 INFO:tasks.workunit.client.1.smithi107.stdout:0/302: mkdir d6/d8/d2f/d35/d3c/d58 0 2024-09-10T10:04:14.269 INFO:tasks.workunit.client.1.smithi107.stdout:2/399: dwrite d3/da/d1e/d27/f2e [8388608,4194304] 0 2024-09-10T10:04:14.270 INFO:tasks.workunit.client.1.smithi107.stdout:9/383: mkdir d5/d7/d3c/d53/d57/d87/d50/d8c 0 2024-09-10T10:04:14.273 INFO:tasks.workunit.client.1.smithi107.stdout:8/266: creat d5/d8/d2a/f5d x:0 0 0 2024-09-10T10:04:14.274 INFO:tasks.workunit.client.0.smithi071.stdout:6/273: dwrite f1 [4194304,4194304] 0 2024-09-10T10:04:14.275 INFO:tasks.workunit.client.1.smithi107.stdout:8/267: chown d5/d8/dc/d1a/f46 472981 1 2024-09-10T10:04:14.277 INFO:tasks.workunit.client.0.smithi071.stdout:2/263: link d8/l17 d8/d38/l50 0 2024-09-10T10:04:14.278 INFO:tasks.workunit.client.0.smithi071.stdout:1/276: dwrite d1/f32 [0,4194304] 0 2024-09-10T10:04:14.278 INFO:tasks.workunit.client.1.smithi107.stdout:3/564: write dc/dd/d42/d55/d58/f7c [471521,3903] 0 2024-09-10T10:04:14.278 INFO:tasks.workunit.client.1.smithi107.stdout:5/464: symlink de/d20/d2b/d4b/d5e/d9a/la1 0 2024-09-10T10:04:14.279 INFO:tasks.workunit.client.1.smithi107.stdout:8/268: write d5/d8/d2a/d47/f54 [483944,1400] 0 2024-09-10T10:04:14.279 INFO:tasks.workunit.client.1.smithi107.stdout:8/269: chown d5 5468 1 2024-09-10T10:04:14.279 INFO:tasks.workunit.client.0.smithi071.stdout:6/274: symlink d4/l54 0 2024-09-10T10:04:14.281 INFO:tasks.workunit.client.1.smithi107.stdout:5/465: unlink de/d41/ca0 0 2024-09-10T10:04:14.282 INFO:tasks.workunit.client.1.smithi107.stdout:2/400: link d3/d21/c60 d3/d6d/c8b 0 2024-09-10T10:04:14.283 INFO:tasks.workunit.client.0.smithi071.stdout:3/279: dwrite d3/d1c/f22 [4194304,4194304] 0 2024-09-10T10:04:14.283 INFO:tasks.workunit.client.1.smithi107.stdout:3/565: symlink dc/dd/d45/d26/d41/d44/d63/lba 0 2024-09-10T10:04:14.284 INFO:tasks.workunit.client.0.smithi071.stdout:2/264: mkdir d8/d13/d51 0 2024-09-10T10:04:14.285 INFO:tasks.workunit.client.0.smithi071.stdout:2/265: truncate d8/d13/d33/f3c 958807 0 2024-09-10T10:04:14.286 INFO:tasks.workunit.client.1.smithi107.stdout:8/270: symlink d5/d8/dc/d18/l5e 0 2024-09-10T10:04:14.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:13 smithi071 ceph-mon[27559]: pgmap v257: 65 pgs: 65 active+clean; 986 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 126 MiB/s wr, 357 op/s 2024-09-10T10:04:14.289 INFO:tasks.workunit.client.1.smithi107.stdout:9/384: dwrite d5/d7/d3c/d53/d57/d87/d50/f32 [0,4194304] 0 2024-09-10T10:04:14.292 INFO:tasks.workunit.client.1.smithi107.stdout:3/566: dread - dc/dd/d45/d26/d41/d44/d63/f7b zero size 2024-09-10T10:04:14.292 INFO:tasks.workunit.client.0.smithi071.stdout:3/280: write d3/fa [3145677,48344] 0 2024-09-10T10:04:14.293 INFO:tasks.workunit.client.0.smithi071.stdout:6/275: creat d4/da/df/d2e/d3a/d40/f55 x:0 0 0 2024-09-10T10:04:14.293 INFO:tasks.workunit.client.1.smithi107.stdout:2/401: creat d3/da/d1e/d40/d8a/f8c x:0 0 0 2024-09-10T10:04:14.295 INFO:tasks.workunit.client.1.smithi107.stdout:8/271: dread d5/d8/dc/f16 [0,4194304] 0 2024-09-10T10:04:14.297 INFO:tasks.workunit.client.0.smithi071.stdout:2/266: getdents d8/d13/d33/d41/d4d 0 2024-09-10T10:04:14.297 INFO:tasks.workunit.client.0.smithi071.stdout:3/281: dread d3/d10/d24/f25 [0,4194304] 0 2024-09-10T10:04:14.298 INFO:tasks.workunit.client.1.smithi107.stdout:8/272: fsync d5/d8/dc/d1a/f43 0 2024-09-10T10:04:14.299 INFO:tasks.workunit.client.0.smithi071.stdout:6/276: mknod d4/da/df/d2e/d3a/d3e/c56 0 2024-09-10T10:04:14.299 INFO:tasks.workunit.client.0.smithi071.stdout:5/285: truncate dc/df/d3e/f63 1000371 0 2024-09-10T10:04:14.300 INFO:tasks.workunit.client.1.smithi107.stdout:8/273: write d5/ff [634094,28848] 0 2024-09-10T10:04:14.300 INFO:tasks.workunit.client.0.smithi071.stdout:1/277: link d1/d21/d3d/d4a/c4c d1/d21/d42/c56 0 2024-09-10T10:04:14.302 INFO:tasks.workunit.client.1.smithi107.stdout:8/274: write d5/d8/dc/d21/f3e [2326808,109122] 0 2024-09-10T10:04:14.303 INFO:tasks.workunit.client.1.smithi107.stdout:3/567: creat dc/dd/d45/d26/d41/d44/d35/d52/fbb x:0 0 0 2024-09-10T10:04:14.304 INFO:tasks.workunit.client.1.smithi107.stdout:5/466: rename de/l1d to de/d20/d2b/d4b/d5e/d9a/la2 0 2024-09-10T10:04:14.305 INFO:tasks.workunit.client.1.smithi107.stdout:3/568: dread - dc/dd/d20/d23/d2f/d9c/fa7 zero size 2024-09-10T10:04:14.306 INFO:tasks.workunit.client.0.smithi071.stdout:1/278: rename d1/d21/d3d/d4a/d51 to d1/d57 0 2024-09-10T10:04:14.306 INFO:tasks.workunit.client.1.smithi107.stdout:4/469: write d0/d40/d57/d4f/fa0 [974990,87009] 0 2024-09-10T10:04:14.309 INFO:tasks.workunit.client.0.smithi071.stdout:2/267: mkdir d8/d13/d33/d41/d4d/d52 0 2024-09-10T10:04:14.309 INFO:tasks.workunit.client.0.smithi071.stdout:1/279: mkdir d1/d3f/d58 0 2024-09-10T10:04:14.311 INFO:tasks.workunit.client.0.smithi071.stdout:2/268: mkdir d8/d13/d33/d53 0 2024-09-10T10:04:14.311 INFO:tasks.workunit.client.0.smithi071.stdout:1/280: fsync d1/d21/f28 0 2024-09-10T10:04:14.312 INFO:tasks.workunit.client.1.smithi107.stdout:3/569: mknod dc/dd/cbc 0 2024-09-10T10:04:14.314 INFO:tasks.workunit.client.1.smithi107.stdout:8/275: symlink d5/d8/dc/d18/l5f 0 2024-09-10T10:04:14.315 INFO:tasks.workunit.client.0.smithi071.stdout:2/269: rename d8/d13/f15 to d8/d13/d51/f54 0 2024-09-10T10:04:14.316 INFO:tasks.workunit.client.0.smithi071.stdout:2/270: fsync d8/d24/f2e 0 2024-09-10T10:04:14.317 INFO:tasks.workunit.client.1.smithi107.stdout:5/467: creat de/d9c/fa3 x:0 0 0 2024-09-10T10:04:14.317 INFO:tasks.workunit.client.1.smithi107.stdout:2/402: getdents d3/da/df 0 2024-09-10T10:04:14.317 INFO:tasks.workunit.client.1.smithi107.stdout:9/385: link d5/d7/d3c/d53/d57/d87/d50/l6e d5/d7/d1d/d3b/l8d 0 2024-09-10T10:04:14.317 INFO:tasks.workunit.client.0.smithi071.stdout:6/277: getdents d4/da/df/d2e/d3a/d40 0 2024-09-10T10:04:14.317 INFO:tasks.workunit.client.0.smithi071.stdout:2/271: write d8/fb [1052749,79654] 0 2024-09-10T10:04:14.318 INFO:tasks.workunit.client.0.smithi071.stdout:4/356: sync 2024-09-10T10:04:14.318 INFO:tasks.workunit.client.0.smithi071.stdout:4/357: readlink db/l1c 0 2024-09-10T10:04:14.318 INFO:tasks.workunit.client.1.smithi107.stdout:8/276: unlink d5/c14 0 2024-09-10T10:04:14.319 INFO:tasks.workunit.client.1.smithi107.stdout:9/386: fdatasync d5/f5c 0 2024-09-10T10:04:14.321 INFO:tasks.workunit.client.1.smithi107.stdout:0/303: dwrite d6/f7 [0,4194304] 0 2024-09-10T10:04:14.324 INFO:tasks.workunit.client.1.smithi107.stdout:4/470: getdents d0/d40/d75/d53 0 2024-09-10T10:04:14.324 INFO:tasks.workunit.client.0.smithi071.stdout:2/272: creat d8/d4a/f55 x:0 0 0 2024-09-10T10:04:14.325 INFO:tasks.workunit.client.0.smithi071.stdout:3/282: write d3/fd [1486896,22639] 0 2024-09-10T10:04:14.327 INFO:tasks.workunit.client.1.smithi107.stdout:0/304: write d6/f4a [268751,24613] 0 2024-09-10T10:04:14.327 INFO:tasks.workunit.client.1.smithi107.stdout:2/403: symlink d3/da/l8d 0 2024-09-10T10:04:14.327 INFO:tasks.workunit.client.1.smithi107.stdout:3/570: dwrite dc/dd/d45/f64 [0,4194304] 0 2024-09-10T10:04:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:4/358: unlink db/l41 0 2024-09-10T10:04:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:2/273: write d8/d13/d33/f3c [209692,23440] 0 2024-09-10T10:04:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:4/359: chown db/c3a 18 1 2024-09-10T10:04:14.329 INFO:tasks.workunit.client.1.smithi107.stdout:0/305: dread - d6/d8/d2f/d2e/d32/f4c zero size 2024-09-10T10:04:14.330 INFO:tasks.workunit.client.1.smithi107.stdout:5/468: readlink de/d4a/d4e/d89/d99/l9f 0 2024-09-10T10:04:14.331 INFO:tasks.workunit.client.1.smithi107.stdout:9/387: truncate d5/d7/d3c/d53/d57/d87/d37/f52 1013880 0 2024-09-10T10:04:14.331 INFO:tasks.workunit.client.1.smithi107.stdout:0/306: readlink d6/d8/l20 0 2024-09-10T10:04:14.332 INFO:tasks.workunit.client.0.smithi071.stdout:2/274: readlink d8/l12 0 2024-09-10T10:04:14.333 INFO:tasks.workunit.client.0.smithi071.stdout:3/283: truncate d3/d10/d24/f27 398207 0 2024-09-10T10:04:14.334 INFO:tasks.workunit.client.0.smithi071.stdout:4/360: mkdir db/d1d/d7a 0 2024-09-10T10:04:14.335 INFO:tasks.workunit.client.1.smithi107.stdout:9/388: chown d5/d7/d3c/d53/d57/d87/d50/f32 2291 1 2024-09-10T10:04:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:2/275: mkdir d8/d13/d33/d41/d56 0 2024-09-10T10:04:14.337 INFO:tasks.workunit.client.1.smithi107.stdout:2/404: dwrite d3/da/d1e/d27/d5b/f5c [0,4194304] 0 2024-09-10T10:04:14.337 INFO:tasks.workunit.client.1.smithi107.stdout:3/571: symlink dc/dd/d45/d26/d41/d44/d35/d4a/lbd 0 2024-09-10T10:04:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:1/281: dread d1/f1f [0,4194304] 0 2024-09-10T10:04:14.338 INFO:tasks.workunit.client.1.smithi107.stdout:8/277: rmdir d5/d8/dc/d21/d52 0 2024-09-10T10:04:14.340 INFO:tasks.workunit.client.1.smithi107.stdout:9/389: chown d5/d7/d3c/d53/d57/d87/d37/c39 7557242 1 2024-09-10T10:04:14.340 INFO:tasks.workunit.client.0.smithi071.stdout:4/361: chown db/d15/d4b/l69 1645 1 2024-09-10T10:04:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:1/282: write d1/d21/f28 [225951,74112] 0 2024-09-10T10:04:14.343 INFO:tasks.workunit.client.1.smithi107.stdout:0/307: read d6/d8/f15 [215565,10403] 0 2024-09-10T10:04:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:6/278: dwrite d4/f27 [0,4194304] 0 2024-09-10T10:04:14.344 INFO:tasks.workunit.client.1.smithi107.stdout:2/405: creat d3/da/d1e/d40/d8a/d7f/d55/d85/f8e x:0 0 0 2024-09-10T10:04:14.349 INFO:tasks.workunit.client.1.smithi107.stdout:9/390: truncate d5/d7/d1d/d41/f48 4736083 0 2024-09-10T10:04:14.351 INFO:tasks.workunit.client.0.smithi071.stdout:4/362: mknod db/d1d/d61/c7b 0 2024-09-10T10:04:14.351 INFO:tasks.workunit.client.0.smithi071.stdout:1/283: rename d1/c1a to d1/d21/d2f/d30/c59 0 2024-09-10T10:04:14.351 INFO:tasks.workunit.client.0.smithi071.stdout:2/276: dwrite d8/f1a [0,4194304] 0 2024-09-10T10:04:14.353 INFO:tasks.workunit.client.1.smithi107.stdout:3/572: dwrite dc/dd/d45/d26/d41/d44/d63/f6f [0,4194304] 0 2024-09-10T10:04:14.357 INFO:tasks.workunit.client.0.smithi071.stdout:1/284: write d1/f1f [5232491,32686] 0 2024-09-10T10:04:14.357 INFO:tasks.workunit.client.1.smithi107.stdout:9/391: mknod d5/d7/d1d/c8e 0 2024-09-10T10:04:14.358 INFO:tasks.workunit.client.1.smithi107.stdout:0/308: dread d6/f12 [0,4194304] 0 2024-09-10T10:04:14.361 INFO:tasks.workunit.client.1.smithi107.stdout:9/392: rmdir d5 39 2024-09-10T10:04:14.362 INFO:tasks.workunit.client.1.smithi107.stdout:0/309: chown d6/d8/f27 34181258 1 2024-09-10T10:04:14.362 INFO:tasks.workunit.client.0.smithi071.stdout:4/363: read db/d15/d17/d24/f25 [2222319,90792] 0 2024-09-10T10:04:14.363 INFO:tasks.workunit.client.0.smithi071.stdout:3/284: truncate d3/d10/d24/d2b/f4e 2749889 0 2024-09-10T10:04:14.363 INFO:tasks.workunit.client.1.smithi107.stdout:2/406: dwrite d3/da/df/f48 [0,4194304] 0 2024-09-10T10:04:14.366 INFO:tasks.workunit.client.0.smithi071.stdout:2/277: link d8/d4a/f4b d8/d38/f57 0 2024-09-10T10:04:14.367 INFO:tasks.workunit.client.1.smithi107.stdout:0/310: mkdir d6/d8/d2f/d2e/d32/d59 0 2024-09-10T10:04:14.367 INFO:tasks.workunit.client.1.smithi107.stdout:0/311: chown d6/d8/d2f/d2e/d32/l39 223 1 2024-09-10T10:04:14.367 INFO:tasks.workunit.client.0.smithi071.stdout:6/279: link d4/da/df/l10 d4/da/df/l57 0 2024-09-10T10:04:14.368 INFO:tasks.workunit.client.1.smithi107.stdout:6/403: sync 2024-09-10T10:04:14.370 INFO:tasks.workunit.client.1.smithi107.stdout:9/393: mknod d5/d7/d3c/c8f 0 2024-09-10T10:04:14.370 INFO:tasks.workunit.client.1.smithi107.stdout:3/573: dread dc/dd/d20/f60 [0,4194304] 0 2024-09-10T10:04:14.371 INFO:tasks.workunit.client.0.smithi071.stdout:1/285: dread d1/d21/f28 [0,4194304] 0 2024-09-10T10:04:14.372 INFO:tasks.workunit.client.1.smithi107.stdout:8/278: truncate d5/f38 445493 0 2024-09-10T10:04:14.372 INFO:tasks.workunit.client.1.smithi107.stdout:2/407: mkdir d3/d8f 0 2024-09-10T10:04:14.373 INFO:tasks.workunit.client.0.smithi071.stdout:4/364: dwrite db/d1d/d61/f70 [0,4194304] 0 2024-09-10T10:04:14.375 INFO:tasks.workunit.client.1.smithi107.stdout:2/408: rename d3/da to d3/da/d66/d90 22 2024-09-10T10:04:14.375 INFO:tasks.workunit.client.0.smithi071.stdout:4/365: write db/d15/d17/f60 [1034298,80930] 0 2024-09-10T10:04:14.376 INFO:tasks.workunit.client.1.smithi107.stdout:3/574: dread dc/dd/d20/f60 [0,4194304] 0 2024-09-10T10:04:14.376 INFO:tasks.workunit.client.1.smithi107.stdout:8/279: truncate d5/d8/d2a/f5d 569078 0 2024-09-10T10:04:14.376 INFO:tasks.workunit.client.0.smithi071.stdout:6/280: unlink d4/da/df/d2e/d3a/c44 0 2024-09-10T10:04:14.377 INFO:tasks.workunit.client.0.smithi071.stdout:4/366: write db/f12 [810555,72444] 0 2024-09-10T10:04:14.380 INFO:tasks.workunit.client.1.smithi107.stdout:6/404: dwrite d0/d3d/d14/d17/f36 [4194304,4194304] 0 2024-09-10T10:04:14.382 INFO:tasks.workunit.client.0.smithi071.stdout:4/367: chown db/c3a 1765372385 1 2024-09-10T10:04:14.383 INFO:tasks.workunit.client.0.smithi071.stdout:6/281: rename d4/f2f to d4/da/df/d2e/d3a/d40/f58 0 2024-09-10T10:04:14.384 INFO:tasks.workunit.client.0.smithi071.stdout:2/278: rmdir d8 39 2024-09-10T10:04:14.386 INFO:tasks.workunit.client.0.smithi071.stdout:4/368: creat db/d15/d17/d4e/d5a/f7c x:0 0 0 2024-09-10T10:04:14.386 INFO:tasks.workunit.client.1.smithi107.stdout:2/409: dwrite d3/d21/d79/f7e [0,4194304] 0 2024-09-10T10:04:14.387 INFO:tasks.workunit.client.0.smithi071.stdout:4/369: stat db/d1d/f36 0 2024-09-10T10:04:14.388 INFO:tasks.workunit.client.0.smithi071.stdout:3/285: write d3/d20/f63 [755424,75460] 0 2024-09-10T10:04:14.389 INFO:tasks.workunit.client.0.smithi071.stdout:4/370: readlink db/d15/d17/d4e/d5a/l59 0 2024-09-10T10:04:14.390 INFO:tasks.workunit.client.0.smithi071.stdout:6/282: mknod d4/da/df/d2e/d3a/d3e/d45/c59 0 2024-09-10T10:04:14.391 INFO:tasks.workunit.client.0.smithi071.stdout:3/286: mknod d3/d10/c65 0 2024-09-10T10:04:14.393 INFO:tasks.workunit.client.0.smithi071.stdout:3/287: read d3/d20/d30/f51 [807500,32183] 0 2024-09-10T10:04:14.393 INFO:tasks.workunit.client.0.smithi071.stdout:6/283: fdatasync d4/d1c/f4d 0 2024-09-10T10:04:14.393 INFO:tasks.workunit.client.0.smithi071.stdout:4/371: rmdir db/d15/d26 39 2024-09-10T10:04:14.394 INFO:tasks.workunit.client.0.smithi071.stdout:3/288: chown d3/d10 1093220 1 2024-09-10T10:04:14.395 INFO:tasks.workunit.client.0.smithi071.stdout:3/289: stat d3/d49 0 2024-09-10T10:04:14.395 INFO:tasks.workunit.client.0.smithi071.stdout:4/372: stat db/d15/d17/d4e/d5a/f65 0 2024-09-10T10:04:14.396 INFO:tasks.workunit.client.0.smithi071.stdout:1/286: dread d1/d21/d2f/f39 [0,4194304] 0 2024-09-10T10:04:14.397 INFO:tasks.workunit.client.1.smithi107.stdout:0/312: dread d6/d8/d2f/f21 [0,4194304] 0 2024-09-10T10:04:14.398 INFO:tasks.workunit.client.1.smithi107.stdout:0/313: readlink d6/d14/l54 0 2024-09-10T10:04:14.398 INFO:tasks.workunit.client.0.smithi071.stdout:3/290: chown d3/f18 450089 1 2024-09-10T10:04:14.399 INFO:tasks.workunit.client.0.smithi071.stdout:4/373: dread - db/d15/d26/d43/d4d/f2f zero size 2024-09-10T10:04:14.399 INFO:tasks.workunit.client.0.smithi071.stdout:2/279: link d8/d13/c27 d8/d13/d33/d41/d56/c58 0 2024-09-10T10:04:14.399 INFO:tasks.workunit.client.0.smithi071.stdout:4/374: fdatasync db/f1b 0 2024-09-10T10:04:14.400 INFO:tasks.workunit.client.0.smithi071.stdout:3/291: mkdir d3/d1c/d3c/d66 0 2024-09-10T10:04:14.401 INFO:tasks.workunit.client.0.smithi071.stdout:3/292: readlink d3/d49/d4f/l55 0 2024-09-10T10:04:14.402 INFO:tasks.workunit.client.0.smithi071.stdout:1/287: creat d1/d3f/d58/f5a x:0 0 0 2024-09-10T10:04:14.403 INFO:tasks.workunit.client.0.smithi071.stdout:1/288: write d1/f32 [4664456,17398] 0 2024-09-10T10:04:14.403 INFO:tasks.workunit.client.0.smithi071.stdout:2/280: unlink d8/d13/d33/c34 0 2024-09-10T10:04:14.404 INFO:tasks.workunit.client.0.smithi071.stdout:2/281: chown d8/d13/d33 1 1 2024-09-10T10:04:14.405 INFO:tasks.workunit.client.0.smithi071.stdout:4/375: mkdir db/d1d/d61/d6a/d7d 0 2024-09-10T10:04:14.405 INFO:tasks.workunit.client.0.smithi071.stdout:2/282: fsync d8/f48 0 2024-09-10T10:04:14.406 INFO:tasks.workunit.client.0.smithi071.stdout:3/293: rename d3/d1c/d3c/d58 to d3/d49/d34/d67 0 2024-09-10T10:04:14.409 INFO:tasks.workunit.client.0.smithi071.stdout:4/376: rename db/c1a to db/d15/d4b/c7e 0 2024-09-10T10:04:14.410 INFO:tasks.workunit.client.0.smithi071.stdout:3/294: creat d3/d20/d30/d3a/f68 x:0 0 0 2024-09-10T10:04:14.411 INFO:tasks.workunit.client.0.smithi071.stdout:1/289: dwrite d1/f37 [8388608,4194304] 0 2024-09-10T10:04:14.413 INFO:tasks.workunit.client.0.smithi071.stdout:2/283: dread d8/f14 [0,4194304] 0 2024-09-10T10:04:14.413 INFO:tasks.workunit.client.0.smithi071.stdout:4/377: write db/d1d/d61/d6a/f6c [401616,20025] 0 2024-09-10T10:04:14.415 INFO:tasks.workunit.client.0.smithi071.stdout:2/284: write d8/d24/f2e [975664,106525] 0 2024-09-10T10:04:14.416 INFO:tasks.workunit.client.0.smithi071.stdout:3/295: creat d3/d1c/d3c/f69 x:0 0 0 2024-09-10T10:04:14.416 INFO:tasks.workunit.client.0.smithi071.stdout:1/290: symlink d1/d21/d2f/d30/l5b 0 2024-09-10T10:04:14.420 INFO:tasks.workunit.client.0.smithi071.stdout:1/291: mkdir d1/d3f/d5c 0 2024-09-10T10:04:14.421 INFO:tasks.workunit.client.0.smithi071.stdout:6/284: truncate d4/da/df/f50 588074 0 2024-09-10T10:04:14.422 INFO:tasks.workunit.client.0.smithi071.stdout:2/285: mkdir d8/d38/d47/d59 0 2024-09-10T10:04:14.424 INFO:tasks.workunit.client.0.smithi071.stdout:2/286: write d8/f28 [2088213,66871] 0 2024-09-10T10:04:14.424 INFO:tasks.workunit.client.0.smithi071.stdout:6/285: stat d4/da/c1f 0 2024-09-10T10:04:14.426 INFO:tasks.workunit.client.0.smithi071.stdout:6/286: read d4/f25 [7733528,87046] 0 2024-09-10T10:04:14.428 INFO:tasks.workunit.client.0.smithi071.stdout:6/287: fdatasync d4/f27 0 2024-09-10T10:04:14.428 INFO:tasks.workunit.client.0.smithi071.stdout:1/292: dwrite d1/f1f [0,4194304] 0 2024-09-10T10:04:14.429 INFO:tasks.workunit.client.0.smithi071.stdout:6/288: fdatasync d4/d1c/f3d 0 2024-09-10T10:04:14.430 INFO:tasks.workunit.client.0.smithi071.stdout:6/289: stat d4/f38 0 2024-09-10T10:04:14.434 INFO:tasks.workunit.client.0.smithi071.stdout:2/287: dwrite d8/fb [0,4194304] 0 2024-09-10T10:04:14.437 INFO:tasks.workunit.client.0.smithi071.stdout:4/378: dread db/f55 [0,4194304] 0 2024-09-10T10:04:14.438 INFO:tasks.workunit.client.0.smithi071.stdout:4/379: read - db/d15/d17/d4e/f5b zero size 2024-09-10T10:04:14.440 INFO:tasks.workunit.client.0.smithi071.stdout:2/288: rename d8/d13/d33/d41/f43 to d8/d38/d47/d59/f5a 0 2024-09-10T10:04:14.441 INFO:tasks.workunit.client.0.smithi071.stdout:4/380: readlink db/lc 0 2024-09-10T10:04:14.444 INFO:tasks.workunit.client.0.smithi071.stdout:2/289: rename d8/c11 to d8/d38/d47/d59/c5b 0 2024-09-10T10:04:14.446 INFO:tasks.workunit.client.0.smithi071.stdout:3/296: dread d3/f1b [0,4194304] 0 2024-09-10T10:04:14.447 INFO:tasks.workunit.client.0.smithi071.stdout:2/290: chown d8/d13/c27 41645732 1 2024-09-10T10:04:14.448 INFO:tasks.workunit.client.0.smithi071.stdout:3/297: symlink d3/d20/d30/l6a 0 2024-09-10T10:04:14.449 INFO:tasks.workunit.client.0.smithi071.stdout:3/298: dread - d3/d1c/d3c/f69 zero size 2024-09-10T10:04:14.449 INFO:tasks.workunit.client.0.smithi071.stdout:4/381: getdents db/d15/d17 0 2024-09-10T10:04:14.450 INFO:tasks.workunit.client.0.smithi071.stdout:2/291: creat d8/d24/f5c x:0 0 0 2024-09-10T10:04:14.450 INFO:tasks.workunit.client.0.smithi071.stdout:6/290: truncate d4/da/df/d2e/f3b 3546712 0 2024-09-10T10:04:14.455 INFO:tasks.workunit.client.0.smithi071.stdout:6/291: creat d4/da/df/d2e/f5a x:0 0 0 2024-09-10T10:04:14.455 INFO:tasks.workunit.client.0.smithi071.stdout:6/292: read - d4/da/df/f47 zero size 2024-09-10T10:04:14.457 INFO:tasks.workunit.client.0.smithi071.stdout:2/292: symlink d8/d13/d49/l5d 0 2024-09-10T10:04:14.457 INFO:tasks.workunit.client.0.smithi071.stdout:6/293: chown d4/da/df/d2e/d3a/d40 2797 1 2024-09-10T10:04:14.457 INFO:tasks.workunit.client.0.smithi071.stdout:2/293: write d8/f10 [1814038,107316] 0 2024-09-10T10:04:14.458 INFO:tasks.workunit.client.0.smithi071.stdout:4/382: dread db/d15/d17/f18 [0,4194304] 0 2024-09-10T10:04:14.459 INFO:tasks.workunit.client.0.smithi071.stdout:2/294: write d8/f10 [497815,125053] 0 2024-09-10T10:04:14.463 INFO:tasks.workunit.client.0.smithi071.stdout:2/295: mkdir d8/d13/d33/d41/d4d/d5e 0 2024-09-10T10:04:14.469 INFO:tasks.workunit.client.0.smithi071.stdout:4/383: dwrite db/d15/d17/f6f [0,4194304] 0 2024-09-10T10:04:14.470 INFO:tasks.workunit.client.0.smithi071.stdout:3/299: dwrite d3/d10/d24/f25 [0,4194304] 0 2024-09-10T10:04:14.473 INFO:tasks.workunit.client.0.smithi071.stdout:4/384: fdatasync db/d15/d26/f3c 0 2024-09-10T10:04:14.475 INFO:tasks.workunit.client.1.smithi107.stdout:9/394: creat d5/d7/d3c/d53/f90 x:0 0 0 2024-09-10T10:04:14.475 INFO:tasks.workunit.client.1.smithi107.stdout:9/395: dread - d5/f85 zero size 2024-09-10T10:04:14.476 INFO:tasks.workunit.client.0.smithi071.stdout:3/300: write d3/f1b [3037174,60857] 0 2024-09-10T10:04:14.479 INFO:tasks.workunit.client.0.smithi071.stdout:6/294: dread d4/da/f13 [0,4194304] 0 2024-09-10T10:04:14.479 INFO:tasks.workunit.client.0.smithi071.stdout:4/385: write db/d15/d17/d4e/d5a/f7c [156785,127449] 0 2024-09-10T10:04:14.481 INFO:tasks.workunit.client.0.smithi071.stdout:2/296: dwrite d8/d13/d33/f40 [0,4194304] 0 2024-09-10T10:04:14.481 INFO:tasks.workunit.client.1.smithi107.stdout:3/575: symlink dc/dd/d20/d23/d6e/lbe 0 2024-09-10T10:04:14.482 INFO:tasks.workunit.client.0.smithi071.stdout:3/301: dread - d3/d20/d30/d42/d4a/f54 zero size 2024-09-10T10:04:14.483 INFO:tasks.workunit.client.1.smithi107.stdout:3/576: stat dc/dd/d45/d26/d41/d44/d35/dab 0 2024-09-10T10:04:14.484 INFO:tasks.workunit.client.0.smithi071.stdout:3/302: fsync d3/d20/d30/d42/d4a/f59 0 2024-09-10T10:04:14.484 INFO:tasks.workunit.client.1.smithi107.stdout:8/280: mkdir d5/d8/dc/d21/d60 0 2024-09-10T10:04:14.485 INFO:tasks.workunit.client.0.smithi071.stdout:2/297: readlink d8/d38/l50 0 2024-09-10T10:04:14.486 INFO:tasks.workunit.client.1.smithi107.stdout:9/396: creat d5/d7/d1d/d41/f91 x:0 0 0 2024-09-10T10:04:14.487 INFO:tasks.workunit.client.0.smithi071.stdout:4/386: creat db/d15/d17/f7f x:0 0 0 2024-09-10T10:04:14.488 INFO:tasks.workunit.client.0.smithi071.stdout:6/295: mknod d4/da/df/d2e/d3a/d43/c5b 0 2024-09-10T10:04:14.489 INFO:tasks.workunit.client.1.smithi107.stdout:0/314: mkdir d6/d5a 0 2024-09-10T10:04:14.491 INFO:tasks.workunit.client.1.smithi107.stdout:9/397: dread d5/d7/d3c/d53/d57/d87/d27/f51 [0,4194304] 0 2024-09-10T10:04:14.491 INFO:tasks.workunit.client.1.smithi107.stdout:8/281: rmdir d5/d8/dc/d21/d48 39 2024-09-10T10:04:14.492 INFO:tasks.workunit.client.0.smithi071.stdout:3/303: rename d3/d20/f3f to d3/d20/d30/d42/d4a/d60/f6b 0 2024-09-10T10:04:14.493 INFO:tasks.workunit.client.1.smithi107.stdout:9/398: chown d5/d7/d1d/d41/f48 52 1 2024-09-10T10:04:14.493 INFO:tasks.workunit.client.1.smithi107.stdout:6/405: link d0/d3d/d14/d17/d24/d60/f6b d0/d3d/d14/d17/d4b/f8c 0 2024-09-10T10:04:14.493 INFO:tasks.workunit.client.1.smithi107.stdout:8/282: write d5/d8/dc/d1a/f43 [1419314,12723] 0 2024-09-10T10:04:14.495 INFO:tasks.workunit.client.0.smithi071.stdout:6/296: dread d4/f27 [0,4194304] 0 2024-09-10T10:04:14.495 INFO:tasks.workunit.client.0.smithi071.stdout:6/297: chown d4/f28 909492 1 2024-09-10T10:04:14.496 INFO:tasks.workunit.client.1.smithi107.stdout:3/577: getdents dc/dd/d20/d23/d2f 0 2024-09-10T10:04:14.496 INFO:tasks.workunit.client.1.smithi107.stdout:6/406: truncate d0/d3d/d14/d21/d83/f86 966814 0 2024-09-10T10:04:14.497 INFO:tasks.workunit.client.0.smithi071.stdout:3/304: getdents d3/d20/d30/d3a 0 2024-09-10T10:04:14.498 INFO:tasks.workunit.client.1.smithi107.stdout:0/315: unlink d6/d14/l2a 0 2024-09-10T10:04:14.499 INFO:tasks.workunit.client.1.smithi107.stdout:9/399: mknod d5/c92 0 2024-09-10T10:04:14.499 INFO:tasks.workunit.client.1.smithi107.stdout:6/407: dread d0/d3d/d14/d21/f43 [4194304,4194304] 0 2024-09-10T10:04:14.500 INFO:tasks.workunit.client.0.smithi071.stdout:6/298: unlink d4/da/df/l57 0 2024-09-10T10:04:14.500 INFO:tasks.workunit.client.1.smithi107.stdout:3/578: creat dc/dd/d20/d23/d39/fbf x:0 0 0 2024-09-10T10:04:14.501 INFO:tasks.workunit.client.1.smithi107.stdout:8/283: creat d5/d8/dc/d21/f61 x:0 0 0 2024-09-10T10:04:14.502 INFO:tasks.workunit.client.0.smithi071.stdout:3/305: creat d3/d49/f6c x:0 0 0 2024-09-10T10:04:14.502 INFO:tasks.workunit.client.1.smithi107.stdout:3/579: fdatasync dc/dd/d45/d26/d41/d44/d35/d4a/f5c 0 2024-09-10T10:04:14.502 INFO:tasks.workunit.client.0.smithi071.stdout:6/299: fsync d4/da/df/d2e/d3a/d40/f58 0 2024-09-10T10:04:14.503 INFO:tasks.workunit.client.0.smithi071.stdout:6/300: chown d4/l54 83670070 1 2024-09-10T10:04:14.503 INFO:tasks.workunit.client.0.smithi071.stdout:3/306: write d3/d1c/d3c/f69 [946992,43415] 0 2024-09-10T10:04:14.504 INFO:tasks.workunit.client.1.smithi107.stdout:0/316: getdents d6/d8/d2f/d2e/d32/d56 0 2024-09-10T10:04:14.506 INFO:tasks.workunit.client.0.smithi071.stdout:6/301: fdatasync d4/da/df/d2e/d3a/d40/f55 0 2024-09-10T10:04:14.506 INFO:tasks.workunit.client.0.smithi071.stdout:3/307: creat d3/d20/f6d x:0 0 0 2024-09-10T10:04:14.507 INFO:tasks.workunit.client.1.smithi107.stdout:2/410: truncate d3/da/df/d20/d4a/f53 1648481 0 2024-09-10T10:04:14.508 INFO:tasks.workunit.client.0.smithi071.stdout:3/308: write d3/d1c/f22 [2179611,3399] 0 2024-09-10T10:04:14.509 INFO:tasks.workunit.client.1.smithi107.stdout:2/411: write d3/da/df/d20/d4a/f77 [1713697,96718] 0 2024-09-10T10:04:14.514 INFO:tasks.workunit.client.1.smithi107.stdout:3/580: creat dc/dd/d20/d23/fc0 x:0 0 0 2024-09-10T10:04:14.514 INFO:tasks.workunit.client.0.smithi071.stdout:6/302: rename d4/da/df/f47 to d4/da/df/d2e/d3a/d3e/d45/f5c 0 2024-09-10T10:04:14.514 INFO:tasks.workunit.client.0.smithi071.stdout:3/309: dread d3/d20/f2c [0,4194304] 0 2024-09-10T10:04:14.514 INFO:tasks.workunit.client.1.smithi107.stdout:2/412: readlink d3/da/d1e/d5f/l2f 0 2024-09-10T10:04:14.515 INFO:tasks.workunit.client.1.smithi107.stdout:9/400: dread d5/f35 [0,4194304] 0 2024-09-10T10:04:14.517 INFO:tasks.workunit.client.1.smithi107.stdout:2/413: mkdir d3/da/d66/d91 0 2024-09-10T10:04:14.519 INFO:tasks.workunit.client.0.smithi071.stdout:2/298: dwrite d8/d38/f57 [0,4194304] 0 2024-09-10T10:04:14.519 INFO:tasks.workunit.client.0.smithi071.stdout:3/310: creat d3/d49/d34/f6e x:0 0 0 2024-09-10T10:04:14.522 INFO:tasks.workunit.client.0.smithi071.stdout:4/387: dwrite db/d15/d17/f75 [0,4194304] 0 2024-09-10T10:04:14.526 INFO:tasks.workunit.client.0.smithi071.stdout:3/311: creat d3/d1c/d3c/f6f x:0 0 0 2024-09-10T10:04:14.526 INFO:tasks.workunit.client.1.smithi107.stdout:6/408: write d0/d3d/d14/d21/f28 [1444396,84483] 0 2024-09-10T10:04:14.527 INFO:tasks.workunit.client.0.smithi071.stdout:3/312: chown d3/d20/d30 32290 1 2024-09-10T10:04:14.527 INFO:tasks.workunit.client.0.smithi071.stdout:4/388: symlink db/d15/d26/d43/d4d/l80 0 2024-09-10T10:04:14.528 INFO:tasks.workunit.client.1.smithi107.stdout:0/317: truncate f4 2461634 0 2024-09-10T10:04:14.530 INFO:tasks.workunit.client.1.smithi107.stdout:2/414: fsync d3/da/df/d20/f46 0 2024-09-10T10:04:14.531 INFO:tasks.workunit.client.0.smithi071.stdout:6/303: getdents d4/da/df/d2e/d3a/d43 0 2024-09-10T10:04:14.531 INFO:tasks.workunit.client.1.smithi107.stdout:2/415: stat d3/da/d1e/d27/d5b 0 2024-09-10T10:04:14.534 INFO:tasks.workunit.client.0.smithi071.stdout:2/299: dread d8/d24/f2d [0,4194304] 0 2024-09-10T10:04:14.534 INFO:tasks.workunit.client.0.smithi071.stdout:4/389: creat db/d15/d17/d4e/d5a/f81 x:0 0 0 2024-09-10T10:04:14.534 INFO:tasks.workunit.client.0.smithi071.stdout:6/304: mkdir d4/da/df/d2e/d3a/d3e/d5d 0 2024-09-10T10:04:14.535 INFO:tasks.workunit.client.1.smithi107.stdout:2/416: unlink d3/f11 0 2024-09-10T10:04:14.538 INFO:tasks.workunit.client.0.smithi071.stdout:4/390: write db/d15/d17/f60 [385732,55277] 0 2024-09-10T10:04:14.542 INFO:tasks.workunit.client.1.smithi107.stdout:2/417: rename d3/da/df/d20/d4a to d3/da/df/d20/d36/d4f/d92 0 2024-09-10T10:04:14.542 INFO:tasks.workunit.client.0.smithi071.stdout:2/300: dwrite d8/f48 [0,4194304] 0 2024-09-10T10:04:14.542 INFO:tasks.workunit.client.0.smithi071.stdout:4/391: mkdir db/d15/d26/d43/d82 0 2024-09-10T10:04:14.543 INFO:tasks.workunit.client.1.smithi107.stdout:0/318: mknod d6/d14/c5b 0 2024-09-10T10:04:14.543 INFO:tasks.workunit.client.1.smithi107.stdout:2/418: dread - d3/da/d1e/d40/d8a/d7f/d55/d85/f8e zero size 2024-09-10T10:04:14.543 INFO:tasks.workunit.client.1.smithi107.stdout:2/419: chown d3/d6d 1796 1 2024-09-10T10:04:14.544 INFO:tasks.workunit.client.0.smithi071.stdout:4/392: truncate db/d15/d17/f75 4534397 0 2024-09-10T10:04:14.545 INFO:tasks.workunit.client.1.smithi107.stdout:2/420: write d3/f31 [464689,22533] 0 2024-09-10T10:04:14.545 INFO:tasks.workunit.client.1.smithi107.stdout:0/319: mkdir d6/d5a/d5c 0 2024-09-10T10:04:14.546 INFO:tasks.workunit.client.0.smithi071.stdout:4/393: chown db/d15/d26/d43/d4d/f4a 11198922 1 2024-09-10T10:04:14.547 INFO:tasks.workunit.client.0.smithi071.stdout:2/301: link d8/d38/d47/d59/f5a d8/d38/d47/f5f 0 2024-09-10T10:04:14.548 INFO:tasks.workunit.client.1.smithi107.stdout:2/421: creat d3/d21/d79/f93 x:0 0 0 2024-09-10T10:04:14.548 INFO:tasks.workunit.client.1.smithi107.stdout:1/448: sync 2024-09-10T10:04:14.548 INFO:tasks.workunit.client.1.smithi107.stdout:7/321: sync 2024-09-10T10:04:14.549 INFO:tasks.workunit.client.0.smithi071.stdout:4/394: write db/d15/d17/d4e/d5a/f53 [1196722,82579] 0 2024-09-10T10:04:14.549 INFO:tasks.workunit.client.0.smithi071.stdout:4/395: chown db/f46 6089827 1 2024-09-10T10:04:14.550 INFO:tasks.workunit.client.1.smithi107.stdout:0/320: creat d6/d8/d2f/d2e/d32/f5d x:0 0 0 2024-09-10T10:04:14.550 INFO:tasks.workunit.client.1.smithi107.stdout:1/449: readlink d2/d12/d65/d6b/l38 0 2024-09-10T10:04:14.550 INFO:tasks.workunit.client.1.smithi107.stdout:3/581: truncate dc/dd/d45/d26/d41/d44/f1f 4812257 0 2024-09-10T10:04:14.552 INFO:tasks.workunit.client.1.smithi107.stdout:2/422: creat d3/d6d/f94 x:0 0 0 2024-09-10T10:04:14.552 INFO:tasks.workunit.client.1.smithi107.stdout:9/401: truncate d5/d7/d3c/d53/d57/d87/d37/f52 492867 0 2024-09-10T10:04:14.553 INFO:tasks.workunit.client.0.smithi071.stdout:2/302: symlink d8/d13/d33/d41/l60 0 2024-09-10T10:04:14.553 INFO:tasks.workunit.client.1.smithi107.stdout:7/322: rmdir d0/d1b/d4d 39 2024-09-10T10:04:14.554 INFO:tasks.workunit.client.0.smithi071.stdout:2/303: write d8/d38/f57 [579069,80934] 0 2024-09-10T10:04:14.555 INFO:tasks.workunit.client.1.smithi107.stdout:1/450: creat d2/d35/f8c x:0 0 0 2024-09-10T10:04:14.556 INFO:tasks.workunit.client.1.smithi107.stdout:3/582: creat dc/dd/d20/d23/d6e/fc1 x:0 0 0 2024-09-10T10:04:14.558 INFO:tasks.workunit.client.0.smithi071.stdout:4/396: creat db/d15/d26/d43/d82/f83 x:0 0 0 2024-09-10T10:04:14.558 INFO:tasks.workunit.client.0.smithi071.stdout:3/313: dread d3/d1c/f22 [0,4194304] 0 2024-09-10T10:04:14.560 INFO:tasks.workunit.client.0.smithi071.stdout:3/314: getdents d3/d20/d30/d3a 0 2024-09-10T10:04:14.561 INFO:tasks.workunit.client.1.smithi107.stdout:2/423: mkdir d3/d21/d95 0 2024-09-10T10:04:14.562 INFO:tasks.workunit.client.1.smithi107.stdout:1/451: dread d2/d6/d24/f69 [0,4194304] 0 2024-09-10T10:04:14.563 INFO:tasks.workunit.client.0.smithi071.stdout:3/315: creat d3/f70 x:0 0 0 2024-09-10T10:04:14.565 INFO:tasks.workunit.client.1.smithi107.stdout:6/409: dwrite d0/d3d/d14/d17/d49/d55/d73/f82 [4194304,4194304] 0 2024-09-10T10:04:14.565 INFO:tasks.workunit.client.0.smithi071.stdout:9/502: sync 2024-09-10T10:04:14.565 INFO:tasks.workunit.client.0.smithi071.stdout:7/331: sync 2024-09-10T10:04:14.565 INFO:tasks.workunit.client.0.smithi071.stdout:3/316: mknod d3/d10/d24/c71 0 2024-09-10T10:04:14.566 INFO:tasks.workunit.client.0.smithi071.stdout:3/317: read - d3/d20/d30/d3a/f45 zero size 2024-09-10T10:04:14.566 INFO:tasks.workunit.client.0.smithi071.stdout:3/318: fdatasync d3/f41 0 2024-09-10T10:04:14.567 INFO:tasks.workunit.client.1.smithi107.stdout:9/402: dwrite d5/d7/d1d/f47 [0,4194304] 0 2024-09-10T10:04:14.567 INFO:tasks.workunit.client.0.smithi071.stdout:3/319: fsync d3/d20/d30/d3a/f45 0 2024-09-10T10:04:14.567 INFO:tasks.workunit.client.0.smithi071.stdout:7/332: fsync d9/d1a/d1d/f1e 0 2024-09-10T10:04:14.570 INFO:tasks.workunit.client.1.smithi107.stdout:2/424: symlink d3/da/d1e/d40/l96 0 2024-09-10T10:04:14.571 INFO:tasks.workunit.client.0.smithi071.stdout:7/333: read f2 [2954298,116858] 0 2024-09-10T10:04:14.571 INFO:tasks.workunit.client.1.smithi107.stdout:3/583: rename dc/dd/d42/d55/d58/d91/lad to dc/dd/d20/d23/d39/d69/lc2 0 2024-09-10T10:04:14.572 INFO:tasks.workunit.client.1.smithi107.stdout:9/403: write d5/d7/d3c/d53/d57/d87/d50/f32 [3534513,107072] 0 2024-09-10T10:04:14.574 INFO:tasks.workunit.client.0.smithi071.stdout:3/320: rename d3/d20/d30/l48 to d3/d20/d30/d5d/l72 0 2024-09-10T10:04:14.577 INFO:tasks.workunit.client.0.smithi071.stdout:3/321: chown d3/l1a 6079269 1 2024-09-10T10:04:14.578 INFO:tasks.workunit.client.1.smithi107.stdout:0/321: dread d6/d8/d2f/d35/d3c/f41 [0,4194304] 0 2024-09-10T10:04:14.579 INFO:tasks.workunit.client.0.smithi071.stdout:2/304: truncate d8/f1a 3142925 0 2024-09-10T10:04:14.581 INFO:tasks.workunit.client.1.smithi107.stdout:9/404: creat d5/d7/d3c/d53/f93 x:0 0 0 2024-09-10T10:04:14.582 INFO:tasks.workunit.client.0.smithi071.stdout:9/503: dwrite d0/db/d20/d3c/d75/f9b [0,4194304] 0 2024-09-10T10:04:14.585 INFO:tasks.workunit.client.0.smithi071.stdout:9/504: chown d0/db/d1b/d1d/d30/d54/f1a 28657394 1 2024-09-10T10:04:14.586 INFO:tasks.workunit.client.1.smithi107.stdout:7/323: write d0/d20/d35/f5e [12273,63104] 0 2024-09-10T10:04:14.586 INFO:tasks.workunit.client.1.smithi107.stdout:6/410: dwrite d0/d3d/d14/d21/f5f [0,4194304] 0 2024-09-10T10:04:14.587 INFO:tasks.workunit.client.0.smithi071.stdout:2/305: dread d8/ff [0,4194304] 0 2024-09-10T10:04:14.588 INFO:tasks.workunit.client.0.smithi071.stdout:7/334: rename d9/d1a/d1d/d39 to d9/d76 0 2024-09-10T10:04:14.589 INFO:tasks.workunit.client.0.smithi071.stdout:3/322: dread d3/d10/d24/f25 [0,4194304] 0 2024-09-10T10:04:14.589 INFO:tasks.workunit.client.0.smithi071.stdout:7/335: fdatasync d9/ff 0 2024-09-10T10:04:14.590 INFO:tasks.workunit.client.1.smithi107.stdout:0/322: write d6/f10 [6657000,59589] 0 2024-09-10T10:04:14.591 INFO:tasks.workunit.client.1.smithi107.stdout:1/452: dwrite d2/d6/f5e [0,4194304] 0 2024-09-10T10:04:14.591 INFO:tasks.workunit.client.0.smithi071.stdout:2/306: creat d8/d24/f61 x:0 0 0 2024-09-10T10:04:14.592 INFO:tasks.workunit.client.1.smithi107.stdout:7/324: readlink d0/d20/l29 0 2024-09-10T10:04:14.593 INFO:tasks.workunit.client.0.smithi071.stdout:2/307: truncate d8/d13/f25 701639 0 2024-09-10T10:04:14.594 INFO:tasks.workunit.client.1.smithi107.stdout:1/453: read - d2/f4c zero size 2024-09-10T10:04:14.596 INFO:tasks.workunit.client.1.smithi107.stdout:0/323: write d6/f7 [1236790,13925] 0 2024-09-10T10:04:14.596 INFO:tasks.workunit.client.0.smithi071.stdout:9/505: rename d0/db/f39 to d0/db/d1b/d46/fa3 0 2024-09-10T10:04:14.597 INFO:tasks.workunit.client.1.smithi107.stdout:7/325: write d0/d1b/f28 [418724,17020] 0 2024-09-10T10:04:14.598 INFO:tasks.workunit.client.0.smithi071.stdout:7/336: dwrite d9/d1a/d1d/f57 [0,4194304] 0 2024-09-10T10:04:14.599 INFO:tasks.workunit.client.1.smithi107.stdout:6/411: chown d0/d3d/d14/d17/d49/d55/d73/f77 13170 1 2024-09-10T10:04:14.600 INFO:tasks.workunit.client.1.smithi107.stdout:9/405: mknod d5/d7/d1d/d41/d83/c94 0 2024-09-10T10:04:14.601 INFO:tasks.workunit.client.0.smithi071.stdout:9/506: dread d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f8d [0,4194304] 0 2024-09-10T10:04:14.601 INFO:tasks.workunit.client.1.smithi107.stdout:1/454: symlink d2/d6/l8d 0 2024-09-10T10:04:14.602 INFO:tasks.workunit.client.0.smithi071.stdout:3/323: symlink d3/d20/d30/d5d/l73 0 2024-09-10T10:04:14.602 INFO:tasks.workunit.client.1.smithi107.stdout:2/425: dwrite d3/da/df/d20/f33 [0,4194304] 0 2024-09-10T10:04:14.604 INFO:tasks.workunit.client.1.smithi107.stdout:6/412: rmdir d0 39 2024-09-10T10:04:14.604 INFO:tasks.workunit.client.1.smithi107.stdout:9/406: stat d5/d7/d3c/d53 0 2024-09-10T10:04:14.606 INFO:tasks.workunit.client.0.smithi071.stdout:7/337: dwrite d9/d1a/f35 [4194304,4194304] 0 2024-09-10T10:04:14.608 INFO:tasks.workunit.client.0.smithi071.stdout:3/324: rmdir d3/d49/d2f 39 2024-09-10T10:04:14.608 INFO:tasks.workunit.client.0.smithi071.stdout:3/325: chown d3/d10/c12 43697 1 2024-09-10T10:04:14.609 INFO:tasks.workunit.client.0.smithi071.stdout:2/308: symlink d8/l62 0 2024-09-10T10:04:14.610 INFO:tasks.workunit.client.0.smithi071.stdout:3/326: read d3/ff [928575,4584] 0 2024-09-10T10:04:14.611 INFO:tasks.workunit.client.1.smithi107.stdout:7/326: dwrite d0/d8/d9/d3d/f60 [0,4194304] 0 2024-09-10T10:04:14.612 INFO:tasks.workunit.client.1.smithi107.stdout:6/413: write d0/d3d/d14/d17/d49/d55/d73/f75 [382228,29624] 0 2024-09-10T10:04:14.612 INFO:tasks.workunit.client.0.smithi071.stdout:7/338: rename d9/d1a/l6b to d9/d76/l77 0 2024-09-10T10:04:14.612 INFO:tasks.workunit.client.0.smithi071.stdout:2/309: mkdir d8/d38/d63 0 2024-09-10T10:04:14.613 INFO:tasks.workunit.client.1.smithi107.stdout:2/426: rename d3/da/df/d20/d36/d4f/l56 to d3/da/d1e/d40/l97 0 2024-09-10T10:04:14.613 INFO:tasks.workunit.client.1.smithi107.stdout:7/327: readlink d0/d8/d9/l53 0 2024-09-10T10:04:14.614 INFO:tasks.workunit.client.1.smithi107.stdout:2/427: chown d3/da/d1e/d40/d8a/f89 1303 1 2024-09-10T10:04:14.614 INFO:tasks.workunit.client.1.smithi107.stdout:7/328: write d0/d8/dc/f59 [65372,64221] 0 2024-09-10T10:04:14.616 INFO:tasks.workunit.client.0.smithi071.stdout:3/327: rename d3/d1c/f57 to d3/d20/d30/d5d/f74 0 2024-09-10T10:04:14.617 INFO:tasks.workunit.client.0.smithi071.stdout:7/339: stat d9/d15/d1f/f6d 0 2024-09-10T10:04:14.617 INFO:tasks.workunit.client.1.smithi107.stdout:9/407: getdents d5/d7/d3c 0 2024-09-10T10:04:14.618 INFO:tasks.workunit.client.1.smithi107.stdout:7/329: write d0/d20/f41 [90338,89729] 0 2024-09-10T10:04:14.618 INFO:tasks.workunit.client.0.smithi071.stdout:2/310: write d8/d24/f2d [618870,28706] 0 2024-09-10T10:04:14.620 INFO:tasks.workunit.client.1.smithi107.stdout:2/428: rename d3/d6d/f94 to d3/d6d/f98 0 2024-09-10T10:04:14.622 INFO:tasks.workunit.client.1.smithi107.stdout:6/414: getdents d0/d70 0 2024-09-10T10:04:14.624 INFO:tasks.workunit.client.1.smithi107.stdout:7/330: creat d0/d1b/d4d/f61 x:0 0 0 2024-09-10T10:04:14.625 INFO:tasks.workunit.client.1.smithi107.stdout:9/408: mkdir d5/d7/d1d/d95 0 2024-09-10T10:04:14.628 INFO:tasks.workunit.client.1.smithi107.stdout:6/415: write d0/d3d/d14/d42/d88/f85 [529134,97600] 0 2024-09-10T10:04:14.628 INFO:tasks.workunit.client.0.smithi071.stdout:7/340: link d9/d15/d55/c67 d9/d76/d66/c78 0 2024-09-10T10:04:14.628 INFO:tasks.workunit.client.0.smithi071.stdout:7/341: chown d9/d70 964809 1 2024-09-10T10:04:14.630 INFO:tasks.workunit.client.1.smithi107.stdout:7/331: symlink d0/d8/d56/l62 0 2024-09-10T10:04:14.631 INFO:tasks.workunit.client.1.smithi107.stdout:2/429: dread d3/da/df/d20/f33 [0,4194304] 0 2024-09-10T10:04:14.631 INFO:tasks.workunit.client.0.smithi071.stdout:7/342: link d9/d11/f59 d9/d15/d40/f79 0 2024-09-10T10:04:14.633 INFO:tasks.workunit.client.0.smithi071.stdout:7/343: creat d9/d15/d40/f7a x:0 0 0 2024-09-10T10:04:14.633 INFO:tasks.workunit.client.1.smithi107.stdout:2/430: dread - d3/da/d1e/d40/d8a/d7f/d55/d85/f75 zero size 2024-09-10T10:04:14.634 INFO:tasks.workunit.client.1.smithi107.stdout:7/332: symlink d0/d8/dc/d2c/d47/l63 0 2024-09-10T10:04:14.636 INFO:tasks.workunit.client.1.smithi107.stdout:2/431: mknod d3/da/d1e/d5f/d54/c99 0 2024-09-10T10:04:14.638 INFO:tasks.workunit.client.0.smithi071.stdout:7/344: read f7 [656631,128792] 0 2024-09-10T10:04:14.638 INFO:tasks.workunit.client.0.smithi071.stdout:7/345: chown c5 2026848 1 2024-09-10T10:04:14.638 INFO:tasks.workunit.client.0.smithi071.stdout:7/346: chown d9/d11/d6f 56 1 2024-09-10T10:04:14.639 INFO:tasks.workunit.client.0.smithi071.stdout:7/347: readlink l1 0 2024-09-10T10:04:14.640 INFO:tasks.workunit.client.0.smithi071.stdout:7/348: mknod d9/d70/c7b 0 2024-09-10T10:04:14.641 INFO:tasks.workunit.client.0.smithi071.stdout:7/349: write d9/f34 [4716622,91423] 0 2024-09-10T10:04:14.643 INFO:tasks.workunit.client.0.smithi071.stdout:7/350: creat d9/d2c/d4f/f7c x:0 0 0 2024-09-10T10:04:14.644 INFO:tasks.workunit.client.1.smithi107.stdout:2/432: dwrite d3/da/d1e/d40/d8a/f89 [0,4194304] 0 2024-09-10T10:04:14.646 INFO:tasks.workunit.client.0.smithi071.stdout:7/351: unlink d9/d15/l47 0 2024-09-10T10:04:14.647 INFO:tasks.workunit.client.1.smithi107.stdout:2/433: mknod d3/da/df/c9a 0 2024-09-10T10:04:14.651 INFO:tasks.workunit.client.0.smithi071.stdout:9/507: write d0/db/d1b/d1d/f1f [5226879,5198] 0 2024-09-10T10:04:14.656 INFO:tasks.workunit.client.0.smithi071.stdout:9/508: getdents d0/db/d1b/d1d/d30/d54/d27 0 2024-09-10T10:04:14.657 INFO:tasks.workunit.client.0.smithi071.stdout:9/509: fsync d0/d3b/d5c/f74 0 2024-09-10T10:04:14.660 INFO:tasks.workunit.client.0.smithi071.stdout:9/510: rename d0/db/d1b/d1d/d5b/d60/c8e to d0/d3b/d5c/ca4 0 2024-09-10T10:04:14.663 INFO:tasks.workunit.client.1.smithi107.stdout:7/333: read d0/d20/f44 [140482,70451] 0 2024-09-10T10:04:14.666 INFO:tasks.workunit.client.0.smithi071.stdout:9/511: getdents d0/db/d1b/d1d/d30 0 2024-09-10T10:04:14.667 INFO:tasks.workunit.client.1.smithi107.stdout:7/334: rename d0/f36 to d0/d57/f64 0 2024-09-10T10:04:14.667 INFO:tasks.workunit.client.1.smithi107.stdout:7/335: readlink d0/d8/d9/l34 0 2024-09-10T10:04:14.669 INFO:tasks.workunit.client.1.smithi107.stdout:7/336: read d0/d8/f32 [645703,13887] 0 2024-09-10T10:04:14.669 INFO:tasks.workunit.client.0.smithi071.stdout:7/352: dread f2 [0,4194304] 0 2024-09-10T10:04:14.672 INFO:tasks.workunit.client.0.smithi071.stdout:9/512: link d0/db/d1b/d1d/d4b/f8b d0/db/d20/d21/fa5 0 2024-09-10T10:04:14.672 INFO:tasks.workunit.client.0.smithi071.stdout:7/353: readlink d9/l26 0 2024-09-10T10:04:14.673 INFO:tasks.workunit.client.0.smithi071.stdout:7/354: dread - d9/d1a/d1d/f61 zero size 2024-09-10T10:04:14.673 INFO:tasks.workunit.client.0.smithi071.stdout:9/513: truncate d0/db/d1b/d46/fa3 762125 0 2024-09-10T10:04:14.675 INFO:tasks.workunit.client.0.smithi071.stdout:7/355: write d9/d15/f51 [917117,24611] 0 2024-09-10T10:04:14.678 INFO:tasks.workunit.client.0.smithi071.stdout:7/356: unlink d9/fa 0 2024-09-10T10:04:14.681 INFO:tasks.workunit.client.1.smithi107.stdout:9/409: truncate d5/d7/f13 3820311 0 2024-09-10T10:04:14.683 INFO:tasks.workunit.client.1.smithi107.stdout:1/455: dwrite d2/d12/d65/d6b/f42 [0,4194304] 0 2024-09-10T10:04:14.683 INFO:tasks.workunit.client.0.smithi071.stdout:7/357: mknod d9/d76/d66/c7d 0 2024-09-10T10:04:14.689 INFO:tasks.workunit.client.0.smithi071.stdout:7/358: creat d9/d2c/f7e x:0 0 0 2024-09-10T10:04:14.691 INFO:tasks.workunit.client.0.smithi071.stdout:2/311: truncate d8/f1a 452977 0 2024-09-10T10:04:14.692 INFO:tasks.workunit.client.0.smithi071.stdout:7/359: unlink d9/d15/l22 0 2024-09-10T10:04:14.692 INFO:tasks.workunit.client.0.smithi071.stdout:7/360: readlink d9/l26 0 2024-09-10T10:04:14.693 INFO:tasks.workunit.client.1.smithi107.stdout:2/434: dread d3/da/df/d20/f46 [0,4194304] 0 2024-09-10T10:04:14.693 INFO:tasks.workunit.client.1.smithi107.stdout:1/456: truncate d2/d12/d65/d6b/f43 1260645 0 2024-09-10T10:04:14.694 INFO:tasks.workunit.client.0.smithi071.stdout:9/514: dread d0/db/d1b/d1d/f1f [0,4194304] 0 2024-09-10T10:04:14.697 INFO:tasks.workunit.client.0.smithi071.stdout:7/361: creat d9/f7f x:0 0 0 2024-09-10T10:04:14.699 INFO:tasks.workunit.client.0.smithi071.stdout:9/515: stat d0/c26 0 2024-09-10T10:04:14.699 INFO:tasks.workunit.client.1.smithi107.stdout:9/410: getdents d5/d1e 0 2024-09-10T10:04:14.700 INFO:tasks.workunit.client.0.smithi071.stdout:7/362: mkdir d9/d15/d40/d80 0 2024-09-10T10:04:14.702 INFO:tasks.workunit.client.0.smithi071.stdout:9/516: symlink d0/db/d20/d3c/d75/la6 0 2024-09-10T10:04:14.703 INFO:tasks.workunit.client.1.smithi107.stdout:9/411: fsync d5/d7/d3c/d53/f93 0 2024-09-10T10:04:14.703 INFO:tasks.workunit.client.0.smithi071.stdout:7/363: mknod d9/d2c/d49/c81 0 2024-09-10T10:04:14.703 INFO:tasks.workunit.client.0.smithi071.stdout:9/517: stat d0/db/d1b/d1d/d30/d54/d27/f66 0 2024-09-10T10:04:14.704 INFO:tasks.workunit.client.1.smithi107.stdout:1/457: link d2/d36/c48 d2/d35/d7b/d8b/c8e 0 2024-09-10T10:04:14.705 INFO:tasks.workunit.client.1.smithi107.stdout:6/416: dread d0/f2c [4194304,4194304] 0 2024-09-10T10:04:14.705 INFO:tasks.workunit.client.1.smithi107.stdout:2/435: link d3/da/d1e/d40/d8a/l86 d3/da/d1e/d27/l9b 0 2024-09-10T10:04:14.707 INFO:tasks.workunit.client.1.smithi107.stdout:3/584: dwrite dc/dd/d45/d26/d41/d44/f1f [0,4194304] 0 2024-09-10T10:04:14.709 INFO:tasks.workunit.client.1.smithi107.stdout:2/436: dread - d3/da/df/d20/d36/f76 zero size 2024-09-10T10:04:14.709 INFO:tasks.workunit.client.1.smithi107.stdout:9/412: truncate d5/d7/d1d/d41/f91 604928 0 2024-09-10T10:04:14.710 INFO:tasks.workunit.client.1.smithi107.stdout:7/337: dread d0/f7 [0,4194304] 0 2024-09-10T10:04:14.711 INFO:tasks.workunit.client.1.smithi107.stdout:3/585: read dc/dd/f17 [2917902,43388] 0 2024-09-10T10:04:14.712 INFO:tasks.workunit.client.1.smithi107.stdout:6/417: mkdir d0/d3d/d14/d21/d8a/d8d 0 2024-09-10T10:04:14.712 INFO:tasks.workunit.client.1.smithi107.stdout:9/413: rmdir d5/d7/d3c/d53/d57/d87/d27 39 2024-09-10T10:04:14.713 INFO:tasks.workunit.client.1.smithi107.stdout:9/414: fdatasync d5/f6a 0 2024-09-10T10:04:14.713 INFO:tasks.workunit.client.1.smithi107.stdout:3/586: read f1 [3535105,41519] 0 2024-09-10T10:04:14.713 INFO:tasks.workunit.client.1.smithi107.stdout:7/338: rename d0/d20/d35/c43 to d0/d20/c65 0 2024-09-10T10:04:14.714 INFO:tasks.workunit.client.1.smithi107.stdout:9/415: write d5/f6a [901347,65526] 0 2024-09-10T10:04:14.715 INFO:tasks.workunit.client.1.smithi107.stdout:3/587: chown dc/dd/d45/d26 240 1 2024-09-10T10:04:14.716 INFO:tasks.workunit.client.1.smithi107.stdout:7/339: symlink d0/d8/d9/d3d/l66 0 2024-09-10T10:04:14.717 INFO:tasks.workunit.client.1.smithi107.stdout:3/588: dread - dc/dd/d20/d23/d39/fbf zero size 2024-09-10T10:04:14.721 INFO:tasks.workunit.client.1.smithi107.stdout:7/340: creat d0/d8/d56/d5d/f67 x:0 0 0 2024-09-10T10:04:14.721 INFO:tasks.workunit.client.1.smithi107.stdout:6/418: dwrite d0/d3d/d14/d17/d49/f7e [0,4194304] 0 2024-09-10T10:04:14.722 INFO:tasks.workunit.client.1.smithi107.stdout:6/419: stat d0/d3d/c57 0 2024-09-10T10:04:14.726 INFO:tasks.workunit.client.1.smithi107.stdout:4/471: sync 2024-09-10T10:04:14.726 INFO:tasks.workunit.client.1.smithi107.stdout:5/469: sync 2024-09-10T10:04:14.726 INFO:tasks.workunit.client.1.smithi107.stdout:3/589: rename dc/dd/d45/d26/d41/d44/d35/f19 to dc/dd/d42/d55/d58/d91/fc3 0 2024-09-10T10:04:14.727 INFO:tasks.workunit.client.1.smithi107.stdout:9/416: dread d5/d7/d1d/f47 [0,4194304] 0 2024-09-10T10:04:14.728 INFO:tasks.workunit.client.1.smithi107.stdout:5/470: readlink de/d20/d2b/d4b/d5e/d9a/la1 0 2024-09-10T10:04:14.729 INFO:tasks.workunit.client.1.smithi107.stdout:3/590: write dc/dd/d45/fb5 [203114,87839] 0 2024-09-10T10:04:14.729 INFO:tasks.workunit.client.1.smithi107.stdout:4/472: write d0/d40/d57/d4f/f58 [826526,38161] 0 2024-09-10T10:04:14.730 INFO:tasks.workunit.client.1.smithi107.stdout:7/341: rename d0/d57 to d0/d8/d9/d68 0 2024-09-10T10:04:14.730 INFO:tasks.workunit.client.1.smithi107.stdout:6/420: creat d0/d3d/d14/d17/d24/f8e x:0 0 0 2024-09-10T10:04:14.733 INFO:tasks.workunit.client.0.smithi071.stdout:8/267: sync 2024-09-10T10:04:14.733 INFO:tasks.workunit.client.1.smithi107.stdout:9/417: write d5/d7/d1d/f47 [5078487,31385] 0 2024-09-10T10:04:14.733 INFO:tasks.workunit.client.1.smithi107.stdout:7/342: write d0/d20/d35/f54 [1019833,69147] 0 2024-09-10T10:04:14.734 INFO:tasks.workunit.client.1.smithi107.stdout:4/473: read d0/fa [3779924,126451] 0 2024-09-10T10:04:14.738 INFO:tasks.workunit.client.1.smithi107.stdout:7/343: mkdir d0/d1b/d4d/d69 0 2024-09-10T10:04:14.738 INFO:tasks.workunit.client.1.smithi107.stdout:4/474: write d0/d40/d6d/f84 [244068,42424] 0 2024-09-10T10:04:14.741 INFO:tasks.workunit.client.1.smithi107.stdout:7/344: chown d0/d8/dc/f4f 1566 1 2024-09-10T10:04:14.744 INFO:tasks.workunit.client.1.smithi107.stdout:4/475: rename d0/le to d0/d40/d57/la8 0 2024-09-10T10:04:14.746 INFO:tasks.workunit.client.1.smithi107.stdout:3/591: dwrite dc/dd/d45/d26/d41/d44/d63/f6f [0,4194304] 0 2024-09-10T10:04:14.747 INFO:tasks.workunit.client.1.smithi107.stdout:4/476: mkdir d0/d40/d57/d76/d77/da9 0 2024-09-10T10:04:14.749 INFO:tasks.workunit.client.1.smithi107.stdout:4/477: stat d0/d40/d57/d76/d77/da1/d59/l8f 0 2024-09-10T10:04:14.752 INFO:tasks.workunit.client.1.smithi107.stdout:3/592: symlink dc/dd/d45/lc4 0 2024-09-10T10:04:14.752 INFO:tasks.workunit.client.1.smithi107.stdout:4/478: mknod d0/d40/d57/caa 0 2024-09-10T10:04:14.755 INFO:tasks.workunit.client.0.smithi071.stdout:9/518: symlink d0/db/d1b/d1d/d30/d54/d27/la7 0 2024-09-10T10:04:14.755 INFO:tasks.workunit.client.0.smithi071.stdout:8/268: fdatasync d5/f11 0 2024-09-10T10:04:14.757 INFO:tasks.workunit.client.0.smithi071.stdout:9/519: write d0/d3b/d44/f89 [3208821,103200] 0 2024-09-10T10:04:14.759 INFO:tasks.workunit.client.1.smithi107.stdout:5/471: dread de/d20/d2b/f39 [0,4194304] 0 2024-09-10T10:04:14.760 INFO:tasks.workunit.client.1.smithi107.stdout:4/479: dwrite d0/d40/d57/f74 [0,4194304] 0 2024-09-10T10:04:14.762 INFO:tasks.workunit.client.0.smithi071.stdout:2/312: dwrite d8/d38/d47/f5f [4194304,4194304] 0 2024-09-10T10:04:14.764 INFO:tasks.workunit.client.0.smithi071.stdout:2/313: chown d8/f14 13 1 2024-09-10T10:04:14.768 INFO:tasks.workunit.client.0.smithi071.stdout:7/364: rename d9/d15/d1f/l23 to d9/d1a/l82 0 2024-09-10T10:04:14.772 INFO:tasks.workunit.client.1.smithi107.stdout:3/593: dwrite dc/dd/d45/d26/d41/d44/fb8 [0,4194304] 0 2024-09-10T10:04:14.772 INFO:tasks.workunit.client.1.smithi107.stdout:5/472: read de/d20/d2b/f60 [3773774,125687] 0 2024-09-10T10:04:14.776 INFO:tasks.workunit.client.1.smithi107.stdout:4/480: dwrite d0/d40/d57/d4f/f58 [0,4194304] 0 2024-09-10T10:04:14.777 INFO:tasks.workunit.client.1.smithi107.stdout:5/473: readlink de/d20/d2b/d4b/d5e/l8a 0 2024-09-10T10:04:14.778 INFO:tasks.workunit.client.0.smithi071.stdout:8/269: mkdir d5/df/d1e/d38/d62 0 2024-09-10T10:04:14.779 INFO:tasks.workunit.client.1.smithi107.stdout:5/474: chown de/d4a/d7e/d79/c97 4475 1 2024-09-10T10:04:14.780 INFO:tasks.workunit.client.0.smithi071.stdout:9/520: write d0/db/d1b/d1d/f1f [2676415,13654] 0 2024-09-10T10:04:14.781 INFO:tasks.workunit.client.1.smithi107.stdout:4/481: dread d0/d40/f68 [0,4194304] 0 2024-09-10T10:04:14.782 INFO:tasks.workunit.client.0.smithi071.stdout:7/365: rmdir d9/d15/d40 39 2024-09-10T10:04:14.783 INFO:tasks.workunit.client.1.smithi107.stdout:3/594: getdents dc/d56 0 2024-09-10T10:04:14.784 INFO:tasks.workunit.client.1.smithi107.stdout:3/595: fdatasync dc/dd/d20/d23/d39/d69/fa8 0 2024-09-10T10:04:14.804 INFO:tasks.workunit.client.1.smithi107.stdout:4/482: link d0/d1f/d20/f2c d0/d40/d57/d76/d77/d8d/fab 0 2024-09-10T10:04:14.804 INFO:tasks.workunit.client.0.smithi071.stdout:7/366: creat d9/d76/f83 x:0 0 0 2024-09-10T10:04:14.805 INFO:tasks.workunit.client.1.smithi107.stdout:3/596: symlink dc/dd/d45/d26/d41/d44/d35/lc5 0 2024-09-10T10:04:14.805 INFO:tasks.workunit.client.0.smithi071.stdout:7/367: fdatasync d9/d1a/d1d/f57 0 2024-09-10T10:04:14.806 INFO:tasks.workunit.client.0.smithi071.stdout:9/521: getdents d0/da0 0 2024-09-10T10:04:14.806 INFO:tasks.workunit.client.1.smithi107.stdout:5/475: rename de/d41/c92 to de/d20/d2b/d4b/d8c/ca4 0 2024-09-10T10:04:14.807 INFO:tasks.workunit.client.0.smithi071.stdout:2/314: getdents d8/d24 0 2024-09-10T10:04:14.807 INFO:tasks.workunit.client.1.smithi107.stdout:3/597: write dc/dd/f17 [5253711,39279] 0 2024-09-10T10:04:14.808 INFO:tasks.workunit.client.1.smithi107.stdout:5/476: unlink de/c40 0 2024-09-10T10:04:14.811 INFO:tasks.workunit.client.0.smithi071.stdout:9/522: mknod d0/d3b/d5c/d6a/ca8 0 2024-09-10T10:04:14.811 INFO:tasks.workunit.client.0.smithi071.stdout:2/315: rmdir d8/d4a 39 2024-09-10T10:04:14.811 INFO:tasks.workunit.client.1.smithi107.stdout:3/598: symlink dc/dd/d42/d55/lc6 0 2024-09-10T10:04:14.812 INFO:tasks.workunit.client.1.smithi107.stdout:5/477: creat de/d20/d2b/d4b/d5e/fa5 x:0 0 0 2024-09-10T10:04:14.812 INFO:tasks.workunit.client.1.smithi107.stdout:4/483: dwrite d0/f1d [0,4194304] 0 2024-09-10T10:04:14.813 INFO:tasks.workunit.client.0.smithi071.stdout:7/368: creat d9/d15/d40/d80/f84 x:0 0 0 2024-09-10T10:04:14.813 INFO:tasks.workunit.client.1.smithi107.stdout:5/478: write f8 [5061937,64404] 0 2024-09-10T10:04:14.817 INFO:tasks.workunit.client.1.smithi107.stdout:4/484: rmdir d0/d40/d57/d71 39 2024-09-10T10:04:14.817 INFO:tasks.workunit.client.0.smithi071.stdout:7/369: dread - d9/d15/d1f/f68 zero size 2024-09-10T10:04:14.818 INFO:tasks.workunit.client.0.smithi071.stdout:7/370: truncate d9/d15/d1f/f6d 4614369 0 2024-09-10T10:04:14.820 INFO:tasks.workunit.client.1.smithi107.stdout:3/599: symlink dc/dd/d45/d26/d41/d44/d35/lc7 0 2024-09-10T10:04:14.820 INFO:tasks.workunit.client.0.smithi071.stdout:9/523: truncate d0/d3b/d5c/f74 3830239 0 2024-09-10T10:04:14.821 INFO:tasks.workunit.client.1.smithi107.stdout:4/485: creat d0/d40/d57/d76/d77/da1/fac x:0 0 0 2024-09-10T10:04:14.822 INFO:tasks.workunit.client.0.smithi071.stdout:7/371: mkdir d9/d2c/d85 0 2024-09-10T10:04:14.822 INFO:tasks.workunit.client.1.smithi107.stdout:5/479: dwrite de/d9c/fa3 [0,4194304] 0 2024-09-10T10:04:14.823 INFO:tasks.workunit.client.1.smithi107.stdout:4/486: creat d0/d40/fad x:0 0 0 2024-09-10T10:04:14.824 INFO:tasks.workunit.client.0.smithi071.stdout:8/270: unlink d5/l15 0 2024-09-10T10:04:14.825 INFO:tasks.workunit.client.0.smithi071.stdout:9/524: read d0/f42 [352456,7084] 0 2024-09-10T10:04:14.826 INFO:tasks.workunit.client.1.smithi107.stdout:3/600: creat dc/dd/d45/d26/fc8 x:0 0 0 2024-09-10T10:04:14.826 INFO:tasks.workunit.client.1.smithi107.stdout:4/487: mknod d0/d1f/d72/cae 0 2024-09-10T10:04:14.827 INFO:tasks.workunit.client.0.smithi071.stdout:8/271: creat d5/df/d16/f63 x:0 0 0 2024-09-10T10:04:14.828 INFO:tasks.workunit.client.0.smithi071.stdout:7/372: creat d9/d15/d1f/d74/f86 x:0 0 0 2024-09-10T10:04:14.829 INFO:tasks.workunit.client.0.smithi071.stdout:8/272: write d5/df/d1e/d38/f3f [269596,38223] 0 2024-09-10T10:04:14.830 INFO:tasks.workunit.client.0.smithi071.stdout:9/525: mknod d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/ca9 0 2024-09-10T10:04:14.830 INFO:tasks.workunit.client.0.smithi071.stdout:7/373: truncate d9/d2c/d4f/f7c 257530 0 2024-09-10T10:04:14.831 INFO:tasks.workunit.client.0.smithi071.stdout:9/526: fdatasync d0/d3b/d5c/d6a/f99 0 2024-09-10T10:04:14.831 INFO:tasks.workunit.client.0.smithi071.stdout:7/374: write d9/f7f [556876,40421] 0 2024-09-10T10:04:14.833 INFO:tasks.workunit.client.0.smithi071.stdout:2/316: truncate d8/fb 1564339 0 2024-09-10T10:04:14.834 INFO:tasks.workunit.client.0.smithi071.stdout:7/375: truncate d9/f7f 798501 0 2024-09-10T10:04:14.834 INFO:tasks.workunit.client.1.smithi107.stdout:4/488: dread d0/d40/d75/f5f [0,4194304] 0 2024-09-10T10:04:14.835 INFO:tasks.workunit.client.0.smithi071.stdout:9/527: truncate d0/d3b/d44/f5a 2713110 0 2024-09-10T10:04:14.835 INFO:tasks.workunit.client.1.smithi107.stdout:3/601: dwrite dc/dd/d45/d26/d41/d44/d35/f66 [0,4194304] 0 2024-09-10T10:04:14.838 INFO:tasks.workunit.client.0.smithi071.stdout:7/376: rmdir d9/d15/d55/d58 39 2024-09-10T10:04:14.839 INFO:tasks.workunit.client.1.smithi107.stdout:4/489: write d0/d40/d57/f3b [4640714,28230] 0 2024-09-10T10:04:14.841 INFO:tasks.workunit.client.0.smithi071.stdout:2/317: dread d8/f20 [0,4194304] 0 2024-09-10T10:04:14.842 INFO:tasks.workunit.client.0.smithi071.stdout:8/273: write d5/fd [1631637,73973] 0 2024-09-10T10:04:14.845 INFO:tasks.workunit.client.0.smithi071.stdout:2/318: write d8/d13/d33/f40 [6970722,31332] 0 2024-09-10T10:04:14.846 INFO:tasks.workunit.client.0.smithi071.stdout:7/377: dwrite d9/ff [0,4194304] 0 2024-09-10T10:04:14.848 INFO:tasks.workunit.client.0.smithi071.stdout:8/274: symlink d5/d36/d49/l64 0 2024-09-10T10:04:14.850 INFO:tasks.workunit.client.0.smithi071.stdout:7/378: symlink d9/d70/l87 0 2024-09-10T10:04:14.851 INFO:tasks.workunit.client.1.smithi107.stdout:3/602: dwrite dc/dd/d45/f6d [0,4194304] 0 2024-09-10T10:04:14.852 INFO:tasks.workunit.client.0.smithi071.stdout:8/275: unlink d5/df/d1e/d38/f3f 0 2024-09-10T10:04:14.852 INFO:tasks.workunit.client.1.smithi107.stdout:5/480: dwrite de/d4a/d7e/f6e [0,4194304] 0 2024-09-10T10:04:14.858 INFO:tasks.workunit.client.1.smithi107.stdout:3/603: creat dc/dd/d20/fc9 x:0 0 0 2024-09-10T10:04:14.858 INFO:tasks.workunit.client.1.smithi107.stdout:4/490: truncate d0/f10 2111919 0 2024-09-10T10:04:14.858 INFO:tasks.workunit.client.0.smithi071.stdout:7/379: dwrite d9/d15/f5d [0,4194304] 0 2024-09-10T10:04:14.863 INFO:tasks.workunit.client.0.smithi071.stdout:7/380: creat d9/d1a/f88 x:0 0 0 2024-09-10T10:04:14.864 INFO:tasks.workunit.client.1.smithi107.stdout:3/604: rmdir dc/dd/d45/d26/d41/d44/d35/dab 0 2024-09-10T10:04:14.865 INFO:tasks.workunit.client.1.smithi107.stdout:3/605: dread - dc/dd/d42/d55/fb3 zero size 2024-09-10T10:04:14.867 INFO:tasks.workunit.client.1.smithi107.stdout:4/491: link d0/d40/d57/d76/d77/da1/f4b d0/d40/d57/d76/faf 0 2024-09-10T10:04:14.868 INFO:tasks.workunit.client.0.smithi071.stdout:7/381: link d9/d15/c2d d9/d2c/d49/c89 0 2024-09-10T10:04:14.869 INFO:tasks.workunit.client.1.smithi107.stdout:4/492: chown d0/cd 66593294 1 2024-09-10T10:04:14.870 INFO:tasks.workunit.client.0.smithi071.stdout:7/382: chown d9/d76/f83 9344219 1 2024-09-10T10:04:14.870 INFO:tasks.workunit.client.0.smithi071.stdout:7/383: write d9/f7f [1198326,28082] 0 2024-09-10T10:04:14.871 INFO:tasks.workunit.client.1.smithi107.stdout:3/606: creat dc/fca x:0 0 0 2024-09-10T10:04:14.871 INFO:tasks.workunit.client.0.smithi071.stdout:7/384: dread - d9/d2c/f7e zero size 2024-09-10T10:04:14.874 INFO:tasks.workunit.client.0.smithi071.stdout:7/385: fdatasync d9/d1a/d1d/f1e 0 2024-09-10T10:04:14.875 INFO:tasks.workunit.client.0.smithi071.stdout:7/386: write d9/d15/d1f/f68 [962474,22353] 0 2024-09-10T10:04:14.877 INFO:tasks.workunit.client.1.smithi107.stdout:4/493: creat d0/d40/d57/fb0 x:0 0 0 2024-09-10T10:04:14.878 INFO:tasks.workunit.client.0.smithi071.stdout:7/387: mknod d9/d15/c8a 0 2024-09-10T10:04:14.885 INFO:tasks.workunit.client.0.smithi071.stdout:7/388: dwrite f2 [4194304,4194304] 0 2024-09-10T10:04:14.886 INFO:tasks.workunit.client.0.smithi071.stdout:8/276: dread f3 [0,4194304] 0 2024-09-10T10:04:14.886 INFO:tasks.workunit.client.0.smithi071.stdout:7/389: dread - d9/d15/d55/f6e zero size 2024-09-10T10:04:14.887 INFO:tasks.workunit.client.0.smithi071.stdout:7/390: chown d9/d15/d1f/d74/f86 2789025 1 2024-09-10T10:04:14.888 INFO:tasks.workunit.client.0.smithi071.stdout:8/277: creat d5/d36/f65 x:0 0 0 2024-09-10T10:04:14.888 INFO:tasks.workunit.client.0.smithi071.stdout:7/391: creat d9/d15/d1f/d74/f8b x:0 0 0 2024-09-10T10:04:14.893 INFO:tasks.workunit.client.0.smithi071.stdout:7/392: link d9/d76/l77 d9/d15/d40/l8c 0 2024-09-10T10:04:14.900 INFO:tasks.workunit.client.1.smithi107.stdout:4/494: write d0/d40/d75/f39 [2211963,87133] 0 2024-09-10T10:04:14.903 INFO:tasks.workunit.client.1.smithi107.stdout:4/495: write d0/d40/d6d/f84 [615872,20856] 0 2024-09-10T10:04:14.903 INFO:tasks.workunit.client.0.smithi071.stdout:7/393: getdents d9/d15/d40 0 2024-09-10T10:04:14.905 INFO:tasks.workunit.client.0.smithi071.stdout:7/394: stat d9/d2c/f7e 0 2024-09-10T10:04:14.906 INFO:tasks.workunit.client.1.smithi107.stdout:3/607: dwrite dc/dd/d45/d26/f50 [0,4194304] 0 2024-09-10T10:04:14.906 INFO:tasks.workunit.client.0.smithi071.stdout:7/395: chown d9/d2c/d4f/c54 24118842 1 2024-09-10T10:04:14.908 INFO:tasks.workunit.client.0.smithi071.stdout:8/278: dwrite d5/fe [0,4194304] 0 2024-09-10T10:04:14.911 INFO:tasks.workunit.client.1.smithi107.stdout:4/496: link d0/f11 d0/d40/d57/d76/d77/da1/d59/fb1 0 2024-09-10T10:04:14.913 INFO:tasks.workunit.client.0.smithi071.stdout:8/279: mknod d5/df/d1e/d38/c66 0 2024-09-10T10:04:14.913 INFO:tasks.workunit.client.1.smithi107.stdout:3/608: link dc/dd/d45/d26/f3a dc/dd/d45/d26/d41/d74/fcb 0 2024-09-10T10:04:14.915 INFO:tasks.workunit.client.0.smithi071.stdout:7/396: dwrite d9/d1a/f30 [0,4194304] 0 2024-09-10T10:04:14.916 INFO:tasks.workunit.client.0.smithi071.stdout:7/397: chown d9/d1a/f4d 149 1 2024-09-10T10:04:14.917 INFO:tasks.workunit.client.1.smithi107.stdout:3/609: write dc/dd/d20/f3e [3686134,54304] 0 2024-09-10T10:04:14.917 INFO:tasks.workunit.client.1.smithi107.stdout:4/497: getdents d0/d1f/d72 0 2024-09-10T10:04:14.918 INFO:tasks.workunit.client.0.smithi071.stdout:7/398: write d9/d15/d55/f6e [833105,127044] 0 2024-09-10T10:04:14.921 INFO:tasks.workunit.client.1.smithi107.stdout:3/610: symlink dc/lcc 0 2024-09-10T10:04:14.922 INFO:tasks.workunit.client.0.smithi071.stdout:8/280: rename d5/df/d1e/d38/d52 to d5/df/d67 0 2024-09-10T10:04:14.922 INFO:tasks.workunit.client.0.smithi071.stdout:7/399: mknod d9/d1a/d1d/c8d 0 2024-09-10T10:04:14.923 INFO:tasks.workunit.client.0.smithi071.stdout:8/281: chown d5/d36/f65 11662937 1 2024-09-10T10:04:14.925 INFO:tasks.workunit.client.0.smithi071.stdout:7/400: rename d9/d11/c27 to d9/d15/d40/c8e 0 2024-09-10T10:04:14.928 INFO:tasks.workunit.client.0.smithi071.stdout:8/282: rename d5/f10 to d5/df/d1e/d38/f68 0 2024-09-10T10:04:14.929 INFO:tasks.workunit.client.0.smithi071.stdout:7/401: dread d9/f10 [0,4194304] 0 2024-09-10T10:04:14.930 INFO:tasks.workunit.client.0.smithi071.stdout:8/283: symlink d5/df/d1e/d38/l69 0 2024-09-10T10:04:14.930 INFO:tasks.workunit.client.1.smithi107.stdout:0/324: sync 2024-09-10T10:04:14.930 INFO:tasks.workunit.client.1.smithi107.stdout:8/284: sync 2024-09-10T10:04:14.930 INFO:tasks.workunit.client.0.smithi071.stdout:7/402: chown d9/d15/c2d 239 1 2024-09-10T10:04:14.931 INFO:tasks.workunit.client.1.smithi107.stdout:8/285: fdatasync d5/d8/dc/d21/f3a 0 2024-09-10T10:04:14.932 INFO:tasks.workunit.client.0.smithi071.stdout:8/284: symlink d5/l6a 0 2024-09-10T10:04:14.932 INFO:tasks.workunit.client.1.smithi107.stdout:8/286: readlink d5/l17 0 2024-09-10T10:04:14.932 INFO:tasks.workunit.client.0.smithi071.stdout:8/285: fdatasync d5/d36/f2e 0 2024-09-10T10:04:14.933 INFO:tasks.workunit.client.0.smithi071.stdout:8/286: chown d5/l6a 0 1 2024-09-10T10:04:14.934 INFO:tasks.workunit.client.1.smithi107.stdout:8/287: write d5/d8/d2a/d35/f57 [786088,62269] 0 2024-09-10T10:04:14.934 INFO:tasks.workunit.client.0.smithi071.stdout:8/287: creat d5/d36/d49/f6b x:0 0 0 2024-09-10T10:04:14.936 INFO:tasks.workunit.client.0.smithi071.stdout:8/288: rmdir d5/d30 39 2024-09-10T10:04:14.937 INFO:tasks.workunit.client.0.smithi071.stdout:0/258: sync 2024-09-10T10:04:14.937 INFO:tasks.workunit.client.0.smithi071.stdout:8/289: chown d5/f11 156763 1 2024-09-10T10:04:14.937 INFO:tasks.workunit.client.1.smithi107.stdout:0/325: dwrite d6/f4a [0,4194304] 0 2024-09-10T10:04:14.938 INFO:tasks.workunit.client.0.smithi071.stdout:0/259: dread - d11/d30/f50 zero size 2024-09-10T10:04:14.940 INFO:tasks.workunit.client.1.smithi107.stdout:0/326: write d6/d8/d2f/f21 [3209599,65449] 0 2024-09-10T10:04:14.941 INFO:tasks.workunit.client.0.smithi071.stdout:8/290: unlink d5/d36/f2e 0 2024-09-10T10:04:14.942 INFO:tasks.workunit.client.1.smithi107.stdout:8/288: link d5/d8/l11 d5/d8/dc/d18/l62 0 2024-09-10T10:04:14.943 INFO:tasks.workunit.client.1.smithi107.stdout:0/327: rename d6/d8/d2f to d6/d8/d2f/d35/d4f/d5e 22 2024-09-10T10:04:14.943 INFO:tasks.workunit.client.0.smithi071.stdout:0/260: mknod d11/d1e/c5a 0 2024-09-10T10:04:14.947 INFO:tasks.workunit.client.1.smithi107.stdout:4/498: truncate d0/d40/d57/f33 2464049 0 2024-09-10T10:04:14.947 INFO:tasks.workunit.client.0.smithi071.stdout:0/261: symlink d11/d22/d31/l5b 0 2024-09-10T10:04:14.947 INFO:tasks.workunit.client.0.smithi071.stdout:8/291: mknod d5/df/d1e/d38/d62/c6c 0 2024-09-10T10:04:14.948 INFO:tasks.workunit.client.1.smithi107.stdout:3/611: truncate dc/dd/d42/d55/d58/d91/fc3 2545740 0 2024-09-10T10:04:14.948 INFO:tasks.workunit.client.0.smithi071.stdout:8/292: fdatasync d5/d36/f39 0 2024-09-10T10:04:14.949 INFO:tasks.workunit.client.1.smithi107.stdout:4/499: rmdir d0/d40/d57/d76/d77 39 2024-09-10T10:04:14.951 INFO:tasks.workunit.client.1.smithi107.stdout:3/612: read - dc/dd/f4f zero size 2024-09-10T10:04:14.952 INFO:tasks.workunit.client.1.smithi107.stdout:3/613: read - dc/d56/fb1 zero size 2024-09-10T10:04:14.952 INFO:tasks.workunit.client.1.smithi107.stdout:4/500: chown d0/d1f/d20/f17 231 1 2024-09-10T10:04:14.952 INFO:tasks.workunit.client.1.smithi107.stdout:8/289: rmdir d5 39 2024-09-10T10:04:14.957 INFO:tasks.workunit.client.1.smithi107.stdout:8/290: symlink d5/d8/d2a/l63 0 2024-09-10T10:04:14.958 INFO:tasks.workunit.client.1.smithi107.stdout:8/291: mkdir d5/d8/dc/d1a/d64 0 2024-09-10T10:04:14.961 INFO:tasks.workunit.client.1.smithi107.stdout:0/328: dread f4 [0,4194304] 0 2024-09-10T10:04:14.962 INFO:tasks.workunit.client.1.smithi107.stdout:0/329: fsync d6/f45 0 2024-09-10T10:04:14.964 INFO:tasks.workunit.client.1.smithi107.stdout:0/330: unlink d6/d8/c1e 0 2024-09-10T10:04:14.965 INFO:tasks.workunit.client.1.smithi107.stdout:4/501: write d0/f11 [5192979,44471] 0 2024-09-10T10:04:14.967 INFO:tasks.workunit.client.1.smithi107.stdout:4/502: creat d0/d40/fb2 x:0 0 0 2024-09-10T10:04:14.969 INFO:tasks.workunit.client.1.smithi107.stdout:4/503: mkdir d0/d40/db3 0 2024-09-10T10:04:14.970 INFO:tasks.workunit.client.1.smithi107.stdout:0/331: getdents d6/d14 0 2024-09-10T10:04:14.971 INFO:tasks.workunit.client.1.smithi107.stdout:4/504: fdatasync d0/d1f/d20/f51 0 2024-09-10T10:04:14.973 INFO:tasks.workunit.client.1.smithi107.stdout:8/292: dwrite d5/f38 [0,4194304] 0 2024-09-10T10:04:14.975 INFO:tasks.workunit.client.1.smithi107.stdout:8/293: write d5/d8/dc/d1a/f4d [399022,59885] 0 2024-09-10T10:04:14.976 INFO:tasks.workunit.client.1.smithi107.stdout:4/505: truncate d0/d40/d75/f44 2761874 0 2024-09-10T10:04:14.977 INFO:tasks.workunit.client.1.smithi107.stdout:0/332: link d6/c1f d6/d8/d3e/c5f 0 2024-09-10T10:04:14.977 INFO:tasks.workunit.client.1.smithi107.stdout:4/506: write d0/d40/fb2 [843257,97176] 0 2024-09-10T10:04:14.979 INFO:tasks.workunit.client.1.smithi107.stdout:4/507: read d0/d40/d75/f46 [94468,8504] 0 2024-09-10T10:04:14.979 INFO:tasks.workunit.client.1.smithi107.stdout:3/614: dread dc/dd/d45/d26/d41/d44/d35/d4a/f5c [0,4194304] 0 2024-09-10T10:04:14.980 INFO:tasks.workunit.client.1.smithi107.stdout:8/294: creat d5/d42/f65 x:0 0 0 2024-09-10T10:04:14.981 INFO:tasks.workunit.client.1.smithi107.stdout:3/615: stat dc/dd/d42/d55/d58/d91/la2 0 2024-09-10T10:04:14.983 INFO:tasks.workunit.client.1.smithi107.stdout:0/333: symlink d6/l60 0 2024-09-10T10:04:14.985 INFO:tasks.workunit.client.1.smithi107.stdout:3/616: mknod dc/dd/d45/d26/d41/d44/d35/d52/ccd 0 2024-09-10T10:04:14.987 INFO:tasks.workunit.client.1.smithi107.stdout:0/334: write d6/d8/d2f/d2e/f3f [719366,122395] 0 2024-09-10T10:04:14.988 INFO:tasks.workunit.client.1.smithi107.stdout:8/295: dread d5/d8/dc/d1a/f43 [0,4194304] 0 2024-09-10T10:04:14.988 INFO:tasks.workunit.client.1.smithi107.stdout:4/508: dwrite d0/d40/d75/f46 [0,4194304] 0 2024-09-10T10:04:14.989 INFO:tasks.workunit.client.1.smithi107.stdout:3/617: write dc/dd/d45/d26/f50 [3988078,32841] 0 2024-09-10T10:04:14.991 INFO:tasks.workunit.client.1.smithi107.stdout:8/296: readlink d5/d8/l39 0 2024-09-10T10:04:14.991 INFO:tasks.workunit.client.1.smithi107.stdout:0/335: mknod d6/d8/d2f/d2e/d32/d59/c61 0 2024-09-10T10:04:14.995 INFO:tasks.workunit.client.1.smithi107.stdout:0/336: chown d6/d8/d2f/d2e/d32/d59/c61 797 1 2024-09-10T10:04:14.998 INFO:tasks.workunit.client.1.smithi107.stdout:0/337: creat d6/d8/d2f/d2e/d32/d59/f62 x:0 0 0 2024-09-10T10:04:14.998 INFO:tasks.workunit.client.1.smithi107.stdout:3/618: write dc/dd/d45/d26/f3a [3117648,24030] 0 2024-09-10T10:04:15.001 INFO:tasks.workunit.client.1.smithi107.stdout:3/619: unlink dc/dd/d42/d55/lc6 0 2024-09-10T10:04:15.001 INFO:tasks.workunit.client.1.smithi107.stdout:0/338: symlink d6/d8/d2f/d2e/d32/d59/l63 0 2024-09-10T10:04:15.002 INFO:tasks.workunit.client.1.smithi107.stdout:3/620: creat dc/dd/d20/d23/d6e/fce x:0 0 0 2024-09-10T10:04:15.003 INFO:tasks.workunit.client.1.smithi107.stdout:0/339: write d6/d8/f28 [1055934,101906] 0 2024-09-10T10:04:15.005 INFO:tasks.workunit.client.1.smithi107.stdout:3/621: symlink dc/dd/d20/d23/lcf 0 2024-09-10T10:04:15.006 INFO:tasks.workunit.client.1.smithi107.stdout:3/622: rmdir dc/d56 39 2024-09-10T10:04:15.006 INFO:tasks.workunit.client.1.smithi107.stdout:0/340: read d6/fa [166167,120615] 0 2024-09-10T10:04:15.009 INFO:tasks.workunit.client.1.smithi107.stdout:3/623: creat dc/dd/d42/d55/d58/d91/fd0 x:0 0 0 2024-09-10T10:04:15.009 INFO:tasks.workunit.client.1.smithi107.stdout:3/624: stat dc/dd/d45/d26/d41/d44 0 2024-09-10T10:04:15.010 INFO:tasks.workunit.client.1.smithi107.stdout:3/625: chown dc/dd/f75 0 1 2024-09-10T10:04:15.013 INFO:tasks.workunit.client.1.smithi107.stdout:8/297: dread d5/d8/d2a/d47/f53 [0,4194304] 0 2024-09-10T10:04:15.014 INFO:tasks.workunit.client.1.smithi107.stdout:4/509: dread d0/d40/d57/f3b [0,4194304] 0 2024-09-10T10:04:15.015 INFO:tasks.workunit.client.1.smithi107.stdout:0/341: truncate d6/f23 1608674 0 2024-09-10T10:04:15.016 INFO:tasks.workunit.client.1.smithi107.stdout:4/510: read - d0/d40/d57/fb0 zero size 2024-09-10T10:04:15.017 INFO:tasks.workunit.client.1.smithi107.stdout:8/298: truncate d5/d8/dc/d21/f61 21709 0 2024-09-10T10:04:15.018 INFO:tasks.workunit.client.1.smithi107.stdout:0/342: symlink d6/d5a/d5c/l64 0 2024-09-10T10:04:15.018 INFO:tasks.workunit.client.1.smithi107.stdout:3/626: dwrite dc/dd/d45/d26/d41/d74/fcb [0,4194304] 0 2024-09-10T10:04:15.019 INFO:tasks.workunit.client.1.smithi107.stdout:8/299: mkdir d5/d8/d66 0 2024-09-10T10:04:15.021 INFO:tasks.workunit.client.1.smithi107.stdout:3/627: symlink dc/dd/d45/d26/d41/d44/d35/d4a/ld1 0 2024-09-10T10:04:15.022 INFO:tasks.workunit.client.1.smithi107.stdout:8/300: fdatasync d5/d8/dc/d21/f61 0 2024-09-10T10:04:15.023 INFO:tasks.workunit.client.1.smithi107.stdout:8/301: chown d5/d8/d2a/c4e 253294 1 2024-09-10T10:04:15.025 INFO:tasks.workunit.client.1.smithi107.stdout:8/302: write d5/d8/dc/d21/f61 [944266,72369] 0 2024-09-10T10:04:15.025 INFO:tasks.workunit.client.1.smithi107.stdout:3/628: creat dc/dd/d45/d26/fd2 x:0 0 0 2024-09-10T10:04:15.027 INFO:tasks.workunit.client.1.smithi107.stdout:4/511: dread d0/d40/d57/d76/d77/d8d/fab [0,4194304] 0 2024-09-10T10:04:15.028 INFO:tasks.workunit.client.1.smithi107.stdout:0/343: truncate d6/d8/d2f/d2e/f3f 120434 0 2024-09-10T10:04:15.029 INFO:tasks.workunit.client.1.smithi107.stdout:3/629: creat dc/dd/d45/d26/d41/fd3 x:0 0 0 2024-09-10T10:04:15.030 INFO:tasks.workunit.client.1.smithi107.stdout:8/303: creat d5/d8/dc/f67 x:0 0 0 2024-09-10T10:04:15.031 INFO:tasks.workunit.client.1.smithi107.stdout:4/512: creat d0/d1f/d20/d47/d8c/fb4 x:0 0 0 2024-09-10T10:04:15.031 INFO:tasks.workunit.client.1.smithi107.stdout:0/344: mkdir d6/d65 0 2024-09-10T10:04:15.032 INFO:tasks.workunit.client.1.smithi107.stdout:8/304: mknod d5/d8/d66/c68 0 2024-09-10T10:04:15.034 INFO:tasks.workunit.client.1.smithi107.stdout:4/513: write d0/d40/f68 [2394273,70545] 0 2024-09-10T10:04:15.035 INFO:tasks.workunit.client.1.smithi107.stdout:0/345: truncate d6/f45 4266156 0 2024-09-10T10:04:15.035 INFO:tasks.workunit.client.1.smithi107.stdout:8/305: chown d5/d8/dc/d21/f3a 0 1 2024-09-10T10:04:15.037 INFO:tasks.workunit.client.1.smithi107.stdout:8/306: fdatasync d5/d8/dc/d21/f61 0 2024-09-10T10:04:15.037 INFO:tasks.workunit.client.1.smithi107.stdout:4/514: rmdir d0/d40/d57 39 2024-09-10T10:04:15.040 INFO:tasks.workunit.client.1.smithi107.stdout:3/630: dwrite dc/dd/d20/d23/d2f/d9c/fa7 [0,4194304] 0 2024-09-10T10:04:15.040 INFO:tasks.workunit.client.1.smithi107.stdout:0/346: mkdir d6/d8/d2f/d2e/d32/d66 0 2024-09-10T10:04:15.040 INFO:tasks.workunit.client.1.smithi107.stdout:4/515: fsync d0/d1f/d20/f50 0 2024-09-10T10:04:15.041 INFO:tasks.workunit.client.1.smithi107.stdout:0/347: chown d6/d5a/d5c 122 1 2024-09-10T10:04:15.041 INFO:tasks.workunit.client.1.smithi107.stdout:8/307: unlink d5/ff 0 2024-09-10T10:04:15.042 INFO:tasks.workunit.client.1.smithi107.stdout:3/631: dread - dc/dd/d45/d26/d41/d44/d35/d52/f9f zero size 2024-09-10T10:04:15.044 INFO:tasks.workunit.client.1.smithi107.stdout:8/308: symlink d5/d8/d2a/l69 0 2024-09-10T10:04:15.045 INFO:tasks.workunit.client.1.smithi107.stdout:3/632: truncate dc/dd/d45/d26/d41/d74/f80 1586131 0 2024-09-10T10:04:15.047 INFO:tasks.workunit.client.1.smithi107.stdout:4/516: dread d0/d40/d57/f74 [0,4194304] 0 2024-09-10T10:04:15.048 INFO:tasks.workunit.client.1.smithi107.stdout:0/348: rename d6/d8/d2f/d2e/f4d to d6/d8/d2f/d2e/d32/d59/f67 0 2024-09-10T10:04:15.048 INFO:tasks.workunit.client.1.smithi107.stdout:0/349: dread - d6/d8/d2f/d2e/f52 zero size 2024-09-10T10:04:15.049 INFO:tasks.workunit.client.1.smithi107.stdout:0/350: chown d6/d14 1279155 1 2024-09-10T10:04:15.051 INFO:tasks.workunit.client.1.smithi107.stdout:3/633: read - dc/d56/fb0 zero size 2024-09-10T10:04:15.052 INFO:tasks.workunit.client.1.smithi107.stdout:4/517: creat d0/fb5 x:0 0 0 2024-09-10T10:04:15.054 INFO:tasks.workunit.client.1.smithi107.stdout:8/309: link d5/d8/f13 d5/d8/d66/f6a 0 2024-09-10T10:04:15.055 INFO:tasks.workunit.client.1.smithi107.stdout:3/634: mknod dc/dd/d20/d23/d39/d69/cd4 0 2024-09-10T10:04:15.056 INFO:tasks.workunit.client.1.smithi107.stdout:4/518: creat d0/d40/d57/d4f/fb6 x:0 0 0 2024-09-10T10:04:15.056 INFO:tasks.workunit.client.1.smithi107.stdout:0/351: symlink d6/d8/d2f/d2e/d32/d56/l68 0 2024-09-10T10:04:15.057 INFO:tasks.workunit.client.1.smithi107.stdout:8/310: write d5/d8/d2a/d47/f53 [397351,52748] 0 2024-09-10T10:04:15.059 INFO:tasks.workunit.client.1.smithi107.stdout:3/635: mkdir dc/dd5 0 2024-09-10T10:04:15.061 INFO:tasks.workunit.client.1.smithi107.stdout:0/352: mkdir d6/d8/d2f/d35/d3c/d58/d69 0 2024-09-10T10:04:15.062 INFO:tasks.workunit.client.1.smithi107.stdout:8/311: dread d5/d8/d2a/d47/f54 [0,4194304] 0 2024-09-10T10:04:15.062 INFO:tasks.workunit.client.1.smithi107.stdout:0/353: chown d6/d8/d3e/d43/f4b 0 1 2024-09-10T10:04:15.064 INFO:tasks.workunit.client.1.smithi107.stdout:4/519: truncate d0/fa 631689 0 2024-09-10T10:04:15.065 INFO:tasks.workunit.client.1.smithi107.stdout:0/354: creat d6/d8/d2f/d2e/d32/f6a x:0 0 0 2024-09-10T10:04:15.066 INFO:tasks.workunit.client.1.smithi107.stdout:8/312: creat d5/d8/dc/d1a/d64/f6b x:0 0 0 2024-09-10T10:04:15.067 INFO:tasks.workunit.client.1.smithi107.stdout:4/520: creat d0/d40/d57/d76/d77/da9/fb7 x:0 0 0 2024-09-10T10:04:15.067 INFO:tasks.workunit.client.1.smithi107.stdout:3/636: dwrite dc/dd/d45/f64 [4194304,4194304] 0 2024-09-10T10:04:15.070 INFO:tasks.workunit.client.1.smithi107.stdout:8/313: chown d5/d8/dc/d18/l62 1728048 1 2024-09-10T10:04:15.070 INFO:tasks.workunit.client.1.smithi107.stdout:4/521: symlink d0/d40/d57/d76/d77/da9/lb8 0 2024-09-10T10:04:15.071 INFO:tasks.workunit.client.1.smithi107.stdout:3/637: symlink dc/dd/d20/d23/d2f/d9c/ld6 0 2024-09-10T10:04:15.071 INFO:tasks.workunit.client.1.smithi107.stdout:0/355: creat d6/d8/d2f/d35/d3c/d58/d69/f6b x:0 0 0 2024-09-10T10:04:15.072 INFO:tasks.workunit.client.1.smithi107.stdout:8/314: rmdir d5/d8/dc/d21/d48 39 2024-09-10T10:04:15.075 INFO:tasks.workunit.client.1.smithi107.stdout:4/522: creat d0/d40/db3/fb9 x:0 0 0 2024-09-10T10:04:15.075 INFO:tasks.workunit.client.1.smithi107.stdout:3/638: rmdir dc/dd5 0 2024-09-10T10:04:15.076 INFO:tasks.workunit.client.1.smithi107.stdout:4/523: symlink d0/d40/d57/d4f/lba 0 2024-09-10T10:04:15.077 INFO:tasks.workunit.client.1.smithi107.stdout:8/315: rmdir d5/d8/dc/d21/d60 0 2024-09-10T10:04:15.078 INFO:tasks.workunit.client.1.smithi107.stdout:3/639: unlink dc/dd/f31 0 2024-09-10T10:04:15.079 INFO:tasks.workunit.client.0.smithi071.stdout:0/262: chown d11/c12 61 1 2024-09-10T10:04:15.079 INFO:tasks.workunit.client.0.smithi071.stdout:5/286: sync 2024-09-10T10:04:15.079 INFO:tasks.workunit.client.0.smithi071.stdout:1/293: sync 2024-09-10T10:04:15.079 INFO:tasks.workunit.client.1.smithi107.stdout:8/316: write d5/d8/dc/d1a/f1f [423596,56254] 0 2024-09-10T10:04:15.080 INFO:tasks.workunit.client.0.smithi071.stdout:5/287: fsync dc/f3c 0 2024-09-10T10:04:15.080 INFO:tasks.workunit.client.0.smithi071.stdout:8/293: fdatasync f3 0 2024-09-10T10:04:15.081 INFO:tasks.workunit.client.0.smithi071.stdout:7/403: write d9/f3e [1408707,67425] 0 2024-09-10T10:04:15.081 INFO:tasks.workunit.client.1.smithi107.stdout:3/640: chown dc/dd/d45/d26/f82 252935090 1 2024-09-10T10:04:15.082 INFO:tasks.workunit.client.1.smithi107.stdout:8/317: chown d5/d8/f13 23584879 1 2024-09-10T10:04:15.082 INFO:tasks.workunit.client.0.smithi071.stdout:8/294: write d5/df/d1e/d38/f42 [814793,28081] 0 2024-09-10T10:04:15.082 INFO:tasks.workunit.client.0.smithi071.stdout:7/404: readlink d9/d2c/l43 0 2024-09-10T10:04:15.083 INFO:tasks.workunit.client.0.smithi071.stdout:8/295: stat d5/df/d16/f29 0 2024-09-10T10:04:15.084 INFO:tasks.workunit.client.0.smithi071.stdout:1/294: unlink d1/f32 0 2024-09-10T10:04:15.086 INFO:tasks.workunit.client.0.smithi071.stdout:5/288: write dc/fd [1465118,1768] 0 2024-09-10T10:04:15.086 INFO:tasks.workunit.client.0.smithi071.stdout:5/289: fdatasync dc/f21 0 2024-09-10T10:04:15.087 INFO:tasks.workunit.client.1.smithi107.stdout:3/641: creat dc/d56/fd7 x:0 0 0 2024-09-10T10:04:15.087 INFO:tasks.workunit.client.1.smithi107.stdout:8/318: mknod d5/d8/dc/d1a/d64/c6c 0 2024-09-10T10:04:15.088 INFO:tasks.workunit.client.1.smithi107.stdout:4/524: dwrite d0/d40/d57/d76/d77/d8d/fab [0,4194304] 0 2024-09-10T10:04:15.089 INFO:tasks.workunit.client.0.smithi071.stdout:8/296: rename d5/d36/d49/f6b to d5/d36/f6d 0 2024-09-10T10:04:15.092 INFO:tasks.workunit.client.1.smithi107.stdout:3/642: truncate dc/dd/d20/d23/d39/d69/f8c 734965 0 2024-09-10T10:04:15.092 INFO:tasks.workunit.client.1.smithi107.stdout:4/525: unlink d0/l22 0 2024-09-10T10:04:15.094 INFO:tasks.workunit.client.0.smithi071.stdout:1/295: creat d1/d3f/d5c/f5d x:0 0 0 2024-09-10T10:04:15.096 INFO:tasks.workunit.client.1.smithi107.stdout:3/643: write dc/dd/d45/d26/d41/d44/fb8 [168356,38441] 0 2024-09-10T10:04:15.097 INFO:tasks.workunit.client.1.smithi107.stdout:8/319: dread d5/d8/d2a/d35/f57 [0,4194304] 0 2024-09-10T10:04:15.098 INFO:tasks.workunit.client.0.smithi071.stdout:0/263: getdents d11 0 2024-09-10T10:04:15.098 INFO:tasks.workunit.client.1.smithi107.stdout:4/526: write d0/d1f/d20/f30 [1368353,110685] 0 2024-09-10T10:04:15.099 INFO:tasks.workunit.client.1.smithi107.stdout:0/356: dwrite d6/f12 [0,4194304] 0 2024-09-10T10:04:15.101 INFO:tasks.workunit.client.0.smithi071.stdout:8/297: chown d5/d30/c4e 1361561 1 2024-09-10T10:04:15.103 INFO:tasks.workunit.client.0.smithi071.stdout:7/405: getdents d9/d15/d40 0 2024-09-10T10:04:15.103 INFO:tasks.workunit.client.1.smithi107.stdout:3/644: mkdir dc/dd/d45/d26/d41/d44/d35/d4a/dd8 0 2024-09-10T10:04:15.104 INFO:tasks.workunit.client.0.smithi071.stdout:8/298: write d5/df/d1e/f37 [1854090,78375] 0 2024-09-10T10:04:15.105 INFO:tasks.workunit.client.1.smithi107.stdout:8/320: creat d5/d8/f6d x:0 0 0 2024-09-10T10:04:15.105 INFO:tasks.workunit.client.1.smithi107.stdout:0/357: creat d6/d8/d2f/d2e/d32/f6c x:0 0 0 2024-09-10T10:04:15.106 INFO:tasks.workunit.client.1.smithi107.stdout:0/358: readlink d6/d8/l1c 0 2024-09-10T10:04:15.109 INFO:tasks.workunit.client.0.smithi071.stdout:0/264: creat d11/d22/f5c x:0 0 0 2024-09-10T10:04:15.109 INFO:tasks.workunit.client.1.smithi107.stdout:3/645: mknod dc/dd/d45/d26/d41/d44/d35/d4a/cd9 0 2024-09-10T10:04:15.111 INFO:tasks.workunit.client.1.smithi107.stdout:8/321: dread d5/d8/d2a/d47/f54 [0,4194304] 0 2024-09-10T10:04:15.112 INFO:tasks.workunit.client.1.smithi107.stdout:4/527: dwrite d0/d1f/d20/f50 [0,4194304] 0 2024-09-10T10:04:15.114 INFO:tasks.workunit.client.0.smithi071.stdout:5/290: truncate dc/f1b 1653432 0 2024-09-10T10:04:15.114 INFO:tasks.workunit.client.0.smithi071.stdout:7/406: creat d9/f8f x:0 0 0 2024-09-10T10:04:15.114 INFO:tasks.workunit.client.1.smithi107.stdout:3/646: truncate dc/dd/d45/d26/d41/fd3 311793 0 2024-09-10T10:04:15.115 INFO:tasks.workunit.client.0.smithi071.stdout:7/407: chown d9/d15/d55 136650 1 2024-09-10T10:04:15.117 INFO:tasks.workunit.client.1.smithi107.stdout:3/647: truncate dc/dd/d45/f77 352914 0 2024-09-10T10:04:15.119 INFO:tasks.workunit.client.0.smithi071.stdout:8/299: link d5/df/d1e/l50 d5/d30/l6e 0 2024-09-10T10:04:15.120 INFO:tasks.workunit.client.0.smithi071.stdout:5/291: mknod dc/df/d29/d48/c66 0 2024-09-10T10:04:15.123 INFO:tasks.workunit.client.0.smithi071.stdout:5/292: mknod dc/d4a/c67 0 2024-09-10T10:04:15.124 INFO:tasks.workunit.client.1.smithi107.stdout:3/648: write dc/dd/d20/d23/d39/fa3 [1144912,48806] 0 2024-09-10T10:04:15.125 INFO:tasks.workunit.client.0.smithi071.stdout:7/408: getdents d9/d2c 0 2024-09-10T10:04:15.126 INFO:tasks.workunit.client.1.smithi107.stdout:8/322: dwrite d5/d8/dc/d18/d4f/f5c [0,4194304] 0 2024-09-10T10:04:15.127 INFO:tasks.workunit.client.1.smithi107.stdout:3/649: stat dc/dd/d45/d26/d59/f67 0 2024-09-10T10:04:15.127 INFO:tasks.workunit.client.0.smithi071.stdout:5/293: mknod dc/c68 0 2024-09-10T10:04:15.128 INFO:tasks.workunit.client.0.smithi071.stdout:5/294: truncate dc/f4b 567836 0 2024-09-10T10:04:15.128 INFO:tasks.workunit.client.1.smithi107.stdout:0/359: truncate d6/d8/d2f/f33 3509138 0 2024-09-10T10:04:15.128 INFO:tasks.workunit.client.1.smithi107.stdout:3/650: dread - dc/fca zero size 2024-09-10T10:04:15.129 INFO:tasks.workunit.client.0.smithi071.stdout:5/295: write dc/df/d17/d22/f2f [2276672,72344] 0 2024-09-10T10:04:15.130 INFO:tasks.workunit.client.0.smithi071.stdout:7/409: creat d9/d15/d40/d80/f90 x:0 0 0 2024-09-10T10:04:15.132 INFO:tasks.workunit.client.0.smithi071.stdout:0/265: write d11/d30/f50 [280434,25641] 0 2024-09-10T10:04:15.132 INFO:tasks.workunit.client.1.smithi107.stdout:8/323: creat d5/d8/d2a/f6e x:0 0 0 2024-09-10T10:04:15.133 INFO:tasks.workunit.client.1.smithi107.stdout:0/360: symlink d6/d8/d3e/d43/l6d 0 2024-09-10T10:04:15.134 INFO:tasks.workunit.client.0.smithi071.stdout:8/300: truncate d5/f19 388791 0 2024-09-10T10:04:15.134 INFO:tasks.workunit.client.1.smithi107.stdout:3/651: mkdir dc/dd/d45/d26/d41/dda 0 2024-09-10T10:04:15.134 INFO:tasks.workunit.client.0.smithi071.stdout:7/410: unlink d9/d76/l77 0 2024-09-10T10:04:15.136 INFO:tasks.workunit.client.1.smithi107.stdout:3/652: write dc/dd/d45/d26/d41/d44/d35/d52/fbb [42481,6531] 0 2024-09-10T10:04:15.136 INFO:tasks.workunit.client.1.smithi107.stdout:0/361: mkdir d6/d8/d2f/d6e 0 2024-09-10T10:04:15.137 INFO:tasks.workunit.client.1.smithi107.stdout:8/324: creat d5/d8/d5b/f6f x:0 0 0 2024-09-10T10:04:15.138 INFO:tasks.workunit.client.1.smithi107.stdout:0/362: chown d6/c1f 1401266 1 2024-09-10T10:04:15.141 INFO:tasks.workunit.client.0.smithi071.stdout:5/296: dwrite dc/df/f33 [0,4194304] 0 2024-09-10T10:04:15.141 INFO:tasks.workunit.client.1.smithi107.stdout:3/653: creat dc/dd/d42/fdb x:0 0 0 2024-09-10T10:04:15.144 INFO:tasks.workunit.client.0.smithi071.stdout:0/266: dwrite d11/d30/d52/f53 [0,4194304] 0 2024-09-10T10:04:15.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:14 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:04:15.149 INFO:tasks.workunit.client.0.smithi071.stdout:8/301: write d5/df/d1e/f21 [1263138,128114] 0 2024-09-10T10:04:15.151 INFO:tasks.workunit.client.0.smithi071.stdout:8/302: read - d5/d36/d49/f4f zero size 2024-09-10T10:04:15.153 INFO:tasks.workunit.client.0.smithi071.stdout:0/267: rename d11/d22/d31/f39 to d11/d30/f5d 0 2024-09-10T10:04:15.156 INFO:tasks.workunit.client.1.smithi107.stdout:8/325: getdents d5/d8/dc 0 2024-09-10T10:04:15.157 INFO:tasks.workunit.client.0.smithi071.stdout:8/303: rename d5/d30/c4e to d5/df/d67/c6f 0 2024-09-10T10:04:15.159 INFO:tasks.workunit.client.1.smithi107.stdout:3/654: chown dc/dd/d45/d26/d41/d44/d35/f4b 31 1 2024-09-10T10:04:15.159 INFO:tasks.workunit.client.0.smithi071.stdout:0/268: creat d11/d30/f5e x:0 0 0 2024-09-10T10:04:15.159 INFO:tasks.workunit.client.0.smithi071.stdout:7/411: dwrite d9/d1a/d1d/f1e [0,4194304] 0 2024-09-10T10:04:15.159 INFO:tasks.workunit.client.1.smithi107.stdout:0/363: dwrite d6/d8/d3e/f50 [0,4194304] 0 2024-09-10T10:04:15.161 INFO:tasks.workunit.client.1.smithi107.stdout:8/326: mkdir d5/d8/d2a/d35/d70 0 2024-09-10T10:04:15.161 INFO:tasks.workunit.client.1.smithi107.stdout:8/327: fdatasync d5/f5a 0 2024-09-10T10:04:15.161 INFO:tasks.workunit.client.0.smithi071.stdout:0/269: mkdir d11/d30/d52/d5f 0 2024-09-10T10:04:15.162 INFO:tasks.workunit.client.1.smithi107.stdout:3/655: creat dc/dd/d20/d23/d39/dac/fdc x:0 0 0 2024-09-10T10:04:15.163 INFO:tasks.workunit.client.0.smithi071.stdout:7/412: mkdir d9/d11/d91 0 2024-09-10T10:04:15.163 INFO:tasks.workunit.client.1.smithi107.stdout:3/656: readlink dc/dd/l30 0 2024-09-10T10:04:15.163 INFO:tasks.workunit.client.1.smithi107.stdout:0/364: mkdir d6/d8/d2f/d2e/d6f 0 2024-09-10T10:04:15.164 INFO:tasks.workunit.client.1.smithi107.stdout:8/328: truncate d5/d8/d2a/d47/f53 5582198 0 2024-09-10T10:04:15.165 INFO:tasks.workunit.client.1.smithi107.stdout:0/365: chown d6/d8/d3e/d43/c49 0 1 2024-09-10T10:04:15.165 INFO:tasks.workunit.client.1.smithi107.stdout:0/366: chown d6/d8/d3e/d43/f4b 4014 1 2024-09-10T10:04:15.166 INFO:tasks.workunit.client.1.smithi107.stdout:8/329: mkdir d5/d8/dc/d1a/d71 0 2024-09-10T10:04:15.167 INFO:tasks.workunit.client.1.smithi107.stdout:0/367: mkdir d6/d8/d2f/d70 0 2024-09-10T10:04:15.171 INFO:tasks.workunit.client.1.smithi107.stdout:3/657: rename dc/dd/d45/d26/d41/d44/f1f to dc/dd/d45/fdd 0 2024-09-10T10:04:15.172 INFO:tasks.workunit.client.1.smithi107.stdout:0/368: write d6/d14/f2d [4542356,38351] 0 2024-09-10T10:04:15.172 INFO:tasks.workunit.client.1.smithi107.stdout:0/369: readlink l5 0 2024-09-10T10:04:15.173 INFO:tasks.workunit.client.1.smithi107.stdout:8/330: rename d5/f5a to d5/d8/dc/d1a/d64/f72 0 2024-09-10T10:04:15.176 INFO:tasks.workunit.client.1.smithi107.stdout:0/370: rmdir d6/d8/d2f/d70 0 2024-09-10T10:04:15.178 INFO:tasks.workunit.client.1.smithi107.stdout:8/331: getdents d5/d8/d66 0 2024-09-10T10:04:15.178 INFO:tasks.workunit.client.1.smithi107.stdout:0/371: fdatasync d6/d14/f40 0 2024-09-10T10:04:15.180 INFO:tasks.workunit.client.1.smithi107.stdout:8/332: creat d5/d8/dc/d21/f73 x:0 0 0 2024-09-10T10:04:15.182 INFO:tasks.workunit.client.1.smithi107.stdout:8/333: write d5/d8/dc/d21/d48/f55 [692078,31750] 0 2024-09-10T10:04:15.194 INFO:tasks.workunit.client.1.smithi107.stdout:3/658: write dc/dd/f4f [853650,66022] 0 2024-09-10T10:04:15.197 INFO:tasks.workunit.client.1.smithi107.stdout:3/659: creat dc/dd/d20/d23/fde x:0 0 0 2024-09-10T10:04:15.199 INFO:tasks.workunit.client.1.smithi107.stdout:8/334: dread d5/fb [0,4194304] 0 2024-09-10T10:04:15.199 INFO:tasks.workunit.client.1.smithi107.stdout:3/660: symlink dc/dd/d42/ldf 0 2024-09-10T10:04:15.200 INFO:tasks.workunit.client.1.smithi107.stdout:0/372: dwrite d6/d8/f15 [0,4194304] 0 2024-09-10T10:04:15.201 INFO:tasks.workunit.client.1.smithi107.stdout:8/335: creat d5/d8/d5b/f74 x:0 0 0 2024-09-10T10:04:15.205 INFO:tasks.workunit.client.1.smithi107.stdout:0/373: rename d6/f12 to d6/d8/d2f/d2e/d32/f71 0 2024-09-10T10:04:15.207 INFO:tasks.workunit.client.1.smithi107.stdout:0/374: write d6/d8/f27 [4574717,130341] 0 2024-09-10T10:04:15.208 INFO:tasks.workunit.client.1.smithi107.stdout:8/336: getdents d5/d8/dc/d1a 0 2024-09-10T10:04:15.208 INFO:tasks.workunit.client.1.smithi107.stdout:3/661: dwrite dc/dd/d20/d23/d39/fa3 [0,4194304] 0 2024-09-10T10:04:15.210 INFO:tasks.workunit.client.1.smithi107.stdout:0/375: stat d6/d8/d2f/d2e/d32/d56/l68 0 2024-09-10T10:04:15.211 INFO:tasks.workunit.client.1.smithi107.stdout:8/337: mkdir d5/d8/dc/d1a/d75 0 2024-09-10T10:04:15.213 INFO:tasks.workunit.client.1.smithi107.stdout:8/338: readlink d5/d8/d2a/l69 0 2024-09-10T10:04:15.215 INFO:tasks.workunit.client.1.smithi107.stdout:0/376: unlink d6/d8/d2f/d2e/f3f 0 2024-09-10T10:04:15.215 INFO:tasks.workunit.client.1.smithi107.stdout:3/662: mkdir dc/dd/d45/d26/d41/d44/d35/d4a/dd8/de0 0 2024-09-10T10:04:15.216 INFO:tasks.workunit.client.1.smithi107.stdout:8/339: creat d5/d8/d5b/f76 x:0 0 0 2024-09-10T10:04:15.219 INFO:tasks.workunit.client.1.smithi107.stdout:3/663: dread dc/dd/d20/d23/d39/f3f [0,4194304] 0 2024-09-10T10:04:15.220 INFO:tasks.workunit.client.1.smithi107.stdout:8/340: mknod d5/d8/d2a/c77 0 2024-09-10T10:04:15.223 INFO:tasks.workunit.client.1.smithi107.stdout:3/664: getdents dc/dd/d42/d55/d58 0 2024-09-10T10:04:15.224 INFO:tasks.workunit.client.1.smithi107.stdout:3/665: write dc/d56/fb0 [6261,28586] 0 2024-09-10T10:04:15.225 INFO:tasks.workunit.client.1.smithi107.stdout:8/341: getdents d5/d8/dc/d21 0 2024-09-10T10:04:15.226 INFO:tasks.workunit.client.1.smithi107.stdout:8/342: write d5/f38 [2513347,89642] 0 2024-09-10T10:04:15.226 INFO:tasks.workunit.client.1.smithi107.stdout:3/666: truncate dc/d56/fd7 1015423 0 2024-09-10T10:04:15.228 INFO:tasks.workunit.client.1.smithi107.stdout:3/667: write dc/dd/d45/d26/d41/f53 [897315,1176] 0 2024-09-10T10:04:15.230 INFO:tasks.workunit.client.1.smithi107.stdout:3/668: mkdir dc/dd/d45/d26/d41/d44/d35/d4a/de1 0 2024-09-10T10:04:15.238 INFO:tasks.workunit.client.1.smithi107.stdout:0/377: truncate d6/f10 2229677 0 2024-09-10T10:04:15.239 INFO:tasks.workunit.client.1.smithi107.stdout:0/378: stat d6/d14/l54 0 2024-09-10T10:04:15.239 INFO:tasks.workunit.client.1.smithi107.stdout:8/343: write d5/fb [1582763,13642] 0 2024-09-10T10:04:15.240 INFO:tasks.workunit.client.1.smithi107.stdout:3/669: write dc/dd/d20/d23/d39/fa3 [4596758,58787] 0 2024-09-10T10:04:15.241 INFO:tasks.workunit.client.0.smithi071.stdout:5/297: write f4 [1985355,21656] 0 2024-09-10T10:04:15.241 INFO:tasks.workunit.client.0.smithi071.stdout:0/270: stat d11/d30/l4d 0 2024-09-10T10:04:15.245 INFO:tasks.workunit.client.1.smithi107.stdout:8/344: mknod d5/c78 0 2024-09-10T10:04:15.245 INFO:tasks.workunit.client.1.smithi107.stdout:3/670: write dc/dd/d20/f60 [239150,116910] 0 2024-09-10T10:04:15.245 INFO:tasks.workunit.client.1.smithi107.stdout:0/379: dread d6/d14/f40 [0,4194304] 0 2024-09-10T10:04:15.245 INFO:tasks.workunit.client.1.smithi107.stdout:3/671: stat dc/dd/d45/d26/d41/d44/d35/d4a/f5c 0 2024-09-10T10:04:15.246 INFO:tasks.workunit.client.0.smithi071.stdout:5/298: fdatasync dc/df/f38 0 2024-09-10T10:04:15.246 INFO:tasks.workunit.client.0.smithi071.stdout:0/271: write d11/d1e/f58 [888628,20817] 0 2024-09-10T10:04:15.246 INFO:tasks.workunit.client.0.smithi071.stdout:4/397: sync 2024-09-10T10:04:15.246 INFO:tasks.workunit.client.0.smithi071.stdout:2/319: sync 2024-09-10T10:04:15.246 INFO:tasks.workunit.client.0.smithi071.stdout:9/528: sync 2024-09-10T10:04:15.246 INFO:tasks.workunit.client.0.smithi071.stdout:6/305: sync 2024-09-10T10:04:15.246 INFO:tasks.workunit.client.0.smithi071.stdout:3/328: sync 2024-09-10T10:04:15.246 INFO:tasks.workunit.client.0.smithi071.stdout:9/529: stat d0/db/d1b/f78 0 2024-09-10T10:04:15.246 INFO:tasks.workunit.client.0.smithi071.stdout:5/299: chown dc/df/f28 484368 1 2024-09-10T10:04:15.247 INFO:tasks.workunit.client.0.smithi071.stdout:2/320: read d8/d13/f1c [107742,53768] 0 2024-09-10T10:04:15.247 INFO:tasks.workunit.client.1.smithi107.stdout:3/672: fdatasync dc/dd/d42/d55/d58/d91/fd0 0 2024-09-10T10:04:15.247 INFO:tasks.workunit.client.1.smithi107.stdout:8/345: creat d5/f79 x:0 0 0 2024-09-10T10:04:15.248 INFO:tasks.workunit.client.0.smithi071.stdout:9/530: chown d0/db/d1b/d1d/d5b/f70 1457400192 1 2024-09-10T10:04:15.248 INFO:tasks.workunit.client.0.smithi071.stdout:6/306: mkdir d4/da/df/d5e 0 2024-09-10T10:04:15.249 INFO:tasks.workunit.client.1.smithi107.stdout:8/346: readlink d5/d8/dc/d18/l27 0 2024-09-10T10:04:15.251 INFO:tasks.workunit.client.1.smithi107.stdout:0/380: dwrite d6/d8/d2f/d2e/d32/f37 [8388608,4194304] 0 2024-09-10T10:04:15.255 INFO:tasks.workunit.client.1.smithi107.stdout:3/673: dread dc/dd/d45/d26/d41/d44/d35/f4b [0,4194304] 0 2024-09-10T10:04:15.255 INFO:tasks.workunit.client.1.smithi107.stdout:0/381: creat d6/d8/f72 x:0 0 0 2024-09-10T10:04:15.257 INFO:tasks.workunit.client.1.smithi107.stdout:0/382: chown d6/d8/c38 10 1 2024-09-10T10:04:15.258 INFO:tasks.workunit.client.0.smithi071.stdout:7/413: link d9/c5e d9/d15/d1f/c92 0 2024-09-10T10:04:15.258 INFO:tasks.workunit.client.1.smithi107.stdout:8/347: dread d5/d8/dc/d21/d48/f55 [0,4194304] 0 2024-09-10T10:04:15.259 INFO:tasks.workunit.client.1.smithi107.stdout:3/674: symlink dc/dd/d45/d26/d41/d44/d35/d4a/dd8/le2 0 2024-09-10T10:04:15.261 INFO:tasks.workunit.client.0.smithi071.stdout:3/329: dwrite d3/f70 [0,4194304] 0 2024-09-10T10:04:15.261 INFO:tasks.workunit.client.0.smithi071.stdout:4/398: getdents db/d15 0 2024-09-10T10:04:15.261 INFO:tasks.workunit.client.1.smithi107.stdout:0/383: creat d6/d8/d2f/d35/d3c/d58/f73 x:0 0 0 2024-09-10T10:04:15.261 INFO:tasks.workunit.client.1.smithi107.stdout:3/675: write dc/dd/d45/d26/d41/fd3 [640339,55484] 0 2024-09-10T10:04:15.261 INFO:tasks.workunit.client.1.smithi107.stdout:8/348: mknod d5/d42/c7a 0 2024-09-10T10:04:15.262 INFO:tasks.workunit.client.1.smithi107.stdout:3/676: dread - dc/dd/d45/d26/d41/d74/f8f zero size 2024-09-10T10:04:15.263 INFO:tasks.workunit.client.1.smithi107.stdout:0/384: read - d6/d8/d2f/d35/d3c/d58/f73 zero size 2024-09-10T10:04:15.264 INFO:tasks.workunit.client.0.smithi071.stdout:2/321: dread d8/f14 [0,4194304] 0 2024-09-10T10:04:15.264 INFO:tasks.workunit.client.0.smithi071.stdout:3/330: readlink d3/d49/d2f/l46 0 2024-09-10T10:04:15.265 INFO:tasks.workunit.client.1.smithi107.stdout:0/385: read d6/d8/f28 [937394,84531] 0 2024-09-10T10:04:15.265 INFO:tasks.workunit.client.1.smithi107.stdout:8/349: mknod d5/d8/dc/d1a/d64/c7b 0 2024-09-10T10:04:15.267 INFO:tasks.workunit.client.1.smithi107.stdout:0/386: creat d6/d8/d2f/d35/d3c/f74 x:0 0 0 2024-09-10T10:04:15.268 INFO:tasks.workunit.client.0.smithi071.stdout:5/300: dwrite dc/df/d17/d22/f35 [0,4194304] 0 2024-09-10T10:04:15.269 INFO:tasks.workunit.client.1.smithi107.stdout:8/350: symlink d5/d8/dc/d21/l7c 0 2024-09-10T10:04:15.271 INFO:tasks.workunit.client.1.smithi107.stdout:0/387: creat d6/d8/d2f/d2e/f75 x:0 0 0 2024-09-10T10:04:15.272 INFO:tasks.workunit.client.0.smithi071.stdout:8/304: dwrite d5/df/d1e/d38/f48 [0,4194304] 0 2024-09-10T10:04:15.272 INFO:tasks.workunit.client.0.smithi071.stdout:6/307: truncate f3 1200027 0 2024-09-10T10:04:15.272 INFO:tasks.workunit.client.1.smithi107.stdout:0/388: chown d6/d8/d2f/d2e/d32/f4c 5944 1 2024-09-10T10:04:15.274 INFO:tasks.workunit.client.0.smithi071.stdout:5/301: truncate dc/df/d17/d22/f45 1146203 0 2024-09-10T10:04:15.274 INFO:tasks.workunit.client.1.smithi107.stdout:0/389: symlink d6/d8/d3e/l76 0 2024-09-10T10:04:15.275 INFO:tasks.workunit.client.0.smithi071.stdout:7/414: getdents d9/d15/d40 0 2024-09-10T10:04:15.275 INFO:tasks.workunit.client.1.smithi107.stdout:0/390: chown d6/d5a 115267 1 2024-09-10T10:04:15.275 INFO:tasks.workunit.client.0.smithi071.stdout:2/322: creat d8/d13/d33/d41/d4d/d52/f64 x:0 0 0 2024-09-10T10:04:15.277 INFO:tasks.workunit.client.0.smithi071.stdout:6/308: symlink d4/da/l5f 0 2024-09-10T10:04:15.277 INFO:tasks.workunit.client.0.smithi071.stdout:5/302: write dc/df/d17/d22/f35 [1823358,96800] 0 2024-09-10T10:04:15.281 INFO:tasks.workunit.client.0.smithi071.stdout:7/415: creat d9/d2c/f93 x:0 0 0 2024-09-10T10:04:15.282 INFO:tasks.workunit.client.0.smithi071.stdout:8/305: mkdir d5/df/d1e/d70 0 2024-09-10T10:04:15.284 INFO:tasks.workunit.client.0.smithi071.stdout:2/323: mkdir d8/d38/d47/d59/d65 0 2024-09-10T10:04:15.286 INFO:tasks.workunit.client.0.smithi071.stdout:4/399: link db/c3a db/d15/d26/d43/d4d/c84 0 2024-09-10T10:04:15.287 INFO:tasks.workunit.client.0.smithi071.stdout:7/416: dread d9/d15/d55/f6e [0,4194304] 0 2024-09-10T10:04:15.287 INFO:tasks.workunit.client.0.smithi071.stdout:2/324: write d8/f28 [1464897,22163] 0 2024-09-10T10:04:15.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:14 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:04:15.289 INFO:tasks.workunit.client.0.smithi071.stdout:5/303: link dc/df/d17/d22/l39 dc/d4a/l69 0 2024-09-10T10:04:15.291 INFO:tasks.workunit.client.0.smithi071.stdout:3/331: dread d3/d10/d24/d2b/f5a [0,4194304] 0 2024-09-10T10:04:15.291 INFO:tasks.workunit.client.0.smithi071.stdout:6/309: dread d4/f28 [0,4194304] 0 2024-09-10T10:04:15.293 INFO:tasks.workunit.client.1.smithi107.stdout:8/351: dwrite d5/d8/dc/d21/f3e [0,4194304] 0 2024-09-10T10:04:15.293 INFO:tasks.workunit.client.0.smithi071.stdout:2/325: unlink d8/d24/c37 0 2024-09-10T10:04:15.294 INFO:tasks.workunit.client.0.smithi071.stdout:5/304: mkdir dc/d53/d6a 0 2024-09-10T10:04:15.296 INFO:tasks.workunit.client.1.smithi107.stdout:0/391: dread d6/f23 [0,4194304] 0 2024-09-10T10:04:15.296 INFO:tasks.workunit.client.0.smithi071.stdout:7/417: rename d9/d76/f3d to d9/d15/d40/d80/f94 0 2024-09-10T10:04:15.296 INFO:tasks.workunit.client.0.smithi071.stdout:8/306: dwrite d5/df/d1e/d38/f42 [0,4194304] 0 2024-09-10T10:04:15.297 INFO:tasks.workunit.client.1.smithi107.stdout:8/352: getdents d5/d8/dc/d1a/d75 0 2024-09-10T10:04:15.298 INFO:tasks.workunit.client.0.smithi071.stdout:8/307: fdatasync d5/f33 0 2024-09-10T10:04:15.303 INFO:tasks.workunit.client.1.smithi107.stdout:8/353: creat d5/d8/dc/d1a/d71/f7d x:0 0 0 2024-09-10T10:04:15.303 INFO:tasks.workunit.client.0.smithi071.stdout:8/308: write d5/df/d1e/f37 [361075,51447] 0 2024-09-10T10:04:15.305 INFO:tasks.workunit.client.0.smithi071.stdout:2/326: mkdir d8/d13/d49/d66 0 2024-09-10T10:04:15.305 INFO:tasks.workunit.client.1.smithi107.stdout:8/354: symlink d5/d8/l7e 0 2024-09-10T10:04:15.305 INFO:tasks.workunit.client.0.smithi071.stdout:8/309: dread - d5/df/d16/f3b zero size 2024-09-10T10:04:15.306 INFO:tasks.workunit.client.1.smithi107.stdout:0/392: getdents d6/d8/d3e/d43 0 2024-09-10T10:04:15.307 INFO:tasks.workunit.client.1.smithi107.stdout:8/355: fdatasync d5/d8/dc/d1a/d71/f7d 0 2024-09-10T10:04:15.307 INFO:tasks.workunit.client.1.smithi107.stdout:0/393: dread - d6/d8/d2f/d2e/d32/f5d zero size 2024-09-10T10:04:15.309 INFO:tasks.workunit.client.1.smithi107.stdout:0/394: readlink d6/d5a/d5c/l64 0 2024-09-10T10:04:15.309 INFO:tasks.workunit.client.0.smithi071.stdout:5/305: dwrite dc/df/f57 [0,4194304] 0 2024-09-10T10:04:15.309 INFO:tasks.workunit.client.0.smithi071.stdout:2/327: mknod d8/d24/c67 0 2024-09-10T10:04:15.309 INFO:tasks.workunit.client.1.smithi107.stdout:8/356: fsync d5/d8/dc/d21/f61 0 2024-09-10T10:04:15.310 INFO:tasks.workunit.client.1.smithi107.stdout:0/395: chown d6/d14/c3d 157 1 2024-09-10T10:04:15.313 INFO:tasks.workunit.client.1.smithi107.stdout:0/396: mknod d6/d8/d2f/d35/d3c/d58/c77 0 2024-09-10T10:04:15.313 INFO:tasks.workunit.client.0.smithi071.stdout:7/418: dread d9/d15/d55/f6e [0,4194304] 0 2024-09-10T10:04:15.315 INFO:tasks.workunit.client.0.smithi071.stdout:5/306: symlink dc/d53/l6b 0 2024-09-10T10:04:15.315 INFO:tasks.workunit.client.1.smithi107.stdout:0/397: mknod d6/d8/d2f/d35/d3c/c78 0 2024-09-10T10:04:15.317 INFO:tasks.workunit.client.0.smithi071.stdout:9/531: dread d0/db/d20/f2b [0,4194304] 0 2024-09-10T10:04:15.319 INFO:tasks.workunit.client.0.smithi071.stdout:3/332: dwrite d3/d1c/f22 [8388608,4194304] 0 2024-09-10T10:04:15.320 INFO:tasks.workunit.client.1.smithi107.stdout:0/398: rmdir d6/d8/d2f/d2e/d32/d66 0 2024-09-10T10:04:15.320 INFO:tasks.workunit.client.1.smithi107.stdout:0/399: fsync d6/d14/f40 0 2024-09-10T10:04:15.321 INFO:tasks.workunit.client.0.smithi071.stdout:7/419: chown d9/d76/d66/c78 6 1 2024-09-10T10:04:15.322 INFO:tasks.workunit.client.0.smithi071.stdout:5/307: symlink dc/df/d29/l6c 0 2024-09-10T10:04:15.322 INFO:tasks.workunit.client.1.smithi107.stdout:0/400: unlink d6/d14/c55 0 2024-09-10T10:04:15.323 INFO:tasks.workunit.client.0.smithi071.stdout:8/310: dwrite d5/df/d16/f3b [0,4194304] 0 2024-09-10T10:04:15.324 INFO:tasks.workunit.client.1.smithi107.stdout:0/401: fsync f4 0 2024-09-10T10:04:15.326 INFO:tasks.workunit.client.1.smithi107.stdout:0/402: write d6/d8/d2f/d35/d3c/f74 [734710,46790] 0 2024-09-10T10:04:15.327 INFO:tasks.workunit.client.0.smithi071.stdout:7/420: creat d9/d15/d40/f95 x:0 0 0 2024-09-10T10:04:15.329 INFO:tasks.workunit.client.0.smithi071.stdout:9/532: creat d0/d3b/d5c/faa x:0 0 0 2024-09-10T10:04:15.331 INFO:tasks.workunit.client.0.smithi071.stdout:5/308: symlink dc/d53/d6a/l6d 0 2024-09-10T10:04:15.332 INFO:tasks.workunit.client.1.smithi107.stdout:0/403: creat d6/d8/d3e/d43/f79 x:0 0 0 2024-09-10T10:04:15.332 INFO:tasks.workunit.client.0.smithi071.stdout:2/328: dwrite d8/d4a/f4b [0,4194304] 0 2024-09-10T10:04:15.332 INFO:tasks.workunit.client.0.smithi071.stdout:8/311: mknod d5/df/d57/c71 0 2024-09-10T10:04:15.333 INFO:tasks.workunit.client.1.smithi107.stdout:8/357: write d5/d8/f13 [2567069,98453] 0 2024-09-10T10:04:15.333 INFO:tasks.workunit.client.0.smithi071.stdout:2/329: chown d8/d38 1 1 2024-09-10T10:04:15.335 INFO:tasks.workunit.client.0.smithi071.stdout:9/533: read d0/db/d20/d3c/f7b [630805,96386] 0 2024-09-10T10:04:15.339 INFO:tasks.workunit.client.0.smithi071.stdout:2/330: rename l6 to d8/d13/d33/d53/l68 0 2024-09-10T10:04:15.341 INFO:tasks.workunit.client.1.smithi107.stdout:8/358: mknod d5/d8/dc/d21/d48/c7f 0 2024-09-10T10:04:15.341 INFO:tasks.workunit.client.0.smithi071.stdout:8/312: getdents d5/df/d1e/d38/d62 0 2024-09-10T10:04:15.342 INFO:tasks.workunit.client.0.smithi071.stdout:2/331: chown d8/d13/d33/f36 11611715 1 2024-09-10T10:04:15.342 INFO:tasks.workunit.client.0.smithi071.stdout:9/534: rename d0/d3b/d72 to d0/db/d1b/d1d/d30/dab 0 2024-09-10T10:04:15.343 INFO:tasks.workunit.client.1.smithi107.stdout:0/404: link d6/f10 d6/d8/d2f/d35/d3c/f7a 0 2024-09-10T10:04:15.343 INFO:tasks.workunit.client.0.smithi071.stdout:5/309: dwrite dc/df/f57 [4194304,4194304] 0 2024-09-10T10:04:15.344 INFO:tasks.workunit.client.1.smithi107.stdout:8/359: symlink d5/d8/dc/d21/l80 0 2024-09-10T10:04:15.345 INFO:tasks.workunit.client.1.smithi107.stdout:0/405: mkdir d6/d8/d2f/d2e/d7b 0 2024-09-10T10:04:15.345 INFO:tasks.workunit.client.0.smithi071.stdout:9/535: write d0/db/d1b/d1d/d30/f65 [368833,23615] 0 2024-09-10T10:04:15.345 INFO:tasks.workunit.client.0.smithi071.stdout:8/313: symlink d5/df/d1e/d38/l72 0 2024-09-10T10:04:15.347 INFO:tasks.workunit.client.1.smithi107.stdout:0/406: symlink d6/l7c 0 2024-09-10T10:04:15.348 INFO:tasks.workunit.client.0.smithi071.stdout:5/310: rename cb to dc/d53/c6e 0 2024-09-10T10:04:15.349 INFO:tasks.workunit.client.0.smithi071.stdout:5/311: stat dc/df/d3e 0 2024-09-10T10:04:15.351 INFO:tasks.workunit.client.1.smithi107.stdout:8/360: dwrite d5/d8/dc/d1a/d71/f7d [0,4194304] 0 2024-09-10T10:04:15.355 INFO:tasks.workunit.client.1.smithi107.stdout:0/407: mknod d6/d14/c7d 0 2024-09-10T10:04:15.357 INFO:tasks.workunit.client.0.smithi071.stdout:2/332: dwrite d8/d13/d51/f54 [0,4194304] 0 2024-09-10T10:04:15.357 INFO:tasks.workunit.client.0.smithi071.stdout:2/333: chown d8/c30 187606664 1 2024-09-10T10:04:15.359 INFO:tasks.workunit.client.1.smithi107.stdout:0/408: rename d6/d14/c7d to d6/d8/d2f/d35/c7e 0 2024-09-10T10:04:15.360 INFO:tasks.workunit.client.0.smithi071.stdout:2/334: mkdir d8/d38/d69 0 2024-09-10T10:04:15.362 INFO:tasks.workunit.client.1.smithi107.stdout:8/361: dwrite d5/d8/dc/d1a/f43 [0,4194304] 0 2024-09-10T10:04:15.366 INFO:tasks.workunit.client.0.smithi071.stdout:2/335: link d8/l12 d8/d38/l6a 0 2024-09-10T10:04:15.366 INFO:tasks.workunit.client.1.smithi107.stdout:0/409: rename d6/d8/d2f/d2e/d32/c3a to d6/d8/d2f/d2e/d32/d56/c7f 0 2024-09-10T10:04:15.368 INFO:tasks.workunit.client.1.smithi107.stdout:8/362: mkdir d5/d8/dc/d81 0 2024-09-10T10:04:15.368 INFO:tasks.workunit.client.1.smithi107.stdout:0/410: creat d6/d8/d2f/d2e/f80 x:0 0 0 2024-09-10T10:04:15.375 INFO:tasks.workunit.client.1.smithi107.stdout:8/363: dread d5/d8/dc/d18/d4f/f5c [0,4194304] 0 2024-09-10T10:04:15.376 INFO:tasks.workunit.client.1.smithi107.stdout:8/364: stat d5/d42 0 2024-09-10T10:04:15.376 INFO:tasks.workunit.client.1.smithi107.stdout:0/411: dwrite d6/d8/d2f/d2e/f80 [0,4194304] 0 2024-09-10T10:04:15.378 INFO:tasks.workunit.client.1.smithi107.stdout:0/412: fsync d6/d8/d2f/d2e/d32/f6c 0 2024-09-10T10:04:15.379 INFO:tasks.workunit.client.1.smithi107.stdout:0/413: chown d6/d8/d2f 196647677 1 2024-09-10T10:04:15.381 INFO:tasks.workunit.client.0.smithi071.stdout:9/536: dread d0/d3b/d5c/f74 [0,4194304] 0 2024-09-10T10:04:15.384 INFO:tasks.workunit.client.0.smithi071.stdout:5/312: dread dc/df/f28 [0,4194304] 0 2024-09-10T10:04:15.385 INFO:tasks.workunit.client.0.smithi071.stdout:9/537: getdents d0/db/d20 0 2024-09-10T10:04:15.387 INFO:tasks.workunit.client.0.smithi071.stdout:5/313: unlink dc/f59 0 2024-09-10T10:04:15.387 INFO:tasks.workunit.client.0.smithi071.stdout:9/538: write d0/db/d1b/d1d/d30/f7d [5170841,103525] 0 2024-09-10T10:04:15.388 INFO:tasks.workunit.client.0.smithi071.stdout:8/314: dread d5/df/d1e/f21 [0,4194304] 0 2024-09-10T10:04:15.390 INFO:tasks.workunit.client.0.smithi071.stdout:9/539: stat d0/db/d1b/d1d/d30/d54/c3f 0 2024-09-10T10:04:15.391 INFO:tasks.workunit.client.0.smithi071.stdout:5/314: rename dc/df/f57 to dc/d4a/d61/f6f 0 2024-09-10T10:04:15.393 INFO:tasks.workunit.client.0.smithi071.stdout:5/315: rmdir dc/d4a 39 2024-09-10T10:04:15.394 INFO:tasks.workunit.client.1.smithi107.stdout:0/414: truncate d6/d8/d2f/d2e/d32/f37 6605730 0 2024-09-10T10:04:15.394 INFO:tasks.workunit.client.0.smithi071.stdout:2/336: write d8/f1a [161045,47623] 0 2024-09-10T10:04:15.395 INFO:tasks.workunit.client.1.smithi107.stdout:0/415: rmdir d6/d5a 39 2024-09-10T10:04:15.397 INFO:tasks.workunit.client.0.smithi071.stdout:5/316: fsync dc/f1b 0 2024-09-10T10:04:15.397 INFO:tasks.workunit.client.1.smithi107.stdout:0/416: symlink d6/d8/d2f/d35/d4f/l81 0 2024-09-10T10:04:15.398 INFO:tasks.workunit.client.0.smithi071.stdout:2/337: write d8/d13/d33/d41/d4d/d52/f64 [374802,127214] 0 2024-09-10T10:04:15.398 INFO:tasks.workunit.client.0.smithi071.stdout:9/540: dwrite d0/db/d1b/d1d/d5b/f70 [0,4194304] 0 2024-09-10T10:04:15.400 INFO:tasks.workunit.client.1.smithi107.stdout:0/417: mknod d6/d8/d2f/d35/d3c/d58/c82 0 2024-09-10T10:04:15.400 INFO:tasks.workunit.client.0.smithi071.stdout:9/541: fsync d0/f87 0 2024-09-10T10:04:15.401 INFO:tasks.workunit.client.1.smithi107.stdout:0/418: write d6/d8/d2f/d35/d3c/f74 [1705158,84729] 0 2024-09-10T10:04:15.402 INFO:tasks.workunit.client.0.smithi071.stdout:9/542: fdatasync d0/db/d1b/d1d/d30/d54/f1a 0 2024-09-10T10:04:15.403 INFO:tasks.workunit.client.0.smithi071.stdout:2/338: rename d8/d13/d33/d41/l46 to d8/d4a/l6b 0 2024-09-10T10:04:15.403 INFO:tasks.workunit.client.1.smithi107.stdout:0/419: symlink d6/d8/d3e/l83 0 2024-09-10T10:04:15.405 INFO:tasks.workunit.client.1.smithi107.stdout:0/420: truncate d6/d8/d3e/d43/f4b 326031 0 2024-09-10T10:04:15.407 INFO:tasks.workunit.client.0.smithi071.stdout:2/339: rename d8/d24/c29 to d8/d13/d33/d41/d4d/d52/c6c 0 2024-09-10T10:04:15.408 INFO:tasks.workunit.client.0.smithi071.stdout:5/317: link dc/c4c dc/d53/d6a/c70 0 2024-09-10T10:04:15.408 INFO:tasks.workunit.client.1.smithi107.stdout:0/421: mkdir d6/d8/d2f/d35/d3c/d58/d69/d84 0 2024-09-10T10:04:15.409 INFO:tasks.workunit.client.0.smithi071.stdout:5/318: fsync dc/df/d17/d22/f45 0 2024-09-10T10:04:15.409 INFO:tasks.workunit.client.0.smithi071.stdout:9/543: creat d0/db/fac x:0 0 0 2024-09-10T10:04:15.410 INFO:tasks.workunit.client.0.smithi071.stdout:2/340: unlink d8/d24/f2e 0 2024-09-10T10:04:15.411 INFO:tasks.workunit.client.0.smithi071.stdout:5/319: creat dc/df/d3e/d5a/f71 x:0 0 0 2024-09-10T10:04:15.412 INFO:tasks.workunit.client.1.smithi107.stdout:0/422: rename d6/d8/d2f/d2e/d6f to d6/d8/d2f/d2e/d32/d85 0 2024-09-10T10:04:15.412 INFO:tasks.workunit.client.0.smithi071.stdout:9/544: rename d0/db/d1b/d46 to d0/db/d1b/d1d/d4b/dad 0 2024-09-10T10:04:15.413 INFO:tasks.workunit.client.0.smithi071.stdout:5/320: symlink dc/d53/l72 0 2024-09-10T10:04:15.414 INFO:tasks.workunit.client.0.smithi071.stdout:2/341: dread d8/d38/d47/d59/f5a [0,4194304] 0 2024-09-10T10:04:15.416 INFO:tasks.workunit.client.1.smithi107.stdout:0/423: getdents d6/d5a 0 2024-09-10T10:04:15.416 INFO:tasks.workunit.client.0.smithi071.stdout:2/342: creat d8/d13/f6d x:0 0 0 2024-09-10T10:04:15.417 INFO:tasks.workunit.client.0.smithi071.stdout:5/321: rename dc/df/l11 to dc/df/d3e/l73 0 2024-09-10T10:04:15.418 INFO:tasks.workunit.client.0.smithi071.stdout:2/343: mknod d8/d13/c6e 0 2024-09-10T10:04:15.418 INFO:tasks.workunit.client.1.smithi107.stdout:0/424: mkdir d6/d8/d2f/d35/d3c/d58/d86 0 2024-09-10T10:04:15.419 INFO:tasks.workunit.client.1.smithi107.stdout:0/425: rmdir d6/d14 39 2024-09-10T10:04:15.419 INFO:tasks.workunit.client.0.smithi071.stdout:5/322: creat dc/d4a/f74 x:0 0 0 2024-09-10T10:04:15.420 INFO:tasks.workunit.client.1.smithi107.stdout:0/426: truncate d6/d8/d3e/f50 4834265 0 2024-09-10T10:04:15.420 INFO:tasks.workunit.client.0.smithi071.stdout:5/323: chown dc/df/d3e/c46 62 1 2024-09-10T10:04:15.421 INFO:tasks.workunit.client.0.smithi071.stdout:5/324: readlink dc/df/d29/l6c 0 2024-09-10T10:04:15.421 INFO:tasks.workunit.client.0.smithi071.stdout:2/344: link d8/d13/f25 d8/d13/d33/d41/d4d/d5e/f6f 0 2024-09-10T10:04:15.423 INFO:tasks.workunit.client.0.smithi071.stdout:5/325: creat dc/df/d3e/d5a/f75 x:0 0 0 2024-09-10T10:04:15.427 INFO:tasks.workunit.client.0.smithi071.stdout:5/326: rename dc/df/d3e/l62 to dc/l76 0 2024-09-10T10:04:15.431 INFO:tasks.workunit.client.1.smithi107.stdout:0/427: dwrite d6/f7 [0,4194304] 0 2024-09-10T10:04:15.433 INFO:tasks.workunit.client.0.smithi071.stdout:5/327: dwrite dc/df/d3e/d5a/f71 [0,4194304] 0 2024-09-10T10:04:15.440 INFO:tasks.workunit.client.0.smithi071.stdout:5/328: dwrite dc/df/f19 [0,4194304] 0 2024-09-10T10:04:15.442 INFO:tasks.workunit.client.0.smithi071.stdout:5/329: rmdir dc/df/d29/d48 39 2024-09-10T10:04:15.485 INFO:tasks.workunit.client.0.smithi071.stdout:1/296: sync 2024-09-10T10:04:15.489 INFO:tasks.workunit.client.0.smithi071.stdout:1/297: readlink d1/d21/l2d 0 2024-09-10T10:04:15.500 INFO:tasks.workunit.client.0.smithi071.stdout:9/545: write d0/db/d1b/d1d/f40 [670398,57429] 0 2024-09-10T10:04:15.501 INFO:tasks.workunit.client.0.smithi071.stdout:5/330: fsync dc/d4a/f74 0 2024-09-10T10:04:15.504 INFO:tasks.workunit.client.0.smithi071.stdout:9/546: creat d0/d3b/d44/fae x:0 0 0 2024-09-10T10:04:15.504 INFO:tasks.workunit.client.0.smithi071.stdout:2/345: truncate d8/f48 437159 0 2024-09-10T10:04:15.505 INFO:tasks.workunit.client.0.smithi071.stdout:9/547: write d0/d3b/f86 [157421,46119] 0 2024-09-10T10:04:15.512 INFO:tasks.workunit.client.0.smithi071.stdout:9/548: dwrite d0/db/d1b/d1d/f40 [0,4194304] 0 2024-09-10T10:04:15.515 INFO:tasks.workunit.client.0.smithi071.stdout:2/346: write d8/fb [98228,66613] 0 2024-09-10T10:04:15.516 INFO:tasks.workunit.client.0.smithi071.stdout:9/549: unlink d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f59 0 2024-09-10T10:04:15.518 INFO:tasks.workunit.client.0.smithi071.stdout:2/347: creat d8/d38/f70 x:0 0 0 2024-09-10T10:04:15.519 INFO:tasks.workunit.client.0.smithi071.stdout:2/348: chown d8/ff 5908 1 2024-09-10T10:04:15.520 INFO:tasks.workunit.client.0.smithi071.stdout:2/349: write d8/d4a/f55 [318053,118038] 0 2024-09-10T10:04:15.520 INFO:tasks.workunit.client.0.smithi071.stdout:1/298: dwrite d1/fd [0,4194304] 0 2024-09-10T10:04:15.525 INFO:tasks.workunit.client.0.smithi071.stdout:1/299: read d1/f40 [224345,13833] 0 2024-09-10T10:04:15.527 INFO:tasks.workunit.client.0.smithi071.stdout:2/350: unlink d8/ff 0 2024-09-10T10:04:15.533 INFO:tasks.workunit.client.0.smithi071.stdout:1/300: getdents d1/d3f/d5c 0 2024-09-10T10:04:15.539 INFO:tasks.workunit.client.0.smithi071.stdout:9/550: dread d0/db/d1b/d1d/d30/f7d [0,4194304] 0 2024-09-10T10:04:15.542 INFO:tasks.workunit.client.0.smithi071.stdout:9/551: truncate d0/db/d20/d21/fa5 113774 0 2024-09-10T10:04:15.543 INFO:tasks.workunit.client.0.smithi071.stdout:9/552: stat d0/db/d1b/d1d/d30/d54/d27 0 2024-09-10T10:04:15.546 INFO:tasks.workunit.client.0.smithi071.stdout:1/301: dwrite d1/f9 [0,4194304] 0 2024-09-10T10:04:15.548 INFO:tasks.workunit.client.0.smithi071.stdout:1/302: rmdir d1 39 2024-09-10T10:04:15.550 INFO:tasks.workunit.client.0.smithi071.stdout:1/303: fsync d1/f40 0 2024-09-10T10:04:15.556 INFO:tasks.workunit.client.0.smithi071.stdout:1/304: link d1/d21/d42/c56 d1/d21/d2f/c5e 0 2024-09-10T10:04:15.559 INFO:tasks.workunit.client.0.smithi071.stdout:1/305: fsync d1/d57/f52 0 2024-09-10T10:04:15.560 INFO:tasks.workunit.client.0.smithi071.stdout:1/306: creat d1/d57/f5f x:0 0 0 2024-09-10T10:04:15.565 INFO:tasks.workunit.client.0.smithi071.stdout:1/307: truncate d1/d3f/f43 2900978 0 2024-09-10T10:04:15.566 INFO:tasks.workunit.client.0.smithi071.stdout:1/308: stat d1/l1c 0 2024-09-10T10:04:15.567 INFO:tasks.workunit.client.0.smithi071.stdout:1/309: mknod d1/d21/c60 0 2024-09-10T10:04:15.568 INFO:tasks.workunit.client.0.smithi071.stdout:1/310: getdents d1/d3f/d5c 0 2024-09-10T10:04:15.570 INFO:tasks.workunit.client.0.smithi071.stdout:1/311: creat d1/d21/f61 x:0 0 0 2024-09-10T10:04:15.571 INFO:tasks.workunit.client.0.smithi071.stdout:1/312: chown d1/d21/d2f/d30/f55 171097 1 2024-09-10T10:04:15.572 INFO:tasks.workunit.client.0.smithi071.stdout:1/313: mknod d1/d21/d3d/d4a/c62 0 2024-09-10T10:04:15.573 INFO:tasks.workunit.client.0.smithi071.stdout:1/314: write d1/f37 [1750674,26258] 0 2024-09-10T10:04:15.576 INFO:tasks.workunit.client.0.smithi071.stdout:1/315: unlink d1/d21/d2f/c41 0 2024-09-10T10:04:15.589 INFO:tasks.workunit.client.0.smithi071.stdout:1/316: dread d1/d21/d2f/d30/f33 [0,4194304] 0 2024-09-10T10:04:15.590 INFO:tasks.workunit.client.0.smithi071.stdout:1/317: write d1/f9 [220608,3839] 0 2024-09-10T10:04:15.593 INFO:tasks.workunit.client.0.smithi071.stdout:1/318: creat d1/d21/f63 x:0 0 0 2024-09-10T10:04:15.599 INFO:tasks.workunit.client.0.smithi071.stdout:1/319: dwrite d1/d21/d3d/f4f [0,4194304] 0 2024-09-10T10:04:15.604 INFO:tasks.workunit.client.0.smithi071.stdout:1/320: write d1/d21/f4d [1540841,119639] 0 2024-09-10T10:04:15.607 INFO:tasks.workunit.client.0.smithi071.stdout:1/321: mknod d1/d1e/c64 0 2024-09-10T10:04:15.615 INFO:tasks.workunit.client.0.smithi071.stdout:1/322: rename d1/d1e to d1/d21/d65 0 2024-09-10T10:04:15.620 INFO:tasks.workunit.client.0.smithi071.stdout:1/323: dwrite d1/f19 [0,4194304] 0 2024-09-10T10:04:15.626 INFO:tasks.workunit.client.0.smithi071.stdout:1/324: dwrite d1/d21/f28 [0,4194304] 0 2024-09-10T10:04:15.628 INFO:tasks.workunit.client.0.smithi071.stdout:1/325: chown d1/l2b 3 1 2024-09-10T10:04:15.630 INFO:tasks.workunit.client.0.smithi071.stdout:1/326: write d1/d21/d2f/d30/f33 [406785,100153] 0 2024-09-10T10:04:15.632 INFO:tasks.workunit.client.0.smithi071.stdout:1/327: chown d1/l13 62418377 1 2024-09-10T10:04:15.634 INFO:tasks.workunit.client.0.smithi071.stdout:1/328: symlink d1/l66 0 2024-09-10T10:04:15.646 INFO:tasks.workunit.client.0.smithi071.stdout:1/329: dwrite d1/d21/d2f/f39 [0,4194304] 0 2024-09-10T10:04:15.646 INFO:tasks.workunit.client.0.smithi071.stdout:1/330: fsync d1/f37 0 2024-09-10T10:04:15.682 INFO:tasks.workunit.client.0.smithi071.stdout:0/272: sync 2024-09-10T10:04:15.687 INFO:tasks.workunit.client.0.smithi071.stdout:0/273: dwrite d11/f14 [0,4194304] 0 2024-09-10T10:04:15.695 INFO:tasks.workunit.client.1.smithi107.stdout:1/458: sync 2024-09-10T10:04:15.695 INFO:tasks.workunit.client.1.smithi107.stdout:6/421: sync 2024-09-10T10:04:15.695 INFO:tasks.workunit.client.1.smithi107.stdout:2/437: sync 2024-09-10T10:04:15.697 INFO:tasks.workunit.client.1.smithi107.stdout:2/438: getdents d3/d8f 0 2024-09-10T10:04:15.698 INFO:tasks.workunit.client.1.smithi107.stdout:1/459: link d2/d12/d71/f75 d2/d35/d7b/f8f 0 2024-09-10T10:04:15.699 INFO:tasks.workunit.client.1.smithi107.stdout:6/422: rename d0/d3d/d14/d17/d49/d55/l6a to d0/d3d/d14/d17/d49/d55/d73/l8f 0 2024-09-10T10:04:15.700 INFO:tasks.workunit.client.1.smithi107.stdout:2/439: mknod d3/da/d1e/d40/d8a/d7f/d55/c9c 0 2024-09-10T10:04:15.701 INFO:tasks.workunit.client.1.smithi107.stdout:1/460: truncate d2/f32 783539 0 2024-09-10T10:04:15.702 INFO:tasks.workunit.client.1.smithi107.stdout:1/461: chown d2/d36/f78 528098811 1 2024-09-10T10:04:15.702 INFO:tasks.workunit.client.0.smithi071.stdout:0/274: dread d11/d1e/f2d [0,4194304] 0 2024-09-10T10:04:15.702 INFO:tasks.workunit.client.0.smithi071.stdout:0/275: write d11/d22/d31/f4c [273702,75674] 0 2024-09-10T10:04:15.703 INFO:tasks.workunit.client.1.smithi107.stdout:2/440: creat d3/da/d1e/d40/d8a/d7f/d55/d85/f9d x:0 0 0 2024-09-10T10:04:15.704 INFO:tasks.workunit.client.1.smithi107.stdout:2/441: chown f0 111875386 1 2024-09-10T10:04:15.706 INFO:tasks.workunit.client.0.smithi071.stdout:0/276: rename d11/d22/c57 to d11/d22/d40/c60 0 2024-09-10T10:04:15.707 INFO:tasks.workunit.client.0.smithi071.stdout:0/277: mknod d11/d22/d40/c61 0 2024-09-10T10:04:15.708 INFO:tasks.workunit.client.1.smithi107.stdout:2/442: creat d3/da/d66/d91/f9e x:0 0 0 2024-09-10T10:04:15.708 INFO:tasks.workunit.client.0.smithi071.stdout:0/278: chown l4 1 1 2024-09-10T10:04:15.708 INFO:tasks.workunit.client.1.smithi107.stdout:1/462: dwrite d2/d12/d65/d6b/f42 [0,4194304] 0 2024-09-10T10:04:15.709 INFO:tasks.workunit.client.0.smithi071.stdout:0/279: mknod d11/d30/d52/c62 0 2024-09-10T10:04:15.713 INFO:tasks.workunit.client.0.smithi071.stdout:0/280: rename d11/c32 to d11/d30/d52/c63 0 2024-09-10T10:04:15.713 INFO:tasks.workunit.client.1.smithi107.stdout:6/423: truncate d0/f2c 6874530 0 2024-09-10T10:04:15.713 INFO:tasks.workunit.client.1.smithi107.stdout:2/443: read d3/f18 [425991,9175] 0 2024-09-10T10:04:15.714 INFO:tasks.workunit.client.1.smithi107.stdout:1/463: read d2/f6a [272860,20472] 0 2024-09-10T10:04:15.717 INFO:tasks.workunit.client.1.smithi107.stdout:6/424: creat d0/d3d/d14/d17/d49/f90 x:0 0 0 2024-09-10T10:04:15.721 INFO:tasks.workunit.client.1.smithi107.stdout:6/425: mkdir d0/d3d/d14/d17/d49/d91 0 2024-09-10T10:04:15.722 INFO:tasks.workunit.client.1.smithi107.stdout:1/464: dwrite d2/d12/f31 [0,4194304] 0 2024-09-10T10:04:15.725 INFO:tasks.workunit.client.0.smithi071.stdout:0/281: creat d11/d22/d31/f64 x:0 0 0 2024-09-10T10:04:15.731 INFO:tasks.workunit.client.1.smithi107.stdout:2/444: dwrite d3/da/df/d20/f57 [0,4194304] 0 2024-09-10T10:04:15.733 INFO:tasks.workunit.client.1.smithi107.stdout:2/445: fsync d3/da/f17 0 2024-09-10T10:04:15.737 INFO:tasks.workunit.client.1.smithi107.stdout:2/446: creat d3/da/d1e/d40/f9f x:0 0 0 2024-09-10T10:04:15.740 INFO:tasks.workunit.client.1.smithi107.stdout:1/465: dwrite d2/d12/d71/f75 [0,4194304] 0 2024-09-10T10:04:15.741 INFO:tasks.workunit.client.1.smithi107.stdout:6/426: dwrite d0/f3e [0,4194304] 0 2024-09-10T10:04:15.743 INFO:tasks.workunit.client.1.smithi107.stdout:1/466: write d2/d35/f3b [3457108,74412] 0 2024-09-10T10:04:15.746 INFO:tasks.workunit.client.1.smithi107.stdout:2/447: rename d3/da/d66/ld to d3/da/d1e/d40/d8a/d7f/la0 0 2024-09-10T10:04:15.746 INFO:tasks.workunit.client.1.smithi107.stdout:6/427: creat d0/d3d/d14/d17/d49/f92 x:0 0 0 2024-09-10T10:04:15.746 INFO:tasks.workunit.client.1.smithi107.stdout:1/467: mknod d2/d35/c90 0 2024-09-10T10:04:15.748 INFO:tasks.workunit.client.1.smithi107.stdout:1/468: fsync d2/d36/f4d 0 2024-09-10T10:04:15.752 INFO:tasks.workunit.client.1.smithi107.stdout:6/428: rename d0/d3d/d14/d21/f22 to d0/d3d/d14/d17/d49/d55/d73/f93 0 2024-09-10T10:04:15.754 INFO:tasks.workunit.client.1.smithi107.stdout:6/429: write d0/f19 [5222621,72501] 0 2024-09-10T10:04:15.755 INFO:tasks.workunit.client.1.smithi107.stdout:1/469: dwrite d2/d12/d65/d6b/f42 [0,4194304] 0 2024-09-10T10:04:15.761 INFO:tasks.workunit.client.1.smithi107.stdout:6/430: rename d0/d3d/c57 to d0/d3d/d14/d17/d49/c94 0 2024-09-10T10:04:15.765 INFO:tasks.workunit.client.1.smithi107.stdout:6/431: link d0/d3d/d14/d21/f5f d0/d70/f95 0 2024-09-10T10:04:15.766 INFO:tasks.workunit.client.1.smithi107.stdout:2/448: dread d3/d21/f3a [0,4194304] 0 2024-09-10T10:04:15.766 INFO:tasks.workunit.client.1.smithi107.stdout:6/432: write d0/d76/f80 [1349083,21226] 0 2024-09-10T10:04:15.767 INFO:tasks.workunit.client.1.smithi107.stdout:2/449: stat d3/da/d1e/d5f/f34 0 2024-09-10T10:04:15.767 INFO:tasks.workunit.client.1.smithi107.stdout:2/450: readlink d3/da/d66/l6a 0 2024-09-10T10:04:15.768 INFO:tasks.workunit.client.1.smithi107.stdout:2/451: readlink d3/da/df/d20/d36/l81 0 2024-09-10T10:04:15.769 INFO:tasks.workunit.client.1.smithi107.stdout:2/452: stat d3/da/d66/d91/f9e 0 2024-09-10T10:04:15.770 INFO:tasks.workunit.client.1.smithi107.stdout:2/453: write d3/da/d1e/d27/f2e [11777004,76544] 0 2024-09-10T10:04:15.774 INFO:tasks.workunit.client.1.smithi107.stdout:6/433: dwrite d0/d3d/d14/d17/d49/d55/d73/f77 [0,4194304] 0 2024-09-10T10:04:15.780 INFO:tasks.workunit.client.1.smithi107.stdout:6/434: fsync d0/d3d/d14/d21/f43 0 2024-09-10T10:04:15.782 INFO:tasks.workunit.client.1.smithi107.stdout:1/470: write d2/d12/f1a [649083,123624] 0 2024-09-10T10:04:15.783 INFO:tasks.workunit.client.1.smithi107.stdout:1/471: dread - d2/d12/d5a/f7a zero size 2024-09-10T10:04:15.785 INFO:tasks.workunit.client.1.smithi107.stdout:1/472: unlink d2/d12/c51 0 2024-09-10T10:04:15.786 INFO:tasks.workunit.client.1.smithi107.stdout:1/473: mknod d2/c91 0 2024-09-10T10:04:15.790 INFO:tasks.workunit.client.1.smithi107.stdout:2/454: dwrite d3/f6c [0,4194304] 0 2024-09-10T10:04:15.791 INFO:tasks.workunit.client.1.smithi107.stdout:2/455: mknod d3/da/d1e/d5f/d54/ca1 0 2024-09-10T10:04:15.793 INFO:tasks.workunit.client.1.smithi107.stdout:2/456: stat d3/da/df/d78 0 2024-09-10T10:04:15.794 INFO:tasks.workunit.client.1.smithi107.stdout:2/457: chown d3/da/d1e/d5f/d54/ca1 196 1 2024-09-10T10:04:15.828 INFO:tasks.workunit.client.0.smithi071.stdout:4/400: sync 2024-09-10T10:04:15.834 INFO:tasks.workunit.client.0.smithi071.stdout:4/401: truncate db/d15/d17/d24/f2b 2537900 0 2024-09-10T10:04:15.835 INFO:tasks.workunit.client.0.smithi071.stdout:4/402: stat db/d15/d17/d24/f49 0 2024-09-10T10:04:15.835 INFO:tasks.workunit.client.0.smithi071.stdout:4/403: fsync db/f1b 0 2024-09-10T10:04:15.849 INFO:tasks.workunit.client.0.smithi071.stdout:4/404: dread db/d15/d26/d43/f66 [0,4194304] 0 2024-09-10T10:04:15.852 INFO:tasks.workunit.client.0.smithi071.stdout:4/405: link db/d15/d17/f60 db/d15/f85 0 2024-09-10T10:04:15.853 INFO:tasks.workunit.client.0.smithi071.stdout:4/406: mkdir db/d86 0 2024-09-10T10:04:15.854 INFO:tasks.workunit.client.0.smithi071.stdout:4/407: creat db/d1d/d61/f87 x:0 0 0 2024-09-10T10:04:15.861 INFO:tasks.workunit.client.0.smithi071.stdout:4/408: chown db/d15/d26/d43/d4d/c67 0 1 2024-09-10T10:04:15.866 INFO:tasks.workunit.client.0.smithi071.stdout:4/409: dwrite db/d15/d26/d43/f50 [0,4194304] 0 2024-09-10T10:04:15.868 INFO:tasks.workunit.client.1.smithi107.stdout:2/458: dwrite d3/f3d [4194304,4194304] 0 2024-09-10T10:04:15.870 INFO:tasks.workunit.client.0.smithi071.stdout:4/410: truncate db/d15/f85 918870 0 2024-09-10T10:04:15.871 INFO:tasks.workunit.client.1.smithi107.stdout:6/435: dread d0/d3d/d14/d17/f36 [4194304,4194304] 0 2024-09-10T10:04:15.875 INFO:tasks.workunit.client.1.smithi107.stdout:2/459: dwrite d3/d21/d79/f7e [4194304,4194304] 0 2024-09-10T10:04:15.878 INFO:tasks.workunit.client.1.smithi107.stdout:6/436: link d0/d3d/d14/d42/d88/f85 d0/d3d/d14/d17/f96 0 2024-09-10T10:04:15.879 INFO:tasks.workunit.client.1.smithi107.stdout:2/460: mknod d3/da/d1e/d27/d5b/ca2 0 2024-09-10T10:04:15.881 INFO:tasks.workunit.client.0.smithi071.stdout:6/310: sync 2024-09-10T10:04:15.881 INFO:tasks.workunit.client.0.smithi071.stdout:0/282: sync 2024-09-10T10:04:15.881 INFO:tasks.workunit.client.0.smithi071.stdout:0/283: stat f2 0 2024-09-10T10:04:15.882 INFO:tasks.workunit.client.1.smithi107.stdout:6/437: creat d0/d3d/d14/d42/d88/f97 x:0 0 0 2024-09-10T10:04:15.882 INFO:tasks.workunit.client.0.smithi071.stdout:0/284: rename d11 to d11/d22/d31/d65 22 2024-09-10T10:04:15.884 INFO:tasks.workunit.client.0.smithi071.stdout:6/311: mkdir d4/da/df/d2e/d3a/d40/d60 0 2024-09-10T10:04:15.884 INFO:tasks.workunit.client.0.smithi071.stdout:6/312: readlink d4/d1c/l36 0 2024-09-10T10:04:15.885 INFO:tasks.workunit.client.0.smithi071.stdout:0/285: mknod d11/d30/d52/c66 0 2024-09-10T10:04:15.886 INFO:tasks.workunit.client.0.smithi071.stdout:6/313: mkdir d4/d61 0 2024-09-10T10:04:15.888 INFO:tasks.workunit.client.1.smithi107.stdout:6/438: dwrite d0/d3d/d14/d42/d88/f97 [0,4194304] 0 2024-09-10T10:04:15.888 INFO:tasks.workunit.client.0.smithi071.stdout:6/314: stat d4/d1c/c41 0 2024-09-10T10:04:15.890 INFO:tasks.workunit.client.1.smithi107.stdout:6/439: chown d0/d3d/d14/d17/d49/d55/d56/l6d 3874618 1 2024-09-10T10:04:15.890 INFO:tasks.workunit.client.0.smithi071.stdout:0/286: rename d11/d30/f4b to d11/d30/d52/d5f/f67 0 2024-09-10T10:04:15.891 INFO:tasks.workunit.client.0.smithi071.stdout:6/315: chown d4/da/df/f2c 189455439 1 2024-09-10T10:04:15.892 INFO:tasks.workunit.client.1.smithi107.stdout:6/440: chown d0/d3d/d14/f58 200301713 1 2024-09-10T10:04:15.892 INFO:tasks.workunit.client.1.smithi107.stdout:6/441: chown d0/d3d/d14/d17/d49/d55/d56 186787 1 2024-09-10T10:04:15.892 INFO:tasks.workunit.client.0.smithi071.stdout:0/287: stat d11/d22/d40/c60 0 2024-09-10T10:04:15.892 INFO:tasks.workunit.client.0.smithi071.stdout:6/316: stat d4/d20/c4e 0 2024-09-10T10:04:15.894 INFO:tasks.workunit.client.1.smithi107.stdout:6/442: dread d0/d3d/d14/d21/d83/f86 [0,4194304] 0 2024-09-10T10:04:15.896 INFO:tasks.workunit.client.1.smithi107.stdout:6/443: dread d0/d3d/d14/d17/d49/d55/d56/f84 [0,4194304] 0 2024-09-10T10:04:15.900 INFO:tasks.workunit.client.0.smithi071.stdout:0/288: dwrite f0 [4194304,4194304] 0 2024-09-10T10:04:15.900 INFO:tasks.workunit.client.0.smithi071.stdout:0/289: readlink d11/d22/l55 0 2024-09-10T10:04:15.901 INFO:tasks.workunit.client.1.smithi107.stdout:6/444: dwrite d0/f13 [0,4194304] 0 2024-09-10T10:04:15.906 INFO:tasks.workunit.client.0.smithi071.stdout:9/553: sync 2024-09-10T10:04:15.906 INFO:tasks.workunit.client.0.smithi071.stdout:7/421: sync 2024-09-10T10:04:15.907 INFO:tasks.workunit.client.0.smithi071.stdout:5/331: sync 2024-09-10T10:04:15.907 INFO:tasks.workunit.client.0.smithi071.stdout:2/351: sync 2024-09-10T10:04:15.907 INFO:tasks.workunit.client.0.smithi071.stdout:1/331: sync 2024-09-10T10:04:15.907 INFO:tasks.workunit.client.0.smithi071.stdout:3/333: sync 2024-09-10T10:04:15.907 INFO:tasks.workunit.client.0.smithi071.stdout:8/315: sync 2024-09-10T10:04:15.907 INFO:tasks.workunit.client.1.smithi107.stdout:6/445: symlink d0/d3d/d14/d21/d8a/d8d/l98 0 2024-09-10T10:04:15.909 INFO:tasks.workunit.client.0.smithi071.stdout:8/316: chown d5/df/d1d 0 1 2024-09-10T10:04:15.911 INFO:tasks.workunit.client.0.smithi071.stdout:7/422: creat d9/d76/f96 x:0 0 0 2024-09-10T10:04:15.912 INFO:tasks.workunit.client.1.smithi107.stdout:6/446: getdents d0/d3d/d14/d17/d49/d55/d73 0 2024-09-10T10:04:15.913 INFO:tasks.workunit.client.0.smithi071.stdout:5/332: dread dc/f31 [0,4194304] 0 2024-09-10T10:04:15.914 INFO:tasks.workunit.client.0.smithi071.stdout:3/334: write d3/d20/d30/d3a/f45 [316768,103416] 0 2024-09-10T10:04:15.914 INFO:tasks.workunit.client.0.smithi071.stdout:2/352: symlink d8/d38/d47/d59/l71 0 2024-09-10T10:04:15.915 INFO:tasks.workunit.client.1.smithi107.stdout:6/447: creat d0/d3d/d14/d17/f99 x:0 0 0 2024-09-10T10:04:15.915 INFO:tasks.workunit.client.0.smithi071.stdout:0/290: dread d11/d1e/f58 [0,4194304] 0 2024-09-10T10:04:15.915 INFO:tasks.workunit.client.0.smithi071.stdout:4/411: dread db/d15/d26/d43/f44 [0,4194304] 0 2024-09-10T10:04:15.916 INFO:tasks.workunit.client.0.smithi071.stdout:9/554: creat d0/db/d1b/d1d/d30/faf x:0 0 0 2024-09-10T10:04:15.917 INFO:tasks.workunit.client.0.smithi071.stdout:2/353: chown d8/d24/f61 6051 1 2024-09-10T10:04:15.918 INFO:tasks.workunit.client.0.smithi071.stdout:4/412: fdatasync db/d1d/f36 0 2024-09-10T10:04:15.919 INFO:tasks.workunit.client.1.smithi107.stdout:6/448: getdents d0/d3d/d14/d17/d49 0 2024-09-10T10:04:15.919 INFO:tasks.workunit.client.0.smithi071.stdout:9/555: readlink d0/db/d1b/d1d/d5b/d60/l62 0 2024-09-10T10:04:15.920 INFO:tasks.workunit.client.0.smithi071.stdout:1/332: link d1/d57/f5f d1/d21/f67 0 2024-09-10T10:04:15.921 INFO:tasks.workunit.client.0.smithi071.stdout:1/333: readlink d1/l13 0 2024-09-10T10:04:15.921 INFO:tasks.workunit.client.0.smithi071.stdout:0/291: creat d11/d22/d40/f68 x:0 0 0 2024-09-10T10:04:15.923 INFO:tasks.workunit.client.1.smithi107.stdout:6/449: rename d0/f45 to d0/d3d/d14/d17/f9a 0 2024-09-10T10:04:15.923 INFO:tasks.workunit.client.0.smithi071.stdout:9/556: write d0/d3b/d5c/d6a/f99 [740015,102755] 0 2024-09-10T10:04:15.924 INFO:tasks.workunit.client.0.smithi071.stdout:0/292: dread - d11/d22/d40/f4a zero size 2024-09-10T10:04:15.925 INFO:tasks.workunit.client.0.smithi071.stdout:3/335: rename d3/d10/d24/d2b/f4e to d3/d49/d34/f75 0 2024-09-10T10:04:15.926 INFO:tasks.workunit.client.0.smithi071.stdout:2/354: dread d8/d13/d33/d41/d4d/d5e/f6f [0,4194304] 0 2024-09-10T10:04:15.928 INFO:tasks.workunit.client.0.smithi071.stdout:4/413: mkdir db/d1d/d61/d6a/d88 0 2024-09-10T10:04:15.928 INFO:tasks.workunit.client.0.smithi071.stdout:1/334: truncate d1/d3f/d5c/f5d 305109 0 2024-09-10T10:04:15.928 INFO:tasks.workunit.client.1.smithi107.stdout:6/450: link d0/d3d/d14/l32 d0/d3d/d14/d21/d8a/d8d/l9b 0 2024-09-10T10:04:15.929 INFO:tasks.workunit.client.0.smithi071.stdout:6/317: dread d4/da/df/f2c [0,4194304] 0 2024-09-10T10:04:15.932 INFO:tasks.workunit.client.0.smithi071.stdout:3/336: mkdir d3/d49/d2f/d76 0 2024-09-10T10:04:15.932 INFO:tasks.workunit.client.0.smithi071.stdout:5/333: truncate dc/df/f1e 611297 0 2024-09-10T10:04:15.933 INFO:tasks.workunit.client.0.smithi071.stdout:0/293: mknod d11/d30/d52/c69 0 2024-09-10T10:04:15.934 INFO:tasks.workunit.client.0.smithi071.stdout:7/423: dwrite d9/d15/d40/f7a [0,4194304] 0 2024-09-10T10:04:15.934 INFO:tasks.workunit.client.0.smithi071.stdout:1/335: creat d1/d3f/f68 x:0 0 0 2024-09-10T10:04:15.934 INFO:tasks.workunit.client.0.smithi071.stdout:4/414: creat db/d15/d26/d43/d82/f89 x:0 0 0 2024-09-10T10:04:15.936 INFO:tasks.workunit.client.1.smithi107.stdout:6/451: dwrite d0/d3d/d14/d17/d49/f5a [0,4194304] 0 2024-09-10T10:04:15.937 INFO:tasks.workunit.client.0.smithi071.stdout:6/318: mknod d4/da/df/d2e/d3a/d3e/d45/c62 0 2024-09-10T10:04:15.937 INFO:tasks.workunit.client.0.smithi071.stdout:0/294: chown ce 7878 1 2024-09-10T10:04:15.938 INFO:tasks.workunit.client.0.smithi071.stdout:9/557: creat d0/db/d20/d3c/fb0 x:0 0 0 2024-09-10T10:04:15.943 INFO:tasks.workunit.client.0.smithi071.stdout:9/558: dread - d0/db/d1b/d1d/d30/faf zero size 2024-09-10T10:04:15.944 INFO:tasks.workunit.client.0.smithi071.stdout:2/355: dwrite d8/d24/f61 [0,4194304] 0 2024-09-10T10:04:15.948 INFO:tasks.workunit.client.0.smithi071.stdout:7/424: dread d9/d2c/d49/f62 [0,4194304] 0 2024-09-10T10:04:15.948 INFO:tasks.workunit.client.1.smithi107.stdout:6/452: rename d0/d3d/d14/d17/c51 to d0/c9c 0 2024-09-10T10:04:15.949 INFO:tasks.workunit.client.0.smithi071.stdout:1/336: creat d1/d21/d42/f69 x:0 0 0 2024-09-10T10:04:15.950 INFO:tasks.workunit.client.0.smithi071.stdout:6/319: creat d4/da/df/f63 x:0 0 0 2024-09-10T10:04:15.951 INFO:tasks.workunit.client.0.smithi071.stdout:8/317: dread d5/df/d16/f17 [0,4194304] 0 2024-09-10T10:04:15.951 INFO:tasks.workunit.client.1.smithi107.stdout:6/453: symlink d0/d76/l9d 0 2024-09-10T10:04:15.952 INFO:tasks.workunit.client.0.smithi071.stdout:3/337: mkdir d3/d1c/d3e/d77 0 2024-09-10T10:04:15.952 INFO:tasks.workunit.client.0.smithi071.stdout:0/295: chown d11/l19 767395135 1 2024-09-10T10:04:15.955 INFO:tasks.workunit.client.0.smithi071.stdout:1/337: write d1/d3f/d5c/f5d [45194,29621] 0 2024-09-10T10:04:15.955 INFO:tasks.workunit.client.0.smithi071.stdout:3/338: write d3/d20/f6d [940904,77910] 0 2024-09-10T10:04:15.955 INFO:tasks.workunit.client.0.smithi071.stdout:2/356: chown d8/d13/d33/l3e 356689433 1 2024-09-10T10:04:15.956 INFO:tasks.workunit.client.0.smithi071.stdout:4/415: dwrite db/d15/d26/f63 [0,4194304] 0 2024-09-10T10:04:15.961 INFO:tasks.workunit.client.0.smithi071.stdout:9/559: link d0/d3b/f3e d0/fb1 0 2024-09-10T10:04:15.961 INFO:tasks.workunit.client.0.smithi071.stdout:2/357: write d8/f1a [1037049,9647] 0 2024-09-10T10:04:15.963 INFO:tasks.workunit.client.0.smithi071.stdout:9/560: chown d0/d3b/d5c/d6a/l6d 1012 1 2024-09-10T10:04:15.963 INFO:tasks.workunit.client.0.smithi071.stdout:6/320: mkdir d4/da/df/d2e/d3a/d51/d64 0 2024-09-10T10:04:15.966 INFO:tasks.workunit.client.0.smithi071.stdout:3/339: dwrite d3/fd [4194304,4194304] 0 2024-09-10T10:04:15.967 INFO:tasks.workunit.client.0.smithi071.stdout:4/416: fdatasync db/d15/f85 0 2024-09-10T10:04:15.971 INFO:tasks.workunit.client.0.smithi071.stdout:9/561: rmdir d0/db/d1b/d1d/d30/d54/d27/d6e/d8a 39 2024-09-10T10:04:15.974 INFO:tasks.workunit.client.1.smithi107.stdout:6/454: truncate d0/d3d/d14/d17/f47 1840344 0 2024-09-10T10:04:15.975 INFO:tasks.workunit.client.0.smithi071.stdout:4/417: chown db/d15/d17/d4e/d5a 676 1 2024-09-10T10:04:15.975 INFO:tasks.workunit.client.1.smithi107.stdout:6/455: chown d0/d3d/l2e 7306635 1 2024-09-10T10:04:15.976 INFO:tasks.workunit.client.0.smithi071.stdout:8/318: dread d5/f28 [0,4194304] 0 2024-09-10T10:04:15.976 INFO:tasks.workunit.client.0.smithi071.stdout:1/338: rename d1/d21/d42 to d1/d21/d2f/d30/d6a 0 2024-09-10T10:04:15.976 INFO:tasks.workunit.client.1.smithi107.stdout:6/456: dread - d0/d3d/d14/d17/d49/f90 zero size 2024-09-10T10:04:15.977 INFO:tasks.workunit.client.0.smithi071.stdout:6/321: dwrite d4/da/df/f53 [0,4194304] 0 2024-09-10T10:04:15.977 INFO:tasks.workunit.client.0.smithi071.stdout:3/340: mkdir d3/d20/d30/d42/d4a/d60/d78 0 2024-09-10T10:04:15.977 INFO:tasks.workunit.client.1.smithi107.stdout:6/457: truncate d0/d76/f7b 290036 0 2024-09-10T10:04:15.978 INFO:tasks.workunit.client.1.smithi107.stdout:6/458: readlink d0/d3d/d14/d17/l66 0 2024-09-10T10:04:15.981 INFO:tasks.workunit.client.0.smithi071.stdout:4/418: dread - db/d15/d26/d43/d4d/f78 zero size 2024-09-10T10:04:15.982 INFO:tasks.workunit.client.0.smithi071.stdout:5/334: dwrite dc/f31 [0,4194304] 0 2024-09-10T10:04:15.983 INFO:tasks.workunit.client.0.smithi071.stdout:6/322: write d4/f38 [749857,115940] 0 2024-09-10T10:04:15.983 INFO:tasks.workunit.client.0.smithi071.stdout:1/339: creat d1/d57/f6b x:0 0 0 2024-09-10T10:04:15.986 INFO:tasks.workunit.client.0.smithi071.stdout:2/358: dread d8/f48 [0,4194304] 0 2024-09-10T10:04:15.987 INFO:tasks.workunit.client.1.smithi107.stdout:6/459: dwrite d0/d3d/d14/f1f [0,4194304] 0 2024-09-10T10:04:15.987 INFO:tasks.workunit.client.0.smithi071.stdout:4/419: readlink db/d15/d26/d43/d4d/l80 0 2024-09-10T10:04:15.989 INFO:tasks.workunit.client.0.smithi071.stdout:5/335: symlink dc/df/d17/d22/l77 0 2024-09-10T10:04:15.992 INFO:tasks.workunit.client.1.smithi107.stdout:6/460: creat d0/d3d/d14/f9e x:0 0 0 2024-09-10T10:04:15.994 INFO:tasks.workunit.client.1.smithi107.stdout:6/461: write d0/d3d/d14/d17/d24/f6f [882773,28601] 0 2024-09-10T10:04:15.996 INFO:tasks.workunit.client.0.smithi071.stdout:9/562: dwrite d0/db/d1b/d1d/d30/f7d [0,4194304] 0 2024-09-10T10:04:15.999 INFO:tasks.workunit.client.0.smithi071.stdout:0/296: dwrite f2 [4194304,4194304] 0 2024-09-10T10:04:16.000 INFO:tasks.workunit.client.0.smithi071.stdout:3/341: dwrite d3/d1c/d3c/f69 [0,4194304] 0 2024-09-10T10:04:16.000 INFO:tasks.workunit.client.0.smithi071.stdout:1/340: unlink d1/c3a 0 2024-09-10T10:04:16.003 INFO:tasks.workunit.client.0.smithi071.stdout:0/297: dread - d11/d22/d40/f68 zero size 2024-09-10T10:04:16.006 INFO:tasks.workunit.client.0.smithi071.stdout:6/323: dwrite d4/da/df/f53 [0,4194304] 0 2024-09-10T10:04:16.006 INFO:tasks.workunit.client.0.smithi071.stdout:4/420: creat db/d15/d17/d24/f8a x:0 0 0 2024-09-10T10:04:16.007 INFO:tasks.workunit.client.0.smithi071.stdout:3/342: truncate d3/d20/d30/d3a/f68 544261 0 2024-09-10T10:04:16.009 INFO:tasks.workunit.client.0.smithi071.stdout:5/336: mknod dc/c78 0 2024-09-10T10:04:16.011 INFO:tasks.workunit.client.0.smithi071.stdout:3/343: write d3/d20/f6d [1646039,126740] 0 2024-09-10T10:04:16.011 INFO:tasks.workunit.client.0.smithi071.stdout:6/324: write d4/f19 [4530800,63376] 0 2024-09-10T10:04:16.012 INFO:tasks.workunit.client.0.smithi071.stdout:9/563: fdatasync d0/db/d20/d3c/f64 0 2024-09-10T10:04:16.014 INFO:tasks.workunit.client.0.smithi071.stdout:1/341: symlink d1/d21/d2f/l6c 0 2024-09-10T10:04:16.014 INFO:tasks.workunit.client.0.smithi071.stdout:2/359: link d8/d38/c3a d8/d13/d49/c72 0 2024-09-10T10:04:16.014 INFO:tasks.workunit.client.0.smithi071.stdout:0/298: write d11/f14 [2667672,116517] 0 2024-09-10T10:04:16.016 INFO:tasks.workunit.client.0.smithi071.stdout:4/421: creat db/d86/f8b x:0 0 0 2024-09-10T10:04:16.016 INFO:tasks.workunit.client.0.smithi071.stdout:9/564: chown d0/d3b/f3e 2829820 1 2024-09-10T10:04:16.016 INFO:tasks.workunit.client.0.smithi071.stdout:6/325: fsync d4/da/df/d2e/f32 0 2024-09-10T10:04:16.017 INFO:tasks.workunit.client.0.smithi071.stdout:3/344: creat d3/d1c/f79 x:0 0 0 2024-09-10T10:04:16.019 INFO:tasks.workunit.client.0.smithi071.stdout:2/360: mknod d8/d13/d51/c73 0 2024-09-10T10:04:16.020 INFO:tasks.workunit.client.0.smithi071.stdout:2/361: read d8/d13/f2b [235511,3957] 0 2024-09-10T10:04:16.020 INFO:tasks.workunit.client.0.smithi071.stdout:8/319: dread d5/f45 [0,4194304] 0 2024-09-10T10:04:16.021 INFO:tasks.workunit.client.0.smithi071.stdout:2/362: write f2 [8287018,35444] 0 2024-09-10T10:04:16.021 INFO:tasks.workunit.client.0.smithi071.stdout:4/422: creat db/d15/d26/d43/d82/f8c x:0 0 0 2024-09-10T10:04:16.022 INFO:tasks.workunit.client.0.smithi071.stdout:3/345: mkdir d3/d20/d30/d5d/d7a 0 2024-09-10T10:04:16.022 INFO:tasks.workunit.client.0.smithi071.stdout:8/320: write d5/df/d1e/d38/f42 [1580511,125400] 0 2024-09-10T10:04:16.024 INFO:tasks.workunit.client.0.smithi071.stdout:4/423: chown db/c3a 352687641 1 2024-09-10T10:04:16.026 INFO:tasks.workunit.client.0.smithi071.stdout:3/346: rename d3/d20/d30/d42/d4a to d3/d20/d30/d42/d4a/d60/d7b 22 2024-09-10T10:04:16.027 INFO:tasks.workunit.client.0.smithi071.stdout:8/321: unlink d5/df/d1e/d38/f68 0 2024-09-10T10:04:16.028 INFO:tasks.workunit.client.0.smithi071.stdout:9/565: getdents d0/d3b/d5c/d6a 0 2024-09-10T10:04:16.028 INFO:tasks.workunit.client.0.smithi071.stdout:3/347: creat d3/d1c/f7c x:0 0 0 2024-09-10T10:04:16.029 INFO:tasks.workunit.client.0.smithi071.stdout:2/363: dwrite d8/d38/f57 [0,4194304] 0 2024-09-10T10:04:16.032 INFO:tasks.workunit.client.0.smithi071.stdout:2/364: chown d8/d13/d33/d41 25794 1 2024-09-10T10:04:16.032 INFO:tasks.workunit.client.0.smithi071.stdout:9/566: mknod d0/d3b/d5c/d6a/cb2 0 2024-09-10T10:04:16.032 INFO:tasks.workunit.client.1.smithi107.stdout:9/418: sync 2024-09-10T10:04:16.034 INFO:tasks.workunit.client.0.smithi071.stdout:9/567: chown d0/db/d1b/d1d/d30/d54/d27/d6e/f9a 13898 1 2024-09-10T10:04:16.035 INFO:tasks.workunit.client.0.smithi071.stdout:9/568: fdatasync d0/f2e 0 2024-09-10T10:04:16.036 INFO:tasks.workunit.client.0.smithi071.stdout:2/365: fdatasync d8/d13/f25 0 2024-09-10T10:04:16.040 INFO:tasks.workunit.client.0.smithi071.stdout:2/366: symlink d8/d13/l74 0 2024-09-10T10:04:16.041 INFO:tasks.workunit.client.0.smithi071.stdout:9/569: creat d0/db/d1b/d1d/d4b/fb3 x:0 0 0 2024-09-10T10:04:16.046 INFO:tasks.workunit.client.0.smithi071.stdout:2/367: link d8/d24/l3f d8/d13/d49/l75 0 2024-09-10T10:04:16.047 INFO:tasks.workunit.client.0.smithi071.stdout:9/570: getdents d0/db/d1b/d1d/d30 0 2024-09-10T10:04:16.048 INFO:tasks.workunit.client.0.smithi071.stdout:5/337: truncate dc/df/d3e/d5a/f71 3763870 0 2024-09-10T10:04:16.048 INFO:tasks.workunit.client.0.smithi071.stdout:9/571: readlink d0/d3b/d5c/d6a/l6d 0 2024-09-10T10:04:16.048 INFO:tasks.workunit.client.0.smithi071.stdout:2/368: creat d8/d13/f76 x:0 0 0 2024-09-10T10:04:16.050 INFO:tasks.workunit.client.0.smithi071.stdout:5/338: chown dc/df/d29/d48/c66 486960 1 2024-09-10T10:04:16.050 INFO:tasks.workunit.client.0.smithi071.stdout:9/572: mkdir d0/db/d1b/db4 0 2024-09-10T10:04:16.052 INFO:tasks.workunit.client.0.smithi071.stdout:5/339: chown dc/d4a/l69 240504 1 2024-09-10T10:04:16.052 INFO:tasks.workunit.client.0.smithi071.stdout:0/299: truncate d11/d22/d40/f44 1019123 0 2024-09-10T10:04:16.053 INFO:tasks.workunit.client.0.smithi071.stdout:5/340: chown dc/df/d29/d48/c66 13564917 1 2024-09-10T10:04:16.053 INFO:tasks.workunit.client.0.smithi071.stdout:0/300: read - d11/d30/f45 zero size 2024-09-10T10:04:16.053 INFO:tasks.workunit.client.0.smithi071.stdout:2/369: mknod d8/d13/d33/c77 0 2024-09-10T10:04:16.054 INFO:tasks.workunit.client.0.smithi071.stdout:6/326: truncate d4/f19 765447 0 2024-09-10T10:04:16.054 INFO:tasks.workunit.client.0.smithi071.stdout:6/327: dread - d4/da/df/f63 zero size 2024-09-10T10:04:16.055 INFO:tasks.workunit.client.0.smithi071.stdout:9/573: creat d0/db/d1b/d1d/d4b/fb5 x:0 0 0 2024-09-10T10:04:16.055 INFO:tasks.workunit.client.0.smithi071.stdout:6/328: fsync d4/d1c/f4b 0 2024-09-10T10:04:16.056 INFO:tasks.workunit.client.0.smithi071.stdout:6/329: stat d4/d20/c22 0 2024-09-10T10:04:16.056 INFO:tasks.workunit.client.0.smithi071.stdout:5/341: mkdir dc/d53/d79 0 2024-09-10T10:04:16.056 INFO:tasks.workunit.client.0.smithi071.stdout:5/342: chown dc/df/d3e/d5a 5890902 1 2024-09-10T10:04:16.057 INFO:tasks.workunit.client.0.smithi071.stdout:0/301: mknod d11/d30/d52/d5f/c6a 0 2024-09-10T10:04:16.058 INFO:tasks.workunit.client.0.smithi071.stdout:5/343: write dc/df/d29/f5f [3809784,46501] 0 2024-09-10T10:04:16.059 INFO:tasks.workunit.client.0.smithi071.stdout:3/348: truncate d3/fa 556918 0 2024-09-10T10:04:16.060 INFO:tasks.workunit.client.0.smithi071.stdout:9/574: fsync d0/d3b/d5c/f74 0 2024-09-10T10:04:16.061 INFO:tasks.workunit.client.0.smithi071.stdout:6/330: rename d4/da/l5f to d4/da/df/d2e/d3a/d43/l65 0 2024-09-10T10:04:16.062 INFO:tasks.workunit.client.0.smithi071.stdout:0/302: dread d11/d30/f3c [0,4194304] 0 2024-09-10T10:04:16.064 INFO:tasks.workunit.client.0.smithi071.stdout:0/303: stat d11/d30/l36 0 2024-09-10T10:04:16.064 INFO:tasks.workunit.client.0.smithi071.stdout:8/322: dwrite d5/d30/f3c [0,4194304] 0 2024-09-10T10:04:16.067 INFO:tasks.workunit.client.0.smithi071.stdout:9/575: symlink d0/db/d1b/lb6 0 2024-09-10T10:04:16.068 INFO:tasks.workunit.client.0.smithi071.stdout:9/576: dread - d0/db/d1b/d1d/d30/d54/d27/d6e/f88 zero size 2024-09-10T10:04:16.069 INFO:tasks.workunit.client.0.smithi071.stdout:6/331: creat d4/da/df/d2e/d3a/f66 x:0 0 0 2024-09-10T10:04:16.070 INFO:tasks.workunit.client.0.smithi071.stdout:6/332: dread - d4/d1c/f4b zero size 2024-09-10T10:04:16.070 INFO:tasks.workunit.client.0.smithi071.stdout:9/577: dread d0/d3b/f86 [0,4194304] 0 2024-09-10T10:04:16.074 INFO:tasks.workunit.client.0.smithi071.stdout:8/323: rmdir d5/df/d1e/d38 39 2024-09-10T10:04:16.075 INFO:tasks.workunit.client.1.smithi107.stdout:3/677: sync 2024-09-10T10:04:16.075 INFO:tasks.workunit.client.1.smithi107.stdout:0/428: sync 2024-09-10T10:04:16.076 INFO:tasks.workunit.client.1.smithi107.stdout:8/365: sync 2024-09-10T10:04:16.076 INFO:tasks.workunit.client.1.smithi107.stdout:1/474: sync 2024-09-10T10:04:16.076 INFO:tasks.workunit.client.1.smithi107.stdout:2/461: sync 2024-09-10T10:04:16.076 INFO:tasks.workunit.client.1.smithi107.stdout:7/345: sync 2024-09-10T10:04:16.076 INFO:tasks.workunit.client.1.smithi107.stdout:4/528: sync 2024-09-10T10:04:16.076 INFO:tasks.workunit.client.1.smithi107.stdout:5/481: sync 2024-09-10T10:04:16.076 INFO:tasks.workunit.client.0.smithi071.stdout:0/304: creat d11/d30/d52/d5f/f6b x:0 0 0 2024-09-10T10:04:16.077 INFO:tasks.workunit.client.0.smithi071.stdout:0/305: chown d11/d22/d40/f68 90 1 2024-09-10T10:04:16.078 INFO:tasks.workunit.client.1.smithi107.stdout:6/462: dwrite d0/d3d/d14/d17/d24/d60/f6b [0,4194304] 0 2024-09-10T10:04:16.078 INFO:tasks.workunit.client.0.smithi071.stdout:6/333: mknod d4/da/df/c67 0 2024-09-10T10:04:16.081 INFO:tasks.workunit.client.0.smithi071.stdout:9/578: mknod d0/db/d1b/d1d/cb7 0 2024-09-10T10:04:16.082 INFO:tasks.workunit.client.1.smithi107.stdout:7/346: readlink d0/d8/d56/l62 0 2024-09-10T10:04:16.082 INFO:tasks.workunit.client.1.smithi107.stdout:1/475: chown d2/d12/d5a/f62 0 1 2024-09-10T10:04:16.082 INFO:tasks.workunit.client.1.smithi107.stdout:3/678: chown dc/l51 29353877 1 2024-09-10T10:04:16.082 INFO:tasks.workunit.client.1.smithi107.stdout:9/419: dwrite d5/d7/d3c/d53/d57/d87/d37/f63 [0,4194304] 0 2024-09-10T10:04:16.082 INFO:tasks.workunit.client.0.smithi071.stdout:9/579: readlink d0/db/l4a 0 2024-09-10T10:04:16.087 INFO:tasks.workunit.client.1.smithi107.stdout:2/462: mkdir d3/da/df/d20/d36/d39/da3 0 2024-09-10T10:04:16.088 INFO:tasks.workunit.client.0.smithi071.stdout:2/370: truncate d8/d24/f61 2399719 0 2024-09-10T10:04:16.089 INFO:tasks.workunit.client.0.smithi071.stdout:9/580: mknod d0/db/d1b/d1d/d5b/cb8 0 2024-09-10T10:04:16.090 INFO:tasks.workunit.client.0.smithi071.stdout:2/371: write d8/d13/d33/d41/d4d/d52/f64 [606088,78370] 0 2024-09-10T10:04:16.091 INFO:tasks.workunit.client.1.smithi107.stdout:6/463: fsync d0/d70/f95 0 2024-09-10T10:04:16.092 INFO:tasks.workunit.client.1.smithi107.stdout:8/366: chown d5/d8/dc/d21/f56 4045000 1 2024-09-10T10:04:16.092 INFO:tasks.workunit.client.1.smithi107.stdout:4/529: mkdir d0/d40/d6d/d8a/dbb 0 2024-09-10T10:04:16.092 INFO:tasks.workunit.client.1.smithi107.stdout:3/679: write dc/dd/d20/d23/d39/d69/f8c [921871,509] 0 2024-09-10T10:04:16.092 INFO:tasks.workunit.client.0.smithi071.stdout:0/306: rename d11/l2f to d11/d30/l6c 0 2024-09-10T10:04:16.094 INFO:tasks.workunit.client.1.smithi107.stdout:2/463: creat d3/da/d1e/d27/fa4 x:0 0 0 2024-09-10T10:04:16.094 INFO:tasks.workunit.client.1.smithi107.stdout:9/420: fsync d5/d7/d1d/d41/f70 0 2024-09-10T10:04:16.095 INFO:tasks.workunit.client.1.smithi107.stdout:8/367: chown d5/d8/dc/d1a 18131601 1 2024-09-10T10:04:16.096 INFO:tasks.workunit.client.1.smithi107.stdout:1/476: rename d2/d12/d65/f72 to d2/d6/d67/f92 0 2024-09-10T10:04:16.096 INFO:tasks.workunit.client.0.smithi071.stdout:9/581: mkdir d0/db/d1b/d1d/d4b/db9 0 2024-09-10T10:04:16.100 INFO:tasks.workunit.client.1.smithi107.stdout:5/482: write de/f25 [1832273,87917] 0 2024-09-10T10:04:16.100 INFO:tasks.workunit.client.1.smithi107.stdout:3/680: symlink dc/dd/d42/le3 0 2024-09-10T10:04:16.100 INFO:tasks.workunit.client.0.smithi071.stdout:2/372: symlink d8/d13/d33/d41/d4d/d5e/l78 0 2024-09-10T10:04:16.100 INFO:tasks.workunit.client.1.smithi107.stdout:8/368: mknod d5/d8/d2a/c82 0 2024-09-10T10:04:16.101 INFO:tasks.workunit.client.1.smithi107.stdout:6/464: write d0/d3d/d14/d17/d49/f5a [2915787,129411] 0 2024-09-10T10:04:16.103 INFO:tasks.workunit.client.1.smithi107.stdout:9/421: mknod d5/d7/d1d/d95/c96 0 2024-09-10T10:04:16.106 INFO:tasks.workunit.client.1.smithi107.stdout:1/477: creat d2/f93 x:0 0 0 2024-09-10T10:04:16.107 INFO:tasks.workunit.client.0.smithi071.stdout:2/373: rename d8/d13/d33/d41/d4d/d52/f64 to d8/d38/d47/d59/d65/f79 0 2024-09-10T10:04:16.107 INFO:tasks.workunit.client.1.smithi107.stdout:3/681: creat dc/dd/d42/d55/d58/d91/fe4 x:0 0 0 2024-09-10T10:04:16.108 INFO:tasks.workunit.client.1.smithi107.stdout:2/464: rename d3/da/df/f45 to d3/da/df/d20/d36/d39/fa5 0 2024-09-10T10:04:16.108 INFO:tasks.workunit.client.1.smithi107.stdout:8/369: truncate d5/d8/f6d 505769 0 2024-09-10T10:04:16.108 INFO:tasks.workunit.client.0.smithi071.stdout:8/324: dread d5/fa [0,4194304] 0 2024-09-10T10:04:16.115 INFO:tasks.workunit.client.1.smithi107.stdout:1/478: mkdir d2/d12/d94 0 2024-09-10T10:04:16.117 INFO:tasks.workunit.client.1.smithi107.stdout:4/530: link d0/d40/d57/d76/d77/d8d/c9a d0/d1f/d20/d80/cbc 0 2024-09-10T10:04:16.117 INFO:tasks.workunit.client.0.smithi071.stdout:6/334: dwrite d4/da/df/d2e/f3b [0,4194304] 0 2024-09-10T10:04:16.119 INFO:tasks.workunit.client.0.smithi071.stdout:2/374: rmdir d8/d38/d69 0 2024-09-10T10:04:16.119 INFO:tasks.workunit.client.1.smithi107.stdout:0/429: dwrite d6/f23 [0,4194304] 0 2024-09-10T10:04:16.119 INFO:tasks.workunit.client.1.smithi107.stdout:1/479: chown d2/c17 1 1 2024-09-10T10:04:16.120 INFO:tasks.workunit.client.0.smithi071.stdout:0/307: readlink d11/d22/d31/l3e 0 2024-09-10T10:04:16.120 INFO:tasks.workunit.client.1.smithi107.stdout:5/483: dread de/d4a/d5c/d6d/f96 [4194304,4194304] 0 2024-09-10T10:04:16.120 INFO:tasks.workunit.client.0.smithi071.stdout:2/375: chown d8/d24/f5c 5178 1 2024-09-10T10:04:16.121 INFO:tasks.workunit.client.1.smithi107.stdout:2/465: mkdir d3/d8f/da6 0 2024-09-10T10:04:16.121 INFO:tasks.workunit.client.0.smithi071.stdout:0/308: stat d11/d22/d40/c61 0 2024-09-10T10:04:16.121 INFO:tasks.workunit.client.0.smithi071.stdout:2/376: write d8/d24/f2d [1301820,68539] 0 2024-09-10T10:04:16.125 INFO:tasks.workunit.client.0.smithi071.stdout:8/325: rename f3 to d5/f73 0 2024-09-10T10:04:16.126 INFO:tasks.workunit.client.0.smithi071.stdout:6/335: creat d4/da/df/d2e/d3a/f68 x:0 0 0 2024-09-10T10:04:16.129 INFO:tasks.workunit.client.0.smithi071.stdout:2/377: dwrite d8/fb [0,4194304] 0 2024-09-10T10:04:16.130 INFO:tasks.workunit.client.1.smithi107.stdout:6/465: dwrite d0/d3d/d14/d42/d88/f97 [0,4194304] 0 2024-09-10T10:04:16.133 INFO:tasks.workunit.client.1.smithi107.stdout:9/422: unlink d5/d7/d3c/d53/d57/d87/d50/f32 0 2024-09-10T10:04:16.135 INFO:tasks.workunit.client.1.smithi107.stdout:7/347: dread d0/d8/f31 [0,4194304] 0 2024-09-10T10:04:16.135 INFO:tasks.workunit.client.0.smithi071.stdout:2/378: rename d8/d13/f2b to d8/d13/f7a 0 2024-09-10T10:04:16.136 INFO:tasks.workunit.client.0.smithi071.stdout:6/336: creat d4/d61/f69 x:0 0 0 2024-09-10T10:04:16.136 INFO:tasks.workunit.client.0.smithi071.stdout:2/379: write d8/fb [1563289,2851] 0 2024-09-10T10:04:16.137 INFO:tasks.workunit.client.1.smithi107.stdout:6/466: chown d0/d3d/d14/d21/f5f 414563 1 2024-09-10T10:04:16.138 INFO:tasks.workunit.client.0.smithi071.stdout:2/380: chown d8/l31 5001 1 2024-09-10T10:04:16.138 INFO:tasks.workunit.client.0.smithi071.stdout:6/337: write d4/f38 [1908268,76862] 0 2024-09-10T10:04:16.138 INFO:tasks.workunit.client.1.smithi107.stdout:6/467: stat d0/d3d/l2e 0 2024-09-10T10:04:16.139 INFO:tasks.workunit.client.0.smithi071.stdout:8/326: mkdir d5/df/d74 0 2024-09-10T10:04:16.139 INFO:tasks.workunit.client.0.smithi071.stdout:2/381: chown d8/d13/d49 358 1 2024-09-10T10:04:16.140 INFO:tasks.workunit.client.1.smithi107.stdout:6/468: write d0/d3d/f64 [127417,114850] 0 2024-09-10T10:04:16.141 INFO:tasks.workunit.client.1.smithi107.stdout:6/469: dread - d0/d3d/d14/d17/d4b/f6e zero size 2024-09-10T10:04:16.143 INFO:tasks.workunit.client.0.smithi071.stdout:2/382: readlink d8/d38/l6a 0 2024-09-10T10:04:16.145 INFO:tasks.workunit.client.0.smithi071.stdout:8/327: mkdir d5/df/d16/d75 0 2024-09-10T10:04:16.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:15 smithi107 ceph-mon[34215]: pgmap v258: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 32 MiB/s rd, 184 MiB/s wr, 439 op/s 2024-09-10T10:04:16.145 INFO:tasks.workunit.client.0.smithi071.stdout:8/328: readlink d5/l55 0 2024-09-10T10:04:16.146 INFO:tasks.workunit.client.0.smithi071.stdout:6/338: creat d4/da/df/d2e/d3a/d43/f6a x:0 0 0 2024-09-10T10:04:16.147 INFO:tasks.workunit.client.0.smithi071.stdout:0/309: dread d11/d22/d40/f44 [0,4194304] 0 2024-09-10T10:04:16.147 INFO:tasks.workunit.client.0.smithi071.stdout:2/383: write d8/d38/d47/d59/d65/f79 [487332,72767] 0 2024-09-10T10:04:16.148 INFO:tasks.workunit.client.1.smithi107.stdout:9/423: mkdir d5/d7/d1d/d41/d97 0 2024-09-10T10:04:16.148 INFO:tasks.workunit.client.0.smithi071.stdout:8/329: symlink d5/df/d67/l76 0 2024-09-10T10:04:16.148 INFO:tasks.workunit.client.0.smithi071.stdout:6/339: fdatasync d4/da/df/d2e/f32 0 2024-09-10T10:04:16.149 INFO:tasks.workunit.client.1.smithi107.stdout:2/466: write d3/da/d1e/f3f [29197,84767] 0 2024-09-10T10:04:16.150 INFO:tasks.workunit.client.0.smithi071.stdout:6/340: stat d4/d61/f69 0 2024-09-10T10:04:16.150 INFO:tasks.workunit.client.0.smithi071.stdout:2/384: truncate d8/d13/d33/f36 334267 0 2024-09-10T10:04:16.151 INFO:tasks.workunit.client.0.smithi071.stdout:0/310: chown d11/f14 61492 1 2024-09-10T10:04:16.153 INFO:tasks.workunit.client.1.smithi107.stdout:0/430: creat d6/d8/d2f/d35/d3c/d58/d86/f87 x:0 0 0 2024-09-10T10:04:16.153 INFO:tasks.workunit.client.1.smithi107.stdout:8/370: dwrite d5/d8/f20 [0,4194304] 0 2024-09-10T10:04:16.153 INFO:tasks.workunit.client.1.smithi107.stdout:4/531: creat d0/d40/d75/fbd x:0 0 0 2024-09-10T10:04:16.154 INFO:tasks.workunit.client.1.smithi107.stdout:9/424: dread - d5/d7/d3c/d53/d57/f7a zero size 2024-09-10T10:04:16.154 INFO:tasks.workunit.client.0.smithi071.stdout:2/385: creat d8/d38/d47/d59/f7b x:0 0 0 2024-09-10T10:04:16.157 INFO:tasks.workunit.client.1.smithi107.stdout:2/467: chown d3/da/d1e/d5f/d54/c99 0 1 2024-09-10T10:04:16.157 INFO:tasks.workunit.client.0.smithi071.stdout:2/386: mkdir d8/d24/d7c 0 2024-09-10T10:04:16.157 INFO:tasks.workunit.client.0.smithi071.stdout:8/330: link d5/l6a d5/df/l77 0 2024-09-10T10:04:16.158 INFO:tasks.workunit.client.1.smithi107.stdout:8/371: stat d5/d8/dc/d1a/d64/c6c 0 2024-09-10T10:04:16.159 INFO:tasks.workunit.client.0.smithi071.stdout:0/311: dwrite d11/d22/f23 [0,4194304] 0 2024-09-10T10:04:16.159 INFO:tasks.workunit.client.1.smithi107.stdout:6/470: mkdir d0/d3d/d14/d9f 0 2024-09-10T10:04:16.160 INFO:tasks.workunit.client.0.smithi071.stdout:8/331: write d5/df/d1d/f3d [402698,72196] 0 2024-09-10T10:04:16.161 INFO:tasks.workunit.client.0.smithi071.stdout:2/387: chown d8/d24/l3f 14579 1 2024-09-10T10:04:16.162 INFO:tasks.workunit.client.0.smithi071.stdout:8/332: chown d5/d36/d49/f4f 4237 1 2024-09-10T10:04:16.162 INFO:tasks.workunit.client.1.smithi107.stdout:5/484: getdents de/d4a 0 2024-09-10T10:04:16.167 INFO:tasks.workunit.client.1.smithi107.stdout:0/431: creat d6/d8/d2f/d35/d3c/d58/d69/f88 x:0 0 0 2024-09-10T10:04:16.168 INFO:tasks.workunit.client.0.smithi071.stdout:8/333: rename d5/d30/f43 to d5/d36/d49/f78 0 2024-09-10T10:04:16.169 INFO:tasks.workunit.client.0.smithi071.stdout:2/388: dwrite d8/d38/d47/d59/d65/f79 [0,4194304] 0 2024-09-10T10:04:16.169 INFO:tasks.workunit.client.1.smithi107.stdout:9/425: unlink d5/d7/d1d/d41/f70 0 2024-09-10T10:04:16.171 INFO:tasks.workunit.client.1.smithi107.stdout:3/682: truncate dc/dd/d20/d23/d39/fa3 1112561 0 2024-09-10T10:04:16.171 INFO:tasks.workunit.client.1.smithi107.stdout:5/485: chown de/d4a/d4e/c78 152 1 2024-09-10T10:04:16.171 INFO:tasks.workunit.client.0.smithi071.stdout:6/341: write d4/da/fb [307762,3414] 0 2024-09-10T10:04:16.174 INFO:tasks.workunit.client.1.smithi107.stdout:2/468: symlink d3/da/d1e/d40/d8a/d7f/d55/d85/d7c/la7 0 2024-09-10T10:04:16.174 INFO:tasks.workunit.client.1.smithi107.stdout:1/480: dread d2/d6/d24/f54 [0,4194304] 0 2024-09-10T10:04:16.174 INFO:tasks.workunit.client.0.smithi071.stdout:2/389: creat d8/d13/d33/d41/d4d/d5e/f7d x:0 0 0 2024-09-10T10:04:16.175 INFO:tasks.workunit.client.1.smithi107.stdout:8/372: dwrite d5/d8/d5b/f6f [0,4194304] 0 2024-09-10T10:04:16.175 INFO:tasks.workunit.client.1.smithi107.stdout:6/471: link d0/fd d0/d3d/d14/d21/fa0 0 2024-09-10T10:04:16.177 INFO:tasks.workunit.client.1.smithi107.stdout:9/426: readlink d5/d1e/l76 0 2024-09-10T10:04:16.177 INFO:tasks.workunit.client.1.smithi107.stdout:0/432: mkdir d6/d8/d2f/d2e/d7b/d89 0 2024-09-10T10:04:16.178 INFO:tasks.workunit.client.1.smithi107.stdout:7/348: write d0/d20/f3a [681229,88135] 0 2024-09-10T10:04:16.179 INFO:tasks.workunit.client.0.smithi071.stdout:2/390: symlink d8/d24/l7e 0 2024-09-10T10:04:16.179 INFO:tasks.workunit.client.0.smithi071.stdout:8/334: dread d5/df/d1e/d38/f48 [0,4194304] 0 2024-09-10T10:04:16.180 INFO:tasks.workunit.client.1.smithi107.stdout:5/486: symlink de/d9c/la6 0 2024-09-10T10:04:16.181 INFO:tasks.workunit.client.1.smithi107.stdout:0/433: chown d6/d8/d2f/d35/d3c/d58/c77 5874835 1 2024-09-10T10:04:16.182 INFO:tasks.workunit.client.1.smithi107.stdout:8/373: unlink d5/d8/dc/d21/l80 0 2024-09-10T10:04:16.183 INFO:tasks.workunit.client.1.smithi107.stdout:5/487: chown de/d20/d2b/d4b/d5e 1888 1 2024-09-10T10:04:16.185 INFO:tasks.workunit.client.1.smithi107.stdout:5/488: readlink de/d4a/d4e/l83 0 2024-09-10T10:04:16.186 INFO:tasks.workunit.client.1.smithi107.stdout:6/472: rename d0/d3d/d14/d42/d88/f85 to d0/d3d/d14/d21/d83/fa1 0 2024-09-10T10:04:16.187 INFO:tasks.workunit.client.0.smithi071.stdout:6/342: dwrite d4/f28 [0,4194304] 0 2024-09-10T10:04:16.188 INFO:tasks.workunit.client.0.smithi071.stdout:8/335: getdents d5/df/d74 0 2024-09-10T10:04:16.189 INFO:tasks.workunit.client.1.smithi107.stdout:9/427: symlink d5/d7/d1d/l98 0 2024-09-10T10:04:16.189 INFO:tasks.workunit.client.1.smithi107.stdout:6/473: read d0/d3d/d14/d17/f9a [1330329,84680] 0 2024-09-10T10:04:16.194 INFO:tasks.workunit.client.1.smithi107.stdout:4/532: dread d0/d40/d57/d4f/f58 [0,4194304] 0 2024-09-10T10:04:16.195 INFO:tasks.workunit.client.1.smithi107.stdout:8/374: unlink d5/d8/dc/d18/f44 0 2024-09-10T10:04:16.195 INFO:tasks.workunit.client.1.smithi107.stdout:4/533: chown d0/d1f/d20/f1e 61722 1 2024-09-10T10:04:16.196 INFO:tasks.workunit.client.1.smithi107.stdout:0/434: mkdir d6/d8/d2f/d2e/d32/d85/d8a 0 2024-09-10T10:04:16.197 INFO:tasks.workunit.client.0.smithi071.stdout:8/336: dwrite d5/d36/f41 [0,4194304] 0 2024-09-10T10:04:16.198 INFO:tasks.workunit.client.0.smithi071.stdout:8/337: fsync d5/d30/f3c 0 2024-09-10T10:04:16.200 INFO:tasks.workunit.client.1.smithi107.stdout:9/428: creat d5/d7/d1d/d29/f99 x:0 0 0 2024-09-10T10:04:16.204 INFO:tasks.workunit.client.0.smithi071.stdout:8/338: read d5/d36/f39 [1772244,31030] 0 2024-09-10T10:04:16.207 INFO:tasks.workunit.client.0.smithi071.stdout:0/312: truncate d11/d22/f2c 2556352 0 2024-09-10T10:04:16.207 INFO:tasks.workunit.client.1.smithi107.stdout:7/349: link d0/d1b/d4d/c5b d0/d8/d9/d3d/c6a 0 2024-09-10T10:04:16.208 INFO:tasks.workunit.client.1.smithi107.stdout:2/469: creat d3/da/df/fa8 x:0 0 0 2024-09-10T10:04:16.208 INFO:tasks.workunit.client.0.smithi071.stdout:8/339: dread d5/df/d1d/f3d [0,4194304] 0 2024-09-10T10:04:16.208 INFO:tasks.workunit.client.0.smithi071.stdout:2/391: write d8/d13/f25 [111414,13777] 0 2024-09-10T10:04:16.210 INFO:tasks.workunit.client.0.smithi071.stdout:2/392: chown d8/d4a 4759 1 2024-09-10T10:04:16.210 INFO:tasks.workunit.client.0.smithi071.stdout:8/340: chown d5/df/d1e/d38/f4c 181530758 1 2024-09-10T10:04:16.215 INFO:tasks.workunit.client.0.smithi071.stdout:8/341: truncate d5/df/d1e/d38/f48 4419117 0 2024-09-10T10:04:16.216 INFO:tasks.workunit.client.1.smithi107.stdout:7/350: truncate d0/d20/d35/f5e 4521953 0 2024-09-10T10:04:16.216 INFO:tasks.workunit.client.1.smithi107.stdout:4/534: dread d0/d40/d57/d4f/f58 [0,4194304] 0 2024-09-10T10:04:16.216 INFO:tasks.workunit.client.0.smithi071.stdout:6/343: dwrite f3 [0,4194304] 0 2024-09-10T10:04:16.216 INFO:tasks.workunit.client.0.smithi071.stdout:2/393: mkdir d8/d24/d7f 0 2024-09-10T10:04:16.217 INFO:tasks.workunit.client.0.smithi071.stdout:6/344: chown d4/da/df/d2e/d3a/d3e/d45/c62 0 1 2024-09-10T10:04:16.217 INFO:tasks.workunit.client.0.smithi071.stdout:6/345: readlink d4/d20/l3c 0 2024-09-10T10:04:16.218 INFO:tasks.workunit.client.0.smithi071.stdout:8/342: rmdir d5/df/d1e 39 2024-09-10T10:04:16.219 INFO:tasks.workunit.client.1.smithi107.stdout:7/351: fsync d0/f2b 0 2024-09-10T10:04:16.220 INFO:tasks.workunit.client.1.smithi107.stdout:1/481: dread d2/d6/d24/f50 [0,4194304] 0 2024-09-10T10:04:16.221 INFO:tasks.workunit.client.1.smithi107.stdout:3/683: dread dc/dd/d45/d26/d41/d44/d35/f2a [0,4194304] 0 2024-09-10T10:04:16.224 INFO:tasks.workunit.client.1.smithi107.stdout:6/474: dwrite d0/d3d/f41 [0,4194304] 0 2024-09-10T10:04:16.224 INFO:tasks.workunit.client.0.smithi071.stdout:8/343: creat d5/df/d67/f79 x:0 0 0 2024-09-10T10:04:16.225 INFO:tasks.workunit.client.1.smithi107.stdout:2/470: dwrite d3/da/d1e/d40/d8a/f89 [0,4194304] 0 2024-09-10T10:04:16.226 INFO:tasks.workunit.client.1.smithi107.stdout:9/429: rename d5/d7/d3c/d53/d57/d87/d50 to d5/d7/d1d/d41/d83/d9a 0 2024-09-10T10:04:16.229 INFO:tasks.workunit.client.0.smithi071.stdout:2/394: rename d8/d4a/f4b to d8/f80 0 2024-09-10T10:04:16.229 INFO:tasks.workunit.client.1.smithi107.stdout:5/489: creat de/fa7 x:0 0 0 2024-09-10T10:04:16.234 INFO:tasks.workunit.client.1.smithi107.stdout:7/352: fdatasync d0/d8/dc/d2c/f3b 0 2024-09-10T10:04:16.234 INFO:tasks.workunit.client.0.smithi071.stdout:2/395: symlink d8/d38/d47/d59/l81 0 2024-09-10T10:04:16.235 INFO:tasks.workunit.client.1.smithi107.stdout:5/490: read de/f2d [173231,92418] 0 2024-09-10T10:04:16.235 INFO:tasks.workunit.client.0.smithi071.stdout:8/344: symlink d5/df/d1e/d38/d62/l7a 0 2024-09-10T10:04:16.238 INFO:tasks.workunit.client.0.smithi071.stdout:2/396: symlink d8/d13/d51/l82 0 2024-09-10T10:04:16.238 INFO:tasks.workunit.client.1.smithi107.stdout:6/475: fsync d0/d3d/d14/d21/d83/fa1 0 2024-09-10T10:04:16.239 INFO:tasks.workunit.client.1.smithi107.stdout:7/353: chown d0/d8/d56 105405341 1 2024-09-10T10:04:16.239 INFO:tasks.workunit.client.0.smithi071.stdout:8/345: readlink d5/df/l34 0 2024-09-10T10:04:16.239 INFO:tasks.workunit.client.1.smithi107.stdout:0/435: link d6/d8/d2f/f1b d6/d8/d2f/d2e/d7b/f8b 0 2024-09-10T10:04:16.242 INFO:tasks.workunit.client.1.smithi107.stdout:1/482: getdents d2/d89 0 2024-09-10T10:04:16.243 INFO:tasks.workunit.client.1.smithi107.stdout:3/684: dwrite dc/dd/d45/d26/d59/f67 [0,4194304] 0 2024-09-10T10:04:16.243 INFO:tasks.workunit.client.0.smithi071.stdout:8/346: truncate d5/f28 358084 0 2024-09-10T10:04:16.243 INFO:tasks.workunit.client.0.smithi071.stdout:2/397: link d8/d24/c67 d8/d13/d51/c83 0 2024-09-10T10:04:16.243 INFO:tasks.workunit.client.0.smithi071.stdout:8/347: fsync d5/df/d1e/d38/f4c 0 2024-09-10T10:04:16.244 INFO:tasks.workunit.client.0.smithi071.stdout:8/348: read d5/df/d1e/f21 [651261,111395] 0 2024-09-10T10:04:16.245 INFO:tasks.workunit.client.1.smithi107.stdout:9/430: mkdir d5/d7/d1d/d9b 0 2024-09-10T10:04:16.245 INFO:tasks.workunit.client.1.smithi107.stdout:5/491: creat de/d20/d2b/d4b/d5e/fa8 x:0 0 0 2024-09-10T10:04:16.246 INFO:tasks.workunit.client.1.smithi107.stdout:8/375: rename d5/d8/dc/d21/d48 to d5/d8/dc/d21/d83 0 2024-09-10T10:04:16.247 INFO:tasks.workunit.client.0.smithi071.stdout:2/398: creat d8/d13/d51/f84 x:0 0 0 2024-09-10T10:04:16.247 INFO:tasks.workunit.client.0.smithi071.stdout:8/349: rmdir d5/df 39 2024-09-10T10:04:16.247 INFO:tasks.workunit.client.0.smithi071.stdout:2/399: dread - d8/d24/f5c zero size 2024-09-10T10:04:16.248 INFO:tasks.workunit.client.0.smithi071.stdout:2/400: fdatasync d8/d13/d33/f3c 0 2024-09-10T10:04:16.248 INFO:tasks.workunit.client.1.smithi107.stdout:7/354: creat d0/d1b/d4d/f6b x:0 0 0 2024-09-10T10:04:16.248 INFO:tasks.workunit.client.1.smithi107.stdout:9/431: mknod d5/d7/d3c/c9c 0 2024-09-10T10:04:16.249 INFO:tasks.workunit.client.1.smithi107.stdout:5/492: chown de/f48 134 1 2024-09-10T10:04:16.249 INFO:tasks.workunit.client.1.smithi107.stdout:3/685: truncate dc/fca 271913 0 2024-09-10T10:04:16.249 INFO:tasks.workunit.client.1.smithi107.stdout:2/471: dwrite d3/da/d1e/d40/d8a/f89 [0,4194304] 0 2024-09-10T10:04:16.250 INFO:tasks.workunit.client.0.smithi071.stdout:2/401: chown d8/d13/d33/c77 65608288 1 2024-09-10T10:04:16.251 INFO:tasks.workunit.client.1.smithi107.stdout:9/432: stat d5/d7/d1d/l6f 0 2024-09-10T10:04:16.253 INFO:tasks.workunit.client.0.smithi071.stdout:2/402: creat d8/d13/d33/d41/d4d/f85 x:0 0 0 2024-09-10T10:04:16.253 INFO:tasks.workunit.client.0.smithi071.stdout:0/313: dread d11/d22/f4e [0,4194304] 0 2024-09-10T10:04:16.256 INFO:tasks.workunit.client.0.smithi071.stdout:8/350: dread d5/df/d1e/f21 [0,4194304] 0 2024-09-10T10:04:16.256 INFO:tasks.workunit.client.1.smithi107.stdout:7/355: rename d0/d8/dc/f59 to d0/d8/d56/f6c 0 2024-09-10T10:04:16.257 INFO:tasks.workunit.client.1.smithi107.stdout:6/476: dwrite d0/d3d/d14/d21/f28 [0,4194304] 0 2024-09-10T10:04:16.258 INFO:tasks.workunit.client.1.smithi107.stdout:9/433: unlink d5/d7/d1d/d41/d83/d9a/l2d 0 2024-09-10T10:04:16.260 INFO:tasks.workunit.client.0.smithi071.stdout:2/403: dread d8/d13/d51/f54 [0,4194304] 0 2024-09-10T10:04:16.264 INFO:tasks.workunit.client.0.smithi071.stdout:2/404: dread d8/f80 [0,4194304] 0 2024-09-10T10:04:16.264 INFO:tasks.workunit.client.1.smithi107.stdout:2/472: write d3/da/df/d78/f80 [538855,35971] 0 2024-09-10T10:04:16.266 INFO:tasks.workunit.client.1.smithi107.stdout:2/473: fsync d3/da/df/d20/f57 0 2024-09-10T10:04:16.267 INFO:tasks.workunit.client.1.smithi107.stdout:7/356: mkdir d0/d8/d5c/d6d 0 2024-09-10T10:04:16.268 INFO:tasks.workunit.client.1.smithi107.stdout:9/434: creat d5/d7/d1d/d41/d97/f9d x:0 0 0 2024-09-10T10:04:16.277 INFO:tasks.workunit.client.1.smithi107.stdout:9/435: rename d5/d7/d3c/d53/d57/d87/d27/c5f to d5/d7/d1d/c9e 0 2024-09-10T10:04:16.278 INFO:tasks.workunit.client.0.smithi071.stdout:0/314: write d11/d22/d40/f44 [150440,33609] 0 2024-09-10T10:04:16.279 INFO:tasks.workunit.client.0.smithi071.stdout:0/315: read - d11/d22/d40/f68 zero size 2024-09-10T10:04:16.279 INFO:tasks.workunit.client.1.smithi107.stdout:7/357: dread d0/d8/d9/f4c [0,4194304] 0 2024-09-10T10:04:16.279 INFO:tasks.workunit.client.0.smithi071.stdout:2/405: write d8/f48 [153711,111120] 0 2024-09-10T10:04:16.283 INFO:tasks.workunit.client.0.smithi071.stdout:0/316: creat d11/d22/d40/f6d x:0 0 0 2024-09-10T10:04:16.285 INFO:tasks.workunit.client.0.smithi071.stdout:2/406: link d8/f14 d8/d13/d33/d53/f86 0 2024-09-10T10:04:16.287 INFO:tasks.workunit.client.0.smithi071.stdout:8/351: link d5/f19 d5/df/d16/d75/f7b 0 2024-09-10T10:04:16.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:15 smithi071 ceph-mon[27559]: pgmap v258: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 32 MiB/s rd, 184 MiB/s wr, 439 op/s 2024-09-10T10:04:16.289 INFO:tasks.workunit.client.1.smithi107.stdout:8/376: truncate d5/d8/d5b/f6f 614800 0 2024-09-10T10:04:16.291 INFO:tasks.workunit.client.0.smithi071.stdout:0/317: creat d11/f6e x:0 0 0 2024-09-10T10:04:16.292 INFO:tasks.workunit.client.1.smithi107.stdout:2/474: truncate d3/da/df/d20/f33 1021596 0 2024-09-10T10:04:16.294 INFO:tasks.workunit.client.0.smithi071.stdout:0/318: readlink d11/d22/d40/l59 0 2024-09-10T10:04:16.294 INFO:tasks.workunit.client.0.smithi071.stdout:0/319: chown d11/d22/f4f 3 1 2024-09-10T10:04:16.295 INFO:tasks.workunit.client.1.smithi107.stdout:5/493: dread de/d20/f2c [0,4194304] 0 2024-09-10T10:04:16.298 INFO:tasks.workunit.client.0.smithi071.stdout:2/407: rename d8/d13 to d8/d87 0 2024-09-10T10:04:16.299 INFO:tasks.workunit.client.0.smithi071.stdout:0/320: truncate d11/d30/f3c 718906 0 2024-09-10T10:04:16.300 INFO:tasks.workunit.client.1.smithi107.stdout:0/436: dwrite d6/d8/d2f/d2e/d7b/f8b [0,4194304] 0 2024-09-10T10:04:16.300 INFO:tasks.workunit.client.0.smithi071.stdout:2/408: truncate d8/d4a/f55 1266698 0 2024-09-10T10:04:16.302 INFO:tasks.workunit.client.0.smithi071.stdout:2/409: stat d8/d38/d47/d59/d65/f79 0 2024-09-10T10:04:16.303 INFO:tasks.workunit.client.1.smithi107.stdout:8/377: write d5/d8/d2a/d35/f59 [363402,51295] 0 2024-09-10T10:04:16.303 INFO:tasks.workunit.client.1.smithi107.stdout:1/483: dwrite d2/d6/d24/f4f [0,4194304] 0 2024-09-10T10:04:16.303 INFO:tasks.workunit.client.1.smithi107.stdout:7/358: dread d0/f4 [4194304,4194304] 0 2024-09-10T10:04:16.306 INFO:tasks.workunit.client.1.smithi107.stdout:0/437: unlink d6/d8/f27 0 2024-09-10T10:04:16.307 INFO:tasks.workunit.client.0.smithi071.stdout:0/321: dwrite d11/d30/f50 [0,4194304] 0 2024-09-10T10:04:16.307 INFO:tasks.workunit.client.0.smithi071.stdout:2/410: rename d8/l17 to d8/d24/l88 0 2024-09-10T10:04:16.307 INFO:tasks.workunit.client.1.smithi107.stdout:9/436: dread d5/d7/fb [0,4194304] 0 2024-09-10T10:04:16.308 INFO:tasks.workunit.client.0.smithi071.stdout:8/352: dread d5/f33 [0,4194304] 0 2024-09-10T10:04:16.309 INFO:tasks.workunit.client.1.smithi107.stdout:5/494: creat de/d4a/d4e/fa9 x:0 0 0 2024-09-10T10:04:16.309 INFO:tasks.workunit.client.0.smithi071.stdout:2/411: write d8/d87/d33/d41/d4d/f85 [12025,69459] 0 2024-09-10T10:04:16.310 INFO:tasks.workunit.client.1.smithi107.stdout:7/359: dread - d0/d1b/d4d/f6b zero size 2024-09-10T10:04:16.312 INFO:tasks.workunit.client.0.smithi071.stdout:2/412: truncate d8/d24/f5c 146863 0 2024-09-10T10:04:16.312 INFO:tasks.workunit.client.0.smithi071.stdout:8/353: creat d5/d36/d49/f7c x:0 0 0 2024-09-10T10:04:16.313 INFO:tasks.workunit.client.1.smithi107.stdout:8/378: creat d5/d8/dc/d21/d83/f84 x:0 0 0 2024-09-10T10:04:16.315 INFO:tasks.workunit.client.0.smithi071.stdout:7/425: sync 2024-09-10T10:04:16.315 INFO:tasks.workunit.client.0.smithi071.stdout:1/342: sync 2024-09-10T10:04:16.316 INFO:tasks.workunit.client.0.smithi071.stdout:2/413: write d8/d87/d33/f36 [88161,94103] 0 2024-09-10T10:04:16.316 INFO:tasks.workunit.client.1.smithi107.stdout:1/484: fsync d2/d12/d5a/f62 0 2024-09-10T10:04:16.316 INFO:tasks.workunit.client.1.smithi107.stdout:6/477: dread d0/d3d/d14/d17/f36 [0,4194304] 0 2024-09-10T10:04:16.316 INFO:tasks.workunit.client.1.smithi107.stdout:0/438: write d6/d8/d3e/d43/f4b [1279322,60046] 0 2024-09-10T10:04:16.317 INFO:tasks.workunit.client.1.smithi107.stdout:9/437: creat d5/d1e/f9f x:0 0 0 2024-09-10T10:04:16.318 INFO:tasks.workunit.client.1.smithi107.stdout:5/495: fdatasync de/d41/f52 0 2024-09-10T10:04:16.318 INFO:tasks.workunit.client.0.smithi071.stdout:7/426: chown d9/f34 1093820 1 2024-09-10T10:04:16.318 INFO:tasks.workunit.client.0.smithi071.stdout:0/322: dwrite d11/d22/d40/f44 [0,4194304] 0 2024-09-10T10:04:16.319 INFO:tasks.workunit.client.0.smithi071.stdout:8/354: symlink d5/df/d1e/d70/l7d 0 2024-09-10T10:04:16.319 INFO:tasks.workunit.client.0.smithi071.stdout:1/343: dread - d1/d21/f63 zero size 2024-09-10T10:04:16.320 INFO:tasks.workunit.client.1.smithi107.stdout:2/475: rename d3/da/d1e/d27/l9b to d3/da/d1e/d5f/la9 0 2024-09-10T10:04:16.320 INFO:tasks.workunit.client.1.smithi107.stdout:7/360: rmdir d0/d8/dc 39 2024-09-10T10:04:16.322 INFO:tasks.workunit.client.1.smithi107.stdout:7/361: readlink d0/d20/d35/l5f 0 2024-09-10T10:04:16.324 INFO:tasks.workunit.client.0.smithi071.stdout:7/427: creat d9/d15/d1f/d74/f97 x:0 0 0 2024-09-10T10:04:16.325 INFO:tasks.workunit.client.1.smithi107.stdout:8/379: mkdir d5/d8/d2a/d35/d85 0 2024-09-10T10:04:16.325 INFO:tasks.workunit.client.1.smithi107.stdout:6/478: dread d0/d3d/f41 [0,4194304] 0 2024-09-10T10:04:16.327 INFO:tasks.workunit.client.1.smithi107.stdout:8/380: truncate d5/d8/d2a/d35/f57 1278217 0 2024-09-10T10:04:16.328 INFO:tasks.workunit.client.0.smithi071.stdout:1/344: creat d1/d21/d2f/d30/d6a/f6d x:0 0 0 2024-09-10T10:04:16.328 INFO:tasks.workunit.client.0.smithi071.stdout:2/414: dread d8/d87/d51/f54 [0,4194304] 0 2024-09-10T10:04:16.329 INFO:tasks.workunit.client.1.smithi107.stdout:5/496: creat de/d4a/d5c/faa x:0 0 0 2024-09-10T10:04:16.329 INFO:tasks.workunit.client.1.smithi107.stdout:2/476: rmdir d3/d21 39 2024-09-10T10:04:16.329 INFO:tasks.workunit.client.0.smithi071.stdout:1/345: readlink d1/d21/l2d 0 2024-09-10T10:04:16.330 INFO:tasks.workunit.client.1.smithi107.stdout:0/439: creat d6/d8/d2f/d2e/d32/d56/f8c x:0 0 0 2024-09-10T10:04:16.331 INFO:tasks.workunit.client.1.smithi107.stdout:0/440: read d6/f23 [3212448,127228] 0 2024-09-10T10:04:16.331 INFO:tasks.workunit.client.0.smithi071.stdout:8/355: dwrite d5/df/d16/f3b [0,4194304] 0 2024-09-10T10:04:16.332 INFO:tasks.workunit.client.1.smithi107.stdout:6/479: chown d0/d3d/d14/d17/d49/d55/d56/c5e 148483331 1 2024-09-10T10:04:16.332 INFO:tasks.workunit.client.0.smithi071.stdout:2/415: mknod d8/d87/d49/c89 0 2024-09-10T10:04:16.332 INFO:tasks.workunit.client.1.smithi107.stdout:0/441: read - d6/d8/f72 zero size 2024-09-10T10:04:16.333 INFO:tasks.workunit.client.0.smithi071.stdout:2/416: chown d8/c30 56199230 1 2024-09-10T10:04:16.333 INFO:tasks.workunit.client.0.smithi071.stdout:1/346: truncate d1/d21/d2f/d30/d6a/f69 327159 0 2024-09-10T10:04:16.334 INFO:tasks.workunit.client.1.smithi107.stdout:2/477: rmdir d3/da/d66/d91 39 2024-09-10T10:04:16.335 INFO:tasks.workunit.client.0.smithi071.stdout:1/347: truncate d1/d3f/f68 780600 0 2024-09-10T10:04:16.336 INFO:tasks.workunit.client.1.smithi107.stdout:5/497: dread de/d4a/f53 [0,4194304] 0 2024-09-10T10:04:16.336 INFO:tasks.workunit.client.1.smithi107.stdout:1/485: creat d2/d12/f95 x:0 0 0 2024-09-10T10:04:16.337 INFO:tasks.workunit.client.0.smithi071.stdout:8/356: fsync d5/d36/d49/f78 0 2024-09-10T10:04:16.337 INFO:tasks.workunit.client.0.smithi071.stdout:2/417: creat d8/d87/d33/d41/d4d/d5e/f8a x:0 0 0 2024-09-10T10:04:16.338 INFO:tasks.workunit.client.1.smithi107.stdout:9/438: creat d5/d7/d1d/fa0 x:0 0 0 2024-09-10T10:04:16.338 INFO:tasks.workunit.client.1.smithi107.stdout:5/498: write de/d4a/d5c/d6d/f73 [470685,26851] 0 2024-09-10T10:04:16.339 INFO:tasks.workunit.client.1.smithi107.stdout:0/442: rmdir d6/d8/d2f/d35 39 2024-09-10T10:04:16.341 INFO:tasks.workunit.client.1.smithi107.stdout:0/443: chown d6/d8/d3e/d43/c49 16837079 1 2024-09-10T10:04:16.342 INFO:tasks.workunit.client.0.smithi071.stdout:8/357: mknod d5/df/d67/c7e 0 2024-09-10T10:04:16.343 INFO:tasks.workunit.client.1.smithi107.stdout:6/480: rename d0/d3d/d14/d17/d24/d60 to d0/d3d/d14/d21/d8a/da2 0 2024-09-10T10:04:16.344 INFO:tasks.workunit.client.0.smithi071.stdout:2/418: symlink d8/d87/d49/d66/l8b 0 2024-09-10T10:04:16.345 INFO:tasks.workunit.client.1.smithi107.stdout:2/478: creat d3/da/df/d20/d36/d4f/faa x:0 0 0 2024-09-10T10:04:16.345 INFO:tasks.workunit.client.0.smithi071.stdout:7/428: dread d9/f3e [0,4194304] 0 2024-09-10T10:04:16.345 INFO:tasks.workunit.client.0.smithi071.stdout:1/348: dwrite d1/d21/f61 [0,4194304] 0 2024-09-10T10:04:16.346 INFO:tasks.workunit.client.1.smithi107.stdout:2/479: write d3/da/df/d20/d36/d39/f6e [133785,23925] 0 2024-09-10T10:04:16.348 INFO:tasks.workunit.client.0.smithi071.stdout:0/323: write d11/d30/f50 [4652764,110905] 0 2024-09-10T10:04:16.350 INFO:tasks.workunit.client.0.smithi071.stdout:2/419: write d8/d87/d51/f84 [883308,80859] 0 2024-09-10T10:04:16.350 INFO:tasks.workunit.client.1.smithi107.stdout:9/439: fdatasync d5/d7/fb 0 2024-09-10T10:04:16.350 INFO:tasks.workunit.client.1.smithi107.stdout:7/362: dread d0/fb [0,4194304] 0 2024-09-10T10:04:16.351 INFO:tasks.workunit.client.0.smithi071.stdout:7/429: mkdir d9/d15/d1f/d98 0 2024-09-10T10:04:16.352 INFO:tasks.workunit.client.1.smithi107.stdout:2/480: truncate d3/da/df/d20/d36/d39/f4e 4285480 0 2024-09-10T10:04:16.352 INFO:tasks.workunit.client.0.smithi071.stdout:2/420: fsync d8/d87/d33/d41/d4d/d5e/f6f 0 2024-09-10T10:04:16.352 INFO:tasks.workunit.client.0.smithi071.stdout:8/358: truncate d5/df/d1d/f3d 613713 0 2024-09-10T10:04:16.353 INFO:tasks.workunit.client.1.smithi107.stdout:5/499: creat de/d4a/d7e/fab x:0 0 0 2024-09-10T10:04:16.359 INFO:tasks.workunit.client.1.smithi107.stdout:0/444: mkdir d6/d8/d2f/d2e/d32/d85/d8a/d8d 0 2024-09-10T10:04:16.360 INFO:tasks.workunit.client.1.smithi107.stdout:6/481: fsync d0/f2c 0 2024-09-10T10:04:16.361 INFO:tasks.workunit.client.1.smithi107.stdout:7/363: creat d0/d8/dc/d2c/f6e x:0 0 0 2024-09-10T10:04:16.364 INFO:tasks.workunit.client.0.smithi071.stdout:0/324: rename d11/d22/f2e to d11/d22/f6f 0 2024-09-10T10:04:16.364 INFO:tasks.workunit.client.1.smithi107.stdout:9/440: dwrite d5/d7/d3c/d53/d57/f7a [0,4194304] 0 2024-09-10T10:04:16.364 INFO:tasks.workunit.client.1.smithi107.stdout:7/364: chown d0/d8/dc/d2c 11421199 1 2024-09-10T10:04:16.365 INFO:tasks.workunit.client.0.smithi071.stdout:1/349: getdents d1/d21 0 2024-09-10T10:04:16.366 INFO:tasks.workunit.client.1.smithi107.stdout:2/481: truncate d3/da/d66/d91/f9e 584948 0 2024-09-10T10:04:16.367 INFO:tasks.workunit.client.1.smithi107.stdout:6/482: fsync d0/d3d/d14/d17/f1a 0 2024-09-10T10:04:16.369 INFO:tasks.workunit.client.0.smithi071.stdout:7/430: getdents d9/d70 0 2024-09-10T10:04:16.370 INFO:tasks.workunit.client.1.smithi107.stdout:0/445: mkdir d6/d8e 0 2024-09-10T10:04:16.371 INFO:tasks.workunit.client.0.smithi071.stdout:0/325: mkdir d11/d30/d70 0 2024-09-10T10:04:16.371 INFO:tasks.workunit.client.1.smithi107.stdout:1/486: dread d2/f10 [0,4194304] 0 2024-09-10T10:04:16.372 INFO:tasks.workunit.client.1.smithi107.stdout:9/441: read d5/d1e/f5b [1256430,62138] 0 2024-09-10T10:04:16.375 INFO:tasks.workunit.client.0.smithi071.stdout:8/359: getdents d5/df/d1e 0 2024-09-10T10:04:16.375 INFO:tasks.workunit.client.1.smithi107.stdout:8/381: dwrite d5/d8/dc/f16 [0,4194304] 0 2024-09-10T10:04:16.376 INFO:tasks.workunit.client.0.smithi071.stdout:0/326: creat d11/d30/f71 x:0 0 0 2024-09-10T10:04:16.377 INFO:tasks.workunit.client.0.smithi071.stdout:2/421: truncate d8/f1a 751992 0 2024-09-10T10:04:16.377 INFO:tasks.workunit.client.0.smithi071.stdout:2/422: fsync d8/d87/d51/f84 0 2024-09-10T10:04:16.378 INFO:tasks.workunit.client.1.smithi107.stdout:2/482: creat d3/d21/d79/fab x:0 0 0 2024-09-10T10:04:16.380 INFO:tasks.workunit.client.0.smithi071.stdout:7/431: rename d9/d11/d6f/l73 to d9/d1a/l99 0 2024-09-10T10:04:16.381 INFO:tasks.workunit.client.0.smithi071.stdout:7/432: write d9/d11/f14 [2255553,62089] 0 2024-09-10T10:04:16.381 INFO:tasks.workunit.client.1.smithi107.stdout:6/483: mkdir d0/d3d/d14/d21/d8a/da2/da3 0 2024-09-10T10:04:16.381 INFO:tasks.workunit.client.0.smithi071.stdout:0/327: mkdir d11/d22/d31/d72 0 2024-09-10T10:04:16.382 INFO:tasks.workunit.client.0.smithi071.stdout:7/433: readlink d9/d11/d6f/l72 0 2024-09-10T10:04:16.384 INFO:tasks.workunit.client.1.smithi107.stdout:7/365: creat d0/d8/f6f x:0 0 0 2024-09-10T10:04:16.384 INFO:tasks.workunit.client.0.smithi071.stdout:8/360: mknod d5/df/d16/d75/c7f 0 2024-09-10T10:04:16.386 INFO:tasks.workunit.client.1.smithi107.stdout:1/487: rename d2/d36/c48 to d2/d6/d24/c96 0 2024-09-10T10:04:16.387 INFO:tasks.workunit.client.1.smithi107.stdout:0/446: dwrite d6/d8/d2f/d2e/d32/f6a [0,4194304] 0 2024-09-10T10:04:16.387 INFO:tasks.workunit.client.0.smithi071.stdout:7/434: link d9/d2c/d49/f62 d9/d76/f9a 0 2024-09-10T10:04:16.387 INFO:tasks.workunit.client.1.smithi107.stdout:9/442: link d5/f6a d5/d7/d3c/d53/d57/d87/d27/fa1 0 2024-09-10T10:04:16.388 INFO:tasks.workunit.client.1.smithi107.stdout:0/447: chown d6/c1a 160785068 1 2024-09-10T10:04:16.389 INFO:tasks.workunit.client.1.smithi107.stdout:7/366: creat d0/d20/f70 x:0 0 0 2024-09-10T10:04:16.389 INFO:tasks.workunit.client.1.smithi107.stdout:7/367: chown d0/d1b 20966 1 2024-09-10T10:04:16.391 INFO:tasks.workunit.client.1.smithi107.stdout:0/448: chown d6/d8/d2f/d2e/d32/d56/f8c 0 1 2024-09-10T10:04:16.391 INFO:tasks.workunit.client.1.smithi107.stdout:9/443: chown d5/d7/d3c/d53/d57/d87/d27/f60 2769 1 2024-09-10T10:04:16.391 INFO:tasks.workunit.client.1.smithi107.stdout:6/484: symlink d0/d3d/d14/d17/d49/d55/la4 0 2024-09-10T10:04:16.394 INFO:tasks.workunit.client.1.smithi107.stdout:9/444: write d5/d7/d3c/d53/d57/f8a [951197,105245] 0 2024-09-10T10:04:16.395 INFO:tasks.workunit.client.1.smithi107.stdout:6/485: creat d0/d3d/d14/d17/fa5 x:0 0 0 2024-09-10T10:04:16.396 INFO:tasks.workunit.client.1.smithi107.stdout:7/368: creat d0/d8/dc/f71 x:0 0 0 2024-09-10T10:04:16.396 INFO:tasks.workunit.client.1.smithi107.stdout:0/449: readlink d6/d8/d2f/d35/d4f/l81 0 2024-09-10T10:04:16.397 INFO:tasks.workunit.client.1.smithi107.stdout:8/382: rename d5/d8/dc/c12 to d5/d8/d5b/c86 0 2024-09-10T10:04:16.398 INFO:tasks.workunit.client.1.smithi107.stdout:2/483: rename d3/da to d3/da/d1e/d27/dac 22 2024-09-10T10:04:16.399 INFO:tasks.workunit.client.1.smithi107.stdout:7/369: chown d0/d8/dc/d2c/d47 4765032 1 2024-09-10T10:04:16.399 INFO:tasks.workunit.client.1.smithi107.stdout:8/383: rmdir d5/d8/d2a 39 2024-09-10T10:04:16.401 INFO:tasks.workunit.client.1.smithi107.stdout:0/450: dread - d6/d8/d2f/d35/d3c/d58/d69/f6b zero size 2024-09-10T10:04:16.403 INFO:tasks.workunit.client.1.smithi107.stdout:7/370: write d0/d8/d9/d3d/f60 [1390603,3943] 0 2024-09-10T10:04:16.404 INFO:tasks.workunit.client.1.smithi107.stdout:1/488: rmdir d2/d36 39 2024-09-10T10:04:16.408 INFO:tasks.workunit.client.1.smithi107.stdout:7/371: mkdir d0/d20/d72 0 2024-09-10T10:04:16.408 INFO:tasks.workunit.client.1.smithi107.stdout:9/445: dwrite d5/d7/d3c/d53/d57/d87/d37/f80 [4194304,4194304] 0 2024-09-10T10:04:16.409 INFO:tasks.workunit.client.1.smithi107.stdout:2/484: dread d3/f6c [0,4194304] 0 2024-09-10T10:04:16.409 INFO:tasks.workunit.client.1.smithi107.stdout:7/372: chown d0/d1b/d4d 260 1 2024-09-10T10:04:16.411 INFO:tasks.workunit.client.1.smithi107.stdout:9/446: readlink d5/d7/d3c/d53/d57/d87/d37/l84 0 2024-09-10T10:04:16.412 INFO:tasks.workunit.client.1.smithi107.stdout:1/489: rename d2/d12/d65/c80 to d2/d6/d24/c97 0 2024-09-10T10:04:16.413 INFO:tasks.workunit.client.1.smithi107.stdout:1/490: read - d2/d12/d5a/f6f zero size 2024-09-10T10:04:16.414 INFO:tasks.workunit.client.1.smithi107.stdout:7/373: symlink d0/d8/d5c/d6d/l73 0 2024-09-10T10:04:16.415 INFO:tasks.workunit.client.1.smithi107.stdout:9/447: symlink d5/la2 0 2024-09-10T10:04:16.417 INFO:tasks.workunit.client.1.smithi107.stdout:1/491: write d2/d36/f78 [232332,30050] 0 2024-09-10T10:04:16.417 INFO:tasks.workunit.client.1.smithi107.stdout:7/374: symlink d0/d1b/d4d/d69/l74 0 2024-09-10T10:04:16.419 INFO:tasks.workunit.client.1.smithi107.stdout:8/384: truncate d5/d8/dc/d1a/d71/f7d 208290 0 2024-09-10T10:04:16.420 INFO:tasks.workunit.client.1.smithi107.stdout:1/492: readlink d2/d12/d5a/l7d 0 2024-09-10T10:04:16.421 INFO:tasks.workunit.client.1.smithi107.stdout:1/493: chown d2/d12/d65/d6b/f41 66 1 2024-09-10T10:04:16.422 INFO:tasks.workunit.client.1.smithi107.stdout:1/494: write d2/d36/f4d [1669444,839] 0 2024-09-10T10:04:16.425 INFO:tasks.workunit.client.1.smithi107.stdout:2/485: dread d3/da/df/d20/f46 [0,4194304] 0 2024-09-10T10:04:16.425 INFO:tasks.workunit.client.1.smithi107.stdout:1/495: unlink d2/d12/f58 0 2024-09-10T10:04:16.427 INFO:tasks.workunit.client.1.smithi107.stdout:1/496: creat d2/d35/f98 x:0 0 0 2024-09-10T10:04:16.428 INFO:tasks.workunit.client.1.smithi107.stdout:2/486: mkdir d3/da/d1e/d5f/dad 0 2024-09-10T10:04:16.428 INFO:tasks.workunit.client.1.smithi107.stdout:0/451: dread d6/f10 [0,4194304] 0 2024-09-10T10:04:16.429 INFO:tasks.workunit.client.1.smithi107.stdout:0/452: chown d6/d8/d2f/d2e/d32/d56 1884 1 2024-09-10T10:04:16.430 INFO:tasks.workunit.client.1.smithi107.stdout:9/448: truncate d5/d7/d1d/d3b/f4a 6988334 0 2024-09-10T10:04:16.430 INFO:tasks.workunit.client.1.smithi107.stdout:1/497: dread d2/d12/d5a/f73 [0,4194304] 0 2024-09-10T10:04:16.431 INFO:tasks.workunit.client.1.smithi107.stdout:7/375: write d0/fb [1994854,106746] 0 2024-09-10T10:04:16.431 INFO:tasks.workunit.client.1.smithi107.stdout:8/385: write d5/d8/dc/d18/f4b [840028,118744] 0 2024-09-10T10:04:16.432 INFO:tasks.workunit.client.1.smithi107.stdout:2/487: write d3/da/d1e/d5f/f34 [1287641,44133] 0 2024-09-10T10:04:16.433 INFO:tasks.workunit.client.1.smithi107.stdout:0/453: chown d6/d8/d2f/d2e/l47 77851 1 2024-09-10T10:04:16.433 INFO:tasks.workunit.client.1.smithi107.stdout:7/376: fsync d0/d8/f13 0 2024-09-10T10:04:16.434 INFO:tasks.workunit.client.1.smithi107.stdout:0/454: chown d6/d8/d2f 950 1 2024-09-10T10:04:16.434 INFO:tasks.workunit.client.1.smithi107.stdout:8/386: fdatasync d5/d8/f13 0 2024-09-10T10:04:16.435 INFO:tasks.workunit.client.1.smithi107.stdout:7/377: write d0/f7 [1956341,35576] 0 2024-09-10T10:04:16.436 INFO:tasks.workunit.client.1.smithi107.stdout:1/498: symlink d2/d12/d94/l99 0 2024-09-10T10:04:16.439 INFO:tasks.workunit.client.1.smithi107.stdout:7/378: write d0/d8/d56/f6c [38275,98048] 0 2024-09-10T10:04:16.439 INFO:tasks.workunit.client.1.smithi107.stdout:1/499: mknod d2/d36/c9a 0 2024-09-10T10:04:16.442 INFO:tasks.workunit.client.1.smithi107.stdout:1/500: chown d2/d12/f95 962 1 2024-09-10T10:04:16.442 INFO:tasks.workunit.client.1.smithi107.stdout:8/387: creat d5/d8/d2a/d35/f87 x:0 0 0 2024-09-10T10:04:16.443 INFO:tasks.workunit.client.1.smithi107.stdout:7/379: creat d0/d8/d9/d68/f75 x:0 0 0 2024-09-10T10:04:16.444 INFO:tasks.workunit.client.1.smithi107.stdout:7/380: chown d0/d20/l51 276226 1 2024-09-10T10:04:16.444 INFO:tasks.workunit.client.1.smithi107.stdout:8/388: truncate d5/d8/d2a/f6e 324784 0 2024-09-10T10:04:16.445 INFO:tasks.workunit.client.1.smithi107.stdout:1/501: creat d2/d6/d67/f9b x:0 0 0 2024-09-10T10:04:16.445 INFO:tasks.workunit.client.0.smithi071.stdout:1/350: truncate d1/f1f 4288745 0 2024-09-10T10:04:16.445 INFO:tasks.workunit.client.0.smithi071.stdout:0/328: dwrite d11/d22/f6f [0,4194304] 0 2024-09-10T10:04:16.445 INFO:tasks.workunit.client.0.smithi071.stdout:8/361: creat d5/df/f80 x:0 0 0 2024-09-10T10:04:16.446 INFO:tasks.workunit.client.1.smithi107.stdout:9/449: write d5/d7/d1d/d3b/f4a [2612163,68500] 0 2024-09-10T10:04:16.446 INFO:tasks.workunit.client.1.smithi107.stdout:7/381: write d0/d8/d9/d3d/f55 [1728902,121682] 0 2024-09-10T10:04:16.447 INFO:tasks.workunit.client.0.smithi071.stdout:0/329: truncate d11/d30/d52/d5f/f6b 452706 0 2024-09-10T10:04:16.447 INFO:tasks.workunit.client.1.smithi107.stdout:1/502: mkdir d2/d35/d9c 0 2024-09-10T10:04:16.448 INFO:tasks.workunit.client.0.smithi071.stdout:8/362: mkdir d5/df/d1d/d81 0 2024-09-10T10:04:16.448 INFO:tasks.workunit.client.0.smithi071.stdout:0/330: write d11/f6e [485700,123854] 0 2024-09-10T10:04:16.449 INFO:tasks.workunit.client.1.smithi107.stdout:8/389: dread d5/d8/d2a/f6e [0,4194304] 0 2024-09-10T10:04:16.450 INFO:tasks.workunit.client.0.smithi071.stdout:8/363: write d5/df/d67/f79 [809008,128470] 0 2024-09-10T10:04:16.451 INFO:tasks.workunit.client.0.smithi071.stdout:7/435: truncate d9/d76/f9a 688023 0 2024-09-10T10:04:16.453 INFO:tasks.workunit.client.0.smithi071.stdout:1/351: creat d1/d35/f6e x:0 0 0 2024-09-10T10:04:16.453 INFO:tasks.workunit.client.1.smithi107.stdout:9/450: mkdir d5/d7/d1d/da3 0 2024-09-10T10:04:16.454 INFO:tasks.workunit.client.0.smithi071.stdout:8/364: mkdir d5/df/d57/d82 0 2024-09-10T10:04:16.455 INFO:tasks.workunit.client.1.smithi107.stdout:8/390: mknod d5/d42/c88 0 2024-09-10T10:04:16.457 INFO:tasks.workunit.client.1.smithi107.stdout:8/391: fsync d5/d8/d2a/d47/f53 0 2024-09-10T10:04:16.457 INFO:tasks.workunit.client.1.smithi107.stdout:9/451: creat d5/d7/d1d/d95/fa4 x:0 0 0 2024-09-10T10:04:16.457 INFO:tasks.workunit.client.0.smithi071.stdout:8/365: readlink d5/df/d16/l1a 0 2024-09-10T10:04:16.457 INFO:tasks.workunit.client.0.smithi071.stdout:1/352: mknod d1/d21/c6f 0 2024-09-10T10:04:16.459 INFO:tasks.workunit.client.1.smithi107.stdout:0/455: dread d6/d8/f15 [0,4194304] 0 2024-09-10T10:04:16.460 INFO:tasks.workunit.client.1.smithi107.stdout:8/392: dread d5/d8/d2a/f6e [0,4194304] 0 2024-09-10T10:04:16.460 INFO:tasks.workunit.client.0.smithi071.stdout:0/331: dwrite d11/d22/d40/f6d [0,4194304] 0 2024-09-10T10:04:16.461 INFO:tasks.workunit.client.1.smithi107.stdout:1/503: link d2/d6/f1c d2/d35/d9c/f9d 0 2024-09-10T10:04:16.462 INFO:tasks.workunit.client.1.smithi107.stdout:9/452: mknod d5/d7/ca5 0 2024-09-10T10:04:16.462 INFO:tasks.workunit.client.0.smithi071.stdout:1/353: write d1/f29 [2689373,51965] 0 2024-09-10T10:04:16.464 INFO:tasks.workunit.client.0.smithi071.stdout:0/332: write d11/d1e/f58 [1464700,40910] 0 2024-09-10T10:04:16.465 INFO:tasks.workunit.client.0.smithi071.stdout:7/436: dwrite d9/d1a/d1d/f57 [4194304,4194304] 0 2024-09-10T10:04:16.465 INFO:tasks.workunit.client.1.smithi107.stdout:1/504: creat d2/d89/f9e x:0 0 0 2024-09-10T10:04:16.468 INFO:tasks.workunit.client.0.smithi071.stdout:8/366: creat d5/df/d74/f83 x:0 0 0 2024-09-10T10:04:16.470 INFO:tasks.workunit.client.1.smithi107.stdout:8/393: getdents d5/d8 0 2024-09-10T10:04:16.472 INFO:tasks.workunit.client.0.smithi071.stdout:1/354: write d1/d21/d3d/f4f [4945082,36753] 0 2024-09-10T10:04:16.474 INFO:tasks.workunit.client.1.smithi107.stdout:9/453: dwrite d5/d7/d3c/d53/d57/f8a [0,4194304] 0 2024-09-10T10:04:16.475 INFO:tasks.workunit.client.0.smithi071.stdout:7/437: unlink d9/d15/d40/d80/f90 0 2024-09-10T10:04:16.475 INFO:tasks.workunit.client.1.smithi107.stdout:1/505: symlink d2/d12/d7e/l9f 0 2024-09-10T10:04:16.476 INFO:tasks.workunit.client.0.smithi071.stdout:0/333: symlink d11/d22/l73 0 2024-09-10T10:04:16.478 INFO:tasks.workunit.client.1.smithi107.stdout:8/394: unlink d5/d8/d2a/d35/c58 0 2024-09-10T10:04:16.479 INFO:tasks.workunit.client.0.smithi071.stdout:7/438: mkdir d9/d15/d1f/d74/d9b 0 2024-09-10T10:04:16.479 INFO:tasks.workunit.client.0.smithi071.stdout:0/334: readlink d11/l19 0 2024-09-10T10:04:16.480 INFO:tasks.workunit.client.0.smithi071.stdout:7/439: dread - d9/d15/d1f/d74/f97 zero size 2024-09-10T10:04:16.481 INFO:tasks.workunit.client.0.smithi071.stdout:0/335: truncate d11/d22/d40/f68 729767 0 2024-09-10T10:04:16.482 INFO:tasks.workunit.client.0.smithi071.stdout:8/367: getdents d5/df/d16/d75 0 2024-09-10T10:04:16.482 INFO:tasks.workunit.client.0.smithi071.stdout:1/355: unlink d1/d21/d2f/l6c 0 2024-09-10T10:04:16.483 INFO:tasks.workunit.client.0.smithi071.stdout:7/440: symlink d9/d1a/l9c 0 2024-09-10T10:04:16.483 INFO:tasks.workunit.client.0.smithi071.stdout:7/441: fsync d9/d76/f96 0 2024-09-10T10:04:16.487 INFO:tasks.workunit.client.0.smithi071.stdout:0/336: link f2 d11/d1e/f74 0 2024-09-10T10:04:16.488 INFO:tasks.workunit.client.1.smithi107.stdout:8/395: readlink d5/d8/dc/d18/l5f 0 2024-09-10T10:04:16.488 INFO:tasks.workunit.client.1.smithi107.stdout:9/454: creat d5/d7/d1d/d41/d83/fa6 x:0 0 0 2024-09-10T10:04:16.488 INFO:tasks.workunit.client.1.smithi107.stdout:0/456: dwrite d6/f23 [0,4194304] 0 2024-09-10T10:04:16.488 INFO:tasks.workunit.client.1.smithi107.stdout:1/506: write d2/d6/d24/f69 [766221,29348] 0 2024-09-10T10:04:16.489 INFO:tasks.workunit.client.0.smithi071.stdout:8/368: creat d5/df/d57/d82/f84 x:0 0 0 2024-09-10T10:04:16.494 INFO:tasks.workunit.client.0.smithi071.stdout:7/442: rename d9/f3e to d9/d15/d40/d80/f9d 0 2024-09-10T10:04:16.494 INFO:tasks.workunit.client.1.smithi107.stdout:9/455: write d5/d7/d3c/d53/d57/f69 [231286,124228] 0 2024-09-10T10:04:16.495 INFO:tasks.workunit.client.0.smithi071.stdout:1/356: truncate d1/d3f/f43 1772376 0 2024-09-10T10:04:16.496 INFO:tasks.workunit.client.1.smithi107.stdout:0/457: dread d6/d8/d2f/d2e/d32/f6a [0,4194304] 0 2024-09-10T10:04:16.497 INFO:tasks.workunit.client.0.smithi071.stdout:8/369: mkdir d5/df/d16/d75/d85 0 2024-09-10T10:04:16.498 INFO:tasks.workunit.client.1.smithi107.stdout:0/458: write d6/d8/d3e/f50 [2433136,19215] 0 2024-09-10T10:04:16.500 INFO:tasks.workunit.client.1.smithi107.stdout:9/456: unlink d5/d7/f13 0 2024-09-10T10:04:16.500 INFO:tasks.workunit.client.0.smithi071.stdout:1/357: mkdir d1/d70 0 2024-09-10T10:04:16.501 INFO:tasks.workunit.client.1.smithi107.stdout:1/507: dwrite d2/d12/f1a [0,4194304] 0 2024-09-10T10:04:16.502 INFO:tasks.workunit.client.0.smithi071.stdout:0/337: dwrite d11/d30/d52/d5f/f67 [0,4194304] 0 2024-09-10T10:04:16.503 INFO:tasks.workunit.client.0.smithi071.stdout:1/358: chown d1/d21/d3d/d4a/c4c 0 1 2024-09-10T10:04:16.509 INFO:tasks.workunit.client.1.smithi107.stdout:0/459: dwrite d6/d8/d2f/d2e/f75 [0,4194304] 0 2024-09-10T10:04:16.514 INFO:tasks.workunit.client.0.smithi071.stdout:0/338: dwrite f2 [4194304,4194304] 0 2024-09-10T10:04:16.514 INFO:tasks.workunit.client.1.smithi107.stdout:0/460: truncate d6/d8/d2f/d35/d3c/d58/d69/f88 228345 0 2024-09-10T10:04:16.514 INFO:tasks.workunit.client.1.smithi107.stdout:0/461: chown d6/d65 3 1 2024-09-10T10:04:16.514 INFO:tasks.workunit.client.1.smithi107.stdout:1/508: link d2/f32 d2/d6/d24/d81/fa0 0 2024-09-10T10:04:16.514 INFO:tasks.workunit.client.0.smithi071.stdout:1/359: link d1/c27 d1/d21/d2f/d30/c71 0 2024-09-10T10:04:16.518 INFO:tasks.workunit.client.0.smithi071.stdout:7/443: dread d9/f34 [0,4194304] 0 2024-09-10T10:04:16.518 INFO:tasks.workunit.client.1.smithi107.stdout:0/462: creat d6/d8/d2f/d35/f8f x:0 0 0 2024-09-10T10:04:16.519 INFO:tasks.workunit.client.0.smithi071.stdout:0/339: unlink d11/d22/f2c 0 2024-09-10T10:04:16.519 INFO:tasks.workunit.client.1.smithi107.stdout:1/509: symlink d2/d89/la1 0 2024-09-10T10:04:16.520 INFO:tasks.workunit.client.1.smithi107.stdout:1/510: chown d2/d6/d67 11004279 1 2024-09-10T10:04:16.521 INFO:tasks.workunit.client.0.smithi071.stdout:7/444: unlink d9/d15/d1f/d74/f97 0 2024-09-10T10:04:16.522 INFO:tasks.workunit.client.1.smithi107.stdout:0/463: fsync d6/f10 0 2024-09-10T10:04:16.524 INFO:tasks.workunit.client.1.smithi107.stdout:1/511: creat d2/d35/d7b/d8b/fa2 x:0 0 0 2024-09-10T10:04:16.525 INFO:tasks.workunit.client.0.smithi071.stdout:0/340: unlink d11/d30/l6c 0 2024-09-10T10:04:16.525 INFO:tasks.workunit.client.1.smithi107.stdout:0/464: mknod d6/d8/d2f/d2e/d32/d59/c90 0 2024-09-10T10:04:16.526 INFO:tasks.workunit.client.0.smithi071.stdout:7/445: creat d9/d11/d91/f9e x:0 0 0 2024-09-10T10:04:16.527 INFO:tasks.workunit.client.1.smithi107.stdout:1/512: creat d2/d36/fa3 x:0 0 0 2024-09-10T10:04:16.527 INFO:tasks.workunit.client.0.smithi071.stdout:1/360: dread d1/d21/f24 [0,4194304] 0 2024-09-10T10:04:16.528 INFO:tasks.workunit.client.1.smithi107.stdout:0/465: symlink d6/d8/d2f/d2e/d7b/l91 0 2024-09-10T10:04:16.528 INFO:tasks.workunit.client.0.smithi071.stdout:7/446: mknod d9/d1a/c9f 0 2024-09-10T10:04:16.528 INFO:tasks.workunit.client.0.smithi071.stdout:1/361: chown d1/d3f/d58 35817198 1 2024-09-10T10:04:16.529 INFO:tasks.workunit.client.0.smithi071.stdout:7/447: chown d9/d15/d1f 1 1 2024-09-10T10:04:16.529 INFO:tasks.workunit.client.1.smithi107.stdout:0/466: stat d6/d8/d2f/d2e/d32/f6c 0 2024-09-10T10:04:16.529 INFO:tasks.workunit.client.1.smithi107.stdout:1/513: mknod d2/ca4 0 2024-09-10T10:04:16.530 INFO:tasks.workunit.client.1.smithi107.stdout:1/514: readlink d2/d6/d24/l88 0 2024-09-10T10:04:16.532 INFO:tasks.workunit.client.1.smithi107.stdout:1/515: getdents d2/d35/d9c 0 2024-09-10T10:04:16.534 INFO:tasks.workunit.client.0.smithi071.stdout:1/362: dwrite d1/d21/d2f/d30/d6a/f6d [0,4194304] 0 2024-09-10T10:04:16.537 INFO:tasks.workunit.client.0.smithi071.stdout:1/363: write d1/d21/d65/f53 [491423,101389] 0 2024-09-10T10:04:16.539 INFO:tasks.workunit.client.0.smithi071.stdout:1/364: mkdir d1/d3f/d5c/d72 0 2024-09-10T10:04:16.546 INFO:tasks.workunit.client.0.smithi071.stdout:1/365: dwrite d1/d35/f6e [0,4194304] 0 2024-09-10T10:04:16.548 INFO:tasks.workunit.client.1.smithi107.stdout:9/457: truncate d5/d7/d3c/d53/d57/f7a 980003 0 2024-09-10T10:04:16.548 INFO:tasks.workunit.client.0.smithi071.stdout:8/370: rename d5/df/d16 to d5/df/d1d/d86 0 2024-09-10T10:04:16.550 INFO:tasks.workunit.client.0.smithi071.stdout:1/366: creat d1/d21/d2f/d30/f73 x:0 0 0 2024-09-10T10:04:16.550 INFO:tasks.workunit.client.1.smithi107.stdout:9/458: truncate d5/d7/fb 4900030 0 2024-09-10T10:04:16.551 INFO:tasks.workunit.client.1.smithi107.stdout:9/459: chown d5/d7/f78 81 1 2024-09-10T10:04:16.552 INFO:tasks.workunit.client.0.smithi071.stdout:1/367: write d1/d21/d2f/d30/f73 [652675,1661] 0 2024-09-10T10:04:16.552 INFO:tasks.workunit.client.0.smithi071.stdout:8/371: creat d5/df/d1d/d86/d75/f87 x:0 0 0 2024-09-10T10:04:16.554 INFO:tasks.workunit.client.0.smithi071.stdout:8/372: write d5/d36/f41 [1466017,16999] 0 2024-09-10T10:04:16.554 INFO:tasks.workunit.client.1.smithi107.stdout:9/460: mknod d5/d7/d1d/d3b/ca7 0 2024-09-10T10:04:16.554 INFO:tasks.workunit.client.1.smithi107.stdout:1/516: write d2/d12/d5a/f62 [764195,61825] 0 2024-09-10T10:04:16.556 INFO:tasks.workunit.client.1.smithi107.stdout:1/517: write d2/d35/f98 [829216,69683] 0 2024-09-10T10:04:16.557 INFO:tasks.workunit.client.0.smithi071.stdout:0/341: truncate d11/d22/d40/f44 298671 0 2024-09-10T10:04:16.558 INFO:tasks.workunit.client.0.smithi071.stdout:7/448: rename d9/d15/d1f/f31 to d9/d15/d55/fa0 0 2024-09-10T10:04:16.559 INFO:tasks.workunit.client.1.smithi107.stdout:9/461: creat d5/d7/d1d/d41/d83/d9a/fa8 x:0 0 0 2024-09-10T10:04:16.559 INFO:tasks.workunit.client.1.smithi107.stdout:1/518: symlink d2/d12/d7e/la5 0 2024-09-10T10:04:16.560 INFO:tasks.workunit.client.1.smithi107.stdout:9/462: write d5/f5c [3326118,109855] 0 2024-09-10T10:04:16.561 INFO:tasks.workunit.client.0.smithi071.stdout:8/373: dwrite d5/df/f80 [0,4194304] 0 2024-09-10T10:04:16.562 INFO:tasks.workunit.client.0.smithi071.stdout:7/449: read f2 [6113213,46706] 0 2024-09-10T10:04:16.562 INFO:tasks.workunit.client.0.smithi071.stdout:8/374: readlink d5/l40 0 2024-09-10T10:04:16.563 INFO:tasks.workunit.client.1.smithi107.stdout:1/519: dread d2/f32 [0,4194304] 0 2024-09-10T10:04:16.564 INFO:tasks.workunit.client.0.smithi071.stdout:7/450: write d9/d15/d1f/d74/f86 [668646,93808] 0 2024-09-10T10:04:16.565 INFO:tasks.workunit.client.1.smithi107.stdout:1/520: mknod d2/d89/ca6 0 2024-09-10T10:04:16.565 INFO:tasks.workunit.client.0.smithi071.stdout:0/342: creat d11/d30/d70/f75 x:0 0 0 2024-09-10T10:04:16.568 INFO:tasks.workunit.client.1.smithi107.stdout:1/521: getdents d2/d35/d9c 0 2024-09-10T10:04:16.569 INFO:tasks.workunit.client.1.smithi107.stdout:1/522: write d2/d35/f8c [522290,68411] 0 2024-09-10T10:04:16.571 INFO:tasks.workunit.client.1.smithi107.stdout:1/523: dread - d2/d12/f3c zero size 2024-09-10T10:04:16.572 INFO:tasks.workunit.client.1.smithi107.stdout:1/524: read d2/d12/d5a/f73 [108088,22648] 0 2024-09-10T10:04:16.572 INFO:tasks.workunit.client.0.smithi071.stdout:7/451: getdents d9/d15/d1f/d74/d9b 0 2024-09-10T10:04:16.573 INFO:tasks.workunit.client.0.smithi071.stdout:1/368: rename d1/d21/f4d to d1/f74 0 2024-09-10T10:04:16.574 INFO:tasks.workunit.client.0.smithi071.stdout:8/375: getdents d5 0 2024-09-10T10:04:16.635 INFO:tasks.workunit.client.0.smithi071.stdout:4/424: sync 2024-09-10T10:04:16.635 INFO:tasks.workunit.client.0.smithi071.stdout:5/344: sync 2024-09-10T10:04:16.635 INFO:tasks.workunit.client.0.smithi071.stdout:1/369: stat d1/f1f 0 2024-09-10T10:04:16.637 INFO:tasks.workunit.client.0.smithi071.stdout:4/425: readlink db/d15/d17/d24/l48 0 2024-09-10T10:04:16.637 INFO:tasks.workunit.client.0.smithi071.stdout:5/345: write dc/df/d17/f2b [825930,91393] 0 2024-09-10T10:04:16.638 INFO:tasks.workunit.client.0.smithi071.stdout:1/370: rmdir d1/d57 39 2024-09-10T10:04:16.639 INFO:tasks.workunit.client.0.smithi071.stdout:7/452: dwrite d9/d15/d40/f95 [0,4194304] 0 2024-09-10T10:04:16.640 INFO:tasks.workunit.client.0.smithi071.stdout:4/426: chown db/d15/d17/d4e/d5a/f7c 4383026 1 2024-09-10T10:04:16.642 INFO:tasks.workunit.client.0.smithi071.stdout:8/376: truncate d5/df/d1d/d86/f29 1022777 0 2024-09-10T10:04:16.643 INFO:tasks.workunit.client.0.smithi071.stdout:7/453: mkdir d9/d15/d1f/d74/da1 0 2024-09-10T10:04:16.644 INFO:tasks.workunit.client.0.smithi071.stdout:8/377: read - d5/d36/d49/f61 zero size 2024-09-10T10:04:16.644 INFO:tasks.workunit.client.0.smithi071.stdout:4/427: mkdir db/d15/d17/d4e/d5a/d8d 0 2024-09-10T10:04:16.646 INFO:tasks.workunit.client.0.smithi071.stdout:7/454: mkdir d9/d1a/da2 0 2024-09-10T10:04:16.646 INFO:tasks.workunit.client.0.smithi071.stdout:8/378: dread - d5/d36/d49/f4f zero size 2024-09-10T10:04:16.647 INFO:tasks.workunit.client.0.smithi071.stdout:4/428: dread - db/d15/d26/d43/d82/f8c zero size 2024-09-10T10:04:16.647 INFO:tasks.workunit.client.0.smithi071.stdout:1/371: dwrite d1/f9 [0,4194304] 0 2024-09-10T10:04:16.648 INFO:tasks.workunit.client.0.smithi071.stdout:4/429: chown db/d1d/d7a 26 1 2024-09-10T10:04:16.650 INFO:tasks.workunit.client.0.smithi071.stdout:7/455: truncate d9/d15/d55/d58/f5c 842790 0 2024-09-10T10:04:16.650 INFO:tasks.workunit.client.0.smithi071.stdout:8/379: mknod d5/df/d1e/d38/d62/c88 0 2024-09-10T10:04:16.652 INFO:tasks.workunit.client.0.smithi071.stdout:8/380: dread d5/f45 [0,4194304] 0 2024-09-10T10:04:16.655 INFO:tasks.workunit.client.0.smithi071.stdout:8/381: truncate d5/d36/f6d 323866 0 2024-09-10T10:04:16.657 INFO:tasks.workunit.client.0.smithi071.stdout:5/346: dwrite dc/df/d17/d22/f44 [0,4194304] 0 2024-09-10T10:04:16.659 INFO:tasks.workunit.client.0.smithi071.stdout:8/382: symlink d5/df/d1d/l89 0 2024-09-10T10:04:16.660 INFO:tasks.workunit.client.0.smithi071.stdout:7/456: dwrite d9/d15/d40/d80/f94 [0,4194304] 0 2024-09-10T10:04:16.660 INFO:tasks.workunit.client.0.smithi071.stdout:5/347: symlink dc/df/l7a 0 2024-09-10T10:04:16.662 INFO:tasks.workunit.client.0.smithi071.stdout:8/383: creat d5/df/d57/f8a x:0 0 0 2024-09-10T10:04:16.669 INFO:tasks.workunit.client.0.smithi071.stdout:8/384: creat d5/df/d1d/d86/d75/f8b x:0 0 0 2024-09-10T10:04:16.669 INFO:tasks.workunit.client.0.smithi071.stdout:5/348: dwrite dc/df/d17/f2b [0,4194304] 0 2024-09-10T10:04:16.674 INFO:tasks.workunit.client.0.smithi071.stdout:5/349: readlink dc/df/d29/l4f 0 2024-09-10T10:04:16.680 INFO:tasks.workunit.client.0.smithi071.stdout:8/385: dwrite d5/df/f5b [0,4194304] 0 2024-09-10T10:04:16.684 INFO:tasks.workunit.client.0.smithi071.stdout:5/350: truncate dc/f3c 3467818 0 2024-09-10T10:04:16.687 INFO:tasks.workunit.client.0.smithi071.stdout:7/457: dread d9/f19 [0,4194304] 0 2024-09-10T10:04:16.688 INFO:tasks.workunit.client.0.smithi071.stdout:8/386: getdents d5/df 0 2024-09-10T10:04:16.689 INFO:tasks.workunit.client.0.smithi071.stdout:8/387: chown d5/c14 1819 1 2024-09-10T10:04:16.690 INFO:tasks.workunit.client.0.smithi071.stdout:7/458: creat d9/d70/fa3 x:0 0 0 2024-09-10T10:04:16.690 INFO:tasks.workunit.client.0.smithi071.stdout:7/459: stat d9/d76/f96 0 2024-09-10T10:04:16.691 INFO:tasks.workunit.client.0.smithi071.stdout:7/460: chown d9/d15/d55/f6e 17264 1 2024-09-10T10:04:16.691 INFO:tasks.workunit.client.0.smithi071.stdout:8/388: creat d5/df/d1d/f8c x:0 0 0 2024-09-10T10:04:16.693 INFO:tasks.workunit.client.0.smithi071.stdout:7/461: mknod d9/d2c/d49/ca4 0 2024-09-10T10:04:16.694 INFO:tasks.workunit.client.0.smithi071.stdout:7/462: write d9/d15/f51 [4264433,49016] 0 2024-09-10T10:04:16.698 INFO:tasks.workunit.client.0.smithi071.stdout:7/463: mkdir d9/d15/d1f/d74/da5 0 2024-09-10T10:04:16.698 INFO:tasks.workunit.client.0.smithi071.stdout:7/464: chown d9/d76/f42 26 1 2024-09-10T10:04:16.704 INFO:tasks.workunit.client.0.smithi071.stdout:3/349: sync 2024-09-10T10:04:16.704 INFO:tasks.workunit.client.0.smithi071.stdout:7/465: dwrite d9/f19 [0,4194304] 0 2024-09-10T10:04:16.707 INFO:tasks.workunit.client.0.smithi071.stdout:7/466: mknod d9/d15/d1f/d98/ca6 0 2024-09-10T10:04:16.709 INFO:tasks.workunit.client.0.smithi071.stdout:3/350: getdents d3/d10/d24/d2b 0 2024-09-10T10:04:16.711 INFO:tasks.workunit.client.0.smithi071.stdout:3/351: symlink d3/d20/d30/d42/d4a/d60/d78/l7d 0 2024-09-10T10:04:16.725 INFO:tasks.workunit.client.0.smithi071.stdout:3/352: truncate d3/f21 3655171 0 2024-09-10T10:04:16.726 INFO:tasks.workunit.client.0.smithi071.stdout:3/353: mknod d3/d49/d34/c7e 0 2024-09-10T10:04:16.730 INFO:tasks.workunit.client.0.smithi071.stdout:3/354: write d3/d49/f4c [1726154,23467] 0 2024-09-10T10:04:16.732 INFO:tasks.workunit.client.0.smithi071.stdout:3/355: mkdir d3/d49/d2f/d7f 0 2024-09-10T10:04:16.736 INFO:tasks.workunit.client.0.smithi071.stdout:3/356: dwrite d3/d49/f4c [0,4194304] 0 2024-09-10T10:04:16.745 INFO:tasks.workunit.client.0.smithi071.stdout:3/357: dwrite d3/ff [0,4194304] 0 2024-09-10T10:04:16.746 INFO:tasks.workunit.client.0.smithi071.stdout:3/358: fdatasync d3/d20/d30/d3a/f68 0 2024-09-10T10:04:16.821 INFO:tasks.workunit.client.0.smithi071.stdout:3/359: rmdir d3/d20/d30 39 2024-09-10T10:04:16.822 INFO:tasks.workunit.client.0.smithi071.stdout:3/360: truncate d3/d1c/f79 455132 0 2024-09-10T10:04:16.823 INFO:tasks.workunit.client.0.smithi071.stdout:3/361: chown d3/d20/d30/d3a/f45 6 1 2024-09-10T10:04:16.826 INFO:tasks.workunit.client.0.smithi071.stdout:3/362: write d3/f18 [2939294,103145] 0 2024-09-10T10:04:16.827 INFO:tasks.workunit.client.0.smithi071.stdout:3/363: dread - d3/d1c/d3c/f6f zero size 2024-09-10T10:04:16.828 INFO:tasks.workunit.client.0.smithi071.stdout:3/364: fdatasync d3/d20/d39/f62 0 2024-09-10T10:04:16.829 INFO:tasks.workunit.client.0.smithi071.stdout:3/365: truncate d3/d10/d24/f25 4907106 0 2024-09-10T10:04:16.830 INFO:tasks.workunit.client.0.smithi071.stdout:3/366: write d3/d20/d30/d5d/f74 [4275186,91588] 0 2024-09-10T10:04:16.831 INFO:tasks.workunit.client.0.smithi071.stdout:3/367: write d3/d49/d34/f6e [125839,71456] 0 2024-09-10T10:04:16.832 INFO:tasks.workunit.client.0.smithi071.stdout:3/368: chown d3/f21 103485 1 2024-09-10T10:04:16.833 INFO:tasks.workunit.client.0.smithi071.stdout:3/369: mknod d3/d49/d2f/c80 0 2024-09-10T10:04:16.835 INFO:tasks.workunit.client.0.smithi071.stdout:3/370: creat d3/d49/d34/f81 x:0 0 0 2024-09-10T10:04:16.842 INFO:tasks.workunit.client.1.smithi107.stdout:4/535: sync 2024-09-10T10:04:16.845 INFO:tasks.workunit.client.0.smithi071.stdout:9/582: sync 2024-09-10T10:04:16.846 INFO:tasks.workunit.client.0.smithi071.stdout:3/371: dread d3/f18 [0,4194304] 0 2024-09-10T10:04:16.848 INFO:tasks.workunit.client.0.smithi071.stdout:9/583: mkdir d0/db/d1b/d1d/d4b/db9/dba 0 2024-09-10T10:04:16.852 INFO:tasks.workunit.client.0.smithi071.stdout:9/584: unlink d0/db/d20/d21/c51 0 2024-09-10T10:04:16.852 INFO:tasks.workunit.client.0.smithi071.stdout:3/372: dwrite d3/d49/f4c [4194304,4194304] 0 2024-09-10T10:04:16.853 INFO:tasks.workunit.client.1.smithi107.stdout:4/536: dwrite d0/d40/d75/f44 [0,4194304] 0 2024-09-10T10:04:16.855 INFO:tasks.workunit.client.0.smithi071.stdout:3/373: creat d3/d1c/d3c/f82 x:0 0 0 2024-09-10T10:04:16.855 INFO:tasks.workunit.client.1.smithi107.stdout:4/537: read d0/d40/d57/f3e [2961587,95652] 0 2024-09-10T10:04:16.856 INFO:tasks.workunit.client.0.smithi071.stdout:3/374: fsync d3/fd 0 2024-09-10T10:04:16.859 INFO:tasks.workunit.client.1.smithi107.stdout:4/538: mkdir d0/d1f/d20/d47/dbe 0 2024-09-10T10:04:16.861 INFO:tasks.workunit.client.0.smithi071.stdout:3/375: write d3/d20/f2c [1717103,65140] 0 2024-09-10T10:04:16.863 INFO:tasks.workunit.client.0.smithi071.stdout:9/585: dwrite d0/db/d20/d3c/fb0 [0,4194304] 0 2024-09-10T10:04:16.864 INFO:tasks.workunit.client.0.smithi071.stdout:3/376: write d3/d10/d24/f25 [5621425,62264] 0 2024-09-10T10:04:16.866 INFO:tasks.workunit.client.1.smithi107.stdout:4/539: dwrite d0/d82/f91 [0,4194304] 0 2024-09-10T10:04:16.867 INFO:tasks.workunit.client.0.smithi071.stdout:9/586: symlink d0/d3b/d5c/d6a/lbb 0 2024-09-10T10:04:16.868 INFO:tasks.workunit.client.0.smithi071.stdout:3/377: fdatasync d3/d20/d30/d5d/f74 0 2024-09-10T10:04:16.873 INFO:tasks.workunit.client.1.smithi107.stdout:4/540: dread d0/d40/fb2 [0,4194304] 0 2024-09-10T10:04:16.873 INFO:tasks.workunit.client.0.smithi071.stdout:9/587: creat d0/db/d1b/d1d/d5b/fbc x:0 0 0 2024-09-10T10:04:16.876 INFO:tasks.workunit.client.0.smithi071.stdout:3/378: creat d3/d49/d2f/d7f/f83 x:0 0 0 2024-09-10T10:04:16.876 INFO:tasks.workunit.client.0.smithi071.stdout:3/379: chown d3/d20/f63 0 1 2024-09-10T10:04:16.876 INFO:tasks.workunit.client.1.smithi107.stdout:4/541: symlink d0/d1f/d20/d80/lbf 0 2024-09-10T10:04:16.877 INFO:tasks.workunit.client.1.smithi107.stdout:4/542: chown d0/c27 517 1 2024-09-10T10:04:16.879 INFO:tasks.workunit.client.1.smithi107.stdout:4/543: write d0/d40/d57/d4f/f61 [1253962,48725] 0 2024-09-10T10:04:16.879 INFO:tasks.workunit.client.0.smithi071.stdout:3/380: creat d3/d10/f84 x:0 0 0 2024-09-10T10:04:16.880 INFO:tasks.workunit.client.0.smithi071.stdout:9/588: creat d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/fbd x:0 0 0 2024-09-10T10:04:16.882 INFO:tasks.workunit.client.0.smithi071.stdout:3/381: symlink d3/d49/d2f/d76/l85 0 2024-09-10T10:04:16.882 INFO:tasks.workunit.client.0.smithi071.stdout:3/382: chown d3/d10/f2d 418 1 2024-09-10T10:04:16.883 INFO:tasks.workunit.client.0.smithi071.stdout:9/589: symlink d0/db/d1b/d1d/d4b/db9/dba/lbe 0 2024-09-10T10:04:16.883 INFO:tasks.workunit.client.0.smithi071.stdout:3/383: write d3/f1b [2888290,11457] 0 2024-09-10T10:04:16.890 INFO:tasks.workunit.client.0.smithi071.stdout:9/590: dwrite d0/f2e [0,4194304] 0 2024-09-10T10:04:16.892 INFO:tasks.workunit.client.0.smithi071.stdout:3/384: dwrite d3/d10/d24/d2b/f5a [0,4194304] 0 2024-09-10T10:04:16.893 INFO:tasks.workunit.client.0.smithi071.stdout:9/591: mknod d0/d3b/cbf 0 2024-09-10T10:04:16.893 INFO:tasks.workunit.client.0.smithi071.stdout:3/385: chown d3/d20 8028 1 2024-09-10T10:04:16.894 INFO:tasks.workunit.client.0.smithi071.stdout:9/592: chown d0/db/d1b/d1d/d5b/f4d 88 1 2024-09-10T10:04:16.897 INFO:tasks.workunit.client.0.smithi071.stdout:9/593: rmdir d0/db/d1b/d1d/d30/d54 39 2024-09-10T10:04:16.899 INFO:tasks.workunit.client.0.smithi071.stdout:9/594: mkdir d0/db/d20/dc0 0 2024-09-10T10:04:16.901 INFO:tasks.workunit.client.0.smithi071.stdout:9/595: fsync d0/db/d20/f2b 0 2024-09-10T10:04:16.902 INFO:tasks.workunit.client.0.smithi071.stdout:3/386: getdents d3/d49/d2f 0 2024-09-10T10:04:16.903 INFO:tasks.workunit.client.0.smithi071.stdout:3/387: dread - d3/d49/f6c zero size 2024-09-10T10:04:16.906 INFO:tasks.workunit.client.0.smithi071.stdout:3/388: dread d3/d1c/f79 [0,4194304] 0 2024-09-10T10:04:16.907 INFO:tasks.workunit.client.1.smithi107.stdout:4/544: dread d0/d40/d57/d76/d77/da1/d59/fb1 [0,4194304] 0 2024-09-10T10:04:16.908 INFO:tasks.workunit.client.0.smithi071.stdout:3/389: symlink d3/l86 0 2024-09-10T10:04:16.910 INFO:tasks.workunit.client.1.smithi107.stdout:4/545: truncate d0/d40/d57/f74 4885603 0 2024-09-10T10:04:16.911 INFO:tasks.workunit.client.0.smithi071.stdout:9/596: dwrite d0/db/d1b/d1d/d4b/dad/fa3 [0,4194304] 0 2024-09-10T10:04:16.911 INFO:tasks.workunit.client.0.smithi071.stdout:3/390: mkdir d3/d10/d87 0 2024-09-10T10:04:16.912 INFO:tasks.workunit.client.0.smithi071.stdout:9/597: readlink d0/db/d1b/d1d/d5b/d60/l62 0 2024-09-10T10:04:16.914 INFO:tasks.workunit.client.0.smithi071.stdout:3/391: rename d3/l86 to d3/d20/d30/d5d/d7a/l88 0 2024-09-10T10:04:16.915 INFO:tasks.workunit.client.1.smithi107.stdout:4/546: getdents d0/d40/d57/d76/d77/da1 0 2024-09-10T10:04:16.915 INFO:tasks.workunit.client.0.smithi071.stdout:3/392: readlink d3/d20/d30/l6a 0 2024-09-10T10:04:16.916 INFO:tasks.workunit.client.1.smithi107.stdout:4/547: dread - d0/d40/d57/d76/d77/da9/fb7 zero size 2024-09-10T10:04:16.917 INFO:tasks.workunit.client.1.smithi107.stdout:5/500: sync 2024-09-10T10:04:16.917 INFO:tasks.workunit.client.1.smithi107.stdout:2/488: sync 2024-09-10T10:04:16.917 INFO:tasks.workunit.client.1.smithi107.stdout:3/686: sync 2024-09-10T10:04:16.917 INFO:tasks.workunit.client.1.smithi107.stdout:6/486: sync 2024-09-10T10:04:16.917 INFO:tasks.workunit.client.1.smithi107.stdout:7/382: sync 2024-09-10T10:04:16.920 INFO:tasks.workunit.client.1.smithi107.stdout:3/687: chown dc/dd/d20/d23/d39/d69/c8b 225677380 1 2024-09-10T10:04:16.921 INFO:tasks.workunit.client.1.smithi107.stdout:2/489: mkdir d3/da/d66/d91/dae 0 2024-09-10T10:04:16.923 INFO:tasks.workunit.client.1.smithi107.stdout:5/501: link de/d41/f52 de/d4a/d4e/d89/d99/fac 0 2024-09-10T10:04:16.927 INFO:tasks.workunit.client.1.smithi107.stdout:2/490: fsync d3/da/d1e/d40/d8a/d7f/d55/d85/f75 0 2024-09-10T10:04:16.928 INFO:tasks.workunit.client.1.smithi107.stdout:4/548: dwrite d0/d1f/d20/f51 [0,4194304] 0 2024-09-10T10:04:16.928 INFO:tasks.workunit.client.1.smithi107.stdout:3/688: creat dc/dd/d45/d26/d41/d44/d35/d4a/dd8/de0/fe5 x:0 0 0 2024-09-10T10:04:16.929 INFO:tasks.workunit.client.1.smithi107.stdout:5/502: mkdir de/d20/d2b/d4b/d8c/dad 0 2024-09-10T10:04:16.932 INFO:tasks.workunit.client.1.smithi107.stdout:2/491: rmdir d3/d6d 39 2024-09-10T10:04:16.932 INFO:tasks.workunit.client.1.smithi107.stdout:4/549: chown d0/d1f/d20/f51 238 1 2024-09-10T10:04:16.933 INFO:tasks.workunit.client.1.smithi107.stdout:3/689: chown dc/dd/l30 1915142 1 2024-09-10T10:04:16.933 INFO:tasks.workunit.client.1.smithi107.stdout:6/487: dread d0/d3d/d14/d17/d49/d55/d73/f82 [0,4194304] 0 2024-09-10T10:04:16.933 INFO:tasks.workunit.client.1.smithi107.stdout:7/383: dwrite d0/d20/f44 [0,4194304] 0 2024-09-10T10:04:16.938 INFO:tasks.workunit.client.1.smithi107.stdout:3/690: chown dc/dd/d20/d23/d2f/d9c/fa7 2233374 1 2024-09-10T10:04:16.941 INFO:tasks.workunit.client.1.smithi107.stdout:6/488: mkdir d0/d3d/d14/d17/d49/d55/da6 0 2024-09-10T10:04:16.942 INFO:tasks.workunit.client.1.smithi107.stdout:2/492: symlink d3/d8f/da6/laf 0 2024-09-10T10:04:16.942 INFO:tasks.workunit.client.1.smithi107.stdout:4/550: dread d0/d1f/d20/f51 [0,4194304] 0 2024-09-10T10:04:16.944 INFO:tasks.workunit.client.0.smithi071.stdout:2/423: sync 2024-09-10T10:04:16.944 INFO:tasks.workunit.client.0.smithi071.stdout:6/346: sync 2024-09-10T10:04:16.945 INFO:tasks.workunit.client.1.smithi107.stdout:7/384: dwrite d0/f2b [0,4194304] 0 2024-09-10T10:04:16.946 INFO:tasks.workunit.client.1.smithi107.stdout:4/551: unlink d0/c1a 0 2024-09-10T10:04:16.947 INFO:tasks.workunit.client.1.smithi107.stdout:6/489: mkdir d0/d3d/d14/d21/d8a/da7 0 2024-09-10T10:04:16.947 INFO:tasks.workunit.client.1.smithi107.stdout:4/552: chown d0/d1f/d20/l3a 236204302 1 2024-09-10T10:04:16.949 INFO:tasks.workunit.client.1.smithi107.stdout:3/691: rename dc/dd/d45/d26/d41/f53 to dc/dd/d20/d23/d39/d69/fe6 0 2024-09-10T10:04:16.952 INFO:tasks.workunit.client.1.smithi107.stdout:6/490: creat d0/d3d/d14/d17/d4b/fa8 x:0 0 0 2024-09-10T10:04:16.954 INFO:tasks.workunit.client.0.smithi071.stdout:9/598: rmdir d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c 39 2024-09-10T10:04:16.956 INFO:tasks.workunit.client.1.smithi107.stdout:2/493: creat d3/da/df/d20/d36/fb0 x:0 0 0 2024-09-10T10:04:16.956 INFO:tasks.workunit.client.1.smithi107.stdout:7/385: dwrite d0/d8/d56/d5d/f67 [0,4194304] 0 2024-09-10T10:04:16.956 INFO:tasks.workunit.client.1.smithi107.stdout:6/491: write d0/d3d/d14/d17/d49/f7e [5174757,32459] 0 2024-09-10T10:04:16.958 INFO:tasks.workunit.client.0.smithi071.stdout:9/599: write d0/f87 [1096763,62114] 0 2024-09-10T10:04:16.962 INFO:tasks.workunit.client.0.smithi071.stdout:6/347: rename d4/da/df/l10 to d4/da/df/d5e/l6b 0 2024-09-10T10:04:16.964 INFO:tasks.workunit.client.0.smithi071.stdout:3/393: dwrite d3/d1c/d3c/f82 [0,4194304] 0 2024-09-10T10:04:16.965 INFO:tasks.workunit.client.0.smithi071.stdout:9/600: creat d0/db/d1b/d1d/d4b/db9/fc1 x:0 0 0 2024-09-10T10:04:16.967 INFO:tasks.workunit.client.0.smithi071.stdout:2/424: dwrite d8/f10 [0,4194304] 0 2024-09-10T10:04:16.967 INFO:tasks.workunit.client.1.smithi107.stdout:6/492: link d0/d3d/d14/d17/d24/f6f d0/d3d/d14/d42/fa9 0 2024-09-10T10:04:16.969 INFO:tasks.workunit.client.0.smithi071.stdout:6/348: write d4/f19 [1155677,84226] 0 2024-09-10T10:04:16.970 INFO:tasks.workunit.client.1.smithi107.stdout:7/386: dwrite d0/d1b/f28 [0,4194304] 0 2024-09-10T10:04:16.971 INFO:tasks.workunit.client.0.smithi071.stdout:6/349: readlink d4/da/df/l2a 0 2024-09-10T10:04:16.972 INFO:tasks.workunit.client.1.smithi107.stdout:7/387: readlink d0/d1b/d4d/d69/l74 0 2024-09-10T10:04:16.972 INFO:tasks.workunit.client.1.smithi107.stdout:2/494: dwrite d3/da/d1e/d40/d8a/d7f/f63 [0,4194304] 0 2024-09-10T10:04:16.975 INFO:tasks.workunit.client.0.smithi071.stdout:9/601: symlink d0/db/d20/dc0/lc2 0 2024-09-10T10:04:16.976 INFO:tasks.workunit.client.0.smithi071.stdout:3/394: truncate d3/f8 2389711 0 2024-09-10T10:04:16.977 INFO:tasks.workunit.client.1.smithi107.stdout:2/495: fsync d3/da/d1e/d27/d5b/f5c 0 2024-09-10T10:04:16.982 INFO:tasks.workunit.client.0.smithi071.stdout:2/425: rename d8/d87/d33/d41/d4d/d5e/f6f to d8/d87/d33/d41/d4d/f8c 0 2024-09-10T10:04:16.983 INFO:tasks.workunit.client.0.smithi071.stdout:6/350: creat d4/f6c x:0 0 0 2024-09-10T10:04:16.983 INFO:tasks.workunit.client.1.smithi107.stdout:3/692: truncate dc/dd/d20/d23/d2f/d9c/fa7 3887673 0 2024-09-10T10:04:16.984 INFO:tasks.workunit.client.0.smithi071.stdout:3/395: creat d3/d20/d30/d5d/d7a/f89 x:0 0 0 2024-09-10T10:04:16.985 INFO:tasks.workunit.client.1.smithi107.stdout:4/553: dwrite d0/d1f/d5e/f73 [0,4194304] 0 2024-09-10T10:04:16.987 INFO:tasks.workunit.client.1.smithi107.stdout:2/496: write d3/da/df/d20/d36/d39/f84 [410253,30877] 0 2024-09-10T10:04:16.987 INFO:tasks.workunit.client.0.smithi071.stdout:2/426: mkdir d8/d38/d8d 0 2024-09-10T10:04:16.989 INFO:tasks.workunit.client.0.smithi071.stdout:9/602: dwrite d0/db/d1b/d1d/d5b/d60/f98 [0,4194304] 0 2024-09-10T10:04:16.990 INFO:tasks.workunit.client.0.smithi071.stdout:6/351: rename d4/da/c24 to d4/da/df/c6d 0 2024-09-10T10:04:16.993 INFO:tasks.workunit.client.1.smithi107.stdout:4/554: creat d0/d1f/d20/fc0 x:0 0 0 2024-09-10T10:04:16.994 INFO:tasks.workunit.client.0.smithi071.stdout:6/352: rmdir d4/da/df/d2e/d3a/d43 39 2024-09-10T10:04:16.994 INFO:tasks.workunit.client.0.smithi071.stdout:3/396: symlink d3/d1c/d3c/d66/l8a 0 2024-09-10T10:04:16.996 INFO:tasks.workunit.client.0.smithi071.stdout:3/397: write d3/d20/d30/d3a/f45 [830011,17895] 0 2024-09-10T10:04:16.997 INFO:tasks.workunit.client.1.smithi107.stdout:4/555: truncate d0/d40/fad 405470 0 2024-09-10T10:04:16.997 INFO:tasks.workunit.client.1.smithi107.stdout:2/497: dwrite d3/da/df/d78/f80 [0,4194304] 0 2024-09-10T10:04:16.998 INFO:tasks.workunit.client.0.smithi071.stdout:2/427: rename d8/d38/l50 to d8/d87/d33/d41/d4d/l8e 0 2024-09-10T10:04:16.999 INFO:tasks.workunit.client.1.smithi107.stdout:7/388: link d0/ca d0/d8/dc/d2c/d47/c76 0 2024-09-10T10:04:17.000 INFO:tasks.workunit.client.0.smithi071.stdout:6/353: symlink d4/da/df/d5e/l6e 0 2024-09-10T10:04:17.000 INFO:tasks.workunit.client.1.smithi107.stdout:3/693: mkdir dc/dd/d45/d26/d41/d44/d35/d4a/de1/de7 0 2024-09-10T10:04:17.001 INFO:tasks.workunit.client.0.smithi071.stdout:3/398: mknod d3/d20/d39/c8b 0 2024-09-10T10:04:17.002 INFO:tasks.workunit.client.1.smithi107.stdout:4/556: stat d0/d40/d57/d76/d77/da1/d59/c99 0 2024-09-10T10:04:17.002 INFO:tasks.workunit.client.0.smithi071.stdout:3/399: write d3/d20/d30/d3a/f45 [366455,62016] 0 2024-09-10T10:04:17.003 INFO:tasks.workunit.client.1.smithi107.stdout:7/389: write d0/d8/dc/f1f [1754233,12101] 0 2024-09-10T10:04:17.003 INFO:tasks.workunit.client.0.smithi071.stdout:6/354: unlink d4/f28 0 2024-09-10T10:04:17.005 INFO:tasks.workunit.client.1.smithi107.stdout:2/498: unlink d3/d8f/da6/laf 0 2024-09-10T10:04:17.007 INFO:tasks.workunit.client.0.smithi071.stdout:2/428: creat d8/f8f x:0 0 0 2024-09-10T10:04:17.008 INFO:tasks.workunit.client.1.smithi107.stdout:3/694: mkdir dc/dd/d42/de8 0 2024-09-10T10:04:17.009 INFO:tasks.workunit.client.0.smithi071.stdout:6/355: fdatasync d4/da/df/d2e/d3a/d43/f49 0 2024-09-10T10:04:17.010 INFO:tasks.workunit.client.1.smithi107.stdout:4/557: creat d0/d1f/d90/fc1 x:0 0 0 2024-09-10T10:04:17.010 INFO:tasks.workunit.client.1.smithi107.stdout:3/695: chown dc/dd/d20/la0 15600574 1 2024-09-10T10:04:17.012 INFO:tasks.workunit.client.0.smithi071.stdout:3/400: link d3/d20/f2c d3/f8c 0 2024-09-10T10:04:17.013 INFO:tasks.workunit.client.0.smithi071.stdout:2/429: rename d8/l39 to d8/d87/d33/d53/l90 0 2024-09-10T10:04:17.013 INFO:tasks.workunit.client.1.smithi107.stdout:7/390: write d0/d8/d9/d68/f64 [30086,39815] 0 2024-09-10T10:04:17.013 INFO:tasks.workunit.client.1.smithi107.stdout:6/493: dwrite d0/d3d/d14/d17/f3b [0,4194304] 0 2024-09-10T10:04:17.014 INFO:tasks.workunit.client.1.smithi107.stdout:2/499: dread d3/da/d1e/f3f [0,4194304] 0 2024-09-10T10:04:17.015 INFO:tasks.workunit.client.0.smithi071.stdout:6/356: dwrite d4/da/fb [0,4194304] 0 2024-09-10T10:04:17.016 INFO:tasks.workunit.client.1.smithi107.stdout:4/558: mknod d0/d40/d57/d76/d77/d8d/cc2 0 2024-09-10T10:04:17.016 INFO:tasks.workunit.client.0.smithi071.stdout:6/357: chown d4/d1c/f4d 6 1 2024-09-10T10:04:17.017 INFO:tasks.workunit.client.0.smithi071.stdout:2/430: mknod d8/d38/d47/d59/d65/c91 0 2024-09-10T10:04:17.018 INFO:tasks.workunit.client.0.smithi071.stdout:2/431: chown d8/d87/d33/d41/d4d/d52 3123 1 2024-09-10T10:04:17.019 INFO:tasks.workunit.client.1.smithi107.stdout:4/559: write d0/d40/f6a [778339,4540] 0 2024-09-10T10:04:17.019 INFO:tasks.workunit.client.1.smithi107.stdout:7/391: write d0/d20/d35/f54 [664115,88032] 0 2024-09-10T10:04:17.019 INFO:tasks.workunit.client.1.smithi107.stdout:6/494: write d0/d3d/d14/d21/f25 [4122152,31930] 0 2024-09-10T10:04:17.021 INFO:tasks.workunit.client.0.smithi071.stdout:6/358: creat d4/da/df/d2e/d3a/d3e/d5d/f6f x:0 0 0 2024-09-10T10:04:17.023 INFO:tasks.workunit.client.1.smithi107.stdout:7/392: chown d0/d8/dc/c22 5813812 1 2024-09-10T10:04:17.023 INFO:tasks.workunit.client.0.smithi071.stdout:2/432: symlink d8/d87/d33/l92 0 2024-09-10T10:04:17.025 INFO:tasks.workunit.client.1.smithi107.stdout:3/696: getdents dc/dd/d45/d26/d59/d78 0 2024-09-10T10:04:17.025 INFO:tasks.workunit.client.0.smithi071.stdout:6/359: creat d4/da/df/d2e/d3a/d51/d64/f70 x:0 0 0 2024-09-10T10:04:17.027 INFO:tasks.workunit.client.0.smithi071.stdout:2/433: creat d8/d38/d47/d59/d65/f93 x:0 0 0 2024-09-10T10:04:17.031 INFO:tasks.workunit.client.1.smithi107.stdout:2/500: dwrite d3/da/d1e/f3f [0,4194304] 0 2024-09-10T10:04:17.036 INFO:tasks.workunit.client.1.smithi107.stdout:7/393: rename d0/d1b/l3c to d0/d8/d9/l77 0 2024-09-10T10:04:17.036 INFO:tasks.workunit.client.1.smithi107.stdout:6/495: dwrite d0/d3d/d14/f9e [0,4194304] 0 2024-09-10T10:04:17.041 INFO:tasks.workunit.client.1.smithi107.stdout:2/501: rmdir d3/da/d1e/d40/d8a/d7f/d55 39 2024-09-10T10:04:17.041 INFO:tasks.workunit.client.1.smithi107.stdout:4/560: dwrite d0/d40/d75/f5f [0,4194304] 0 2024-09-10T10:04:17.044 INFO:tasks.workunit.client.1.smithi107.stdout:2/502: chown d3/da/d66/d91/dae 25 1 2024-09-10T10:04:17.045 INFO:tasks.workunit.client.1.smithi107.stdout:2/503: stat d3/l2d 0 2024-09-10T10:04:17.049 INFO:tasks.workunit.client.1.smithi107.stdout:6/496: link d0/d3d/d14/d21/f53 d0/d76/faa 0 2024-09-10T10:04:17.049 INFO:tasks.workunit.client.1.smithi107.stdout:3/697: dwrite dc/dd/d45/d26/d41/d44/f2d [0,4194304] 0 2024-09-10T10:04:17.051 INFO:tasks.workunit.client.1.smithi107.stdout:4/561: rename d0/d1f/d20/f2b to d0/d40/d57/d76/d77/d8d/fc3 0 2024-09-10T10:04:17.053 INFO:tasks.workunit.client.1.smithi107.stdout:2/504: fdatasync d3/d21/f3a 0 2024-09-10T10:04:17.053 INFO:tasks.workunit.client.0.smithi071.stdout:6/360: creat d4/da/df/d2e/d3a/d3e/d45/f71 x:0 0 0 2024-09-10T10:04:17.055 INFO:tasks.workunit.client.0.smithi071.stdout:9/603: write d0/d3b/f86 [304155,104350] 0 2024-09-10T10:04:17.056 INFO:tasks.workunit.client.0.smithi071.stdout:2/434: unlink d8/d87/d33/d41/d4d/d5e/l78 0 2024-09-10T10:04:17.057 INFO:tasks.workunit.client.0.smithi071.stdout:9/604: write d0/db/d1b/d1d/f35 [1632442,49974] 0 2024-09-10T10:04:17.060 INFO:tasks.workunit.client.1.smithi107.stdout:2/505: dread d3/da/d1e/d40/d8a/f89 [0,4194304] 0 2024-09-10T10:04:17.060 INFO:tasks.workunit.client.0.smithi071.stdout:6/361: unlink d4/da/df/d2e/d3a/d43/c5b 0 2024-09-10T10:04:17.060 INFO:tasks.workunit.client.1.smithi107.stdout:3/698: creat dc/dd/d42/de8/fe9 x:0 0 0 2024-09-10T10:04:17.060 INFO:tasks.workunit.client.1.smithi107.stdout:2/506: chown d3/da/l8d 4016984 1 2024-09-10T10:04:17.061 INFO:tasks.workunit.client.0.smithi071.stdout:6/362: truncate d4/d1c/f4b 511095 0 2024-09-10T10:04:17.062 INFO:tasks.workunit.client.1.smithi107.stdout:2/507: read - d3/da/d1e/d5f/d54/f7d zero size 2024-09-10T10:04:17.062 INFO:tasks.workunit.client.1.smithi107.stdout:3/699: fdatasync dc/dd/d45/d26/d41/d44/d35/d52/f9f 0 2024-09-10T10:04:17.064 INFO:tasks.workunit.client.0.smithi071.stdout:9/605: rename d0/d3b/f8f to d0/db/d1b/d1d/d5b/d9f/fc3 0 2024-09-10T10:04:17.066 INFO:tasks.workunit.client.0.smithi071.stdout:6/363: creat d4/da/df/d2e/d3a/d51/d64/f72 x:0 0 0 2024-09-10T10:04:17.066 INFO:tasks.workunit.client.1.smithi107.stdout:3/700: creat dc/fea x:0 0 0 2024-09-10T10:04:17.067 INFO:tasks.workunit.client.0.smithi071.stdout:2/435: link d8/f48 d8/f94 0 2024-09-10T10:04:17.067 INFO:tasks.workunit.client.0.smithi071.stdout:2/436: fsync f2 0 2024-09-10T10:04:17.070 INFO:tasks.workunit.client.1.smithi107.stdout:8/396: sync 2024-09-10T10:04:17.071 INFO:tasks.workunit.client.0.smithi071.stdout:2/437: dread d8/f10 [0,4194304] 0 2024-09-10T10:04:17.071 INFO:tasks.workunit.client.1.smithi107.stdout:2/508: dwrite d3/d21/d79/f7e [8388608,4194304] 0 2024-09-10T10:04:17.072 INFO:tasks.workunit.client.1.smithi107.stdout:3/701: creat dc/dd/d45/d26/feb x:0 0 0 2024-09-10T10:04:17.072 INFO:tasks.workunit.client.0.smithi071.stdout:9/606: getdents d0/db/d1b/d1d 0 2024-09-10T10:04:17.072 INFO:tasks.workunit.client.0.smithi071.stdout:6/364: getdents d4/da 0 2024-09-10T10:04:17.073 INFO:tasks.workunit.client.1.smithi107.stdout:2/509: fdatasync d3/da/df/d20/d36/d4f/f83 0 2024-09-10T10:04:17.075 INFO:tasks.workunit.client.0.smithi071.stdout:2/438: dread d8/d87/d33/f36 [0,4194304] 0 2024-09-10T10:04:17.076 INFO:tasks.workunit.client.0.smithi071.stdout:6/365: dread d4/d1c/f4b [0,4194304] 0 2024-09-10T10:04:17.076 INFO:tasks.workunit.client.0.smithi071.stdout:9/607: truncate d0/db/d1b/d1d/d30/d54/d27/d6e/f9a 1008869 0 2024-09-10T10:04:17.079 INFO:tasks.workunit.client.0.smithi071.stdout:2/439: write d8/f48 [1183891,28464] 0 2024-09-10T10:04:17.079 INFO:tasks.workunit.client.0.smithi071.stdout:6/366: truncate d4/da/df/d2e/d3a/d40/f58 445277 0 2024-09-10T10:04:17.080 INFO:tasks.workunit.client.0.smithi071.stdout:9/608: truncate d0/d3b/f3e 1960 0 2024-09-10T10:04:17.080 INFO:tasks.workunit.client.0.smithi071.stdout:6/367: dread - d4/da/df/d2e/d3a/f66 zero size 2024-09-10T10:04:17.080 INFO:tasks.workunit.client.1.smithi107.stdout:8/397: dwrite d5/fb [0,4194304] 0 2024-09-10T10:04:17.082 INFO:tasks.workunit.client.0.smithi071.stdout:9/609: write d0/db/d1b/d1d/d4b/fb3 [910338,85372] 0 2024-09-10T10:04:17.083 INFO:tasks.workunit.client.0.smithi071.stdout:6/368: truncate d4/da/df/d2e/d3a/d43/f6a 127636 0 2024-09-10T10:04:17.084 INFO:tasks.workunit.client.1.smithi107.stdout:3/702: link dc/dd/d20/d23/d39/d69/c8b dc/dd/d20/d23/d2f/d9c/cec 0 2024-09-10T10:04:17.086 INFO:tasks.workunit.client.1.smithi107.stdout:3/703: fdatasync dc/dd/f27 0 2024-09-10T10:04:17.087 INFO:tasks.workunit.client.0.smithi071.stdout:6/369: creat d4/da/df/d2e/d3a/d43/f73 x:0 0 0 2024-09-10T10:04:17.088 INFO:tasks.workunit.client.1.smithi107.stdout:7/394: dwrite d0/d1b/f28 [4194304,4194304] 0 2024-09-10T10:04:17.089 INFO:tasks.workunit.client.1.smithi107.stdout:6/497: write d0/d3d/d14/f58 [4497246,88651] 0 2024-09-10T10:04:17.089 INFO:tasks.workunit.client.0.smithi071.stdout:9/610: read d0/db/d1b/d1d/d4b/fb3 [874971,108225] 0 2024-09-10T10:04:17.091 INFO:tasks.workunit.client.1.smithi107.stdout:6/498: stat d0/d3d/d14/d21/d8a 0 2024-09-10T10:04:17.091 INFO:tasks.workunit.client.1.smithi107.stdout:3/704: symlink dc/dd/d20/d23/d39/dac/led 0 2024-09-10T10:04:17.093 INFO:tasks.workunit.client.1.smithi107.stdout:7/395: mkdir d0/d8/d56/d78 0 2024-09-10T10:04:17.094 INFO:tasks.workunit.client.1.smithi107.stdout:3/705: write dc/dd/d45/fb5 [438436,111420] 0 2024-09-10T10:04:17.095 INFO:tasks.workunit.client.0.smithi071.stdout:9/611: symlink d0/db/d1b/d1d/d5b/lc4 0 2024-09-10T10:04:17.096 INFO:tasks.workunit.client.0.smithi071.stdout:6/370: dwrite d4/da/df/d2e/d3a/d40/f55 [0,4194304] 0 2024-09-10T10:04:17.097 INFO:tasks.workunit.client.1.smithi107.stdout:7/396: fdatasync d0/d8/d9/d3d/f55 0 2024-09-10T10:04:17.098 INFO:tasks.workunit.client.0.smithi071.stdout:9/612: fsync d0/db/d1b/d1d/d30/d54/d27/d6e/f88 0 2024-09-10T10:04:17.101 INFO:tasks.workunit.client.0.smithi071.stdout:9/613: fdatasync d0/db/d1b/d1d/f3a 0 2024-09-10T10:04:17.103 INFO:tasks.workunit.client.1.smithi107.stdout:2/510: dwrite d3/da/d1e/f24 [0,4194304] 0 2024-09-10T10:04:17.105 INFO:tasks.workunit.client.0.smithi071.stdout:1/372: sync 2024-09-10T10:04:17.105 INFO:tasks.workunit.client.0.smithi071.stdout:0/343: sync 2024-09-10T10:04:17.105 INFO:tasks.workunit.client.0.smithi071.stdout:4/430: sync 2024-09-10T10:04:17.105 INFO:tasks.workunit.client.1.smithi107.stdout:6/499: link d0/d3d/d14/l32 d0/d3d/d14/d21/d8a/da7/lab 0 2024-09-10T10:04:17.106 INFO:tasks.workunit.client.0.smithi071.stdout:6/371: link d4/da/df/d2e/f3b d4/da/df/d2e/d3a/f74 0 2024-09-10T10:04:17.108 INFO:tasks.workunit.client.1.smithi107.stdout:2/511: write d3/da/d1e/d5f/f34 [233209,25101] 0 2024-09-10T10:04:17.109 INFO:tasks.workunit.client.1.smithi107.stdout:3/706: getdents dc/dd/d42/d55/d58/d91 0 2024-09-10T10:04:17.109 INFO:tasks.workunit.client.1.smithi107.stdout:7/397: dwrite d0/d20/d35/f5e [0,4194304] 0 2024-09-10T10:04:17.109 INFO:tasks.workunit.client.0.smithi071.stdout:1/373: fdatasync d1/d21/d2f/d30/d6a/f69 0 2024-09-10T10:04:17.110 INFO:tasks.workunit.client.0.smithi071.stdout:6/372: dread - d4/da/df/d2e/d3a/d51/d64/f72 zero size 2024-09-10T10:04:17.110 INFO:tasks.workunit.client.1.smithi107.stdout:7/398: chown d0/d8/d9/d68 15525 1 2024-09-10T10:04:17.111 INFO:tasks.workunit.client.0.smithi071.stdout:1/374: write d1/f9 [3535049,120781] 0 2024-09-10T10:04:17.114 INFO:tasks.workunit.client.0.smithi071.stdout:9/614: creat d0/db/d1b/d1d/d30/d54/fc5 x:0 0 0 2024-09-10T10:04:17.114 INFO:tasks.workunit.client.1.smithi107.stdout:3/707: creat dc/dd/d45/d26/d41/d44/d63/fee x:0 0 0 2024-09-10T10:04:17.115 INFO:tasks.workunit.client.0.smithi071.stdout:9/615: chown d0/db/d1b/d1d/d5b/c71 267 1 2024-09-10T10:04:17.116 INFO:tasks.workunit.client.1.smithi107.stdout:6/500: rename d0/d3d/d14/d17/d49/d91 to d0/d3d/d14/d21/d8a/da2/da3/dac 0 2024-09-10T10:04:17.118 INFO:tasks.workunit.client.1.smithi107.stdout:3/708: creat dc/dd/d45/d26/d41/d44/d35/d4a/dd8/de0/fef x:0 0 0 2024-09-10T10:04:17.118 INFO:tasks.workunit.client.0.smithi071.stdout:4/431: rename db/d15/d17/c35 to db/d15/d17/d4e/d5a/d8d/c8e 0 2024-09-10T10:04:17.118 INFO:tasks.workunit.client.1.smithi107.stdout:6/501: write d0/d3d/d14/d21/f23 [3478831,24565] 0 2024-09-10T10:04:17.119 INFO:tasks.workunit.client.1.smithi107.stdout:2/512: creat d3/da/df/fb1 x:0 0 0 2024-09-10T10:04:17.120 INFO:tasks.workunit.client.1.smithi107.stdout:7/399: mknod d0/d1b/c79 0 2024-09-10T10:04:17.121 INFO:tasks.workunit.client.0.smithi071.stdout:6/373: unlink d4/da/df/d2e/f5a 0 2024-09-10T10:04:17.123 INFO:tasks.workunit.client.1.smithi107.stdout:6/502: creat d0/d3d/d14/d21/d83/fad x:0 0 0 2024-09-10T10:04:17.123 INFO:tasks.workunit.client.1.smithi107.stdout:7/400: fdatasync d0/d8/f31 0 2024-09-10T10:04:17.125 INFO:tasks.workunit.client.1.smithi107.stdout:6/503: write d0/d3d/d14/d21/fa0 [97142,50787] 0 2024-09-10T10:04:17.125 INFO:tasks.workunit.client.0.smithi071.stdout:4/432: mkdir db/d8f 0 2024-09-10T10:04:17.127 INFO:tasks.workunit.client.1.smithi107.stdout:3/709: link dc/dd/d45/f64 dc/dd/d45/ff0 0 2024-09-10T10:04:17.127 INFO:tasks.workunit.client.1.smithi107.stdout:7/401: symlink d0/d20/l7a 0 2024-09-10T10:04:17.128 INFO:tasks.workunit.client.0.smithi071.stdout:6/374: creat d4/da/df/d5e/f75 x:0 0 0 2024-09-10T10:04:17.131 INFO:tasks.workunit.client.0.smithi071.stdout:9/616: getdents d0/db/d1b/d1d/d30 0 2024-09-10T10:04:17.132 INFO:tasks.workunit.client.0.smithi071.stdout:6/375: rename d4/da/df/f63 to d4/da/df/d2e/d3a/d3e/d5d/f76 0 2024-09-10T10:04:17.134 INFO:tasks.workunit.client.1.smithi107.stdout:6/504: read d0/d3d/d14/d17/f1a [1425147,116420] 0 2024-09-10T10:04:17.134 INFO:tasks.workunit.client.0.smithi071.stdout:6/376: readlink d4/da/df/d2e/d3a/d3e/d45/l52 0 2024-09-10T10:04:17.135 INFO:tasks.workunit.client.0.smithi071.stdout:9/617: creat d0/db/d1b/d1d/d30/d54/fc6 x:0 0 0 2024-09-10T10:04:17.135 INFO:tasks.workunit.client.1.smithi107.stdout:3/710: dread - dc/dd/d45/d26/d41/d44/d63/f7b zero size 2024-09-10T10:04:17.136 INFO:tasks.workunit.client.1.smithi107.stdout:6/505: write d0/d3d/d14/f58 [1423024,52321] 0 2024-09-10T10:04:17.138 INFO:tasks.workunit.client.1.smithi107.stdout:3/711: chown dc/dd/d45/d26/d41/d44/d35/f2a 6170 1 2024-09-10T10:04:17.139 INFO:tasks.workunit.client.1.smithi107.stdout:6/506: truncate d0/d3d/d14/d17/d4b/f6e 492197 0 2024-09-10T10:04:17.140 INFO:tasks.workunit.client.1.smithi107.stdout:6/507: chown d0/d3d/d14/d42/d88 1001390 1 2024-09-10T10:04:17.141 INFO:tasks.workunit.client.0.smithi071.stdout:9/618: truncate d0/db/d1b/d1d/d30/d54/d27/d6e/f9a 1630965 0 2024-09-10T10:04:17.141 INFO:tasks.workunit.client.0.smithi071.stdout:6/377: dwrite d4/f6c [0,4194304] 0 2024-09-10T10:04:17.150 INFO:tasks.workunit.client.0.smithi071.stdout:9/619: chown d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/fbd 2975490 1 2024-09-10T10:04:17.150 INFO:tasks.workunit.client.0.smithi071.stdout:0/344: dread d11/d22/f29 [0,4194304] 0 2024-09-10T10:04:17.151 INFO:tasks.workunit.client.0.smithi071.stdout:1/375: dwrite d1/d21/f67 [0,4194304] 0 2024-09-10T10:04:17.152 INFO:tasks.workunit.client.0.smithi071.stdout:9/620: readlink d0/db/d1b/d1d/d4b/dad/la2 0 2024-09-10T10:04:17.153 INFO:tasks.workunit.client.1.smithi107.stdout:6/508: dread d0/f2c [0,4194304] 0 2024-09-10T10:04:17.154 INFO:tasks.workunit.client.1.smithi107.stdout:2/513: rename d3/da/df/f48 to d3/da/df/d20/d36/d39/fb2 0 2024-09-10T10:04:17.155 INFO:tasks.workunit.client.0.smithi071.stdout:1/376: mkdir d1/d21/d2f/d30/d75 0 2024-09-10T10:04:17.156 INFO:tasks.workunit.client.0.smithi071.stdout:0/345: link d11/d1e/f58 d11/d30/f76 0 2024-09-10T10:04:17.158 INFO:tasks.workunit.client.1.smithi107.stdout:6/509: rmdir d0/d3d/d14/d42 39 2024-09-10T10:04:17.159 INFO:tasks.workunit.client.0.smithi071.stdout:1/377: write d1/f19 [1710149,66989] 0 2024-09-10T10:04:17.160 INFO:tasks.workunit.client.0.smithi071.stdout:4/433: dread db/d15/d17/f6f [0,4194304] 0 2024-09-10T10:04:17.160 INFO:tasks.workunit.client.1.smithi107.stdout:7/402: creat d0/d20/d72/f7b x:0 0 0 2024-09-10T10:04:17.162 INFO:tasks.workunit.client.1.smithi107.stdout:2/514: mknod d3/da/d1e/d40/cb3 0 2024-09-10T10:04:17.162 INFO:tasks.workunit.client.0.smithi071.stdout:9/621: dwrite d0/f2e [0,4194304] 0 2024-09-10T10:04:17.165 INFO:tasks.workunit.client.0.smithi071.stdout:0/346: dread d11/d22/f4e [0,4194304] 0 2024-09-10T10:04:17.166 INFO:tasks.workunit.client.0.smithi071.stdout:4/434: mkdir db/d1d/d61/d6a/d88/d90 0 2024-09-10T10:04:17.167 INFO:tasks.workunit.client.1.smithi107.stdout:7/403: creat d0/d8/dc/d2c/f7c x:0 0 0 2024-09-10T10:04:17.169 INFO:tasks.workunit.client.0.smithi071.stdout:0/347: creat d11/d30/d52/d5f/f77 x:0 0 0 2024-09-10T10:04:17.169 INFO:tasks.workunit.client.0.smithi071.stdout:1/378: dread d1/d21/d2f/d30/d6a/f6d [0,4194304] 0 2024-09-10T10:04:17.169 INFO:tasks.workunit.client.1.smithi107.stdout:3/712: rmdir dc/dd/d45/d26/d41/d44/d35/d4a 39 2024-09-10T10:04:17.169 INFO:tasks.workunit.client.1.smithi107.stdout:6/510: dwrite d0/d3d/d14/d17/f99 [0,4194304] 0 2024-09-10T10:04:17.170 INFO:tasks.workunit.client.0.smithi071.stdout:4/435: creat db/d15/d26/f91 x:0 0 0 2024-09-10T10:04:17.170 INFO:tasks.workunit.client.0.smithi071.stdout:4/436: dread - db/d15/d26/d43/d4d/f78 zero size 2024-09-10T10:04:17.171 INFO:tasks.workunit.client.0.smithi071.stdout:4/437: chown db/d86/f8b 33536 1 2024-09-10T10:04:17.172 INFO:tasks.workunit.client.0.smithi071.stdout:0/348: rmdir d11/d22 39 2024-09-10T10:04:17.173 INFO:tasks.workunit.client.0.smithi071.stdout:0/349: read d11/d1e/f74 [5460606,87385] 0 2024-09-10T10:04:17.174 INFO:tasks.workunit.client.0.smithi071.stdout:4/438: creat db/d15/d17/d4e/d5a/f92 x:0 0 0 2024-09-10T10:04:17.175 INFO:tasks.workunit.client.0.smithi071.stdout:4/439: stat db/d15/d26/d43/d4d 0 2024-09-10T10:04:17.177 INFO:tasks.workunit.client.0.smithi071.stdout:1/379: mkdir d1/d70/d76 0 2024-09-10T10:04:17.179 INFO:tasks.workunit.client.1.smithi107.stdout:3/713: creat dc/dd/d45/d26/d41/d44/d35/d4a/ff1 x:0 0 0 2024-09-10T10:04:17.181 INFO:tasks.workunit.client.1.smithi107.stdout:3/714: mknod dc/dd/d20/d23/d2f/cf2 0 2024-09-10T10:04:17.183 INFO:tasks.workunit.client.0.smithi071.stdout:0/350: rename d11/d1e/c20 to d11/d22/d40/c78 0 2024-09-10T10:04:17.184 INFO:tasks.workunit.client.0.smithi071.stdout:1/380: symlink d1/d57/l77 0 2024-09-10T10:04:17.186 INFO:tasks.workunit.client.0.smithi071.stdout:0/351: mkdir d11/d30/d52/d79 0 2024-09-10T10:04:17.186 INFO:tasks.workunit.client.0.smithi071.stdout:9/622: dwrite d0/db/d20/d3c/f82 [0,4194304] 0 2024-09-10T10:04:17.191 INFO:tasks.workunit.client.0.smithi071.stdout:9/623: unlink d0/db/f22 0 2024-09-10T10:04:17.191 INFO:tasks.workunit.client.0.smithi071.stdout:9/624: stat d0/da0 0 2024-09-10T10:04:17.192 INFO:tasks.workunit.client.0.smithi071.stdout:0/352: creat d11/d30/d52/d79/f7a x:0 0 0 2024-09-10T10:04:17.194 INFO:tasks.workunit.client.1.smithi107.stdout:2/515: truncate d3/da/df/f15 551781 0 2024-09-10T10:04:17.198 INFO:tasks.workunit.client.0.smithi071.stdout:0/353: rmdir d11/d30/d52/d5f 39 2024-09-10T10:04:17.198 INFO:tasks.workunit.client.1.smithi107.stdout:2/516: symlink d3/da/df/d20/d36/d4f/d92/lb4 0 2024-09-10T10:04:17.199 INFO:tasks.workunit.client.0.smithi071.stdout:0/354: chown d11/d22/d40/c61 8 1 2024-09-10T10:04:17.200 INFO:tasks.workunit.client.1.smithi107.stdout:7/404: dread d0/d8/d9/ff [0,4194304] 0 2024-09-10T10:04:17.201 INFO:tasks.workunit.client.1.smithi107.stdout:7/405: chown d0/d8/f6f 13281983 1 2024-09-10T10:04:17.202 INFO:tasks.workunit.client.1.smithi107.stdout:6/511: dread d0/d3d/d14/d21/fa0 [0,4194304] 0 2024-09-10T10:04:17.202 INFO:tasks.workunit.client.1.smithi107.stdout:2/517: creat d3/da/df/d20/d36/fb5 x:0 0 0 2024-09-10T10:04:17.203 INFO:tasks.workunit.client.1.smithi107.stdout:7/406: dread - d0/d8/f6f zero size 2024-09-10T10:04:17.204 INFO:tasks.workunit.client.1.smithi107.stdout:6/512: write d0/d3d/d14/f1f [3295796,90171] 0 2024-09-10T10:04:17.204 INFO:tasks.workunit.client.1.smithi107.stdout:2/518: write d3/da/d1e/d27/fa4 [432015,109217] 0 2024-09-10T10:04:17.205 INFO:tasks.workunit.client.0.smithi071.stdout:1/381: dwrite d1/d21/d65/f25 [0,4194304] 0 2024-09-10T10:04:17.205 INFO:tasks.workunit.client.0.smithi071.stdout:0/355: rename d11/d22/f5c to d11/f7b 0 2024-09-10T10:04:17.205 INFO:tasks.workunit.client.1.smithi107.stdout:6/513: fsync d0/f3e 0 2024-09-10T10:04:17.205 INFO:tasks.workunit.client.1.smithi107.stdout:7/407: stat d0/d8/ld 0 2024-09-10T10:04:17.206 INFO:tasks.workunit.client.0.smithi071.stdout:0/356: write d11/d30/f71 [612322,13521] 0 2024-09-10T10:04:17.207 INFO:tasks.workunit.client.1.smithi107.stdout:7/408: read - d0/d20/f70 zero size 2024-09-10T10:04:17.207 INFO:tasks.workunit.client.0.smithi071.stdout:1/382: readlink d1/l20 0 2024-09-10T10:04:17.208 INFO:tasks.workunit.client.1.smithi107.stdout:6/514: dread - d0/d3d/d14/d21/d83/fad zero size 2024-09-10T10:04:17.208 INFO:tasks.workunit.client.1.smithi107.stdout:3/715: dread dc/dd/f12 [0,4194304] 0 2024-09-10T10:04:17.211 INFO:tasks.workunit.client.1.smithi107.stdout:3/716: readlink dc/dd/d45/d26/d41/d44/d35/lc5 0 2024-09-10T10:04:17.211 INFO:tasks.workunit.client.0.smithi071.stdout:9/625: write d0/d3b/d44/f63 [343516,34111] 0 2024-09-10T10:04:17.212 INFO:tasks.workunit.client.1.smithi107.stdout:6/515: fdatasync d0/d3d/f40 0 2024-09-10T10:04:17.216 INFO:tasks.workunit.client.0.smithi071.stdout:9/626: unlink d0/db/d20/f2b 0 2024-09-10T10:04:17.217 INFO:tasks.workunit.client.1.smithi107.stdout:3/717: stat dc/dd/d20/d23/d39/d69/lc2 0 2024-09-10T10:04:17.218 INFO:tasks.workunit.client.0.smithi071.stdout:1/383: dwrite d1/d21/d2f/d30/f73 [0,4194304] 0 2024-09-10T10:04:17.220 INFO:tasks.workunit.client.1.smithi107.stdout:6/516: symlink d0/lae 0 2024-09-10T10:04:17.220 INFO:tasks.workunit.client.1.smithi107.stdout:7/409: dread d0/d20/d35/f54 [0,4194304] 0 2024-09-10T10:04:17.221 INFO:tasks.workunit.client.1.smithi107.stdout:7/410: read - d0/d8/d9/d68/f58 zero size 2024-09-10T10:04:17.222 INFO:tasks.workunit.client.0.smithi071.stdout:1/384: rename d1/d21/d2f/d30/l5b to d1/d70/l78 0 2024-09-10T10:04:17.225 INFO:tasks.workunit.client.1.smithi107.stdout:6/517: rename d0/f19 to d0/d70/faf 0 2024-09-10T10:04:17.225 INFO:tasks.workunit.client.1.smithi107.stdout:7/411: creat d0/d8/d9/d68/f7d x:0 0 0 2024-09-10T10:04:17.226 INFO:tasks.workunit.client.1.smithi107.stdout:7/412: stat d0/d8/dc/d2c/f7c 0 2024-09-10T10:04:17.227 INFO:tasks.workunit.client.0.smithi071.stdout:0/357: dwrite d11/d22/d40/f44 [0,4194304] 0 2024-09-10T10:04:17.227 INFO:tasks.workunit.client.1.smithi107.stdout:6/518: chown d0/d3d/d14/d42/c68 324207 1 2024-09-10T10:04:17.228 INFO:tasks.workunit.client.1.smithi107.stdout:6/519: fdatasync d0/d3d/d14/d17/f3b 0 2024-09-10T10:04:17.229 INFO:tasks.workunit.client.0.smithi071.stdout:1/385: rename d1/d57/f52 to d1/d21/d2f/d30/f79 0 2024-09-10T10:04:17.229 INFO:tasks.workunit.client.1.smithi107.stdout:7/413: creat d0/d8/dc/d2c/f7e x:0 0 0 2024-09-10T10:04:17.230 INFO:tasks.workunit.client.1.smithi107.stdout:7/414: dread - d0/d8/d9/d68/f75 zero size 2024-09-10T10:04:17.231 INFO:tasks.workunit.client.1.smithi107.stdout:6/520: symlink d0/d3d/d14/d21/d8a/d8d/lb0 0 2024-09-10T10:04:17.232 INFO:tasks.workunit.client.1.smithi107.stdout:6/521: stat d0/d3d 0 2024-09-10T10:04:17.232 INFO:tasks.workunit.client.0.smithi071.stdout:1/386: creat d1/d21/d65/f7a x:0 0 0 2024-09-10T10:04:17.233 INFO:tasks.workunit.client.0.smithi071.stdout:1/387: chown d1/d21/c6f 50359 1 2024-09-10T10:04:17.234 INFO:tasks.workunit.client.0.smithi071.stdout:1/388: write d1/d21/d3d/f4f [3827727,1918] 0 2024-09-10T10:04:17.237 INFO:tasks.workunit.client.1.smithi107.stdout:6/522: write d0/d3d/d14/d17/d49/d55/d73/f93 [4035241,59832] 0 2024-09-10T10:04:17.238 INFO:tasks.workunit.client.0.smithi071.stdout:1/389: rename d1/d3f/f68 to d1/d70/f7b 0 2024-09-10T10:04:17.238 INFO:tasks.workunit.client.1.smithi107.stdout:7/415: dwrite d0/d1b/d4d/f61 [0,4194304] 0 2024-09-10T10:04:17.241 INFO:tasks.workunit.client.1.smithi107.stdout:7/416: mknod d0/d20/c7f 0 2024-09-10T10:04:17.246 INFO:tasks.workunit.client.1.smithi107.stdout:2/519: dread d3/da/d1e/d40/d8a/d7f/f44 [0,4194304] 0 2024-09-10T10:04:17.247 INFO:tasks.workunit.client.0.smithi071.stdout:0/358: write f7 [732042,45022] 0 2024-09-10T10:04:17.247 INFO:tasks.workunit.client.1.smithi107.stdout:7/417: dwrite d0/d8/f13 [0,4194304] 0 2024-09-10T10:04:17.249 INFO:tasks.workunit.client.1.smithi107.stdout:2/520: fsync d3/da/df/d78/f80 0 2024-09-10T10:04:17.250 INFO:tasks.workunit.client.0.smithi071.stdout:1/390: truncate d1/d35/f6e 91848 0 2024-09-10T10:04:17.255 INFO:tasks.workunit.client.0.smithi071.stdout:1/391: read d1/f74 [1767160,96895] 0 2024-09-10T10:04:17.256 INFO:tasks.workunit.client.0.smithi071.stdout:0/359: dwrite d11/d30/d52/d79/f7a [0,4194304] 0 2024-09-10T10:04:17.262 INFO:tasks.workunit.client.0.smithi071.stdout:1/392: creat d1/d21/d2f/f7c x:0 0 0 2024-09-10T10:04:17.268 INFO:tasks.workunit.client.0.smithi071.stdout:8/389: sync 2024-09-10T10:04:17.268 INFO:tasks.workunit.client.0.smithi071.stdout:5/351: sync 2024-09-10T10:04:17.268 INFO:tasks.workunit.client.0.smithi071.stdout:5/352: chown dc/l37 9351 1 2024-09-10T10:04:17.271 INFO:tasks.workunit.client.0.smithi071.stdout:5/353: getdents dc/d53 0 2024-09-10T10:04:17.277 INFO:tasks.workunit.client.0.smithi071.stdout:1/393: truncate d1/f74 3890587 0 2024-09-10T10:04:17.279 INFO:tasks.workunit.client.0.smithi071.stdout:1/394: creat d1/d21/d2f/d30/f7d x:0 0 0 2024-09-10T10:04:17.282 INFO:tasks.workunit.client.1.smithi107.stdout:3/718: dread dc/dd/d45/fdd [0,4194304] 0 2024-09-10T10:04:17.283 INFO:tasks.workunit.client.1.smithi107.stdout:7/418: rename d0/d1b/d4d/d69/l74 to d0/d8/d56/d78/l80 0 2024-09-10T10:04:17.283 INFO:tasks.workunit.client.1.smithi107.stdout:3/719: chown dc/dd/d45/l36 184350 1 2024-09-10T10:04:17.285 INFO:tasks.workunit.client.0.smithi071.stdout:1/395: dwrite d1/d57/f6b [0,4194304] 0 2024-09-10T10:04:17.288 INFO:tasks.workunit.client.1.smithi107.stdout:3/720: mkdir dc/dd/d20/d23/df3 0 2024-09-10T10:04:17.288 INFO:tasks.workunit.client.0.smithi071.stdout:8/390: dread d5/df/d1d/f59 [0,4194304] 0 2024-09-10T10:04:17.290 INFO:tasks.workunit.client.0.smithi071.stdout:8/391: chown d5/df/d1d/f23 122493172 1 2024-09-10T10:04:17.290 INFO:tasks.workunit.client.1.smithi107.stdout:2/521: getdents d3/da/d1e/d5f 0 2024-09-10T10:04:17.291 INFO:tasks.workunit.client.0.smithi071.stdout:5/354: dread dc/df/f19 [0,4194304] 0 2024-09-10T10:04:17.291 INFO:tasks.workunit.client.1.smithi107.stdout:2/522: dread - d3/da/df/d20/d36/f71 zero size 2024-09-10T10:04:17.292 INFO:tasks.workunit.client.0.smithi071.stdout:1/396: symlink d1/d21/d2f/d30/l7e 0 2024-09-10T10:04:17.294 INFO:tasks.workunit.client.1.smithi107.stdout:2/523: chown d3/da/df/d20/d36/d4f/d92/f87 660934 1 2024-09-10T10:04:17.294 INFO:tasks.workunit.client.1.smithi107.stdout:7/419: truncate d0/f4 6771507 0 2024-09-10T10:04:17.295 INFO:tasks.workunit.client.1.smithi107.stdout:3/721: write dc/dd/d45/d26/d59/f7a [5214580,100629] 0 2024-09-10T10:04:17.297 INFO:tasks.workunit.client.1.smithi107.stdout:7/420: mkdir d0/d8/d9/d3d/d81 0 2024-09-10T10:04:17.297 INFO:tasks.workunit.client.0.smithi071.stdout:8/392: link d5/df/d1d/d86/f3e d5/df/d1d/f8d 0 2024-09-10T10:04:17.298 INFO:tasks.workunit.client.1.smithi107.stdout:2/524: creat d3/da/d1e/d40/d8a/d7f/d55/fb6 x:0 0 0 2024-09-10T10:04:17.300 INFO:tasks.workunit.client.0.smithi071.stdout:5/355: dwrite dc/fe [0,4194304] 0 2024-09-10T10:04:17.301 INFO:tasks.workunit.client.0.smithi071.stdout:1/397: dread d1/d21/f67 [0,4194304] 0 2024-09-10T10:04:17.304 INFO:tasks.workunit.client.1.smithi107.stdout:2/525: mkdir d3/da/d66/db7 0 2024-09-10T10:04:17.305 INFO:tasks.workunit.client.0.smithi071.stdout:1/398: fdatasync d1/d21/d2f/d30/d6a/f6d 0 2024-09-10T10:04:17.306 INFO:tasks.workunit.client.0.smithi071.stdout:5/356: chown dc/df/d3e/d5a/f5e 1716303 1 2024-09-10T10:04:17.306 INFO:tasks.workunit.client.1.smithi107.stdout:3/722: getdents dc/dd/d45/d26/d41/d44 0 2024-09-10T10:04:17.306 INFO:tasks.workunit.client.1.smithi107.stdout:7/421: getdents d0/d8/d9/d68 0 2024-09-10T10:04:17.308 INFO:tasks.workunit.client.0.smithi071.stdout:1/399: chown d1/d3f/d5c/f5d 66128664 1 2024-09-10T10:04:17.308 INFO:tasks.workunit.client.0.smithi071.stdout:5/357: readlink dc/d53/d6a/l6d 0 2024-09-10T10:04:17.309 INFO:tasks.workunit.client.1.smithi107.stdout:3/723: write dc/dd/d45/d26/d41/d44/d35/f66 [797111,54868] 0 2024-09-10T10:04:17.309 INFO:tasks.workunit.client.1.smithi107.stdout:7/422: chown d0/d8/d56/d5d/f67 1 1 2024-09-10T10:04:17.309 INFO:tasks.workunit.client.1.smithi107.stdout:2/526: symlink d3/da/df/d20/d36/lb8 0 2024-09-10T10:04:17.310 INFO:tasks.workunit.client.1.smithi107.stdout:7/423: chown d0/d8/d9/d68 44011257 1 2024-09-10T10:04:17.310 INFO:tasks.workunit.client.0.smithi071.stdout:8/393: dwrite d5/df/d1d/d86/d75/f8b [0,4194304] 0 2024-09-10T10:04:17.311 INFO:tasks.workunit.client.1.smithi107.stdout:7/424: stat d0/d8/dc/f1f 0 2024-09-10T10:04:17.312 INFO:tasks.workunit.client.1.smithi107.stdout:7/425: fsync d0/d8/d9/d3d/f55 0 2024-09-10T10:04:17.313 INFO:tasks.workunit.client.0.smithi071.stdout:1/400: unlink d1/f1f 0 2024-09-10T10:04:17.315 INFO:tasks.workunit.client.0.smithi071.stdout:8/394: write d5/df/d1e/d38/f48 [1429400,8755] 0 2024-09-10T10:04:17.315 INFO:tasks.workunit.client.0.smithi071.stdout:1/401: write d1/d3f/d5c/f5d [190903,89717] 0 2024-09-10T10:04:17.317 INFO:tasks.workunit.client.0.smithi071.stdout:1/402: truncate d1/d21/d65/f4e 4643215 0 2024-09-10T10:04:17.318 INFO:tasks.workunit.client.1.smithi107.stdout:2/527: creat d3/da/d1e/d40/d8a/d7f/fb9 x:0 0 0 2024-09-10T10:04:17.319 INFO:tasks.workunit.client.0.smithi071.stdout:8/395: creat d5/df/d57/f8e x:0 0 0 2024-09-10T10:04:17.319 INFO:tasks.workunit.client.1.smithi107.stdout:3/724: dwrite dc/dd/d45/d26/feb [0,4194304] 0 2024-09-10T10:04:17.320 INFO:tasks.workunit.client.0.smithi071.stdout:1/403: mknod d1/d21/d2f/d30/d6a/c7f 0 2024-09-10T10:04:17.323 INFO:tasks.workunit.client.1.smithi107.stdout:7/426: dwrite d0/d8/f6f [0,4194304] 0 2024-09-10T10:04:17.323 INFO:tasks.workunit.client.1.smithi107.stdout:2/528: fsync d3/da/df/d20/d36/f71 0 2024-09-10T10:04:17.323 INFO:tasks.workunit.client.0.smithi071.stdout:5/358: write dc/df/f28 [2289622,39782] 0 2024-09-10T10:04:17.324 INFO:tasks.workunit.client.1.smithi107.stdout:3/725: chown dc/dd/d45/d26/d41/d44/d35/lc5 15992333 1 2024-09-10T10:04:17.324 INFO:tasks.workunit.client.0.smithi071.stdout:1/404: creat d1/d21/d2f/d30/d6a/f80 x:0 0 0 2024-09-10T10:04:17.326 INFO:tasks.workunit.client.1.smithi107.stdout:7/427: dread d0/d8/d56/f6c [0,4194304] 0 2024-09-10T10:04:17.328 INFO:tasks.workunit.client.0.smithi071.stdout:1/405: chown d1/d21/d65/l2a 931 1 2024-09-10T10:04:17.330 INFO:tasks.workunit.client.0.smithi071.stdout:8/396: dwrite d5/d36/d49/f7c [0,4194304] 0 2024-09-10T10:04:17.331 INFO:tasks.workunit.client.0.smithi071.stdout:1/406: fdatasync d1/d3f/d58/f5a 0 2024-09-10T10:04:17.332 INFO:tasks.workunit.client.1.smithi107.stdout:7/428: rename d0/d20/f70 to d0/d8/d56/f82 0 2024-09-10T10:04:17.333 INFO:tasks.workunit.client.0.smithi071.stdout:8/397: chown d5/c14 29148 1 2024-09-10T10:04:17.335 INFO:tasks.workunit.client.1.smithi107.stdout:2/529: getdents d3 0 2024-09-10T10:04:17.337 INFO:tasks.workunit.client.0.smithi071.stdout:8/398: mkdir d5/d36/d49/d8f 0 2024-09-10T10:04:17.338 INFO:tasks.workunit.client.0.smithi071.stdout:5/359: dwrite dc/df/d17/d22/f44 [4194304,4194304] 0 2024-09-10T10:04:17.339 INFO:tasks.workunit.client.1.smithi107.stdout:2/530: creat d3/da/d1e/d40/d8a/d7f/d55/fba x:0 0 0 2024-09-10T10:04:17.340 INFO:tasks.workunit.client.0.smithi071.stdout:1/407: mkdir d1/d21/d2f/d81 0 2024-09-10T10:04:17.342 INFO:tasks.workunit.client.0.smithi071.stdout:8/399: write d5/df/d1d/d86/f3b [256654,129512] 0 2024-09-10T10:04:17.344 INFO:tasks.workunit.client.1.smithi107.stdout:2/531: read d3/f31 [2286430,67940] 0 2024-09-10T10:04:17.345 INFO:tasks.workunit.client.0.smithi071.stdout:8/400: dread - d5/df/d57/f8a zero size 2024-09-10T10:04:17.346 INFO:tasks.workunit.client.1.smithi107.stdout:2/532: readlink d3/da/d1e/d40/d8a/l86 0 2024-09-10T10:04:17.348 INFO:tasks.workunit.client.1.smithi107.stdout:2/533: write d3/da/df/d20/d36/d4f/f83 [1037741,54836] 0 2024-09-10T10:04:17.350 INFO:tasks.workunit.client.0.smithi071.stdout:8/401: mkdir d5/df/d1d/d86/d90 0 2024-09-10T10:04:17.350 INFO:tasks.workunit.client.0.smithi071.stdout:5/360: dwrite dc/df/f33 [0,4194304] 0 2024-09-10T10:04:17.353 INFO:tasks.workunit.client.1.smithi107.stdout:3/726: write dc/dd/d45/ff0 [4388052,72334] 0 2024-09-10T10:04:17.353 INFO:tasks.workunit.client.0.smithi071.stdout:5/361: rmdir dc/d53 39 2024-09-10T10:04:17.354 INFO:tasks.workunit.client.0.smithi071.stdout:1/408: dwrite d1/d3f/d5c/f5d [0,4194304] 0 2024-09-10T10:04:17.359 INFO:tasks.workunit.client.1.smithi107.stdout:7/429: write d0/d8/dc/d2c/f3b [24740,113012] 0 2024-09-10T10:04:17.360 INFO:tasks.workunit.client.1.smithi107.stdout:2/534: write d3/da/d1e/d40/d8a/f89 [3605204,92795] 0 2024-09-10T10:04:17.362 INFO:tasks.workunit.client.0.smithi071.stdout:8/402: link d5/df/d57/f5a d5/df/d57/d82/f91 0 2024-09-10T10:04:17.362 INFO:tasks.workunit.client.0.smithi071.stdout:1/409: creat d1/d21/d3d/d4a/f82 x:0 0 0 2024-09-10T10:04:17.362 INFO:tasks.workunit.client.1.smithi107.stdout:3/727: rename dc/dd/f27 to dc/dd/d20/d23/ff4 0 2024-09-10T10:04:17.363 INFO:tasks.workunit.client.1.smithi107.stdout:7/430: symlink d0/d8/d56/l83 0 2024-09-10T10:04:17.364 INFO:tasks.workunit.client.0.smithi071.stdout:1/410: write d1/d21/d3d/d4a/f82 [819169,88684] 0 2024-09-10T10:04:17.364 INFO:tasks.workunit.client.1.smithi107.stdout:3/728: write dc/dd/d20/d23/fde [232592,50503] 0 2024-09-10T10:04:17.364 INFO:tasks.workunit.client.0.smithi071.stdout:8/403: creat d5/df/d1d/f92 x:0 0 0 2024-09-10T10:04:17.365 INFO:tasks.workunit.client.1.smithi107.stdout:2/535: mknod d3/da/df/d20/d36/d4f/d92/cbb 0 2024-09-10T10:04:17.365 INFO:tasks.workunit.client.0.smithi071.stdout:5/362: truncate dc/df/f1e 1534834 0 2024-09-10T10:04:17.366 INFO:tasks.workunit.client.1.smithi107.stdout:3/729: write dc/dd/d20/fc9 [665748,89950] 0 2024-09-10T10:04:17.368 INFO:tasks.workunit.client.1.smithi107.stdout:3/730: readlink dc/dd/d45/l2b 0 2024-09-10T10:04:17.368 INFO:tasks.workunit.client.0.smithi071.stdout:5/363: creat dc/df/f7b x:0 0 0 2024-09-10T10:04:17.368 INFO:tasks.workunit.client.1.smithi107.stdout:2/536: creat d3/da/df/d20/d36/d39/fbc x:0 0 0 2024-09-10T10:04:17.369 INFO:tasks.workunit.client.0.smithi071.stdout:8/404: fsync d5/f28 0 2024-09-10T10:04:17.369 INFO:tasks.workunit.client.1.smithi107.stdout:2/537: fdatasync d3/da/d1e/d40/f9f 0 2024-09-10T10:04:17.370 INFO:tasks.workunit.client.1.smithi107.stdout:7/431: rename d0/d8/d9/d68/f64 to d0/d8/f84 0 2024-09-10T10:04:17.371 INFO:tasks.workunit.client.1.smithi107.stdout:2/538: creat d3/d21/d79/fbd x:0 0 0 2024-09-10T10:04:17.372 INFO:tasks.workunit.client.0.smithi071.stdout:8/405: write d5/d36/f65 [440617,15898] 0 2024-09-10T10:04:17.373 INFO:tasks.workunit.client.1.smithi107.stdout:7/432: creat d0/d20/d72/f85 x:0 0 0 2024-09-10T10:04:17.374 INFO:tasks.workunit.client.1.smithi107.stdout:7/433: write d0/d20/d35/f5e [1268687,65148] 0 2024-09-10T10:04:17.374 INFO:tasks.workunit.client.0.smithi071.stdout:1/411: dwrite d1/d21/f67 [4194304,4194304] 0 2024-09-10T10:04:17.374 INFO:tasks.workunit.client.0.smithi071.stdout:8/406: chown d5/df/d1d/d86/f3b 0 1 2024-09-10T10:04:17.377 INFO:tasks.workunit.client.1.smithi107.stdout:3/731: rename dc/dd/d20/d23/d6e to dc/dd/d45/d26/df5 0 2024-09-10T10:04:17.377 INFO:tasks.workunit.client.0.smithi071.stdout:1/412: mkdir d1/d21/d3d/d83 0 2024-09-10T10:04:17.378 INFO:tasks.workunit.client.1.smithi107.stdout:3/732: write dc/dd/d42/d55/fb3 [977811,19509] 0 2024-09-10T10:04:17.378 INFO:tasks.workunit.client.0.smithi071.stdout:8/407: creat d5/df/d1d/f93 x:0 0 0 2024-09-10T10:04:17.379 INFO:tasks.workunit.client.1.smithi107.stdout:7/434: symlink d0/d8/d9/l86 0 2024-09-10T10:04:17.380 INFO:tasks.workunit.client.1.smithi107.stdout:7/435: chown d0/d1b 15 1 2024-09-10T10:04:17.380 INFO:tasks.workunit.client.1.smithi107.stdout:3/733: chown dc/dd/d20/d23/d39/dac/led 493452 1 2024-09-10T10:04:17.384 INFO:tasks.workunit.client.0.smithi071.stdout:1/413: link d1/f19 d1/d3f/f84 0 2024-09-10T10:04:17.385 INFO:tasks.workunit.client.0.smithi071.stdout:8/408: link d5/d30/f3c d5/d36/d49/d8f/f94 0 2024-09-10T10:04:17.387 INFO:tasks.workunit.client.0.smithi071.stdout:1/414: mknod d1/d21/d3d/c85 0 2024-09-10T10:04:17.388 INFO:tasks.workunit.client.1.smithi107.stdout:2/539: truncate d3/da/d1e/d40/d8a/d7f/d55/f64 326377 0 2024-09-10T10:04:17.389 INFO:tasks.workunit.client.0.smithi071.stdout:8/409: mkdir d5/df/d95 0 2024-09-10T10:04:17.389 INFO:tasks.workunit.client.1.smithi107.stdout:7/436: dwrite d0/d8/d9/d68/f58 [0,4194304] 0 2024-09-10T10:04:17.390 INFO:tasks.workunit.client.0.smithi071.stdout:8/410: truncate d5/f45 2259538 0 2024-09-10T10:04:17.390 INFO:tasks.workunit.client.1.smithi107.stdout:2/540: dread - d3/da/d1e/d40/d8a/f8c zero size 2024-09-10T10:04:17.390 INFO:tasks.workunit.client.1.smithi107.stdout:3/734: dread dc/dd/f17 [4194304,4194304] 0 2024-09-10T10:04:17.391 INFO:tasks.workunit.client.0.smithi071.stdout:1/415: mknod d1/d21/d2f/d30/d6a/c86 0 2024-09-10T10:04:17.393 INFO:tasks.workunit.client.0.smithi071.stdout:5/364: truncate dc/fe 419771 0 2024-09-10T10:04:17.394 INFO:tasks.workunit.client.0.smithi071.stdout:1/416: mknod d1/d57/c87 0 2024-09-10T10:04:17.395 INFO:tasks.workunit.client.1.smithi107.stdout:3/735: link dc/dd/d42/d55/d58/l6c dc/dd/d20/d23/d39/lf6 0 2024-09-10T10:04:17.396 INFO:tasks.workunit.client.0.smithi071.stdout:1/417: truncate d1/d21/d3d/f4f 5232376 0 2024-09-10T10:04:17.396 INFO:tasks.workunit.client.0.smithi071.stdout:1/418: chown d1/d3f/d5c 4998661 1 2024-09-10T10:04:17.397 INFO:tasks.workunit.client.0.smithi071.stdout:1/419: read d1/d21/f24 [160607,50529] 0 2024-09-10T10:04:17.399 INFO:tasks.workunit.client.0.smithi071.stdout:1/420: mknod d1/d3f/d5c/d72/c88 0 2024-09-10T10:04:17.402 INFO:tasks.workunit.client.0.smithi071.stdout:1/421: dread d1/d21/d65/f53 [0,4194304] 0 2024-09-10T10:04:17.408 INFO:tasks.workunit.client.1.smithi107.stdout:0/467: sync 2024-09-10T10:04:17.408 INFO:tasks.workunit.client.1.smithi107.stdout:9/463: sync 2024-09-10T10:04:17.409 INFO:tasks.workunit.client.0.smithi071.stdout:8/411: fdatasync d5/df/d57/f5a 0 2024-09-10T10:04:17.411 INFO:tasks.workunit.client.1.smithi107.stdout:0/468: creat d6/d5a/d5c/f92 x:0 0 0 2024-09-10T10:04:17.412 INFO:tasks.workunit.client.1.smithi107.stdout:3/736: dwrite dc/dd/f1d [0,4194304] 0 2024-09-10T10:04:17.412 INFO:tasks.workunit.client.1.smithi107.stdout:9/464: readlink d5/d7/d1d/d41/d83/d9a/l6e 0 2024-09-10T10:04:17.412 INFO:tasks.workunit.client.0.smithi071.stdout:5/365: truncate dc/d4a/d61/f6f 7486359 0 2024-09-10T10:04:17.413 INFO:tasks.workunit.client.1.smithi107.stdout:0/469: fdatasync d6/d8/d2f/f1b 0 2024-09-10T10:04:17.413 INFO:tasks.workunit.client.1.smithi107.stdout:9/465: dread - d5/d7/d1d/d29/f86 zero size 2024-09-10T10:04:17.418 INFO:tasks.workunit.client.1.smithi107.stdout:0/470: mkdir d6/d14/d93 0 2024-09-10T10:04:17.418 INFO:tasks.workunit.client.0.smithi071.stdout:8/412: link d5/d36/f6d d5/df/d74/f96 0 2024-09-10T10:04:17.419 INFO:tasks.workunit.client.1.smithi107.stdout:0/471: read f4 [404236,81625] 0 2024-09-10T10:04:17.419 INFO:tasks.workunit.client.0.smithi071.stdout:1/422: truncate d1/d21/d65/f4e 2993412 0 2024-09-10T10:04:17.419 INFO:tasks.workunit.client.0.smithi071.stdout:1/423: chown d1/f19 4 1 2024-09-10T10:04:17.422 INFO:tasks.workunit.client.1.smithi107.stdout:9/466: link d5/d7/d3c/d53/d57/d87/d37/c58 d5/d7/d3c/d53/ca9 0 2024-09-10T10:04:17.423 INFO:tasks.workunit.client.0.smithi071.stdout:8/413: unlink d5/df/d1e/d38/c66 0 2024-09-10T10:04:17.424 INFO:tasks.workunit.client.1.smithi107.stdout:9/467: dread - d5/d7/d3c/d53/f90 zero size 2024-09-10T10:04:17.425 INFO:tasks.workunit.client.0.smithi071.stdout:8/414: readlink d5/df/l34 0 2024-09-10T10:04:17.426 INFO:tasks.workunit.client.0.smithi071.stdout:5/366: write dc/df/d29/f3f [1225344,82973] 0 2024-09-10T10:04:17.426 INFO:tasks.workunit.client.1.smithi107.stdout:9/468: chown d5/d7/d1d/fa0 589581942 1 2024-09-10T10:04:17.427 INFO:tasks.workunit.client.0.smithi071.stdout:8/415: symlink d5/df/d74/l97 0 2024-09-10T10:04:17.427 INFO:tasks.workunit.client.0.smithi071.stdout:1/424: link d1/d21/d2f/c3c d1/d21/d2f/d30/d75/c89 0 2024-09-10T10:04:17.428 INFO:tasks.workunit.client.1.smithi107.stdout:3/737: dwrite dc/dd/f75 [0,4194304] 0 2024-09-10T10:04:17.429 INFO:tasks.workunit.client.1.smithi107.stdout:9/469: mknod d5/d7/d1d/d41/caa 0 2024-09-10T10:04:17.431 INFO:tasks.workunit.client.1.smithi107.stdout:3/738: mknod dc/dd/d45/d26/d41/cf7 0 2024-09-10T10:04:17.436 INFO:tasks.workunit.client.1.smithi107.stdout:9/470: rename d5/d7/d3c/d53 to d5/d7/d1d/d9b/dab 0 2024-09-10T10:04:17.436 INFO:tasks.workunit.client.1.smithi107.stdout:3/739: getdents dc/dd/d45/d26/d41/d44/d35/d4a/de1 0 2024-09-10T10:04:17.438 INFO:tasks.workunit.client.1.smithi107.stdout:3/740: dread - dc/dd/d45/d26/d41/d44/d63/f7b zero size 2024-09-10T10:04:17.440 INFO:tasks.workunit.client.1.smithi107.stdout:3/741: readlink dc/dd/d20/d23/d39/d69/lc2 0 2024-09-10T10:04:17.441 INFO:tasks.workunit.client.1.smithi107.stdout:0/472: dwrite d6/f10 [0,4194304] 0 2024-09-10T10:04:17.445 INFO:tasks.workunit.client.1.smithi107.stdout:3/742: rename dc/dd/d45/d26/d41/d44/d35/d4a/f5c to dc/dd/d45/d26/d41/d44/d35/d4a/de1/de7/ff8 0 2024-09-10T10:04:17.447 INFO:tasks.workunit.client.1.smithi107.stdout:3/743: write dc/dd/d20/d23/fde [943767,114595] 0 2024-09-10T10:04:17.447 INFO:tasks.workunit.client.1.smithi107.stdout:0/473: dwrite d6/d8/d2f/f1b [0,4194304] 0 2024-09-10T10:04:17.449 INFO:tasks.workunit.client.1.smithi107.stdout:0/474: truncate d6/d8/d2f/d35/f8f 959615 0 2024-09-10T10:04:17.454 INFO:tasks.workunit.client.0.smithi071.stdout:3/401: sync 2024-09-10T10:04:17.454 INFO:tasks.workunit.client.0.smithi071.stdout:7/467: sync 2024-09-10T10:04:17.454 INFO:tasks.workunit.client.0.smithi071.stdout:7/468: fsync d9/f19 0 2024-09-10T10:04:17.454 INFO:tasks.workunit.client.1.smithi107.stdout:3/744: dwrite dc/dd/d45/ff0 [0,4194304] 0 2024-09-10T10:04:17.455 INFO:tasks.workunit.client.0.smithi071.stdout:7/469: fdatasync d9/f8f 0 2024-09-10T10:04:17.455 INFO:tasks.workunit.client.1.smithi107.stdout:0/475: dread d6/d8/f15 [0,4194304] 0 2024-09-10T10:04:17.456 INFO:tasks.workunit.client.1.smithi107.stdout:3/745: readlink dc/dd/d20/d23/d39/d69/lc2 0 2024-09-10T10:04:17.460 INFO:tasks.workunit.client.1.smithi107.stdout:3/746: fsync dc/dd/d20/d23/d39/d69/f70 0 2024-09-10T10:04:17.465 INFO:tasks.workunit.client.1.smithi107.stdout:3/747: creat dc/dd/d45/d26/d41/d74/ff9 x:0 0 0 2024-09-10T10:04:17.465 INFO:tasks.workunit.client.1.smithi107.stdout:0/476: dwrite d6/d8/d2f/d35/d3c/d58/d69/f88 [0,4194304] 0 2024-09-10T10:04:17.468 INFO:tasks.workunit.client.1.smithi107.stdout:3/748: creat dc/dd/d42/d55/d58/ffa x:0 0 0 2024-09-10T10:04:17.469 INFO:tasks.workunit.client.1.smithi107.stdout:0/477: mknod d6/d8/d2f/c94 0 2024-09-10T10:04:17.470 INFO:tasks.workunit.client.1.smithi107.stdout:0/478: chown d6/d8/d3e/c42 19 1 2024-09-10T10:04:17.475 INFO:tasks.workunit.client.1.smithi107.stdout:0/479: rmdir d6/d8/d2f/d2e/d32/d85/d8a/d8d 0 2024-09-10T10:04:17.476 INFO:tasks.workunit.client.1.smithi107.stdout:0/480: write d6/d8/d2f/d2e/d32/d56/f8c [749183,63858] 0 2024-09-10T10:04:17.479 INFO:tasks.workunit.client.1.smithi107.stdout:0/481: mkdir d6/d8/d2f/d2e/d32/d95 0 2024-09-10T10:04:17.481 INFO:tasks.workunit.client.1.smithi107.stdout:0/482: unlink d6/d8/d2f/f21 0 2024-09-10T10:04:17.483 INFO:tasks.workunit.client.1.smithi107.stdout:0/483: symlink d6/d8/d2f/d35/d3c/d58/d69/l96 0 2024-09-10T10:04:17.488 INFO:tasks.workunit.client.1.smithi107.stdout:3/749: dwrite dc/dd/d20/d23/ff4 [0,4194304] 0 2024-09-10T10:04:17.490 INFO:tasks.workunit.client.1.smithi107.stdout:3/750: mknod dc/dd/d20/d23/d2f/d9c/cfb 0 2024-09-10T10:04:17.496 INFO:tasks.workunit.client.1.smithi107.stdout:3/751: link dc/dd/d42/d55/d58/d91/fc3 dc/dd/d20/d23/df3/ffc 0 2024-09-10T10:04:17.498 INFO:tasks.workunit.client.1.smithi107.stdout:3/752: creat dc/dd/d45/d26/d41/d74/ffd x:0 0 0 2024-09-10T10:04:17.500 INFO:tasks.workunit.client.1.smithi107.stdout:3/753: write dc/dd/d45/d26/d41/d74/fcb [5233902,54884] 0 2024-09-10T10:04:17.513 INFO:tasks.workunit.client.1.smithi107.stdout:3/754: dread dc/dd/d42/d55/d58/d91/fc3 [0,4194304] 0 2024-09-10T10:04:17.515 INFO:tasks.workunit.client.1.smithi107.stdout:3/755: creat dc/dd/d45/d26/d41/d44/d35/ffe x:0 0 0 2024-09-10T10:04:17.518 INFO:tasks.workunit.client.0.smithi071.stdout:5/367: creat dc/d4a/d61/f7c x:0 0 0 2024-09-10T10:04:17.518 INFO:tasks.workunit.client.1.smithi107.stdout:3/756: rename dc/dd/d45/f77 to dc/dd/fff 0 2024-09-10T10:04:17.519 INFO:tasks.workunit.client.0.smithi071.stdout:1/425: chown d1/l17 1918 1 2024-09-10T10:04:17.521 INFO:tasks.workunit.client.1.smithi107.stdout:3/757: truncate dc/dd/d20/d23/d2f/f85 1022048 0 2024-09-10T10:04:17.523 INFO:tasks.workunit.client.0.smithi071.stdout:7/470: symlink d9/d76/la7 0 2024-09-10T10:04:17.523 INFO:tasks.workunit.client.0.smithi071.stdout:1/426: dread d1/f9 [0,4194304] 0 2024-09-10T10:04:17.524 INFO:tasks.workunit.client.0.smithi071.stdout:5/368: write dc/df/d3e/d5a/f5e [625533,109378] 0 2024-09-10T10:04:17.524 INFO:tasks.workunit.client.0.smithi071.stdout:7/471: chown d9/d15/d40/d80/f84 1558570 1 2024-09-10T10:04:17.526 INFO:tasks.workunit.client.1.smithi107.stdout:3/758: creat dc/dd/d45/f100 x:0 0 0 2024-09-10T10:04:17.527 INFO:tasks.workunit.client.0.smithi071.stdout:7/472: write d9/d1a/f30 [222655,62756] 0 2024-09-10T10:04:17.531 INFO:tasks.workunit.client.0.smithi071.stdout:1/427: dread d1/d21/d2f/d30/f73 [0,4194304] 0 2024-09-10T10:04:17.531 INFO:tasks.workunit.client.1.smithi107.stdout:3/759: mkdir dc/dd/d45/d26/d41/d44/d63/d101 0 2024-09-10T10:04:17.534 INFO:tasks.workunit.client.0.smithi071.stdout:3/402: getdents d3/d1c/d3e 0 2024-09-10T10:04:17.537 INFO:tasks.workunit.client.0.smithi071.stdout:8/416: dwrite d5/df/d1d/d86/f3e [0,4194304] 0 2024-09-10T10:04:17.537 INFO:tasks.workunit.client.0.smithi071.stdout:1/428: symlink d1/d21/d2f/d30/d75/l8a 0 2024-09-10T10:04:17.541 INFO:tasks.workunit.client.0.smithi071.stdout:8/417: write d5/d36/d49/f7c [4543509,26142] 0 2024-09-10T10:04:17.543 INFO:tasks.workunit.client.0.smithi071.stdout:3/403: dread d3/fa [0,4194304] 0 2024-09-10T10:04:17.543 INFO:tasks.workunit.client.0.smithi071.stdout:1/429: fdatasync d1/f3 0 2024-09-10T10:04:17.545 INFO:tasks.workunit.client.0.smithi071.stdout:1/430: fsync d1/d21/d2f/f7c 0 2024-09-10T10:04:17.546 INFO:tasks.workunit.client.1.smithi107.stdout:3/760: dwrite dc/dd/d20/d23/d39/fa3 [0,4194304] 0 2024-09-10T10:04:17.546 INFO:tasks.workunit.client.0.smithi071.stdout:5/369: dread dc/f31 [0,4194304] 0 2024-09-10T10:04:17.546 INFO:tasks.workunit.client.0.smithi071.stdout:7/473: dwrite d9/d2c/f56 [0,4194304] 0 2024-09-10T10:04:17.547 INFO:tasks.workunit.client.0.smithi071.stdout:5/370: write f4 [1385883,935] 0 2024-09-10T10:04:17.548 INFO:tasks.workunit.client.0.smithi071.stdout:7/474: dread - d9/d15/d40/d80/f84 zero size 2024-09-10T10:04:17.549 INFO:tasks.workunit.client.0.smithi071.stdout:3/404: read d3/d20/d30/d3a/f45 [737560,6632] 0 2024-09-10T10:04:17.549 INFO:tasks.workunit.client.1.smithi107.stdout:3/761: symlink dc/dd/d45/d26/d41/d44/d35/d4a/de1/l102 0 2024-09-10T10:04:17.551 INFO:tasks.workunit.client.0.smithi071.stdout:1/431: rmdir d1/d21/d2f/d30/d6a 39 2024-09-10T10:04:17.553 INFO:tasks.workunit.client.0.smithi071.stdout:7/475: creat d9/d76/fa8 x:0 0 0 2024-09-10T10:04:17.553 INFO:tasks.workunit.client.1.smithi107.stdout:3/762: rmdir dc/dd/d45/d26/d41/d74 39 2024-09-10T10:04:17.554 INFO:tasks.workunit.client.0.smithi071.stdout:5/371: creat dc/df/d17/d22/f7d x:0 0 0 2024-09-10T10:04:17.555 INFO:tasks.workunit.client.0.smithi071.stdout:7/476: write d9/d1a/f35 [4502022,16708] 0 2024-09-10T10:04:17.556 INFO:tasks.workunit.client.1.smithi107.stdout:3/763: mknod dc/dd/d20/d23/d39/dac/c103 0 2024-09-10T10:04:17.557 INFO:tasks.workunit.client.0.smithi071.stdout:1/432: write d1/d21/d2f/d30/d6a/f80 [131054,112666] 0 2024-09-10T10:04:17.560 INFO:tasks.workunit.client.1.smithi107.stdout:3/764: unlink dc/dd/d20/d23/d2f/d9c/ld6 0 2024-09-10T10:04:17.561 INFO:tasks.workunit.client.0.smithi071.stdout:1/433: creat d1/d70/f8b x:0 0 0 2024-09-10T10:04:17.562 INFO:tasks.workunit.client.0.smithi071.stdout:5/372: getdents dc/d4a/d61 0 2024-09-10T10:04:17.564 INFO:tasks.workunit.client.0.smithi071.stdout:3/405: dwrite d3/d49/d2f/d7f/f83 [0,4194304] 0 2024-09-10T10:04:17.568 INFO:tasks.workunit.client.0.smithi071.stdout:7/477: dwrite d9/d76/f83 [0,4194304] 0 2024-09-10T10:04:17.569 INFO:tasks.workunit.client.0.smithi071.stdout:5/373: stat dc/d53/d6a/c70 0 2024-09-10T10:04:17.570 INFO:tasks.workunit.client.0.smithi071.stdout:7/478: readlink d9/d76/la7 0 2024-09-10T10:04:17.570 INFO:tasks.workunit.client.0.smithi071.stdout:3/406: mkdir d3/d20/d8d 0 2024-09-10T10:04:17.571 INFO:tasks.workunit.client.1.smithi107.stdout:3/765: dread dc/dd/d45/d26/f82 [0,4194304] 0 2024-09-10T10:04:17.573 INFO:tasks.workunit.client.0.smithi071.stdout:5/374: dread dc/fe [0,4194304] 0 2024-09-10T10:04:17.574 INFO:tasks.workunit.client.0.smithi071.stdout:7/479: mknod d9/d15/d1f/d74/d9b/ca9 0 2024-09-10T10:04:17.574 INFO:tasks.workunit.client.0.smithi071.stdout:7/480: readlink d9/d15/l4b 0 2024-09-10T10:04:17.575 INFO:tasks.workunit.client.0.smithi071.stdout:3/407: truncate d3/d10/f2d 1403395 0 2024-09-10T10:04:17.575 INFO:tasks.workunit.client.0.smithi071.stdout:5/375: mknod dc/df/c7e 0 2024-09-10T10:04:17.578 INFO:tasks.workunit.client.0.smithi071.stdout:3/408: truncate d3/fa 567844 0 2024-09-10T10:04:17.580 INFO:tasks.workunit.client.1.smithi107.stdout:3/766: dwrite dc/dd/d45/d26/d41/d44/d35/d52/fbb [0,4194304] 0 2024-09-10T10:04:17.581 INFO:tasks.workunit.client.0.smithi071.stdout:7/481: link d9/d15/d40/f95 d9/d70/faa 0 2024-09-10T10:04:17.582 INFO:tasks.workunit.client.0.smithi071.stdout:1/434: dwrite d1/d3f/f43 [0,4194304] 0 2024-09-10T10:04:17.582 INFO:tasks.workunit.client.0.smithi071.stdout:3/409: symlink d3/d20/d30/d3a/l8e 0 2024-09-10T10:04:17.585 INFO:tasks.workunit.client.1.smithi107.stdout:5/503: sync 2024-09-10T10:04:17.586 INFO:tasks.workunit.client.1.smithi107.stdout:3/767: mkdir dc/dd/d45/d26/d41/d44/d35/d104 0 2024-09-10T10:04:17.586 INFO:tasks.workunit.client.0.smithi071.stdout:5/376: dwrite dc/df/d17/f2b [0,4194304] 0 2024-09-10T10:04:17.589 INFO:tasks.workunit.client.1.smithi107.stdout:1/525: sync 2024-09-10T10:04:17.590 INFO:tasks.workunit.client.1.smithi107.stdout:5/504: symlink de/d4a/d4e/lae 0 2024-09-10T10:04:17.590 INFO:tasks.workunit.client.0.smithi071.stdout:3/410: rmdir d3/d20/d30/d42/d4a/d60/d78 39 2024-09-10T10:04:17.590 INFO:tasks.workunit.client.1.smithi107.stdout:1/526: read - d2/d12/d7e/f7f zero size 2024-09-10T10:04:17.591 INFO:tasks.workunit.client.0.smithi071.stdout:1/435: creat d1/d21/d3d/d83/f8c x:0 0 0 2024-09-10T10:04:17.591 INFO:tasks.workunit.client.0.smithi071.stdout:5/377: creat dc/d53/f7f x:0 0 0 2024-09-10T10:04:17.592 INFO:tasks.workunit.client.1.smithi107.stdout:3/768: creat dc/dd/d45/d26/d41/d44/f105 x:0 0 0 2024-09-10T10:04:17.592 INFO:tasks.workunit.client.0.smithi071.stdout:7/482: dwrite d9/d11/f14 [0,4194304] 0 2024-09-10T10:04:17.595 INFO:tasks.workunit.client.1.smithi107.stdout:5/505: creat de/d20/d2b/faf x:0 0 0 2024-09-10T10:04:17.595 INFO:tasks.workunit.client.0.smithi071.stdout:1/436: fsync d1/d21/f61 0 2024-09-10T10:04:17.596 INFO:tasks.workunit.client.0.smithi071.stdout:3/411: chown d3/d20/d30/d42/d4a/c61 61818685 1 2024-09-10T10:04:17.598 INFO:tasks.workunit.client.1.smithi107.stdout:1/527: unlink d2/d6/d24/f4f 0 2024-09-10T10:04:17.599 INFO:tasks.workunit.client.1.smithi107.stdout:3/769: mknod dc/dd/d20/d23/d39/c106 0 2024-09-10T10:04:17.600 INFO:tasks.workunit.client.0.smithi071.stdout:3/412: mkdir d3/d20/d30/d5d/d8f 0 2024-09-10T10:04:17.601 INFO:tasks.workunit.client.0.smithi071.stdout:3/413: fdatasync d3/d1c/f22 0 2024-09-10T10:04:17.601 INFO:tasks.workunit.client.1.smithi107.stdout:5/506: mkdir de/d4a/d4e/d89/d99/db0 0 2024-09-10T10:04:17.602 INFO:tasks.workunit.client.0.smithi071.stdout:1/437: creat d1/d21/d2f/d81/f8d x:0 0 0 2024-09-10T10:04:17.605 INFO:tasks.workunit.client.0.smithi071.stdout:1/438: fdatasync d1/d21/d2f/d30/f73 0 2024-09-10T10:04:17.605 INFO:tasks.workunit.client.1.smithi107.stdout:3/770: chown dc/dd/d45/d26/d41/d74/ff9 679 1 2024-09-10T10:04:17.606 INFO:tasks.workunit.client.0.smithi071.stdout:1/439: chown d1/d21/d65/f7a 869765 1 2024-09-10T10:04:17.607 INFO:tasks.workunit.client.1.smithi107.stdout:3/771: stat dc/dd/d42/d55/l5d 0 2024-09-10T10:04:17.607 INFO:tasks.workunit.client.1.smithi107.stdout:5/507: rmdir de/d4a/d4e/d89/d99/db0 0 2024-09-10T10:04:17.609 INFO:tasks.workunit.client.1.smithi107.stdout:1/528: dwrite d2/d12/d5a/f6f [0,4194304] 0 2024-09-10T10:04:17.609 INFO:tasks.workunit.client.0.smithi071.stdout:3/414: truncate d3/d20/d30/d42/d4a/f59 1889329 0 2024-09-10T10:04:17.610 INFO:tasks.workunit.client.1.smithi107.stdout:3/772: write dc/dd/f75 [414335,103980] 0 2024-09-10T10:04:17.612 INFO:tasks.workunit.client.1.smithi107.stdout:1/529: mknod d2/d6/ca7 0 2024-09-10T10:04:17.615 INFO:tasks.workunit.client.1.smithi107.stdout:1/530: mkdir d2/da8 0 2024-09-10T10:04:17.616 INFO:tasks.workunit.client.0.smithi071.stdout:3/415: link d3/d20/d39/f62 d3/d20/d30/d5d/f90 0 2024-09-10T10:04:17.617 INFO:tasks.workunit.client.0.smithi071.stdout:1/440: creat d1/f8e x:0 0 0 2024-09-10T10:04:17.617 INFO:tasks.workunit.client.1.smithi107.stdout:1/531: readlink d2/d6/l8d 0 2024-09-10T10:04:17.618 INFO:tasks.workunit.client.0.smithi071.stdout:3/416: chown d3/d20/d30/f51 1 1 2024-09-10T10:04:17.619 INFO:tasks.workunit.client.1.smithi107.stdout:3/773: dwrite dc/dd/d45/d26/d59/f7a [4194304,4194304] 0 2024-09-10T10:04:17.620 INFO:tasks.workunit.client.0.smithi071.stdout:7/483: write d9/d11/f59 [2751576,116256] 0 2024-09-10T10:04:17.623 INFO:tasks.workunit.client.0.smithi071.stdout:7/484: rmdir d9/d11 39 2024-09-10T10:04:17.624 INFO:tasks.workunit.client.1.smithi107.stdout:3/774: creat dc/dd/d42/d55/d58/d91/f107 x:0 0 0 2024-09-10T10:04:17.624 INFO:tasks.workunit.client.0.smithi071.stdout:3/417: creat d3/d20/f91 x:0 0 0 2024-09-10T10:04:17.625 INFO:tasks.workunit.client.0.smithi071.stdout:7/485: stat d9/d15/d1f/d74/f8b 0 2024-09-10T10:04:17.625 INFO:tasks.workunit.client.0.smithi071.stdout:1/441: dwrite d1/d70/f8b [0,4194304] 0 2024-09-10T10:04:17.627 INFO:tasks.workunit.client.0.smithi071.stdout:1/442: write d1/f29 [5238562,89804] 0 2024-09-10T10:04:17.627 INFO:tasks.workunit.client.1.smithi107.stdout:3/775: readlink dc/dd/d20/d23/d39/lf6 0 2024-09-10T10:04:17.628 INFO:tasks.workunit.client.1.smithi107.stdout:1/532: dwrite d2/d12/d65/d6b/f42 [4194304,4194304] 0 2024-09-10T10:04:17.630 INFO:tasks.workunit.client.0.smithi071.stdout:1/443: write d1/d21/d2f/d30/d6a/f50 [105744,93337] 0 2024-09-10T10:04:17.635 INFO:tasks.workunit.client.0.smithi071.stdout:1/444: symlink d1/d3f/d5c/l8f 0 2024-09-10T10:04:17.635 INFO:tasks.workunit.client.0.smithi071.stdout:3/418: dwrite d3/d49/d34/f6e [0,4194304] 0 2024-09-10T10:04:17.637 INFO:tasks.workunit.client.1.smithi107.stdout:3/776: mknod dc/dd/d45/d26/d41/d44/d63/d101/c108 0 2024-09-10T10:04:17.638 INFO:tasks.workunit.client.0.smithi071.stdout:7/486: creat d9/d15/d1f/fab x:0 0 0 2024-09-10T10:04:17.638 INFO:tasks.workunit.client.0.smithi071.stdout:5/378: dread f6 [0,4194304] 0 2024-09-10T10:04:17.641 INFO:tasks.workunit.client.0.smithi071.stdout:7/487: creat d9/d15/d1f/d74/fac x:0 0 0 2024-09-10T10:04:17.642 INFO:tasks.workunit.client.0.smithi071.stdout:3/419: mknod d3/d49/d2f/d76/c92 0 2024-09-10T10:04:17.643 INFO:tasks.workunit.client.0.smithi071.stdout:3/420: fsync d3/f41 0 2024-09-10T10:04:17.644 INFO:tasks.workunit.client.1.smithi107.stdout:5/508: dread de/f48 [0,4194304] 0 2024-09-10T10:04:17.645 INFO:tasks.workunit.client.1.smithi107.stdout:5/509: write de/d4a/d5c/f8e [822608,7501] 0 2024-09-10T10:04:17.647 INFO:tasks.workunit.client.0.smithi071.stdout:3/421: creat d3/d49/d2f/f93 x:0 0 0 2024-09-10T10:04:17.647 INFO:tasks.workunit.client.0.smithi071.stdout:5/379: dwrite dc/df/f14 [0,4194304] 0 2024-09-10T10:04:17.651 INFO:tasks.workunit.client.0.smithi071.stdout:5/380: mkdir dc/df/d3e/d5a/d80 0 2024-09-10T10:04:17.655 INFO:tasks.workunit.client.0.smithi071.stdout:5/381: dread - dc/df/d17/d22/f7d zero size 2024-09-10T10:04:17.655 INFO:tasks.workunit.client.0.smithi071.stdout:7/488: dwrite d9/d11/f14 [0,4194304] 0 2024-09-10T10:04:17.658 INFO:tasks.workunit.client.0.smithi071.stdout:5/382: dread dc/df/d17/d22/f45 [0,4194304] 0 2024-09-10T10:04:17.658 INFO:tasks.workunit.client.0.smithi071.stdout:7/489: rename d9/d15/d55/c67 to d9/d2c/d4f/cad 0 2024-09-10T10:04:17.660 INFO:tasks.workunit.client.1.smithi107.stdout:1/533: write d2/d12/d65/d6b/f43 [1768029,12196] 0 2024-09-10T10:04:17.660 INFO:tasks.workunit.client.0.smithi071.stdout:2/440: sync 2024-09-10T10:04:17.660 INFO:tasks.workunit.client.0.smithi071.stdout:6/378: sync 2024-09-10T10:04:17.660 INFO:tasks.workunit.client.0.smithi071.stdout:5/383: fsync dc/df/d17/d22/f45 0 2024-09-10T10:04:17.661 INFO:tasks.workunit.client.1.smithi107.stdout:3/777: truncate dc/dd/f4f 209079 0 2024-09-10T10:04:17.661 INFO:tasks.workunit.client.0.smithi071.stdout:2/441: truncate d8/d87/f76 986076 0 2024-09-10T10:04:17.662 INFO:tasks.workunit.client.0.smithi071.stdout:5/384: chown dc/df/d17/d22/l39 444480 1 2024-09-10T10:04:17.663 INFO:tasks.workunit.client.1.smithi107.stdout:1/534: truncate d2/d6/f52 1671992 0 2024-09-10T10:04:17.665 INFO:tasks.workunit.client.0.smithi071.stdout:2/442: creat d8/d87/d51/f95 x:0 0 0 2024-09-10T10:04:17.666 INFO:tasks.workunit.client.0.smithi071.stdout:5/385: creat dc/df/d17/d22/f81 x:0 0 0 2024-09-10T10:04:17.668 INFO:tasks.workunit.client.1.smithi107.stdout:1/535: dread d2/d35/f98 [0,4194304] 0 2024-09-10T10:04:17.668 INFO:tasks.workunit.client.0.smithi071.stdout:6/379: dwrite d4/da/df/d5e/f75 [0,4194304] 0 2024-09-10T10:04:17.669 INFO:tasks.workunit.client.1.smithi107.stdout:1/536: chown d2/f49 51544806 1 2024-09-10T10:04:17.670 INFO:tasks.workunit.client.0.smithi071.stdout:6/380: write d4/da/df/d2e/d3a/f68 [647661,97691] 0 2024-09-10T10:04:17.672 INFO:tasks.workunit.client.0.smithi071.stdout:1/445: write d1/f74 [2230105,30778] 0 2024-09-10T10:04:17.675 INFO:tasks.workunit.client.0.smithi071.stdout:5/386: chown dc/df/f1e 1031049 1 2024-09-10T10:04:17.677 INFO:tasks.workunit.client.0.smithi071.stdout:3/422: write d3/d1c/f79 [953089,103494] 0 2024-09-10T10:04:17.678 INFO:tasks.workunit.client.0.smithi071.stdout:5/387: mknod dc/df/d3e/c82 0 2024-09-10T10:04:17.679 INFO:tasks.workunit.client.0.smithi071.stdout:1/446: mkdir d1/d21/d3d/d4a/d90 0 2024-09-10T10:04:17.679 INFO:tasks.workunit.client.0.smithi071.stdout:2/443: dwrite d8/d38/d47/f5f [0,4194304] 0 2024-09-10T10:04:17.681 INFO:tasks.workunit.client.0.smithi071.stdout:3/423: creat d3/d49/d34/d67/f94 x:0 0 0 2024-09-10T10:04:17.682 INFO:tasks.workunit.client.1.smithi107.stdout:5/510: dread de/f28 [0,4194304] 0 2024-09-10T10:04:17.684 INFO:tasks.workunit.client.0.smithi071.stdout:1/447: dread d1/d3f/f43 [0,4194304] 0 2024-09-10T10:04:17.686 INFO:tasks.workunit.client.1.smithi107.stdout:5/511: rmdir de 39 2024-09-10T10:04:17.686 INFO:tasks.workunit.client.0.smithi071.stdout:3/424: creat d3/d20/d30/d42/d4a/f95 x:0 0 0 2024-09-10T10:04:17.688 INFO:tasks.workunit.client.0.smithi071.stdout:5/388: rename dc/df/c7e to dc/c83 0 2024-09-10T10:04:17.689 INFO:tasks.workunit.client.1.smithi107.stdout:5/512: mkdir de/d20/d2b/d4b/d5e/db1 0 2024-09-10T10:04:17.693 INFO:tasks.workunit.client.0.smithi071.stdout:1/448: rename d1/d21/d3d/d4a/d90 to d1/d21/d2f/d30/d6a/d91 0 2024-09-10T10:04:17.693 INFO:tasks.workunit.client.1.smithi107.stdout:5/513: mkdir de/d4a/d7e/db2 0 2024-09-10T10:04:17.694 INFO:tasks.workunit.client.1.smithi107.stdout:1/537: write d2/d6/d24/f56 [1412443,67065] 0 2024-09-10T10:04:17.695 INFO:tasks.workunit.client.1.smithi107.stdout:1/538: write d2/d12/f95 [383224,36940] 0 2024-09-10T10:04:17.696 INFO:tasks.workunit.client.0.smithi071.stdout:3/425: dread d3/ff [0,4194304] 0 2024-09-10T10:04:17.696 INFO:tasks.workunit.client.0.smithi071.stdout:7/490: dwrite d9/d76/f9a [0,4194304] 0 2024-09-10T10:04:17.697 INFO:tasks.workunit.client.1.smithi107.stdout:5/514: write de/f1e [3608009,112858] 0 2024-09-10T10:04:17.698 INFO:tasks.workunit.client.1.smithi107.stdout:1/539: readlink d2/d12/d65/d6b/l33 0 2024-09-10T10:04:17.699 INFO:tasks.workunit.client.0.smithi071.stdout:7/491: dread - d9/d15/d1f/d74/fac zero size 2024-09-10T10:04:17.700 INFO:tasks.workunit.client.1.smithi107.stdout:1/540: write d2/d35/d7b/d8b/fa2 [106151,98547] 0 2024-09-10T10:04:17.703 INFO:tasks.workunit.client.0.smithi071.stdout:5/389: rename dc/c16 to dc/df/d29/d48/c84 0 2024-09-10T10:04:17.703 INFO:tasks.workunit.client.1.smithi107.stdout:5/515: mkdir de/db3 0 2024-09-10T10:04:17.704 INFO:tasks.workunit.client.0.smithi071.stdout:7/492: chown d9/d15/d40/d80 13 1 2024-09-10T10:04:17.704 INFO:tasks.workunit.client.0.smithi071.stdout:1/449: mknod d1/d21/d2f/d30/d6a/d91/c92 0 2024-09-10T10:04:17.705 INFO:tasks.workunit.client.1.smithi107.stdout:5/516: chown de/d20/d2b/d4b/d8c/dad 247672815 1 2024-09-10T10:04:17.706 INFO:tasks.workunit.client.0.smithi071.stdout:6/381: dwrite d4/da/df/f50 [0,4194304] 0 2024-09-10T10:04:17.707 INFO:tasks.workunit.client.0.smithi071.stdout:5/390: symlink dc/df/d17/d22/l85 0 2024-09-10T10:04:17.707 INFO:tasks.workunit.client.0.smithi071.stdout:6/382: chown d4/da/c39 84248 1 2024-09-10T10:04:17.709 INFO:tasks.workunit.client.1.smithi107.stdout:1/541: dwrite d2/d6/d24/f69 [0,4194304] 0 2024-09-10T10:04:17.712 INFO:tasks.workunit.client.1.smithi107.stdout:1/542: unlink d2/d36/f84 0 2024-09-10T10:04:17.712 INFO:tasks.workunit.client.0.smithi071.stdout:3/426: unlink d3/d20/d30/d5d/f74 0 2024-09-10T10:04:17.714 INFO:tasks.workunit.client.0.smithi071.stdout:7/493: chown d9/d1a/l82 15516 1 2024-09-10T10:04:17.715 INFO:tasks.workunit.client.1.smithi107.stdout:1/543: fdatasync d2/d35/f5b 0 2024-09-10T10:04:17.716 INFO:tasks.workunit.client.0.smithi071.stdout:5/391: stat dc/df/d17/d22/c2e 0 2024-09-10T10:04:17.717 INFO:tasks.workunit.client.0.smithi071.stdout:6/383: creat d4/da/df/d2e/d3a/d3e/f77 x:0 0 0 2024-09-10T10:04:17.717 INFO:tasks.workunit.client.1.smithi107.stdout:1/544: rmdir d2/d35/d7b/d8b 39 2024-09-10T10:04:17.719 INFO:tasks.workunit.client.0.smithi071.stdout:1/450: mknod d1/d70/d76/c93 0 2024-09-10T10:04:17.720 INFO:tasks.workunit.client.1.smithi107.stdout:5/517: truncate de/f5b 559474 0 2024-09-10T10:04:17.720 INFO:tasks.workunit.client.0.smithi071.stdout:3/427: symlink d3/d1c/d3e/d77/l96 0 2024-09-10T10:04:17.721 INFO:tasks.workunit.client.1.smithi107.stdout:5/518: chown de/d20/d2b/d4b/d5e/f94 7490189 1 2024-09-10T10:04:17.722 INFO:tasks.workunit.client.1.smithi107.stdout:5/519: read - de/d20/d2b/faf zero size 2024-09-10T10:04:17.722 INFO:tasks.workunit.client.0.smithi071.stdout:3/428: chown d3/d49/d2f/d76 79 1 2024-09-10T10:04:17.723 INFO:tasks.workunit.client.1.smithi107.stdout:1/545: link d2/d36/f4d d2/da8/fa9 0 2024-09-10T10:04:17.723 INFO:tasks.workunit.client.1.smithi107.stdout:1/546: fdatasync d2/d6/f5e 0 2024-09-10T10:04:17.724 INFO:tasks.workunit.client.0.smithi071.stdout:1/451: creat d1/d21/d2f/d30/d6a/d91/f94 x:0 0 0 2024-09-10T10:04:17.725 INFO:tasks.workunit.client.0.smithi071.stdout:6/384: rename d4/d1c/c41 to d4/d1c/c78 0 2024-09-10T10:04:17.725 INFO:tasks.workunit.client.0.smithi071.stdout:7/494: dwrite d9/d15/d1f/d74/f86 [0,4194304] 0 2024-09-10T10:04:17.726 INFO:tasks.workunit.client.1.smithi107.stdout:1/547: write d2/d35/f98 [1717261,113735] 0 2024-09-10T10:04:17.726 INFO:tasks.workunit.client.0.smithi071.stdout:3/429: creat d3/d1c/d3e/f97 x:0 0 0 2024-09-10T10:04:17.727 INFO:tasks.workunit.client.1.smithi107.stdout:5/520: creat de/d4a/d7e/db2/fb4 x:0 0 0 2024-09-10T10:04:17.728 INFO:tasks.workunit.client.0.smithi071.stdout:1/452: rmdir d1/d21/d3d/d4a 39 2024-09-10T10:04:17.729 INFO:tasks.workunit.client.1.smithi107.stdout:1/548: mknod d2/d36/caa 0 2024-09-10T10:04:17.729 INFO:tasks.workunit.client.0.smithi071.stdout:7/495: mkdir d9/d11/d6f/dae 0 2024-09-10T10:04:17.730 INFO:tasks.workunit.client.1.smithi107.stdout:5/521: creat de/d20/d2b/d4b/d8c/dad/fb5 x:0 0 0 2024-09-10T10:04:17.731 INFO:tasks.workunit.client.0.smithi071.stdout:1/453: fdatasync d1/d21/d2f/f39 0 2024-09-10T10:04:17.731 INFO:tasks.workunit.client.0.smithi071.stdout:6/385: rename d4/da/c39 to d4/da/df/d2e/d3a/d51/c79 0 2024-09-10T10:04:17.733 INFO:tasks.workunit.client.0.smithi071.stdout:7/496: read f4 [4056357,82476] 0 2024-09-10T10:04:17.734 INFO:tasks.workunit.client.0.smithi071.stdout:7/497: write d9/d2c/f56 [1990164,782] 0 2024-09-10T10:04:17.734 INFO:tasks.workunit.client.1.smithi107.stdout:5/522: mkdir de/db3/db6 0 2024-09-10T10:04:17.735 INFO:tasks.workunit.client.0.smithi071.stdout:7/498: readlink d9/d1a/l82 0 2024-09-10T10:04:17.735 INFO:tasks.workunit.client.0.smithi071.stdout:3/430: creat d3/d20/d30/d42/d4a/d60/d78/f98 x:0 0 0 2024-09-10T10:04:17.737 INFO:tasks.workunit.client.0.smithi071.stdout:6/386: mkdir d4/da/df/d2e/d3a/d40/d60/d7a 0 2024-09-10T10:04:17.737 INFO:tasks.workunit.client.1.smithi107.stdout:5/523: rmdir de/d20 39 2024-09-10T10:04:17.739 INFO:tasks.workunit.client.1.smithi107.stdout:1/549: dwrite d2/d6/d67/f92 [0,4194304] 0 2024-09-10T10:04:17.747 INFO:tasks.workunit.client.1.smithi107.stdout:5/524: mknod de/d20/d2b/d4b/d8c/dad/cb7 0 2024-09-10T10:04:17.755 INFO:tasks.workunit.client.1.smithi107.stdout:4/562: sync 2024-09-10T10:04:17.759 INFO:tasks.workunit.client.1.smithi107.stdout:1/550: dwrite d2/d6/f52 [0,4194304] 0 2024-09-10T10:04:17.760 INFO:tasks.workunit.client.1.smithi107.stdout:5/525: dwrite fc [0,4194304] 0 2024-09-10T10:04:17.762 INFO:tasks.workunit.client.1.smithi107.stdout:4/563: write d0/d1f/f66 [420949,120670] 0 2024-09-10T10:04:17.762 INFO:tasks.workunit.client.1.smithi107.stdout:1/551: mknod d2/d12/d5a/cab 0 2024-09-10T10:04:17.766 INFO:tasks.workunit.client.1.smithi107.stdout:4/564: readlink d0/d40/l89 0 2024-09-10T10:04:17.771 INFO:tasks.workunit.client.1.smithi107.stdout:5/526: dwrite de/d20/d3d/f4c [0,4194304] 0 2024-09-10T10:04:17.771 INFO:tasks.workunit.client.1.smithi107.stdout:4/565: unlink d0/d40/c42 0 2024-09-10T10:04:17.771 INFO:tasks.workunit.client.1.smithi107.stdout:1/552: creat d2/d6/d24/d81/fac x:0 0 0 2024-09-10T10:04:17.772 INFO:tasks.workunit.client.1.smithi107.stdout:5/527: readlink de/d41/l47 0 2024-09-10T10:04:17.773 INFO:tasks.workunit.client.1.smithi107.stdout:5/528: dread - de/d20/f91 zero size 2024-09-10T10:04:17.775 INFO:tasks.workunit.client.1.smithi107.stdout:4/566: unlink d0/d1f/d20/d47/f9b 0 2024-09-10T10:04:17.779 INFO:tasks.workunit.client.0.smithi071.stdout:4/440: sync 2024-09-10T10:04:17.779 INFO:tasks.workunit.client.0.smithi071.stdout:9/627: sync 2024-09-10T10:04:17.779 INFO:tasks.workunit.client.0.smithi071.stdout:8/418: sync 2024-09-10T10:04:17.779 INFO:tasks.workunit.client.0.smithi071.stdout:0/360: sync 2024-09-10T10:04:17.779 INFO:tasks.workunit.client.1.smithi107.stdout:4/567: mknod d0/d1f/d20/d47/d8c/cc4 0 2024-09-10T10:04:17.779 INFO:tasks.workunit.client.1.smithi107.stdout:5/529: getdents de/d4a/d4e/d89 0 2024-09-10T10:04:17.780 INFO:tasks.workunit.client.1.smithi107.stdout:1/553: dwrite d2/d35/f3b [0,4194304] 0 2024-09-10T10:04:17.781 INFO:tasks.workunit.client.1.smithi107.stdout:5/530: read - de/d20/d2b/faf zero size 2024-09-10T10:04:17.788 INFO:tasks.workunit.client.1.smithi107.stdout:1/554: dwrite d2/f4c [0,4194304] 0 2024-09-10T10:04:17.791 INFO:tasks.workunit.client.1.smithi107.stdout:1/555: rmdir d2/d89 39 2024-09-10T10:04:17.806 INFO:tasks.workunit.client.0.smithi071.stdout:3/431: mkdir d3/d20/d99 0 2024-09-10T10:04:17.809 INFO:tasks.workunit.client.0.smithi071.stdout:7/499: dwrite d9/f7f [0,4194304] 0 2024-09-10T10:04:17.810 INFO:tasks.workunit.client.0.smithi071.stdout:0/361: stat d11/d1e/c51 0 2024-09-10T10:04:17.810 INFO:tasks.workunit.client.0.smithi071.stdout:9/628: mknod d0/db/d1b/d1d/d4b/cc7 0 2024-09-10T10:04:17.811 INFO:tasks.workunit.client.0.smithi071.stdout:6/387: getdents d4/da/df/d2e/d3a/d40/d60/d7a 0 2024-09-10T10:04:17.817 INFO:tasks.workunit.client.0.smithi071.stdout:4/441: dwrite db/d15/d17/d4e/f6d [0,4194304] 0 2024-09-10T10:04:17.818 INFO:tasks.workunit.client.0.smithi071.stdout:0/362: symlink d11/d30/d52/d5f/l7c 0 2024-09-10T10:04:17.818 INFO:tasks.workunit.client.0.smithi071.stdout:9/629: write d0/d3b/d5c/faa [256044,45240] 0 2024-09-10T10:04:17.819 INFO:tasks.workunit.client.0.smithi071.stdout:4/442: chown db/d15 28980830 1 2024-09-10T10:04:17.821 INFO:tasks.workunit.client.1.smithi107.stdout:1/556: write d2/d12/f3c [988876,112991] 0 2024-09-10T10:04:17.822 INFO:tasks.workunit.client.0.smithi071.stdout:0/363: chown d11/d30/c35 3430494 1 2024-09-10T10:04:17.823 INFO:tasks.workunit.client.1.smithi107.stdout:1/557: readlink d2/l68 0 2024-09-10T10:04:17.825 INFO:tasks.workunit.client.1.smithi107.stdout:5/531: dwrite de/f2d [0,4194304] 0 2024-09-10T10:04:17.826 INFO:tasks.workunit.client.0.smithi071.stdout:3/432: write d3/d49/d2f/f35 [1936792,79985] 0 2024-09-10T10:04:17.829 INFO:tasks.workunit.client.1.smithi107.stdout:1/558: mknod d2/d12/cad 0 2024-09-10T10:04:17.829 INFO:tasks.workunit.client.0.smithi071.stdout:7/500: dwrite f7 [0,4194304] 0 2024-09-10T10:04:17.831 INFO:tasks.workunit.client.0.smithi071.stdout:6/388: link d4/d20/c4e d4/da/df/d2e/d3a/d40/d60/c7b 0 2024-09-10T10:04:17.832 INFO:tasks.workunit.client.1.smithi107.stdout:5/532: dread de/d20/f37 [0,4194304] 0 2024-09-10T10:04:17.833 INFO:tasks.workunit.client.1.smithi107.stdout:1/559: creat d2/d6/d24/fae x:0 0 0 2024-09-10T10:04:17.834 INFO:tasks.workunit.client.0.smithi071.stdout:4/443: rmdir db/d1d/d61/d6a/d7d 0 2024-09-10T10:04:17.835 INFO:tasks.workunit.client.0.smithi071.stdout:6/389: readlink d4/da/df/d2e/d3a/d3e/d45/l52 0 2024-09-10T10:04:17.835 INFO:tasks.workunit.client.0.smithi071.stdout:8/419: dwrite d5/d36/f6d [0,4194304] 0 2024-09-10T10:04:17.838 INFO:tasks.workunit.client.0.smithi071.stdout:0/364: rename d11/d30/d52/c56 to d11/d30/d52/c7d 0 2024-09-10T10:04:17.838 INFO:tasks.workunit.client.0.smithi071.stdout:8/420: read d5/df/d1d/f8d [2793576,71798] 0 2024-09-10T10:04:17.839 INFO:tasks.workunit.client.1.smithi107.stdout:1/560: creat d2/d12/d7e/faf x:0 0 0 2024-09-10T10:04:17.841 INFO:tasks.workunit.client.0.smithi071.stdout:7/501: rename d9/d1a/f88 to d9/d11/faf 0 2024-09-10T10:04:17.841 INFO:tasks.workunit.client.0.smithi071.stdout:1/454: dread d1/d21/f28 [0,4194304] 0 2024-09-10T10:04:17.841 INFO:tasks.workunit.client.1.smithi107.stdout:1/561: write d2/d35/d7b/f8f [383506,56867] 0 2024-09-10T10:04:17.842 INFO:tasks.workunit.client.1.smithi107.stdout:5/533: rename de/d4a/d4e/f8d to de/fb8 0 2024-09-10T10:04:17.853 INFO:tasks.workunit.client.1.smithi107.stdout:8/398: sync 2024-09-10T10:04:17.854 INFO:tasks.workunit.client.1.smithi107.stdout:8/399: write d5/d8/dc/d18/f4b [2297773,34996] 0 2024-09-10T10:04:17.888 INFO:tasks.workunit.client.1.smithi107.stdout:1/562: dread - d2/d89/f9e zero size 2024-09-10T10:04:17.889 INFO:tasks.workunit.client.1.smithi107.stdout:5/534: symlink de/d4a/d7e/d79/lb9 0 2024-09-10T10:04:17.890 INFO:tasks.workunit.client.1.smithi107.stdout:8/400: symlink d5/d8/d5b/l89 0 2024-09-10T10:04:17.891 INFO:tasks.workunit.client.1.smithi107.stdout:1/563: creat d2/d35/fb0 x:0 0 0 2024-09-10T10:04:17.892 INFO:tasks.workunit.client.1.smithi107.stdout:5/535: symlink de/d20/d2b/d4b/d8c/dad/lba 0 2024-09-10T10:04:17.893 INFO:tasks.workunit.client.1.smithi107.stdout:5/536: stat de/d20/d2b/d4b/d5e 0 2024-09-10T10:04:17.896 INFO:tasks.workunit.client.1.smithi107.stdout:1/564: rmdir d2/d12 39 2024-09-10T10:04:17.896 INFO:tasks.workunit.client.1.smithi107.stdout:5/537: write de/d20/d3d/f88 [287618,38918] 0 2024-09-10T10:04:17.897 INFO:tasks.workunit.client.0.smithi071.stdout:3/433: creat d3/d1c/d3e/d77/f9a x:0 0 0 2024-09-10T10:04:17.898 INFO:tasks.workunit.client.1.smithi107.stdout:8/401: dwrite d5/d8/f20 [0,4194304] 0 2024-09-10T10:04:17.898 INFO:tasks.workunit.client.1.smithi107.stdout:1/565: symlink d2/d6/d67/lb1 0 2024-09-10T10:04:17.899 INFO:tasks.workunit.client.0.smithi071.stdout:0/365: chown d11/f18 935757 1 2024-09-10T10:04:17.900 INFO:tasks.workunit.client.0.smithi071.stdout:7/502: chown d9/d15/d1f/f68 0 1 2024-09-10T10:04:17.900 INFO:tasks.workunit.client.1.smithi107.stdout:5/538: mknod de/d4a/d5c/d6d/cbb 0 2024-09-10T10:04:17.902 INFO:tasks.workunit.client.0.smithi071.stdout:6/390: dwrite d4/da/df/d2e/d3a/d3e/d45/f46 [0,4194304] 0 2024-09-10T10:04:17.902 INFO:tasks.workunit.client.1.smithi107.stdout:1/566: creat d2/d6/d24/d81/fb2 x:0 0 0 2024-09-10T10:04:17.902 INFO:tasks.workunit.client.1.smithi107.stdout:8/402: dread d5/d8/d2a/d35/f59 [0,4194304] 0 2024-09-10T10:04:17.903 INFO:tasks.workunit.client.0.smithi071.stdout:8/421: creat d5/df/d1d/d86/d75/d85/f98 x:0 0 0 2024-09-10T10:04:17.904 INFO:tasks.workunit.client.1.smithi107.stdout:8/403: write d5/d8/dc/d1a/f1f [3186454,100661] 0 2024-09-10T10:04:17.905 INFO:tasks.workunit.client.0.smithi071.stdout:7/503: truncate d9/d15/d1f/fab 811510 0 2024-09-10T10:04:17.906 INFO:tasks.workunit.client.0.smithi071.stdout:3/434: mkdir d3/d20/d99/d9b 0 2024-09-10T10:04:17.907 INFO:tasks.workunit.client.0.smithi071.stdout:8/422: write d5/d36/d49/f61 [737036,9256] 0 2024-09-10T10:04:17.907 INFO:tasks.workunit.client.1.smithi107.stdout:5/539: rename de/d20/d2b/d4b/d8c/dad to de/d4a/d7e/db2/dbc 0 2024-09-10T10:04:17.909 INFO:tasks.workunit.client.0.smithi071.stdout:0/366: creat d11/d30/d52/f7e x:0 0 0 2024-09-10T10:04:17.911 INFO:tasks.workunit.client.0.smithi071.stdout:6/391: creat d4/da/df/d2e/d3a/d40/d60/f7c x:0 0 0 2024-09-10T10:04:17.911 INFO:tasks.workunit.client.1.smithi107.stdout:8/404: rename d5/d8/d2a/c4e to d5/d8/c8a 0 2024-09-10T10:04:17.911 INFO:tasks.workunit.client.1.smithi107.stdout:5/540: rmdir de/d20 39 2024-09-10T10:04:17.913 INFO:tasks.workunit.client.0.smithi071.stdout:9/630: dread d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f5d [0,4194304] 0 2024-09-10T10:04:17.913 INFO:tasks.workunit.client.0.smithi071.stdout:8/423: rename d5/f11 to d5/df/d1e/d38/f99 0 2024-09-10T10:04:17.915 INFO:tasks.workunit.client.0.smithi071.stdout:3/435: symlink d3/d20/d8d/l9c 0 2024-09-10T10:04:17.915 INFO:tasks.workunit.client.0.smithi071.stdout:8/424: readlink d5/df/d1e/l46 0 2024-09-10T10:04:17.915 INFO:tasks.workunit.client.0.smithi071.stdout:7/504: dread d9/d76/f83 [0,4194304] 0 2024-09-10T10:04:17.918 INFO:tasks.workunit.client.0.smithi071.stdout:9/631: fsync d0/db/d1b/d1d/d5b/f70 0 2024-09-10T10:04:17.918 INFO:tasks.workunit.client.0.smithi071.stdout:8/425: read - d5/df/d57/d82/f84 zero size 2024-09-10T10:04:17.919 INFO:tasks.workunit.client.1.smithi107.stdout:1/567: dread d2/d12/f1e [0,4194304] 0 2024-09-10T10:04:17.920 INFO:tasks.workunit.client.1.smithi107.stdout:1/568: dread - d2/d36/fa3 zero size 2024-09-10T10:04:17.921 INFO:tasks.workunit.client.0.smithi071.stdout:3/436: mkdir d3/d20/d30/d5d/d9d 0 2024-09-10T10:04:17.921 INFO:tasks.workunit.client.0.smithi071.stdout:1/455: dwrite d1/f19 [0,4194304] 0 2024-09-10T10:04:17.922 INFO:tasks.workunit.client.1.smithi107.stdout:1/569: write d2/d6/f5e [3107689,57773] 0 2024-09-10T10:04:17.923 INFO:tasks.workunit.client.0.smithi071.stdout:0/367: creat d11/d30/d52/f7f x:0 0 0 2024-09-10T10:04:17.923 INFO:tasks.workunit.client.1.smithi107.stdout:1/570: write d2/d12/d7e/faf [55484,97929] 0 2024-09-10T10:04:17.925 INFO:tasks.workunit.client.1.smithi107.stdout:1/571: rmdir d2/da8 39 2024-09-10T10:04:17.926 INFO:tasks.workunit.client.0.smithi071.stdout:8/426: dread d5/f28 [0,4194304] 0 2024-09-10T10:04:17.926 INFO:tasks.workunit.client.0.smithi071.stdout:6/392: rmdir d4/da/df/d2e 39 2024-09-10T10:04:17.927 INFO:tasks.workunit.client.0.smithi071.stdout:1/456: mknod d1/d21/d65/c95 0 2024-09-10T10:04:17.929 INFO:tasks.workunit.client.1.smithi107.stdout:8/405: rename d5/d8/dc to d5/d8/d66/d8b 0 2024-09-10T10:04:17.933 INFO:tasks.workunit.client.0.smithi071.stdout:3/437: dwrite d3/d20/d30/f5f [0,4194304] 0 2024-09-10T10:04:17.934 INFO:tasks.workunit.client.0.smithi071.stdout:8/427: creat d5/df/d1d/f9a x:0 0 0 2024-09-10T10:04:17.935 INFO:tasks.workunit.client.0.smithi071.stdout:1/457: dread d1/f19 [0,4194304] 0 2024-09-10T10:04:17.936 INFO:tasks.workunit.client.0.smithi071.stdout:7/505: getdents d9/d15/d55 0 2024-09-10T10:04:17.938 INFO:tasks.workunit.client.0.smithi071.stdout:1/458: fsync d1/d57/f6b 0 2024-09-10T10:04:17.938 INFO:tasks.workunit.client.0.smithi071.stdout:8/428: chown d5/df/d1d/d86/l20 121 1 2024-09-10T10:04:17.938 INFO:tasks.workunit.client.0.smithi071.stdout:0/368: rename d11/d22/f25 to d11/d30/d52/f80 0 2024-09-10T10:04:17.939 INFO:tasks.workunit.client.0.smithi071.stdout:7/506: chown d9/d1a/f30 774264 1 2024-09-10T10:04:17.939 INFO:tasks.workunit.client.0.smithi071.stdout:3/438: symlink d3/d20/d30/d3a/l9e 0 2024-09-10T10:04:17.940 INFO:tasks.workunit.client.0.smithi071.stdout:1/459: chown d1/l17 0 1 2024-09-10T10:04:17.943 INFO:tasks.workunit.client.0.smithi071.stdout:9/632: dwrite d0/d3b/d5c/f74 [0,4194304] 0 2024-09-10T10:04:17.943 INFO:tasks.workunit.client.1.smithi107.stdout:5/541: dread de/d4a/d4e/d89/d99/fac [0,4194304] 0 2024-09-10T10:04:17.945 INFO:tasks.workunit.client.1.smithi107.stdout:8/406: creat d5/d8/d66/d8b/d81/f8c x:0 0 0 2024-09-10T10:04:17.946 INFO:tasks.workunit.client.1.smithi107.stdout:5/542: symlink de/d41/lbd 0 2024-09-10T10:04:17.946 INFO:tasks.workunit.client.1.smithi107.stdout:1/572: dwrite d2/d6/d24/f50 [0,4194304] 0 2024-09-10T10:04:17.946 INFO:tasks.workunit.client.1.smithi107.stdout:5/543: fsync f9 0 2024-09-10T10:04:17.949 INFO:tasks.workunit.client.1.smithi107.stdout:8/407: rmdir d5/d8/d2a/d35 39 2024-09-10T10:04:17.951 INFO:tasks.workunit.client.1.smithi107.stdout:5/544: mknod de/d4a/d7e/db2/dbc/cbe 0 2024-09-10T10:04:17.951 INFO:tasks.workunit.client.0.smithi071.stdout:1/460: chown d1/d21/d2f/d30/c71 3 1 2024-09-10T10:04:17.951 INFO:tasks.workunit.client.0.smithi071.stdout:7/507: dread d9/d1a/d1d/f5a [0,4194304] 0 2024-09-10T10:04:17.953 INFO:tasks.workunit.client.0.smithi071.stdout:2/444: sync 2024-09-10T10:04:17.953 INFO:tasks.workunit.client.1.smithi107.stdout:8/408: creat d5/d8/d66/d8b/d18/d4f/f8d x:0 0 0 2024-09-10T10:04:17.954 INFO:tasks.workunit.client.0.smithi071.stdout:0/369: getdents d11/d1e 0 2024-09-10T10:04:17.955 INFO:tasks.workunit.client.1.smithi107.stdout:5/545: chown de/d20/c45 990097862 1 2024-09-10T10:04:17.955 INFO:tasks.workunit.client.1.smithi107.stdout:5/546: fdatasync de/d4a/d5c/d6d/f73 0 2024-09-10T10:04:17.956 INFO:tasks.workunit.client.1.smithi107.stdout:1/573: getdents d2/d35/d7b 0 2024-09-10T10:04:17.956 INFO:tasks.workunit.client.1.smithi107.stdout:5/547: readlink de/d9c/la6 0 2024-09-10T10:04:17.957 INFO:tasks.workunit.client.0.smithi071.stdout:3/439: dwrite d3/d20/d39/f53 [0,4194304] 0 2024-09-10T10:04:17.957 INFO:tasks.workunit.client.1.smithi107.stdout:8/409: write d5/d8/d66/d8b/d21/d83/f55 [1185562,6788] 0 2024-09-10T10:04:17.958 INFO:tasks.workunit.client.1.smithi107.stdout:1/574: truncate d2/d35/fb0 587652 0 2024-09-10T10:04:17.961 INFO:tasks.workunit.client.1.smithi107.stdout:8/410: mkdir d5/d8/d66/d8e 0 2024-09-10T10:04:17.961 INFO:tasks.workunit.client.0.smithi071.stdout:1/461: chown d1/d70/l78 444803330 1 2024-09-10T10:04:17.961 INFO:tasks.workunit.client.0.smithi071.stdout:8/429: dwrite d5/df/d1d/d86/f17 [0,4194304] 0 2024-09-10T10:04:17.963 INFO:tasks.workunit.client.1.smithi107.stdout:5/548: unlink de/d20/d2b/d4b/c77 0 2024-09-10T10:04:17.964 INFO:tasks.workunit.client.0.smithi071.stdout:9/633: rename d0/d3b/d44/c5e to d0/db/cc8 0 2024-09-10T10:04:17.964 INFO:tasks.workunit.client.0.smithi071.stdout:2/445: mknod d8/d87/d33/c96 0 2024-09-10T10:04:17.964 INFO:tasks.workunit.client.0.smithi071.stdout:7/508: rename d9 to d9/d76/d66/db0 22 2024-09-10T10:04:17.965 INFO:tasks.workunit.client.0.smithi071.stdout:2/446: chown d8/d24 346 1 2024-09-10T10:04:17.966 INFO:tasks.workunit.client.0.smithi071.stdout:1/462: write d1/d21/d2f/d30/d6a/f80 [307302,112659] 0 2024-09-10T10:04:17.966 INFO:tasks.workunit.client.1.smithi107.stdout:5/549: creat de/db3/fbf x:0 0 0 2024-09-10T10:04:17.968 INFO:tasks.workunit.client.0.smithi071.stdout:8/430: dread d5/df/d1d/f59 [4194304,4194304] 0 2024-09-10T10:04:17.970 INFO:tasks.workunit.client.1.smithi107.stdout:8/411: creat d5/d8/d2a/d35/d70/f8f x:0 0 0 2024-09-10T10:04:17.971 INFO:tasks.workunit.client.1.smithi107.stdout:5/550: mkdir de/d20/d3d/dc0 0 2024-09-10T10:04:17.971 INFO:tasks.workunit.client.1.smithi107.stdout:8/412: chown d5/d8/d66/d8b/d1a/d64 1112179 1 2024-09-10T10:04:17.972 INFO:tasks.workunit.client.0.smithi071.stdout:8/431: fdatasync d5/fe 0 2024-09-10T10:04:17.972 INFO:tasks.workunit.client.0.smithi071.stdout:2/447: creat d8/d4a/f97 x:0 0 0 2024-09-10T10:04:17.973 INFO:tasks.workunit.client.1.smithi107.stdout:5/551: write de/d20/d2b/f60 [1916605,130039] 0 2024-09-10T10:04:17.973 INFO:tasks.workunit.client.0.smithi071.stdout:7/509: creat d9/d15/d1f/d74/d9b/fb1 x:0 0 0 2024-09-10T10:04:17.974 INFO:tasks.workunit.client.0.smithi071.stdout:6/393: dread d4/da/df/d2e/f3b [0,4194304] 0 2024-09-10T10:04:17.975 INFO:tasks.workunit.client.1.smithi107.stdout:1/575: truncate d2/d12/d5a/f70 86509 0 2024-09-10T10:04:17.976 INFO:tasks.workunit.client.0.smithi071.stdout:0/370: dwrite d11/d22/d31/f49 [0,4194304] 0 2024-09-10T10:04:17.977 INFO:tasks.workunit.client.1.smithi107.stdout:5/552: mknod de/d4a/d7e/db2/dbc/cc1 0 2024-09-10T10:04:17.978 INFO:tasks.workunit.client.1.smithi107.stdout:5/553: dread - de/d4a/d5c/faa zero size 2024-09-10T10:04:17.980 INFO:tasks.workunit.client.0.smithi071.stdout:9/634: dwrite d0/d3b/d5c/d6a/f99 [0,4194304] 0 2024-09-10T10:04:17.981 INFO:tasks.workunit.client.1.smithi107.stdout:1/576: rename d2/d12/d5a/f7a to d2/d6/d24/fb3 0 2024-09-10T10:04:17.982 INFO:tasks.workunit.client.1.smithi107.stdout:5/554: mknod de/d4a/d7e/db2/cc2 0 2024-09-10T10:04:17.984 INFO:tasks.workunit.client.0.smithi071.stdout:6/394: write d4/da/df/d2e/d3a/d43/f49 [419264,74301] 0 2024-09-10T10:04:17.984 INFO:tasks.workunit.client.1.smithi107.stdout:1/577: mkdir d2/d12/d65/db4 0 2024-09-10T10:04:17.984 INFO:tasks.workunit.client.0.smithi071.stdout:2/448: creat d8/d38/d8d/f98 x:0 0 0 2024-09-10T10:04:17.987 INFO:tasks.workunit.client.0.smithi071.stdout:7/510: symlink d9/d15/d1f/lb2 0 2024-09-10T10:04:17.989 INFO:tasks.workunit.client.0.smithi071.stdout:0/371: mknod d11/d22/d31/c81 0 2024-09-10T10:04:17.994 INFO:tasks.workunit.client.0.smithi071.stdout:2/449: write d8/d38/d47/d59/f7b [106047,128317] 0 2024-09-10T10:04:17.996 INFO:tasks.workunit.client.0.smithi071.stdout:1/463: dwrite d1/d21/d2f/d30/f73 [0,4194304] 0 2024-09-10T10:04:17.998 INFO:tasks.workunit.client.0.smithi071.stdout:8/432: dwrite d5/df/f5f [0,4194304] 0 2024-09-10T10:04:18.001 INFO:tasks.workunit.client.0.smithi071.stdout:7/511: creat d9/d15/fb3 x:0 0 0 2024-09-10T10:04:18.001 INFO:tasks.workunit.client.0.smithi071.stdout:2/450: mkdir d8/d38/d99 0 2024-09-10T10:04:18.001 INFO:tasks.workunit.client.0.smithi071.stdout:9/635: dwrite d0/db/d1b/d1d/d5b/f70 [0,4194304] 0 2024-09-10T10:04:18.005 INFO:tasks.workunit.client.0.smithi071.stdout:0/372: creat d11/d22/f82 x:0 0 0 2024-09-10T10:04:18.006 INFO:tasks.workunit.client.0.smithi071.stdout:2/451: write d8/f94 [1905389,125769] 0 2024-09-10T10:04:18.007 INFO:tasks.workunit.client.0.smithi071.stdout:6/395: getdents d4/da 0 2024-09-10T10:04:18.011 INFO:tasks.workunit.client.0.smithi071.stdout:7/512: link d9/d15/d40/d80/f84 d9/d11/d6f/fb4 0 2024-09-10T10:04:18.012 INFO:tasks.workunit.client.0.smithi071.stdout:7/513: write d9/d15/d1f/d74/f8b [62770,13082] 0 2024-09-10T10:04:18.013 INFO:tasks.workunit.client.1.smithi107.stdout:8/413: dread d5/d8/d66/d8b/d18/d4f/f5c [0,4194304] 0 2024-09-10T10:04:18.014 INFO:tasks.workunit.client.1.smithi107.stdout:6/523: sync 2024-09-10T10:04:18.014 INFO:tasks.workunit.client.1.smithi107.stdout:9/471: sync 2024-09-10T10:04:18.014 INFO:tasks.workunit.client.1.smithi107.stdout:7/437: sync 2024-09-10T10:04:18.014 INFO:tasks.workunit.client.1.smithi107.stdout:2/541: sync 2024-09-10T10:04:18.014 INFO:tasks.workunit.client.1.smithi107.stdout:0/484: sync 2024-09-10T10:04:18.014 INFO:tasks.workunit.client.1.smithi107.stdout:3/778: sync 2024-09-10T10:04:18.014 INFO:tasks.workunit.client.1.smithi107.stdout:4/568: sync 2024-09-10T10:04:18.015 INFO:tasks.workunit.client.0.smithi071.stdout:6/396: rename d4/da/df/d2e/d3a/d3e/d5d/f6f to d4/d20/f7d 0 2024-09-10T10:04:18.017 INFO:tasks.workunit.client.0.smithi071.stdout:0/373: link d11/d22/d40/f68 d11/d1e/f83 0 2024-09-10T10:04:18.018 INFO:tasks.workunit.client.1.smithi107.stdout:7/438: stat d0/d8/f38 0 2024-09-10T10:04:18.018 INFO:tasks.workunit.client.0.smithi071.stdout:1/464: getdents d1/d21/d3d 0 2024-09-10T10:04:18.019 INFO:tasks.workunit.client.1.smithi107.stdout:5/555: rename de/d20/c38 to de/d20/d2b/d4b/d5e/cc3 0 2024-09-10T10:04:18.019 INFO:tasks.workunit.client.0.smithi071.stdout:7/514: symlink d9/d15/d1f/d74/d9b/lb5 0 2024-09-10T10:04:18.019 INFO:tasks.workunit.client.1.smithi107.stdout:0/485: dread - d6/d8/d2f/d35/d3c/d58/d86/f87 zero size 2024-09-10T10:04:18.021 INFO:tasks.workunit.client.0.smithi071.stdout:1/465: readlink d1/d21/d3d/l47 0 2024-09-10T10:04:18.021 INFO:tasks.workunit.client.0.smithi071.stdout:2/452: getdents d8 0 2024-09-10T10:04:18.021 INFO:tasks.workunit.client.1.smithi107.stdout:3/779: chown dc/dd/d45/d26/d41/d44/d35/d4a/fa9 344400096 1 2024-09-10T10:04:18.022 INFO:tasks.workunit.client.1.smithi107.stdout:6/524: unlink d0/d3d/d14/d17/d49/d55/d56/l6d 0 2024-09-10T10:04:18.022 INFO:tasks.workunit.client.0.smithi071.stdout:8/433: dread d5/fa [0,4194304] 0 2024-09-10T10:04:18.022 INFO:tasks.workunit.client.0.smithi071.stdout:2/453: write d8/f28 [413080,88189] 0 2024-09-10T10:04:18.023 INFO:tasks.workunit.client.0.smithi071.stdout:7/515: chown d9/d2c/d49/l71 65796 1 2024-09-10T10:04:18.024 INFO:tasks.workunit.client.1.smithi107.stdout:9/472: dread d5/d7/d1d/d9b/dab/d57/d87/d37/f52 [0,4194304] 0 2024-09-10T10:04:18.024 INFO:tasks.workunit.client.1.smithi107.stdout:7/439: mkdir d0/d20/d35/d87 0 2024-09-10T10:04:18.024 INFO:tasks.workunit.client.0.smithi071.stdout:8/434: chown d5/df/d1d/d81 186987 1 2024-09-10T10:04:18.024 INFO:tasks.workunit.client.0.smithi071.stdout:2/454: stat d8/d38/d47/c4e 0 2024-09-10T10:04:18.025 INFO:tasks.workunit.client.1.smithi107.stdout:3/780: write dc/dd/d45/ff0 [9315027,15053] 0 2024-09-10T10:04:18.025 INFO:tasks.workunit.client.0.smithi071.stdout:1/466: unlink d1/d21/l2d 0 2024-09-10T10:04:18.026 INFO:tasks.workunit.client.1.smithi107.stdout:5/556: truncate de/d4a/d7e/d79/f7d 870370 0 2024-09-10T10:04:18.026 INFO:tasks.workunit.client.1.smithi107.stdout:8/414: dread d5/d8/d66/d8b/d21/f61 [0,4194304] 0 2024-09-10T10:04:18.027 INFO:tasks.workunit.client.0.smithi071.stdout:8/435: chown d5/df/d1d/d86/f29 55272 1 2024-09-10T10:04:18.027 INFO:tasks.workunit.client.0.smithi071.stdout:7/516: mkdir d9/d11/d91/db6 0 2024-09-10T10:04:18.027 INFO:tasks.workunit.client.1.smithi107.stdout:2/542: write d3/da/df/d20/d36/d4f/d92/f53 [2293736,80958] 0 2024-09-10T10:04:18.029 INFO:tasks.workunit.client.1.smithi107.stdout:0/486: creat d6/d8/d2f/d2e/d32/d95/f97 x:0 0 0 2024-09-10T10:04:18.029 INFO:tasks.workunit.client.0.smithi071.stdout:1/467: creat d1/d21/d2f/d30/d6a/d91/f96 x:0 0 0 2024-09-10T10:04:18.030 INFO:tasks.workunit.client.0.smithi071.stdout:0/374: dread d11/d22/f4f [0,4194304] 0 2024-09-10T10:04:18.032 INFO:tasks.workunit.client.0.smithi071.stdout:7/517: creat d9/d76/d66/fb7 x:0 0 0 2024-09-10T10:04:18.033 INFO:tasks.workunit.client.1.smithi107.stdout:8/415: write d5/d42/f65 [240627,22907] 0 2024-09-10T10:04:18.033 INFO:tasks.workunit.client.1.smithi107.stdout:0/487: readlink d6/d8/d2f/l2b 0 2024-09-10T10:04:18.034 INFO:tasks.workunit.client.1.smithi107.stdout:2/543: chown d3/da/d1e/l43 16031 1 2024-09-10T10:04:18.034 INFO:tasks.workunit.client.1.smithi107.stdout:3/781: readlink dc/dd/d45/d26/d41/d44/d35/d4a/de1/l102 0 2024-09-10T10:04:18.034 INFO:tasks.workunit.client.1.smithi107.stdout:5/557: read - de/d20/d2b/d4b/d5e/fa5 zero size 2024-09-10T10:04:18.037 INFO:tasks.workunit.client.1.smithi107.stdout:2/544: chown d3/da/df/d20/d36/d39/fb2 227 1 2024-09-10T10:04:18.038 INFO:tasks.workunit.client.0.smithi071.stdout:8/436: dwrite d5/df/d74/f83 [0,4194304] 0 2024-09-10T10:04:18.039 INFO:tasks.workunit.client.0.smithi071.stdout:0/375: symlink d11/d30/d52/d5f/l84 0 2024-09-10T10:04:18.039 INFO:tasks.workunit.client.0.smithi071.stdout:9/636: dread d0/d3b/f68 [0,4194304] 0 2024-09-10T10:04:18.039 INFO:tasks.workunit.client.1.smithi107.stdout:1/578: dwrite d2/d35/f47 [0,4194304] 0 2024-09-10T10:04:18.039 INFO:tasks.workunit.client.1.smithi107.stdout:2/545: dread - d3/da/df/d20/d36/f71 zero size 2024-09-10T10:04:18.040 INFO:tasks.workunit.client.0.smithi071.stdout:7/518: truncate d9/d15/d1f/d74/f8b 516839 0 2024-09-10T10:04:18.042 INFO:tasks.workunit.client.0.smithi071.stdout:9/637: chown d0/db/f15 201450 1 2024-09-10T10:04:18.042 INFO:tasks.workunit.client.0.smithi071.stdout:2/455: write d8/f1a [225346,82251] 0 2024-09-10T10:04:18.043 INFO:tasks.workunit.client.0.smithi071.stdout:2/456: fdatasync d8/d38/f70 0 2024-09-10T10:04:18.046 INFO:tasks.workunit.client.0.smithi071.stdout:0/376: mknod d11/d30/d52/d79/c85 0 2024-09-10T10:04:18.047 INFO:tasks.workunit.client.0.smithi071.stdout:9/638: creat d0/db/d1b/d1d/fc9 x:0 0 0 2024-09-10T10:04:18.049 INFO:tasks.workunit.client.1.smithi107.stdout:9/473: creat d5/d7/d3c/fac x:0 0 0 2024-09-10T10:04:18.051 INFO:tasks.workunit.client.0.smithi071.stdout:2/457: creat d8/d87/d33/d41/d4d/d5e/f9a x:0 0 0 2024-09-10T10:04:18.051 INFO:tasks.workunit.client.0.smithi071.stdout:0/377: rmdir d11/d1e 39 2024-09-10T10:04:18.052 INFO:tasks.workunit.client.0.smithi071.stdout:0/378: readlink la 0 2024-09-10T10:04:18.053 INFO:tasks.workunit.client.0.smithi071.stdout:8/437: mkdir d5/df/d1d/d81/d9b 0 2024-09-10T10:04:18.053 INFO:tasks.workunit.client.0.smithi071.stdout:9/639: write d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f6b [947297,42573] 0 2024-09-10T10:04:18.054 INFO:tasks.workunit.client.0.smithi071.stdout:2/458: write d8/d4a/f97 [806745,18891] 0 2024-09-10T10:04:18.055 INFO:tasks.workunit.client.0.smithi071.stdout:7/519: mkdir d9/d15/d40/db8 0 2024-09-10T10:04:18.056 INFO:tasks.workunit.client.0.smithi071.stdout:0/379: chown d11/d30/d52/d5f/f6b 2 1 2024-09-10T10:04:18.056 INFO:tasks.workunit.client.0.smithi071.stdout:7/520: write d9/d2c/d49/f62 [3512842,41177] 0 2024-09-10T10:04:18.057 INFO:tasks.workunit.client.0.smithi071.stdout:0/380: rename d11 to d11/d30/d86 22 2024-09-10T10:04:18.057 INFO:tasks.workunit.client.1.smithi107.stdout:4/569: dread d0/d1f/d20/f2c [0,4194304] 0 2024-09-10T10:04:18.058 INFO:tasks.workunit.client.0.smithi071.stdout:1/468: truncate d1/d70/f7b 538820 0 2024-09-10T10:04:18.059 INFO:tasks.workunit.client.0.smithi071.stdout:8/438: rmdir d5/df/d1e/d70 39 2024-09-10T10:04:18.060 INFO:tasks.workunit.client.0.smithi071.stdout:2/459: chown d8/d87/d33/d41/d4d 72 1 2024-09-10T10:04:18.061 INFO:tasks.workunit.client.0.smithi071.stdout:9/640: creat d0/db/d1b/d1d/d5b/d60/fca x:0 0 0 2024-09-10T10:04:18.062 INFO:tasks.workunit.client.0.smithi071.stdout:1/469: truncate d1/d21/d2f/d30/f33 5206645 0 2024-09-10T10:04:18.063 INFO:tasks.workunit.client.0.smithi071.stdout:5/392: sync 2024-09-10T10:04:18.063 INFO:tasks.workunit.client.0.smithi071.stdout:8/439: chown d5/df/d1d/d86/f3b 26640494 1 2024-09-10T10:04:18.063 INFO:tasks.workunit.client.0.smithi071.stdout:1/470: chown d1/d70 7461 1 2024-09-10T10:04:18.065 INFO:tasks.workunit.client.0.smithi071.stdout:7/521: mkdir d9/d15/d1f/db9 0 2024-09-10T10:04:18.065 INFO:tasks.workunit.client.0.smithi071.stdout:2/460: write d8/d38/f57 [4816406,63701] 0 2024-09-10T10:04:18.066 INFO:tasks.workunit.client.0.smithi071.stdout:9/641: write d0/f2e [3492014,4005] 0 2024-09-10T10:04:18.069 INFO:tasks.workunit.client.1.smithi107.stdout:7/440: mknod d0/d8/d5c/c88 0 2024-09-10T10:04:18.069 INFO:tasks.workunit.client.0.smithi071.stdout:8/440: creat d5/df/d1d/d86/f9c x:0 0 0 2024-09-10T10:04:18.070 INFO:tasks.workunit.client.0.smithi071.stdout:5/393: chown dc/f3c 35 1 2024-09-10T10:04:18.070 INFO:tasks.workunit.client.1.smithi107.stdout:7/441: dread - d0/d8/dc/d2c/f7e zero size 2024-09-10T10:04:18.079 INFO:tasks.workunit.client.0.smithi071.stdout:1/471: getdents d1/d21/d3d/d4a 0 2024-09-10T10:04:18.079 INFO:tasks.workunit.client.0.smithi071.stdout:8/441: dread d5/d36/d49/f61 [0,4194304] 0 2024-09-10T10:04:18.080 INFO:tasks.workunit.client.1.smithi107.stdout:3/782: truncate dc/dd/d45/d26/f82 1994759 0 2024-09-10T10:04:18.080 INFO:tasks.workunit.client.0.smithi071.stdout:5/394: rename dc/fd to dc/df/d3e/d5a/d80/f86 0 2024-09-10T10:04:18.084 INFO:tasks.workunit.client.0.smithi071.stdout:7/522: link d9/d15/d55/f6e d9/d11/d6f/fba 0 2024-09-10T10:04:18.084 INFO:tasks.workunit.client.0.smithi071.stdout:1/472: mkdir d1/d21/d2f/d30/d75/d97 0 2024-09-10T10:04:18.084 INFO:tasks.workunit.client.1.smithi107.stdout:4/570: chown d0/f12 3349 1 2024-09-10T10:04:18.085 INFO:tasks.workunit.client.0.smithi071.stdout:2/461: rename d8/d87/d33/f36 to d8/d87/d33/d41/d4d/d52/f9b 0 2024-09-10T10:04:18.088 INFO:tasks.workunit.client.1.smithi107.stdout:0/488: mknod d6/d14/c98 0 2024-09-10T10:04:18.089 INFO:tasks.workunit.client.0.smithi071.stdout:7/523: mknod d9/d15/d55/cbb 0 2024-09-10T10:04:18.090 INFO:tasks.workunit.client.1.smithi107.stdout:0/489: write d6/d8/d2f/d2e/f52 [25584,124688] 0 2024-09-10T10:04:18.092 INFO:tasks.workunit.client.1.smithi107.stdout:3/783: rmdir dc/dd/d20/d23 39 2024-09-10T10:04:18.095 INFO:tasks.workunit.client.0.smithi071.stdout:0/381: dread d11/d1e/f74 [0,4194304] 0 2024-09-10T10:04:18.096 INFO:tasks.workunit.client.0.smithi071.stdout:7/524: chown d9/d1a/d1d/f5a 661052107 1 2024-09-10T10:04:18.096 INFO:tasks.workunit.client.1.smithi107.stdout:2/546: link d3/da/df/d20/d36/fb5 d3/d21/d79/fbe 0 2024-09-10T10:04:18.096 INFO:tasks.workunit.client.0.smithi071.stdout:5/395: dwrite dc/df/d17/d22/f7d [0,4194304] 0 2024-09-10T10:04:18.097 INFO:tasks.workunit.client.0.smithi071.stdout:1/473: rename d1/d21/d2f/d30/d6a/d91/f96 to d1/d21/f98 0 2024-09-10T10:04:18.101 INFO:tasks.workunit.client.0.smithi071.stdout:7/525: rmdir d9/d15/d1f/d74 39 2024-09-10T10:04:18.101 INFO:tasks.workunit.client.1.smithi107.stdout:7/442: mknod d0/d8/c89 0 2024-09-10T10:04:18.102 INFO:tasks.workunit.client.0.smithi071.stdout:8/442: dwrite d5/d36/f65 [0,4194304] 0 2024-09-10T10:04:18.103 INFO:tasks.workunit.client.1.smithi107.stdout:6/525: link d0/d3d/d14/d21/d83/f86 d0/d3d/fb1 0 2024-09-10T10:04:18.104 INFO:tasks.workunit.client.0.smithi071.stdout:5/396: chown dc/df/d29/f3f 15495915 1 2024-09-10T10:04:18.106 INFO:tasks.workunit.client.0.smithi071.stdout:9/642: dread d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f6b [0,4194304] 0 2024-09-10T10:04:18.106 INFO:tasks.workunit.client.0.smithi071.stdout:2/462: truncate d8/f20 691454 0 2024-09-10T10:04:18.108 INFO:tasks.workunit.client.0.smithi071.stdout:2/463: stat d8/c1e 0 2024-09-10T10:04:18.108 INFO:tasks.workunit.client.0.smithi071.stdout:5/397: chown dc/d4a 15239780 1 2024-09-10T10:04:18.109 INFO:tasks.workunit.client.1.smithi107.stdout:7/443: dwrite d0/d8/dc/d2c/f6e [0,4194304] 0 2024-09-10T10:04:18.111 INFO:tasks.workunit.client.1.smithi107.stdout:3/784: chown dc/dd/d20/d23/d39/d69/f8c 1031767004 1 2024-09-10T10:04:18.111 INFO:tasks.workunit.client.0.smithi071.stdout:1/474: rename d1/f3 to d1/d70/d76/f99 0 2024-09-10T10:04:18.112 INFO:tasks.workunit.client.0.smithi071.stdout:5/398: write dc/df/f7b [891655,111382] 0 2024-09-10T10:04:18.113 INFO:tasks.workunit.client.1.smithi107.stdout:3/785: write dc/dd/d45/d26/d41/d44/d35/f9b [240039,121528] 0 2024-09-10T10:04:18.114 INFO:tasks.workunit.client.0.smithi071.stdout:9/643: mknod d0/db/d1b/d1d/d5b/d9f/ccb 0 2024-09-10T10:04:18.115 INFO:tasks.workunit.client.1.smithi107.stdout:3/786: write dc/dd/d45/d26/df5/fce [274451,65542] 0 2024-09-10T10:04:18.115 INFO:tasks.workunit.client.1.smithi107.stdout:4/571: stat d0/d40/d57/d76/l8b 0 2024-09-10T10:04:18.117 INFO:tasks.workunit.client.1.smithi107.stdout:6/526: mknod d0/d3d/d14/d21/d8a/da2/da3/dac/cb2 0 2024-09-10T10:04:18.120 INFO:tasks.workunit.client.0.smithi071.stdout:9/644: dread - d0/d3b/f97 zero size 2024-09-10T10:04:18.120 INFO:tasks.workunit.client.0.smithi071.stdout:1/475: chown d1/d21/d2f/d30/d6a/d91/c92 125347 1 2024-09-10T10:04:18.120 INFO:tasks.workunit.client.0.smithi071.stdout:7/526: dwrite d9/d11/d91/f9e [0,4194304] 0 2024-09-10T10:04:18.123 INFO:tasks.workunit.client.0.smithi071.stdout:8/443: write d5/df/d57/f5a [1816698,62600] 0 2024-09-10T10:04:18.124 INFO:tasks.workunit.client.0.smithi071.stdout:5/399: mkdir dc/df/d17/d22/d87 0 2024-09-10T10:04:18.125 INFO:tasks.workunit.client.1.smithi107.stdout:9/474: getdents d5/d7/d1d/d41/d83/d9a 0 2024-09-10T10:04:18.127 INFO:tasks.workunit.client.0.smithi071.stdout:0/382: dwrite f2 [4194304,4194304] 0 2024-09-10T10:04:18.127 INFO:tasks.workunit.client.1.smithi107.stdout:9/475: write d5/d7/f8b [11301,68307] 0 2024-09-10T10:04:18.127 INFO:tasks.workunit.client.1.smithi107.stdout:2/547: link d3/da/df/d20/d36/f76 d3/da/d66/d91/dae/fbf 0 2024-09-10T10:04:18.128 INFO:tasks.workunit.client.1.smithi107.stdout:2/548: readlink d3/da/d66/l6a 0 2024-09-10T10:04:18.129 INFO:tasks.workunit.client.0.smithi071.stdout:1/476: fdatasync d1/f19 0 2024-09-10T10:04:18.130 INFO:tasks.workunit.client.1.smithi107.stdout:9/476: write d5/f64 [5592608,41508] 0 2024-09-10T10:04:18.130 INFO:tasks.workunit.client.1.smithi107.stdout:3/787: write dc/dd/d20/d23/d39/d69/fe6 [1771201,56294] 0 2024-09-10T10:04:18.133 INFO:tasks.workunit.client.0.smithi071.stdout:9/645: creat d0/db/d20/d21/fcc x:0 0 0 2024-09-10T10:04:18.133 INFO:tasks.workunit.client.1.smithi107.stdout:5/558: getdents de/d4a 0 2024-09-10T10:04:18.134 INFO:tasks.workunit.client.0.smithi071.stdout:8/444: creat d5/df/d1d/d86/d75/f9d x:0 0 0 2024-09-10T10:04:18.134 INFO:tasks.workunit.client.1.smithi107.stdout:0/490: creat d6/d14/f99 x:0 0 0 2024-09-10T10:04:18.135 INFO:tasks.workunit.client.0.smithi071.stdout:7/527: symlink d9/lbc 0 2024-09-10T10:04:18.138 INFO:tasks.workunit.client.0.smithi071.stdout:8/445: fdatasync d5/df/d1e/d38/f4c 0 2024-09-10T10:04:18.140 INFO:tasks.workunit.client.0.smithi071.stdout:1/477: rename d1/d3f/d5c to d1/d21/d3d/d9a 0 2024-09-10T10:04:18.142 INFO:tasks.workunit.client.0.smithi071.stdout:0/383: dwrite d11/d30/d52/f7e [0,4194304] 0 2024-09-10T10:04:18.142 INFO:tasks.workunit.client.1.smithi107.stdout:2/549: rmdir d3/da/df/d78 39 2024-09-10T10:04:18.144 INFO:tasks.workunit.client.0.smithi071.stdout:7/528: read - d9/d15/d40/d80/f84 zero size 2024-09-10T10:04:18.145 INFO:tasks.workunit.client.0.smithi071.stdout:5/400: rename dc/df/d17/d22/f44 to dc/df/d3e/d5a/f88 0 2024-09-10T10:04:18.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:17 smithi107 ceph-mon[34215]: pgmap v259: 65 pgs: 65 active+clean; 1.6 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 44 MiB/s rd, 219 MiB/s wr, 436 op/s 2024-09-10T10:04:18.147 INFO:tasks.workunit.client.0.smithi071.stdout:1/478: dread d1/d21/d65/f53 [0,4194304] 0 2024-09-10T10:04:18.150 INFO:tasks.workunit.client.0.smithi071.stdout:0/384: symlink d11/d22/d31/d72/l87 0 2024-09-10T10:04:18.154 INFO:tasks.workunit.client.1.smithi107.stdout:4/572: dwrite d0/d1f/d20/f51 [0,4194304] 0 2024-09-10T10:04:18.154 INFO:tasks.workunit.client.1.smithi107.stdout:9/477: dwrite d5/d7/d1d/d41/d83/fa6 [0,4194304] 0 2024-09-10T10:04:18.155 INFO:tasks.workunit.client.1.smithi107.stdout:4/573: dread - d0/d40/d57/fb0 zero size 2024-09-10T10:04:18.156 INFO:tasks.workunit.client.0.smithi071.stdout:5/401: dwrite dc/d53/f7f [0,4194304] 0 2024-09-10T10:04:18.156 INFO:tasks.workunit.client.0.smithi071.stdout:8/446: getdents d5/df/d57 0 2024-09-10T10:04:18.157 INFO:tasks.workunit.client.1.smithi107.stdout:9/478: write d5/d7/d1d/d41/d83/d9a/f28 [4577552,92240] 0 2024-09-10T10:04:18.157 INFO:tasks.workunit.client.1.smithi107.stdout:0/491: dread d6/d8/d2f/d35/d3c/f74 [0,4194304] 0 2024-09-10T10:04:18.158 INFO:tasks.workunit.client.0.smithi071.stdout:5/402: truncate dc/d53/f60 319163 0 2024-09-10T10:04:18.160 INFO:tasks.workunit.client.0.smithi071.stdout:5/403: write dc/df/d29/f3f [1921131,61879] 0 2024-09-10T10:04:18.163 INFO:tasks.workunit.client.0.smithi071.stdout:7/529: link d9/d15/d1f/f65 d9/d2c/d49/fbd 0 2024-09-10T10:04:18.165 INFO:tasks.workunit.client.0.smithi071.stdout:0/385: dwrite d11/d30/f5d [0,4194304] 0 2024-09-10T10:04:18.166 INFO:tasks.workunit.client.0.smithi071.stdout:1/479: creat d1/d21/d2f/f9b x:0 0 0 2024-09-10T10:04:18.167 INFO:tasks.workunit.client.0.smithi071.stdout:0/386: fdatasync f0 0 2024-09-10T10:04:18.170 INFO:tasks.workunit.client.1.smithi107.stdout:1/579: rename d2/l68 to d2/d12/d5a/lb5 0 2024-09-10T10:04:18.177 INFO:tasks.workunit.client.0.smithi071.stdout:0/387: symlink d11/l88 0 2024-09-10T10:04:18.178 INFO:tasks.workunit.client.0.smithi071.stdout:8/447: dwrite d5/df/f80 [0,4194304] 0 2024-09-10T10:04:18.180 INFO:tasks.workunit.client.0.smithi071.stdout:9/646: dwrite d0/db/d1b/d1d/d4b/f4c [0,4194304] 0 2024-09-10T10:04:18.182 INFO:tasks.workunit.client.0.smithi071.stdout:0/388: creat d11/d1e/f89 x:0 0 0 2024-09-10T10:04:18.185 INFO:tasks.workunit.client.0.smithi071.stdout:7/530: getdents d9/d15/d55 0 2024-09-10T10:04:18.186 INFO:tasks.workunit.client.0.smithi071.stdout:0/389: stat d11/d30/d52/d5f/f67 0 2024-09-10T10:04:18.186 INFO:tasks.workunit.client.0.smithi071.stdout:7/531: readlink l8 0 2024-09-10T10:04:18.187 INFO:tasks.workunit.client.0.smithi071.stdout:7/532: chown d9/d15/f6c 1582 1 2024-09-10T10:04:18.188 INFO:tasks.workunit.client.0.smithi071.stdout:9/647: unlink d0/d3b/f3e 0 2024-09-10T10:04:18.188 INFO:tasks.workunit.client.1.smithi107.stdout:6/527: write d0/d3d/d14/d17/d24/f6f [1721473,3583] 0 2024-09-10T10:04:18.189 INFO:tasks.workunit.client.1.smithi107.stdout:6/528: chown d0/d3d/d14/f58 15976 1 2024-09-10T10:04:18.190 INFO:tasks.workunit.client.1.smithi107.stdout:7/444: truncate d0/d8/f13 1600505 0 2024-09-10T10:04:18.191 INFO:tasks.workunit.client.0.smithi071.stdout:0/390: creat d11/d22/d31/d72/f8a x:0 0 0 2024-09-10T10:04:18.194 INFO:tasks.workunit.client.1.smithi107.stdout:4/574: write d0/d40/fad [1159798,106595] 0 2024-09-10T10:04:18.194 INFO:tasks.workunit.client.0.smithi071.stdout:7/533: creat d9/d15/d40/db8/fbe x:0 0 0 2024-09-10T10:04:18.195 INFO:tasks.workunit.client.0.smithi071.stdout:0/391: creat d11/d22/d31/d72/f8b x:0 0 0 2024-09-10T10:04:18.195 INFO:tasks.workunit.client.1.smithi107.stdout:9/479: mknod d5/d7/d1d/d9b/dab/d57/cad 0 2024-09-10T10:04:18.195 INFO:tasks.workunit.client.0.smithi071.stdout:8/448: link d5/df/l35 d5/df/d1d/d86/d75/d85/l9e 0 2024-09-10T10:04:18.197 INFO:tasks.workunit.client.0.smithi071.stdout:9/648: dwrite d0/db/d1b/f78 [0,4194304] 0 2024-09-10T10:04:18.198 INFO:tasks.workunit.client.0.smithi071.stdout:0/392: chown d11/d22/d31/l3e 93076 1 2024-09-10T10:04:18.198 INFO:tasks.workunit.client.1.smithi107.stdout:5/559: symlink de/db3/db6/lc4 0 2024-09-10T10:04:18.198 INFO:tasks.workunit.client.1.smithi107.stdout:3/788: dwrite dc/dd/d45/d26/d41/d44/d35/d4a/f5a [0,4194304] 0 2024-09-10T10:04:18.198 INFO:tasks.workunit.client.0.smithi071.stdout:8/449: dread - d5/df/d1d/d86/f63 zero size 2024-09-10T10:04:18.199 INFO:tasks.workunit.client.0.smithi071.stdout:7/534: symlink d9/d15/d40/d80/lbf 0 2024-09-10T10:04:18.199 INFO:tasks.workunit.client.1.smithi107.stdout:3/789: dread - dc/dd/d42/de8/fe9 zero size 2024-09-10T10:04:18.200 INFO:tasks.workunit.client.0.smithi071.stdout:0/393: creat d11/d30/d70/f8c x:0 0 0 2024-09-10T10:04:18.201 INFO:tasks.workunit.client.1.smithi107.stdout:3/790: fdatasync dc/dd/d45/d26/d41/d44/d35/d4a/ff1 0 2024-09-10T10:04:18.202 INFO:tasks.workunit.client.0.smithi071.stdout:0/394: read d11/d22/f4e [1328200,53445] 0 2024-09-10T10:04:18.206 INFO:tasks.workunit.client.1.smithi107.stdout:1/580: truncate d2/d35/d9c/f9d 1671020 0 2024-09-10T10:04:18.207 INFO:tasks.workunit.client.1.smithi107.stdout:3/791: dread dc/dd/d20/fc9 [0,4194304] 0 2024-09-10T10:04:18.207 INFO:tasks.workunit.client.1.smithi107.stdout:5/560: readlink de/d20/l32 0 2024-09-10T10:04:18.208 INFO:tasks.workunit.client.0.smithi071.stdout:7/535: rename d9/d15/c8a to d9/d15/d1f/d74/d9b/cc0 0 2024-09-10T10:04:18.209 INFO:tasks.workunit.client.1.smithi107.stdout:9/480: truncate d5/d7/d1d/d9b/dab/d57/d87/d27/f60 223935 0 2024-09-10T10:04:18.210 INFO:tasks.workunit.client.0.smithi071.stdout:7/536: creat d9/d15/d1f/d98/fc1 x:0 0 0 2024-09-10T10:04:18.210 INFO:tasks.workunit.client.1.smithi107.stdout:5/561: write de/d4a/d7e/db2/dbc/fb5 [157848,36849] 0 2024-09-10T10:04:18.210 INFO:tasks.workunit.client.1.smithi107.stdout:2/550: link d3/f18 d3/da/df/d20/fc0 0 2024-09-10T10:04:18.211 INFO:tasks.workunit.client.0.smithi071.stdout:0/395: symlink d11/d30/d52/l8d 0 2024-09-10T10:04:18.211 INFO:tasks.workunit.client.0.smithi071.stdout:9/649: link d0/db/d1b/lb6 d0/db/d1b/d1d/d4b/lcd 0 2024-09-10T10:04:18.212 INFO:tasks.workunit.client.1.smithi107.stdout:2/551: stat d3/d21/d79 0 2024-09-10T10:04:18.212 INFO:tasks.workunit.client.1.smithi107.stdout:4/575: dread d0/d40/d75/f39 [0,4194304] 0 2024-09-10T10:04:18.212 INFO:tasks.workunit.client.1.smithi107.stdout:1/581: fdatasync d2/d12/d5a/f73 0 2024-09-10T10:04:18.212 INFO:tasks.workunit.client.0.smithi071.stdout:7/537: chown d9/d15/d40/l75 735980 1 2024-09-10T10:04:18.213 INFO:tasks.workunit.client.1.smithi107.stdout:5/562: write de/d4a/d7e/db2/fb4 [251624,93388] 0 2024-09-10T10:04:18.213 INFO:tasks.workunit.client.0.smithi071.stdout:9/650: fdatasync d0/db/d1b/d1d/f3a 0 2024-09-10T10:04:18.214 INFO:tasks.workunit.client.0.smithi071.stdout:7/538: dread d9/d1a/d1d/f5a [0,4194304] 0 2024-09-10T10:04:18.215 INFO:tasks.workunit.client.1.smithi107.stdout:4/576: chown d0/d40/d57/d4f/f61 47 1 2024-09-10T10:04:18.215 INFO:tasks.workunit.client.1.smithi107.stdout:3/792: unlink dc/dd/d45/d26/d41/d44/d35/d4a/dd8/le2 0 2024-09-10T10:04:18.215 INFO:tasks.workunit.client.1.smithi107.stdout:4/577: read d0/d40/d75/f39 [2486055,120645] 0 2024-09-10T10:04:18.216 INFO:tasks.workunit.client.0.smithi071.stdout:8/450: rmdir d5/df/d1d/d86/d75/d85 39 2024-09-10T10:04:18.217 INFO:tasks.workunit.client.1.smithi107.stdout:5/563: symlink de/d9c/lc5 0 2024-09-10T10:04:18.217 INFO:tasks.workunit.client.0.smithi071.stdout:9/651: fsync d0/d3b/d44/f5f 0 2024-09-10T10:04:18.217 INFO:tasks.workunit.client.1.smithi107.stdout:2/552: dread d3/da/d1e/d27/fa4 [0,4194304] 0 2024-09-10T10:04:18.219 INFO:tasks.workunit.client.1.smithi107.stdout:5/564: chown de/d20/f5d 0 1 2024-09-10T10:04:18.222 INFO:tasks.workunit.client.1.smithi107.stdout:8/416: rename d5/d8/f9 to d5/d8/d5b/f90 0 2024-09-10T10:04:18.222 INFO:tasks.workunit.client.1.smithi107.stdout:1/582: link d2/f32 d2/d35/d7b/d8b/fb6 0 2024-09-10T10:04:18.223 INFO:tasks.workunit.client.0.smithi071.stdout:8/451: unlink d5/df/d74/f83 0 2024-09-10T10:04:18.224 INFO:tasks.workunit.client.1.smithi107.stdout:5/565: symlink de/d4a/lc6 0 2024-09-10T10:04:18.225 INFO:tasks.workunit.client.0.smithi071.stdout:7/539: dwrite d9/d76/f83 [4194304,4194304] 0 2024-09-10T10:04:18.225 INFO:tasks.workunit.client.1.smithi107.stdout:2/553: symlink d3/da/df/d20/d36/d4f/lc1 0 2024-09-10T10:04:18.228 INFO:tasks.workunit.client.1.smithi107.stdout:3/793: dwrite dc/dd/d45/d26/d41/d74/f8f [0,4194304] 0 2024-09-10T10:04:18.230 INFO:tasks.workunit.client.0.smithi071.stdout:8/452: mkdir d5/df/d1e/d38/d9f 0 2024-09-10T10:04:18.230 INFO:tasks.workunit.client.1.smithi107.stdout:3/794: fdatasync dc/d56/fd7 0 2024-09-10T10:04:18.230 INFO:tasks.workunit.client.1.smithi107.stdout:4/578: dwrite d0/d40/d75/f39 [0,4194304] 0 2024-09-10T10:04:18.231 INFO:tasks.workunit.client.1.smithi107.stdout:6/529: rename d0/d3d/d14/d17/f9a to d0/d3d/d14/d21/fb3 0 2024-09-10T10:04:18.231 INFO:tasks.workunit.client.0.smithi071.stdout:0/396: getdents d11/d30/d52 0 2024-09-10T10:04:18.234 INFO:tasks.workunit.client.0.smithi071.stdout:7/540: mknod d9/d1a/d1d/cc2 0 2024-09-10T10:04:18.235 INFO:tasks.workunit.client.0.smithi071.stdout:7/541: chown d9/d2c/d49 59290 1 2024-09-10T10:04:18.235 INFO:tasks.workunit.client.0.smithi071.stdout:0/397: dread - d11/d22/f82 zero size 2024-09-10T10:04:18.235 INFO:tasks.workunit.client.1.smithi107.stdout:2/554: mkdir d3/da/d1e/d5f/d54/dc2 0 2024-09-10T10:04:18.236 INFO:tasks.workunit.client.1.smithi107.stdout:2/555: fsync d3/da/d1e/f24 0 2024-09-10T10:04:18.237 INFO:tasks.workunit.client.1.smithi107.stdout:2/556: chown d3/da/df/d20/c29 60555 1 2024-09-10T10:04:18.239 INFO:tasks.workunit.client.1.smithi107.stdout:9/481: rename d5/d7/d1d/d41/l6d to d5/d7/d1d/d3b/lae 0 2024-09-10T10:04:18.240 INFO:tasks.workunit.client.0.smithi071.stdout:8/453: dwrite d5/d36/f6d [0,4194304] 0 2024-09-10T10:04:18.241 INFO:tasks.workunit.client.1.smithi107.stdout:5/566: getdents de/d20/d3d/dc0 0 2024-09-10T10:04:18.242 INFO:tasks.workunit.client.0.smithi071.stdout:7/542: symlink d9/d15/d55/d58/lc3 0 2024-09-10T10:04:18.243 INFO:tasks.workunit.client.0.smithi071.stdout:9/652: creat d0/db/d1b/d1d/d4b/db9/fce x:0 0 0 2024-09-10T10:04:18.243 INFO:tasks.workunit.client.1.smithi107.stdout:6/530: creat d0/d3d/d14/d17/fb4 x:0 0 0 2024-09-10T10:04:18.245 INFO:tasks.workunit.client.1.smithi107.stdout:6/531: read d0/d3d/d14/d21/fa0 [668566,57476] 0 2024-09-10T10:04:18.246 INFO:tasks.workunit.client.1.smithi107.stdout:2/557: mknod d3/cc3 0 2024-09-10T10:04:18.247 INFO:tasks.workunit.client.0.smithi071.stdout:8/454: read d5/df/d1d/d86/f3e [4852012,5254] 0 2024-09-10T10:04:18.247 INFO:tasks.workunit.client.1.smithi107.stdout:9/482: creat d5/d7/d1d/d95/faf x:0 0 0 2024-09-10T10:04:18.248 INFO:tasks.workunit.client.0.smithi071.stdout:9/653: mknod d0/db/d20/d21/ccf 0 2024-09-10T10:04:18.248 INFO:tasks.workunit.client.0.smithi071.stdout:7/543: dread d9/d76/f83 [0,4194304] 0 2024-09-10T10:04:18.249 INFO:tasks.workunit.client.0.smithi071.stdout:0/398: write d11/d1e/f58 [2043276,8472] 0 2024-09-10T10:04:18.250 INFO:tasks.workunit.client.1.smithi107.stdout:9/483: write d5/d7/d1d/d9b/dab/f93 [542865,78128] 0 2024-09-10T10:04:18.253 INFO:tasks.workunit.client.0.smithi071.stdout:9/654: read - d0/db/d1b/d1d/d4b/fb5 zero size 2024-09-10T10:04:18.253 INFO:tasks.workunit.client.0.smithi071.stdout:7/544: write d9/d1a/f4d [334141,53477] 0 2024-09-10T10:04:18.254 INFO:tasks.workunit.client.0.smithi071.stdout:0/399: symlink d11/d22/d31/l8e 0 2024-09-10T10:04:18.257 INFO:tasks.workunit.client.1.smithi107.stdout:6/532: symlink d0/d3d/d14/d17/d49/d55/lb5 0 2024-09-10T10:04:18.258 INFO:tasks.workunit.client.0.smithi071.stdout:8/455: dwrite d5/df/d1d/d86/f63 [0,4194304] 0 2024-09-10T10:04:18.259 INFO:tasks.workunit.client.0.smithi071.stdout:9/655: creat d0/db/d1b/db4/fd0 x:0 0 0 2024-09-10T10:04:18.261 INFO:tasks.workunit.client.0.smithi071.stdout:9/656: dread - d0/db/fac zero size 2024-09-10T10:04:18.261 INFO:tasks.workunit.client.0.smithi071.stdout:8/456: truncate d5/df/d1d/f8c 555540 0 2024-09-10T10:04:18.261 INFO:tasks.workunit.client.0.smithi071.stdout:0/400: creat d11/d30/d52/f8f x:0 0 0 2024-09-10T10:04:18.264 INFO:tasks.workunit.client.1.smithi107.stdout:7/445: dwrite d0/d8/f18 [0,4194304] 0 2024-09-10T10:04:18.264 INFO:tasks.workunit.client.0.smithi071.stdout:8/457: chown d5/df/d1e/l50 61963760 1 2024-09-10T10:04:18.265 INFO:tasks.workunit.client.0.smithi071.stdout:8/458: fsync d5/d36/d49/f7c 0 2024-09-10T10:04:18.266 INFO:tasks.workunit.client.0.smithi071.stdout:9/657: rmdir d0/db/d20/d3c 39 2024-09-10T10:04:18.266 INFO:tasks.workunit.client.1.smithi107.stdout:6/533: read d0/d3d/fb1 [913913,10269] 0 2024-09-10T10:04:18.267 INFO:tasks.workunit.client.0.smithi071.stdout:8/459: dread - d5/df/d57/f8a zero size 2024-09-10T10:04:18.269 INFO:tasks.workunit.client.0.smithi071.stdout:0/401: dread d11/d30/d52/d5f/f6b [0,4194304] 0 2024-09-10T10:04:18.269 INFO:tasks.workunit.client.0.smithi071.stdout:9/658: mknod d0/db/d1b/d1d/cd1 0 2024-09-10T10:04:18.271 INFO:tasks.workunit.client.0.smithi071.stdout:8/460: creat d5/fa0 x:0 0 0 2024-09-10T10:04:18.271 INFO:tasks.workunit.client.0.smithi071.stdout:9/659: read d0/db/d1b/d1d/d4b/f4c [195016,86870] 0 2024-09-10T10:04:18.272 INFO:tasks.workunit.client.1.smithi107.stdout:6/534: creat d0/d70/fb6 x:0 0 0 2024-09-10T10:04:18.273 INFO:tasks.workunit.client.1.smithi107.stdout:1/583: write d2/d6/fa [4122570,50517] 0 2024-09-10T10:04:18.275 INFO:tasks.workunit.client.1.smithi107.stdout:9/484: getdents d5/d7/d1d/d41/d97 0 2024-09-10T10:04:18.276 INFO:tasks.workunit.client.1.smithi107.stdout:4/579: dread d0/d40/d75/f44 [0,4194304] 0 2024-09-10T10:04:18.277 INFO:tasks.workunit.client.0.smithi071.stdout:8/461: mkdir d5/df/da1 0 2024-09-10T10:04:18.278 INFO:tasks.workunit.client.0.smithi071.stdout:8/462: fdatasync d5/fa 0 2024-09-10T10:04:18.278 INFO:tasks.workunit.client.1.smithi107.stdout:1/584: chown d2/f6a 61154183 1 2024-09-10T10:04:18.279 INFO:tasks.workunit.client.0.smithi071.stdout:9/660: symlink d0/db/d1b/d1d/d30/d54/ld2 0 2024-09-10T10:04:18.282 INFO:tasks.workunit.client.1.smithi107.stdout:3/795: truncate dc/dd/f1d 5402594 0 2024-09-10T10:04:18.284 INFO:tasks.workunit.client.0.smithi071.stdout:9/661: write d0/d3b/f48 [4316144,87482] 0 2024-09-10T10:04:18.285 INFO:tasks.workunit.client.0.smithi071.stdout:0/402: getdents d11/d30/d52/d79 0 2024-09-10T10:04:18.285 INFO:tasks.workunit.client.1.smithi107.stdout:9/485: creat d5/d7/d1d/d41/d83/d9a/fb0 x:0 0 0 2024-09-10T10:04:18.285 INFO:tasks.workunit.client.1.smithi107.stdout:1/585: truncate d2/d6/d67/f92 5040704 0 2024-09-10T10:04:18.286 INFO:tasks.workunit.client.0.smithi071.stdout:8/463: getdents d5/df/d1e/d38/d9f 0 2024-09-10T10:04:18.287 INFO:tasks.workunit.client.1.smithi107.stdout:8/417: dwrite d5/d8/d2a/d35/d70/f8f [0,4194304] 0 2024-09-10T10:04:18.288 INFO:tasks.workunit.client.0.smithi071.stdout:9/662: mkdir d0/d3b/d5c/d6a/dd3 0 2024-09-10T10:04:18.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:17 smithi071 ceph-mon[27559]: pgmap v259: 65 pgs: 65 active+clean; 1.6 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 44 MiB/s rd, 219 MiB/s wr, 436 op/s 2024-09-10T10:04:18.289 INFO:tasks.workunit.client.1.smithi107.stdout:7/446: dread d0/f27 [0,4194304] 0 2024-09-10T10:04:18.290 INFO:tasks.workunit.client.1.smithi107.stdout:2/558: write d3/da/d1e/d40/d8a/f8c [897924,66120] 0 2024-09-10T10:04:18.290 INFO:tasks.workunit.client.1.smithi107.stdout:3/796: creat dc/dd/d20/d23/d2f/d9c/f109 x:0 0 0 2024-09-10T10:04:18.293 INFO:tasks.workunit.client.1.smithi107.stdout:1/586: symlink d2/d6/d67/lb7 0 2024-09-10T10:04:18.294 INFO:tasks.workunit.client.1.smithi107.stdout:1/587: stat d2/d12/f3e 0 2024-09-10T10:04:18.295 INFO:tasks.workunit.client.0.smithi071.stdout:0/403: dwrite d11/d30/d52/f7f [0,4194304] 0 2024-09-10T10:04:18.296 INFO:tasks.workunit.client.1.smithi107.stdout:2/559: dread - d3/da/df/fa8 zero size 2024-09-10T10:04:18.296 INFO:tasks.workunit.client.1.smithi107.stdout:7/447: write d0/d8/dc/d2c/f6e [3892960,2631] 0 2024-09-10T10:04:18.298 INFO:tasks.workunit.client.0.smithi071.stdout:7/545: dread d9/d70/faa [0,4194304] 0 2024-09-10T10:04:18.298 INFO:tasks.workunit.client.0.smithi071.stdout:9/663: write d0/fb1 [987891,128548] 0 2024-09-10T10:04:18.301 INFO:tasks.workunit.client.1.smithi107.stdout:5/567: dread de/d20/d2b/f39 [0,4194304] 0 2024-09-10T10:04:18.304 INFO:tasks.workunit.client.1.smithi107.stdout:6/535: dwrite d0/d70/f95 [0,4194304] 0 2024-09-10T10:04:18.305 INFO:tasks.workunit.client.0.smithi071.stdout:7/546: chown d9/d15/d55/f6e 0 1 2024-09-10T10:04:18.305 INFO:tasks.workunit.client.0.smithi071.stdout:0/404: dwrite f0 [4194304,4194304] 0 2024-09-10T10:04:18.307 INFO:tasks.workunit.client.0.smithi071.stdout:7/547: write d9/d2c/f56 [1560816,92031] 0 2024-09-10T10:04:18.308 INFO:tasks.workunit.client.1.smithi107.stdout:6/536: readlink d0/d3d/d14/d21/d8a/da2/l81 0 2024-09-10T10:04:18.312 INFO:tasks.workunit.client.0.smithi071.stdout:0/405: rename d11/d22/d31/d72/f8a to d11/d1e/f90 0 2024-09-10T10:04:18.313 INFO:tasks.workunit.client.1.smithi107.stdout:8/418: dwrite d5/d8/d5b/f74 [0,4194304] 0 2024-09-10T10:04:18.313 INFO:tasks.workunit.client.1.smithi107.stdout:1/588: link d2/d6/d67/f92 d2/d12/d5a/fb8 0 2024-09-10T10:04:18.314 INFO:tasks.workunit.client.1.smithi107.stdout:9/486: getdents d5/d7/d1d/d9b/dab/d57/d87/d37 0 2024-09-10T10:04:18.314 INFO:tasks.workunit.client.1.smithi107.stdout:1/589: readlink d2/d89/la1 0 2024-09-10T10:04:18.315 INFO:tasks.workunit.client.0.smithi071.stdout:7/548: unlink d9/d2c/d4f/c54 0 2024-09-10T10:04:18.316 INFO:tasks.workunit.client.1.smithi107.stdout:9/487: chown d5/d7/d1d/d95 506046 1 2024-09-10T10:04:18.316 INFO:tasks.workunit.client.1.smithi107.stdout:1/590: readlink d2/d6/d24/l76 0 2024-09-10T10:04:18.316 INFO:tasks.workunit.client.0.smithi071.stdout:7/549: write d9/d15/fb3 [433863,41235] 0 2024-09-10T10:04:18.318 INFO:tasks.workunit.client.1.smithi107.stdout:2/560: truncate d3/da/f17 2376771 0 2024-09-10T10:04:18.318 INFO:tasks.workunit.client.1.smithi107.stdout:5/568: symlink de/d4a/d5c/d6d/lc7 0 2024-09-10T10:04:18.318 INFO:tasks.workunit.client.1.smithi107.stdout:7/448: creat d0/d8/d9/d3d/d81/f8a x:0 0 0 2024-09-10T10:04:18.321 INFO:tasks.workunit.client.1.smithi107.stdout:7/449: read d0/f2b [3225679,73194] 0 2024-09-10T10:04:18.323 INFO:tasks.workunit.client.1.smithi107.stdout:7/450: readlink d0/d8/l49 0 2024-09-10T10:04:18.323 INFO:tasks.workunit.client.0.smithi071.stdout:0/406: creat d11/d22/f91 x:0 0 0 2024-09-10T10:04:18.323 INFO:tasks.workunit.client.1.smithi107.stdout:5/569: mkdir de/db3/db6/dc8 0 2024-09-10T10:04:18.324 INFO:tasks.workunit.client.0.smithi071.stdout:0/407: rmdir d11/d30/d52/d5f 39 2024-09-10T10:04:18.325 INFO:tasks.workunit.client.1.smithi107.stdout:2/561: creat d3/da/d1e/d40/fc4 x:0 0 0 2024-09-10T10:04:18.327 INFO:tasks.workunit.client.1.smithi107.stdout:5/570: symlink de/db3/lc9 0 2024-09-10T10:04:18.328 INFO:tasks.workunit.client.1.smithi107.stdout:8/419: symlink d5/d8/d66/d8b/d1a/d75/l91 0 2024-09-10T10:04:18.329 INFO:tasks.workunit.client.0.smithi071.stdout:0/408: dread d11/d30/f3c [0,4194304] 0 2024-09-10T10:04:18.330 INFO:tasks.workunit.client.1.smithi107.stdout:1/591: dread d2/d12/d65/d6b/f43 [0,4194304] 0 2024-09-10T10:04:18.330 INFO:tasks.workunit.client.1.smithi107.stdout:7/451: truncate d0/d8/f13 1141043 0 2024-09-10T10:04:18.330 INFO:tasks.workunit.client.1.smithi107.stdout:1/592: chown d2/d35 252 1 2024-09-10T10:04:18.330 INFO:tasks.workunit.client.1.smithi107.stdout:2/562: symlink d3/lc5 0 2024-09-10T10:04:18.332 INFO:tasks.workunit.client.1.smithi107.stdout:8/420: chown d5/d8/d66/d8b/d18/l5f 81 1 2024-09-10T10:04:18.333 INFO:tasks.workunit.client.1.smithi107.stdout:8/421: stat d5/d42/f65 0 2024-09-10T10:04:18.334 INFO:tasks.workunit.client.1.smithi107.stdout:2/563: chown d3/da/l8d 3 1 2024-09-10T10:04:18.335 INFO:tasks.workunit.client.1.smithi107.stdout:7/452: creat d0/d8/d56/d5d/f8b x:0 0 0 2024-09-10T10:04:18.336 INFO:tasks.workunit.client.0.smithi071.stdout:0/409: dwrite d11/f17 [0,4194304] 0 2024-09-10T10:04:18.336 INFO:tasks.workunit.client.1.smithi107.stdout:5/571: dwrite de/d20/d3d/f6f [0,4194304] 0 2024-09-10T10:04:18.339 INFO:tasks.workunit.client.1.smithi107.stdout:9/488: dread d5/f6 [0,4194304] 0 2024-09-10T10:04:18.343 INFO:tasks.workunit.client.1.smithi107.stdout:3/797: truncate dc/dd/d45/d26/d41/d74/fcb 2419270 0 2024-09-10T10:04:18.346 INFO:tasks.workunit.client.1.smithi107.stdout:7/453: dwrite d0/d8/dc/f1f [0,4194304] 0 2024-09-10T10:04:18.346 INFO:tasks.workunit.client.0.smithi071.stdout:9/664: truncate d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f5d 2783013 0 2024-09-10T10:04:18.346 INFO:tasks.workunit.client.1.smithi107.stdout:8/422: mknod d5/d8/d66/d8b/d18/c92 0 2024-09-10T10:04:18.347 INFO:tasks.workunit.client.0.smithi071.stdout:0/410: dread d11/d30/d52/f7e [0,4194304] 0 2024-09-10T10:04:18.349 INFO:tasks.workunit.client.0.smithi071.stdout:0/411: dread - d11/d30/f45 zero size 2024-09-10T10:04:18.349 INFO:tasks.workunit.client.1.smithi107.stdout:1/593: link d2/d6/d24/c97 d2/da8/cb9 0 2024-09-10T10:04:18.350 INFO:tasks.workunit.client.1.smithi107.stdout:2/564: getdents d3/d21/d95 0 2024-09-10T10:04:18.352 INFO:tasks.workunit.client.1.smithi107.stdout:5/572: fsync de/f5b 0 2024-09-10T10:04:18.352 INFO:tasks.workunit.client.1.smithi107.stdout:9/489: mkdir d5/d7/d1d/d9b/db1 0 2024-09-10T10:04:18.355 INFO:tasks.workunit.client.0.smithi071.stdout:3/440: sync 2024-09-10T10:04:18.355 INFO:tasks.workunit.client.0.smithi071.stdout:4/444: sync 2024-09-10T10:04:18.355 INFO:tasks.workunit.client.1.smithi107.stdout:7/454: creat d0/d8/d5c/d6d/f8c x:0 0 0 2024-09-10T10:04:18.356 INFO:tasks.workunit.client.0.smithi071.stdout:7/550: dread d9/ff [0,4194304] 0 2024-09-10T10:04:18.357 INFO:tasks.workunit.client.0.smithi071.stdout:9/665: rmdir d0/da0 0 2024-09-10T10:04:18.358 INFO:tasks.workunit.client.1.smithi107.stdout:7/455: chown d0/d8/dc/f71 9 1 2024-09-10T10:04:18.358 INFO:tasks.workunit.client.0.smithi071.stdout:7/551: write d9/d15/d40/d80/f94 [4912006,47289] 0 2024-09-10T10:04:18.358 INFO:tasks.workunit.client.0.smithi071.stdout:3/441: stat d3/d49/c2a 0 2024-09-10T10:04:18.359 INFO:tasks.workunit.client.1.smithi107.stdout:9/490: rmdir d5 39 2024-09-10T10:04:18.359 INFO:tasks.workunit.client.0.smithi071.stdout:4/445: fdatasync db/d15/d17/f3f 0 2024-09-10T10:04:18.365 INFO:tasks.workunit.client.1.smithi107.stdout:8/423: dread - d5/d8/d66/d8b/d21/f3a zero size 2024-09-10T10:04:18.365 INFO:tasks.workunit.client.1.smithi107.stdout:6/537: dwrite d0/d3d/d14/d17/d49/d55/d56/f84 [0,4194304] 0 2024-09-10T10:04:18.366 INFO:tasks.workunit.client.1.smithi107.stdout:1/594: rename d2/d6/f1c to d2/d36/fba 0 2024-09-10T10:04:18.367 INFO:tasks.workunit.client.0.smithi071.stdout:7/552: chown d9/d1a/d1d/l2b 3 1 2024-09-10T10:04:18.367 INFO:tasks.workunit.client.1.smithi107.stdout:9/491: stat d5/d7/d1d/d9b/dab/d57/d87/d37/f52 0 2024-09-10T10:04:18.367 INFO:tasks.workunit.client.0.smithi071.stdout:9/666: unlink d0/db/d1b/d1d/d30/d54/d27/la7 0 2024-09-10T10:04:18.368 INFO:tasks.workunit.client.0.smithi071.stdout:4/446: chown db/d15/d4b 8826627 1 2024-09-10T10:04:18.368 INFO:tasks.workunit.client.1.smithi107.stdout:5/573: truncate de/d20/d2b/d4b/d5e/f93 269078 0 2024-09-10T10:04:18.370 INFO:tasks.workunit.client.1.smithi107.stdout:3/798: dwrite dc/dd/d45/d26/feb [0,4194304] 0 2024-09-10T10:04:18.370 INFO:tasks.workunit.client.1.smithi107.stdout:5/574: chown de/f48 65860 1 2024-09-10T10:04:18.373 INFO:tasks.workunit.client.1.smithi107.stdout:3/799: write dc/dd/d42/fdb [262811,94143] 0 2024-09-10T10:04:18.374 INFO:tasks.workunit.client.1.smithi107.stdout:6/538: truncate d0/d3d/d14/d17/d49/f92 883258 0 2024-09-10T10:04:18.374 INFO:tasks.workunit.client.0.smithi071.stdout:9/667: creat d0/d3b/d5c/fd4 x:0 0 0 2024-09-10T10:04:18.375 INFO:tasks.workunit.client.1.smithi107.stdout:1/595: link d2/d89/f9e d2/d6/d67/fbb 0 2024-09-10T10:04:18.376 INFO:tasks.workunit.client.1.smithi107.stdout:3/800: dread - dc/dd/d45/d26/d41/d44/d35/d52/f9f zero size 2024-09-10T10:04:18.377 INFO:tasks.workunit.client.0.smithi071.stdout:9/668: dread - d0/d3b/d5c/f7f zero size 2024-09-10T10:04:18.378 INFO:tasks.workunit.client.1.smithi107.stdout:2/565: rename d3/da/d1e/d27/d5b/f5c to d3/da/fc6 0 2024-09-10T10:04:18.378 INFO:tasks.workunit.client.0.smithi071.stdout:3/442: getdents d3/d20/d30/d42/d4a/d60 0 2024-09-10T10:04:18.378 INFO:tasks.workunit.client.0.smithi071.stdout:7/553: creat d9/d15/d40/fc4 x:0 0 0 2024-09-10T10:04:18.379 INFO:tasks.workunit.client.0.smithi071.stdout:3/443: readlink d3/d49/d2f/l46 0 2024-09-10T10:04:18.380 INFO:tasks.workunit.client.1.smithi107.stdout:5/575: creat de/d20/d3d/dc0/fca x:0 0 0 2024-09-10T10:04:18.380 INFO:tasks.workunit.client.0.smithi071.stdout:4/447: rename db/d15/d26/d43/f44 to db/d15/d17/f93 0 2024-09-10T10:04:18.381 INFO:tasks.workunit.client.1.smithi107.stdout:9/492: dread - d5/d7/d1d/d9b/dab/d57/f62 zero size 2024-09-10T10:04:18.382 INFO:tasks.workunit.client.0.smithi071.stdout:4/448: write db/d15/d17/f75 [1371984,10270] 0 2024-09-10T10:04:18.383 INFO:tasks.workunit.client.0.smithi071.stdout:4/449: chown db/d15/d26/f91 3 1 2024-09-10T10:04:18.384 INFO:tasks.workunit.client.0.smithi071.stdout:3/444: truncate d3/f41 1066389 0 2024-09-10T10:04:18.385 INFO:tasks.workunit.client.1.smithi107.stdout:6/539: readlink d0/d3d/d14/l32 0 2024-09-10T10:04:18.385 INFO:tasks.workunit.client.1.smithi107.stdout:1/596: mkdir d2/d36/dbc 0 2024-09-10T10:04:18.385 INFO:tasks.workunit.client.0.smithi071.stdout:9/669: readlink d0/d3b/l6f 0 2024-09-10T10:04:18.386 INFO:tasks.workunit.client.0.smithi071.stdout:7/554: truncate d9/d15/d1f/d74/d9b/fb1 715141 0 2024-09-10T10:04:18.386 INFO:tasks.workunit.client.1.smithi107.stdout:8/424: rename d5/d8/d5b/l89 to d5/d8/d66/d8b/d21/d83/l93 0 2024-09-10T10:04:18.387 INFO:tasks.workunit.client.1.smithi107.stdout:5/576: mknod de/d20/d2b/d4b/d8c/ccb 0 2024-09-10T10:04:18.390 INFO:tasks.workunit.client.0.smithi071.stdout:9/670: write d0/d3b/d5c/d6a/f99 [960643,11147] 0 2024-09-10T10:04:18.390 INFO:tasks.workunit.client.0.smithi071.stdout:3/445: truncate d3/d10/f84 1040572 0 2024-09-10T10:04:18.391 INFO:tasks.workunit.client.1.smithi107.stdout:6/540: creat d0/d70/fb7 x:0 0 0 2024-09-10T10:04:18.392 INFO:tasks.workunit.client.1.smithi107.stdout:9/493: dwrite d5/d7/d1d/d41/f48 [4194304,4194304] 0 2024-09-10T10:04:18.392 INFO:tasks.workunit.client.0.smithi071.stdout:4/450: link db/d15/d17/d24/f8a db/d15/f94 0 2024-09-10T10:04:18.394 INFO:tasks.workunit.client.1.smithi107.stdout:3/801: rename dc/dd/d20/d23/d39/d69/lc2 to dc/dd/d45/d26/d59/d78/l10a 0 2024-09-10T10:04:18.395 INFO:tasks.workunit.client.0.smithi071.stdout:3/446: unlink d3/d20/d39/f62 0 2024-09-10T10:04:18.396 INFO:tasks.workunit.client.0.smithi071.stdout:0/412: dwrite d11/d22/f4f [0,4194304] 0 2024-09-10T10:04:18.402 INFO:tasks.workunit.client.1.smithi107.stdout:1/597: mknod d2/d12/d65/db4/cbd 0 2024-09-10T10:04:18.402 INFO:tasks.workunit.client.0.smithi071.stdout:7/555: rmdir d9/d15/d40 39 2024-09-10T10:04:18.404 INFO:tasks.workunit.client.1.smithi107.stdout:7/456: dwrite d0/f4 [0,4194304] 0 2024-09-10T10:04:18.405 INFO:tasks.workunit.client.1.smithi107.stdout:2/566: rename d3/da/df/d20/d36/d4f/f58 to d3/da/d1e/d40/fc7 0 2024-09-10T10:04:18.407 INFO:tasks.workunit.client.1.smithi107.stdout:5/577: mkdir de/d20/d2b/dcc 0 2024-09-10T10:04:18.407 INFO:tasks.workunit.client.0.smithi071.stdout:9/671: dwrite d0/db/d20/d21/f34 [0,4194304] 0 2024-09-10T10:04:18.408 INFO:tasks.workunit.client.1.smithi107.stdout:2/567: write d3/d21/f32 [4111290,46005] 0 2024-09-10T10:04:18.411 INFO:tasks.workunit.client.1.smithi107.stdout:1/598: creat d2/d12/d5a/fbe x:0 0 0 2024-09-10T10:04:18.416 INFO:tasks.workunit.client.1.smithi107.stdout:7/457: dwrite d0/d8/f11 [0,4194304] 0 2024-09-10T10:04:18.417 INFO:tasks.workunit.client.0.smithi071.stdout:4/451: dwrite db/d15/d4b/f4f [0,4194304] 0 2024-09-10T10:04:18.418 INFO:tasks.workunit.client.0.smithi071.stdout:3/447: dread d3/d20/d30/d3a/f45 [0,4194304] 0 2024-09-10T10:04:18.419 INFO:tasks.workunit.client.0.smithi071.stdout:3/448: stat d3/d20/f2c 0 2024-09-10T10:04:18.419 INFO:tasks.workunit.client.1.smithi107.stdout:7/458: truncate d0/d8/d9/d68/f7d 937534 0 2024-09-10T10:04:18.420 INFO:tasks.workunit.client.1.smithi107.stdout:3/802: mknod dc/dd/d20/c10b 0 2024-09-10T10:04:18.421 INFO:tasks.workunit.client.1.smithi107.stdout:1/599: read d2/da8/fa9 [4261655,5622] 0 2024-09-10T10:04:18.422 INFO:tasks.workunit.client.1.smithi107.stdout:5/578: rmdir de/d9c 39 2024-09-10T10:04:18.423 INFO:tasks.workunit.client.0.smithi071.stdout:7/556: rename d9/d11/c13 to d9/d15/d40/d80/cc5 0 2024-09-10T10:04:18.425 INFO:tasks.workunit.client.0.smithi071.stdout:9/672: getdents d0/d3b/d5c/d6a/d96 0 2024-09-10T10:04:18.426 INFO:tasks.workunit.client.0.smithi071.stdout:4/452: mknod db/d15/d26/d43/c95 0 2024-09-10T10:04:18.428 INFO:tasks.workunit.client.1.smithi107.stdout:1/600: dread d2/d6/d24/f50 [0,4194304] 0 2024-09-10T10:04:18.428 INFO:tasks.workunit.client.0.smithi071.stdout:7/557: creat d9/d2c/d4f/fc6 x:0 0 0 2024-09-10T10:04:18.430 INFO:tasks.workunit.client.0.smithi071.stdout:7/558: write d9/d1a/f35 [210289,52384] 0 2024-09-10T10:04:18.431 INFO:tasks.workunit.client.0.smithi071.stdout:3/449: getdents d3/d1c/d3e 0 2024-09-10T10:04:18.431 INFO:tasks.workunit.client.0.smithi071.stdout:9/673: dread d0/f42 [0,4194304] 0 2024-09-10T10:04:18.432 INFO:tasks.workunit.client.1.smithi107.stdout:6/541: dwrite d0/d3d/d14/d17/f96 [0,4194304] 0 2024-09-10T10:04:18.433 INFO:tasks.workunit.client.0.smithi071.stdout:3/450: rename d3/d10/d87 to d3/d10/d87/d9f 22 2024-09-10T10:04:18.435 INFO:tasks.workunit.client.1.smithi107.stdout:3/803: symlink dc/dd/d20/d23/d2f/d9c/l10c 0 2024-09-10T10:04:18.436 INFO:tasks.workunit.client.1.smithi107.stdout:6/542: write d0/d3d/d14/d21/f28 [2246874,59995] 0 2024-09-10T10:04:18.436 INFO:tasks.workunit.client.1.smithi107.stdout:8/425: write d5/d8/d66/d8b/d1a/d71/f7d [1251890,103723] 0 2024-09-10T10:04:18.436 INFO:tasks.workunit.client.0.smithi071.stdout:9/674: rmdir d0/db/d1b/d1d/d30/d54/d27 39 2024-09-10T10:04:18.439 INFO:tasks.workunit.client.0.smithi071.stdout:6/397: sync 2024-09-10T10:04:18.439 INFO:tasks.workunit.client.1.smithi107.stdout:2/568: symlink d3/da/df/d20/d36/lc8 0 2024-09-10T10:04:18.439 INFO:tasks.workunit.client.0.smithi071.stdout:3/451: creat d3/d49/d2f/d7f/fa0 x:0 0 0 2024-09-10T10:04:18.442 INFO:tasks.workunit.client.1.smithi107.stdout:9/494: rename d5/d7/d1d/d41/d83/d9a/fa8 to d5/d7/fb2 0 2024-09-10T10:04:18.442 INFO:tasks.workunit.client.1.smithi107.stdout:1/601: mknod d2/d35/d7b/cbf 0 2024-09-10T10:04:18.442 INFO:tasks.workunit.client.1.smithi107.stdout:7/459: dwrite d0/d8/d56/f82 [0,4194304] 0 2024-09-10T10:04:18.443 INFO:tasks.workunit.client.0.smithi071.stdout:7/559: link d9/d70/l87 d9/d15/d1f/lc7 0 2024-09-10T10:04:18.444 INFO:tasks.workunit.client.1.smithi107.stdout:1/602: chown d2/d6/d67/f92 14 1 2024-09-10T10:04:18.446 INFO:tasks.workunit.client.0.smithi071.stdout:0/413: dread f0 [0,4194304] 0 2024-09-10T10:04:18.447 INFO:tasks.workunit.client.0.smithi071.stdout:7/560: mkdir d9/d1a/dc8 0 2024-09-10T10:04:18.447 INFO:tasks.workunit.client.1.smithi107.stdout:3/804: creat dc/dd/d45/d26/d41/d44/d35/d4a/dd8/de0/f10d x:0 0 0 2024-09-10T10:04:18.448 INFO:tasks.workunit.client.1.smithi107.stdout:2/569: write d3/f31 [1405336,113482] 0 2024-09-10T10:04:18.449 INFO:tasks.workunit.client.0.smithi071.stdout:6/398: dwrite d4/da/df/f50 [4194304,4194304] 0 2024-09-10T10:04:18.449 INFO:tasks.workunit.client.1.smithi107.stdout:7/460: fsync d0/d8/d56/f6c 0 2024-09-10T10:04:18.450 INFO:tasks.workunit.client.0.smithi071.stdout:9/675: rename d0/d3b/d44/f5a to d0/db/d20/d3c/fd5 0 2024-09-10T10:04:18.452 INFO:tasks.workunit.client.1.smithi107.stdout:8/426: dwrite d5/d8/d66/d8b/f67 [0,4194304] 0 2024-09-10T10:04:18.453 INFO:tasks.workunit.client.1.smithi107.stdout:7/461: write d0/d8/f11 [2284599,119139] 0 2024-09-10T10:04:18.455 INFO:tasks.workunit.client.1.smithi107.stdout:9/495: truncate d5/d7/d1d/d9b/dab/f93 772744 0 2024-09-10T10:04:18.455 INFO:tasks.workunit.client.1.smithi107.stdout:1/603: creat d2/d35/d9c/fc0 x:0 0 0 2024-09-10T10:04:18.456 INFO:tasks.workunit.client.0.smithi071.stdout:3/452: rename d3/d20/d30 to d3/d1c/d3c/da1 0 2024-09-10T10:04:18.459 INFO:tasks.workunit.client.1.smithi107.stdout:7/462: fsync d0/d20/d72/f7b 0 2024-09-10T10:04:18.460 INFO:tasks.workunit.client.0.smithi071.stdout:0/414: dwrite d11/d30/d52/f8f [0,4194304] 0 2024-09-10T10:04:18.461 INFO:tasks.workunit.client.0.smithi071.stdout:9/676: chown d0/db/d1b/d1d/d4b/lcd 1487902 1 2024-09-10T10:04:18.462 INFO:tasks.workunit.client.0.smithi071.stdout:7/561: rename d9/d15/f6c to d9/d11/d6f/dae/fc9 0 2024-09-10T10:04:18.462 INFO:tasks.workunit.client.1.smithi107.stdout:2/570: unlink d3/da/df/d20/d36/d4f/c68 0 2024-09-10T10:04:18.463 INFO:tasks.workunit.client.1.smithi107.stdout:7/463: read - d0/d8/dc/f71 zero size 2024-09-10T10:04:18.464 INFO:tasks.workunit.client.0.smithi071.stdout:6/399: dwrite d4/d1c/f3d [0,4194304] 0 2024-09-10T10:04:18.465 INFO:tasks.workunit.client.1.smithi107.stdout:3/805: mkdir dc/dd/d45/d26/d41/d10e 0 2024-09-10T10:04:18.467 INFO:tasks.workunit.client.1.smithi107.stdout:2/571: chown d3/da/d1e/d5f/d54/f7d 972692538 1 2024-09-10T10:04:18.469 INFO:tasks.workunit.client.1.smithi107.stdout:8/427: dwrite d5/d8/d5b/f76 [0,4194304] 0 2024-09-10T10:04:18.469 INFO:tasks.workunit.client.1.smithi107.stdout:7/464: creat d0/d1b/d4d/f8d x:0 0 0 2024-09-10T10:04:18.470 INFO:tasks.workunit.client.1.smithi107.stdout:3/806: dread dc/fca [0,4194304] 0 2024-09-10T10:04:18.470 INFO:tasks.workunit.client.1.smithi107.stdout:2/572: fsync d3/d21/f3a 0 2024-09-10T10:04:18.472 INFO:tasks.workunit.client.1.smithi107.stdout:2/573: readlink d3/d21/l2b 0 2024-09-10T10:04:18.474 INFO:tasks.workunit.client.1.smithi107.stdout:5/579: write de/f1b [1424616,24243] 0 2024-09-10T10:04:18.476 INFO:tasks.workunit.client.1.smithi107.stdout:2/574: dread - d3/da/d1e/d40/d8a/d7f/fb9 zero size 2024-09-10T10:04:18.476 INFO:tasks.workunit.client.0.smithi071.stdout:0/415: dwrite d11/d22/f23 [0,4194304] 0 2024-09-10T10:04:18.477 INFO:tasks.workunit.client.1.smithi107.stdout:7/465: creat d0/d8/d56/f8e x:0 0 0 2024-09-10T10:04:18.477 INFO:tasks.workunit.client.1.smithi107.stdout:8/428: creat d5/d42/f94 x:0 0 0 2024-09-10T10:04:18.477 INFO:tasks.workunit.client.0.smithi071.stdout:9/677: truncate d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f6b 4687787 0 2024-09-10T10:04:18.479 INFO:tasks.workunit.client.1.smithi107.stdout:8/429: write d5/d8/d2a/f5d [811964,113617] 0 2024-09-10T10:04:18.481 INFO:tasks.workunit.client.0.smithi071.stdout:6/400: dwrite d4/da/df/d2e/d3a/d43/f73 [0,4194304] 0 2024-09-10T10:04:18.481 INFO:tasks.workunit.client.1.smithi107.stdout:2/575: truncate d3/d6d/f98 91030 0 2024-09-10T10:04:18.481 INFO:tasks.workunit.client.1.smithi107.stdout:3/807: unlink dc/dd/d45/d26/d41/d44/d63/l9e 0 2024-09-10T10:04:18.484 INFO:tasks.workunit.client.1.smithi107.stdout:3/808: chown dc/dd/d45/d26/d41/d44/fb8 3579823 1 2024-09-10T10:04:18.485 INFO:tasks.workunit.client.1.smithi107.stdout:8/430: creat d5/d8/d2a/d35/d70/f95 x:0 0 0 2024-09-10T10:04:18.486 INFO:tasks.workunit.client.1.smithi107.stdout:3/809: write dc/dd/d20/f3e [3967357,109661] 0 2024-09-10T10:04:18.488 INFO:tasks.workunit.client.1.smithi107.stdout:3/810: readlink dc/dd/d42/d55/d58/d91/la2 0 2024-09-10T10:04:18.488 INFO:tasks.workunit.client.1.smithi107.stdout:5/580: creat de/d20/fcd x:0 0 0 2024-09-10T10:04:18.489 INFO:tasks.workunit.client.0.smithi071.stdout:4/453: dwrite db/d15/d17/d24/f25 [0,4194304] 0 2024-09-10T10:04:18.490 INFO:tasks.workunit.client.1.smithi107.stdout:2/576: rmdir d3/da/d1e/d40/d8a 39 2024-09-10T10:04:18.492 INFO:tasks.workunit.client.0.smithi071.stdout:0/416: dwrite d11/d30/f5e [0,4194304] 0 2024-09-10T10:04:18.492 INFO:tasks.workunit.client.0.smithi071.stdout:9/678: symlink d0/db/d1b/d1d/d4b/db9/dba/ld6 0 2024-09-10T10:04:18.494 INFO:tasks.workunit.client.1.smithi107.stdout:7/466: rename d0/d8/d9/d3d/c6a to d0/d8/d56/c8f 0 2024-09-10T10:04:18.495 INFO:tasks.workunit.client.0.smithi071.stdout:9/679: dread - d0/db/d20/d3c/d75/f9c zero size 2024-09-10T10:04:18.495 INFO:tasks.workunit.client.0.smithi071.stdout:4/454: write db/d15/d26/f63 [836302,37412] 0 2024-09-10T10:04:18.500 INFO:tasks.workunit.client.0.smithi071.stdout:9/680: chown d0/db/d1b/d1d/d4b/lcd 0 1 2024-09-10T10:04:18.500 INFO:tasks.workunit.client.1.smithi107.stdout:5/581: symlink de/d20/d2b/d4b/lce 0 2024-09-10T10:04:18.501 INFO:tasks.workunit.client.1.smithi107.stdout:2/577: creat d3/da/df/d20/d36/d39/da3/fc9 x:0 0 0 2024-09-10T10:04:18.503 INFO:tasks.workunit.client.1.smithi107.stdout:5/582: mknod de/d4a/d4e/d89/d99/ccf 0 2024-09-10T10:04:18.504 INFO:tasks.workunit.client.1.smithi107.stdout:3/811: getdents dc/dd/d20/d23/d2f/d9c 0 2024-09-10T10:04:18.505 INFO:tasks.workunit.client.1.smithi107.stdout:1/604: dread d2/d6/d24/f54 [0,4194304] 0 2024-09-10T10:04:18.508 INFO:tasks.workunit.client.1.smithi107.stdout:3/812: mkdir dc/dd/d20/d23/d39/d10f 0 2024-09-10T10:04:18.509 INFO:tasks.workunit.client.0.smithi071.stdout:0/417: dread d11/d30/f76 [0,4194304] 0 2024-09-10T10:04:18.509 INFO:tasks.workunit.client.0.smithi071.stdout:9/681: dwrite d0/db/d1b/d1d/d5b/d60/fca [0,4194304] 0 2024-09-10T10:04:18.510 INFO:tasks.workunit.client.1.smithi107.stdout:1/605: fdatasync d2/d35/d9c/f9d 0 2024-09-10T10:04:18.512 INFO:tasks.workunit.client.1.smithi107.stdout:3/813: dread dc/d56/fb0 [0,4194304] 0 2024-09-10T10:04:18.513 INFO:tasks.workunit.client.0.smithi071.stdout:0/418: rmdir d11/d22/d31/d72 39 2024-09-10T10:04:18.513 INFO:tasks.workunit.client.1.smithi107.stdout:2/578: rename d3/da/d1e/d40/d8a/l86 to d3/da/d1e/d40/lca 0 2024-09-10T10:04:18.515 INFO:tasks.workunit.client.0.smithi071.stdout:9/682: unlink d0/db/d20/d3c/f57 0 2024-09-10T10:04:18.517 INFO:tasks.workunit.client.0.smithi071.stdout:9/683: fsync d0/db/d20/d3c/f82 0 2024-09-10T10:04:18.518 INFO:tasks.workunit.client.1.smithi107.stdout:2/579: creat d3/da/d1e/d40/d8a/d7f/d55/fcb x:0 0 0 2024-09-10T10:04:18.518 INFO:tasks.workunit.client.0.smithi071.stdout:9/684: fsync d0/db/d20/d3c/d75/f9c 0 2024-09-10T10:04:18.519 INFO:tasks.workunit.client.1.smithi107.stdout:1/606: link d2/d12/c4b d2/d6/d24/cc1 0 2024-09-10T10:04:18.519 INFO:tasks.workunit.client.1.smithi107.stdout:2/580: readlink d3/da/d1e/d5f/l2f 0 2024-09-10T10:04:18.520 INFO:tasks.workunit.client.1.smithi107.stdout:1/607: readlink d2/l1b 0 2024-09-10T10:04:18.521 INFO:tasks.workunit.client.1.smithi107.stdout:2/581: readlink d3/da/l13 0 2024-09-10T10:04:18.524 INFO:tasks.workunit.client.1.smithi107.stdout:1/608: rename d2/d12/d5a/cab to d2/d36/cc2 0 2024-09-10T10:04:18.524 INFO:tasks.workunit.client.1.smithi107.stdout:2/582: dread d3/da/d1e/d27/fa4 [0,4194304] 0 2024-09-10T10:04:18.524 INFO:tasks.workunit.client.1.smithi107.stdout:3/814: dwrite dc/dd/d45/d26/d41/d44/d35/f2a [0,4194304] 0 2024-09-10T10:04:18.529 INFO:tasks.workunit.client.1.smithi107.stdout:1/609: dread - d2/d6/d24/fb3 zero size 2024-09-10T10:04:18.529 INFO:tasks.workunit.client.1.smithi107.stdout:2/583: rmdir d3/da/d1e 39 2024-09-10T10:04:18.530 INFO:tasks.workunit.client.1.smithi107.stdout:3/815: dread - dc/dd/d42/d55/d58/ffa zero size 2024-09-10T10:04:18.532 INFO:tasks.workunit.client.1.smithi107.stdout:1/610: write d2/d6/fa [2194540,106486] 0 2024-09-10T10:04:18.534 INFO:tasks.workunit.client.0.smithi071.stdout:7/562: write d9/f7f [4529321,91793] 0 2024-09-10T10:04:18.537 INFO:tasks.workunit.client.1.smithi107.stdout:2/584: unlink d3/da/d1e/d40/d8a/d7f/d55/c9c 0 2024-09-10T10:04:18.538 INFO:tasks.workunit.client.1.smithi107.stdout:1/611: rename d2/d6/f52 to d2/d6/fc3 0 2024-09-10T10:04:18.538 INFO:tasks.workunit.client.0.smithi071.stdout:7/563: write d9/d1a/d1d/f57 [856875,84002] 0 2024-09-10T10:04:18.540 INFO:tasks.workunit.client.0.smithi071.stdout:0/419: dread d11/f18 [0,4194304] 0 2024-09-10T10:04:18.540 INFO:tasks.workunit.client.1.smithi107.stdout:3/816: mkdir dc/dd/d20/d23/df3/d110 0 2024-09-10T10:04:18.541 INFO:tasks.workunit.client.0.smithi071.stdout:6/401: truncate d4/d1c/f42 2149484 0 2024-09-10T10:04:18.542 INFO:tasks.workunit.client.0.smithi071.stdout:7/564: truncate d9/d15/d40/db8/fbe 203262 0 2024-09-10T10:04:18.545 INFO:tasks.workunit.client.0.smithi071.stdout:7/565: write d9/d1a/d1d/f57 [7013067,121561] 0 2024-09-10T10:04:18.546 INFO:tasks.workunit.client.1.smithi107.stdout:1/612: link d2/d12/d5a/fbe d2/d35/fc4 0 2024-09-10T10:04:18.547 INFO:tasks.workunit.client.0.smithi071.stdout:6/402: creat d4/da/df/d2e/d3a/d51/d64/f7e x:0 0 0 2024-09-10T10:04:18.547 INFO:tasks.workunit.client.1.smithi107.stdout:1/613: stat d2/d6/d67/fbb 0 2024-09-10T10:04:18.548 INFO:tasks.workunit.client.1.smithi107.stdout:3/817: dwrite dc/d56/fd7 [0,4194304] 0 2024-09-10T10:04:18.551 INFO:tasks.workunit.client.0.smithi071.stdout:4/455: dwrite db/d15/d17/d24/f49 [0,4194304] 0 2024-09-10T10:04:18.551 INFO:tasks.workunit.client.0.smithi071.stdout:6/403: write d4/da/df/d2e/d3a/f68 [151220,13648] 0 2024-09-10T10:04:18.554 INFO:tasks.workunit.client.0.smithi071.stdout:7/566: dread d9/d76/f83 [4194304,4194304] 0 2024-09-10T10:04:18.556 INFO:tasks.workunit.client.0.smithi071.stdout:7/567: chown d9/d15/d40/fc4 476935 1 2024-09-10T10:04:18.556 INFO:tasks.workunit.client.0.smithi071.stdout:6/404: symlink d4/d61/l7f 0 2024-09-10T10:04:18.556 INFO:tasks.workunit.client.0.smithi071.stdout:4/456: creat db/d86/f96 x:0 0 0 2024-09-10T10:04:18.556 INFO:tasks.workunit.client.1.smithi107.stdout:8/431: write d5/d8/d5b/f90 [2764876,7927] 0 2024-09-10T10:04:18.560 INFO:tasks.workunit.client.1.smithi107.stdout:8/432: write d5/d8/f20 [2083347,112864] 0 2024-09-10T10:04:18.560 INFO:tasks.workunit.client.0.smithi071.stdout:6/405: mknod d4/da/df/d2e/d3a/d40/d60/c80 0 2024-09-10T10:04:18.561 INFO:tasks.workunit.client.0.smithi071.stdout:9/685: dread d0/db/d20/d21/f4f [0,4194304] 0 2024-09-10T10:04:18.563 INFO:tasks.workunit.client.0.smithi071.stdout:9/686: truncate d0/d3b/f48 4642754 0 2024-09-10T10:04:18.564 INFO:tasks.workunit.client.1.smithi107.stdout:8/433: mknod d5/d8/d66/d8b/d18/d4f/c96 0 2024-09-10T10:04:18.565 INFO:tasks.workunit.client.0.smithi071.stdout:4/457: creat db/d1d/d61/d6a/d88/d90/f97 x:0 0 0 2024-09-10T10:04:18.566 INFO:tasks.workunit.client.1.smithi107.stdout:5/583: dwrite de/d4a/f85 [0,4194304] 0 2024-09-10T10:04:18.566 INFO:tasks.workunit.client.0.smithi071.stdout:9/687: fsync d0/db/d1b/d1d/d30/d54/d27/d6e/f92 0 2024-09-10T10:04:18.567 INFO:tasks.workunit.client.0.smithi071.stdout:0/420: dwrite d11/d30/d52/d5f/f6b [0,4194304] 0 2024-09-10T10:04:18.568 INFO:tasks.workunit.client.1.smithi107.stdout:5/584: write de/d4a/d7e/db2/fb4 [169650,28736] 0 2024-09-10T10:04:18.569 INFO:tasks.workunit.client.1.smithi107.stdout:5/585: fsync de/d20/f91 0 2024-09-10T10:04:18.570 INFO:tasks.workunit.client.1.smithi107.stdout:5/586: chown de/d4a/d4e/d89/d99/ccf 4199 1 2024-09-10T10:04:18.571 INFO:tasks.workunit.client.1.smithi107.stdout:5/587: readlink de/d20/d2b/d4b/d5e/l8a 0 2024-09-10T10:04:18.572 INFO:tasks.workunit.client.0.smithi071.stdout:0/421: dread d11/d1e/f58 [0,4194304] 0 2024-09-10T10:04:18.575 INFO:tasks.workunit.client.1.smithi107.stdout:5/588: dread - de/d20/d2b/faf zero size 2024-09-10T10:04:18.575 INFO:tasks.workunit.client.0.smithi071.stdout:4/458: rename db/d15/d17/f7f to db/d15/d26/d43/d82/f98 0 2024-09-10T10:04:18.577 INFO:tasks.workunit.client.0.smithi071.stdout:9/688: getdents d0/db/d20/dc0 0 2024-09-10T10:04:18.577 INFO:tasks.workunit.client.1.smithi107.stdout:3/818: write dc/dd/d45/d26/d41/d74/fcb [1345561,99665] 0 2024-09-10T10:04:18.578 INFO:tasks.workunit.client.0.smithi071.stdout:4/459: read db/d15/d17/f18 [4432,14760] 0 2024-09-10T10:04:18.579 INFO:tasks.workunit.client.0.smithi071.stdout:0/422: creat d11/d22/d31/f92 x:0 0 0 2024-09-10T10:04:18.580 INFO:tasks.workunit.client.1.smithi107.stdout:3/819: chown dc/dd/d42/d55/d58/d91/fd0 236985998 1 2024-09-10T10:04:18.581 INFO:tasks.workunit.client.0.smithi071.stdout:9/689: write d0/db/d1b/d1d/d4b/fb3 [1417512,61917] 0 2024-09-10T10:04:18.583 INFO:tasks.workunit.client.0.smithi071.stdout:0/423: symlink d11/d30/d52/d5f/l93 0 2024-09-10T10:04:18.583 INFO:tasks.workunit.client.1.smithi107.stdout:1/614: dwrite d2/d12/d65/d6b/f2e [0,4194304] 0 2024-09-10T10:04:18.584 INFO:tasks.workunit.client.0.smithi071.stdout:7/568: truncate d9/d1a/d1d/f57 8306239 0 2024-09-10T10:04:18.586 INFO:tasks.workunit.client.0.smithi071.stdout:6/406: write d4/d1c/f4b [287138,114871] 0 2024-09-10T10:04:18.587 INFO:tasks.workunit.client.0.smithi071.stdout:6/407: dread - d4/d61/f69 zero size 2024-09-10T10:04:18.587 INFO:tasks.workunit.client.1.smithi107.stdout:5/589: write de/d20/d2b/d4b/f58 [3950894,50642] 0 2024-09-10T10:04:18.589 INFO:tasks.workunit.client.0.smithi071.stdout:9/690: rename d0/db/d1b/d1d/d30/d54/d27/f2c to d0/db/d1b/d1d/d4b/db9/dba/fd7 0 2024-09-10T10:04:18.590 INFO:tasks.workunit.client.0.smithi071.stdout:7/569: rmdir d9/d11/d91 39 2024-09-10T10:04:18.591 INFO:tasks.workunit.client.0.smithi071.stdout:7/570: fsync d9/d15/d55/d58/f5c 0 2024-09-10T10:04:18.591 INFO:tasks.workunit.client.1.smithi107.stdout:3/820: creat dc/dd/d45/d26/d41/d74/f111 x:0 0 0 2024-09-10T10:04:18.592 INFO:tasks.workunit.client.0.smithi071.stdout:6/408: mkdir d4/da/df/d2e/d3a/d3e/d5d/d81 0 2024-09-10T10:04:18.593 INFO:tasks.workunit.client.1.smithi107.stdout:5/590: unlink de/db3/db6/lc4 0 2024-09-10T10:04:18.593 INFO:tasks.workunit.client.0.smithi071.stdout:4/460: getdents db/d86 0 2024-09-10T10:04:18.595 INFO:tasks.workunit.client.1.smithi107.stdout:5/591: chown de/d20/d3d/l3f 6760382 1 2024-09-10T10:04:18.595 INFO:tasks.workunit.client.0.smithi071.stdout:6/409: write d4/da/df/d2e/d3a/d43/f49 [1245327,105525] 0 2024-09-10T10:04:18.596 INFO:tasks.workunit.client.1.smithi107.stdout:5/592: fsync de/f2d 0 2024-09-10T10:04:18.596 INFO:tasks.workunit.client.0.smithi071.stdout:0/424: rename d11/d22/d40/c78 to d11/d30/d52/d5f/c94 0 2024-09-10T10:04:18.598 INFO:tasks.workunit.client.1.smithi107.stdout:5/593: write de/d20/d2b/d4b/d5e/fa5 [297190,42208] 0 2024-09-10T10:04:18.598 INFO:tasks.workunit.client.1.smithi107.stdout:3/821: rename dc/dd/d45/d26/d41/d44/d35/d4a/de1/de7/ff8 to dc/dd/d45/f112 0 2024-09-10T10:04:18.598 INFO:tasks.workunit.client.0.smithi071.stdout:9/691: dwrite d0/db/d1b/d1d/d30/f7d [0,4194304] 0 2024-09-10T10:04:18.598 INFO:tasks.workunit.client.0.smithi071.stdout:4/461: symlink db/d15/d17/d4e/d5a/d8d/l99 0 2024-09-10T10:04:18.600 INFO:tasks.workunit.client.1.smithi107.stdout:5/594: symlink de/db3/db6/ld0 0 2024-09-10T10:04:18.601 INFO:tasks.workunit.client.0.smithi071.stdout:6/410: creat d4/da/f82 x:0 0 0 2024-09-10T10:04:18.603 INFO:tasks.workunit.client.0.smithi071.stdout:0/425: creat d11/d30/d52/d5f/f95 x:0 0 0 2024-09-10T10:04:18.603 INFO:tasks.workunit.client.0.smithi071.stdout:6/411: mkdir d4/d61/d83 0 2024-09-10T10:04:18.604 INFO:tasks.workunit.client.1.smithi107.stdout:3/822: unlink dc/dd/d42/d55/d58/d91/la2 0 2024-09-10T10:04:18.604 INFO:tasks.workunit.client.1.smithi107.stdout:8/434: dread d5/d8/d66/d8b/d1a/f1f [0,4194304] 0 2024-09-10T10:04:18.606 INFO:tasks.workunit.client.0.smithi071.stdout:9/692: truncate d0/db/d1b/d1d/f3a 172841 0 2024-09-10T10:04:18.606 INFO:tasks.workunit.client.1.smithi107.stdout:5/595: unlink de/d4a/d4e/d89/f9e 0 2024-09-10T10:04:18.606 INFO:tasks.workunit.client.0.smithi071.stdout:0/426: creat d11/d30/d52/d5f/f96 x:0 0 0 2024-09-10T10:04:18.608 INFO:tasks.workunit.client.1.smithi107.stdout:3/823: write dc/dd/d42/d55/d58/d91/fd0 [771998,30539] 0 2024-09-10T10:04:18.608 INFO:tasks.workunit.client.0.smithi071.stdout:6/412: symlink d4/da/df/d2e/d3a/d3e/d5d/l84 0 2024-09-10T10:04:18.608 INFO:tasks.workunit.client.0.smithi071.stdout:9/693: write d0/db/d1b/d1d/d5b/d60/fca [1153133,44466] 0 2024-09-10T10:04:18.612 INFO:tasks.workunit.client.0.smithi071.stdout:9/694: chown d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/l7c 0 1 2024-09-10T10:04:18.613 INFO:tasks.workunit.client.1.smithi107.stdout:3/824: unlink dc/dd/d20/d23/f57 0 2024-09-10T10:04:18.614 INFO:tasks.workunit.client.0.smithi071.stdout:6/413: symlink d4/da/df/d2e/d3a/d40/d60/l85 0 2024-09-10T10:04:18.615 INFO:tasks.workunit.client.1.smithi107.stdout:1/615: dread d2/d6/f2d [0,4194304] 0 2024-09-10T10:04:18.615 INFO:tasks.workunit.client.0.smithi071.stdout:6/414: write d4/da/fb [2298648,126500] 0 2024-09-10T10:04:18.615 INFO:tasks.workunit.client.1.smithi107.stdout:3/825: creat dc/d56/f113 x:0 0 0 2024-09-10T10:04:18.616 INFO:tasks.workunit.client.0.smithi071.stdout:0/427: link d11/f14 d11/d22/f97 0 2024-09-10T10:04:18.616 INFO:tasks.workunit.client.1.smithi107.stdout:3/826: readlink dc/dd/d20/l2c 0 2024-09-10T10:04:18.617 INFO:tasks.workunit.client.0.smithi071.stdout:6/415: dread - d4/da/f82 zero size 2024-09-10T10:04:18.618 INFO:tasks.workunit.client.1.smithi107.stdout:5/596: write de/f1f [3144774,63981] 0 2024-09-10T10:04:18.620 INFO:tasks.workunit.client.1.smithi107.stdout:3/827: mkdir dc/dd/d45/d26/d41/d74/d114 0 2024-09-10T10:04:18.620 INFO:tasks.workunit.client.0.smithi071.stdout:0/428: rmdir d11/d30/d70 39 2024-09-10T10:04:18.622 INFO:tasks.workunit.client.1.smithi107.stdout:1/616: write d2/d89/f9e [208895,22752] 0 2024-09-10T10:04:18.622 INFO:tasks.workunit.client.0.smithi071.stdout:6/416: creat d4/d20/f86 x:0 0 0 2024-09-10T10:04:18.623 INFO:tasks.workunit.client.1.smithi107.stdout:3/828: mknod dc/dd/d45/c115 0 2024-09-10T10:04:18.625 INFO:tasks.workunit.client.1.smithi107.stdout:1/617: creat d2/d12/d5a/fc5 x:0 0 0 2024-09-10T10:04:18.625 INFO:tasks.workunit.client.1.smithi107.stdout:8/435: dread d5/d8/d66/d8b/f16 [0,4194304] 0 2024-09-10T10:04:18.627 INFO:tasks.workunit.client.0.smithi071.stdout:0/429: rename d11/d30/l43 to d11/d30/d52/d79/l98 0 2024-09-10T10:04:18.628 INFO:tasks.workunit.client.1.smithi107.stdout:1/618: unlink d2/d6/d24/cc1 0 2024-09-10T10:04:18.628 INFO:tasks.workunit.client.1.smithi107.stdout:8/436: write d5/d8/f6d [352388,1826] 0 2024-09-10T10:04:18.629 INFO:tasks.workunit.client.0.smithi071.stdout:0/430: read d11/d30/f5e [2045783,17108] 0 2024-09-10T10:04:18.629 INFO:tasks.workunit.client.1.smithi107.stdout:3/829: getdents dc/dd/d45/d26/d41 0 2024-09-10T10:04:18.632 INFO:tasks.workunit.client.1.smithi107.stdout:5/597: dwrite de/f3b [0,4194304] 0 2024-09-10T10:04:18.633 INFO:tasks.workunit.client.1.smithi107.stdout:3/830: write dc/dd/d45/d26/d41/fd3 [1711513,45896] 0 2024-09-10T10:04:18.634 INFO:tasks.workunit.client.1.smithi107.stdout:8/437: symlink d5/d8/d66/l97 0 2024-09-10T10:04:18.634 INFO:tasks.workunit.client.1.smithi107.stdout:3/831: dread - dc/d56/fb1 zero size 2024-09-10T10:04:18.635 INFO:tasks.workunit.client.0.smithi071.stdout:6/417: rename d4/da/l17 to d4/da/df/l87 0 2024-09-10T10:04:18.637 INFO:tasks.workunit.client.0.smithi071.stdout:6/418: write d4/da/df/d2e/d3a/d43/f6a [683798,15002] 0 2024-09-10T10:04:18.637 INFO:tasks.workunit.client.1.smithi107.stdout:1/619: rename d2/d12/d71 to d2/d6/dc6 0 2024-09-10T10:04:18.640 INFO:tasks.workunit.client.1.smithi107.stdout:8/438: mknod d5/d8/d5b/c98 0 2024-09-10T10:04:18.641 INFO:tasks.workunit.client.1.smithi107.stdout:1/620: rmdir d2/d6 39 2024-09-10T10:04:18.642 INFO:tasks.workunit.client.1.smithi107.stdout:3/832: dwrite dc/dd/d42/d55/d58/d91/f107 [0,4194304] 0 2024-09-10T10:04:18.643 INFO:tasks.workunit.client.1.smithi107.stdout:1/621: chown d2/l1b 0 1 2024-09-10T10:04:18.643 INFO:tasks.workunit.client.1.smithi107.stdout:8/439: chown d5/d8/d66/d8b/d21/f61 747744 1 2024-09-10T10:04:18.647 INFO:tasks.workunit.client.0.smithi071.stdout:6/419: dwrite d4/da/df/d2e/d3a/d43/f4c [0,4194304] 0 2024-09-10T10:04:18.648 INFO:tasks.workunit.client.0.smithi071.stdout:6/420: fsync d4/da/df/d2e/d3a/d51/d64/f7e 0 2024-09-10T10:04:18.648 INFO:tasks.workunit.client.1.smithi107.stdout:3/833: getdents dc/dd/d20/d23/df3/d110 0 2024-09-10T10:04:18.651 INFO:tasks.workunit.client.1.smithi107.stdout:1/622: getdents d2/d12/d94 0 2024-09-10T10:04:18.652 INFO:tasks.workunit.client.1.smithi107.stdout:3/834: creat dc/dd/d20/d23/d39/d69/f116 x:0 0 0 2024-09-10T10:04:18.653 INFO:tasks.workunit.client.1.smithi107.stdout:3/835: fdatasync dc/dd/d45/fb5 0 2024-09-10T10:04:18.653 INFO:tasks.workunit.client.0.smithi071.stdout:0/431: dread d11/d30/d52/f53 [0,4194304] 0 2024-09-10T10:04:18.654 INFO:tasks.workunit.client.1.smithi107.stdout:3/836: stat dc/dd/d45/d26/d41/d44/d63/d101 0 2024-09-10T10:04:18.655 INFO:tasks.workunit.client.1.smithi107.stdout:3/837: fsync dc/dd/d42/d55/d58/ffa 0 2024-09-10T10:04:18.656 INFO:tasks.workunit.client.1.smithi107.stdout:3/838: fdatasync dc/dd/d20/d23/fde 0 2024-09-10T10:04:18.659 INFO:tasks.workunit.client.1.smithi107.stdout:3/839: creat dc/dd/d45/d26/d41/dda/f117 x:0 0 0 2024-09-10T10:04:18.665 INFO:tasks.workunit.client.1.smithi107.stdout:3/840: dwrite dc/dd/d20/d23/d39/fa3 [4194304,4194304] 0 2024-09-10T10:04:18.669 INFO:tasks.workunit.client.1.smithi107.stdout:3/841: rename dc/dd/d45/d26/d41/d44/d35/d4a/l7f to dc/l118 0 2024-09-10T10:04:18.670 INFO:tasks.workunit.client.1.smithi107.stdout:3/842: readlink dc/dd/d45/d26/d41/d44/d35/d4a/ld1 0 2024-09-10T10:04:18.673 INFO:tasks.workunit.client.1.smithi107.stdout:3/843: symlink dc/dd/d45/d26/d41/d44/d35/d104/l119 0 2024-09-10T10:04:18.686 INFO:tasks.workunit.client.1.smithi107.stdout:1/623: dread d2/d12/d65/d6b/f74 [0,4194304] 0 2024-09-10T10:04:18.687 INFO:tasks.workunit.client.1.smithi107.stdout:1/624: rmdir d2/d12/d7e 39 2024-09-10T10:04:18.689 INFO:tasks.workunit.client.1.smithi107.stdout:1/625: creat d2/d12/d94/fc7 x:0 0 0 2024-09-10T10:04:18.689 INFO:tasks.workunit.client.1.smithi107.stdout:8/440: truncate d5/d8/d2a/d35/d70/f8f 2375984 0 2024-09-10T10:04:18.690 INFO:tasks.workunit.client.1.smithi107.stdout:8/441: write d5/fb [2457274,27739] 0 2024-09-10T10:04:18.691 INFO:tasks.workunit.client.1.smithi107.stdout:1/626: write d2/d6/f5e [3796321,110578] 0 2024-09-10T10:04:18.694 INFO:tasks.workunit.client.1.smithi107.stdout:1/627: mknod d2/d36/cc8 0 2024-09-10T10:04:18.695 INFO:tasks.workunit.client.1.smithi107.stdout:8/442: read d5/f26 [3050645,10673] 0 2024-09-10T10:04:18.695 INFO:tasks.workunit.client.1.smithi107.stdout:3/844: write dc/dd/d45/d26/d41/d44/f3c [3093631,14962] 0 2024-09-10T10:04:18.696 INFO:tasks.workunit.client.1.smithi107.stdout:3/845: read dc/dd/d42/fdb [104028,4738] 0 2024-09-10T10:04:18.726 INFO:tasks.workunit.client.1.smithi107.stdout:8/443: mknod d5/d8/d66/d8b/d1a/d64/c99 0 2024-09-10T10:04:18.728 INFO:tasks.workunit.client.0.smithi071.stdout:9/695: truncate d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f6b 3862874 0 2024-09-10T10:04:18.729 INFO:tasks.workunit.client.0.smithi071.stdout:6/421: creat d4/da/df/d2e/d3a/d51/d64/f88 x:0 0 0 2024-09-10T10:04:18.729 INFO:tasks.workunit.client.1.smithi107.stdout:3/846: mknod dc/dd/d45/d26/d41/d44/d35/c11a 0 2024-09-10T10:04:18.731 INFO:tasks.workunit.client.0.smithi071.stdout:0/432: chown d11/d30/d52/f80 91 1 2024-09-10T10:04:18.731 INFO:tasks.workunit.client.1.smithi107.stdout:0/492: sync 2024-09-10T10:04:18.731 INFO:tasks.workunit.client.0.smithi071.stdout:9/696: read d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f8d [225391,68574] 0 2024-09-10T10:04:18.732 INFO:tasks.workunit.client.1.smithi107.stdout:3/847: mkdir dc/dd/d20/d23/d39/d11b 0 2024-09-10T10:04:18.733 INFO:tasks.workunit.client.1.smithi107.stdout:0/493: unlink d6/fa 0 2024-09-10T10:04:18.734 INFO:tasks.workunit.client.1.smithi107.stdout:0/494: read - d6/d14/f99 zero size 2024-09-10T10:04:18.734 INFO:tasks.workunit.client.1.smithi107.stdout:3/848: fdatasync dc/dd/d45/d26/d41/d44/d35/d52/f92 0 2024-09-10T10:04:18.735 INFO:tasks.workunit.client.0.smithi071.stdout:9/697: fdatasync d0/db/d1b/d1d/d4b/f4c 0 2024-09-10T10:04:18.741 INFO:tasks.workunit.client.0.smithi071.stdout:9/698: rmdir d0/db/d1b/d1d 39 2024-09-10T10:04:18.742 INFO:tasks.workunit.client.1.smithi107.stdout:8/444: write d5/d8/d2a/d35/d70/f8f [163131,13984] 0 2024-09-10T10:04:18.744 INFO:tasks.workunit.client.1.smithi107.stdout:8/445: chown d5/d8/l39 109683353 1 2024-09-10T10:04:18.747 INFO:tasks.workunit.client.0.smithi071.stdout:0/433: link d11/d22/d31/c81 d11/d22/d31/d72/c99 0 2024-09-10T10:04:18.748 INFO:tasks.workunit.client.0.smithi071.stdout:6/422: write d4/f25 [458340,5302] 0 2024-09-10T10:04:18.752 INFO:tasks.workunit.client.0.smithi071.stdout:9/699: dwrite d0/db/d1b/d1d/f35 [0,4194304] 0 2024-09-10T10:04:18.752 INFO:tasks.workunit.client.1.smithi107.stdout:8/446: dwrite d5/d8/d66/d8b/d21/d83/f55 [0,4194304] 0 2024-09-10T10:04:18.752 INFO:tasks.workunit.client.1.smithi107.stdout:3/849: dread dc/dd/d45/d26/f3a [0,4194304] 0 2024-09-10T10:04:18.755 INFO:tasks.workunit.client.1.smithi107.stdout:3/850: chown dc/dd/d45/d26/d41/d44/c7d 0 1 2024-09-10T10:04:18.756 INFO:tasks.workunit.client.0.smithi071.stdout:0/434: mkdir d11/d22/d9a 0 2024-09-10T10:04:18.757 INFO:tasks.workunit.client.0.smithi071.stdout:6/423: dwrite d4/d1c/f4b [0,4194304] 0 2024-09-10T10:04:18.757 INFO:tasks.workunit.client.1.smithi107.stdout:8/447: rename d5/d42/c7a to d5/d8/d66/d8b/d1a/c9a 0 2024-09-10T10:04:18.758 INFO:tasks.workunit.client.1.smithi107.stdout:0/495: dread d6/d8/d2f/f1b [0,4194304] 0 2024-09-10T10:04:18.760 INFO:tasks.workunit.client.0.smithi071.stdout:6/424: creat d4/d61/f89 x:0 0 0 2024-09-10T10:04:18.762 INFO:tasks.workunit.client.1.smithi107.stdout:3/851: link dc/dd/d45/f6d dc/dd/d20/d23/d2f/d9c/f11c 0 2024-09-10T10:04:18.763 INFO:tasks.workunit.client.1.smithi107.stdout:8/448: mknod d5/c9b 0 2024-09-10T10:04:18.764 INFO:tasks.workunit.client.1.smithi107.stdout:8/449: chown d5/l17 6137448 1 2024-09-10T10:04:18.764 INFO:tasks.workunit.client.0.smithi071.stdout:6/425: creat d4/d61/f8a x:0 0 0 2024-09-10T10:04:18.764 INFO:tasks.workunit.client.0.smithi071.stdout:0/435: dwrite d11/d22/d40/f6d [0,4194304] 0 2024-09-10T10:04:18.764 INFO:tasks.workunit.client.1.smithi107.stdout:3/852: write dc/dd/d20/d23/d2f/d9c/f109 [269859,59078] 0 2024-09-10T10:04:18.766 INFO:tasks.workunit.client.0.smithi071.stdout:6/426: dread - d4/da/df/d2e/d3a/d3e/f77 zero size 2024-09-10T10:04:18.767 INFO:tasks.workunit.client.1.smithi107.stdout:3/853: dread - dc/dd/d45/d26/d41/d44/d35/d4a/dd8/de0/fef zero size 2024-09-10T10:04:18.768 INFO:tasks.workunit.client.1.smithi107.stdout:8/450: creat d5/d8/d2a/d47/f9c x:0 0 0 2024-09-10T10:04:18.769 INFO:tasks.workunit.client.0.smithi071.stdout:0/436: truncate d11/d30/f3c 817178 0 2024-09-10T10:04:18.769 INFO:tasks.workunit.client.0.smithi071.stdout:0/437: stat d11/d22/l55 0 2024-09-10T10:04:18.771 INFO:tasks.workunit.client.1.smithi107.stdout:8/451: symlink d5/d8/d66/l9d 0 2024-09-10T10:04:18.772 INFO:tasks.workunit.client.1.smithi107.stdout:8/452: write d5/f79 [993533,29134] 0 2024-09-10T10:04:18.775 INFO:tasks.workunit.client.1.smithi107.stdout:8/453: symlink d5/d8/d66/d8b/d1a/d75/l9e 0 2024-09-10T10:04:18.778 INFO:tasks.workunit.client.0.smithi071.stdout:0/438: link d11/d22/d40/f68 d11/d30/f9b 0 2024-09-10T10:04:18.779 INFO:tasks.workunit.client.0.smithi071.stdout:9/700: truncate d0/db/d20/d21/f34 494752 0 2024-09-10T10:04:18.780 INFO:tasks.workunit.client.0.smithi071.stdout:9/701: write d0/d3b/d5c/d6a/f6c [6015757,80224] 0 2024-09-10T10:04:18.780 INFO:tasks.workunit.client.0.smithi071.stdout:0/439: symlink d11/d30/l9c 0 2024-09-10T10:04:18.782 INFO:tasks.workunit.client.0.smithi071.stdout:0/440: write d11/d22/d40/f4a [773863,51489] 0 2024-09-10T10:04:18.783 INFO:tasks.workunit.client.0.smithi071.stdout:9/702: mkdir d0/db/d20/dd8 0 2024-09-10T10:04:18.783 INFO:tasks.workunit.client.0.smithi071.stdout:0/441: mkdir d11/d30/d52/d79/d9d 0 2024-09-10T10:04:18.785 INFO:tasks.workunit.client.0.smithi071.stdout:9/703: write d0/db/d1b/d1d/d5b/d60/fca [2744384,53410] 0 2024-09-10T10:04:18.786 INFO:tasks.workunit.client.0.smithi071.stdout:9/704: dread - d0/db/d1b/d1d/d4b/db9/fce zero size 2024-09-10T10:04:18.786 INFO:tasks.workunit.client.0.smithi071.stdout:0/442: rename d11/d22/d40/f6d to d11/d30/d52/d5f/f9e 0 2024-09-10T10:04:18.788 INFO:tasks.workunit.client.0.smithi071.stdout:0/443: read d11/d30/f71 [385870,25200] 0 2024-09-10T10:04:18.788 INFO:tasks.workunit.client.0.smithi071.stdout:9/705: creat d0/db/d1b/d1d/d5b/d9f/fd9 x:0 0 0 2024-09-10T10:04:18.791 INFO:tasks.workunit.client.0.smithi071.stdout:9/706: rename d0/db/d20/d3c to d0/d3b/d5c/d6a/d96/dda 0 2024-09-10T10:04:18.792 INFO:tasks.workunit.client.0.smithi071.stdout:9/707: mknod d0/db/d20/dd8/cdb 0 2024-09-10T10:04:18.794 INFO:tasks.workunit.client.0.smithi071.stdout:9/708: unlink d0/d3b/d5c/faa 0 2024-09-10T10:04:18.795 INFO:tasks.workunit.client.0.smithi071.stdout:9/709: creat d0/d3b/fdc x:0 0 0 2024-09-10T10:04:18.797 INFO:tasks.workunit.client.0.smithi071.stdout:9/710: creat d0/d3b/d5c/d6a/d96/fdd x:0 0 0 2024-09-10T10:04:18.800 INFO:tasks.workunit.client.0.smithi071.stdout:9/711: getdents d0/db 0 2024-09-10T10:04:18.800 INFO:tasks.workunit.client.1.smithi107.stdout:3/854: truncate dc/dd/d45/d26/d41/d44/d35/f2a 2456386 0 2024-09-10T10:04:18.801 INFO:tasks.workunit.client.0.smithi071.stdout:9/712: chown d0/db/d1b/d1d/d30/d54/fc6 26729268 1 2024-09-10T10:04:18.802 INFO:tasks.workunit.client.0.smithi071.stdout:6/427: getdents d4/d61 0 2024-09-10T10:04:18.802 INFO:tasks.workunit.client.1.smithi107.stdout:3/855: mknod dc/dd/d20/d23/d39/d69/c11d 0 2024-09-10T10:04:18.804 INFO:tasks.workunit.client.0.smithi071.stdout:2/464: sync 2024-09-10T10:04:18.807 INFO:tasks.workunit.client.0.smithi071.stdout:2/465: symlink d8/d24/l9c 0 2024-09-10T10:04:18.808 INFO:tasks.workunit.client.0.smithi071.stdout:2/466: stat d8/d87/c35 0 2024-09-10T10:04:18.812 INFO:tasks.workunit.client.0.smithi071.stdout:9/713: link d0/db/d1b/d1d/d4b/f8b d0/db/d20/fde 0 2024-09-10T10:04:18.815 INFO:tasks.workunit.client.0.smithi071.stdout:9/714: rmdir d0/db/d1b/d1d/d5b/d9f 39 2024-09-10T10:04:18.817 INFO:tasks.workunit.client.0.smithi071.stdout:6/428: dread d4/da/df/d5e/f75 [0,4194304] 0 2024-09-10T10:04:18.819 INFO:tasks.workunit.client.0.smithi071.stdout:9/715: creat d0/db/d20/fdf x:0 0 0 2024-09-10T10:04:18.820 INFO:tasks.workunit.client.0.smithi071.stdout:6/429: mknod d4/da/df/d2e/d3a/d3e/d5d/d81/c8b 0 2024-09-10T10:04:18.821 INFO:tasks.workunit.client.0.smithi071.stdout:9/716: write d0/d3b/fdc [299028,67879] 0 2024-09-10T10:04:18.823 INFO:tasks.workunit.client.1.smithi107.stdout:3/856: dread dc/dd/d45/d26/d59/f67 [0,4194304] 0 2024-09-10T10:04:18.823 INFO:tasks.workunit.client.0.smithi071.stdout:6/430: mknod d4/da/df/d2e/d3a/d40/d60/c8c 0 2024-09-10T10:04:18.824 INFO:tasks.workunit.client.1.smithi107.stdout:3/857: fdatasync dc/dd/d42/d55/d58/d91/fd0 0 2024-09-10T10:04:18.826 INFO:tasks.workunit.client.0.smithi071.stdout:9/717: chown d0/db/d20/d21/f34 24 1 2024-09-10T10:04:18.827 INFO:tasks.workunit.client.0.smithi071.stdout:6/431: symlink d4/da/df/d2e/d3a/d40/d60/d7a/l8d 0 2024-09-10T10:04:18.828 INFO:tasks.workunit.client.0.smithi071.stdout:2/467: dread d8/f80 [0,4194304] 0 2024-09-10T10:04:18.828 INFO:tasks.workunit.client.0.smithi071.stdout:9/718: chown d0/d3b/d44/f63 607 1 2024-09-10T10:04:18.829 INFO:tasks.workunit.client.1.smithi107.stdout:3/858: rename dc/dd/d45/d26/d41/d44/d35/lc7 to dc/dd/d45/d26/d59/l11e 0 2024-09-10T10:04:18.829 INFO:tasks.workunit.client.0.smithi071.stdout:2/468: read d8/d38/f57 [332485,101711] 0 2024-09-10T10:04:18.830 INFO:tasks.workunit.client.0.smithi071.stdout:6/432: write d4/da/df/d2e/d3a/d51/d64/f72 [884866,59321] 0 2024-09-10T10:04:18.831 INFO:tasks.workunit.client.0.smithi071.stdout:9/719: mkdir d0/db/d1b/d1d/d4b/db9/de0 0 2024-09-10T10:04:18.831 INFO:tasks.workunit.client.1.smithi107.stdout:3/859: creat dc/dd/d45/d26/d41/d44/d63/d101/f11f x:0 0 0 2024-09-10T10:04:18.832 INFO:tasks.workunit.client.0.smithi071.stdout:2/469: mknod d8/d87/d33/d41/d4d/c9d 0 2024-09-10T10:04:18.833 INFO:tasks.workunit.client.0.smithi071.stdout:9/720: mkdir d0/d3b/d5c/d6a/dd3/de1 0 2024-09-10T10:04:18.834 INFO:tasks.workunit.client.0.smithi071.stdout:2/470: symlink d8/d87/d33/d41/d4d/l9e 0 2024-09-10T10:04:18.835 INFO:tasks.workunit.client.1.smithi107.stdout:3/860: rename dc/dd/d20/d23/d39/c87 to dc/dd/d42/d55/d58/d91/c120 0 2024-09-10T10:04:18.835 INFO:tasks.workunit.client.0.smithi071.stdout:2/471: fdatasync d8/d87/d33/d41/d4d/f85 0 2024-09-10T10:04:18.835 INFO:tasks.workunit.client.0.smithi071.stdout:2/472: chown d8/f94 3 1 2024-09-10T10:04:18.837 INFO:tasks.workunit.client.0.smithi071.stdout:2/473: mknod d8/d38/d47/d59/c9f 0 2024-09-10T10:04:18.842 INFO:tasks.workunit.client.0.smithi071.stdout:9/721: truncate d0/d3b/d5c/f74 1108042 0 2024-09-10T10:04:18.843 INFO:tasks.workunit.client.0.smithi071.stdout:9/722: rmdir d0/db/d1b/d1d/d4b 39 2024-09-10T10:04:18.844 INFO:tasks.workunit.client.0.smithi071.stdout:2/474: truncate d8/d38/d47/f5f 6135676 0 2024-09-10T10:04:18.844 INFO:tasks.workunit.client.1.smithi107.stdout:3/861: truncate dc/dd/d45/d26/d41/d74/f80 1013517 0 2024-09-10T10:04:18.846 INFO:tasks.workunit.client.1.smithi107.stdout:3/862: rmdir dc/dd/d45/d26 39 2024-09-10T10:04:18.846 INFO:tasks.workunit.client.0.smithi071.stdout:9/723: rename d0/d3b/d5c/f7f to d0/db/fe2 0 2024-09-10T10:04:18.851 INFO:tasks.workunit.client.0.smithi071.stdout:2/475: dwrite d8/d87/d33/f3c [0,4194304] 0 2024-09-10T10:04:18.851 INFO:tasks.workunit.client.1.smithi107.stdout:3/863: getdents dc/dd/d45/d26/d59/d78 0 2024-09-10T10:04:18.854 INFO:tasks.workunit.client.1.smithi107.stdout:3/864: rename dc/la1 to dc/dd/d20/d23/df3/d110/l121 0 2024-09-10T10:04:18.858 INFO:tasks.workunit.client.0.smithi071.stdout:2/476: getdents d8/d38/d47/d59 0 2024-09-10T10:04:18.859 INFO:tasks.workunit.client.0.smithi071.stdout:9/724: truncate d0/db/d1b/d1d/f3a 151156 0 2024-09-10T10:04:18.860 INFO:tasks.workunit.client.0.smithi071.stdout:9/725: write d0/db/d1b/d1d/f35 [2434436,33924] 0 2024-09-10T10:04:18.860 INFO:tasks.workunit.client.0.smithi071.stdout:2/477: chown d8/d87/c44 132915425 1 2024-09-10T10:04:18.863 INFO:tasks.workunit.client.0.smithi071.stdout:2/478: creat d8/d38/fa0 x:0 0 0 2024-09-10T10:04:18.864 INFO:tasks.workunit.client.0.smithi071.stdout:2/479: chown d8/f48 79 1 2024-09-10T10:04:18.865 INFO:tasks.workunit.client.0.smithi071.stdout:2/480: truncate d8/d87/f1c 1414852 0 2024-09-10T10:04:18.866 INFO:tasks.workunit.client.1.smithi107.stdout:3/865: dread dc/dd/d45/d26/d41/fd3 [0,4194304] 0 2024-09-10T10:04:18.866 INFO:tasks.workunit.client.0.smithi071.stdout:2/481: fdatasync d8/f1a 0 2024-09-10T10:04:18.867 INFO:tasks.workunit.client.1.smithi107.stdout:3/866: write dc/dd/d20/d23/d39/fbf [20653,49685] 0 2024-09-10T10:04:18.868 INFO:tasks.workunit.client.0.smithi071.stdout:2/482: mknod d8/d87/d33/d41/d56/ca1 0 2024-09-10T10:04:18.874 INFO:tasks.workunit.client.0.smithi071.stdout:9/726: dwrite d0/db/d20/d21/f34 [0,4194304] 0 2024-09-10T10:04:18.874 INFO:tasks.workunit.client.1.smithi107.stdout:3/867: write dc/dd/d20/d23/d39/fa5 [749728,6295] 0 2024-09-10T10:04:18.875 INFO:tasks.workunit.client.0.smithi071.stdout:9/727: chown d0/db/d1b/lb6 416155905 1 2024-09-10T10:04:18.878 INFO:tasks.workunit.client.0.smithi071.stdout:2/483: dread d8/f48 [0,4194304] 0 2024-09-10T10:04:18.879 INFO:tasks.workunit.client.0.smithi071.stdout:9/728: truncate d0/db/d1b/d1d/d5b/d9f/fd9 77992 0 2024-09-10T10:04:18.879 INFO:tasks.workunit.client.1.smithi107.stdout:3/868: unlink dc/dd/d45/d26/d41/d44/d35/d4a/dd8/de0/fe5 0 2024-09-10T10:04:18.885 INFO:tasks.workunit.client.1.smithi107.stdout:3/869: rename dc/l118 to dc/dd/d45/d26/d59/l122 0 2024-09-10T10:04:18.886 INFO:tasks.workunit.client.1.smithi107.stdout:3/870: dread - dc/dd/d45/d26/d41/d44/d35/d52/f9f zero size 2024-09-10T10:04:18.889 INFO:tasks.workunit.client.1.smithi107.stdout:3/871: creat dc/dd/d45/d26/d41/d74/d114/f123 x:0 0 0 2024-09-10T10:04:18.890 INFO:tasks.workunit.client.0.smithi071.stdout:9/729: dwrite d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f5d [0,4194304] 0 2024-09-10T10:04:18.890 INFO:tasks.workunit.client.1.smithi107.stdout:3/872: write dc/dd/d45/d26/d41/d44/f3c [1483931,128252] 0 2024-09-10T10:04:18.895 INFO:tasks.workunit.client.1.smithi107.stdout:3/873: getdents dc/dd/d42/de8 0 2024-09-10T10:04:18.897 INFO:tasks.workunit.client.0.smithi071.stdout:9/730: dwrite d0/db/d1b/d1d/d30/f65 [0,4194304] 0 2024-09-10T10:04:18.900 INFO:tasks.workunit.client.1.smithi107.stdout:3/874: rename dc/dd/d45/f6d to dc/dd/d45/d26/d41/d44/d35/d4a/dd8/de0/f124 0 2024-09-10T10:04:18.902 INFO:tasks.workunit.client.0.smithi071.stdout:2/484: dread f2 [0,4194304] 0 2024-09-10T10:04:18.903 INFO:tasks.workunit.client.1.smithi107.stdout:3/875: truncate dc/dd/d45/d26/d41/d44/d35/d4a/dd8/de0/f10d 695610 0 2024-09-10T10:04:18.906 INFO:tasks.workunit.client.0.smithi071.stdout:9/731: dwrite d0/db/d1b/d1d/d5b/fbc [0,4194304] 0 2024-09-10T10:04:18.908 INFO:tasks.workunit.client.1.smithi107.stdout:3/876: unlink dc/dd/d20/f60 0 2024-09-10T10:04:18.909 INFO:tasks.workunit.client.1.smithi107.stdout:3/877: write dc/dd/d45/d26/f50 [3972251,115725] 0 2024-09-10T10:04:18.909 INFO:tasks.workunit.client.0.smithi071.stdout:2/485: mknod d8/d87/d49/d66/ca2 0 2024-09-10T10:04:18.911 INFO:tasks.workunit.client.1.smithi107.stdout:3/878: dread dc/dd/d45/d26/d41/d44/d35/f9b [0,4194304] 0 2024-09-10T10:04:18.912 INFO:tasks.workunit.client.0.smithi071.stdout:9/732: mknod d0/d3b/d5c/d6a/ce3 0 2024-09-10T10:04:18.912 INFO:tasks.workunit.client.1.smithi107.stdout:3/879: readlink dc/dd/d45/l48 0 2024-09-10T10:04:18.913 INFO:tasks.workunit.client.0.smithi071.stdout:2/486: write d8/f80 [290435,93801] 0 2024-09-10T10:04:18.915 INFO:tasks.workunit.client.1.smithi107.stdout:3/880: creat dc/dd/d20/d23/df3/d110/f125 x:0 0 0 2024-09-10T10:04:18.918 INFO:tasks.workunit.client.0.smithi071.stdout:2/487: getdents d8/d87/d33 0 2024-09-10T10:04:18.919 INFO:tasks.workunit.client.1.smithi107.stdout:3/881: link dc/dd/d45/ff0 dc/dd/d45/d26/d41/d10e/f126 0 2024-09-10T10:04:18.920 INFO:tasks.workunit.client.0.smithi071.stdout:9/733: dwrite d0/f87 [0,4194304] 0 2024-09-10T10:04:18.921 INFO:tasks.workunit.client.1.smithi107.stdout:3/882: read dc/dd/d45/d26/d41/d10e/f126 [6537776,61290] 0 2024-09-10T10:04:18.923 INFO:tasks.workunit.client.1.smithi107.stdout:3/883: truncate dc/dd/d20/d23/d39/fbf 79551 0 2024-09-10T10:04:18.925 INFO:tasks.workunit.client.0.smithi071.stdout:2/488: dwrite d8/d87/f1c [0,4194304] 0 2024-09-10T10:04:18.931 INFO:tasks.workunit.client.0.smithi071.stdout:9/734: write d0/db/d1b/d1d/d4b/f4c [846852,24236] 0 2024-09-10T10:04:18.932 INFO:tasks.workunit.client.1.smithi107.stdout:3/884: dwrite dc/dd/d20/d23/d2f/fb4 [0,4194304] 0 2024-09-10T10:04:18.934 INFO:tasks.workunit.client.1.smithi107.stdout:3/885: write dc/dd/d45/d26/d41/d44/d35/d52/fbb [2271414,44599] 0 2024-09-10T10:04:18.941 INFO:tasks.workunit.client.1.smithi107.stdout:3/886: getdents dc/dd/d45/d26/d59 0 2024-09-10T10:04:18.942 INFO:tasks.workunit.client.1.smithi107.stdout:3/887: chown dc/dd/d45/d26/d41/d44/d63/f6f 1 1 2024-09-10T10:04:18.944 INFO:tasks.workunit.client.1.smithi107.stdout:3/888: mknod dc/dd/d20/d23/d39/d69/c127 0 2024-09-10T10:04:18.947 INFO:tasks.workunit.client.1.smithi107.stdout:3/889: creat dc/dd/d45/d26/d41/d44/d35/d104/f128 x:0 0 0 2024-09-10T10:04:18.949 INFO:tasks.workunit.client.0.smithi071.stdout:2/489: dwrite d8/d24/f61 [0,4194304] 0 2024-09-10T10:04:18.949 INFO:tasks.workunit.client.1.smithi107.stdout:3/890: truncate dc/dd/d42/d55/f68 487452 0 2024-09-10T10:04:18.949 INFO:tasks.workunit.client.1.smithi107.stdout:4/580: sync 2024-09-10T10:04:18.952 INFO:tasks.workunit.client.0.smithi071.stdout:2/490: mknod d8/d87/d33/d41/d4d/ca3 0 2024-09-10T10:04:18.953 INFO:tasks.workunit.client.1.smithi107.stdout:3/891: mknod dc/dd/d20/d23/d39/c129 0 2024-09-10T10:04:18.953 INFO:tasks.workunit.client.0.smithi071.stdout:2/491: chown d8/d38/d47/d59/l81 8027733 1 2024-09-10T10:04:18.953 INFO:tasks.workunit.client.0.smithi071.stdout:2/492: readlink d8/d87/d33/l92 0 2024-09-10T10:04:18.960 INFO:tasks.workunit.client.0.smithi071.stdout:2/493: dwrite d8/fb [4194304,4194304] 0 2024-09-10T10:04:18.961 INFO:tasks.workunit.client.0.smithi071.stdout:2/494: chown d8/d87/d33/d41/l60 4 1 2024-09-10T10:04:18.963 INFO:tasks.workunit.client.0.smithi071.stdout:2/495: symlink d8/d87/d33/d41/d4d/d5e/la4 0 2024-09-10T10:04:18.966 INFO:tasks.workunit.client.1.smithi107.stdout:3/892: mkdir dc/dd/d45/d26/d41/d44/d12a 0 2024-09-10T10:04:18.966 INFO:tasks.workunit.client.0.smithi071.stdout:2/496: creat d8/d24/fa5 x:0 0 0 2024-09-10T10:04:18.967 INFO:tasks.workunit.client.1.smithi107.stdout:4/581: dwrite d0/d1f/d20/f4c [0,4194304] 0 2024-09-10T10:04:18.968 INFO:tasks.workunit.client.1.smithi107.stdout:3/893: fsync dc/dd/d45/d26/f50 0 2024-09-10T10:04:18.968 INFO:tasks.workunit.client.0.smithi071.stdout:2/497: readlink d8/d4a/l6b 0 2024-09-10T10:04:18.969 INFO:tasks.workunit.client.1.smithi107.stdout:4/582: write d0/d6b/f96 [1026740,101874] 0 2024-09-10T10:04:18.969 INFO:tasks.workunit.client.0.smithi071.stdout:2/498: readlink d8/d87/d33/d41/d4d/d5e/la4 0 2024-09-10T10:04:18.969 INFO:tasks.workunit.client.1.smithi107.stdout:3/894: chown dc/d56/fb1 1 1 2024-09-10T10:04:18.969 INFO:tasks.workunit.client.1.smithi107.stdout:4/583: readlink d0/d40/d57/d76/l7b 0 2024-09-10T10:04:18.970 INFO:tasks.workunit.client.1.smithi107.stdout:4/584: chown d0/c43 71244698 1 2024-09-10T10:04:18.972 INFO:tasks.workunit.client.0.smithi071.stdout:9/735: dread d0/db/d1b/d1d/d30/d54/d27/f66 [0,4194304] 0 2024-09-10T10:04:18.973 INFO:tasks.workunit.client.1.smithi107.stdout:4/585: chown d0/d40/d57/d76/d77/d8d/fc3 0 1 2024-09-10T10:04:18.974 INFO:tasks.workunit.client.1.smithi107.stdout:4/586: fsync d0/d40/d57/d76/d77/da1/f5b 0 2024-09-10T10:04:18.974 INFO:tasks.workunit.client.1.smithi107.stdout:3/895: rmdir dc/dd/d20/d23/d39/d11b 0 2024-09-10T10:04:18.975 INFO:tasks.workunit.client.0.smithi071.stdout:9/736: chown d0/db/d1b/d1d/d5b/cb8 1444 1 2024-09-10T10:04:18.977 INFO:tasks.workunit.client.0.smithi071.stdout:5/404: sync 2024-09-10T10:04:18.978 INFO:tasks.workunit.client.0.smithi071.stdout:8/464: sync 2024-09-10T10:04:18.978 INFO:tasks.workunit.client.0.smithi071.stdout:1/480: sync 2024-09-10T10:04:18.978 INFO:tasks.workunit.client.0.smithi071.stdout:2/499: dwrite d8/d87/d33/f3c [0,4194304] 0 2024-09-10T10:04:18.978 INFO:tasks.workunit.client.1.smithi107.stdout:3/896: unlink dc/dd/d42/fdb 0 2024-09-10T10:04:18.979 INFO:tasks.workunit.client.1.smithi107.stdout:4/587: creat d0/d6b/d9d/fc5 x:0 0 0 2024-09-10T10:04:18.979 INFO:tasks.workunit.client.1.smithi107.stdout:3/897: write dc/dd/d20/d23/d39/d69/fe6 [1742664,47100] 0 2024-09-10T10:04:18.980 INFO:tasks.workunit.client.1.smithi107.stdout:4/588: write d0/d40/d57/fb0 [988703,59922] 0 2024-09-10T10:04:18.982 INFO:tasks.workunit.client.1.smithi107.stdout:3/898: mkdir dc/dd/d20/d12b 0 2024-09-10T10:04:18.983 INFO:tasks.workunit.client.1.smithi107.stdout:4/589: symlink d0/d40/d75/d53/lc6 0 2024-09-10T10:04:18.984 INFO:tasks.workunit.client.0.smithi071.stdout:2/500: unlink f2 0 2024-09-10T10:04:18.984 INFO:tasks.workunit.client.0.smithi071.stdout:8/465: fdatasync d5/df/d1e/d38/f48 0 2024-09-10T10:04:18.986 INFO:tasks.workunit.client.0.smithi071.stdout:1/481: unlink d1/d3f/d58/f5a 0 2024-09-10T10:04:18.987 INFO:tasks.workunit.client.1.smithi107.stdout:3/899: unlink dc/dd/f4f 0 2024-09-10T10:04:18.991 INFO:tasks.workunit.client.1.smithi107.stdout:4/590: dwrite d0/d1f/d20/f30 [0,4194304] 0 2024-09-10T10:04:18.991 INFO:tasks.workunit.client.0.smithi071.stdout:1/482: creat d1/d21/d2f/d30/d6a/d91/f9c x:0 0 0 2024-09-10T10:04:18.992 INFO:tasks.workunit.client.1.smithi107.stdout:4/591: chown d0/f1d 26506 1 2024-09-10T10:04:18.992 INFO:tasks.workunit.client.0.smithi071.stdout:1/483: dread - d1/d21/f98 zero size 2024-09-10T10:04:18.993 INFO:tasks.workunit.client.0.smithi071.stdout:2/501: creat d8/d24/d7f/fa6 x:0 0 0 2024-09-10T10:04:18.993 INFO:tasks.workunit.client.1.smithi107.stdout:3/900: rename dc/dd/d20/d23/fc0 to dc/dd/d45/d26/d41/d44/d35/f12c 0 2024-09-10T10:04:18.994 INFO:tasks.workunit.client.0.smithi071.stdout:5/405: write dc/fe [1090115,10696] 0 2024-09-10T10:04:18.996 INFO:tasks.workunit.client.1.smithi107.stdout:3/901: fsync dc/d56/fb0 0 2024-09-10T10:04:18.996 INFO:tasks.workunit.client.0.smithi071.stdout:8/466: getdents d5/d36/d49/d8f 0 2024-09-10T10:04:18.997 INFO:tasks.workunit.client.0.smithi071.stdout:9/737: dread d0/db/d1b/d1d/f1f [0,4194304] 0 2024-09-10T10:04:18.997 INFO:tasks.workunit.client.0.smithi071.stdout:8/467: readlink d5/d30/l6e 0 2024-09-10T10:04:18.998 INFO:tasks.workunit.client.0.smithi071.stdout:5/406: rmdir dc/df 39 2024-09-10T10:04:18.998 INFO:tasks.workunit.client.0.smithi071.stdout:9/738: chown d0/db/d1b/d1d/d4b/db9/fce 20 1 2024-09-10T10:04:18.999 INFO:tasks.workunit.client.1.smithi107.stdout:4/592: rename d0/d40/d75/l35 to d0/d1f/d20/d47/dbe/lc7 0 2024-09-10T10:04:18.999 INFO:tasks.workunit.client.0.smithi071.stdout:1/484: mkdir d1/d21/d2f/d30/d6a/d91/d9d 0 2024-09-10T10:04:19.001 INFO:tasks.workunit.client.1.smithi107.stdout:3/902: rmdir dc/dd/d45/d26/d41/d44/d35/d4a/dd8 39 2024-09-10T10:04:19.001 INFO:tasks.workunit.client.0.smithi071.stdout:9/739: chown d0/db/d1b/d1d/d4b/dad/l53 127722824 1 2024-09-10T10:04:19.002 INFO:tasks.workunit.client.0.smithi071.stdout:2/502: link d8/d24/d7f/fa6 d8/d38/d8d/fa7 0 2024-09-10T10:04:19.002 INFO:tasks.workunit.client.0.smithi071.stdout:8/468: readlink d5/df/d1e/d70/l7d 0 2024-09-10T10:04:19.002 INFO:tasks.workunit.client.0.smithi071.stdout:1/485: rmdir d1/d21/d2f/d30/d6a 39 2024-09-10T10:04:19.002 INFO:tasks.workunit.client.0.smithi071.stdout:9/740: dread - d0/d3b/d5c/fd4 zero size 2024-09-10T10:04:19.003 INFO:tasks.workunit.client.1.smithi107.stdout:3/903: symlink dc/dd/d45/d26/d41/d74/d114/l12d 0 2024-09-10T10:04:19.004 INFO:tasks.workunit.client.1.smithi107.stdout:4/593: write d0/d40/fb2 [1030352,39259] 0 2024-09-10T10:04:19.004 INFO:tasks.workunit.client.0.smithi071.stdout:1/486: dread - d1/d21/d2f/d81/f8d zero size 2024-09-10T10:04:19.005 INFO:tasks.workunit.client.0.smithi071.stdout:2/503: symlink d8/d38/d47/d59/la8 0 2024-09-10T10:04:19.007 INFO:tasks.workunit.client.0.smithi071.stdout:8/469: symlink d5/df/d67/la2 0 2024-09-10T10:04:19.007 INFO:tasks.workunit.client.1.smithi107.stdout:4/594: mknod d0/d1f/d90/cc8 0 2024-09-10T10:04:19.009 INFO:tasks.workunit.client.0.smithi071.stdout:2/504: rmdir d8/d87/d33/d41/d4d/d5e 39 2024-09-10T10:04:19.012 INFO:tasks.workunit.client.1.smithi107.stdout:4/595: rename d0/d1f/d90/f94 to d0/d40/db3/fc9 0 2024-09-10T10:04:19.012 INFO:tasks.workunit.client.0.smithi071.stdout:8/470: stat d5/df/d1d/d86/d75/f8b 0 2024-09-10T10:04:19.012 INFO:tasks.workunit.client.0.smithi071.stdout:1/487: mkdir d1/d21/d2f/d30/d6a/d91/d9e 0 2024-09-10T10:04:19.013 INFO:tasks.workunit.client.0.smithi071.stdout:2/505: creat d8/d38/d47/fa9 x:0 0 0 2024-09-10T10:04:19.013 INFO:tasks.workunit.client.1.smithi107.stdout:4/596: creat d0/d6b/fca x:0 0 0 2024-09-10T10:04:19.014 INFO:tasks.workunit.client.0.smithi071.stdout:9/741: rmdir d0/db/d1b/d1d/d4b/db9/de0 0 2024-09-10T10:04:19.014 INFO:tasks.workunit.client.1.smithi107.stdout:4/597: dread - d0/d1f/f55 zero size 2024-09-10T10:04:19.015 INFO:tasks.workunit.client.0.smithi071.stdout:1/488: chown d1/d21/d2f/d30/l3b 12878532 1 2024-09-10T10:04:19.016 INFO:tasks.workunit.client.0.smithi071.stdout:8/471: rename d5/df/d1e/d38/d62/c88 to d5/d36/d49/ca3 0 2024-09-10T10:04:19.016 INFO:tasks.workunit.client.0.smithi071.stdout:9/742: read - d0/db/d1b/d1d/d4b/db9/fc1 zero size 2024-09-10T10:04:19.016 INFO:tasks.workunit.client.0.smithi071.stdout:1/489: fsync d1/d21/d2f/d30/d6a/d91/f9c 0 2024-09-10T10:04:19.016 INFO:tasks.workunit.client.0.smithi071.stdout:2/506: creat d8/d87/d51/faa x:0 0 0 2024-09-10T10:04:19.017 INFO:tasks.workunit.client.1.smithi107.stdout:4/598: rename d0/d40/fad to d0/d6b/fcb 0 2024-09-10T10:04:19.018 INFO:tasks.workunit.client.0.smithi071.stdout:2/507: chown d8/d87/c2f 104849408 1 2024-09-10T10:04:19.019 INFO:tasks.workunit.client.0.smithi071.stdout:2/508: fdatasync d8/d87/f76 0 2024-09-10T10:04:19.020 INFO:tasks.workunit.client.0.smithi071.stdout:9/743: read d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f6b [1750364,9640] 0 2024-09-10T10:04:19.021 INFO:tasks.workunit.client.0.smithi071.stdout:2/509: creat d8/d4a/fab x:0 0 0 2024-09-10T10:04:19.022 INFO:tasks.workunit.client.0.smithi071.stdout:9/744: stat d0/db/d1b/d1d/d5b 0 2024-09-10T10:04:19.022 INFO:tasks.workunit.client.1.smithi107.stdout:3/904: dwrite dc/dd/d45/d26/d41/d44/d35/d4a/dd8/de0/f124 [0,4194304] 0 2024-09-10T10:04:19.023 INFO:tasks.workunit.client.0.smithi071.stdout:1/490: rename d1/l7 to d1/d21/d2f/d30/d6a/d91/d9e/l9f 0 2024-09-10T10:04:19.023 INFO:tasks.workunit.client.1.smithi107.stdout:4/599: rename d0/d40/d57/d76/d77/d8d/fc3 to d0/d40/d75/fcc 0 2024-09-10T10:04:19.024 INFO:tasks.workunit.client.0.smithi071.stdout:1/491: chown d1/d21/d2f/d30/f79 26 1 2024-09-10T10:04:19.024 INFO:tasks.workunit.client.0.smithi071.stdout:9/745: read d0/db/d1b/d1d/d30/d54/f94 [330208,117826] 0 2024-09-10T10:04:19.025 INFO:tasks.workunit.client.1.smithi107.stdout:3/905: getdents dc/dd/d45/d26/d41/d44/d12a 0 2024-09-10T10:04:19.027 INFO:tasks.workunit.client.1.smithi107.stdout:4/600: chown d0/d40/ca5 248 1 2024-09-10T10:04:19.029 INFO:tasks.workunit.client.0.smithi071.stdout:1/492: write d1/d21/f98 [431234,84086] 0 2024-09-10T10:04:19.029 INFO:tasks.workunit.client.0.smithi071.stdout:9/746: unlink d0/d3b/f86 0 2024-09-10T10:04:19.030 INFO:tasks.workunit.client.1.smithi107.stdout:3/906: rename dc/dd/d20/d23/d39/fa3 to dc/dd/d20/d23/df3/d110/f12e 0 2024-09-10T10:04:19.031 INFO:tasks.workunit.client.0.smithi071.stdout:2/510: mkdir d8/d87/d33/d41/d4d/d5e/dac 0 2024-09-10T10:04:19.031 INFO:tasks.workunit.client.0.smithi071.stdout:8/472: dread d5/df/f5f [0,4194304] 0 2024-09-10T10:04:19.033 INFO:tasks.workunit.client.0.smithi071.stdout:8/473: write d5/d36/d49/f4f [522382,90397] 0 2024-09-10T10:04:19.033 INFO:tasks.workunit.client.1.smithi107.stdout:3/907: mkdir dc/dd/d45/d26/d41/d44/d35/d4a/de1/de7/d12f 0 2024-09-10T10:04:19.034 INFO:tasks.workunit.client.0.smithi071.stdout:2/511: mkdir d8/d87/dad 0 2024-09-10T10:04:19.036 INFO:tasks.workunit.client.0.smithi071.stdout:8/474: creat d5/df/d95/fa4 x:0 0 0 2024-09-10T10:04:19.037 INFO:tasks.workunit.client.0.smithi071.stdout:9/747: dread d0/f6 [0,4194304] 0 2024-09-10T10:04:19.039 INFO:tasks.workunit.client.0.smithi071.stdout:8/475: creat d5/df/d1d/fa5 x:0 0 0 2024-09-10T10:04:19.039 INFO:tasks.workunit.client.1.smithi107.stdout:3/908: link dc/dd/d45/d26/d41/d44/fb8 dc/dd/d45/d26/d41/d44/d35/d4a/f130 0 2024-09-10T10:04:19.041 INFO:tasks.workunit.client.1.smithi107.stdout:4/601: dread d0/f14 [0,4194304] 0 2024-09-10T10:04:19.041 INFO:tasks.workunit.client.1.smithi107.stdout:3/909: truncate dc/dd/d20/d23/d2f/d9c/f109 1019703 0 2024-09-10T10:04:19.042 INFO:tasks.workunit.client.0.smithi071.stdout:9/748: dread d0/db/d1b/d1d/d4b/f4c [0,4194304] 0 2024-09-10T10:04:19.042 INFO:tasks.workunit.client.0.smithi071.stdout:8/476: creat d5/df/d1d/d81/fa6 x:0 0 0 2024-09-10T10:04:19.043 INFO:tasks.workunit.client.0.smithi071.stdout:1/493: write d1/d70/f7b [1200980,61699] 0 2024-09-10T10:04:19.043 INFO:tasks.workunit.client.1.smithi107.stdout:4/602: creat d0/d1f/d20/fcd x:0 0 0 2024-09-10T10:04:19.043 INFO:tasks.workunit.client.0.smithi071.stdout:8/477: mkdir d5/d36/da7 0 2024-09-10T10:04:19.044 INFO:tasks.workunit.client.0.smithi071.stdout:9/749: write d0/db/d1b/d1d/d5b/d9f/fc3 [139946,20341] 0 2024-09-10T10:04:19.045 INFO:tasks.workunit.client.1.smithi107.stdout:4/603: truncate d0/d1f/f34 7025455 0 2024-09-10T10:04:19.047 INFO:tasks.workunit.client.1.smithi107.stdout:4/604: write d0/d1f/d20/f2c [3332730,15939] 0 2024-09-10T10:04:19.048 INFO:tasks.workunit.client.1.smithi107.stdout:4/605: readlink d0/d40/d75/l4e 0 2024-09-10T10:04:19.048 INFO:tasks.workunit.client.0.smithi071.stdout:1/494: rename d1/d21/d2f/d30/d75/c89 to d1/d21/d3d/d4a/ca0 0 2024-09-10T10:04:19.051 INFO:tasks.workunit.client.0.smithi071.stdout:8/478: rename d5/l4d to d5/df/d95/la8 0 2024-09-10T10:04:19.051 INFO:tasks.workunit.client.1.smithi107.stdout:4/606: creat d0/d40/d57/fce x:0 0 0 2024-09-10T10:04:19.052 INFO:tasks.workunit.client.1.smithi107.stdout:3/910: dwrite dc/dd/d45/ff0 [0,4194304] 0 2024-09-10T10:04:19.056 INFO:tasks.workunit.client.1.smithi107.stdout:3/911: mkdir dc/dd/d45/d26/d41/d44/d35/d4a/dd8/d131 0 2024-09-10T10:04:19.056 INFO:tasks.workunit.client.1.smithi107.stdout:4/607: dread d0/d40/d57/d76/d77/da1/f4b [0,4194304] 0 2024-09-10T10:04:19.057 INFO:tasks.workunit.client.1.smithi107.stdout:4/608: chown d0/fb 2835390 1 2024-09-10T10:04:19.058 INFO:tasks.workunit.client.1.smithi107.stdout:3/912: mkdir dc/dd/d45/d26/d41/d44/d63/d101/d132 0 2024-09-10T10:04:19.060 INFO:tasks.workunit.client.1.smithi107.stdout:3/913: truncate dc/dd/d45/d26/d41/d74/ffd 949124 0 2024-09-10T10:04:19.061 INFO:tasks.workunit.client.1.smithi107.stdout:4/609: rename d0/d40/d57/d76/d77/da1/d59/c8e to d0/ccf 0 2024-09-10T10:04:19.062 INFO:tasks.workunit.client.1.smithi107.stdout:3/914: creat dc/dd/d42/d55/f133 x:0 0 0 2024-09-10T10:04:19.067 INFO:tasks.workunit.client.1.smithi107.stdout:3/915: dread dc/dd/d42/d55/fb3 [0,4194304] 0 2024-09-10T10:04:19.068 INFO:tasks.workunit.client.1.smithi107.stdout:4/610: write d0/d1f/f60 [42921,3273] 0 2024-09-10T10:04:19.072 INFO:tasks.workunit.client.1.smithi107.stdout:4/611: link d0/d1f/c26 d0/d40/d57/d76/d77/da1/cd0 0 2024-09-10T10:04:19.077 INFO:tasks.workunit.client.1.smithi107.stdout:4/612: dwrite d0/d6b/fcb [0,4194304] 0 2024-09-10T10:04:19.082 INFO:tasks.workunit.client.1.smithi107.stdout:4/613: truncate d0/d40/f68 3288115 0 2024-09-10T10:04:19.084 INFO:tasks.workunit.client.1.smithi107.stdout:4/614: fdatasync d0/fb 0 2024-09-10T10:04:19.085 INFO:tasks.workunit.client.1.smithi107.stdout:4/615: dread - d0/d1f/d20/fc0 zero size 2024-09-10T10:04:19.091 INFO:tasks.workunit.client.1.smithi107.stdout:4/616: dwrite d0/d1f/f55 [0,4194304] 0 2024-09-10T10:04:19.095 INFO:tasks.workunit.client.1.smithi107.stdout:4/617: rename d0/d40/d6d/l87 to d0/d82/ld1 0 2024-09-10T10:04:19.105 INFO:tasks.workunit.client.1.smithi107.stdout:4/618: dwrite d0/d1f/d20/f70 [0,4194304] 0 2024-09-10T10:04:19.109 INFO:tasks.workunit.client.1.smithi107.stdout:4/619: write d0/d1f/d20/f17 [1035365,77563] 0 2024-09-10T10:04:19.112 INFO:tasks.workunit.client.1.smithi107.stdout:4/620: getdents d0/d40/d6d/d8a 0 2024-09-10T10:04:19.122 INFO:tasks.workunit.client.0.smithi071.stdout:3/453: sync 2024-09-10T10:04:19.128 INFO:tasks.workunit.client.1.smithi107.stdout:4/621: dread d0/d82/f91 [0,4194304] 0 2024-09-10T10:04:19.133 INFO:tasks.workunit.client.1.smithi107.stdout:4/622: dwrite d0/d40/f6a [0,4194304] 0 2024-09-10T10:04:19.136 INFO:tasks.workunit.client.1.smithi107.stdout:4/623: unlink d0/c27 0 2024-09-10T10:04:19.138 INFO:tasks.workunit.client.1.smithi107.stdout:4/624: creat d0/d40/db3/fd2 x:0 0 0 2024-09-10T10:04:19.148 INFO:tasks.workunit.client.0.smithi071.stdout:9/750: getdents d0/db/d1b/d1d/d30/dab 0 2024-09-10T10:04:19.148 INFO:tasks.workunit.client.0.smithi071.stdout:1/495: creat d1/d21/d2f/d30/d6a/d91/fa1 x:0 0 0 2024-09-10T10:04:19.150 INFO:tasks.workunit.client.0.smithi071.stdout:3/454: write d3/d1c/d3c/da1/d3a/f68 [309397,115505] 0 2024-09-10T10:04:19.154 INFO:tasks.workunit.client.0.smithi071.stdout:3/455: rename d3/f8 to d3/d1c/d3c/fa2 0 2024-09-10T10:04:19.154 INFO:tasks.workunit.client.0.smithi071.stdout:9/751: getdents d0/db/d1b/d1d/d4b/db9 0 2024-09-10T10:04:19.157 INFO:tasks.workunit.client.0.smithi071.stdout:1/496: dwrite d1/d21/d2f/d30/d6a/f50 [0,4194304] 0 2024-09-10T10:04:19.161 INFO:tasks.workunit.client.0.smithi071.stdout:9/752: rename d0/db/d20/l43 to d0/d3b/d5c/d6a/d96/le4 0 2024-09-10T10:04:19.162 INFO:tasks.workunit.client.0.smithi071.stdout:1/497: mknod d1/d21/d3d/d83/ca2 0 2024-09-10T10:04:19.164 INFO:tasks.workunit.client.0.smithi071.stdout:8/479: dread d5/d36/f6d [0,4194304] 0 2024-09-10T10:04:19.164 INFO:tasks.workunit.client.1.smithi107.stdout:4/625: dread d0/d40/d57/d76/d77/da1/d59/fb1 [0,4194304] 0 2024-09-10T10:04:19.165 INFO:tasks.workunit.client.0.smithi071.stdout:9/753: fdatasync d0/db/d20/d21/f4f 0 2024-09-10T10:04:19.166 INFO:tasks.workunit.client.1.smithi107.stdout:4/626: dread - d0/d1f/d20/fcd zero size 2024-09-10T10:04:19.166 INFO:tasks.workunit.client.1.smithi107.stdout:4/627: readlink d0/d40/d75/l4e 0 2024-09-10T10:04:19.169 INFO:tasks.workunit.client.1.smithi107.stdout:6/543: sync 2024-09-10T10:04:19.170 INFO:tasks.workunit.client.1.smithi107.stdout:9/496: sync 2024-09-10T10:04:19.170 INFO:tasks.workunit.client.1.smithi107.stdout:4/628: creat d0/d40/fd3 x:0 0 0 2024-09-10T10:04:19.170 INFO:tasks.workunit.client.1.smithi107.stdout:6/544: readlink d0/d3d/d14/d17/l66 0 2024-09-10T10:04:19.171 INFO:tasks.workunit.client.0.smithi071.stdout:1/498: truncate d1/d3f/f84 4596583 0 2024-09-10T10:04:19.173 INFO:tasks.workunit.client.1.smithi107.stdout:9/497: mkdir d5/db3 0 2024-09-10T10:04:19.173 INFO:tasks.workunit.client.0.smithi071.stdout:8/480: dwrite d5/f73 [8388608,4194304] 0 2024-09-10T10:04:19.174 INFO:tasks.workunit.client.0.smithi071.stdout:1/499: creat d1/d3f/fa3 x:0 0 0 2024-09-10T10:04:19.175 INFO:tasks.workunit.client.0.smithi071.stdout:9/754: readlink d0/d3b/d5c/d6a/d96/le4 0 2024-09-10T10:04:19.176 INFO:tasks.workunit.client.1.smithi107.stdout:4/629: getdents d0/d40/d57 0 2024-09-10T10:04:19.177 INFO:tasks.workunit.client.0.smithi071.stdout:1/500: dread - d1/d3f/fa3 zero size 2024-09-10T10:04:19.178 INFO:tasks.workunit.client.0.smithi071.stdout:9/755: dread d0/f42 [0,4194304] 0 2024-09-10T10:04:19.178 INFO:tasks.workunit.client.1.smithi107.stdout:4/630: fdatasync d0/d1f/d20/f17 0 2024-09-10T10:04:19.179 INFO:tasks.workunit.client.0.smithi071.stdout:3/456: dwrite d3/d1c/d3c/da1/d42/d4a/f59 [0,4194304] 0 2024-09-10T10:04:19.179 INFO:tasks.workunit.client.1.smithi107.stdout:6/545: dwrite d0/d3d/d14/d17/d49/f92 [0,4194304] 0 2024-09-10T10:04:19.180 INFO:tasks.workunit.client.1.smithi107.stdout:4/631: stat d0/d40/d57/fce 0 2024-09-10T10:04:19.180 INFO:tasks.workunit.client.0.smithi071.stdout:3/457: chown d3/d49/d2f/f93 2380 1 2024-09-10T10:04:19.182 INFO:tasks.workunit.client.0.smithi071.stdout:1/501: creat d1/d35/fa4 x:0 0 0 2024-09-10T10:04:19.184 INFO:tasks.workunit.client.0.smithi071.stdout:3/458: creat d3/d10/fa3 x:0 0 0 2024-09-10T10:04:19.185 INFO:tasks.workunit.client.0.smithi071.stdout:1/502: creat d1/d21/d65/fa5 x:0 0 0 2024-09-10T10:04:19.189 INFO:tasks.workunit.client.0.smithi071.stdout:8/481: link d5/df/d1d/d86/c58 d5/df/d1d/d81/ca9 0 2024-09-10T10:04:19.189 INFO:tasks.workunit.client.0.smithi071.stdout:9/756: write d0/d3b/f48 [3799541,43482] 0 2024-09-10T10:04:19.189 INFO:tasks.workunit.client.1.smithi107.stdout:6/546: creat d0/d76/fb8 x:0 0 0 2024-09-10T10:04:19.190 INFO:tasks.workunit.client.0.smithi071.stdout:3/459: symlink d3/d20/la4 0 2024-09-10T10:04:19.191 INFO:tasks.workunit.client.1.smithi107.stdout:6/547: chown d0/d3d/d14/d17/f36 49101 1 2024-09-10T10:04:19.193 INFO:tasks.workunit.client.0.smithi071.stdout:3/460: readlink d3/d1c/d3c/da1/d5d/l73 0 2024-09-10T10:04:19.193 INFO:tasks.workunit.client.0.smithi071.stdout:9/757: write d0/d3b/d5c/d6a/f99 [2121955,6655] 0 2024-09-10T10:04:19.195 INFO:tasks.workunit.client.0.smithi071.stdout:1/503: dwrite d1/d21/d65/f25 [4194304,4194304] 0 2024-09-10T10:04:19.196 INFO:tasks.workunit.client.1.smithi107.stdout:6/548: fdatasync d0/d3d/d14/d42/f7a 0 2024-09-10T10:04:19.198 INFO:tasks.workunit.client.0.smithi071.stdout:1/504: write d1/d21/d2f/d30/d6a/d91/f9c [1044060,53801] 0 2024-09-10T10:04:19.199 INFO:tasks.workunit.client.0.smithi071.stdout:8/482: rename d5/d36/l5d to d5/df/d1e/d38/laa 0 2024-09-10T10:04:19.200 INFO:tasks.workunit.client.1.smithi107.stdout:4/632: creat d0/d40/d57/d76/fd4 x:0 0 0 2024-09-10T10:04:19.201 INFO:tasks.workunit.client.0.smithi071.stdout:9/758: fdatasync d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f8d 0 2024-09-10T10:04:19.201 INFO:tasks.workunit.client.0.smithi071.stdout:8/483: dread - d5/df/d95/fa4 zero size 2024-09-10T10:04:19.201 INFO:tasks.workunit.client.0.smithi071.stdout:1/505: write d1/d21/d2f/f39 [3140810,117891] 0 2024-09-10T10:04:19.203 INFO:tasks.workunit.client.0.smithi071.stdout:1/506: stat d1/d21/d3d/d9a/d72/c88 0 2024-09-10T10:04:19.204 INFO:tasks.workunit.client.1.smithi107.stdout:6/549: dwrite d0/f13 [0,4194304] 0 2024-09-10T10:04:19.209 INFO:tasks.workunit.client.0.smithi071.stdout:1/507: creat d1/d21/d3d/d4a/fa6 x:0 0 0 2024-09-10T10:04:19.209 INFO:tasks.workunit.client.1.smithi107.stdout:9/498: dwrite d5/d7/d1d/d9b/dab/d57/d87/d27/f60 [0,4194304] 0 2024-09-10T10:04:19.214 INFO:tasks.workunit.client.1.smithi107.stdout:9/499: mkdir d5/d7/d1d/d29/db4 0 2024-09-10T10:04:19.218 INFO:tasks.workunit.client.1.smithi107.stdout:4/633: symlink d0/d1f/d72/ld5 0 2024-09-10T10:04:19.219 INFO:tasks.workunit.client.0.smithi071.stdout:9/759: write d0/db/d20/fde [874284,40446] 0 2024-09-10T10:04:19.219 INFO:tasks.workunit.client.0.smithi071.stdout:1/508: dwrite d1/d21/d2f/d30/f7d [0,4194304] 0 2024-09-10T10:04:19.221 INFO:tasks.workunit.client.1.smithi107.stdout:9/500: mkdir d5/d7/d1d/db5 0 2024-09-10T10:04:19.223 INFO:tasks.workunit.client.0.smithi071.stdout:1/509: mknod d1/d21/d65/ca7 0 2024-09-10T10:04:19.224 INFO:tasks.workunit.client.0.smithi071.stdout:9/760: creat d0/db/d1b/d1d/d30/fe5 x:0 0 0 2024-09-10T10:04:19.225 INFO:tasks.workunit.client.1.smithi107.stdout:4/634: creat d0/d40/d57/fd6 x:0 0 0 2024-09-10T10:04:19.226 INFO:tasks.workunit.client.0.smithi071.stdout:9/761: write d0/db/d1b/d1d/d4b/db9/fc1 [837037,118886] 0 2024-09-10T10:04:19.226 INFO:tasks.workunit.client.0.smithi071.stdout:1/510: fsync d1/d21/d2f/f39 0 2024-09-10T10:04:19.226 INFO:tasks.workunit.client.1.smithi107.stdout:9/501: mkdir d5/d7/d1d/d41/d83/d9a/d8c/db6 0 2024-09-10T10:04:19.228 INFO:tasks.workunit.client.1.smithi107.stdout:9/502: write d5/d7/d3c/fac [353037,101761] 0 2024-09-10T10:04:19.228 INFO:tasks.workunit.client.0.smithi071.stdout:9/762: write d0/db/d1b/d1d/d30/d54/d27/d6e/f92 [446052,45308] 0 2024-09-10T10:04:19.229 INFO:tasks.workunit.client.0.smithi071.stdout:1/511: creat d1/d35/fa8 x:0 0 0 2024-09-10T10:04:19.230 INFO:tasks.workunit.client.0.smithi071.stdout:9/763: fsync d0/db/d1b/d1d/d5b/f70 0 2024-09-10T10:04:19.231 INFO:tasks.workunit.client.1.smithi107.stdout:4/635: dread d0/d1f/d20/f4c [0,4194304] 0 2024-09-10T10:04:19.232 INFO:tasks.workunit.client.0.smithi071.stdout:9/764: fsync d0/f6 0 2024-09-10T10:04:19.233 INFO:tasks.workunit.client.1.smithi107.stdout:9/503: unlink d5/d7/d1d/d3b/c44 0 2024-09-10T10:04:19.234 INFO:tasks.workunit.client.0.smithi071.stdout:1/512: rename d1/d21/d65/ca7 to d1/d21/d2f/d30/d6a/ca9 0 2024-09-10T10:04:19.234 INFO:tasks.workunit.client.0.smithi071.stdout:3/461: dread d3/d10/d24/d2b/f5a [0,4194304] 0 2024-09-10T10:04:19.235 INFO:tasks.workunit.client.0.smithi071.stdout:3/462: chown d3/d1c/d3e/f97 0 1 2024-09-10T10:04:19.235 INFO:tasks.workunit.client.1.smithi107.stdout:9/504: creat d5/d7/d1d/d41/d83/d9a/fb7 x:0 0 0 2024-09-10T10:04:19.236 INFO:tasks.workunit.client.0.smithi071.stdout:3/463: fsync d3/d20/d39/f53 0 2024-09-10T10:04:19.236 INFO:tasks.workunit.client.0.smithi071.stdout:9/765: getdents d0/db/d1b/db4 0 2024-09-10T10:04:19.237 INFO:tasks.workunit.client.0.smithi071.stdout:9/766: readlink d0/db/d1b/d1d/d4b/dad/l81 0 2024-09-10T10:04:19.238 INFO:tasks.workunit.client.0.smithi071.stdout:4/462: sync 2024-09-10T10:04:19.238 INFO:tasks.workunit.client.0.smithi071.stdout:7/571: sync 2024-09-10T10:04:19.238 INFO:tasks.workunit.client.0.smithi071.stdout:0/444: sync 2024-09-10T10:04:19.238 INFO:tasks.workunit.client.0.smithi071.stdout:6/433: sync 2024-09-10T10:04:19.239 INFO:tasks.workunit.client.0.smithi071.stdout:3/464: write d3/d1c/d3c/da1/d42/d4a/f59 [142270,40895] 0 2024-09-10T10:04:19.241 INFO:tasks.workunit.client.0.smithi071.stdout:3/465: chown d3/d1c/d3e/d77 899765 1 2024-09-10T10:04:19.242 INFO:tasks.workunit.client.1.smithi107.stdout:9/505: dwrite d5/d7/d1d/d41/f48 [0,4194304] 0 2024-09-10T10:04:19.242 INFO:tasks.workunit.client.0.smithi071.stdout:1/513: dread d1/d21/d65/f53 [0,4194304] 0 2024-09-10T10:04:19.244 INFO:tasks.workunit.client.1.smithi107.stdout:6/550: dread d0/d3d/d14/d21/f25 [0,4194304] 0 2024-09-10T10:04:19.245 INFO:tasks.workunit.client.0.smithi071.stdout:4/463: creat db/d86/f9a x:0 0 0 2024-09-10T10:04:19.245 INFO:tasks.workunit.client.1.smithi107.stdout:4/636: write d0/d40/d57/fd6 [885982,20447] 0 2024-09-10T10:04:19.246 INFO:tasks.workunit.client.0.smithi071.stdout:7/572: creat d9/d70/fca x:0 0 0 2024-09-10T10:04:19.247 INFO:tasks.workunit.client.1.smithi107.stdout:6/551: mkdir d0/d3d/d14/d21/d8a/db9 0 2024-09-10T10:04:19.248 INFO:tasks.workunit.client.0.smithi071.stdout:3/466: mkdir d3/d1c/d3c/da1/d5d/da5 0 2024-09-10T10:04:19.248 INFO:tasks.workunit.client.0.smithi071.stdout:8/484: dread d5/fd [0,4194304] 0 2024-09-10T10:04:19.248 INFO:tasks.workunit.client.0.smithi071.stdout:0/445: rename d11/d1e/l26 to d11/d22/d31/d72/l9f 0 2024-09-10T10:04:19.249 INFO:tasks.workunit.client.1.smithi107.stdout:4/637: creat d0/d40/d6d/fd7 x:0 0 0 2024-09-10T10:04:19.249 INFO:tasks.workunit.client.0.smithi071.stdout:4/464: read db/d15/d17/f60 [705970,18087] 0 2024-09-10T10:04:19.250 INFO:tasks.workunit.client.0.smithi071.stdout:6/434: symlink d4/da/df/d2e/d3a/d40/d60/l8e 0 2024-09-10T10:04:19.251 INFO:tasks.workunit.client.1.smithi107.stdout:4/638: symlink d0/d40/d75/d53/ld8 0 2024-09-10T10:04:19.252 INFO:tasks.workunit.client.0.smithi071.stdout:6/435: stat d4/d1c/f4d 0 2024-09-10T10:04:19.252 INFO:tasks.workunit.client.0.smithi071.stdout:1/514: mknod d1/d21/d65/caa 0 2024-09-10T10:04:19.252 INFO:tasks.workunit.client.1.smithi107.stdout:9/506: creat d5/d7/fb8 x:0 0 0 2024-09-10T10:04:19.253 INFO:tasks.workunit.client.0.smithi071.stdout:9/767: dread d0/f2e [0,4194304] 0 2024-09-10T10:04:19.253 INFO:tasks.workunit.client.0.smithi071.stdout:8/485: stat d5/df/f5b 0 2024-09-10T10:04:19.254 INFO:tasks.workunit.client.0.smithi071.stdout:4/465: symlink db/d15/d17/d24/l9b 0 2024-09-10T10:04:19.254 INFO:tasks.workunit.client.1.smithi107.stdout:6/552: link d0/l39 d0/d3d/d14/d17/d49/d55/d73/lba 0 2024-09-10T10:04:19.254 INFO:tasks.workunit.client.1.smithi107.stdout:9/507: chown d5/d7/d1d/d9b/dab/d57/cad 1692 1 2024-09-10T10:04:19.255 INFO:tasks.workunit.client.0.smithi071.stdout:4/466: stat db/f55 0 2024-09-10T10:04:19.256 INFO:tasks.workunit.client.0.smithi071.stdout:3/467: creat d3/d1c/d3c/da1/d5d/d9d/fa6 x:0 0 0 2024-09-10T10:04:19.257 INFO:tasks.workunit.client.0.smithi071.stdout:7/573: rename d9/l2f to d9/d2c/d85/lcb 0 2024-09-10T10:04:19.258 INFO:tasks.workunit.client.0.smithi071.stdout:7/574: chown d9/d76/f9a 16852908 1 2024-09-10T10:04:19.259 INFO:tasks.workunit.client.0.smithi071.stdout:3/468: mknod d3/d1c/d3e/d77/ca7 0 2024-09-10T10:04:19.261 INFO:tasks.workunit.client.1.smithi107.stdout:4/639: dread d0/d40/d57/d4f/f61 [0,4194304] 0 2024-09-10T10:04:19.263 INFO:tasks.workunit.client.0.smithi071.stdout:2/512: sync 2024-09-10T10:04:19.263 INFO:tasks.workunit.client.0.smithi071.stdout:5/407: sync 2024-09-10T10:04:19.263 INFO:tasks.workunit.client.0.smithi071.stdout:4/467: fsync db/d15/d17/d24/f8a 0 2024-09-10T10:04:19.263 INFO:tasks.workunit.client.0.smithi071.stdout:0/446: rmdir d11/d22 39 2024-09-10T10:04:19.264 INFO:tasks.workunit.client.0.smithi071.stdout:8/486: dwrite d5/df/d1d/f59 [0,4194304] 0 2024-09-10T10:04:19.264 INFO:tasks.workunit.client.1.smithi107.stdout:9/508: dwrite d5/d7/d3c/fac [0,4194304] 0 2024-09-10T10:04:19.265 INFO:tasks.workunit.client.1.smithi107.stdout:6/553: dwrite d0/d3d/d14/d17/d24/f8e [0,4194304] 0 2024-09-10T10:04:19.266 INFO:tasks.workunit.client.0.smithi071.stdout:2/513: fsync d8/d24/f61 0 2024-09-10T10:04:19.267 INFO:tasks.workunit.client.1.smithi107.stdout:4/640: symlink d0/d40/db3/ld9 0 2024-09-10T10:04:19.268 INFO:tasks.workunit.client.0.smithi071.stdout:4/468: chown db/d15/d4b/f64 63469728 1 2024-09-10T10:04:19.270 INFO:tasks.workunit.client.0.smithi071.stdout:7/575: chown d9/d11/d91/f9e 17 1 2024-09-10T10:04:19.271 INFO:tasks.workunit.client.0.smithi071.stdout:3/469: dwrite d3/d49/d34/f44 [0,4194304] 0 2024-09-10T10:04:19.271 INFO:tasks.workunit.client.1.smithi107.stdout:6/554: rmdir d0/d3d/d14/d17 39 2024-09-10T10:04:19.271 INFO:tasks.workunit.client.1.smithi107.stdout:9/509: rmdir d5/d7/d1d/d41/d83/d9a/d8c 39 2024-09-10T10:04:19.272 INFO:tasks.workunit.client.0.smithi071.stdout:4/469: write db/d15/d17/f75 [74838,92485] 0 2024-09-10T10:04:19.275 INFO:tasks.workunit.client.1.smithi107.stdout:6/555: chown d0/d3d/d14/d17/fa5 904984 1 2024-09-10T10:04:19.277 INFO:tasks.workunit.client.1.smithi107.stdout:4/641: dwrite d0/d40/d6d/f84 [0,4194304] 0 2024-09-10T10:04:19.277 INFO:tasks.workunit.client.0.smithi071.stdout:1/515: truncate d1/d57/f5f 2985399 0 2024-09-10T10:04:19.278 INFO:tasks.workunit.client.0.smithi071.stdout:6/436: link d4/da/df/d2e/d3a/d43/f73 d4/da/df/d2e/d3a/d3e/d5d/f8f 0 2024-09-10T10:04:19.279 INFO:tasks.workunit.client.0.smithi071.stdout:1/516: readlink d1/d21/d2f/d30/l7e 0 2024-09-10T10:04:19.280 INFO:tasks.workunit.client.0.smithi071.stdout:5/408: truncate dc/f13 1102977 0 2024-09-10T10:04:19.282 INFO:tasks.workunit.client.0.smithi071.stdout:9/768: link d0/db/d1b/d1d/d5b/fbc d0/db/d1b/d1d/d5b/d9f/fe6 0 2024-09-10T10:04:19.284 INFO:tasks.workunit.client.0.smithi071.stdout:7/576: dread d9/d15/d55/f6e [0,4194304] 0 2024-09-10T10:04:19.285 INFO:tasks.workunit.client.0.smithi071.stdout:1/517: dread - d1/d21/d2f/d30/f79 zero size 2024-09-10T10:04:19.285 INFO:tasks.workunit.client.1.smithi107.stdout:4/642: symlink d0/d40/d6d/d8a/lda 0 2024-09-10T10:04:19.287 INFO:tasks.workunit.client.1.smithi107.stdout:4/643: chown d0/fa 0 1 2024-09-10T10:04:19.287 INFO:tasks.workunit.client.0.smithi071.stdout:4/470: creat db/d15/d17/d4e/f9c x:0 0 0 2024-09-10T10:04:19.289 INFO:tasks.workunit.client.0.smithi071.stdout:2/514: fdatasync d8/d87/d33/d41/d4d/d52/f9b 0 2024-09-10T10:04:19.290 INFO:tasks.workunit.client.1.smithi107.stdout:4/644: creat d0/d1f/d90/fdb x:0 0 0 2024-09-10T10:04:19.290 INFO:tasks.workunit.client.1.smithi107.stdout:4/645: fdatasync d0/d40/d75/fbd 0 2024-09-10T10:04:19.291 INFO:tasks.workunit.client.0.smithi071.stdout:6/437: rename d4/da/df/d2e/d3a/f68 to d4/da/f90 0 2024-09-10T10:04:19.291 INFO:tasks.workunit.client.0.smithi071.stdout:8/487: creat d5/df/d1d/d81/d9b/fab x:0 0 0 2024-09-10T10:04:19.292 INFO:tasks.workunit.client.0.smithi071.stdout:0/447: dwrite d11/d22/f6f [4194304,4194304] 0 2024-09-10T10:04:19.292 INFO:tasks.workunit.client.0.smithi071.stdout:9/769: creat d0/db/d20/dd8/fe7 x:0 0 0 2024-09-10T10:04:19.293 INFO:tasks.workunit.client.1.smithi107.stdout:4/646: symlink d0/d1f/d5e/ldc 0 2024-09-10T10:04:19.293 INFO:tasks.workunit.client.0.smithi071.stdout:7/577: rmdir d9/d1a/d1d 39 2024-09-10T10:04:19.295 INFO:tasks.workunit.client.0.smithi071.stdout:4/471: symlink db/d15/d17/d24/l9d 0 2024-09-10T10:04:19.295 INFO:tasks.workunit.client.0.smithi071.stdout:0/448: rename d11/d22/d40 to d11/d22/d40/da0 22 2024-09-10T10:04:19.296 INFO:tasks.workunit.client.0.smithi071.stdout:8/488: chown d5/d36/d49/f78 24 1 2024-09-10T10:04:19.297 INFO:tasks.workunit.client.0.smithi071.stdout:9/770: write d0/f6 [3802595,18400] 0 2024-09-10T10:04:19.297 INFO:tasks.workunit.client.0.smithi071.stdout:3/470: link d3/d1c/d3c/da1/d5d/l72 d3/d1c/d3e/la8 0 2024-09-10T10:04:19.297 INFO:tasks.workunit.client.0.smithi071.stdout:2/515: dread d8/d24/f5c [0,4194304] 0 2024-09-10T10:04:19.299 INFO:tasks.workunit.client.1.smithi107.stdout:4/647: dread d0/d6b/f96 [0,4194304] 0 2024-09-10T10:04:19.299 INFO:tasks.workunit.client.0.smithi071.stdout:1/518: symlink d1/d21/d2f/d30/d75/d97/lab 0 2024-09-10T10:04:19.300 INFO:tasks.workunit.client.0.smithi071.stdout:8/489: write d5/df/d1d/f8c [1241762,62629] 0 2024-09-10T10:04:19.301 INFO:tasks.workunit.client.1.smithi107.stdout:4/648: readlink d0/d82/l83 0 2024-09-10T10:04:19.301 INFO:tasks.workunit.client.0.smithi071.stdout:7/578: rmdir d9/d15/d40/d80 39 2024-09-10T10:04:19.302 INFO:tasks.workunit.client.1.smithi107.stdout:9/510: dread d5/d1e/f5b [0,4194304] 0 2024-09-10T10:04:19.302 INFO:tasks.workunit.client.0.smithi071.stdout:5/409: write dc/df/d3e/d5a/d80/f86 [3195428,66919] 0 2024-09-10T10:04:19.303 INFO:tasks.workunit.client.0.smithi071.stdout:4/472: rmdir db/d15/d17 39 2024-09-10T10:04:19.303 INFO:tasks.workunit.client.0.smithi071.stdout:2/516: dread - d8/d87/d51/faa zero size 2024-09-10T10:04:19.304 INFO:tasks.workunit.client.0.smithi071.stdout:0/449: unlink c10 0 2024-09-10T10:04:19.305 INFO:tasks.workunit.client.0.smithi071.stdout:2/517: chown d8/l31 1 1 2024-09-10T10:04:19.305 INFO:tasks.workunit.client.0.smithi071.stdout:5/410: write dc/df/f28 [2164200,53017] 0 2024-09-10T10:04:19.306 INFO:tasks.workunit.client.0.smithi071.stdout:0/450: stat d11/d30/c35 0 2024-09-10T10:04:19.306 INFO:tasks.workunit.client.1.smithi107.stdout:4/649: creat d0/d40/d57/d76/d77/da1/fdd x:0 0 0 2024-09-10T10:04:19.308 INFO:tasks.workunit.client.0.smithi071.stdout:6/438: mkdir d4/da/df/d2e/d3a/d91 0 2024-09-10T10:04:19.309 INFO:tasks.workunit.client.0.smithi071.stdout:5/411: write dc/df/d29/f5f [1820284,123306] 0 2024-09-10T10:04:19.310 INFO:tasks.workunit.client.1.smithi107.stdout:4/650: dread d0/d1f/d20/f30 [0,4194304] 0 2024-09-10T10:04:19.310 INFO:tasks.workunit.client.0.smithi071.stdout:2/518: symlink d8/d38/d47/lae 0 2024-09-10T10:04:19.312 INFO:tasks.workunit.client.1.smithi107.stdout:4/651: mknod d0/d1f/d20/d47/dbe/cde 0 2024-09-10T10:04:19.313 INFO:tasks.workunit.client.0.smithi071.stdout:5/412: dread dc/d53/f60 [0,4194304] 0 2024-09-10T10:04:19.314 INFO:tasks.workunit.client.0.smithi071.stdout:4/473: creat db/d15/f9e x:0 0 0 2024-09-10T10:04:19.315 INFO:tasks.workunit.client.0.smithi071.stdout:6/439: symlink d4/da/df/d2e/d3a/d3e/d5d/l92 0 2024-09-10T10:04:19.315 INFO:tasks.workunit.client.0.smithi071.stdout:8/490: dwrite d5/df/d1e/f21 [0,4194304] 0 2024-09-10T10:04:19.316 INFO:tasks.workunit.client.1.smithi107.stdout:4/652: link d0/d6b/d9d/fc5 d0/d1f/d5e/fdf 0 2024-09-10T10:04:19.318 INFO:tasks.workunit.client.1.smithi107.stdout:4/653: mknod d0/d1f/d5e/ce0 0 2024-09-10T10:04:19.319 INFO:tasks.workunit.client.0.smithi071.stdout:9/771: getdents d0/d3b/d5c/d6a/d96/dda 0 2024-09-10T10:04:19.321 INFO:tasks.workunit.client.1.smithi107.stdout:4/654: fsync d0/f10 0 2024-09-10T10:04:19.321 INFO:tasks.workunit.client.0.smithi071.stdout:8/491: dread - d5/df/d1d/f9a zero size 2024-09-10T10:04:19.322 INFO:tasks.workunit.client.0.smithi071.stdout:6/440: write d4/da/df/d2e/d3a/d3e/d45/f46 [5078118,50436] 0 2024-09-10T10:04:19.325 INFO:tasks.workunit.client.1.smithi107.stdout:4/655: stat d0/d82/ld1 0 2024-09-10T10:04:19.326 INFO:tasks.workunit.client.1.smithi107.stdout:4/656: truncate d0/d40/d75/fbd 527178 0 2024-09-10T10:04:19.328 INFO:tasks.workunit.client.1.smithi107.stdout:9/511: truncate d5/d7/d1d/d9b/dab/d57/d87/d37/f63 1080580 0 2024-09-10T10:04:19.329 INFO:tasks.workunit.client.0.smithi071.stdout:1/519: link d1/cc d1/d21/d2f/d30/d6a/d91/d9d/cac 0 2024-09-10T10:04:19.330 INFO:tasks.workunit.client.1.smithi107.stdout:4/657: rmdir d0/d40/d6d 39 2024-09-10T10:04:19.332 INFO:tasks.workunit.client.0.smithi071.stdout:2/519: dwrite d8/d24/f5c [0,4194304] 0 2024-09-10T10:04:19.334 INFO:tasks.workunit.client.0.smithi071.stdout:6/441: creat d4/d1c/f93 x:0 0 0 2024-09-10T10:04:19.334 INFO:tasks.workunit.client.0.smithi071.stdout:0/451: link d11/d30/d52/c66 d11/d22/d9a/ca1 0 2024-09-10T10:04:19.335 INFO:tasks.workunit.client.0.smithi071.stdout:9/772: getdents d0/db/d1b/db4 0 2024-09-10T10:04:19.335 INFO:tasks.workunit.client.1.smithi107.stdout:4/658: mkdir d0/d40/d6d/d8a/dbb/de1 0 2024-09-10T10:04:19.339 INFO:tasks.workunit.client.0.smithi071.stdout:4/474: dread db/d15/d17/d24/f49 [0,4194304] 0 2024-09-10T10:04:19.339 INFO:tasks.workunit.client.0.smithi071.stdout:1/520: write d1/d21/d2f/d30/f79 [968778,22252] 0 2024-09-10T10:04:19.340 INFO:tasks.workunit.client.0.smithi071.stdout:8/492: link d5/df/d1e/f21 d5/df/d57/fac 0 2024-09-10T10:04:19.340 INFO:tasks.workunit.client.0.smithi071.stdout:2/520: dread d8/d87/d33/d41/d4d/f85 [0,4194304] 0 2024-09-10T10:04:19.340 INFO:tasks.workunit.client.1.smithi107.stdout:4/659: rename d0/d40/d75/d53/ld8 to d0/d1f/d20/d47/dbe/le2 0 2024-09-10T10:04:19.341 INFO:tasks.workunit.client.1.smithi107.stdout:4/660: chown d0/d1f/d20/d47/dbe 99936 1 2024-09-10T10:04:19.342 INFO:tasks.workunit.client.0.smithi071.stdout:3/471: write d3/f21 [134455,75491] 0 2024-09-10T10:04:19.343 INFO:tasks.workunit.client.1.smithi107.stdout:4/661: symlink d0/d1f/d20/d80/le3 0 2024-09-10T10:04:19.344 INFO:tasks.workunit.client.0.smithi071.stdout:7/579: dread d9/d11/f14 [0,4194304] 0 2024-09-10T10:04:19.344 INFO:tasks.workunit.client.0.smithi071.stdout:4/475: readlink db/d15/d26/d43/d4d/l3e 0 2024-09-10T10:04:19.344 INFO:tasks.workunit.client.0.smithi071.stdout:1/521: fdatasync d1/d21/d3d/f4f 0 2024-09-10T10:04:19.345 INFO:tasks.workunit.client.1.smithi107.stdout:4/662: chown d0/d40/d57/d76/d77/da1/la7 116519 1 2024-09-10T10:04:19.345 INFO:tasks.workunit.client.0.smithi071.stdout:6/442: creat d4/da/df/d2e/d3a/d51/f94 x:0 0 0 2024-09-10T10:04:19.346 INFO:tasks.workunit.client.0.smithi071.stdout:7/580: fsync d9/f7f 0 2024-09-10T10:04:19.346 INFO:tasks.workunit.client.1.smithi107.stdout:4/663: dread - d0/d1f/d20/fc0 zero size 2024-09-10T10:04:19.347 INFO:tasks.workunit.client.1.smithi107.stdout:4/664: chown d0/d1f/d20/d47/d8c/fb4 13055928 1 2024-09-10T10:04:19.348 INFO:tasks.workunit.client.0.smithi071.stdout:2/521: creat d8/d38/d47/d59/d65/faf x:0 0 0 2024-09-10T10:04:19.349 INFO:tasks.workunit.client.0.smithi071.stdout:9/773: symlink d0/d3b/d5c/d6a/dd3/de1/le8 0 2024-09-10T10:04:19.350 INFO:tasks.workunit.client.0.smithi071.stdout:5/413: dread dc/df/d17/d22/f7d [0,4194304] 0 2024-09-10T10:04:19.351 INFO:tasks.workunit.client.0.smithi071.stdout:5/414: read - dc/d4a/f74 zero size 2024-09-10T10:04:19.351 INFO:tasks.workunit.client.0.smithi071.stdout:3/472: creat d3/d1c/d3c/da1/fa9 x:0 0 0 2024-09-10T10:04:19.354 INFO:tasks.workunit.client.0.smithi071.stdout:7/581: dwrite d9/d15/d1f/f68 [0,4194304] 0 2024-09-10T10:04:19.356 INFO:tasks.workunit.client.0.smithi071.stdout:1/522: fsync d1/f19 0 2024-09-10T10:04:19.357 INFO:tasks.workunit.client.0.smithi071.stdout:5/415: rename dc/c40 to dc/d53/d6a/c89 0 2024-09-10T10:04:19.357 INFO:tasks.workunit.client.0.smithi071.stdout:1/523: dread - d1/d21/d2f/d30/f55 zero size 2024-09-10T10:04:19.359 INFO:tasks.workunit.client.0.smithi071.stdout:6/443: unlink d4/da/df/l87 0 2024-09-10T10:04:19.360 INFO:tasks.workunit.client.0.smithi071.stdout:2/522: getdents d8/d38/d63 0 2024-09-10T10:04:19.361 INFO:tasks.workunit.client.0.smithi071.stdout:6/444: write d4/da/fb [4637282,6762] 0 2024-09-10T10:04:19.361 INFO:tasks.workunit.client.0.smithi071.stdout:7/582: creat d9/d15/d55/fcc x:0 0 0 2024-09-10T10:04:19.362 INFO:tasks.workunit.client.0.smithi071.stdout:2/523: chown d8/d87/d33/d41/d4d/f8c 25 1 2024-09-10T10:04:19.362 INFO:tasks.workunit.client.0.smithi071.stdout:9/774: mknod d0/db/ce9 0 2024-09-10T10:04:19.366 INFO:tasks.workunit.client.0.smithi071.stdout:6/445: dread d4/da/df/d2e/d3a/d51/d64/f72 [0,4194304] 0 2024-09-10T10:04:19.371 INFO:tasks.workunit.client.0.smithi071.stdout:1/524: read d1/d21/d65/f4e [2021528,57392] 0 2024-09-10T10:04:19.371 INFO:tasks.workunit.client.0.smithi071.stdout:5/416: unlink dc/df/c2d 0 2024-09-10T10:04:19.373 INFO:tasks.workunit.client.0.smithi071.stdout:8/493: dread d5/df/d1d/d86/f17 [0,4194304] 0 2024-09-10T10:04:19.377 INFO:tasks.workunit.client.0.smithi071.stdout:1/525: dwrite d1/f74 [0,4194304] 0 2024-09-10T10:04:19.382 INFO:tasks.workunit.client.0.smithi071.stdout:9/775: dwrite d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/fbd [0,4194304] 0 2024-09-10T10:04:19.386 INFO:tasks.workunit.client.1.smithi107.stdout:4/665: write d0/d40/d6d/f84 [5144771,106219] 0 2024-09-10T10:04:19.386 INFO:tasks.workunit.client.1.smithi107.stdout:4/666: readlink d0/d1f/d20/l3a 0 2024-09-10T10:04:19.388 INFO:tasks.workunit.client.1.smithi107.stdout:4/667: chown d0/d40/d57/d76/d77/d8d/fab 31163 1 2024-09-10T10:04:19.388 INFO:tasks.workunit.client.0.smithi071.stdout:4/476: truncate db/d15/d17/f47 687829 0 2024-09-10T10:04:19.391 INFO:tasks.workunit.client.1.smithi107.stdout:4/668: mknod d0/d40/d57/d76/d77/da1/d59/ce4 0 2024-09-10T10:04:19.393 INFO:tasks.workunit.client.1.smithi107.stdout:4/669: chown d0/f14 1 1 2024-09-10T10:04:19.393 INFO:tasks.workunit.client.0.smithi071.stdout:3/473: getdents d3/d49/d34 0 2024-09-10T10:04:19.393 INFO:tasks.workunit.client.0.smithi071.stdout:3/474: fsync d3/d10/f2d 0 2024-09-10T10:04:19.394 INFO:tasks.workunit.client.0.smithi071.stdout:5/417: mkdir dc/df/d3e/d5a/d80/d8a 0 2024-09-10T10:04:19.395 INFO:tasks.workunit.client.0.smithi071.stdout:6/446: mkdir d4/da/df/d2e/d3a/d3e/d5d/d81/d95 0 2024-09-10T10:04:19.396 INFO:tasks.workunit.client.1.smithi107.stdout:4/670: creat d0/d40/d6d/d8a/dbb/de1/fe5 x:0 0 0 2024-09-10T10:04:19.396 INFO:tasks.workunit.client.0.smithi071.stdout:1/526: creat d1/d21/d3d/d9a/d72/fad x:0 0 0 2024-09-10T10:04:19.397 INFO:tasks.workunit.client.1.smithi107.stdout:4/671: chown d0/d40/d57/d76/d77/da1 130133305 1 2024-09-10T10:04:19.397 INFO:tasks.workunit.client.0.smithi071.stdout:9/776: dread - d0/db/fe2 zero size 2024-09-10T10:04:19.398 INFO:tasks.workunit.client.1.smithi107.stdout:4/672: write d0/d1f/d90/fc1 [606960,64692] 0 2024-09-10T10:04:19.398 INFO:tasks.workunit.client.0.smithi071.stdout:1/527: chown d1/d21/d3d/d4a/c4c 13256 1 2024-09-10T10:04:19.398 INFO:tasks.workunit.client.0.smithi071.stdout:4/477: chown db/c11 0 1 2024-09-10T10:04:19.399 INFO:tasks.workunit.client.0.smithi071.stdout:7/583: unlink d9/d1a/d1d/l6a 0 2024-09-10T10:04:19.399 INFO:tasks.workunit.client.0.smithi071.stdout:4/478: dread - db/d86/f8b zero size 2024-09-10T10:04:19.400 INFO:tasks.workunit.client.0.smithi071.stdout:2/524: rmdir d8/d24/d7c 0 2024-09-10T10:04:19.401 INFO:tasks.workunit.client.1.smithi107.stdout:4/673: truncate d0/d40/d57/f74 5742262 0 2024-09-10T10:04:19.401 INFO:tasks.workunit.client.0.smithi071.stdout:3/475: rmdir d3/d1c/d3c/da1 39 2024-09-10T10:04:19.401 INFO:tasks.workunit.client.0.smithi071.stdout:3/476: fdatasync d3/d10/d24/f25 0 2024-09-10T10:04:19.402 INFO:tasks.workunit.client.1.smithi107.stdout:4/674: chown d0/d40/db3/fd2 83 1 2024-09-10T10:04:19.403 INFO:tasks.workunit.client.0.smithi071.stdout:1/528: creat d1/d21/d2f/d81/fae x:0 0 0 2024-09-10T10:04:19.408 INFO:tasks.workunit.client.0.smithi071.stdout:4/479: unlink db/d15/d17/d4e/d5a/f53 0 2024-09-10T10:04:19.408 INFO:tasks.workunit.client.0.smithi071.stdout:3/477: dwrite d3/f41 [0,4194304] 0 2024-09-10T10:04:19.409 INFO:tasks.workunit.client.0.smithi071.stdout:5/418: symlink dc/d53/d79/l8b 0 2024-09-10T10:04:19.412 INFO:tasks.workunit.client.0.smithi071.stdout:2/525: dwrite d8/f10 [0,4194304] 0 2024-09-10T10:04:19.412 INFO:tasks.workunit.client.0.smithi071.stdout:8/494: rename d5/df/d57/fac to d5/df/fad 0 2024-09-10T10:04:19.413 INFO:tasks.workunit.client.0.smithi071.stdout:2/526: fsync d8/d87/d51/faa 0 2024-09-10T10:04:19.413 INFO:tasks.workunit.client.0.smithi071.stdout:6/447: creat d4/da/df/d2e/d3a/d91/f96 x:0 0 0 2024-09-10T10:04:19.416 INFO:tasks.workunit.client.0.smithi071.stdout:5/419: dread dc/df/f1e [0,4194304] 0 2024-09-10T10:04:19.417 INFO:tasks.workunit.client.0.smithi071.stdout:2/527: write d8/d38/d47/d59/d65/f93 [582957,71099] 0 2024-09-10T10:04:19.419 INFO:tasks.workunit.client.0.smithi071.stdout:2/528: fdatasync d8/d24/f2d 0 2024-09-10T10:04:19.421 INFO:tasks.workunit.client.0.smithi071.stdout:1/529: rename d1/d21/d2f/d30/d6a/d91/d9e to d1/d3f/d58/daf 0 2024-09-10T10:04:19.422 INFO:tasks.workunit.client.0.smithi071.stdout:3/478: getdents d3/d10/d87 0 2024-09-10T10:04:19.424 INFO:tasks.workunit.client.0.smithi071.stdout:1/530: chown d1/d70/d76 1025 1 2024-09-10T10:04:19.426 INFO:tasks.workunit.client.0.smithi071.stdout:8/495: dwrite d5/d36/d49/f4f [0,4194304] 0 2024-09-10T10:04:19.427 INFO:tasks.workunit.client.0.smithi071.stdout:1/531: chown d1/d57/f6b 616 1 2024-09-10T10:04:19.427 INFO:tasks.workunit.client.0.smithi071.stdout:4/480: rename db/d86 to db/d15/d26/d43/d4d/d9f 0 2024-09-10T10:04:19.431 INFO:tasks.workunit.client.0.smithi071.stdout:4/481: mkdir db/da0 0 2024-09-10T10:04:19.432 INFO:tasks.workunit.client.0.smithi071.stdout:3/479: dread d3/d10/d24/f27 [0,4194304] 0 2024-09-10T10:04:19.433 INFO:tasks.workunit.client.0.smithi071.stdout:6/448: dread d4/f27 [0,4194304] 0 2024-09-10T10:04:19.433 INFO:tasks.workunit.client.0.smithi071.stdout:6/449: chown d4/d1c 495034399 1 2024-09-10T10:04:19.434 INFO:tasks.workunit.client.0.smithi071.stdout:1/532: unlink d1/d21/d3d/d83/ca2 0 2024-09-10T10:04:19.434 INFO:tasks.workunit.client.0.smithi071.stdout:6/450: read - d4/d61/f89 zero size 2024-09-10T10:04:19.434 INFO:tasks.workunit.client.0.smithi071.stdout:1/533: dread - d1/d35/fa4 zero size 2024-09-10T10:04:19.435 INFO:tasks.workunit.client.0.smithi071.stdout:4/482: read db/d15/d17/f6f [2140305,40763] 0 2024-09-10T10:04:19.435 INFO:tasks.workunit.client.0.smithi071.stdout:6/451: dread - d4/da/df/d2e/d3a/f66 zero size 2024-09-10T10:04:19.437 INFO:tasks.workunit.client.0.smithi071.stdout:2/529: link d8/d87/c6e d8/d87/d33/d41/d4d/d5e/cb0 0 2024-09-10T10:04:19.438 INFO:tasks.workunit.client.0.smithi071.stdout:7/584: write f2 [5270945,72237] 0 2024-09-10T10:04:19.439 INFO:tasks.workunit.client.0.smithi071.stdout:9/777: write d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f67 [279499,14299] 0 2024-09-10T10:04:19.443 INFO:tasks.workunit.client.0.smithi071.stdout:4/483: write db/d15/d17/d24/f49 [3394524,26328] 0 2024-09-10T10:04:19.443 INFO:tasks.workunit.client.0.smithi071.stdout:7/585: truncate d9/f8f 161077 0 2024-09-10T10:04:19.443 INFO:tasks.workunit.client.0.smithi071.stdout:8/496: link d5/df/d1e/d38/l54 d5/lae 0 2024-09-10T10:04:19.446 INFO:tasks.workunit.client.0.smithi071.stdout:3/480: symlink d3/d1c/d3c/da1/d42/d4a/laa 0 2024-09-10T10:04:19.447 INFO:tasks.workunit.client.0.smithi071.stdout:1/534: dwrite d1/d21/f98 [0,4194304] 0 2024-09-10T10:04:19.447 INFO:tasks.workunit.client.0.smithi071.stdout:9/778: readlink d0/db/d1b/d1d/d4b/dad/la2 0 2024-09-10T10:04:19.448 INFO:tasks.workunit.client.0.smithi071.stdout:3/481: stat d3/f41 0 2024-09-10T10:04:19.452 INFO:tasks.workunit.client.0.smithi071.stdout:6/452: dwrite d4/d1c/f93 [0,4194304] 0 2024-09-10T10:04:19.453 INFO:tasks.workunit.client.0.smithi071.stdout:1/535: read d1/d57/f6b [3638905,38845] 0 2024-09-10T10:04:19.455 INFO:tasks.workunit.client.0.smithi071.stdout:5/420: write dc/d4a/d61/f6f [8135276,61445] 0 2024-09-10T10:04:19.460 INFO:tasks.workunit.client.0.smithi071.stdout:2/530: dwrite d8/f48 [0,4194304] 0 2024-09-10T10:04:19.462 INFO:tasks.workunit.client.0.smithi071.stdout:4/484: symlink db/d1d/d61/la1 0 2024-09-10T10:04:19.464 INFO:tasks.workunit.client.0.smithi071.stdout:6/453: mkdir d4/da/df/d2e/d3a/d3e/d5d/d97 0 2024-09-10T10:04:19.465 INFO:tasks.workunit.client.0.smithi071.stdout:1/536: rename d1/f37 to d1/d35/fb0 0 2024-09-10T10:04:19.466 INFO:tasks.workunit.client.0.smithi071.stdout:2/531: dread - d8/d38/d47/d59/d65/faf zero size 2024-09-10T10:04:19.468 INFO:tasks.workunit.client.0.smithi071.stdout:9/779: dwrite d0/db/d1b/d1d/d30/fe5 [0,4194304] 0 2024-09-10T10:04:19.469 INFO:tasks.workunit.client.0.smithi071.stdout:4/485: write db/d15/d26/d43/d82/f83 [680402,53274] 0 2024-09-10T10:04:19.469 INFO:tasks.workunit.client.0.smithi071.stdout:7/586: link d9/d2c/d49/c89 d9/d15/d40/d80/ccd 0 2024-09-10T10:04:19.472 INFO:tasks.workunit.client.0.smithi071.stdout:1/537: mkdir d1/d21/d2f/d81/db1 0 2024-09-10T10:04:19.475 INFO:tasks.workunit.client.0.smithi071.stdout:4/486: write db/f12 [1770003,22364] 0 2024-09-10T10:04:19.475 INFO:tasks.workunit.client.0.smithi071.stdout:2/532: mknod d8/d38/d99/cb1 0 2024-09-10T10:04:19.476 INFO:tasks.workunit.client.0.smithi071.stdout:7/587: write d9/d1a/f35 [7133652,43600] 0 2024-09-10T10:04:19.476 INFO:tasks.workunit.client.0.smithi071.stdout:8/497: dwrite d5/df/d1e/d38/f99 [0,4194304] 0 2024-09-10T10:04:19.477 INFO:tasks.workunit.client.0.smithi071.stdout:1/538: fsync d1/d35/fb0 0 2024-09-10T10:04:19.480 INFO:tasks.workunit.client.0.smithi071.stdout:3/482: dwrite d3/d20/f2c [0,4194304] 0 2024-09-10T10:04:19.486 INFO:tasks.workunit.client.0.smithi071.stdout:5/421: dread dc/df/d17/f2b [0,4194304] 0 2024-09-10T10:04:19.486 INFO:tasks.workunit.client.0.smithi071.stdout:7/588: symlink d9/d15/lce 0 2024-09-10T10:04:19.488 INFO:tasks.workunit.client.0.smithi071.stdout:9/780: dwrite d0/db/d1b/d1d/d30/f65 [0,4194304] 0 2024-09-10T10:04:19.489 INFO:tasks.workunit.client.0.smithi071.stdout:3/483: mkdir d3/d10/d24/dab 0 2024-09-10T10:04:19.492 INFO:tasks.workunit.client.1.smithi107.stdout:1/628: sync 2024-09-10T10:04:19.492 INFO:tasks.workunit.client.1.smithi107.stdout:2/585: sync 2024-09-10T10:04:19.492 INFO:tasks.workunit.client.1.smithi107.stdout:8/454: sync 2024-09-10T10:04:19.492 INFO:tasks.workunit.client.1.smithi107.stdout:7/467: sync 2024-09-10T10:04:19.492 INFO:tasks.workunit.client.1.smithi107.stdout:5/598: sync 2024-09-10T10:04:19.492 INFO:tasks.workunit.client.1.smithi107.stdout:3/916: sync 2024-09-10T10:04:19.492 INFO:tasks.workunit.client.1.smithi107.stdout:0/496: sync 2024-09-10T10:04:19.492 INFO:tasks.workunit.client.0.smithi071.stdout:8/498: creat d5/df/d1e/d38/d9f/faf x:0 0 0 2024-09-10T10:04:19.494 INFO:tasks.workunit.client.0.smithi071.stdout:3/484: rmdir d3/d1c/d3e/d77 39 2024-09-10T10:04:19.496 INFO:tasks.workunit.client.0.smithi071.stdout:5/422: dread dc/df/f38 [0,4194304] 0 2024-09-10T10:04:19.496 INFO:tasks.workunit.client.0.smithi071.stdout:1/539: rmdir d1/d21/d2f/d81/db1 0 2024-09-10T10:04:19.498 INFO:tasks.workunit.client.0.smithi071.stdout:8/499: stat d5/df/d1e/f21 0 2024-09-10T10:04:19.498 INFO:tasks.workunit.client.0.smithi071.stdout:2/533: getdents d8/d87/d33/d41/d4d 0 2024-09-10T10:04:19.499 INFO:tasks.workunit.client.1.smithi107.stdout:2/586: chown d3/da/df/d20/d36/d4f/d92/f77 0 1 2024-09-10T10:04:19.499 INFO:tasks.workunit.client.1.smithi107.stdout:7/468: symlink d0/d8/d9/d3d/l90 0 2024-09-10T10:04:19.503 INFO:tasks.workunit.client.0.smithi071.stdout:5/423: mknod dc/d4a/d61/c8c 0 2024-09-10T10:04:19.504 INFO:tasks.workunit.client.0.smithi071.stdout:2/534: creat d8/d87/d49/d66/fb2 x:0 0 0 2024-09-10T10:04:19.505 INFO:tasks.workunit.client.0.smithi071.stdout:3/485: dwrite d3/d49/d2f/d7f/f83 [0,4194304] 0 2024-09-10T10:04:19.505 INFO:tasks.workunit.client.0.smithi071.stdout:5/424: readlink dc/df/d17/d22/l85 0 2024-09-10T10:04:19.506 INFO:tasks.workunit.client.1.smithi107.stdout:1/629: dwrite d2/d12/d5a/f73 [0,4194304] 0 2024-09-10T10:04:19.507 INFO:tasks.workunit.client.0.smithi071.stdout:5/425: chown dc/df/d29/f5f 33108 1 2024-09-10T10:04:19.507 INFO:tasks.workunit.client.1.smithi107.stdout:7/469: write d0/d20/f3a [801348,32995] 0 2024-09-10T10:04:19.507 INFO:tasks.workunit.client.0.smithi071.stdout:8/500: fsync d5/df/d1d/f8d 0 2024-09-10T10:04:19.508 INFO:tasks.workunit.client.0.smithi071.stdout:3/486: truncate d3/d49/d2f/f93 692916 0 2024-09-10T10:04:19.510 INFO:tasks.workunit.client.1.smithi107.stdout:1/630: truncate d2/d6/d24/fae 105312 0 2024-09-10T10:04:19.511 INFO:tasks.workunit.client.0.smithi071.stdout:7/589: dread d9/d15/d40/d80/f9d [0,4194304] 0 2024-09-10T10:04:19.512 INFO:tasks.workunit.client.1.smithi107.stdout:2/587: mkdir d3/da/df/d20/d36/d4f/dcc 0 2024-09-10T10:04:19.513 INFO:tasks.workunit.client.1.smithi107.stdout:7/470: rmdir d0/d8/d9/d68 39 2024-09-10T10:04:19.513 INFO:tasks.workunit.client.0.smithi071.stdout:5/426: unlink dc/df/f1e 0 2024-09-10T10:04:19.514 INFO:tasks.workunit.client.1.smithi107.stdout:3/917: dwrite dc/dd/d42/d55/d58/d91/fe4 [0,4194304] 0 2024-09-10T10:04:19.516 INFO:tasks.workunit.client.0.smithi071.stdout:8/501: symlink d5/df/d95/lb0 0 2024-09-10T10:04:19.520 INFO:tasks.workunit.client.0.smithi071.stdout:5/427: mkdir dc/df/d17/d8d 0 2024-09-10T10:04:19.521 INFO:tasks.workunit.client.1.smithi107.stdout:2/588: fsync d3/da/d1e/d40/d8a/d7f/f44 0 2024-09-10T10:04:19.524 INFO:tasks.workunit.client.0.smithi071.stdout:3/487: rename d3/d1c/d3c/da1/d42/d4a/d60/d78/f98 to d3/d1c/d3c/da1/d42/d4a/d60/d78/fac 0 2024-09-10T10:04:19.528 INFO:tasks.workunit.client.1.smithi107.stdout:2/589: write d3/da/df/d20/d36/d4f/d92/f77 [1136267,58823] 0 2024-09-10T10:04:19.528 INFO:tasks.workunit.client.1.smithi107.stdout:7/471: unlink d0/d8/d9/d68/f7d 0 2024-09-10T10:04:19.530 INFO:tasks.workunit.client.0.smithi071.stdout:7/590: dwrite d9/d2c/d4f/f7c [0,4194304] 0 2024-09-10T10:04:19.531 INFO:tasks.workunit.client.0.smithi071.stdout:8/502: dwrite d5/d36/d49/f4f [0,4194304] 0 2024-09-10T10:04:19.532 INFO:tasks.workunit.client.1.smithi107.stdout:8/455: write d5/d8/f34 [1291385,39521] 0 2024-09-10T10:04:19.533 INFO:tasks.workunit.client.0.smithi071.stdout:3/488: truncate d3/d1c/f79 1550094 0 2024-09-10T10:04:19.534 INFO:tasks.workunit.client.0.smithi071.stdout:1/540: write d1/f2e [621918,41724] 0 2024-09-10T10:04:19.537 INFO:tasks.workunit.client.1.smithi107.stdout:5/599: dwrite de/d20/f7c [0,4194304] 0 2024-09-10T10:04:19.537 INFO:tasks.workunit.client.1.smithi107.stdout:3/918: creat dc/dd/f134 x:0 0 0 2024-09-10T10:04:19.539 INFO:tasks.workunit.client.0.smithi071.stdout:8/503: write d5/d36/f39 [1539556,34618] 0 2024-09-10T10:04:19.539 INFO:tasks.workunit.client.1.smithi107.stdout:7/472: mknod d0/d8/d9/d3d/d81/c91 0 2024-09-10T10:04:19.539 INFO:tasks.workunit.client.1.smithi107.stdout:0/497: write d6/d14/f25 [269290,8666] 0 2024-09-10T10:04:19.540 INFO:tasks.workunit.client.0.smithi071.stdout:4/487: dwrite db/d15/d4b/f58 [0,4194304] 0 2024-09-10T10:04:19.542 INFO:tasks.workunit.client.0.smithi071.stdout:3/489: dread - d3/d1c/d3e/d77/f9a zero size 2024-09-10T10:04:19.542 INFO:tasks.workunit.client.1.smithi107.stdout:0/498: stat d6/c36 0 2024-09-10T10:04:19.542 INFO:tasks.workunit.client.0.smithi071.stdout:9/781: dwrite d0/db/d20/d21/f4f [0,4194304] 0 2024-09-10T10:04:19.544 INFO:tasks.workunit.client.1.smithi107.stdout:7/473: dread - d0/d8/d9/d3d/d81/f8a zero size 2024-09-10T10:04:19.546 INFO:tasks.workunit.client.0.smithi071.stdout:3/490: write d3/d1c/d3c/f6f [970663,88344] 0 2024-09-10T10:04:19.546 INFO:tasks.workunit.client.1.smithi107.stdout:1/631: getdents d2/d12/d7e 0 2024-09-10T10:04:19.547 INFO:tasks.workunit.client.0.smithi071.stdout:7/591: mkdir d9/d15/d1f/d74/da1/dcf 0 2024-09-10T10:04:19.548 INFO:tasks.workunit.client.0.smithi071.stdout:1/541: creat d1/d21/d2f/d30/d6a/d91/fb2 x:0 0 0 2024-09-10T10:04:19.549 INFO:tasks.workunit.client.1.smithi107.stdout:1/632: readlink d2/d12/l85 0 2024-09-10T10:04:19.549 INFO:tasks.workunit.client.1.smithi107.stdout:7/474: fsync d0/d8/f18 0 2024-09-10T10:04:19.550 INFO:tasks.workunit.client.1.smithi107.stdout:0/499: fdatasync d6/d8/d2f/d35/d3c/d58/f73 0 2024-09-10T10:04:19.550 INFO:tasks.workunit.client.0.smithi071.stdout:1/542: chown d1/d57/f6b 283952 1 2024-09-10T10:04:19.551 INFO:tasks.workunit.client.1.smithi107.stdout:2/590: creat d3/da/df/d20/d36/fcd x:0 0 0 2024-09-10T10:04:19.553 INFO:tasks.workunit.client.0.smithi071.stdout:8/504: creat d5/df/d1e/d38/fb1 x:0 0 0 2024-09-10T10:04:19.554 INFO:tasks.workunit.client.0.smithi071.stdout:3/491: creat d3/d1c/d3c/d66/fad x:0 0 0 2024-09-10T10:04:19.555 INFO:tasks.workunit.client.1.smithi107.stdout:8/456: dwrite d5/d8/d66/d8b/d18/d4f/f8d [0,4194304] 0 2024-09-10T10:04:19.556 INFO:tasks.workunit.client.1.smithi107.stdout:7/475: write d0/d20/d35/f54 [829404,99799] 0 2024-09-10T10:04:19.557 INFO:tasks.workunit.client.1.smithi107.stdout:2/591: write d3/da/df/d20/d36/fb0 [973865,109508] 0 2024-09-10T10:04:19.557 INFO:tasks.workunit.client.0.smithi071.stdout:1/543: dread d1/d21/d65/f53 [0,4194304] 0 2024-09-10T10:04:19.558 INFO:tasks.workunit.client.1.smithi107.stdout:1/633: dread d2/f4e [0,4194304] 0 2024-09-10T10:04:19.558 INFO:tasks.workunit.client.0.smithi071.stdout:7/592: fdatasync f4 0 2024-09-10T10:04:19.558 INFO:tasks.workunit.client.1.smithi107.stdout:0/500: truncate d6/d5a/d5c/f92 422351 0 2024-09-10T10:04:19.559 INFO:tasks.workunit.client.0.smithi071.stdout:2/535: dwrite d8/d38/d47/d59/f5a [0,4194304] 0 2024-09-10T10:04:19.562 INFO:tasks.workunit.client.1.smithi107.stdout:0/501: write d6/d8/d2f/f33 [3218360,50312] 0 2024-09-10T10:04:19.563 INFO:tasks.workunit.client.1.smithi107.stdout:7/476: rmdir d0/d8/d56/d5d 39 2024-09-10T10:04:19.563 INFO:tasks.workunit.client.0.smithi071.stdout:3/492: mknod d3/d1c/d3c/da1/d42/d4a/d60/cae 0 2024-09-10T10:04:19.564 INFO:tasks.workunit.client.0.smithi071.stdout:5/428: write dc/df/d17/f1f [3154587,123206] 0 2024-09-10T10:04:19.564 INFO:tasks.workunit.client.0.smithi071.stdout:3/493: readlink d3/d20/d8d/l9c 0 2024-09-10T10:04:19.566 INFO:tasks.workunit.client.0.smithi071.stdout:9/782: link d0/db/f15 d0/d3b/d5c/d6a/d96/fea 0 2024-09-10T10:04:19.566 INFO:tasks.workunit.client.0.smithi071.stdout:8/505: symlink d5/df/d74/lb2 0 2024-09-10T10:04:19.567 INFO:tasks.workunit.client.1.smithi107.stdout:8/457: read d5/d8/d5b/f90 [735706,78661] 0 2024-09-10T10:04:19.567 INFO:tasks.workunit.client.1.smithi107.stdout:1/634: creat d2/d12/d94/fc9 x:0 0 0 2024-09-10T10:04:19.568 INFO:tasks.workunit.client.0.smithi071.stdout:1/544: symlink d1/d21/d2f/d30/d6a/d91/lb3 0 2024-09-10T10:04:19.569 INFO:tasks.workunit.client.0.smithi071.stdout:7/593: creat d9/d15/d40/d80/fd0 x:0 0 0 2024-09-10T10:04:19.570 INFO:tasks.workunit.client.1.smithi107.stdout:2/592: creat d3/da/df/d20/d36/d39/fce x:0 0 0 2024-09-10T10:04:19.570 INFO:tasks.workunit.client.0.smithi071.stdout:1/545: fdatasync d1/d57/f6b 0 2024-09-10T10:04:19.571 INFO:tasks.workunit.client.1.smithi107.stdout:7/477: mknod d0/d20/d72/c92 0 2024-09-10T10:04:19.571 INFO:tasks.workunit.client.1.smithi107.stdout:8/458: readlink d5/d8/d2a/l63 0 2024-09-10T10:04:19.572 INFO:tasks.workunit.client.0.smithi071.stdout:9/783: creat d0/db/d1b/d1d/d4b/db9/dba/feb x:0 0 0 2024-09-10T10:04:19.572 INFO:tasks.workunit.client.1.smithi107.stdout:1/635: write d2/f4c [1387382,125576] 0 2024-09-10T10:04:19.573 INFO:tasks.workunit.client.0.smithi071.stdout:7/594: write d9/f7f [3549059,94864] 0 2024-09-10T10:04:19.573 INFO:tasks.workunit.client.0.smithi071.stdout:8/506: mkdir d5/df/d57/d82/db3 0 2024-09-10T10:04:19.574 INFO:tasks.workunit.client.1.smithi107.stdout:8/459: chown d5/d8/d66/d8b/d21/f3c 4643 1 2024-09-10T10:04:19.576 INFO:tasks.workunit.client.0.smithi071.stdout:8/507: chown d5/d36/f65 1 1 2024-09-10T10:04:19.577 INFO:tasks.workunit.client.0.smithi071.stdout:9/784: fsync d0/db/d1b/d1d/d4b/fb3 0 2024-09-10T10:04:19.577 INFO:tasks.workunit.client.1.smithi107.stdout:0/502: dwrite d6/d8/d2f/d2e/d32/f4c [0,4194304] 0 2024-09-10T10:04:19.578 INFO:tasks.workunit.client.0.smithi071.stdout:2/536: dwrite d8/d24/fa5 [0,4194304] 0 2024-09-10T10:04:19.579 INFO:tasks.workunit.client.1.smithi107.stdout:1/636: write d2/d6/d24/fb3 [1006894,63935] 0 2024-09-10T10:04:19.579 INFO:tasks.workunit.client.0.smithi071.stdout:9/785: fsync d0/d3b/d44/f63 0 2024-09-10T10:04:19.582 INFO:tasks.workunit.client.1.smithi107.stdout:2/593: dread d3/da/df/d20/d36/d39/f6e [0,4194304] 0 2024-09-10T10:04:19.584 INFO:tasks.workunit.client.1.smithi107.stdout:0/503: read d6/d8/d2f/d2e/f52 [145982,90755] 0 2024-09-10T10:04:19.586 INFO:tasks.workunit.client.0.smithi071.stdout:9/786: creat d0/db/d1b/db4/fec x:0 0 0 2024-09-10T10:04:19.586 INFO:tasks.workunit.client.0.smithi071.stdout:2/537: creat d8/d87/d33/d41/d56/fb3 x:0 0 0 2024-09-10T10:04:19.588 INFO:tasks.workunit.client.1.smithi107.stdout:1/637: symlink d2/lca 0 2024-09-10T10:04:19.588 INFO:tasks.workunit.client.0.smithi071.stdout:7/595: getdents d9/d15/d1f/d74/d9b 0 2024-09-10T10:04:19.589 INFO:tasks.workunit.client.0.smithi071.stdout:9/787: creat d0/d3b/fed x:0 0 0 2024-09-10T10:04:19.590 INFO:tasks.workunit.client.1.smithi107.stdout:7/478: dwrite d0/d20/f3a [0,4194304] 0 2024-09-10T10:04:19.590 INFO:tasks.workunit.client.0.smithi071.stdout:9/788: fsync d0/d3b/d5c/d6a/d96/dda/d75/f9b 0 2024-09-10T10:04:19.594 INFO:tasks.workunit.client.0.smithi071.stdout:9/789: creat d0/db/d20/d21/fee x:0 0 0 2024-09-10T10:04:19.595 INFO:tasks.workunit.client.1.smithi107.stdout:2/594: rename d3/da/df/d20/f82 to d3/da/df/d20/d36/d4f/dcc/fcf 0 2024-09-10T10:04:19.595 INFO:tasks.workunit.client.1.smithi107.stdout:0/504: symlink d6/d8/d2f/l9a 0 2024-09-10T10:04:19.596 INFO:tasks.workunit.client.1.smithi107.stdout:8/460: dwrite d5/d42/f65 [0,4194304] 0 2024-09-10T10:04:19.597 INFO:tasks.workunit.client.1.smithi107.stdout:7/479: fdatasync d0/d8/d56/d5d/f67 0 2024-09-10T10:04:19.597 INFO:tasks.workunit.client.1.smithi107.stdout:2/595: readlink d3/da/df/d20/d36/d4f/d92/lb4 0 2024-09-10T10:04:19.597 INFO:tasks.workunit.client.1.smithi107.stdout:1/638: unlink d2/d12/d65/d6b/f43 0 2024-09-10T10:04:19.599 INFO:tasks.workunit.client.0.smithi071.stdout:9/790: dread d0/db/d1b/d1d/f1f [0,4194304] 0 2024-09-10T10:04:19.599 INFO:tasks.workunit.client.1.smithi107.stdout:0/505: symlink d6/l9b 0 2024-09-10T10:04:19.600 INFO:tasks.workunit.client.1.smithi107.stdout:1/639: mknod d2/d6/dc6/ccb 0 2024-09-10T10:04:19.601 INFO:tasks.workunit.client.1.smithi107.stdout:0/506: readlink d6/d8/d2f/d2e/d7b/l91 0 2024-09-10T10:04:19.602 INFO:tasks.workunit.client.1.smithi107.stdout:8/461: symlink d5/d8/d66/d8b/d1a/d64/l9f 0 2024-09-10T10:04:19.602 INFO:tasks.workunit.client.0.smithi071.stdout:0/452: sync 2024-09-10T10:04:19.603 INFO:tasks.workunit.client.1.smithi107.stdout:7/480: rename d0/fb to d0/d8/d5c/f93 0 2024-09-10T10:04:19.605 INFO:tasks.workunit.client.1.smithi107.stdout:2/596: mkdir d3/da/df/d20/d36/d39/da3/dd0 0 2024-09-10T10:04:19.606 INFO:tasks.workunit.client.1.smithi107.stdout:7/481: read - d0/d8/d56/f8e zero size 2024-09-10T10:04:19.607 INFO:tasks.workunit.client.1.smithi107.stdout:0/507: fsync f4 0 2024-09-10T10:04:19.609 INFO:tasks.workunit.client.0.smithi071.stdout:4/488: write db/d15/d17/d24/f2b [696961,40199] 0 2024-09-10T10:04:19.610 INFO:tasks.workunit.client.0.smithi071.stdout:9/791: dwrite d0/d3b/d5c/fd4 [0,4194304] 0 2024-09-10T10:04:19.612 INFO:tasks.workunit.client.1.smithi107.stdout:8/462: dread d5/d42/f65 [0,4194304] 0 2024-09-10T10:04:19.612 INFO:tasks.workunit.client.0.smithi071.stdout:4/489: fdatasync db/d15/d26/f91 0 2024-09-10T10:04:19.614 INFO:tasks.workunit.client.0.smithi071.stdout:9/792: chown d0/db/d1b/d1d/d30/faf 61340 1 2024-09-10T10:04:19.615 INFO:tasks.workunit.client.1.smithi107.stdout:2/597: fsync d3/da/df/d20/d36/d4f/f50 0 2024-09-10T10:04:19.615 INFO:tasks.workunit.client.1.smithi107.stdout:3/919: dwrite dc/dd/d45/d26/d41/d44/d35/d4a/fa9 [0,4194304] 0 2024-09-10T10:04:19.616 INFO:tasks.workunit.client.0.smithi071.stdout:0/453: dwrite d11/d22/d31/f92 [0,4194304] 0 2024-09-10T10:04:19.618 INFO:tasks.workunit.client.1.smithi107.stdout:8/463: rmdir d5/d42 39 2024-09-10T10:04:19.620 INFO:tasks.workunit.client.1.smithi107.stdout:2/598: chown d3/da/d66/db7 344 1 2024-09-10T10:04:19.621 INFO:tasks.workunit.client.0.smithi071.stdout:9/793: dread d0/db/d1b/d1d/d4b/f8b [0,4194304] 0 2024-09-10T10:04:19.622 INFO:tasks.workunit.client.0.smithi071.stdout:9/794: chown d0/db/d1b/d1d/d5b/f70 36 1 2024-09-10T10:04:19.624 INFO:tasks.workunit.client.1.smithi107.stdout:1/640: dwrite d2/d35/d7b/d8b/fa2 [0,4194304] 0 2024-09-10T10:04:19.630 INFO:tasks.workunit.client.1.smithi107.stdout:7/482: dwrite d0/d8/d9/d3d/f60 [0,4194304] 0 2024-09-10T10:04:19.632 INFO:tasks.workunit.client.1.smithi107.stdout:2/599: unlink d3/da/d1e/d5f/c7a 0 2024-09-10T10:04:19.633 INFO:tasks.workunit.client.0.smithi071.stdout:1/546: truncate d1/d70/d76/f99 1037687 0 2024-09-10T10:04:19.633 INFO:tasks.workunit.client.0.smithi071.stdout:9/795: dwrite d0/d3b/d44/f5f [0,4194304] 0 2024-09-10T10:04:19.633 INFO:tasks.workunit.client.1.smithi107.stdout:0/508: getdents d6/d8/d2f/d2e/d32 0 2024-09-10T10:04:19.636 INFO:tasks.workunit.client.0.smithi071.stdout:5/429: dwrite dc/f3c [0,4194304] 0 2024-09-10T10:04:19.639 INFO:tasks.workunit.client.0.smithi071.stdout:0/454: getdents d11/d22/d9a 0 2024-09-10T10:04:19.639 INFO:tasks.workunit.client.0.smithi071.stdout:1/547: chown d1/d70 267649836 1 2024-09-10T10:04:19.639 INFO:tasks.workunit.client.1.smithi107.stdout:1/641: mkdir d2/dcc 0 2024-09-10T10:04:19.640 INFO:tasks.workunit.client.0.smithi071.stdout:5/430: fdatasync dc/d4a/f74 0 2024-09-10T10:04:19.644 INFO:tasks.workunit.client.0.smithi071.stdout:9/796: dread - d0/db/d1b/d1d/fc9 zero size 2024-09-10T10:04:19.644 INFO:tasks.workunit.client.0.smithi071.stdout:1/548: dread - d1/d21/d3d/d4a/fa6 zero size 2024-09-10T10:04:19.648 INFO:tasks.workunit.client.0.smithi071.stdout:0/455: mknod d11/d30/d52/d5f/ca2 0 2024-09-10T10:04:19.649 INFO:tasks.workunit.client.0.smithi071.stdout:5/431: creat dc/d4a/d61/f8e x:0 0 0 2024-09-10T10:04:19.652 INFO:tasks.workunit.client.1.smithi107.stdout:6/556: sync 2024-09-10T10:04:19.652 INFO:tasks.workunit.client.0.smithi071.stdout:1/549: mknod d1/d3f/cb4 0 2024-09-10T10:04:19.652 INFO:tasks.workunit.client.0.smithi071.stdout:3/494: dread d3/fd [4194304,4194304] 0 2024-09-10T10:04:19.652 INFO:tasks.workunit.client.1.smithi107.stdout:1/642: fsync d2/d12/d65/d6b/f6e 0 2024-09-10T10:04:19.653 INFO:tasks.workunit.client.0.smithi071.stdout:7/596: dwrite d9/d76/f42 [0,4194304] 0 2024-09-10T10:04:19.654 INFO:tasks.workunit.client.0.smithi071.stdout:9/797: rmdir d0/db/d1b/d1d/d4b/db9 39 2024-09-10T10:04:19.656 INFO:tasks.workunit.client.0.smithi071.stdout:5/432: creat dc/d4a/d61/f8f x:0 0 0 2024-09-10T10:04:19.657 INFO:tasks.workunit.client.0.smithi071.stdout:1/550: dread - d1/d21/d2f/d81/fae zero size 2024-09-10T10:04:19.657 INFO:tasks.workunit.client.0.smithi071.stdout:8/508: dread d5/df/d1d/d86/f63 [0,4194304] 0 2024-09-10T10:04:19.658 INFO:tasks.workunit.client.1.smithi107.stdout:2/600: write d3/da/df/d20/d36/d4f/f50 [1739343,94102] 0 2024-09-10T10:04:19.658 INFO:tasks.workunit.client.1.smithi107.stdout:8/464: getdents d5/d8/d66/d8b/d18 0 2024-09-10T10:04:19.660 INFO:tasks.workunit.client.0.smithi071.stdout:8/509: write d5/f33 [2906271,121086] 0 2024-09-10T10:04:19.662 INFO:tasks.workunit.client.1.smithi107.stdout:8/465: chown d5/d8/d66/d8b/d21/d83/l33 25222951 1 2024-09-10T10:04:19.663 INFO:tasks.workunit.client.1.smithi107.stdout:1/643: getdents d2/d12/d65/d6b 0 2024-09-10T10:04:19.665 INFO:tasks.workunit.client.0.smithi071.stdout:1/551: symlink d1/lb5 0 2024-09-10T10:04:19.665 INFO:tasks.workunit.client.0.smithi071.stdout:9/798: rmdir d0/db/d1b/d1d/d30 39 2024-09-10T10:04:19.666 INFO:tasks.workunit.client.1.smithi107.stdout:2/601: creat d3/da/d66/fd1 x:0 0 0 2024-09-10T10:04:19.666 INFO:tasks.workunit.client.0.smithi071.stdout:3/495: creat d3/d49/d34/faf x:0 0 0 2024-09-10T10:04:19.667 INFO:tasks.workunit.client.1.smithi107.stdout:1/644: creat d2/d12/d65/d6b/fcd x:0 0 0 2024-09-10T10:04:19.670 INFO:tasks.workunit.client.1.smithi107.stdout:2/602: mknod d3/da/df/d78/cd2 0 2024-09-10T10:04:19.670 INFO:tasks.workunit.client.0.smithi071.stdout:3/496: chown d3/d10/d24/dab 793 1 2024-09-10T10:04:19.671 INFO:tasks.workunit.client.0.smithi071.stdout:1/552: mkdir d1/d21/d3d/d83/db6 0 2024-09-10T10:04:19.673 INFO:tasks.workunit.client.1.smithi107.stdout:7/483: dread d0/d8/dc/d2c/f6e [0,4194304] 0 2024-09-10T10:04:19.674 INFO:tasks.workunit.client.1.smithi107.stdout:7/484: write d0/d8/d56/d5d/f67 [2127093,91258] 0 2024-09-10T10:04:19.675 INFO:tasks.workunit.client.1.smithi107.stdout:2/603: link d3/da/d1e/d5f/d54/f7d d3/da/d1e/d27/fd3 0 2024-09-10T10:04:19.676 INFO:tasks.workunit.client.0.smithi071.stdout:9/799: write d0/db/d1b/db4/fd0 [460885,106911] 0 2024-09-10T10:04:19.676 INFO:tasks.workunit.client.1.smithi107.stdout:3/920: truncate dc/dd/d20/d23/df3/d110/f12e 334753 0 2024-09-10T10:04:19.677 INFO:tasks.workunit.client.1.smithi107.stdout:2/604: stat d3/da/df/d20/d36/d4f/d92/cbb 0 2024-09-10T10:04:19.677 INFO:tasks.workunit.client.0.smithi071.stdout:5/433: dwrite dc/d53/f7f [0,4194304] 0 2024-09-10T10:04:19.678 INFO:tasks.workunit.client.0.smithi071.stdout:1/553: write d1/d35/fa4 [137463,125335] 0 2024-09-10T10:04:19.678 INFO:tasks.workunit.client.1.smithi107.stdout:7/485: write d0/d8/dc/f1f [4979814,111984] 0 2024-09-10T10:04:19.681 INFO:tasks.workunit.client.1.smithi107.stdout:7/486: write d0/d8/f6f [3950056,112156] 0 2024-09-10T10:04:19.682 INFO:tasks.workunit.client.0.smithi071.stdout:4/490: dwrite db/d15/d17/f47 [0,4194304] 0 2024-09-10T10:04:19.682 INFO:tasks.workunit.client.1.smithi107.stdout:7/487: write d0/d8/f18 [5050669,76983] 0 2024-09-10T10:04:19.686 INFO:tasks.workunit.client.1.smithi107.stdout:2/605: symlink d3/da/df/d20/d36/ld4 0 2024-09-10T10:04:19.687 INFO:tasks.workunit.client.0.smithi071.stdout:8/510: dwrite d5/df/d1d/d86/d75/f87 [0,4194304] 0 2024-09-10T10:04:19.688 INFO:tasks.workunit.client.1.smithi107.stdout:8/466: dread d5/d8/d5b/f6f [0,4194304] 0 2024-09-10T10:04:19.689 INFO:tasks.workunit.client.1.smithi107.stdout:0/509: dread d6/d8/d2f/d35/d3c/d58/d69/f88 [0,4194304] 0 2024-09-10T10:04:19.689 INFO:tasks.workunit.client.1.smithi107.stdout:3/921: dwrite dc/dd/d42/d55/d58/d91/f107 [0,4194304] 0 2024-09-10T10:04:19.690 INFO:tasks.workunit.client.0.smithi071.stdout:1/554: creat d1/d35/fb7 x:0 0 0 2024-09-10T10:04:19.692 INFO:tasks.workunit.client.0.smithi071.stdout:4/491: creat db/d15/d26/d43/d4d/fa2 x:0 0 0 2024-09-10T10:04:19.696 INFO:tasks.workunit.client.1.smithi107.stdout:0/510: creat d6/d8/d2f/d2e/d32/f9c x:0 0 0 2024-09-10T10:04:19.697 INFO:tasks.workunit.client.0.smithi071.stdout:1/555: mknod d1/d21/d2f/d30/d6a/d91/cb8 0 2024-09-10T10:04:19.700 INFO:tasks.workunit.client.1.smithi107.stdout:0/511: dread - d6/d8/d2f/d2e/d32/d59/f62 zero size 2024-09-10T10:04:19.701 INFO:tasks.workunit.client.0.smithi071.stdout:3/497: dwrite d3/d1c/d3c/da1/d42/d4a/f95 [0,4194304] 0 2024-09-10T10:04:19.702 INFO:tasks.workunit.client.1.smithi107.stdout:8/467: dwrite d5/d8/d66/d8b/d1a/d64/f6b [0,4194304] 0 2024-09-10T10:04:19.702 INFO:tasks.workunit.client.0.smithi071.stdout:0/456: dread d11/d30/d52/f53 [0,4194304] 0 2024-09-10T10:04:19.703 INFO:tasks.workunit.client.0.smithi071.stdout:1/556: fdatasync d1/d21/d3d/d9a/f5d 0 2024-09-10T10:04:19.703 INFO:tasks.workunit.client.0.smithi071.stdout:8/511: mkdir d5/df/d1d/d86/d90/db4 0 2024-09-10T10:04:19.704 INFO:tasks.workunit.client.1.smithi107.stdout:0/512: write d6/d8/d2f/d2e/f80 [2097487,68828] 0 2024-09-10T10:04:19.707 INFO:tasks.workunit.client.0.smithi071.stdout:1/557: write d1/f74 [3775228,94515] 0 2024-09-10T10:04:19.711 INFO:tasks.workunit.client.1.smithi107.stdout:0/513: creat d6/d8/d2f/d6e/f9d x:0 0 0 2024-09-10T10:04:19.711 INFO:tasks.workunit.client.0.smithi071.stdout:0/457: dread - d11/d30/d70/f8c zero size 2024-09-10T10:04:19.714 INFO:tasks.workunit.client.0.smithi071.stdout:3/498: dwrite d3/d1c/d3c/da1/d42/d4a/f59 [0,4194304] 0 2024-09-10T10:04:19.714 INFO:tasks.workunit.client.1.smithi107.stdout:0/514: truncate d6/d8/d2f/d2e/d32/f5d 303009 0 2024-09-10T10:04:19.714 INFO:tasks.workunit.client.0.smithi071.stdout:5/434: link dc/c83 dc/df/d17/d8d/c90 0 2024-09-10T10:04:19.715 INFO:tasks.workunit.client.1.smithi107.stdout:0/515: fsync d6/d8/f72 0 2024-09-10T10:04:19.716 INFO:tasks.workunit.client.0.smithi071.stdout:4/492: truncate db/d15/d17/f3d 1857359 0 2024-09-10T10:04:19.717 INFO:tasks.workunit.client.1.smithi107.stdout:1/645: dread d2/d12/d65/d6b/f74 [0,4194304] 0 2024-09-10T10:04:19.719 INFO:tasks.workunit.client.0.smithi071.stdout:8/512: creat d5/df/d1e/d38/d9f/fb5 x:0 0 0 2024-09-10T10:04:19.721 INFO:tasks.workunit.client.1.smithi107.stdout:1/646: mkdir d2/d6/d24/dce 0 2024-09-10T10:04:19.722 INFO:tasks.workunit.client.0.smithi071.stdout:4/493: symlink db/d1d/d61/la3 0 2024-09-10T10:04:19.722 INFO:tasks.workunit.client.1.smithi107.stdout:1/647: stat d2/d89/la1 0 2024-09-10T10:04:19.723 INFO:tasks.workunit.client.1.smithi107.stdout:0/516: dwrite d6/d8/d2f/d2e/d32/d59/f67 [0,4194304] 0 2024-09-10T10:04:19.724 INFO:tasks.workunit.client.0.smithi071.stdout:0/458: mknod d11/d30/d52/ca3 0 2024-09-10T10:04:19.724 INFO:tasks.workunit.client.0.smithi071.stdout:8/513: write d5/df/d1d/f9a [905064,7749] 0 2024-09-10T10:04:19.725 INFO:tasks.workunit.client.0.smithi071.stdout:5/435: mknod dc/c91 0 2024-09-10T10:04:19.725 INFO:tasks.workunit.client.0.smithi071.stdout:3/499: dwrite d3/d1c/d3e/f97 [0,4194304] 0 2024-09-10T10:04:19.725 INFO:tasks.workunit.client.0.smithi071.stdout:4/494: stat db/d15/d26/d43/d4d/f78 0 2024-09-10T10:04:19.726 INFO:tasks.workunit.client.1.smithi107.stdout:1/648: write d2/d6/d67/fbb [480222,105775] 0 2024-09-10T10:04:19.727 INFO:tasks.workunit.client.0.smithi071.stdout:5/436: write dc/fe [238848,47663] 0 2024-09-10T10:04:19.727 INFO:tasks.workunit.client.1.smithi107.stdout:7/488: dread d0/f4 [0,4194304] 0 2024-09-10T10:04:19.728 INFO:tasks.workunit.client.0.smithi071.stdout:4/495: dread - db/d15/f94 zero size 2024-09-10T10:04:19.729 INFO:tasks.workunit.client.1.smithi107.stdout:7/489: fsync d0/d8/d5c/d6d/f8c 0 2024-09-10T10:04:19.729 INFO:tasks.workunit.client.1.smithi107.stdout:0/517: mknod d6/d8/d2f/d2e/c9e 0 2024-09-10T10:04:19.730 INFO:tasks.workunit.client.1.smithi107.stdout:1/649: mknod d2/d36/ccf 0 2024-09-10T10:04:19.730 INFO:tasks.workunit.client.0.smithi071.stdout:4/496: chown db/d15/d26/l71 6807157 1 2024-09-10T10:04:19.731 INFO:tasks.workunit.client.1.smithi107.stdout:0/518: readlink d6/d8/d3e/d43/l6d 0 2024-09-10T10:04:19.731 INFO:tasks.workunit.client.0.smithi071.stdout:5/437: write dc/df/f14 [1705635,27618] 0 2024-09-10T10:04:19.732 INFO:tasks.workunit.client.0.smithi071.stdout:1/558: getdents d1/d3f/d58 0 2024-09-10T10:04:19.732 INFO:tasks.workunit.client.0.smithi071.stdout:0/459: chown d11/d30/d52/c63 19 1 2024-09-10T10:04:19.733 INFO:tasks.workunit.client.1.smithi107.stdout:7/490: creat d0/d20/d35/f94 x:0 0 0 2024-09-10T10:04:19.735 INFO:tasks.workunit.client.1.smithi107.stdout:1/650: unlink d2/d6/d67/lb1 0 2024-09-10T10:04:19.735 INFO:tasks.workunit.client.1.smithi107.stdout:0/519: fsync d6/d8/d2f/d2e/f80 0 2024-09-10T10:04:19.738 INFO:tasks.workunit.client.1.smithi107.stdout:0/520: write d6/d8/d2f/d2e/d32/f6c [72995,46721] 0 2024-09-10T10:04:19.739 INFO:tasks.workunit.client.1.smithi107.stdout:3/922: write dc/dd/d42/d55/f68 [44381,73385] 0 2024-09-10T10:04:19.740 INFO:tasks.workunit.client.0.smithi071.stdout:5/438: chown dc/df/d3e/d5a/d80/d8a 7431880 1 2024-09-10T10:04:19.741 INFO:tasks.workunit.client.1.smithi107.stdout:1/651: mknod d2/d36/cd0 0 2024-09-10T10:04:19.741 INFO:tasks.workunit.client.0.smithi071.stdout:4/497: creat db/d15/d26/d43/d4d/d9f/fa4 x:0 0 0 2024-09-10T10:04:19.741 INFO:tasks.workunit.client.1.smithi107.stdout:2/606: dread d3/da/df/d20/d36/d4f/d92/f77 [0,4194304] 0 2024-09-10T10:04:19.743 INFO:tasks.workunit.client.1.smithi107.stdout:2/607: write d3/d21/f3a [1738276,83278] 0 2024-09-10T10:04:19.743 INFO:tasks.workunit.client.0.smithi071.stdout:9/800: dwrite d0/db/d1b/d1d/d5b/f4d [0,4194304] 0 2024-09-10T10:04:19.743 INFO:tasks.workunit.client.1.smithi107.stdout:0/521: symlink d6/d8/d2f/d2e/d7b/l9f 0 2024-09-10T10:04:19.745 INFO:tasks.workunit.client.1.smithi107.stdout:1/652: readlink d2/d12/d65/d6b/l45 0 2024-09-10T10:04:19.746 INFO:tasks.workunit.client.0.smithi071.stdout:4/498: write db/d15/d26/d43/d4d/d9f/f9a [16510,101119] 0 2024-09-10T10:04:19.748 INFO:tasks.workunit.client.1.smithi107.stdout:2/608: rmdir d3/da/df 39 2024-09-10T10:04:19.749 INFO:tasks.workunit.client.1.smithi107.stdout:0/522: mknod d6/d8/d2f/d2e/d32/d56/ca0 0 2024-09-10T10:04:19.750 INFO:tasks.workunit.client.0.smithi071.stdout:1/559: dwrite d1/d3f/f43 [0,4194304] 0 2024-09-10T10:04:19.752 INFO:tasks.workunit.client.1.smithi107.stdout:1/653: mkdir d2/d89/dd1 0 2024-09-10T10:04:19.752 INFO:tasks.workunit.client.1.smithi107.stdout:2/609: creat d3/d21/d79/fd5 x:0 0 0 2024-09-10T10:04:19.752 INFO:tasks.workunit.client.1.smithi107.stdout:1/654: chown d2/d12/d65 443196151 1 2024-09-10T10:04:19.753 INFO:tasks.workunit.client.1.smithi107.stdout:0/523: mkdir d6/d8/d2f/d35/d4f/da1 0 2024-09-10T10:04:19.754 INFO:tasks.workunit.client.1.smithi107.stdout:0/524: chown d6/d8/d3e/d43 271171603 1 2024-09-10T10:04:19.755 INFO:tasks.workunit.client.1.smithi107.stdout:9/512: sync 2024-09-10T10:04:19.755 INFO:tasks.workunit.client.1.smithi107.stdout:4/675: sync 2024-09-10T10:04:19.755 INFO:tasks.workunit.client.1.smithi107.stdout:5/600: sync 2024-09-10T10:04:19.757 INFO:tasks.workunit.client.1.smithi107.stdout:9/513: read - d5/d7/d1d/d9b/dab/f90 zero size 2024-09-10T10:04:19.758 INFO:tasks.workunit.client.1.smithi107.stdout:5/601: write de/d4a/d4e/fa9 [1029343,33376] 0 2024-09-10T10:04:19.760 INFO:tasks.workunit.client.1.smithi107.stdout:0/525: rename d6/f23 to d6/d8/d2f/d2e/d7b/fa2 0 2024-09-10T10:04:19.762 INFO:tasks.workunit.client.1.smithi107.stdout:1/655: dread d2/f6a [0,4194304] 0 2024-09-10T10:04:19.763 INFO:tasks.workunit.client.1.smithi107.stdout:0/526: fsync d6/d8/d3e/d43/f79 0 2024-09-10T10:04:19.764 INFO:tasks.workunit.client.1.smithi107.stdout:4/676: symlink d0/d40/db3/le6 0 2024-09-10T10:04:19.765 INFO:tasks.workunit.client.1.smithi107.stdout:1/656: write d2/d12/d5a/f62 [1269596,66603] 0 2024-09-10T10:04:19.766 INFO:tasks.workunit.client.1.smithi107.stdout:2/610: unlink d3/da/d1e/d40/d8a/d7f/la0 0 2024-09-10T10:04:19.767 INFO:tasks.workunit.client.1.smithi107.stdout:0/527: chown d6/f7 38 1 2024-09-10T10:04:19.769 INFO:tasks.workunit.client.1.smithi107.stdout:4/677: mknod d0/d1f/d5e/ce7 0 2024-09-10T10:04:19.771 INFO:tasks.workunit.client.1.smithi107.stdout:5/602: dwrite de/d20/f91 [0,4194304] 0 2024-09-10T10:04:19.771 INFO:tasks.workunit.client.1.smithi107.stdout:9/514: chown d5/d7/d1d/d9b/dab/d57/d87/c43 272 1 2024-09-10T10:04:19.772 INFO:tasks.workunit.client.1.smithi107.stdout:1/657: creat d2/d6/fd2 x:0 0 0 2024-09-10T10:04:19.779 INFO:tasks.workunit.client.1.smithi107.stdout:4/678: creat d0/d1f/d20/d47/d8c/fe8 x:0 0 0 2024-09-10T10:04:19.779 INFO:tasks.workunit.client.1.smithi107.stdout:7/491: dwrite d0/f2b [0,4194304] 0 2024-09-10T10:04:19.784 INFO:tasks.workunit.client.1.smithi107.stdout:5/603: dwrite f8 [0,4194304] 0 2024-09-10T10:04:19.784 INFO:tasks.workunit.client.1.smithi107.stdout:5/604: stat de/d20/c45 0 2024-09-10T10:04:19.785 INFO:tasks.workunit.client.0.smithi071.stdout:3/500: symlink d3/d1c/d3c/da1/d42/d4a/d60/d78/lb0 0 2024-09-10T10:04:19.787 INFO:tasks.workunit.client.1.smithi107.stdout:2/611: symlink d3/da/df/d20/d36/d39/ld6 0 2024-09-10T10:04:19.788 INFO:tasks.workunit.client.1.smithi107.stdout:2/612: write d3/d21/d79/f7e [11450037,57574] 0 2024-09-10T10:04:19.789 INFO:tasks.workunit.client.1.smithi107.stdout:0/528: truncate d6/f4a 649303 0 2024-09-10T10:04:19.790 INFO:tasks.workunit.client.1.smithi107.stdout:0/529: write d6/d8/d3e/d43/f79 [966793,79977] 0 2024-09-10T10:04:19.791 INFO:tasks.workunit.client.1.smithi107.stdout:1/658: mknod d2/dcc/cd3 0 2024-09-10T10:04:19.791 INFO:tasks.workunit.client.1.smithi107.stdout:5/605: creat de/db3/fd1 x:0 0 0 2024-09-10T10:04:19.792 INFO:tasks.workunit.client.1.smithi107.stdout:0/530: readlink d6/d8/d2f/d35/d4f/l81 0 2024-09-10T10:04:19.793 INFO:tasks.workunit.client.1.smithi107.stdout:0/531: fsync d6/f7 0 2024-09-10T10:04:19.793 INFO:tasks.workunit.client.1.smithi107.stdout:5/606: fsync f1 0 2024-09-10T10:04:19.794 INFO:tasks.workunit.client.1.smithi107.stdout:7/492: mkdir d0/d8/d9/d95 0 2024-09-10T10:04:19.796 INFO:tasks.workunit.client.0.smithi071.stdout:3/501: creat d3/d20/d39/fb1 x:0 0 0 2024-09-10T10:04:19.796 INFO:tasks.workunit.client.1.smithi107.stdout:9/515: symlink d5/d7/d1d/d41/d83/d9a/d8c/db6/lb9 0 2024-09-10T10:04:19.802 INFO:tasks.workunit.client.1.smithi107.stdout:9/516: truncate d5/d7/d1d/d9b/dab/d57/f62 516043 0 2024-09-10T10:04:19.803 INFO:tasks.workunit.client.1.smithi107.stdout:0/532: mkdir d6/d8/d2f/da3 0 2024-09-10T10:04:19.803 INFO:tasks.workunit.client.1.smithi107.stdout:4/679: link d0/c48 d0/d40/d57/d76/d77/ce9 0 2024-09-10T10:04:19.804 INFO:tasks.workunit.client.0.smithi071.stdout:3/502: mkdir d3/d10/d24/d2b/db2 0 2024-09-10T10:04:19.807 INFO:tasks.workunit.client.1.smithi107.stdout:0/533: write d6/d8/d2f/f33 [513977,65970] 0 2024-09-10T10:04:19.807 INFO:tasks.workunit.client.1.smithi107.stdout:7/493: rmdir d0/d20/d35/d87 0 2024-09-10T10:04:19.807 INFO:tasks.workunit.client.0.smithi071.stdout:3/503: mkdir d3/d1c/d3c/da1/d5d/da5/db3 0 2024-09-10T10:04:19.807 INFO:tasks.workunit.client.1.smithi107.stdout:9/517: read d5/d7/d1d/d3b/f4a [1808345,35511] 0 2024-09-10T10:04:19.808 INFO:tasks.workunit.client.0.smithi071.stdout:3/504: write d3/d49/f6c [181750,46124] 0 2024-09-10T10:04:19.809 INFO:tasks.workunit.client.1.smithi107.stdout:7/494: fdatasync d0/d8/d9/ff 0 2024-09-10T10:04:19.809 INFO:tasks.workunit.client.1.smithi107.stdout:9/518: read - d5/d7/d1d/f82 zero size 2024-09-10T10:04:19.810 INFO:tasks.workunit.client.0.smithi071.stdout:3/505: dread - d3/d49/d34/faf zero size 2024-09-10T10:04:19.811 INFO:tasks.workunit.client.1.smithi107.stdout:0/534: unlink d6/d8/d2f/d35/c3b 0 2024-09-10T10:04:19.811 INFO:tasks.workunit.client.0.smithi071.stdout:6/454: sync 2024-09-10T10:04:19.812 INFO:tasks.workunit.client.1.smithi107.stdout:4/680: read d0/d1f/d20/f51 [1313830,118845] 0 2024-09-10T10:04:19.812 INFO:tasks.workunit.client.0.smithi071.stdout:3/506: fdatasync d3/d49/d34/f44 0 2024-09-10T10:04:19.813 INFO:tasks.workunit.client.1.smithi107.stdout:7/495: creat d0/d8/d9/d68/f96 x:0 0 0 2024-09-10T10:04:19.815 INFO:tasks.workunit.client.1.smithi107.stdout:7/496: write d0/d8/f6f [4403183,48699] 0 2024-09-10T10:04:19.815 INFO:tasks.workunit.client.1.smithi107.stdout:9/519: symlink d5/d7/d1d/d9b/dab/lba 0 2024-09-10T10:04:19.816 INFO:tasks.workunit.client.1.smithi107.stdout:9/520: read - d5/d1e/f9f zero size 2024-09-10T10:04:19.816 INFO:tasks.workunit.client.0.smithi071.stdout:6/455: read - d4/da/df/d2e/d3a/d3e/d5d/f76 zero size 2024-09-10T10:04:19.818 INFO:tasks.workunit.client.0.smithi071.stdout:8/514: dwrite d5/df/d1d/f3d [0,4194304] 0 2024-09-10T10:04:19.819 INFO:tasks.workunit.client.0.smithi071.stdout:3/507: truncate d3/d1c/d3c/da1/d3a/f68 867364 0 2024-09-10T10:04:19.819 INFO:tasks.workunit.client.1.smithi107.stdout:4/681: symlink d0/d1f/d90/lea 0 2024-09-10T10:04:19.819 INFO:tasks.workunit.client.0.smithi071.stdout:3/508: stat d3/d10 0 2024-09-10T10:04:19.824 INFO:tasks.workunit.client.0.smithi071.stdout:8/515: symlink d5/df/d1e/d70/lb6 0 2024-09-10T10:04:19.827 INFO:tasks.workunit.client.1.smithi107.stdout:7/497: dwrite d0/d20/d72/f85 [0,4194304] 0 2024-09-10T10:04:19.829 INFO:tasks.workunit.client.0.smithi071.stdout:3/509: fdatasync d3/d1c/d3c/da1/d5d/f90 0 2024-09-10T10:04:19.830 INFO:tasks.workunit.client.0.smithi071.stdout:6/456: dread d4/f19 [0,4194304] 0 2024-09-10T10:04:19.832 INFO:tasks.workunit.client.0.smithi071.stdout:8/516: mkdir d5/df/d1d/d86/db7 0 2024-09-10T10:04:19.832 INFO:tasks.workunit.client.0.smithi071.stdout:3/510: symlink d3/d49/d34/lb4 0 2024-09-10T10:04:19.834 INFO:tasks.workunit.client.1.smithi107.stdout:2/613: truncate d3/f31 734864 0 2024-09-10T10:04:19.836 INFO:tasks.workunit.client.1.smithi107.stdout:4/682: creat d0/d1f/d5e/feb x:0 0 0 2024-09-10T10:04:19.836 INFO:tasks.workunit.client.0.smithi071.stdout:3/511: creat d3/d49/d2f/fb5 x:0 0 0 2024-09-10T10:04:19.836 INFO:tasks.workunit.client.0.smithi071.stdout:8/517: creat d5/d36/d49/fb8 x:0 0 0 2024-09-10T10:04:19.838 INFO:tasks.workunit.client.1.smithi107.stdout:5/607: dwrite de/f5b [0,4194304] 0 2024-09-10T10:04:19.839 INFO:tasks.workunit.client.1.smithi107.stdout:1/659: dwrite d2/d12/d5a/f5c [0,4194304] 0 2024-09-10T10:04:19.839 INFO:tasks.workunit.client.1.smithi107.stdout:0/535: write d6/d8/f9 [6859067,123223] 0 2024-09-10T10:04:19.840 INFO:tasks.workunit.client.1.smithi107.stdout:7/498: read d0/d20/f44 [4176543,92580] 0 2024-09-10T10:04:19.843 INFO:tasks.workunit.client.1.smithi107.stdout:2/614: mknod d3/da/df/cd7 0 2024-09-10T10:04:19.844 INFO:tasks.workunit.client.1.smithi107.stdout:0/536: chown d6/d8/d2f/d2e 0 1 2024-09-10T10:04:19.847 INFO:tasks.workunit.client.1.smithi107.stdout:5/608: creat de/d20/d3d/fd2 x:0 0 0 2024-09-10T10:04:19.851 INFO:tasks.workunit.client.0.smithi071.stdout:8/518: rmdir d5/df/d57/d82/db3 0 2024-09-10T10:04:19.851 INFO:tasks.workunit.client.1.smithi107.stdout:1/660: mkdir d2/d6/dc6/dd4 0 2024-09-10T10:04:19.852 INFO:tasks.workunit.client.1.smithi107.stdout:1/661: stat d2/d12/d7e 0 2024-09-10T10:04:19.855 INFO:tasks.workunit.client.1.smithi107.stdout:4/683: dwrite d0/d40/db3/fd2 [0,4194304] 0 2024-09-10T10:04:19.856 INFO:tasks.workunit.client.0.smithi071.stdout:3/512: link d3/f18 d3/d1c/d3c/da1/d42/d4a/d60/fb6 0 2024-09-10T10:04:19.859 INFO:tasks.workunit.client.1.smithi107.stdout:5/609: creat de/db3/fd3 x:0 0 0 2024-09-10T10:04:19.859 INFO:tasks.workunit.client.1.smithi107.stdout:9/521: write d5/d7/d1d/d9b/dab/d57/f7a [319430,111421] 0 2024-09-10T10:04:19.860 INFO:tasks.workunit.client.1.smithi107.stdout:7/499: rename d0/d8/d9 to d0/d1b/d4d/d69/d97 0 2024-09-10T10:04:19.865 INFO:tasks.workunit.client.1.smithi107.stdout:1/662: dread d2/d35/d7b/d8b/fb6 [0,4194304] 0 2024-09-10T10:04:19.865 INFO:tasks.workunit.client.1.smithi107.stdout:5/610: mkdir de/d20/d3d/dd4 0 2024-09-10T10:04:19.868 INFO:tasks.workunit.client.1.smithi107.stdout:2/615: write f0 [526952,63923] 0 2024-09-10T10:04:19.868 INFO:tasks.workunit.client.0.smithi071.stdout:4/499: rename db/d15/d17/d4e/d5a/f81 to db/d15/d26/d43/fa5 0 2024-09-10T10:04:19.869 INFO:tasks.workunit.client.0.smithi071.stdout:4/500: chown db/f55 19 1 2024-09-10T10:04:19.869 INFO:tasks.workunit.client.1.smithi107.stdout:4/684: fdatasync d0/d40/d57/f33 0 2024-09-10T10:04:19.870 INFO:tasks.workunit.client.0.smithi071.stdout:6/457: dread d4/da/df/d2e/d3a/d3e/f4a [0,4194304] 0 2024-09-10T10:04:19.871 INFO:tasks.workunit.client.1.smithi107.stdout:7/500: rmdir d0/d1b/d4d/d69/d97/d3d/d81 39 2024-09-10T10:04:19.872 INFO:tasks.workunit.client.0.smithi071.stdout:0/460: truncate d11/d22/d31/f49 2092425 0 2024-09-10T10:04:19.873 INFO:tasks.workunit.client.0.smithi071.stdout:0/461: chown d11/d22/d31/c54 101 1 2024-09-10T10:04:19.874 INFO:tasks.workunit.client.0.smithi071.stdout:4/501: mkdir db/d15/d26/d43/d4d/d9f/da6 0 2024-09-10T10:04:19.875 INFO:tasks.workunit.client.1.smithi107.stdout:4/685: readlink d0/d40/d57/d76/d77/da1/la7 0 2024-09-10T10:04:19.875 INFO:tasks.workunit.client.1.smithi107.stdout:2/616: dread - d3/d21/d79/fbd zero size 2024-09-10T10:04:19.876 INFO:tasks.workunit.client.1.smithi107.stdout:9/522: dwrite d5/d7/fb2 [0,4194304] 0 2024-09-10T10:04:19.880 INFO:tasks.workunit.client.1.smithi107.stdout:5/611: link de/d4a/f63 de/d20/d3d/dc0/fd5 0 2024-09-10T10:04:19.882 INFO:tasks.workunit.client.1.smithi107.stdout:7/501: dread d0/d20/f41 [0,4194304] 0 2024-09-10T10:04:19.882 INFO:tasks.workunit.client.1.smithi107.stdout:1/663: link d2/f32 d2/d35/d7b/fd5 0 2024-09-10T10:04:19.884 INFO:tasks.workunit.client.0.smithi071.stdout:0/462: dwrite d11/d22/f91 [0,4194304] 0 2024-09-10T10:04:19.886 INFO:tasks.workunit.client.1.smithi107.stdout:9/523: truncate d5/d7/f9 3058217 0 2024-09-10T10:04:19.886 INFO:tasks.workunit.client.1.smithi107.stdout:2/617: dwrite d3/da/d1e/d40/d8a/d7f/d55/fba [0,4194304] 0 2024-09-10T10:04:19.886 INFO:tasks.workunit.client.0.smithi071.stdout:4/502: dwrite db/d15/d4b/f58 [0,4194304] 0 2024-09-10T10:04:19.886 INFO:tasks.workunit.client.0.smithi071.stdout:3/513: dread d3/d1c/d3c/f82 [0,4194304] 0 2024-09-10T10:04:19.887 INFO:tasks.workunit.client.1.smithi107.stdout:0/537: truncate d6/d8/d2f/d2e/d32/f71 2877275 0 2024-09-10T10:04:19.888 INFO:tasks.workunit.client.1.smithi107.stdout:5/612: creat de/d4a/fd6 x:0 0 0 2024-09-10T10:04:19.889 INFO:tasks.workunit.client.0.smithi071.stdout:4/503: symlink db/la7 0 2024-09-10T10:04:19.890 INFO:tasks.workunit.client.1.smithi107.stdout:5/613: write de/d20/d3d/fd2 [725877,8671] 0 2024-09-10T10:04:19.891 INFO:tasks.workunit.client.1.smithi107.stdout:5/614: fsync de/d20/f7c 0 2024-09-10T10:04:19.893 INFO:tasks.workunit.client.0.smithi071.stdout:3/514: creat d3/d1c/d3c/da1/fb7 x:0 0 0 2024-09-10T10:04:19.893 INFO:tasks.workunit.client.1.smithi107.stdout:7/502: creat d0/d20/d35/f98 x:0 0 0 2024-09-10T10:04:19.895 INFO:tasks.workunit.client.1.smithi107.stdout:4/686: creat d0/d40/fec x:0 0 0 2024-09-10T10:04:19.896 INFO:tasks.workunit.client.0.smithi071.stdout:4/504: creat db/da0/fa8 x:0 0 0 2024-09-10T10:04:19.899 INFO:tasks.workunit.client.0.smithi071.stdout:1/560: rename d1/d57/l77 to d1/d21/lb9 0 2024-09-10T10:04:19.901 INFO:tasks.workunit.client.0.smithi071.stdout:3/515: dwrite d3/d10/fa3 [0,4194304] 0 2024-09-10T10:04:19.902 INFO:tasks.workunit.client.0.smithi071.stdout:3/516: fdatasync d3/d49/f6c 0 2024-09-10T10:04:19.903 INFO:tasks.workunit.client.1.smithi107.stdout:2/618: write d3/da/fc6 [4286218,7672] 0 2024-09-10T10:04:19.903 INFO:tasks.workunit.client.0.smithi071.stdout:3/517: chown d3/d1c/d3c/d66/fad 1279876047 1 2024-09-10T10:04:19.905 INFO:tasks.workunit.client.1.smithi107.stdout:7/503: chown d0/d1b/d4d/d69/d97/d3d/c50 60033122 1 2024-09-10T10:04:19.906 INFO:tasks.workunit.client.1.smithi107.stdout:4/687: read d0/d40/d57/d76/d77/da1/f5b [2419175,47790] 0 2024-09-10T10:04:19.907 INFO:tasks.workunit.client.0.smithi071.stdout:4/505: mknod db/d1d/d7a/ca9 0 2024-09-10T10:04:19.907 INFO:tasks.workunit.client.0.smithi071.stdout:4/506: stat db/d15/d4b/f58 0 2024-09-10T10:04:19.907 INFO:tasks.workunit.client.0.smithi071.stdout:4/507: chown db/c3a 1 1 2024-09-10T10:04:19.908 INFO:tasks.workunit.client.0.smithi071.stdout:4/508: readlink db/l1c 0 2024-09-10T10:04:19.908 INFO:tasks.workunit.client.1.smithi107.stdout:0/538: symlink d6/d8/d2f/d35/d3c/d58/d69/d84/la4 0 2024-09-10T10:04:19.910 INFO:tasks.workunit.client.0.smithi071.stdout:3/518: creat d3/d1c/d3c/da1/d5d/d9d/fb8 x:0 0 0 2024-09-10T10:04:19.913 INFO:tasks.workunit.client.1.smithi107.stdout:5/615: unlink de/d20/d3d/dc0/fd5 0 2024-09-10T10:04:19.913 INFO:tasks.workunit.client.1.smithi107.stdout:1/664: getdents d2/da8 0 2024-09-10T10:04:19.913 INFO:tasks.workunit.client.0.smithi071.stdout:9/801: rename d0/d3b/f90 to d0/db/d1b/d1d/d30/d54/fef 0 2024-09-10T10:04:19.915 INFO:tasks.workunit.client.1.smithi107.stdout:0/539: rename d6/d8/d2f/d35/d4f/da1 to d6/d8/d2f/da3/da5 0 2024-09-10T10:04:19.916 INFO:tasks.workunit.client.1.smithi107.stdout:0/540: readlink d6/d8/d2f/d35/d4f/l81 0 2024-09-10T10:04:19.916 INFO:tasks.workunit.client.1.smithi107.stdout:1/665: mkdir d2/d6/dc6/dd6 0 2024-09-10T10:04:19.916 INFO:tasks.workunit.client.1.smithi107.stdout:2/619: creat d3/da/df/d20/d36/fd8 x:0 0 0 2024-09-10T10:04:19.917 INFO:tasks.workunit.client.1.smithi107.stdout:5/616: creat de/d9c/fd7 x:0 0 0 2024-09-10T10:04:19.919 INFO:tasks.workunit.client.0.smithi071.stdout:9/802: mknod d0/d3b/cf0 0 2024-09-10T10:04:19.920 INFO:tasks.workunit.client.1.smithi107.stdout:1/666: mknod d2/d35/d9c/cd7 0 2024-09-10T10:04:19.921 INFO:tasks.workunit.client.1.smithi107.stdout:0/541: truncate d6/d8/d2f/d2e/d32/f6c 1068458 0 2024-09-10T10:04:19.924 INFO:tasks.workunit.client.0.smithi071.stdout:1/561: getdents d1/d21/d3d/d83 0 2024-09-10T10:04:19.924 INFO:tasks.workunit.client.1.smithi107.stdout:5/617: creat de/d20/fd8 x:0 0 0 2024-09-10T10:04:19.925 INFO:tasks.workunit.client.1.smithi107.stdout:5/618: dread - de/d9c/fd7 zero size 2024-09-10T10:04:19.925 INFO:tasks.workunit.client.1.smithi107.stdout:4/688: dwrite d0/d40/d57/f3e [0,4194304] 0 2024-09-10T10:04:19.928 INFO:tasks.workunit.client.0.smithi071.stdout:9/803: truncate d0/db/d1b/d1d/d30/d54/f94 541385 0 2024-09-10T10:04:19.931 INFO:tasks.workunit.client.0.smithi071.stdout:1/562: rename d1/d21/d2f/d30/d6a/f50 to d1/d21/d2f/d30/d6a/fba 0 2024-09-10T10:04:19.931 INFO:tasks.workunit.client.0.smithi071.stdout:3/519: dread d3/d1c/d3c/f69 [0,4194304] 0 2024-09-10T10:04:19.932 INFO:tasks.workunit.client.1.smithi107.stdout:6/557: sync 2024-09-10T10:04:19.932 INFO:tasks.workunit.client.1.smithi107.stdout:3/923: sync 2024-09-10T10:04:19.932 INFO:tasks.workunit.client.1.smithi107.stdout:8/468: sync 2024-09-10T10:04:19.932 INFO:tasks.workunit.client.1.smithi107.stdout:9/524: dread d5/f31 [0,4194304] 0 2024-09-10T10:04:19.932 INFO:tasks.workunit.client.1.smithi107.stdout:9/525: read - d5/f85 zero size 2024-09-10T10:04:19.932 INFO:tasks.workunit.client.1.smithi107.stdout:2/620: unlink d3/da/d1e/d40/d8a/d7f/d55/d85/f75 0 2024-09-10T10:04:19.933 INFO:tasks.workunit.client.0.smithi071.stdout:3/520: chown d3/d1c/d3c/da1/d5d/l73 158405 1 2024-09-10T10:04:19.936 INFO:tasks.workunit.client.0.smithi071.stdout:3/521: dread d3/d10/d24/f27 [0,4194304] 0 2024-09-10T10:04:19.936 INFO:tasks.workunit.client.0.smithi071.stdout:0/463: rename d11/d22/d31/c81 to d11/d30/d52/ca4 0 2024-09-10T10:04:19.936 INFO:tasks.workunit.client.1.smithi107.stdout:5/619: creat de/d4a/d4e/d89/d99/fd9 x:0 0 0 2024-09-10T10:04:19.937 INFO:tasks.workunit.client.0.smithi071.stdout:1/563: mknod d1/d3f/d58/cbb 0 2024-09-10T10:04:19.938 INFO:tasks.workunit.client.0.smithi071.stdout:9/804: mkdir d0/db/d1b/d1d/d5b/df1 0 2024-09-10T10:04:19.940 INFO:tasks.workunit.client.1.smithi107.stdout:1/667: dwrite d2/d12/d65/d6b/fcd [0,4194304] 0 2024-09-10T10:04:19.940 INFO:tasks.workunit.client.1.smithi107.stdout:8/469: mknod d5/d8/d66/d8b/d1a/ca0 0 2024-09-10T10:04:19.940 INFO:tasks.workunit.client.1.smithi107.stdout:2/621: chown d3/da/df/d20/d36/d4f/d92 1314 1 2024-09-10T10:04:19.941 INFO:tasks.workunit.client.0.smithi071.stdout:9/805: stat d0/c26 0 2024-09-10T10:04:19.941 INFO:tasks.workunit.client.0.smithi071.stdout:3/522: dread d3/d1c/d3c/f69 [0,4194304] 0 2024-09-10T10:04:19.942 INFO:tasks.workunit.client.1.smithi107.stdout:0/542: truncate d6/f4a 1619153 0 2024-09-10T10:04:19.942 INFO:tasks.workunit.client.0.smithi071.stdout:3/523: stat d3/d49/d2f/f35 0 2024-09-10T10:04:19.942 INFO:tasks.workunit.client.0.smithi071.stdout:1/564: mknod d1/d21/d3d/d9a/cbc 0 2024-09-10T10:04:19.944 INFO:tasks.workunit.client.1.smithi107.stdout:9/526: creat d5/d7/d1d/d3b/fbb x:0 0 0 2024-09-10T10:04:19.945 INFO:tasks.workunit.client.1.smithi107.stdout:2/622: fdatasync d3/da/d1e/d40/d8a/d7f/fb9 0 2024-09-10T10:04:19.948 INFO:tasks.workunit.client.1.smithi107.stdout:9/527: chown d5/d1e/f5b 0 1 2024-09-10T10:04:19.949 INFO:tasks.workunit.client.0.smithi071.stdout:4/509: creat db/d1d/faa x:0 0 0 2024-09-10T10:04:19.949 INFO:tasks.workunit.client.1.smithi107.stdout:5/620: mknod de/d4a/d7e/db2/cda 0 2024-09-10T10:04:19.950 INFO:tasks.workunit.client.1.smithi107.stdout:7/504: dread d0/f27 [0,4194304] 0 2024-09-10T10:04:19.952 INFO:tasks.workunit.client.1.smithi107.stdout:7/505: chown d0/d8/d5c/f93 757188 1 2024-09-10T10:04:19.953 INFO:tasks.workunit.client.1.smithi107.stdout:7/506: chown d0/d8/dc/c22 2 1 2024-09-10T10:04:19.953 INFO:tasks.workunit.client.0.smithi071.stdout:4/510: fdatasync db/d15/d17/f6f 0 2024-09-10T10:04:19.954 INFO:tasks.workunit.client.0.smithi071.stdout:3/524: getdents d3/d10/d24/d2b 0 2024-09-10T10:04:19.956 INFO:tasks.workunit.client.0.smithi071.stdout:9/806: dread d0/f2e [0,4194304] 0 2024-09-10T10:04:19.956 INFO:tasks.workunit.client.1.smithi107.stdout:0/543: mknod d6/d8/d2f/d35/d3c/d58/d69/ca6 0 2024-09-10T10:04:19.956 INFO:tasks.workunit.client.1.smithi107.stdout:8/470: dread d5/d8/f34 [0,4194304] 0 2024-09-10T10:04:19.957 INFO:tasks.workunit.client.1.smithi107.stdout:4/689: link d0/d1f/d20/l9e d0/d40/d57/d76/d77/da1/d59/led 0 2024-09-10T10:04:19.957 INFO:tasks.workunit.client.1.smithi107.stdout:0/544: fdatasync d6/d8/d3e/f50 0 2024-09-10T10:04:19.958 INFO:tasks.workunit.client.0.smithi071.stdout:4/511: mknod db/d15/d26/d43/d4d/d9f/da6/cab 0 2024-09-10T10:04:19.959 INFO:tasks.workunit.client.1.smithi107.stdout:5/621: rmdir de/d41 39 2024-09-10T10:04:19.959 INFO:tasks.workunit.client.1.smithi107.stdout:9/528: write d5/f35 [1076303,129859] 0 2024-09-10T10:04:19.959 INFO:tasks.workunit.client.0.smithi071.stdout:4/512: chown db/c16 15 1 2024-09-10T10:04:19.960 INFO:tasks.workunit.client.1.smithi107.stdout:0/545: write d6/d8/f72 [677198,121903] 0 2024-09-10T10:04:19.961 INFO:tasks.workunit.client.0.smithi071.stdout:3/525: rename d3/d49/d2f/d76 to d3/d49/d2f/db9 0 2024-09-10T10:04:19.962 INFO:tasks.workunit.client.1.smithi107.stdout:0/546: chown l5 0 1 2024-09-10T10:04:19.962 INFO:tasks.workunit.client.1.smithi107.stdout:9/529: readlink d5/d7/d1d/d41/d83/d9a/l33 0 2024-09-10T10:04:19.962 INFO:tasks.workunit.client.1.smithi107.stdout:6/558: creat d0/d3d/fbb x:0 0 0 2024-09-10T10:04:19.962 INFO:tasks.workunit.client.0.smithi071.stdout:3/526: readlink d3/d1c/d3c/da1/l6a 0 2024-09-10T10:04:19.963 INFO:tasks.workunit.client.1.smithi107.stdout:1/668: mknod d2/d12/d65/d6b/cd8 0 2024-09-10T10:04:19.964 INFO:tasks.workunit.client.1.smithi107.stdout:9/530: write d5/d1e/f9f [830182,79250] 0 2024-09-10T10:04:19.965 INFO:tasks.workunit.client.0.smithi071.stdout:4/513: creat db/d8f/fac x:0 0 0 2024-09-10T10:04:19.966 INFO:tasks.workunit.client.1.smithi107.stdout:7/507: rename d0/d8/d56/d78 to d0/d99 0 2024-09-10T10:04:19.967 INFO:tasks.workunit.client.0.smithi071.stdout:3/527: mkdir d3/d1c/d3c/da1/d3a/dba 0 2024-09-10T10:04:19.968 INFO:tasks.workunit.client.0.smithi071.stdout:4/514: dread - db/d15/d17/d4e/f5b zero size 2024-09-10T10:04:19.968 INFO:tasks.workunit.client.0.smithi071.stdout:0/464: write d11/f14 [673472,65489] 0 2024-09-10T10:04:19.970 INFO:tasks.workunit.client.1.smithi107.stdout:8/471: rmdir d5/d8/d5b 39 2024-09-10T10:04:19.970 INFO:tasks.workunit.client.0.smithi071.stdout:9/807: dwrite d0/db/d1b/d1d/d4b/db9/fce [0,4194304] 0 2024-09-10T10:04:19.971 INFO:tasks.workunit.client.0.smithi071.stdout:1/565: write d1/d35/f6e [622533,26792] 0 2024-09-10T10:04:19.972 INFO:tasks.workunit.client.0.smithi071.stdout:0/465: fdatasync d11/d30/d52/f53 0 2024-09-10T10:04:19.974 INFO:tasks.workunit.client.0.smithi071.stdout:9/808: chown d0/db/d1b/d1d/d4b/dad/fa3 66141151 1 2024-09-10T10:04:19.975 INFO:tasks.workunit.client.1.smithi107.stdout:4/690: symlink d0/d40/d75/d53/lee 0 2024-09-10T10:04:19.978 INFO:tasks.workunit.client.0.smithi071.stdout:9/809: creat d0/db/d1b/d1d/d5b/d9f/ff2 x:0 0 0 2024-09-10T10:04:19.985 INFO:tasks.workunit.client.0.smithi071.stdout:1/566: dwrite d1/d35/fa8 [0,4194304] 0 2024-09-10T10:04:19.985 INFO:tasks.workunit.client.0.smithi071.stdout:0/466: dwrite d11/d22/f4e [0,4194304] 0 2024-09-10T10:04:19.988 INFO:tasks.workunit.client.1.smithi107.stdout:6/559: dwrite d0/d3d/d14/d17/d4b/f6e [0,4194304] 0 2024-09-10T10:04:19.991 INFO:tasks.workunit.client.0.smithi071.stdout:3/528: dread d3/d1c/d3c/da1/d5d/f90 [4194304,4194304] 0 2024-09-10T10:04:19.996 INFO:tasks.workunit.client.0.smithi071.stdout:3/529: write d3/d10/f84 [1983522,28798] 0 2024-09-10T10:04:19.997 INFO:tasks.workunit.client.1.smithi107.stdout:9/531: fdatasync d5/d7/fe 0 2024-09-10T10:04:19.997 INFO:tasks.workunit.client.1.smithi107.stdout:1/669: read d2/d35/d7b/d8b/fb6 [207560,59831] 0 2024-09-10T10:04:19.998 INFO:tasks.workunit.client.1.smithi107.stdout:3/924: write dc/fca [197496,37477] 0 2024-09-10T10:04:19.998 INFO:tasks.workunit.client.1.smithi107.stdout:7/508: creat d0/d20/d72/f9a x:0 0 0 2024-09-10T10:04:19.999 INFO:tasks.workunit.client.0.smithi071.stdout:3/530: truncate d3/d49/d2f/fb5 585577 0 2024-09-10T10:04:19.999 INFO:tasks.workunit.client.0.smithi071.stdout:0/467: dwrite d11/d30/d70/f8c [0,4194304] 0 2024-09-10T10:04:19.999 INFO:tasks.workunit.client.1.smithi107.stdout:9/532: stat d5/d7/d1d/d3b/l8d 0 2024-09-10T10:04:20.002 INFO:tasks.workunit.client.0.smithi071.stdout:9/810: symlink d0/d3b/d5c/d6a/d96/dda/lf3 0 2024-09-10T10:04:20.002 INFO:tasks.workunit.client.0.smithi071.stdout:0/468: fdatasync d11/f6e 0 2024-09-10T10:04:20.003 INFO:tasks.workunit.client.1.smithi107.stdout:3/925: read dc/dd/d45/d26/d41/d44/d35/d4a/f5a [2069432,91812] 0 2024-09-10T10:04:20.004 INFO:tasks.workunit.client.0.smithi071.stdout:1/567: symlink d1/d57/lbd 0 2024-09-10T10:04:20.006 INFO:tasks.workunit.client.1.smithi107.stdout:4/691: rmdir d0/d40/d75 39 2024-09-10T10:04:20.007 INFO:tasks.workunit.client.0.smithi071.stdout:1/568: mknod d1/d21/d2f/d81/cbe 0 2024-09-10T10:04:20.009 INFO:tasks.workunit.client.0.smithi071.stdout:4/515: dread db/d15/d17/f6f [0,4194304] 0 2024-09-10T10:04:20.017 INFO:tasks.workunit.client.0.smithi071.stdout:3/531: dread d3/d20/f6d [0,4194304] 0 2024-09-10T10:04:20.017 INFO:tasks.workunit.client.0.smithi071.stdout:0/469: dwrite d11/d30/f45 [0,4194304] 0 2024-09-10T10:04:20.018 INFO:tasks.workunit.client.0.smithi071.stdout:4/516: creat db/d15/d26/d43/d4d/fad x:0 0 0 2024-09-10T10:04:20.018 INFO:tasks.workunit.client.1.smithi107.stdout:0/547: creat d6/d65/fa7 x:0 0 0 2024-09-10T10:04:20.018 INFO:tasks.workunit.client.1.smithi107.stdout:4/692: dwrite d0/d40/d57/d76/d77/da1/f5b [0,4194304] 0 2024-09-10T10:04:20.018 INFO:tasks.workunit.client.1.smithi107.stdout:4/693: chown d0/d1f/d5e/ldc 0 1 2024-09-10T10:04:20.019 INFO:tasks.workunit.client.1.smithi107.stdout:5/622: write de/d20/d2b/f39 [1934387,33135] 0 2024-09-10T10:04:20.021 INFO:tasks.workunit.client.0.smithi071.stdout:1/569: dwrite d1/d21/d65/f7a [0,4194304] 0 2024-09-10T10:04:20.022 INFO:tasks.workunit.client.1.smithi107.stdout:5/623: fsync de/f1b 0 2024-09-10T10:04:20.022 INFO:tasks.workunit.client.0.smithi071.stdout:0/470: unlink d11/d30/d52/ca3 0 2024-09-10T10:04:20.024 INFO:tasks.workunit.client.1.smithi107.stdout:0/548: dwrite d6/d8/d2f/d2e/d32/f6c [0,4194304] 0 2024-09-10T10:04:20.024 INFO:tasks.workunit.client.1.smithi107.stdout:3/926: mknod dc/dd/d45/d26/d41/d44/c135 0 2024-09-10T10:04:20.025 INFO:tasks.workunit.client.0.smithi071.stdout:0/471: chown ce 998724019 1 2024-09-10T10:04:20.027 INFO:tasks.workunit.client.0.smithi071.stdout:1/570: unlink d1/d21/d3d/d4a/c62 0 2024-09-10T10:04:20.028 INFO:tasks.workunit.client.0.smithi071.stdout:1/571: fsync d1/f2e 0 2024-09-10T10:04:20.030 INFO:tasks.workunit.client.0.smithi071.stdout:3/532: dwrite d3/d10/fa3 [0,4194304] 0 2024-09-10T10:04:20.031 INFO:tasks.workunit.client.1.smithi107.stdout:2/623: dwrite d3/da/df/d20/fc0 [0,4194304] 0 2024-09-10T10:04:20.032 INFO:tasks.workunit.client.1.smithi107.stdout:8/472: write d5/d8/d5b/f74 [394516,106770] 0 2024-09-10T10:04:20.032 INFO:tasks.workunit.client.1.smithi107.stdout:7/509: mkdir d0/d1b/d9b 0 2024-09-10T10:04:20.035 INFO:tasks.workunit.client.1.smithi107.stdout:6/560: creat d0/d3d/d14/fbc x:0 0 0 2024-09-10T10:04:20.035 INFO:tasks.workunit.client.1.smithi107.stdout:4/694: write d0/d40/d75/f46 [2727749,6624] 0 2024-09-10T10:04:20.038 INFO:tasks.workunit.client.0.smithi071.stdout:3/533: creat d3/d10/d24/dab/fbb x:0 0 0 2024-09-10T10:04:20.041 INFO:tasks.workunit.client.1.smithi107.stdout:0/549: symlink d6/d8/d2f/d35/d3c/d58/d86/la8 0 2024-09-10T10:04:20.042 INFO:tasks.workunit.client.0.smithi071.stdout:0/472: dwrite d11/d30/d52/f53 [0,4194304] 0 2024-09-10T10:04:20.043 INFO:tasks.workunit.client.1.smithi107.stdout:1/670: dwrite d2/d12/d65/d6b/f42 [0,4194304] 0 2024-09-10T10:04:20.046 INFO:tasks.workunit.client.1.smithi107.stdout:3/927: dread - dc/dd/d45/d26/d41/d44/f105 zero size 2024-09-10T10:04:20.046 INFO:tasks.workunit.client.1.smithi107.stdout:5/624: rename de/d4a/d5c/d6d/lc7 to de/d20/d3d/dc0/ldb 0 2024-09-10T10:04:20.047 INFO:tasks.workunit.client.0.smithi071.stdout:1/572: dwrite d1/d21/d3d/f4f [0,4194304] 0 2024-09-10T10:04:20.049 INFO:tasks.workunit.client.1.smithi107.stdout:1/671: fsync d2/d6/d24/f56 0 2024-09-10T10:04:20.050 INFO:tasks.workunit.client.1.smithi107.stdout:7/510: mknod d0/d8/c9c 0 2024-09-10T10:04:20.050 INFO:tasks.workunit.client.0.smithi071.stdout:2/538: sync 2024-09-10T10:04:20.051 INFO:tasks.workunit.client.0.smithi071.stdout:4/517: dread db/d15/d4b/f5f [0,4194304] 0 2024-09-10T10:04:20.053 INFO:tasks.workunit.client.1.smithi107.stdout:6/561: fdatasync d0/d3d/f41 0 2024-09-10T10:04:20.062 INFO:tasks.workunit.client.1.smithi107.stdout:5/625: dwrite de/d20/d3d/fd2 [0,4194304] 0 2024-09-10T10:04:20.062 INFO:tasks.workunit.client.0.smithi071.stdout:4/518: dwrite db/d15/d17/f6f [4194304,4194304] 0 2024-09-10T10:04:20.063 INFO:tasks.workunit.client.1.smithi107.stdout:4/695: dread d0/d1f/d20/f30 [0,4194304] 0 2024-09-10T10:04:20.063 INFO:tasks.workunit.client.0.smithi071.stdout:1/573: mkdir d1/d57/dbf 0 2024-09-10T10:04:20.064 INFO:tasks.workunit.client.1.smithi107.stdout:9/533: dread f3 [0,4194304] 0 2024-09-10T10:04:20.071 INFO:tasks.workunit.client.1.smithi107.stdout:0/550: rename d6/d65 to d6/d5a/da9 0 2024-09-10T10:04:20.072 INFO:tasks.workunit.client.1.smithi107.stdout:1/672: mkdir d2/d12/d65/db4/dd9 0 2024-09-10T10:04:20.072 INFO:tasks.workunit.client.1.smithi107.stdout:6/562: symlink d0/d3d/d14/d21/d8a/lbd 0 2024-09-10T10:04:20.073 INFO:tasks.workunit.client.1.smithi107.stdout:4/696: chown d0/fb5 637 1 2024-09-10T10:04:20.075 INFO:tasks.workunit.client.1.smithi107.stdout:1/673: chown d2/d6/d67/f9b 568020 1 2024-09-10T10:04:20.075 INFO:tasks.workunit.client.1.smithi107.stdout:2/624: rename d3/da/d1e/d27/f2e to d3/da/df/d20/d36/d4f/d92/fd9 0 2024-09-10T10:04:20.075 INFO:tasks.workunit.client.1.smithi107.stdout:4/697: dread - d0/d40/d6d/fd7 zero size 2024-09-10T10:04:20.077 INFO:tasks.workunit.client.0.smithi071.stdout:4/519: mknod db/d15/d26/d43/d4d/d9f/da6/cae 0 2024-09-10T10:04:20.078 INFO:tasks.workunit.client.0.smithi071.stdout:3/534: link d3/d1c/d3c/da1/l38 d3/d1c/d3c/da1/d5d/da5/lbc 0 2024-09-10T10:04:20.078 INFO:tasks.workunit.client.1.smithi107.stdout:7/511: mkdir d0/d1b/d9d 0 2024-09-10T10:04:20.078 INFO:tasks.workunit.client.1.smithi107.stdout:9/534: symlink d5/d7/d1d/d29/db4/lbc 0 2024-09-10T10:04:20.079 INFO:tasks.workunit.client.0.smithi071.stdout:3/535: stat d3/d1c/d3c/da1/d42/d4a/d60/d78/lb0 0 2024-09-10T10:04:20.079 INFO:tasks.workunit.client.0.smithi071.stdout:2/539: getdents d8/d87/d49 0 2024-09-10T10:04:20.080 INFO:tasks.workunit.client.0.smithi071.stdout:2/540: write d8/fb [8719486,62745] 0 2024-09-10T10:04:20.080 INFO:tasks.workunit.client.0.smithi071.stdout:4/520: unlink db/d15/d26/d43/d4d/c84 0 2024-09-10T10:04:20.083 INFO:tasks.workunit.client.0.smithi071.stdout:4/521: chown db/d15/d17/d24/c27 2883448 1 2024-09-10T10:04:20.085 INFO:tasks.workunit.client.0.smithi071.stdout:4/522: fdatasync db/f55 0 2024-09-10T10:04:20.085 INFO:tasks.workunit.client.0.smithi071.stdout:3/536: dwrite d3/d1c/f22 [0,4194304] 0 2024-09-10T10:04:20.087 INFO:tasks.workunit.client.0.smithi071.stdout:4/523: fdatasync f3 0 2024-09-10T10:04:20.088 INFO:tasks.workunit.client.1.smithi107.stdout:6/563: mkdir d0/d3d/d14/d17/d49/dbe 0 2024-09-10T10:04:20.089 INFO:tasks.workunit.client.1.smithi107.stdout:6/564: readlink d0/d3d/l2e 0 2024-09-10T10:04:20.090 INFO:tasks.workunit.client.1.smithi107.stdout:2/625: symlink d3/da/df/d20/d36/d4f/dcc/lda 0 2024-09-10T10:04:20.092 INFO:tasks.workunit.client.1.smithi107.stdout:2/626: chown d3/d21/d79/f7e 8116 1 2024-09-10T10:04:20.094 INFO:tasks.workunit.client.1.smithi107.stdout:1/674: creat d2/d36/dbc/fda x:0 0 0 2024-09-10T10:04:20.094 INFO:tasks.workunit.client.1.smithi107.stdout:0/551: creat d6/d8/faa x:0 0 0 2024-09-10T10:04:20.094 INFO:tasks.workunit.client.1.smithi107.stdout:6/565: rmdir d0/d3d/d14/d21/d8a/da2/da3/dac 39 2024-09-10T10:04:20.096 INFO:tasks.workunit.client.1.smithi107.stdout:4/698: mkdir d0/d40/d57/def 0 2024-09-10T10:04:20.100 INFO:tasks.workunit.client.1.smithi107.stdout:4/699: chown d0/d40/ca5 563816 1 2024-09-10T10:04:20.101 INFO:tasks.workunit.client.0.smithi071.stdout:0/473: truncate d11/d22/f6f 3829421 0 2024-09-10T10:04:20.103 INFO:tasks.workunit.client.1.smithi107.stdout:7/512: rename d0/d8/f13 to d0/d8/d56/f9e 0 2024-09-10T10:04:20.103 INFO:tasks.workunit.client.0.smithi071.stdout:0/474: symlink d11/d30/la5 0 2024-09-10T10:04:20.104 INFO:tasks.workunit.client.0.smithi071.stdout:0/475: stat d11/d30/d52/d5f/f77 0 2024-09-10T10:04:20.111 INFO:tasks.workunit.client.1.smithi107.stdout:2/627: dwrite d3/da/df/d20/d36/d39/fce [0,4194304] 0 2024-09-10T10:04:20.114 INFO:tasks.workunit.client.1.smithi107.stdout:0/552: dread d6/d8/d2f/f1b [0,4194304] 0 2024-09-10T10:04:20.114 INFO:tasks.workunit.client.1.smithi107.stdout:6/566: dwrite d0/d3d/d14/fbc [0,4194304] 0 2024-09-10T10:04:20.114 INFO:tasks.workunit.client.1.smithi107.stdout:1/675: dwrite d2/d6/fa [4194304,4194304] 0 2024-09-10T10:04:20.117 INFO:tasks.workunit.client.1.smithi107.stdout:0/553: write d6/d8/f72 [1643540,27257] 0 2024-09-10T10:04:20.118 INFO:tasks.workunit.client.1.smithi107.stdout:5/626: dwrite de/d20/d3d/f95 [0,4194304] 0 2024-09-10T10:04:20.118 INFO:tasks.workunit.client.0.smithi071.stdout:4/524: dread db/d15/d4b/f64 [0,4194304] 0 2024-09-10T10:04:20.127 INFO:tasks.workunit.client.0.smithi071.stdout:4/525: dwrite db/d15/d26/d43/d82/f83 [0,4194304] 0 2024-09-10T10:04:20.128 INFO:tasks.workunit.client.1.smithi107.stdout:9/535: write d5/d7/d1d/d9b/dab/d57/d87/d27/f42 [308618,32943] 0 2024-09-10T10:04:20.130 INFO:tasks.workunit.client.0.smithi071.stdout:0/476: write d11/d1e/f2d [712904,38362] 0 2024-09-10T10:04:20.130 INFO:tasks.workunit.client.0.smithi071.stdout:4/526: chown db/f55 95428317 1 2024-09-10T10:04:20.134 INFO:tasks.workunit.client.0.smithi071.stdout:0/477: creat d11/d22/d9a/fa6 x:0 0 0 2024-09-10T10:04:20.140 INFO:tasks.workunit.client.0.smithi071.stdout:0/478: link d11/d30/d70/f8c d11/d30/d70/fa7 0 2024-09-10T10:04:20.143 INFO:tasks.workunit.client.1.smithi107.stdout:0/554: read d6/d8/d2f/d2e/d32/f37 [1792624,114279] 0 2024-09-10T10:04:20.143 INFO:tasks.workunit.client.1.smithi107.stdout:4/700: rename d0/d40/d57/f74 to d0/d40/d6d/ff0 0 2024-09-10T10:04:20.144 INFO:tasks.workunit.client.1.smithi107.stdout:4/701: fsync d0/d40/d6d/f84 0 2024-09-10T10:04:20.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:19 smithi107 ceph-mon[34215]: pgmap v260: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 66 MiB/s rd, 275 MiB/s wr, 514 op/s 2024-09-10T10:04:20.146 INFO:tasks.workunit.client.0.smithi071.stdout:0/479: rename d11/d30/d52/d5f/l84 to d11/d22/la8 0 2024-09-10T10:04:20.151 INFO:tasks.workunit.client.1.smithi107.stdout:6/567: unlink d0/d3d/d14/d17/f1a 0 2024-09-10T10:04:20.152 INFO:tasks.workunit.client.1.smithi107.stdout:5/627: creat de/d4a/d7e/fdc x:0 0 0 2024-09-10T10:04:20.152 INFO:tasks.workunit.client.1.smithi107.stdout:9/536: mkdir d5/d7/d1d/d29/db4/dbd 0 2024-09-10T10:04:20.167 INFO:tasks.workunit.client.1.smithi107.stdout:2/628: unlink d3/f3d 0 2024-09-10T10:04:20.167 INFO:tasks.workunit.client.1.smithi107.stdout:7/513: rename d0/d20/f41 to d0/d20/d35/f9f 0 2024-09-10T10:04:20.167 INFO:tasks.workunit.client.1.smithi107.stdout:1/676: getdents d2/d12/d7e 0 2024-09-10T10:04:20.172 INFO:tasks.workunit.client.1.smithi107.stdout:2/629: dwrite d3/d21/d79/fab [0,4194304] 0 2024-09-10T10:04:20.178 INFO:tasks.workunit.client.0.smithi071.stdout:0/480: fdatasync d11/d30/f50 0 2024-09-10T10:04:20.181 INFO:tasks.workunit.client.0.smithi071.stdout:0/481: write d11/d22/f29 [1908488,52851] 0 2024-09-10T10:04:20.183 INFO:tasks.workunit.client.0.smithi071.stdout:4/527: dwrite f3 [0,4194304] 0 2024-09-10T10:04:20.185 INFO:tasks.workunit.client.0.smithi071.stdout:0/482: write d11/d22/f91 [4705844,9913] 0 2024-09-10T10:04:20.195 INFO:tasks.workunit.client.0.smithi071.stdout:4/528: dwrite db/d15/d17/f3f [0,4194304] 0 2024-09-10T10:04:20.202 INFO:tasks.workunit.client.1.smithi107.stdout:0/555: rename d6/d8/f28 to d6/d8/d2f/da3/da5/fab 0 2024-09-10T10:04:20.202 INFO:tasks.workunit.client.1.smithi107.stdout:7/514: rmdir d0/d1b/d4d/d69/d97/d3d 39 2024-09-10T10:04:20.203 INFO:tasks.workunit.client.1.smithi107.stdout:1/677: truncate d2/f32 1031198 0 2024-09-10T10:04:20.206 INFO:tasks.workunit.client.1.smithi107.stdout:6/568: symlink d0/d3d/d14/d21/d8a/da2/da3/dac/lbf 0 2024-09-10T10:04:20.208 INFO:tasks.workunit.client.1.smithi107.stdout:4/702: creat d0/d40/d57/d76/d77/ff1 x:0 0 0 2024-09-10T10:04:20.215 INFO:tasks.workunit.client.1.smithi107.stdout:0/556: symlink d6/d8/d2f/da3/da5/lac 0 2024-09-10T10:04:20.222 INFO:tasks.workunit.client.0.smithi071.stdout:0/483: mknod d11/d22/d9a/ca9 0 2024-09-10T10:04:20.223 INFO:tasks.workunit.client.1.smithi107.stdout:5/628: dread de/d20/d2b/f60 [0,4194304] 0 2024-09-10T10:04:20.225 INFO:tasks.workunit.client.0.smithi071.stdout:0/484: creat d11/d30/d70/faa x:0 0 0 2024-09-10T10:04:20.226 INFO:tasks.workunit.client.0.smithi071.stdout:0/485: rmdir d11/d22/d31/d72 39 2024-09-10T10:04:20.228 INFO:tasks.workunit.client.0.smithi071.stdout:4/529: dread db/f62 [0,4194304] 0 2024-09-10T10:04:20.228 INFO:tasks.workunit.client.0.smithi071.stdout:0/486: unlink d11/d30/la5 0 2024-09-10T10:04:20.228 INFO:tasks.workunit.client.1.smithi107.stdout:5/629: dread de/d4a/d5c/d6d/f73 [0,4194304] 0 2024-09-10T10:04:20.229 INFO:tasks.workunit.client.1.smithi107.stdout:5/630: chown de/d4a/d5c/d6d/f96 9260365 1 2024-09-10T10:04:20.230 INFO:tasks.workunit.client.1.smithi107.stdout:6/569: rmdir d0/d3d/d14/d42/d88 39 2024-09-10T10:04:20.231 INFO:tasks.workunit.client.0.smithi071.stdout:0/487: unlink d11/d30/d52/c63 0 2024-09-10T10:04:20.231 INFO:tasks.workunit.client.0.smithi071.stdout:4/530: creat db/d15/d17/d4e/d5a/d8d/faf x:0 0 0 2024-09-10T10:04:20.231 INFO:tasks.workunit.client.1.smithi107.stdout:1/678: symlink d2/ldb 0 2024-09-10T10:04:20.232 INFO:tasks.workunit.client.0.smithi071.stdout:0/488: creat d11/d22/d9a/fab x:0 0 0 2024-09-10T10:04:20.234 INFO:tasks.workunit.client.0.smithi071.stdout:4/531: unlink db/d15/d26/d43/d82/f8c 0 2024-09-10T10:04:20.235 INFO:tasks.workunit.client.0.smithi071.stdout:0/489: symlink d11/lac 0 2024-09-10T10:04:20.236 INFO:tasks.workunit.client.0.smithi071.stdout:4/532: symlink db/d15/d26/d43/d4d/d9f/da6/lb0 0 2024-09-10T10:04:20.236 INFO:tasks.workunit.client.0.smithi071.stdout:0/490: write d11/d30/d52/f8f [2051761,28654] 0 2024-09-10T10:04:20.238 INFO:tasks.workunit.client.0.smithi071.stdout:9/811: rename d0/d3b/d5c/fd4 to d0/d3b/d5c/ff4 0 2024-09-10T10:04:20.239 INFO:tasks.workunit.client.0.smithi071.stdout:1/574: dread d1/f40 [0,4194304] 0 2024-09-10T10:04:20.239 INFO:tasks.workunit.client.1.smithi107.stdout:9/537: getdents d5/d7/d1d/d29/db4 0 2024-09-10T10:04:20.239 INFO:tasks.workunit.client.0.smithi071.stdout:4/533: creat db/d8f/fb1 x:0 0 0 2024-09-10T10:04:20.240 INFO:tasks.workunit.client.0.smithi071.stdout:0/491: read d11/d22/f6f [1523747,118745] 0 2024-09-10T10:04:20.241 INFO:tasks.workunit.client.1.smithi107.stdout:5/631: rename de/db3/lc9 to de/db3/ldd 0 2024-09-10T10:04:20.241 INFO:tasks.workunit.client.0.smithi071.stdout:4/534: write db/d1d/d61/d6a/f6c [249173,5927] 0 2024-09-10T10:04:20.242 INFO:tasks.workunit.client.0.smithi071.stdout:4/535: fsync db/d15/d17/d4e/f9c 0 2024-09-10T10:04:20.246 INFO:tasks.workunit.client.1.smithi107.stdout:1/679: write d2/d12/f1e [5036068,40550] 0 2024-09-10T10:04:20.247 INFO:tasks.workunit.client.0.smithi071.stdout:9/812: fdatasync d0/db/d1b/d1d/d5b/fbc 0 2024-09-10T10:04:20.248 INFO:tasks.workunit.client.0.smithi071.stdout:0/492: dwrite d11/d30/d52/f7e [0,4194304] 0 2024-09-10T10:04:20.249 INFO:tasks.workunit.client.1.smithi107.stdout:4/703: mkdir d0/d40/d75/df2 0 2024-09-10T10:04:20.250 INFO:tasks.workunit.client.1.smithi107.stdout:4/704: readlink d0/d40/d57/d76/d77/da1/d59/l67 0 2024-09-10T10:04:20.251 INFO:tasks.workunit.client.1.smithi107.stdout:2/630: write d3/d21/d79/fbe [345317,46146] 0 2024-09-10T10:04:20.252 INFO:tasks.workunit.client.1.smithi107.stdout:7/515: mkdir d0/d1b/d4d/d69/d97/d3d/da0 0 2024-09-10T10:04:20.252 INFO:tasks.workunit.client.1.smithi107.stdout:2/631: chown d3/da/d1e/f3f 25961476 1 2024-09-10T10:04:20.253 INFO:tasks.workunit.client.1.smithi107.stdout:4/705: read d0/d1f/f55 [1218965,110110] 0 2024-09-10T10:04:20.253 INFO:tasks.workunit.client.0.smithi071.stdout:9/813: truncate d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f8d 1257653 0 2024-09-10T10:04:20.254 INFO:tasks.workunit.client.0.smithi071.stdout:9/814: stat d0/db/d1b/d1d/d4b/fb3 0 2024-09-10T10:04:20.255 INFO:tasks.workunit.client.1.smithi107.stdout:4/706: dread - d0/d6b/d9d/fc5 zero size 2024-09-10T10:04:20.255 INFO:tasks.workunit.client.1.smithi107.stdout:0/557: link d6/f7 d6/d8/d2f/d35/fad 0 2024-09-10T10:04:20.256 INFO:tasks.workunit.client.1.smithi107.stdout:9/538: mknod d5/d7/d1d/d41/d83/cbe 0 2024-09-10T10:04:20.258 INFO:tasks.workunit.client.1.smithi107.stdout:6/570: mkdir d0/dc0 0 2024-09-10T10:04:20.259 INFO:tasks.workunit.client.0.smithi071.stdout:1/575: rmdir d1/d21/d3d 39 2024-09-10T10:04:20.262 INFO:tasks.workunit.client.0.smithi071.stdout:9/815: chown d0/d3b/d5c/d6a/d96/dda/c85 7928 1 2024-09-10T10:04:20.263 INFO:tasks.workunit.client.1.smithi107.stdout:7/516: dwrite d0/d20/d72/f7b [0,4194304] 0 2024-09-10T10:04:20.263 INFO:tasks.workunit.client.1.smithi107.stdout:5/632: dread f9 [0,4194304] 0 2024-09-10T10:04:20.264 INFO:tasks.workunit.client.0.smithi071.stdout:1/576: creat d1/d21/d3d/d83/db6/fc0 x:0 0 0 2024-09-10T10:04:20.265 INFO:tasks.workunit.client.0.smithi071.stdout:0/493: truncate d11/d30/f5d 3837069 0 2024-09-10T10:04:20.267 INFO:tasks.workunit.client.1.smithi107.stdout:4/707: dwrite d0/d40/d75/f46 [0,4194304] 0 2024-09-10T10:04:20.268 INFO:tasks.workunit.client.0.smithi071.stdout:9/816: unlink d0/db/d20/d21/fee 0 2024-09-10T10:04:20.269 INFO:tasks.workunit.client.1.smithi107.stdout:4/708: chown d0/d40/d57/d76/d77/da9 12 1 2024-09-10T10:04:20.273 INFO:tasks.workunit.client.0.smithi071.stdout:1/577: mknod d1/d21/d2f/d30/d75/d97/cc1 0 2024-09-10T10:04:20.278 INFO:tasks.workunit.client.0.smithi071.stdout:7/597: sync 2024-09-10T10:04:20.280 INFO:tasks.workunit.client.0.smithi071.stdout:7/598: creat d9/d15/d1f/d98/fd1 x:0 0 0 2024-09-10T10:04:20.282 INFO:tasks.workunit.client.0.smithi071.stdout:9/817: mkdir d0/db/d1b/d1d/d30/d54/df5 0 2024-09-10T10:04:20.283 INFO:tasks.workunit.client.0.smithi071.stdout:7/599: rename d9/d11/d6f to d9/d11/dd2 0 2024-09-10T10:04:20.283 INFO:tasks.workunit.client.1.smithi107.stdout:9/539: mknod d5/d7/d1d/d29/db4/cbf 0 2024-09-10T10:04:20.283 INFO:tasks.workunit.client.1.smithi107.stdout:9/540: chown d5/d7/d1d/f3f 10317222 1 2024-09-10T10:04:20.285 INFO:tasks.workunit.client.0.smithi071.stdout:7/600: mkdir d9/d15/d40/d80/dd3 0 2024-09-10T10:04:20.285 INFO:tasks.workunit.client.0.smithi071.stdout:1/578: link d1/d21/d3d/d9a/d72/c88 d1/d21/d3d/cc2 0 2024-09-10T10:04:20.288 INFO:tasks.workunit.client.1.smithi107.stdout:2/632: fsync d3/da/f17 0 2024-09-10T10:04:20.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:19 smithi071 ceph-mon[27559]: pgmap v260: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 66 MiB/s rd, 275 MiB/s wr, 514 op/s 2024-09-10T10:04:20.289 INFO:tasks.workunit.client.1.smithi107.stdout:5/633: read de/d20/f26 [249641,17423] 0 2024-09-10T10:04:20.289 INFO:tasks.workunit.client.1.smithi107.stdout:5/634: dread - de/d4a/d7e/fdc zero size 2024-09-10T10:04:20.291 INFO:tasks.workunit.client.0.smithi071.stdout:9/818: getdents d0/db/d1b/d1d/d5b 0 2024-09-10T10:04:20.291 INFO:tasks.workunit.client.1.smithi107.stdout:0/558: mkdir d6/d14/d93/dae 0 2024-09-10T10:04:20.293 INFO:tasks.workunit.client.0.smithi071.stdout:1/579: mkdir d1/d21/d2f/d30/d75/dc3 0 2024-09-10T10:04:20.293 INFO:tasks.workunit.client.0.smithi071.stdout:7/601: dwrite d9/f19 [4194304,4194304] 0 2024-09-10T10:04:20.296 INFO:tasks.workunit.client.1.smithi107.stdout:6/571: mkdir d0/d3d/d14/d21/d8a/da7/dc1 0 2024-09-10T10:04:20.298 INFO:tasks.workunit.client.0.smithi071.stdout:0/494: dwrite d11/d30/f5d [4194304,4194304] 0 2024-09-10T10:04:20.298 INFO:tasks.workunit.client.0.smithi071.stdout:7/602: mknod d9/d15/d1f/cd4 0 2024-09-10T10:04:20.298 INFO:tasks.workunit.client.1.smithi107.stdout:9/541: creat d5/d7/d1d/d29/db4/fc0 x:0 0 0 2024-09-10T10:04:20.301 INFO:tasks.workunit.client.0.smithi071.stdout:9/819: symlink d0/db/d1b/d1d/d4b/dad/lf6 0 2024-09-10T10:04:20.302 INFO:tasks.workunit.client.1.smithi107.stdout:7/517: mknod d0/d1b/d4d/d69/d97/d3d/ca1 0 2024-09-10T10:04:20.304 INFO:tasks.workunit.client.0.smithi071.stdout:7/603: creat d9/d15/d40/d80/dd3/fd5 x:0 0 0 2024-09-10T10:04:20.304 INFO:tasks.workunit.client.1.smithi107.stdout:4/709: mknod d0/d40/d57/def/cf3 0 2024-09-10T10:04:20.305 INFO:tasks.workunit.client.0.smithi071.stdout:0/495: creat d11/d30/fad x:0 0 0 2024-09-10T10:04:20.306 INFO:tasks.workunit.client.1.smithi107.stdout:9/542: dwrite d5/d7/d1d/d9b/dab/d57/d87/d37/f80 [0,4194304] 0 2024-09-10T10:04:20.308 INFO:tasks.workunit.client.1.smithi107.stdout:2/633: mkdir d3/da/df/d20/d36/d39/da3/ddb 0 2024-09-10T10:04:20.310 INFO:tasks.workunit.client.1.smithi107.stdout:2/634: truncate d3/da/df/fa8 254430 0 2024-09-10T10:04:20.310 INFO:tasks.workunit.client.0.smithi071.stdout:0/496: dwrite d11/d30/d70/f75 [0,4194304] 0 2024-09-10T10:04:20.315 INFO:tasks.workunit.client.0.smithi071.stdout:0/497: mknod d11/cae 0 2024-09-10T10:04:20.316 INFO:tasks.workunit.client.0.smithi071.stdout:7/604: rename d9/d15/d40/d80/dd3 to d9/d15/d40/d80/dd6 0 2024-09-10T10:04:20.317 INFO:tasks.workunit.client.0.smithi071.stdout:7/605: fdatasync d9/d76/f9a 0 2024-09-10T10:04:20.323 INFO:tasks.workunit.client.0.smithi071.stdout:7/606: read f2 [3707968,98411] 0 2024-09-10T10:04:20.325 INFO:tasks.workunit.client.0.smithi071.stdout:7/607: creat d9/d15/d1f/d74/d9b/fd7 x:0 0 0 2024-09-10T10:04:20.326 INFO:tasks.workunit.client.0.smithi071.stdout:7/608: dread d9/d15/d1f/d74/d9b/fb1 [0,4194304] 0 2024-09-10T10:04:20.328 INFO:tasks.workunit.client.0.smithi071.stdout:7/609: mkdir d9/d15/d1f/d74/d9b/dd8 0 2024-09-10T10:04:20.330 INFO:tasks.workunit.client.0.smithi071.stdout:7/610: getdents d9/d15/d40/db8 0 2024-09-10T10:04:20.342 INFO:tasks.workunit.client.0.smithi071.stdout:0/498: dwrite d11/d30/d70/fa7 [4194304,4194304] 0 2024-09-10T10:04:20.343 INFO:tasks.workunit.client.0.smithi071.stdout:0/499: write d11/d30/fad [284414,91962] 0 2024-09-10T10:04:20.344 INFO:tasks.workunit.client.0.smithi071.stdout:0/500: fsync d11/d30/d52/d79/f7a 0 2024-09-10T10:04:20.346 INFO:tasks.workunit.client.0.smithi071.stdout:0/501: unlink d11/d30/d52/d5f/f6b 0 2024-09-10T10:04:20.349 INFO:tasks.workunit.client.0.smithi071.stdout:0/502: creat d11/d22/faf x:0 0 0 2024-09-10T10:04:20.445 INFO:tasks.workunit.client.0.smithi071.stdout:1/580: rmdir d1/d21/d2f/d30/d75/dc3 0 2024-09-10T10:04:20.446 INFO:tasks.workunit.client.1.smithi107.stdout:1/680: getdents d2/d12/d65/d6b 0 2024-09-10T10:04:20.447 INFO:tasks.workunit.client.1.smithi107.stdout:6/572: symlink d0/d3d/d14/d21/lc2 0 2024-09-10T10:04:20.447 INFO:tasks.workunit.client.1.smithi107.stdout:6/573: chown d0/d3d/f40 953 1 2024-09-10T10:04:20.448 INFO:tasks.workunit.client.1.smithi107.stdout:6/574: truncate d0/d3d/d14/f9e 4275365 0 2024-09-10T10:04:20.449 INFO:tasks.workunit.client.1.smithi107.stdout:6/575: write d0/d3d/d14/d17/d4b/fa8 [447793,90624] 0 2024-09-10T10:04:20.449 INFO:tasks.workunit.client.0.smithi071.stdout:9/820: rename d0/db/d20/dc0 to d0/db/d1b/d1d/d30/d54/df7 0 2024-09-10T10:04:20.450 INFO:tasks.workunit.client.1.smithi107.stdout:7/518: creat d0/d8/d5c/fa2 x:0 0 0 2024-09-10T10:04:20.450 INFO:tasks.workunit.client.1.smithi107.stdout:6/576: truncate d0/d70/fb6 901645 0 2024-09-10T10:04:20.450 INFO:tasks.workunit.client.0.smithi071.stdout:9/821: chown d0/db/d1b/d1d/d30/d54/d27 627351 1 2024-09-10T10:04:20.451 INFO:tasks.workunit.client.0.smithi071.stdout:1/581: unlink d1/d3f/d58/cbb 0 2024-09-10T10:04:20.451 INFO:tasks.workunit.client.0.smithi071.stdout:0/503: rename d11/d30/d52/d5f/l93 to d11/d22/d9a/lb0 0 2024-09-10T10:04:20.452 INFO:tasks.workunit.client.1.smithi107.stdout:7/519: read d0/d8/f18 [3280679,125695] 0 2024-09-10T10:04:20.454 INFO:tasks.workunit.client.0.smithi071.stdout:0/504: unlink d11/d30/f5d 0 2024-09-10T10:04:20.454 INFO:tasks.workunit.client.1.smithi107.stdout:9/543: creat d5/d7/d1d/d9b/dab/d57/d87/d27/fc1 x:0 0 0 2024-09-10T10:04:20.455 INFO:tasks.workunit.client.1.smithi107.stdout:9/544: read - d5/d7/d1d/d9b/dab/d57/d87/d27/fc1 zero size 2024-09-10T10:04:20.456 INFO:tasks.workunit.client.1.smithi107.stdout:5/635: link de/d20/fcd de/d20/d3d/dd4/fde 0 2024-09-10T10:04:20.457 INFO:tasks.workunit.client.0.smithi071.stdout:0/505: rmdir d11/d30/d52/d79/d9d 0 2024-09-10T10:04:20.458 INFO:tasks.workunit.client.0.smithi071.stdout:9/822: dwrite d0/db/d1b/d1d/d30/d54/d27/d6e/f88 [0,4194304] 0 2024-09-10T10:04:20.461 INFO:tasks.workunit.client.1.smithi107.stdout:0/559: truncate d6/f4a 2499602 0 2024-09-10T10:04:20.462 INFO:tasks.workunit.client.1.smithi107.stdout:1/681: write d2/f6a [978099,65692] 0 2024-09-10T10:04:20.462 INFO:tasks.workunit.client.0.smithi071.stdout:9/823: write d0/d3b/d5c/d6a/d96/fdd [926669,116926] 0 2024-09-10T10:04:20.464 INFO:tasks.workunit.client.0.smithi071.stdout:0/506: dread d11/d30/d70/f8c [0,4194304] 0 2024-09-10T10:04:20.466 INFO:tasks.workunit.client.1.smithi107.stdout:6/577: read - d0/d3d/d14/d17/d4b/f5c zero size 2024-09-10T10:04:20.467 INFO:tasks.workunit.client.1.smithi107.stdout:7/520: unlink d0/d8/d5c/d6d/l73 0 2024-09-10T10:04:20.468 INFO:tasks.workunit.client.1.smithi107.stdout:8/473: sync 2024-09-10T10:04:20.468 INFO:tasks.workunit.client.1.smithi107.stdout:3/928: sync 2024-09-10T10:04:20.469 INFO:tasks.workunit.client.0.smithi071.stdout:9/824: symlink d0/db/d20/dd8/lf8 0 2024-09-10T10:04:20.470 INFO:tasks.workunit.client.1.smithi107.stdout:4/710: write d0/d40/d57/d4f/f58 [1004040,40148] 0 2024-09-10T10:04:20.473 INFO:tasks.workunit.client.0.smithi071.stdout:1/582: dread d1/f19 [0,4194304] 0 2024-09-10T10:04:20.474 INFO:tasks.workunit.client.1.smithi107.stdout:2/635: creat d3/da/d66/d91/dae/fdc x:0 0 0 2024-09-10T10:04:20.478 INFO:tasks.workunit.client.0.smithi071.stdout:1/583: dread d1/d21/d3d/f4f [0,4194304] 0 2024-09-10T10:04:20.478 INFO:tasks.workunit.client.0.smithi071.stdout:9/825: mknod d0/db/d1b/d1d/d30/d54/cf9 0 2024-09-10T10:04:20.479 INFO:tasks.workunit.client.0.smithi071.stdout:1/584: truncate d1/f2e 1082751 0 2024-09-10T10:04:20.481 INFO:tasks.workunit.client.0.smithi071.stdout:1/585: read d1/d21/d3d/d4a/f82 [581378,55907] 0 2024-09-10T10:04:20.481 INFO:tasks.workunit.client.1.smithi107.stdout:1/682: mknod d2/d12/d65/d6b/cdc 0 2024-09-10T10:04:20.482 INFO:tasks.workunit.client.0.smithi071.stdout:5/439: sync 2024-09-10T10:04:20.483 INFO:tasks.workunit.client.0.smithi071.stdout:9/826: creat d0/db/d20/dd8/ffa x:0 0 0 2024-09-10T10:04:20.483 INFO:tasks.workunit.client.0.smithi071.stdout:0/507: rmdir d11/d30 39 2024-09-10T10:04:20.488 INFO:tasks.workunit.client.1.smithi107.stdout:6/578: dwrite d0/d3d/d14/d42/d88/f97 [0,4194304] 0 2024-09-10T10:04:20.489 INFO:tasks.workunit.client.0.smithi071.stdout:0/508: fdatasync d11/d30/d52/d5f/f9e 0 2024-09-10T10:04:20.489 INFO:tasks.workunit.client.0.smithi071.stdout:1/586: dwrite d1/d3f/fa3 [0,4194304] 0 2024-09-10T10:04:20.493 INFO:tasks.workunit.client.0.smithi071.stdout:0/509: rmdir d11/d30/d52 39 2024-09-10T10:04:20.494 INFO:tasks.workunit.client.1.smithi107.stdout:2/636: creat d3/da/df/d20/fdd x:0 0 0 2024-09-10T10:04:20.495 INFO:tasks.workunit.client.0.smithi071.stdout:9/827: dread d0/db/d1b/d1d/f3a [0,4194304] 0 2024-09-10T10:04:20.495 INFO:tasks.workunit.client.0.smithi071.stdout:5/440: dwrite dc/d4a/d61/f6f [4194304,4194304] 0 2024-09-10T10:04:20.496 INFO:tasks.workunit.client.0.smithi071.stdout:1/587: write d1/f2e [540502,66057] 0 2024-09-10T10:04:20.497 INFO:tasks.workunit.client.1.smithi107.stdout:5/636: link de/f2d de/d20/d2b/d4b/d8c/fdf 0 2024-09-10T10:04:20.501 INFO:tasks.workunit.client.0.smithi071.stdout:1/588: read d1/d21/d2f/f39 [3076892,7970] 0 2024-09-10T10:04:20.502 INFO:tasks.workunit.client.0.smithi071.stdout:5/441: rename dc/df/d3e/d5a/f75 to dc/df/d17/d22/d87/f92 0 2024-09-10T10:04:20.504 INFO:tasks.workunit.client.0.smithi071.stdout:9/828: creat d0/db/d1b/d1d/d4b/db9/dba/ffb x:0 0 0 2024-09-10T10:04:20.505 INFO:tasks.workunit.client.0.smithi071.stdout:0/510: rename d11/d30/d52/d79/c85 to d11/d22/d40/cb1 0 2024-09-10T10:04:20.507 INFO:tasks.workunit.client.0.smithi071.stdout:9/829: write d0/db/d1b/d1d/d5b/d9f/ff2 [539851,53530] 0 2024-09-10T10:04:20.508 INFO:tasks.workunit.client.0.smithi071.stdout:9/830: chown d0/d3b/d5c 447313 1 2024-09-10T10:04:20.511 INFO:tasks.workunit.client.0.smithi071.stdout:9/831: readlink d0/db/d20/d21/l31 0 2024-09-10T10:04:20.512 INFO:tasks.workunit.client.1.smithi107.stdout:6/579: creat d0/d70/fc3 x:0 0 0 2024-09-10T10:04:20.512 INFO:tasks.workunit.client.1.smithi107.stdout:9/545: write d5/d7/fb [3952097,107794] 0 2024-09-10T10:04:20.514 INFO:tasks.workunit.client.0.smithi071.stdout:5/442: dwrite dc/df/f28 [0,4194304] 0 2024-09-10T10:04:20.515 INFO:tasks.workunit.client.1.smithi107.stdout:5/637: mknod de/d9c/ce0 0 2024-09-10T10:04:20.515 INFO:tasks.workunit.client.0.smithi071.stdout:1/589: truncate d1/d21/f63 684558 0 2024-09-10T10:04:20.516 INFO:tasks.workunit.client.1.smithi107.stdout:0/560: creat d6/faf x:0 0 0 2024-09-10T10:04:20.517 INFO:tasks.workunit.client.1.smithi107.stdout:1/683: mkdir d2/d12/d65/db4/dd9/ddd 0 2024-09-10T10:04:20.518 INFO:tasks.workunit.client.0.smithi071.stdout:1/590: fdatasync d1/f8e 0 2024-09-10T10:04:20.521 INFO:tasks.workunit.client.1.smithi107.stdout:3/929: rename dc/dd/d20/d23/fde to dc/dd/d45/d26/d41/d44/d35/f136 0 2024-09-10T10:04:20.521 INFO:tasks.workunit.client.0.smithi071.stdout:5/443: symlink dc/d4a/d61/l93 0 2024-09-10T10:04:20.521 INFO:tasks.workunit.client.1.smithi107.stdout:9/546: unlink d5/f31 0 2024-09-10T10:04:20.522 INFO:tasks.workunit.client.0.smithi071.stdout:0/511: dwrite d11/d30/d52/d79/f7a [4194304,4194304] 0 2024-09-10T10:04:20.522 INFO:tasks.workunit.client.1.smithi107.stdout:7/521: dwrite d0/d8/f32 [0,4194304] 0 2024-09-10T10:04:20.523 INFO:tasks.workunit.client.0.smithi071.stdout:5/444: readlink dc/df/d29/l6c 0 2024-09-10T10:04:20.525 INFO:tasks.workunit.client.1.smithi107.stdout:6/580: mknod d0/d3d/d14/d21/d83/cc4 0 2024-09-10T10:04:20.529 INFO:tasks.workunit.client.1.smithi107.stdout:3/930: stat dc/dd/d45/d26/d41/l8a 0 2024-09-10T10:04:20.529 INFO:tasks.workunit.client.1.smithi107.stdout:1/684: rename d2/d36/cd0 to d2/d12/d5a/cde 0 2024-09-10T10:04:20.530 INFO:tasks.workunit.client.0.smithi071.stdout:9/832: rename d0/d3b/d5c/d6a/d96/dda/d75 to d0/db/d1b/d1d/d30/d54/df7/dfc 0 2024-09-10T10:04:20.531 INFO:tasks.workunit.client.0.smithi071.stdout:9/833: dread - d0/db/fe2 zero size 2024-09-10T10:04:20.531 INFO:tasks.workunit.client.0.smithi071.stdout:5/445: mkdir dc/df/d29/d94 0 2024-09-10T10:04:20.533 INFO:tasks.workunit.client.0.smithi071.stdout:0/512: link d11/d30/l36 d11/d22/d40/lb2 0 2024-09-10T10:04:20.536 INFO:tasks.workunit.client.1.smithi107.stdout:2/637: dwrite d3/da/df/d20/d36/d39/f6e [0,4194304] 0 2024-09-10T10:04:20.536 INFO:tasks.workunit.client.0.smithi071.stdout:5/446: truncate dc/df/f7b 1677079 0 2024-09-10T10:04:20.537 INFO:tasks.workunit.client.1.smithi107.stdout:5/638: dwrite f8 [0,4194304] 0 2024-09-10T10:04:20.540 INFO:tasks.workunit.client.1.smithi107.stdout:6/581: mkdir d0/d3d/d14/d17/d24/dc5 0 2024-09-10T10:04:20.540 INFO:tasks.workunit.client.0.smithi071.stdout:0/513: rename d11/d1e/c2b to d11/d1e/cb3 0 2024-09-10T10:04:20.542 INFO:tasks.workunit.client.0.smithi071.stdout:5/447: truncate dc/f4b 627085 0 2024-09-10T10:04:20.542 INFO:tasks.workunit.client.1.smithi107.stdout:1/685: dread - d2/d12/d7e/f7f zero size 2024-09-10T10:04:20.544 INFO:tasks.workunit.client.1.smithi107.stdout:2/638: chown d3/da/d1e/d27/d5b/c6b 1 1 2024-09-10T10:04:20.545 INFO:tasks.workunit.client.1.smithi107.stdout:0/561: dwrite d6/d8/d2f/d6e/f9d [0,4194304] 0 2024-09-10T10:04:20.547 INFO:tasks.workunit.client.0.smithi071.stdout:1/591: getdents d1/d21/d2f/d30/d6a/d91 0 2024-09-10T10:04:20.547 INFO:tasks.workunit.client.1.smithi107.stdout:7/522: dread d0/d20/d35/f5e [0,4194304] 0 2024-09-10T10:04:20.547 INFO:tasks.workunit.client.1.smithi107.stdout:5/639: truncate de/d20/d2b/d4b/d5e/fa5 1320083 0 2024-09-10T10:04:20.549 INFO:tasks.workunit.client.1.smithi107.stdout:8/474: truncate d5/d8/f20 2284851 0 2024-09-10T10:04:20.549 INFO:tasks.workunit.client.0.smithi071.stdout:5/448: symlink dc/df/d29/d94/l95 0 2024-09-10T10:04:20.550 INFO:tasks.workunit.client.1.smithi107.stdout:2/639: rename d3/da/df/d20/d36/d4f to d3/da/df/d20/d36/d4f/d92/dde 22 2024-09-10T10:04:20.553 INFO:tasks.workunit.client.1.smithi107.stdout:7/523: chown d0/d8/d5c/fa2 39551246 1 2024-09-10T10:04:20.553 INFO:tasks.workunit.client.0.smithi071.stdout:5/449: creat dc/d53/d6a/f96 x:0 0 0 2024-09-10T10:04:20.554 INFO:tasks.workunit.client.1.smithi107.stdout:2/640: chown d3/da/d1e/d40/d8a/d7f 198 1 2024-09-10T10:04:20.555 INFO:tasks.workunit.client.1.smithi107.stdout:7/524: chown d0/f2b 1 1 2024-09-10T10:04:20.556 INFO:tasks.workunit.client.1.smithi107.stdout:6/582: dwrite d0/d3d/d14/d17/d49/d55/d56/f84 [0,4194304] 0 2024-09-10T10:04:20.557 INFO:tasks.workunit.client.0.smithi071.stdout:5/450: write dc/df/d3e/d5a/f5e [1676268,86851] 0 2024-09-10T10:04:20.557 INFO:tasks.workunit.client.0.smithi071.stdout:1/592: creat d1/d21/d2f/d30/d6a/d91/fc4 x:0 0 0 2024-09-10T10:04:20.557 INFO:tasks.workunit.client.1.smithi107.stdout:7/525: write d0/d8/d56/f8e [169918,55987] 0 2024-09-10T10:04:20.560 INFO:tasks.workunit.client.1.smithi107.stdout:0/562: chown d6/f4a 0 1 2024-09-10T10:04:20.561 INFO:tasks.workunit.client.0.smithi071.stdout:5/451: creat dc/df/f97 x:0 0 0 2024-09-10T10:04:20.562 INFO:tasks.workunit.client.0.smithi071.stdout:9/834: dread d0/db/d1b/d1d/d4b/db9/dba/fd7 [0,4194304] 0 2024-09-10T10:04:20.563 INFO:tasks.workunit.client.0.smithi071.stdout:1/593: unlink d1/d21/d2f/d81/f8d 0 2024-09-10T10:04:20.564 INFO:tasks.workunit.client.0.smithi071.stdout:0/514: truncate d11/d30/d52/d79/f7a 2314064 0 2024-09-10T10:04:20.565 INFO:tasks.workunit.client.1.smithi107.stdout:9/547: write d5/d7/d1d/f47 [2365971,26448] 0 2024-09-10T10:04:20.566 INFO:tasks.workunit.client.0.smithi071.stdout:5/452: mknod dc/d53/d79/c98 0 2024-09-10T10:04:20.567 INFO:tasks.workunit.client.1.smithi107.stdout:9/548: fsync d5/d7/f8b 0 2024-09-10T10:04:20.568 INFO:tasks.workunit.client.0.smithi071.stdout:9/835: truncate d0/db/d1b/d1d/d5b/fbc 4650921 0 2024-09-10T10:04:20.569 INFO:tasks.workunit.client.0.smithi071.stdout:0/515: creat d11/fb4 x:0 0 0 2024-09-10T10:04:20.570 INFO:tasks.workunit.client.1.smithi107.stdout:0/563: fdatasync d6/d8/f15 0 2024-09-10T10:04:20.570 INFO:tasks.workunit.client.1.smithi107.stdout:2/641: dwrite d3/da/df/d20/d36/d4f/d92/f53 [0,4194304] 0 2024-09-10T10:04:20.570 INFO:tasks.workunit.client.0.smithi071.stdout:1/594: rename d1/d21/d2f/d81/cbe to d1/d21/d3d/d9a/cc5 0 2024-09-10T10:04:20.571 INFO:tasks.workunit.client.0.smithi071.stdout:5/453: creat dc/df/d29/f99 x:0 0 0 2024-09-10T10:04:20.572 INFO:tasks.workunit.client.1.smithi107.stdout:9/549: readlink d5/d7/d1d/d41/d83/d9a/l26 0 2024-09-10T10:04:20.572 INFO:tasks.workunit.client.0.smithi071.stdout:0/516: creat d11/d22/d40/fb5 x:0 0 0 2024-09-10T10:04:20.573 INFO:tasks.workunit.client.1.smithi107.stdout:6/583: rename d0/d3d/d14/d17/d49/d55/d73/f77 to d0/d3d/d14/d17/d49/fc6 0 2024-09-10T10:04:20.574 INFO:tasks.workunit.client.0.smithi071.stdout:5/454: chown dc/df/d17/d22/l39 556795605 1 2024-09-10T10:04:20.575 INFO:tasks.workunit.client.1.smithi107.stdout:3/931: truncate dc/d56/fd7 2995844 0 2024-09-10T10:04:20.576 INFO:tasks.workunit.client.0.smithi071.stdout:0/517: write d11/d22/d31/f92 [2063064,41037] 0 2024-09-10T10:04:20.577 INFO:tasks.workunit.client.0.smithi071.stdout:5/455: chown dc/df/d17/c47 620 1 2024-09-10T10:04:20.577 INFO:tasks.workunit.client.1.smithi107.stdout:3/932: write dc/dd/d45/d26/d59/f7a [4476407,94388] 0 2024-09-10T10:04:20.578 INFO:tasks.workunit.client.1.smithi107.stdout:8/475: read - d5/d8/d66/d8b/d21/f41 zero size 2024-09-10T10:04:20.580 INFO:tasks.workunit.client.0.smithi071.stdout:0/518: rmdir d11/d30 39 2024-09-10T10:04:20.580 INFO:tasks.workunit.client.1.smithi107.stdout:0/564: mknod d6/d5a/da9/cb0 0 2024-09-10T10:04:20.581 INFO:tasks.workunit.client.0.smithi071.stdout:9/836: dwrite d0/db/d1b/d1d/d30/d54/fc6 [0,4194304] 0 2024-09-10T10:04:20.581 INFO:tasks.workunit.client.1.smithi107.stdout:0/565: readlink d6/d8/d2f/d2e/d7b/l91 0 2024-09-10T10:04:20.582 INFO:tasks.workunit.client.0.smithi071.stdout:5/456: write dc/f31 [4073355,28965] 0 2024-09-10T10:04:20.583 INFO:tasks.workunit.client.1.smithi107.stdout:0/566: fdatasync d6/d8/d2f/d35/d3c/f7a 0 2024-09-10T10:04:20.583 INFO:tasks.workunit.client.1.smithi107.stdout:6/584: rename d0/d70/f95 to d0/d70/fc7 0 2024-09-10T10:04:20.586 INFO:tasks.workunit.client.0.smithi071.stdout:0/519: read - d11/d22/d31/d72/f8b zero size 2024-09-10T10:04:20.586 INFO:tasks.workunit.client.0.smithi071.stdout:5/457: rename dc to dc/df/d3e/d5a/d80/d8a/d9a 22 2024-09-10T10:04:20.586 INFO:tasks.workunit.client.0.smithi071.stdout:1/595: dwrite d1/d21/d2f/d30/d6a/d91/fc4 [0,4194304] 0 2024-09-10T10:04:20.586 INFO:tasks.workunit.client.0.smithi071.stdout:9/837: dread - d0/db/d1b/db4/fec zero size 2024-09-10T10:04:20.586 INFO:tasks.workunit.client.1.smithi107.stdout:7/526: link d0/d20/d35/f94 d0/d1b/fa3 0 2024-09-10T10:04:20.587 INFO:tasks.workunit.client.1.smithi107.stdout:3/933: creat dc/dd/d45/d26/d41/d44/f137 x:0 0 0 2024-09-10T10:04:20.590 INFO:tasks.workunit.client.0.smithi071.stdout:0/520: symlink d11/d22/d40/lb6 0 2024-09-10T10:04:20.590 INFO:tasks.workunit.client.1.smithi107.stdout:0/567: rmdir d6/d8/d2f/da3/da5 39 2024-09-10T10:04:20.591 INFO:tasks.workunit.client.1.smithi107.stdout:0/568: chown d6/d14/d93 418 1 2024-09-10T10:04:20.591 INFO:tasks.workunit.client.1.smithi107.stdout:3/934: chown dc/dd/d45/d26/d41/d44/d63/f7b 107461389 1 2024-09-10T10:04:20.591 INFO:tasks.workunit.client.0.smithi071.stdout:9/838: write d0/db/d1b/d1d/d4b/db9/fce [620876,85262] 0 2024-09-10T10:04:20.592 INFO:tasks.workunit.client.0.smithi071.stdout:5/458: symlink dc/df/d29/d48/l9b 0 2024-09-10T10:04:20.592 INFO:tasks.workunit.client.1.smithi107.stdout:7/527: rmdir d0/d8/dc 39 2024-09-10T10:04:20.594 INFO:tasks.workunit.client.0.smithi071.stdout:6/458: sync 2024-09-10T10:04:20.594 INFO:tasks.workunit.client.0.smithi071.stdout:8/519: sync 2024-09-10T10:04:20.594 INFO:tasks.workunit.client.1.smithi107.stdout:8/476: rename d5/d8/d2a/d35/f87 to d5/d8/d66/d8b/d21/d83/fa1 0 2024-09-10T10:04:20.596 INFO:tasks.workunit.client.0.smithi071.stdout:0/521: creat d11/d22/d31/d72/fb7 x:0 0 0 2024-09-10T10:04:20.596 INFO:tasks.workunit.client.1.smithi107.stdout:8/477: readlink d5/d8/d2a/l2c 0 2024-09-10T10:04:20.596 INFO:tasks.workunit.client.0.smithi071.stdout:9/839: write d0/db/d1b/d1d/d5b/d9f/ff2 [310207,35077] 0 2024-09-10T10:04:20.597 INFO:tasks.workunit.client.1.smithi107.stdout:0/569: fdatasync d6/d8/d2f/f1b 0 2024-09-10T10:04:20.598 INFO:tasks.workunit.client.0.smithi071.stdout:1/596: rename d1/d21/d2f/d30/f55 to d1/d57/fc6 0 2024-09-10T10:04:20.598 INFO:tasks.workunit.client.0.smithi071.stdout:6/459: chown d4/da/df/d2e/d3a/d3e/d45 33136026 1 2024-09-10T10:04:20.599 INFO:tasks.workunit.client.0.smithi071.stdout:1/597: fdatasync d1/d21/f61 0 2024-09-10T10:04:20.600 INFO:tasks.workunit.client.1.smithi107.stdout:1/686: write d2/d12/d5a/fbe [674996,2455] 0 2024-09-10T10:04:20.601 INFO:tasks.workunit.client.0.smithi071.stdout:8/520: creat d5/df/d1e/d38/d9f/fb9 x:0 0 0 2024-09-10T10:04:20.602 INFO:tasks.workunit.client.0.smithi071.stdout:0/522: creat d11/d22/d40/fb8 x:0 0 0 2024-09-10T10:04:20.603 INFO:tasks.workunit.client.1.smithi107.stdout:7/528: write d0/d1b/d4d/d69/d97/d3d/f60 [3858781,99223] 0 2024-09-10T10:04:20.605 INFO:tasks.workunit.client.1.smithi107.stdout:6/585: creat d0/d3d/d14/d42/fc8 x:0 0 0 2024-09-10T10:04:20.605 INFO:tasks.workunit.client.0.smithi071.stdout:1/598: symlink d1/d3f/lc7 0 2024-09-10T10:04:20.607 INFO:tasks.workunit.client.1.smithi107.stdout:6/586: chown d0/d76/f7b 117 1 2024-09-10T10:04:20.607 INFO:tasks.workunit.client.1.smithi107.stdout:8/478: dwrite d5/d8/d66/d8b/d18/d4f/f8d [4194304,4194304] 0 2024-09-10T10:04:20.608 INFO:tasks.workunit.client.1.smithi107.stdout:2/642: dread d3/da/d1e/d40/d8a/d7f/f63 [0,4194304] 0 2024-09-10T10:04:20.609 INFO:tasks.workunit.client.0.smithi071.stdout:5/459: getdents dc/df/d17/d22 0 2024-09-10T10:04:20.610 INFO:tasks.workunit.client.1.smithi107.stdout:5/640: write de/d4a/f63 [1592707,68417] 0 2024-09-10T10:04:20.610 INFO:tasks.workunit.client.0.smithi071.stdout:6/460: symlink d4/da/df/l98 0 2024-09-10T10:04:20.611 INFO:tasks.workunit.client.1.smithi107.stdout:2/643: chown d3/da/d1e/d5f/d54/c99 373697111 1 2024-09-10T10:04:20.615 INFO:tasks.workunit.client.0.smithi071.stdout:1/599: fdatasync d1/d21/d2f/d30/d6a/d91/fb2 0 2024-09-10T10:04:20.616 INFO:tasks.workunit.client.1.smithi107.stdout:1/687: truncate d2/d6/d24/f50 2191708 0 2024-09-10T10:04:20.616 INFO:tasks.workunit.client.0.smithi071.stdout:6/461: dread - d4/da/df/d2e/d3a/d3e/d45/f48 zero size 2024-09-10T10:04:20.617 INFO:tasks.workunit.client.0.smithi071.stdout:0/523: link d11/d22/l55 d11/d30/d52/d5f/lb9 0 2024-09-10T10:04:20.619 INFO:tasks.workunit.client.0.smithi071.stdout:0/524: fsync d11/d22/d40/f4a 0 2024-09-10T10:04:20.619 INFO:tasks.workunit.client.0.smithi071.stdout:1/600: mknod d1/d70/d76/cc8 0 2024-09-10T10:04:20.620 INFO:tasks.workunit.client.0.smithi071.stdout:5/460: link dc/df/d29/d48/c84 dc/df/d29/c9c 0 2024-09-10T10:04:20.621 INFO:tasks.workunit.client.1.smithi107.stdout:7/529: read d0/d8/dc/d2c/f6e [3789000,119239] 0 2024-09-10T10:04:20.621 INFO:tasks.workunit.client.0.smithi071.stdout:0/525: fdatasync d11/d22/d9a/fa6 0 2024-09-10T10:04:20.622 INFO:tasks.workunit.client.1.smithi107.stdout:6/587: mkdir d0/d3d/d14/d21/d8a/da7/dc9 0 2024-09-10T10:04:20.622 INFO:tasks.workunit.client.0.smithi071.stdout:6/462: creat d4/da/df/d2e/d3a/d3e/d45/f99 x:0 0 0 2024-09-10T10:04:20.622 INFO:tasks.workunit.client.0.smithi071.stdout:5/461: symlink dc/df/l9d 0 2024-09-10T10:04:20.623 INFO:tasks.workunit.client.0.smithi071.stdout:9/840: rmdir d0/db/d1b/d1d/d5b/df1 0 2024-09-10T10:04:20.624 INFO:tasks.workunit.client.1.smithi107.stdout:6/588: write d0/f13 [3869340,99269] 0 2024-09-10T10:04:20.624 INFO:tasks.workunit.client.1.smithi107.stdout:9/550: dwrite d5/d7/d1d/d41/f91 [0,4194304] 0 2024-09-10T10:04:20.624 INFO:tasks.workunit.client.0.smithi071.stdout:8/521: dwrite d5/df/d1d/d86/d75/f7b [0,4194304] 0 2024-09-10T10:04:20.626 INFO:tasks.workunit.client.1.smithi107.stdout:5/641: readlink de/d41/l64 0 2024-09-10T10:04:20.627 INFO:tasks.workunit.client.0.smithi071.stdout:1/601: symlink d1/d3f/d58/daf/lc9 0 2024-09-10T10:04:20.628 INFO:tasks.workunit.client.0.smithi071.stdout:0/526: symlink d11/d30/d52/lba 0 2024-09-10T10:04:20.629 INFO:tasks.workunit.client.1.smithi107.stdout:8/479: fdatasync d5/d8/d66/d8b/d1a/f1f 0 2024-09-10T10:04:20.629 INFO:tasks.workunit.client.0.smithi071.stdout:6/463: creat d4/da/df/d2e/d3a/d51/f9a x:0 0 0 2024-09-10T10:04:20.630 INFO:tasks.workunit.client.1.smithi107.stdout:0/570: symlink d6/d8/d2f/da3/da5/lb1 0 2024-09-10T10:04:20.630 INFO:tasks.workunit.client.0.smithi071.stdout:9/841: fdatasync d0/db/d1b/d1d/f40 0 2024-09-10T10:04:20.632 INFO:tasks.workunit.client.0.smithi071.stdout:0/527: fsync d11/d1e/f90 0 2024-09-10T10:04:20.633 INFO:tasks.workunit.client.1.smithi107.stdout:2/644: symlink d3/da/d66/d91/ldf 0 2024-09-10T10:04:20.633 INFO:tasks.workunit.client.1.smithi107.stdout:5/642: write de/d20/f7c [5057891,112681] 0 2024-09-10T10:04:20.642 INFO:tasks.workunit.client.1.smithi107.stdout:6/589: dwrite d0/d70/fb6 [0,4194304] 0 2024-09-10T10:04:20.644 INFO:tasks.workunit.client.1.smithi107.stdout:3/935: link dc/dd/d20/d23/d39/dac/lb9 dc/dd/d45/d26/d41/d10e/l138 0 2024-09-10T10:04:20.644 INFO:tasks.workunit.client.1.smithi107.stdout:9/551: dread d5/d7/d1d/d9b/dab/d57/d87/d27/fa1 [0,4194304] 0 2024-09-10T10:04:20.644 INFO:tasks.workunit.client.0.smithi071.stdout:1/602: creat d1/d57/fca x:0 0 0 2024-09-10T10:04:20.645 INFO:tasks.workunit.client.1.smithi107.stdout:7/530: creat d0/d99/fa4 x:0 0 0 2024-09-10T10:04:20.645 INFO:tasks.workunit.client.0.smithi071.stdout:5/462: dwrite dc/df/f38 [0,4194304] 0 2024-09-10T10:04:20.648 INFO:tasks.workunit.client.1.smithi107.stdout:0/571: creat d6/d8/d2f/d35/fb2 x:0 0 0 2024-09-10T10:04:20.648 INFO:tasks.workunit.client.0.smithi071.stdout:6/464: rmdir d4/da/df/d2e/d3a/d43 39 2024-09-10T10:04:20.649 INFO:tasks.workunit.client.1.smithi107.stdout:5/643: fdatasync de/d20/f37 0 2024-09-10T10:04:20.652 INFO:tasks.workunit.client.0.smithi071.stdout:5/463: fdatasync dc/f13 0 2024-09-10T10:04:20.653 INFO:tasks.workunit.client.1.smithi107.stdout:8/480: mkdir d5/da2 0 2024-09-10T10:04:20.656 INFO:tasks.workunit.client.0.smithi071.stdout:6/465: creat d4/da/df/d2e/d3a/d40/d60/d7a/f9b x:0 0 0 2024-09-10T10:04:20.656 INFO:tasks.workunit.client.0.smithi071.stdout:0/528: dwrite d11/d30/d52/f8f [0,4194304] 0 2024-09-10T10:04:20.656 INFO:tasks.workunit.client.1.smithi107.stdout:8/481: fsync d5/d8/d66/d8b/d21/d83/f84 0 2024-09-10T10:04:20.658 INFO:tasks.workunit.client.1.smithi107.stdout:9/552: dwrite d5/d1e/f9f [0,4194304] 0 2024-09-10T10:04:20.660 INFO:tasks.workunit.client.0.smithi071.stdout:1/603: unlink d1/d21/d2f/d30/f79 0 2024-09-10T10:04:20.661 INFO:tasks.workunit.client.0.smithi071.stdout:0/529: fsync d11/d30/d52/f80 0 2024-09-10T10:04:20.662 INFO:tasks.workunit.client.1.smithi107.stdout:9/553: chown d5/d7/d1d/d29/f99 1519244349 1 2024-09-10T10:04:20.662 INFO:tasks.workunit.client.1.smithi107.stdout:0/572: dwrite d6/d8/d2f/d35/d3c/d58/f73 [0,4194304] 0 2024-09-10T10:04:20.662 INFO:tasks.workunit.client.0.smithi071.stdout:5/464: unlink dc/df/d29/c9c 0 2024-09-10T10:04:20.662 INFO:tasks.workunit.client.1.smithi107.stdout:9/554: readlink d5/d7/d1d/l98 0 2024-09-10T10:04:20.663 INFO:tasks.workunit.client.1.smithi107.stdout:9/555: fsync d5/d7/fb8 0 2024-09-10T10:04:20.664 INFO:tasks.workunit.client.0.smithi071.stdout:6/466: truncate d4/da/df/d2e/d3a/d40/f58 1151901 0 2024-09-10T10:04:20.664 INFO:tasks.workunit.client.0.smithi071.stdout:0/530: symlink d11/d30/d52/d79/lbb 0 2024-09-10T10:04:20.664 INFO:tasks.workunit.client.0.smithi071.stdout:6/467: write d4/f38 [1559475,90891] 0 2024-09-10T10:04:20.665 INFO:tasks.workunit.client.1.smithi107.stdout:2/645: mkdir d3/d8f/de0 0 2024-09-10T10:04:20.665 INFO:tasks.workunit.client.0.smithi071.stdout:0/531: chown d11/d22/f4e 3034487 1 2024-09-10T10:04:20.665 INFO:tasks.workunit.client.0.smithi071.stdout:1/604: chown d1/d21/d2f/d30/d6a/d91/cb8 2217102 1 2024-09-10T10:04:20.666 INFO:tasks.workunit.client.0.smithi071.stdout:1/605: chown d1/l1c 195 1 2024-09-10T10:04:20.668 INFO:tasks.workunit.client.1.smithi107.stdout:1/688: write d2/d36/fba [1783892,120314] 0 2024-09-10T10:04:20.671 INFO:tasks.workunit.client.0.smithi071.stdout:1/606: symlink d1/d21/d3d/d4a/lcb 0 2024-09-10T10:04:20.671 INFO:tasks.workunit.client.0.smithi071.stdout:5/465: rename dc/c91 to dc/df/d29/c9e 0 2024-09-10T10:04:20.673 INFO:tasks.workunit.client.0.smithi071.stdout:0/532: symlink d11/lbc 0 2024-09-10T10:04:20.673 INFO:tasks.workunit.client.0.smithi071.stdout:1/607: truncate d1/d21/d2f/f7c 624079 0 2024-09-10T10:04:20.674 INFO:tasks.workunit.client.1.smithi107.stdout:0/573: dwrite d6/d5a/da9/fa7 [0,4194304] 0 2024-09-10T10:04:20.674 INFO:tasks.workunit.client.1.smithi107.stdout:9/556: symlink d5/d7/d3c/lc2 0 2024-09-10T10:04:20.674 INFO:tasks.workunit.client.1.smithi107.stdout:7/531: dread d0/d8/f18 [4194304,4194304] 0 2024-09-10T10:04:20.675 INFO:tasks.workunit.client.1.smithi107.stdout:0/574: read d6/d8/d2f/d2e/d32/f6c [230370,115777] 0 2024-09-10T10:04:20.681 INFO:tasks.workunit.client.0.smithi071.stdout:9/842: dread d0/db/d1b/d1d/d30/f7d [0,4194304] 0 2024-09-10T10:04:20.681 INFO:tasks.workunit.client.0.smithi071.stdout:5/466: dwrite f4 [0,4194304] 0 2024-09-10T10:04:20.682 INFO:tasks.workunit.client.1.smithi107.stdout:7/532: readlink d0/d8/d56/l83 0 2024-09-10T10:04:20.682 INFO:tasks.workunit.client.0.smithi071.stdout:1/608: rename d1/d70/d76/cc8 to d1/d57/ccc 0 2024-09-10T10:04:20.683 INFO:tasks.workunit.client.1.smithi107.stdout:3/936: rename dc/dd/d20/d23/d39/d69/c72 to dc/dd/d45/d26/d41/dda/c139 0 2024-09-10T10:04:20.683 INFO:tasks.workunit.client.1.smithi107.stdout:9/557: truncate d5/d7/d1d/fa0 522556 0 2024-09-10T10:04:20.684 INFO:tasks.workunit.client.1.smithi107.stdout:0/575: chown d6/d8/d2f/d2e/d32/d56/f8c 36 1 2024-09-10T10:04:20.685 INFO:tasks.workunit.client.1.smithi107.stdout:5/644: link de/f2d de/d4a/d4e/fe1 0 2024-09-10T10:04:20.685 INFO:tasks.workunit.client.0.smithi071.stdout:0/533: truncate d11/d30/f3c 1522262 0 2024-09-10T10:04:20.686 INFO:tasks.workunit.client.0.smithi071.stdout:9/843: write d0/db/d1b/d1d/d30/d54/d27/d6e/f9a [436078,42386] 0 2024-09-10T10:04:20.687 INFO:tasks.workunit.client.1.smithi107.stdout:5/645: write f8 [999349,77894] 0 2024-09-10T10:04:20.687 INFO:tasks.workunit.client.1.smithi107.stdout:7/533: chown d0/d20/c39 0 1 2024-09-10T10:04:20.689 INFO:tasks.workunit.client.0.smithi071.stdout:1/609: creat d1/d70/fcd x:0 0 0 2024-09-10T10:04:20.689 INFO:tasks.workunit.client.1.smithi107.stdout:5/646: truncate de/d20/d3d/dd4/fde 262402 0 2024-09-10T10:04:20.690 INFO:tasks.workunit.client.1.smithi107.stdout:7/534: dread d0/d20/d35/f9f [0,4194304] 0 2024-09-10T10:04:20.691 INFO:tasks.workunit.client.1.smithi107.stdout:5/647: stat de/d4a/d7e/fab 0 2024-09-10T10:04:20.691 INFO:tasks.workunit.client.0.smithi071.stdout:1/610: truncate d1/f8e 477905 0 2024-09-10T10:04:20.691 INFO:tasks.workunit.client.1.smithi107.stdout:7/535: readlink d0/d8/d56/l83 0 2024-09-10T10:04:20.693 INFO:tasks.workunit.client.0.smithi071.stdout:9/844: symlink d0/db/d1b/d1d/d4b/db9/lfd 0 2024-09-10T10:04:20.693 INFO:tasks.workunit.client.1.smithi107.stdout:7/536: write d0/d8/d56/f82 [392970,108186] 0 2024-09-10T10:04:20.694 INFO:tasks.workunit.client.0.smithi071.stdout:9/845: readlink d0/d3b/d5c/d6a/lbb 0 2024-09-10T10:04:20.694 INFO:tasks.workunit.client.1.smithi107.stdout:6/590: dwrite d0/d3d/d14/d42/f7a [0,4194304] 0 2024-09-10T10:04:20.695 INFO:tasks.workunit.client.0.smithi071.stdout:1/611: creat d1/d21/d65/fce x:0 0 0 2024-09-10T10:04:20.697 INFO:tasks.workunit.client.0.smithi071.stdout:1/612: dread - d1/d21/d65/fa5 zero size 2024-09-10T10:04:20.698 INFO:tasks.workunit.client.0.smithi071.stdout:9/846: mknod d0/d3b/d5c/d6a/cfe 0 2024-09-10T10:04:20.700 INFO:tasks.workunit.client.1.smithi107.stdout:3/937: symlink dc/dd/d45/d26/d59/d78/l13a 0 2024-09-10T10:04:20.700 INFO:tasks.workunit.client.0.smithi071.stdout:1/613: creat d1/d70/d76/fcf x:0 0 0 2024-09-10T10:04:20.701 INFO:tasks.workunit.client.1.smithi107.stdout:9/558: symlink d5/d7/d1d/d41/lc3 0 2024-09-10T10:04:20.701 INFO:tasks.workunit.client.0.smithi071.stdout:9/847: creat d0/db/d1b/d1d/d4b/dad/fff x:0 0 0 2024-09-10T10:04:20.702 INFO:tasks.workunit.client.1.smithi107.stdout:0/576: creat d6/d8/d3e/d43/fb3 x:0 0 0 2024-09-10T10:04:20.704 INFO:tasks.workunit.client.0.smithi071.stdout:1/614: symlink d1/d70/ld0 0 2024-09-10T10:04:20.706 INFO:tasks.workunit.client.1.smithi107.stdout:5/648: creat de/d20/d2b/d4b/d8c/fe2 x:0 0 0 2024-09-10T10:04:20.706 INFO:tasks.workunit.client.0.smithi071.stdout:9/848: mknod d0/db/d1b/d1d/d30/d54/df7/c100 0 2024-09-10T10:04:20.708 INFO:tasks.workunit.client.1.smithi107.stdout:1/689: dwrite d2/f49 [0,4194304] 0 2024-09-10T10:04:20.708 INFO:tasks.workunit.client.0.smithi071.stdout:9/849: rmdir d0/d3b/d5c/d6a/dd3 39 2024-09-10T10:04:20.713 INFO:tasks.workunit.client.0.smithi071.stdout:9/850: dread d0/db/f15 [0,4194304] 0 2024-09-10T10:04:20.714 INFO:tasks.workunit.client.0.smithi071.stdout:6/468: write d4/da/df/d2e/d3a/d3e/d5d/f8f [437602,86631] 0 2024-09-10T10:04:20.716 INFO:tasks.workunit.client.1.smithi107.stdout:8/482: truncate d5/d42/f65 2592530 0 2024-09-10T10:04:20.719 INFO:tasks.workunit.client.0.smithi071.stdout:1/615: link d1/d21/d2f/d30/d6a/d91/f9c d1/d21/d3d/d9a/fd1 0 2024-09-10T10:04:20.720 INFO:tasks.workunit.client.0.smithi071.stdout:6/469: creat d4/da/df/d2e/d3a/d3e/d5d/f9c x:0 0 0 2024-09-10T10:04:20.720 INFO:tasks.workunit.client.0.smithi071.stdout:9/851: fsync d0/db/d1b/d1d/f1f 0 2024-09-10T10:04:20.722 INFO:tasks.workunit.client.0.smithi071.stdout:5/467: dread dc/f3c [0,4194304] 0 2024-09-10T10:04:20.724 INFO:tasks.workunit.client.1.smithi107.stdout:1/690: rename d2/d36/dbc/fda to d2/d12/d65/fdf 0 2024-09-10T10:04:20.724 INFO:tasks.workunit.client.0.smithi071.stdout:9/852: truncate d0/db/d1b/d1d/d30/faf 769577 0 2024-09-10T10:04:20.725 INFO:tasks.workunit.client.1.smithi107.stdout:1/691: write d2/d35/f3b [5726738,127317] 0 2024-09-10T10:04:20.726 INFO:tasks.workunit.client.0.smithi071.stdout:1/616: rename d1/d21/d3d/d9a/f5d to d1/d21/d3d/d83/db6/fd2 0 2024-09-10T10:04:20.727 INFO:tasks.workunit.client.1.smithi107.stdout:8/483: stat d5/d8/d66/d8b/d21/f73 0 2024-09-10T10:04:20.729 INFO:tasks.workunit.client.0.smithi071.stdout:0/534: dread d11/d22/f23 [0,4194304] 0 2024-09-10T10:04:20.731 INFO:tasks.workunit.client.1.smithi107.stdout:9/559: creat d5/d7/d1d/d9b/dab/d57/d87/fc4 x:0 0 0 2024-09-10T10:04:20.732 INFO:tasks.workunit.client.0.smithi071.stdout:1/617: creat d1/d3f/fd3 x:0 0 0 2024-09-10T10:04:20.733 INFO:tasks.workunit.client.1.smithi107.stdout:6/591: dread d0/d3d/d14/d17/d49/f5a [4194304,4194304] 0 2024-09-10T10:04:20.733 INFO:tasks.workunit.client.0.smithi071.stdout:1/618: read d1/d3f/f84 [4491610,40980] 0 2024-09-10T10:04:20.734 INFO:tasks.workunit.client.1.smithi107.stdout:6/592: fsync d0/d3d/d14/d17/d49/f92 0 2024-09-10T10:04:20.735 INFO:tasks.workunit.client.0.smithi071.stdout:1/619: write d1/d21/d2f/d30/d6a/f6d [4255663,42077] 0 2024-09-10T10:04:20.736 INFO:tasks.workunit.client.1.smithi107.stdout:1/692: mknod d2/d12/d65/db4/ce0 0 2024-09-10T10:04:20.737 INFO:tasks.workunit.client.1.smithi107.stdout:8/484: truncate d5/d8/d66/d8b/d1a/f46 326943 0 2024-09-10T10:04:20.739 INFO:tasks.workunit.client.0.smithi071.stdout:1/620: mkdir d1/d70/d76/dd4 0 2024-09-10T10:04:20.739 INFO:tasks.workunit.client.0.smithi071.stdout:5/468: dread dc/df/f33 [0,4194304] 0 2024-09-10T10:04:20.740 INFO:tasks.workunit.client.1.smithi107.stdout:7/537: truncate d0/d1b/f28 2301143 0 2024-09-10T10:04:20.741 INFO:tasks.workunit.client.1.smithi107.stdout:9/560: rename d5/d7/d1d/d9b/db1 to d5/d1e/dc5 0 2024-09-10T10:04:20.742 INFO:tasks.workunit.client.0.smithi071.stdout:5/469: creat dc/df/d17/d22/d87/f9f x:0 0 0 2024-09-10T10:04:20.742 INFO:tasks.workunit.client.0.smithi071.stdout:9/853: getdents d0/db/d1b 0 2024-09-10T10:04:20.743 INFO:tasks.workunit.client.0.smithi071.stdout:5/470: readlink dc/df/d29/d48/l9b 0 2024-09-10T10:04:20.745 INFO:tasks.workunit.client.1.smithi107.stdout:3/938: dwrite dc/dd/d45/d26/d59/d5f/f8e [0,4194304] 0 2024-09-10T10:04:20.747 INFO:tasks.workunit.client.1.smithi107.stdout:0/577: dwrite d6/f7 [4194304,4194304] 0 2024-09-10T10:04:20.747 INFO:tasks.workunit.client.1.smithi107.stdout:5/649: getdents de/d4a/d7e/db2/dbc 0 2024-09-10T10:04:20.750 INFO:tasks.workunit.client.1.smithi107.stdout:1/693: dwrite d2/d6/d24/fae [0,4194304] 0 2024-09-10T10:04:20.752 INFO:tasks.workunit.client.1.smithi107.stdout:9/561: truncate d5/d7/d1d/d95/faf 750848 0 2024-09-10T10:04:20.757 INFO:tasks.workunit.client.0.smithi071.stdout:9/854: dread d0/d3b/d5c/f74 [0,4194304] 0 2024-09-10T10:04:20.761 INFO:tasks.workunit.client.1.smithi107.stdout:5/650: symlink de/d4a/d5c/d6d/le3 0 2024-09-10T10:04:20.761 INFO:tasks.workunit.client.1.smithi107.stdout:1/694: mkdir d2/d12/d65/de1 0 2024-09-10T10:04:20.763 INFO:tasks.workunit.client.1.smithi107.stdout:3/939: rename dc/dd/d45/d26/fc8 to dc/dd/d20/d23/d2f/d9c/f13b 0 2024-09-10T10:04:20.767 INFO:tasks.workunit.client.1.smithi107.stdout:9/562: fsync d5/d7/d1d/d9b/dab/f5d 0 2024-09-10T10:04:20.767 INFO:tasks.workunit.client.1.smithi107.stdout:0/578: dwrite d6/d8/d2f/d2e/f52 [0,4194304] 0 2024-09-10T10:04:20.768 INFO:tasks.workunit.client.1.smithi107.stdout:9/563: stat d5/d7/d1d/d41/d97 0 2024-09-10T10:04:20.769 INFO:tasks.workunit.client.1.smithi107.stdout:9/564: dread - d5/d7/d1d/d9b/dab/f5d zero size 2024-09-10T10:04:20.769 INFO:tasks.workunit.client.0.smithi071.stdout:5/471: dread dc/df/d3e/f63 [0,4194304] 0 2024-09-10T10:04:20.770 INFO:tasks.workunit.client.1.smithi107.stdout:7/538: link d0/d20/d72/f7b d0/d8/d5c/d6d/fa5 0 2024-09-10T10:04:20.772 INFO:tasks.workunit.client.0.smithi071.stdout:9/855: symlink d0/d3b/d5c/d6a/dd3/de1/l101 0 2024-09-10T10:04:20.774 INFO:tasks.workunit.client.0.smithi071.stdout:5/472: getdents dc/df/d29/d94 0 2024-09-10T10:04:20.774 INFO:tasks.workunit.client.1.smithi107.stdout:6/593: getdents d0/d3d/d14/d21/d8a 0 2024-09-10T10:04:20.777 INFO:tasks.workunit.client.0.smithi071.stdout:1/621: truncate d1/d70/f8b 365904 0 2024-09-10T10:04:20.779 INFO:tasks.workunit.client.0.smithi071.stdout:9/856: creat d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/f102 x:0 0 0 2024-09-10T10:04:20.780 INFO:tasks.workunit.client.0.smithi071.stdout:5/473: getdents dc 0 2024-09-10T10:04:20.780 INFO:tasks.workunit.client.1.smithi107.stdout:1/695: rename d2/d12/d5a/l7d to d2/d35/le2 0 2024-09-10T10:04:20.781 INFO:tasks.workunit.client.0.smithi071.stdout:9/857: read d0/db/d1b/d1d/d4b/db9/fce [2925346,128528] 0 2024-09-10T10:04:20.781 INFO:tasks.workunit.client.1.smithi107.stdout:1/696: fdatasync d2/d36/fba 0 2024-09-10T10:04:20.785 INFO:tasks.workunit.client.1.smithi107.stdout:0/579: creat d6/d8/d2f/d2e/d32/d85/fb4 x:0 0 0 2024-09-10T10:04:20.785 INFO:tasks.workunit.client.1.smithi107.stdout:7/539: rmdir d0/d8/d56 39 2024-09-10T10:04:20.786 INFO:tasks.workunit.client.0.smithi071.stdout:3/537: sync 2024-09-10T10:04:20.786 INFO:tasks.workunit.client.0.smithi071.stdout:4/536: sync 2024-09-10T10:04:20.786 INFO:tasks.workunit.client.0.smithi071.stdout:2/541: sync 2024-09-10T10:04:20.786 INFO:tasks.workunit.client.0.smithi071.stdout:5/474: link dc/df/d17/d22/c30 dc/df/d29/ca0 0 2024-09-10T10:04:20.787 INFO:tasks.workunit.client.0.smithi071.stdout:2/542: chown d8/d87/f7a 0 1 2024-09-10T10:04:20.787 INFO:tasks.workunit.client.1.smithi107.stdout:0/580: write d6/d8/f15 [3192023,38711] 0 2024-09-10T10:04:20.790 INFO:tasks.workunit.client.1.smithi107.stdout:5/651: creat de/d20/d3d/dd4/fe4 x:0 0 0 2024-09-10T10:04:20.790 INFO:tasks.workunit.client.1.smithi107.stdout:1/697: dwrite d2/d36/fa3 [0,4194304] 0 2024-09-10T10:04:20.790 INFO:tasks.workunit.client.0.smithi071.stdout:3/538: rename d3/d20/d39 to d3/d1c/d3c/da1/d3a/dbd 0 2024-09-10T10:04:20.791 INFO:tasks.workunit.client.0.smithi071.stdout:9/858: symlink d0/db/d1b/d1d/d4b/l103 0 2024-09-10T10:04:20.791 INFO:tasks.workunit.client.1.smithi107.stdout:5/652: chown de/d20/f26 3 1 2024-09-10T10:04:20.792 INFO:tasks.workunit.client.0.smithi071.stdout:2/543: creat d8/d87/d49/d66/fb4 x:0 0 0 2024-09-10T10:04:20.794 INFO:tasks.workunit.client.0.smithi071.stdout:2/544: fdatasync d8/d38/f70 0 2024-09-10T10:04:20.794 INFO:tasks.workunit.client.0.smithi071.stdout:9/859: chown d0/db/d1b/d1d/f40 1 1 2024-09-10T10:04:20.798 INFO:tasks.workunit.client.1.smithi107.stdout:7/540: creat d0/d1b/d4d/fa6 x:0 0 0 2024-09-10T10:04:20.798 INFO:tasks.workunit.client.0.smithi071.stdout:4/537: dwrite db/d15/d17/d4e/f9c [0,4194304] 0 2024-09-10T10:04:20.801 INFO:tasks.workunit.client.1.smithi107.stdout:0/581: dread d6/d8/d2f/d2e/d32/f5d [0,4194304] 0 2024-09-10T10:04:20.803 INFO:tasks.workunit.client.0.smithi071.stdout:2/545: dread d8/d4a/f97 [0,4194304] 0 2024-09-10T10:04:20.804 INFO:tasks.workunit.client.1.smithi107.stdout:1/698: creat d2/d12/d65/db4/dd9/fe3 x:0 0 0 2024-09-10T10:04:20.805 INFO:tasks.workunit.client.0.smithi071.stdout:3/539: mkdir d3/d1c/d3c/da1/d3a/dba/dbe 0 2024-09-10T10:04:20.805 INFO:tasks.workunit.client.0.smithi071.stdout:4/538: mkdir db/d15/d26/db2 0 2024-09-10T10:04:20.806 INFO:tasks.workunit.client.0.smithi071.stdout:4/539: stat db/d15/f94 0 2024-09-10T10:04:20.807 INFO:tasks.workunit.client.1.smithi107.stdout:7/541: dwrite d0/d1b/d4d/d69/d97/d68/f75 [0,4194304] 0 2024-09-10T10:04:20.807 INFO:tasks.workunit.client.1.smithi107.stdout:5/653: mknod de/d20/ce5 0 2024-09-10T10:04:20.807 INFO:tasks.workunit.client.0.smithi071.stdout:9/860: dread d0/f2e [0,4194304] 0 2024-09-10T10:04:20.809 INFO:tasks.workunit.client.0.smithi071.stdout:2/546: rmdir d8/d24 39 2024-09-10T10:04:20.809 INFO:tasks.workunit.client.0.smithi071.stdout:3/540: unlink d3/d49/c2a 0 2024-09-10T10:04:20.810 INFO:tasks.workunit.client.1.smithi107.stdout:0/582: chown d6/d14/c3d 518020082 1 2024-09-10T10:04:20.810 INFO:tasks.workunit.client.0.smithi071.stdout:4/540: creat db/d15/d4b/fb3 x:0 0 0 2024-09-10T10:04:20.813 INFO:tasks.workunit.client.0.smithi071.stdout:3/541: truncate d3/d1c/d3c/da1/fa9 196645 0 2024-09-10T10:04:20.813 INFO:tasks.workunit.client.1.smithi107.stdout:3/940: rename dc/dd/d45/d26/d41/d44/d63/fee to dc/f13c 0 2024-09-10T10:04:20.814 INFO:tasks.workunit.client.0.smithi071.stdout:1/622: dread d1/d21/d2f/d30/f73 [0,4194304] 0 2024-09-10T10:04:20.815 INFO:tasks.workunit.client.1.smithi107.stdout:1/699: creat d2/d12/d5a/fe4 x:0 0 0 2024-09-10T10:04:20.817 INFO:tasks.workunit.client.1.smithi107.stdout:1/700: dread - d2/d12/d5a/fe4 zero size 2024-09-10T10:04:20.817 INFO:tasks.workunit.client.1.smithi107.stdout:1/701: chown d2/c17 0 1 2024-09-10T10:04:20.819 INFO:tasks.workunit.client.0.smithi071.stdout:3/542: mknod d3/d1c/d3e/d77/cbf 0 2024-09-10T10:04:20.819 INFO:tasks.workunit.client.0.smithi071.stdout:2/547: fdatasync d8/d87/f25 0 2024-09-10T10:04:20.820 INFO:tasks.workunit.client.1.smithi107.stdout:0/583: rmdir d6 39 2024-09-10T10:04:20.821 INFO:tasks.workunit.client.0.smithi071.stdout:1/623: dwrite d1/d35/fa8 [0,4194304] 0 2024-09-10T10:04:20.822 INFO:tasks.workunit.client.1.smithi107.stdout:3/941: dwrite dc/dd/d45/d26/d41/d44/d63/d101/f11f [0,4194304] 0 2024-09-10T10:04:20.824 INFO:tasks.workunit.client.1.smithi107.stdout:3/942: write dc/dd/d42/de8/fe9 [282391,125737] 0 2024-09-10T10:04:20.824 INFO:tasks.workunit.client.0.smithi071.stdout:2/548: creat d8/d87/d33/fb5 x:0 0 0 2024-09-10T10:04:20.826 INFO:tasks.workunit.client.1.smithi107.stdout:6/594: rename d0/d3d/d14/d21/d83 to d0/d3d/d14/d9f/dca 0 2024-09-10T10:04:20.828 INFO:tasks.workunit.client.1.smithi107.stdout:3/943: dread dc/dd/d42/d55/fb3 [0,4194304] 0 2024-09-10T10:04:20.830 INFO:tasks.workunit.client.0.smithi071.stdout:3/543: dwrite d3/d1c/d3c/da1/d5d/d7a/f89 [0,4194304] 0 2024-09-10T10:04:20.831 INFO:tasks.workunit.client.0.smithi071.stdout:3/544: chown d3/d1c/f79 44 1 2024-09-10T10:04:20.833 INFO:tasks.workunit.client.0.smithi071.stdout:3/545: dread - d3/d1c/d3c/da1/fb7 zero size 2024-09-10T10:04:20.834 INFO:tasks.workunit.client.0.smithi071.stdout:9/861: rmdir d0/db/d1b/d1d 39 2024-09-10T10:04:20.837 INFO:tasks.workunit.client.0.smithi071.stdout:3/546: mkdir d3/d1c/d3c/da1/d3a/dc0 0 2024-09-10T10:04:20.839 INFO:tasks.workunit.client.0.smithi071.stdout:9/862: fsync d0/d3b/d5c/ff4 0 2024-09-10T10:04:20.843 INFO:tasks.workunit.client.1.smithi107.stdout:5/654: dread f1 [0,4194304] 0 2024-09-10T10:04:20.843 INFO:tasks.workunit.client.0.smithi071.stdout:1/624: creat d1/d21/fd5 x:0 0 0 2024-09-10T10:04:20.843 INFO:tasks.workunit.client.0.smithi071.stdout:3/547: dwrite d3/d10/f84 [0,4194304] 0 2024-09-10T10:04:20.846 INFO:tasks.workunit.client.0.smithi071.stdout:9/863: mknod d0/db/d20/dd8/c104 0 2024-09-10T10:04:20.847 INFO:tasks.workunit.client.0.smithi071.stdout:1/625: symlink d1/d21/d2f/d30/d75/d97/ld6 0 2024-09-10T10:04:20.847 INFO:tasks.workunit.client.0.smithi071.stdout:3/548: mknod d3/d1c/d3c/da1/d42/d4a/cc1 0 2024-09-10T10:04:20.851 INFO:tasks.workunit.client.1.smithi107.stdout:7/542: rename d0/d99/l80 to d0/d8/dc/la7 0 2024-09-10T10:04:20.852 INFO:tasks.workunit.client.1.smithi107.stdout:7/543: write d0/d20/d35/f98 [481785,6426] 0 2024-09-10T10:04:20.852 INFO:tasks.workunit.client.0.smithi071.stdout:4/541: write db/d15/d26/d43/fa5 [775819,68498] 0 2024-09-10T10:04:20.855 INFO:tasks.workunit.client.1.smithi107.stdout:5/655: creat de/d20/d2b/d4b/d5e/d9a/fe6 x:0 0 0 2024-09-10T10:04:20.856 INFO:tasks.workunit.client.1.smithi107.stdout:7/544: dread d0/d8/f32 [0,4194304] 0 2024-09-10T10:04:20.859 INFO:tasks.workunit.client.0.smithi071.stdout:4/542: truncate db/d1d/f36 2089810 0 2024-09-10T10:04:20.859 INFO:tasks.workunit.client.0.smithi071.stdout:9/864: write d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f8d [107906,120438] 0 2024-09-10T10:04:20.859 INFO:tasks.workunit.client.1.smithi107.stdout:5/656: creat de/db3/db6/fe7 x:0 0 0 2024-09-10T10:04:20.862 INFO:tasks.workunit.client.0.smithi071.stdout:1/626: dwrite d1/d21/d3d/f4f [4194304,4194304] 0 2024-09-10T10:04:20.863 INFO:tasks.workunit.client.1.smithi107.stdout:0/584: getdents d6/d5a/d5c 0 2024-09-10T10:04:20.864 INFO:tasks.workunit.client.0.smithi071.stdout:9/865: truncate d0/db/d1b/d1d/d30/d54/fc6 4330307 0 2024-09-10T10:04:20.864 INFO:tasks.workunit.client.0.smithi071.stdout:1/627: chown d1/d3f/d58/daf 47125 1 2024-09-10T10:04:20.865 INFO:tasks.workunit.client.1.smithi107.stdout:5/657: dwrite f1 [0,4194304] 0 2024-09-10T10:04:20.865 INFO:tasks.workunit.client.0.smithi071.stdout:1/628: write d1/d57/f6b [2669527,112507] 0 2024-09-10T10:04:20.867 INFO:tasks.workunit.client.1.smithi107.stdout:7/545: getdents d0/d1b/d4d 0 2024-09-10T10:04:20.869 INFO:tasks.workunit.client.0.smithi071.stdout:2/549: dread d8/d24/f5c [0,4194304] 0 2024-09-10T10:04:20.869 INFO:tasks.workunit.client.1.smithi107.stdout:0/585: symlink d6/d8/d2f/d2e/lb5 0 2024-09-10T10:04:20.870 INFO:tasks.workunit.client.0.smithi071.stdout:9/866: rmdir d0/db/d20 39 2024-09-10T10:04:20.873 INFO:tasks.workunit.client.0.smithi071.stdout:2/550: stat d8/d87/d33/l3e 0 2024-09-10T10:04:20.875 INFO:tasks.workunit.client.0.smithi071.stdout:1/629: rename d1/d21/d2f/d30/d6a/c86 to d1/d3f/d58/daf/cd7 0 2024-09-10T10:04:20.879 INFO:tasks.workunit.client.0.smithi071.stdout:2/551: mkdir d8/db6 0 2024-09-10T10:04:20.879 INFO:tasks.workunit.client.0.smithi071.stdout:9/867: dwrite d0/d3b/d44/f5f [0,4194304] 0 2024-09-10T10:04:20.880 INFO:tasks.workunit.client.0.smithi071.stdout:3/549: dread d3/f18 [0,4194304] 0 2024-09-10T10:04:20.881 INFO:tasks.workunit.client.0.smithi071.stdout:4/543: write db/d15/f85 [1125055,17351] 0 2024-09-10T10:04:20.881 INFO:tasks.workunit.client.1.smithi107.stdout:6/595: dwrite d0/d3d/d14/d21/f33 [0,4194304] 0 2024-09-10T10:04:20.881 INFO:tasks.workunit.client.0.smithi071.stdout:9/868: stat d0/db/d1b/d1d/f1f 0 2024-09-10T10:04:20.882 INFO:tasks.workunit.client.1.smithi107.stdout:7/546: link d0/d1b/d4d/d69/d97/d3d/f55 d0/d8/fa8 0 2024-09-10T10:04:20.883 INFO:tasks.workunit.client.1.smithi107.stdout:5/658: dwrite de/fb8 [0,4194304] 0 2024-09-10T10:04:20.883 INFO:tasks.workunit.client.0.smithi071.stdout:4/544: chown db/d15/d17/d4e/d5a/d8d/l99 2 1 2024-09-10T10:04:20.885 INFO:tasks.workunit.client.1.smithi107.stdout:1/702: write d2/d12/d65/d6b/f41 [1718719,112802] 0 2024-09-10T10:04:20.886 INFO:tasks.workunit.client.0.smithi071.stdout:9/869: write d0/db/d1b/d1d/d30/fe5 [3444116,31322] 0 2024-09-10T10:04:20.887 INFO:tasks.workunit.client.0.smithi071.stdout:1/630: creat d1/d21/d2f/d30/fd8 x:0 0 0 2024-09-10T10:04:20.887 INFO:tasks.workunit.client.0.smithi071.stdout:3/550: mkdir d3/d49/d2f/dc2 0 2024-09-10T10:04:20.888 INFO:tasks.workunit.client.1.smithi107.stdout:0/586: dwrite d6/d8/d2f/d2e/d32/d59/f67 [0,4194304] 0 2024-09-10T10:04:20.888 INFO:tasks.workunit.client.1.smithi107.stdout:1/703: read - d2/d35/d9c/fc0 zero size 2024-09-10T10:04:20.888 INFO:tasks.workunit.client.0.smithi071.stdout:1/631: write d1/d57/f6b [4565281,23626] 0 2024-09-10T10:04:20.890 INFO:tasks.workunit.client.1.smithi107.stdout:6/596: chown d0/d3d/d14/d9f/dca/f86 64609169 1 2024-09-10T10:04:20.890 INFO:tasks.workunit.client.0.smithi071.stdout:9/870: dread - d0/db/fe2 zero size 2024-09-10T10:04:20.893 INFO:tasks.workunit.client.0.smithi071.stdout:2/552: creat d8/d38/d63/fb7 x:0 0 0 2024-09-10T10:04:20.894 INFO:tasks.workunit.client.0.smithi071.stdout:2/553: fdatasync d8/d87/d51/f84 0 2024-09-10T10:04:20.895 INFO:tasks.workunit.client.1.smithi107.stdout:1/704: creat d2/d35/d9c/fe5 x:0 0 0 2024-09-10T10:04:20.896 INFO:tasks.workunit.client.0.smithi071.stdout:3/551: mknod d3/d1c/d3c/da1/cc3 0 2024-09-10T10:04:20.897 INFO:tasks.workunit.client.0.smithi071.stdout:9/871: mknod d0/d3b/d5c/d6a/c105 0 2024-09-10T10:04:20.897 INFO:tasks.workunit.client.1.smithi107.stdout:6/597: write d0/d3d/d14/d17/d24/f6f [1952499,52872] 0 2024-09-10T10:04:20.897 INFO:tasks.workunit.client.1.smithi107.stdout:4/711: sync 2024-09-10T10:04:20.898 INFO:tasks.workunit.client.0.smithi071.stdout:1/632: mknod d1/cd9 0 2024-09-10T10:04:20.899 INFO:tasks.workunit.client.1.smithi107.stdout:1/705: chown d2/d12/d7e/faf 133449539 1 2024-09-10T10:04:20.902 INFO:tasks.workunit.client.0.smithi071.stdout:3/552: symlink d3/d49/d2f/db9/lc4 0 2024-09-10T10:04:20.902 INFO:tasks.workunit.client.0.smithi071.stdout:9/872: write d0/db/d1b/f78 [673924,20667] 0 2024-09-10T10:04:20.904 INFO:tasks.workunit.client.1.smithi107.stdout:3/944: dwrite dc/dd/d20/d23/d2f/d9c/f13b [0,4194304] 0 2024-09-10T10:04:20.905 INFO:tasks.workunit.client.1.smithi107.stdout:4/712: unlink d0/d1f/d20/l45 0 2024-09-10T10:04:20.906 INFO:tasks.workunit.client.0.smithi071.stdout:9/873: fdatasync d0/d3b/d5c/d6a/f99 0 2024-09-10T10:04:20.906 INFO:tasks.workunit.client.0.smithi071.stdout:2/554: symlink d8/d87/d33/d41/d4d/d5e/dac/lb8 0 2024-09-10T10:04:20.907 INFO:tasks.workunit.client.1.smithi107.stdout:1/706: fdatasync d2/d6/d67/f77 0 2024-09-10T10:04:20.907 INFO:tasks.workunit.client.1.smithi107.stdout:7/547: dwrite d0/d8/d56/f8e [0,4194304] 0 2024-09-10T10:04:20.908 INFO:tasks.workunit.client.0.smithi071.stdout:2/555: write d8/d38/d47/d59/d65/faf [85429,59525] 0 2024-09-10T10:04:20.909 INFO:tasks.workunit.client.1.smithi107.stdout:1/707: readlink d2/d12/l60 0 2024-09-10T10:04:20.911 INFO:tasks.workunit.client.1.smithi107.stdout:6/598: dwrite d0/d76/fb8 [0,4194304] 0 2024-09-10T10:04:20.913 INFO:tasks.workunit.client.0.smithi071.stdout:2/556: read d8/d87/d33/d41/d4d/f85 [38297,31324] 0 2024-09-10T10:04:20.913 INFO:tasks.workunit.client.1.smithi107.stdout:4/713: unlink d0/d1f/d20/d47/d8c/fb4 0 2024-09-10T10:04:20.915 INFO:tasks.workunit.client.1.smithi107.stdout:7/548: symlink d0/d20/d72/la9 0 2024-09-10T10:04:20.918 INFO:tasks.workunit.client.1.smithi107.stdout:3/945: symlink dc/dd/d42/l13d 0 2024-09-10T10:04:20.919 INFO:tasks.workunit.client.1.smithi107.stdout:3/946: dread - dc/dd/d45/d26/d41/d74/f111 zero size 2024-09-10T10:04:20.920 INFO:tasks.workunit.client.1.smithi107.stdout:3/947: chown dc/dd/d45/d26/feb 4099646 1 2024-09-10T10:04:20.922 INFO:tasks.workunit.client.1.smithi107.stdout:6/599: symlink d0/d3d/d14/d21/d8a/d8d/lcb 0 2024-09-10T10:04:20.923 INFO:tasks.workunit.client.0.smithi071.stdout:1/633: link d1/cc d1/d21/d2f/d30/d6a/d91/cda 0 2024-09-10T10:04:20.925 INFO:tasks.workunit.client.0.smithi071.stdout:2/557: link d8/f20 d8/d38/d47/fb9 0 2024-09-10T10:04:20.925 INFO:tasks.workunit.client.0.smithi071.stdout:4/545: dread db/f46 [0,4194304] 0 2024-09-10T10:04:20.926 INFO:tasks.workunit.client.0.smithi071.stdout:4/546: write db/d15/d17/d4e/d5a/d8d/faf [761173,67202] 0 2024-09-10T10:04:20.927 INFO:tasks.workunit.client.0.smithi071.stdout:2/558: mknod d8/d87/d33/cba 0 2024-09-10T10:04:20.929 INFO:tasks.workunit.client.0.smithi071.stdout:2/559: fdatasync d8/f8f 0 2024-09-10T10:04:20.931 INFO:tasks.workunit.client.0.smithi071.stdout:2/560: mknod d8/d87/d33/d41/d56/cbb 0 2024-09-10T10:04:20.932 INFO:tasks.workunit.client.0.smithi071.stdout:2/561: fdatasync d8/d87/d33/f40 0 2024-09-10T10:04:20.934 INFO:tasks.workunit.client.0.smithi071.stdout:2/562: creat d8/d87/d33/d41/d4d/d5e/fbc x:0 0 0 2024-09-10T10:04:20.936 INFO:tasks.workunit.client.0.smithi071.stdout:2/563: mknod d8/d38/d47/d59/d65/cbd 0 2024-09-10T10:04:20.936 INFO:tasks.workunit.client.0.smithi071.stdout:2/564: dread - d8/d87/f6d zero size 2024-09-10T10:04:20.937 INFO:tasks.workunit.client.0.smithi071.stdout:2/565: write d8/d38/fa0 [794907,62938] 0 2024-09-10T10:04:20.938 INFO:tasks.workunit.client.0.smithi071.stdout:2/566: write d8/f28 [2794214,85124] 0 2024-09-10T10:04:20.939 INFO:tasks.workunit.client.0.smithi071.stdout:2/567: write d8/d24/fa5 [609999,23745] 0 2024-09-10T10:04:20.942 INFO:tasks.workunit.client.0.smithi071.stdout:2/568: unlink d8/d87/d51/faa 0 2024-09-10T10:04:20.942 INFO:tasks.workunit.client.0.smithi071.stdout:2/569: dread - d8/f8f zero size 2024-09-10T10:04:20.944 INFO:tasks.workunit.client.0.smithi071.stdout:2/570: unlink d8/d87/d33/d41/d4d/c9d 0 2024-09-10T10:04:20.945 INFO:tasks.workunit.client.0.smithi071.stdout:2/571: write d8/d38/d47/d59/d65/faf [339848,37002] 0 2024-09-10T10:04:20.954 INFO:tasks.workunit.client.0.smithi071.stdout:4/547: write db/d15/d26/f3c [756019,9660] 0 2024-09-10T10:04:20.960 INFO:tasks.workunit.client.0.smithi071.stdout:2/572: symlink d8/d87/d33/d41/d4d/d52/lbe 0 2024-09-10T10:04:20.960 INFO:tasks.workunit.client.0.smithi071.stdout:2/573: stat d8/d38/d99/cb1 0 2024-09-10T10:04:20.960 INFO:tasks.workunit.client.0.smithi071.stdout:4/548: truncate db/d15/d17/d4e/f6d 2383920 0 2024-09-10T10:04:20.961 INFO:tasks.workunit.client.0.smithi071.stdout:4/549: creat db/d1d/d7a/fb4 x:0 0 0 2024-09-10T10:04:20.961 INFO:tasks.workunit.client.0.smithi071.stdout:2/574: creat d8/db6/fbf x:0 0 0 2024-09-10T10:04:20.962 INFO:tasks.workunit.client.0.smithi071.stdout:2/575: read - d8/d87/f6d zero size 2024-09-10T10:04:20.963 INFO:tasks.workunit.client.0.smithi071.stdout:2/576: creat d8/d38/d47/d59/fc0 x:0 0 0 2024-09-10T10:04:20.965 INFO:tasks.workunit.client.0.smithi071.stdout:2/577: creat d8/d38/d63/fc1 x:0 0 0 2024-09-10T10:04:20.965 INFO:tasks.workunit.client.0.smithi071.stdout:2/578: write d8/d24/f5c [4250511,67335] 0 2024-09-10T10:04:20.975 INFO:tasks.workunit.client.0.smithi071.stdout:2/579: truncate d8/d4a/f97 547533 0 2024-09-10T10:04:20.975 INFO:tasks.workunit.client.0.smithi071.stdout:2/580: fdatasync d8/d38/d47/d59/d65/f79 0 2024-09-10T10:04:20.976 INFO:tasks.workunit.client.0.smithi071.stdout:2/581: write d8/d87/f6d [1046555,30870] 0 2024-09-10T10:04:21.012 INFO:tasks.workunit.client.0.smithi071.stdout:7/611: sync 2024-09-10T10:04:21.035 INFO:tasks.workunit.client.0.smithi071.stdout:7/612: dread d9/d70/faa [0,4194304] 0 2024-09-10T10:04:21.036 INFO:tasks.workunit.client.0.smithi071.stdout:7/613: write d9/d76/f42 [2378290,63930] 0 2024-09-10T10:04:21.037 INFO:tasks.workunit.client.0.smithi071.stdout:2/582: dwrite d8/d38/d8d/fa7 [0,4194304] 0 2024-09-10T10:04:21.037 INFO:tasks.workunit.client.0.smithi071.stdout:7/614: chown f2 8 1 2024-09-10T10:04:21.045 INFO:tasks.workunit.client.1.smithi107.stdout:2/646: sync 2024-09-10T10:04:21.045 INFO:tasks.workunit.client.1.smithi107.stdout:8/485: sync 2024-09-10T10:04:21.046 INFO:tasks.workunit.client.1.smithi107.stdout:8/486: dread - d5/d8/d66/d8b/d21/f3c zero size 2024-09-10T10:04:21.049 INFO:tasks.workunit.client.1.smithi107.stdout:2/647: dread d3/d21/f32 [0,4194304] 0 2024-09-10T10:04:21.049 INFO:tasks.workunit.client.0.smithi071.stdout:2/583: dread - d8/d87/d33/fb5 zero size 2024-09-10T10:04:21.050 INFO:tasks.workunit.client.0.smithi071.stdout:9/874: unlink d0/d3b/d5c/d6a/d96/dda/c85 0 2024-09-10T10:04:21.051 INFO:tasks.workunit.client.0.smithi071.stdout:7/615: mknod d9/d15/d40/d80/dd6/cd9 0 2024-09-10T10:04:21.051 INFO:tasks.workunit.client.0.smithi071.stdout:1/634: mkdir d1/d21/d2f/d30/d6a/ddb 0 2024-09-10T10:04:21.051 INFO:tasks.workunit.client.1.smithi107.stdout:0/587: write d6/d8/d2f/d2e/d32/f6c [4278026,82607] 0 2024-09-10T10:04:21.052 INFO:tasks.workunit.client.0.smithi071.stdout:9/875: truncate d0/d3b/fdc 1298428 0 2024-09-10T10:04:21.052 INFO:tasks.workunit.client.1.smithi107.stdout:7/549: creat d0/d20/d35/faa x:0 0 0 2024-09-10T10:04:21.052 INFO:tasks.workunit.client.0.smithi071.stdout:2/584: creat d8/d87/fc2 x:0 0 0 2024-09-10T10:04:21.053 INFO:tasks.workunit.client.1.smithi107.stdout:0/588: fdatasync d6/d8/d2f/d6e/f9d 0 2024-09-10T10:04:21.054 INFO:tasks.workunit.client.1.smithi107.stdout:1/708: getdents d2/d12/d65/db4/dd9/ddd 0 2024-09-10T10:04:21.055 INFO:tasks.workunit.client.1.smithi107.stdout:6/600: rmdir d0/d3d/d14/d17/d49/d55 39 2024-09-10T10:04:21.057 INFO:tasks.workunit.client.0.smithi071.stdout:2/585: dread d8/f20 [0,4194304] 0 2024-09-10T10:04:21.057 INFO:tasks.workunit.client.0.smithi071.stdout:1/635: unlink d1/c23 0 2024-09-10T10:04:21.057 INFO:tasks.workunit.client.0.smithi071.stdout:2/586: dread - d8/f8f zero size 2024-09-10T10:04:21.059 INFO:tasks.workunit.client.1.smithi107.stdout:8/487: mkdir d5/d8/d66/d8b/d1a/da3 0 2024-09-10T10:04:21.061 INFO:tasks.workunit.client.1.smithi107.stdout:7/550: dwrite d0/d8/dc/d2c/f7c [0,4194304] 0 2024-09-10T10:04:21.063 INFO:tasks.workunit.client.1.smithi107.stdout:0/589: rmdir d6/d8/d2f/d35/d3c/d58/d69/d84 39 2024-09-10T10:04:21.070 INFO:tasks.workunit.client.1.smithi107.stdout:4/714: creat d0/d1f/ff4 x:0 0 0 2024-09-10T10:04:21.071 INFO:tasks.workunit.client.1.smithi107.stdout:0/590: dwrite d6/d8/d2f/d2e/d32/d56/f8c [0,4194304] 0 2024-09-10T10:04:21.071 INFO:tasks.workunit.client.0.smithi071.stdout:7/616: dread f4 [0,4194304] 0 2024-09-10T10:04:21.071 INFO:tasks.workunit.client.0.smithi071.stdout:7/617: dread - d9/d15/d1f/f65 zero size 2024-09-10T10:04:21.073 INFO:tasks.workunit.client.1.smithi107.stdout:7/551: fsync d0/d20/d35/faa 0 2024-09-10T10:04:21.074 INFO:tasks.workunit.client.1.smithi107.stdout:1/709: dread d2/d12/d5a/f6f [0,4194304] 0 2024-09-10T10:04:21.075 INFO:tasks.workunit.client.1.smithi107.stdout:1/710: readlink d2/d12/d7e/la5 0 2024-09-10T10:04:21.078 INFO:tasks.workunit.client.1.smithi107.stdout:8/488: truncate d5/d8/f32 1527784 0 2024-09-10T10:04:21.078 INFO:tasks.workunit.client.1.smithi107.stdout:3/948: write dc/dd/d45/d26/d41/d44/d35/f2a [2561885,81476] 0 2024-09-10T10:04:21.078 INFO:tasks.workunit.client.1.smithi107.stdout:2/648: link d3/da/d1e/d27/fd3 d3/da/df/d78/fe1 0 2024-09-10T10:04:21.080 INFO:tasks.workunit.client.1.smithi107.stdout:0/591: creat d6/d8/d2f/d2e/d32/d95/fb6 x:0 0 0 2024-09-10T10:04:21.081 INFO:tasks.workunit.client.1.smithi107.stdout:6/601: link d0/d3d/d14/d17/fb4 d0/d3d/d14/d42/fcc 0 2024-09-10T10:04:21.083 INFO:tasks.workunit.client.1.smithi107.stdout:3/949: symlink dc/dd/d45/d26/d59/l13e 0 2024-09-10T10:04:21.084 INFO:tasks.workunit.client.1.smithi107.stdout:1/711: mknod d2/d89/dd1/ce6 0 2024-09-10T10:04:21.085 INFO:tasks.workunit.client.1.smithi107.stdout:2/649: chown d3/da/df/d20/d36/d4f/dcc/lda 490 1 2024-09-10T10:04:21.085 INFO:tasks.workunit.client.1.smithi107.stdout:7/552: rename d0/d1b/d4d/d69/d97/l86 to d0/d1b/d4d/d69/d97/lab 0 2024-09-10T10:04:21.085 INFO:tasks.workunit.client.1.smithi107.stdout:0/592: write d6/d8/d2f/d2e/d32/d59/f62 [237577,124046] 0 2024-09-10T10:04:21.087 INFO:tasks.workunit.client.1.smithi107.stdout:6/602: stat d0/d3d/d14/d17/d49/d55/d56/c5e 0 2024-09-10T10:04:21.094 INFO:tasks.workunit.client.0.smithi071.stdout:7/618: write d9/d15/d1f/f65 [568564,85360] 0 2024-09-10T10:04:21.096 INFO:tasks.workunit.client.0.smithi071.stdout:7/619: unlink d9/d11/f14 0 2024-09-10T10:04:21.098 INFO:tasks.workunit.client.0.smithi071.stdout:7/620: dread - d9/d2c/f7e zero size 2024-09-10T10:04:21.098 INFO:tasks.workunit.client.0.smithi071.stdout:7/621: fdatasync d9/d15/d40/d80/fd0 0 2024-09-10T10:04:21.099 INFO:tasks.workunit.client.0.smithi071.stdout:7/622: symlink d9/d2c/lda 0 2024-09-10T10:04:21.101 INFO:tasks.workunit.client.0.smithi071.stdout:7/623: mkdir d9/ddb 0 2024-09-10T10:04:21.102 INFO:tasks.workunit.client.0.smithi071.stdout:7/624: dread - d9/d11/f5f zero size 2024-09-10T10:04:21.103 INFO:tasks.workunit.client.0.smithi071.stdout:7/625: write d9/d2c/d49/f62 [5103959,117147] 0 2024-09-10T10:04:21.104 INFO:tasks.workunit.client.0.smithi071.stdout:7/626: fdatasync d9/d1a/d1d/f61 0 2024-09-10T10:04:21.108 INFO:tasks.workunit.client.0.smithi071.stdout:7/627: dread d9/d15/d55/f6e [0,4194304] 0 2024-09-10T10:04:21.111 INFO:tasks.workunit.client.0.smithi071.stdout:7/628: write d9/f10 [3165684,116767] 0 2024-09-10T10:04:21.112 INFO:tasks.workunit.client.0.smithi071.stdout:7/629: chown d9/d15/d1f/c21 13 1 2024-09-10T10:04:21.113 INFO:tasks.workunit.client.0.smithi071.stdout:7/630: mknod d9/d76/cdc 0 2024-09-10T10:04:21.115 INFO:tasks.workunit.client.0.smithi071.stdout:7/631: rename d9/d11/d91/db6 to d9/d15/d40/d80/ddd 0 2024-09-10T10:04:21.124 INFO:tasks.workunit.client.1.smithi107.stdout:4/715: dwrite d0/d40/d57/d4f/f61 [0,4194304] 0 2024-09-10T10:04:21.125 INFO:tasks.workunit.client.0.smithi071.stdout:7/632: dread d9/f10 [0,4194304] 0 2024-09-10T10:04:21.125 INFO:tasks.workunit.client.1.smithi107.stdout:7/553: write d0/d8/d5c/f93 [2422741,71860] 0 2024-09-10T10:04:21.125 INFO:tasks.workunit.client.1.smithi107.stdout:3/950: symlink dc/dd/d45/d26/d41/d44/d35/l13f 0 2024-09-10T10:04:21.127 INFO:tasks.workunit.client.0.smithi071.stdout:7/633: creat d9/d2c/d49/fde x:0 0 0 2024-09-10T10:04:21.127 INFO:tasks.workunit.client.1.smithi107.stdout:8/489: dwrite d5/f79 [0,4194304] 0 2024-09-10T10:04:21.128 INFO:tasks.workunit.client.1.smithi107.stdout:6/603: write d0/d3d/d14/d17/d24/f6f [2799692,2314] 0 2024-09-10T10:04:21.129 INFO:tasks.workunit.client.1.smithi107.stdout:1/712: write d2/d35/f57 [76696,91814] 0 2024-09-10T10:04:21.130 INFO:tasks.workunit.client.1.smithi107.stdout:8/490: chown d5/d8/d66/d8b/d1a/d64/f72 3 1 2024-09-10T10:04:21.131 INFO:tasks.workunit.client.1.smithi107.stdout:3/951: mkdir dc/dd/d45/d26/d41/d44/d35/d4a/dd8/d140 0 2024-09-10T10:04:21.133 INFO:tasks.workunit.client.1.smithi107.stdout:0/593: mknod d6/d8/d2f/d2e/d7b/d89/cb7 0 2024-09-10T10:04:21.133 INFO:tasks.workunit.client.1.smithi107.stdout:3/952: stat dc/dd/d20/d23/d39/d69/fa8 0 2024-09-10T10:04:21.135 INFO:tasks.workunit.client.1.smithi107.stdout:3/953: fdatasync dc/dd/d42/d55/d58/d91/fe4 0 2024-09-10T10:04:21.139 INFO:tasks.workunit.client.1.smithi107.stdout:4/716: getdents d0/d1f/d72 0 2024-09-10T10:04:21.139 INFO:tasks.workunit.client.1.smithi107.stdout:6/604: link d0/l39 d0/d3d/d14/d21/d8a/da7/dc1/lcd 0 2024-09-10T10:04:21.141 INFO:tasks.workunit.client.1.smithi107.stdout:6/605: creat d0/d3d/d14/d21/fce x:0 0 0 2024-09-10T10:04:21.145 INFO:tasks.workunit.client.1.smithi107.stdout:6/606: creat d0/d3d/d14/d9f/dca/fcf x:0 0 0 2024-09-10T10:04:21.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:20 smithi107 ceph-mon[34215]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:04:21.146 INFO:tasks.workunit.client.1.smithi107.stdout:4/717: dwrite d0/d40/d57/d76/fd4 [0,4194304] 0 2024-09-10T10:04:21.146 INFO:tasks.workunit.client.1.smithi107.stdout:8/491: stat d5/d8/f32 0 2024-09-10T10:04:21.148 INFO:tasks.workunit.client.1.smithi107.stdout:4/718: creat d0/d82/ff5 x:0 0 0 2024-09-10T10:04:21.149 INFO:tasks.workunit.client.1.smithi107.stdout:8/492: mkdir d5/d8/d66/d8b/d18/da4 0 2024-09-10T10:04:21.151 INFO:tasks.workunit.client.1.smithi107.stdout:6/607: creat d0/d3d/d14/d17/d49/dbe/fd0 x:0 0 0 2024-09-10T10:04:21.156 INFO:tasks.workunit.client.1.smithi107.stdout:6/608: write d0/f3e [4766951,114531] 0 2024-09-10T10:04:21.157 INFO:tasks.workunit.client.1.smithi107.stdout:8/493: truncate d5/d42/f65 3632668 0 2024-09-10T10:04:21.160 INFO:tasks.workunit.client.1.smithi107.stdout:1/713: dwrite d2/d6/d24/f50 [0,4194304] 0 2024-09-10T10:04:21.162 INFO:tasks.workunit.client.1.smithi107.stdout:1/714: chown d2/c17 5 1 2024-09-10T10:04:21.162 INFO:tasks.workunit.client.1.smithi107.stdout:4/719: dwrite d0/d1f/d5e/feb [0,4194304] 0 2024-09-10T10:04:21.164 INFO:tasks.workunit.client.1.smithi107.stdout:6/609: creat d0/d3d/d14/d17/d49/d55/d56/fd1 x:0 0 0 2024-09-10T10:04:21.166 INFO:tasks.workunit.client.1.smithi107.stdout:8/494: stat d5/d8/d66/d8b/d18/l5f 0 2024-09-10T10:04:21.167 INFO:tasks.workunit.client.1.smithi107.stdout:6/610: fsync d0/d3d/d14/d17/d4b/f8c 0 2024-09-10T10:04:21.168 INFO:tasks.workunit.client.1.smithi107.stdout:6/611: chown d0/d3d/d14/d9f/dca/f86 889579 1 2024-09-10T10:04:21.172 INFO:tasks.workunit.client.1.smithi107.stdout:8/495: mknod d5/d8/d66/d8b/d21/ca5 0 2024-09-10T10:04:21.174 INFO:tasks.workunit.client.1.smithi107.stdout:4/720: write d0/d40/d75/d53/fa2 [770826,65407] 0 2024-09-10T10:04:21.175 INFO:tasks.workunit.client.1.smithi107.stdout:8/496: fsync d5/d8/f13 0 2024-09-10T10:04:21.177 INFO:tasks.workunit.client.1.smithi107.stdout:8/497: chown d5/d8/f20 33858256 1 2024-09-10T10:04:21.178 INFO:tasks.workunit.client.1.smithi107.stdout:4/721: mknod d0/d40/d75/df2/cf6 0 2024-09-10T10:04:21.179 INFO:tasks.workunit.client.1.smithi107.stdout:4/722: creat d0/d40/d6d/ff7 x:0 0 0 2024-09-10T10:04:21.183 INFO:tasks.workunit.client.1.smithi107.stdout:8/498: dwrite d5/d8/d5b/f74 [4194304,4194304] 0 2024-09-10T10:04:21.185 INFO:tasks.workunit.client.1.smithi107.stdout:8/499: readlink d5/d8/l23 0 2024-09-10T10:04:21.188 INFO:tasks.workunit.client.1.smithi107.stdout:6/612: truncate d0/d3d/d14/d17/d24/f6f 2769865 0 2024-09-10T10:04:21.189 INFO:tasks.workunit.client.1.smithi107.stdout:8/500: fsync d5/d8/d66/d8b/d18/f4b 0 2024-09-10T10:04:21.191 INFO:tasks.workunit.client.1.smithi107.stdout:6/613: creat d0/d3d/d14/d9f/fd2 x:0 0 0 2024-09-10T10:04:21.192 INFO:tasks.workunit.client.1.smithi107.stdout:1/715: dread d2/d36/fba [0,4194304] 0 2024-09-10T10:04:21.194 INFO:tasks.workunit.client.1.smithi107.stdout:6/614: symlink d0/d3d/d14/d17/d49/d55/ld3 0 2024-09-10T10:04:21.196 INFO:tasks.workunit.client.1.smithi107.stdout:4/723: dwrite d0/d6b/d9d/fc5 [0,4194304] 0 2024-09-10T10:04:21.197 INFO:tasks.workunit.client.1.smithi107.stdout:6/615: write d0/d70/faf [3469045,106860] 0 2024-09-10T10:04:21.200 INFO:tasks.workunit.client.1.smithi107.stdout:6/616: fdatasync d0/d3d/d14/d17/d4b/f6e 0 2024-09-10T10:04:21.200 INFO:tasks.workunit.client.1.smithi107.stdout:4/724: chown d0/d40/d57/d76/d77/da9/fb7 178820 1 2024-09-10T10:04:21.205 INFO:tasks.workunit.client.1.smithi107.stdout:6/617: rmdir d0/dc0 0 2024-09-10T10:04:21.206 INFO:tasks.workunit.client.1.smithi107.stdout:9/565: sync 2024-09-10T10:04:21.207 INFO:tasks.workunit.client.1.smithi107.stdout:6/618: creat d0/d3d/d14/d9f/dca/fd4 x:0 0 0 2024-09-10T10:04:21.208 INFO:tasks.workunit.client.1.smithi107.stdout:9/566: mknod d5/d7/d1d/d41/d83/d9a/cc6 0 2024-09-10T10:04:21.209 INFO:tasks.workunit.client.1.smithi107.stdout:8/501: dread d5/f19 [0,4194304] 0 2024-09-10T10:04:21.209 INFO:tasks.workunit.client.1.smithi107.stdout:4/725: dread d0/d40/fb2 [0,4194304] 0 2024-09-10T10:04:21.210 INFO:tasks.workunit.client.1.smithi107.stdout:9/567: fsync d5/d7/d1d/fa0 0 2024-09-10T10:04:21.210 INFO:tasks.workunit.client.1.smithi107.stdout:6/619: unlink d0/d3d/d14/d21/d8a/d8d/lcb 0 2024-09-10T10:04:21.211 INFO:tasks.workunit.client.1.smithi107.stdout:8/502: fdatasync d5/d8/d66/d8b/d21/f3a 0 2024-09-10T10:04:21.213 INFO:tasks.workunit.client.1.smithi107.stdout:9/568: write d5/d7/d1d/d29/db4/fc0 [176792,115125] 0 2024-09-10T10:04:21.213 INFO:tasks.workunit.client.1.smithi107.stdout:8/503: fsync d5/d8/d66/d8b/f16 0 2024-09-10T10:04:21.217 INFO:tasks.workunit.client.1.smithi107.stdout:1/716: dread d2/da8/fa9 [0,4194304] 0 2024-09-10T10:04:21.219 INFO:tasks.workunit.client.1.smithi107.stdout:4/726: dwrite d0/d40/d75/f46 [0,4194304] 0 2024-09-10T10:04:21.220 INFO:tasks.workunit.client.1.smithi107.stdout:9/569: rename d5/d7/d1d/d41/c7e to d5/d7/d1d/d9b/dab/d57/d87/d27/cc7 0 2024-09-10T10:04:21.224 INFO:tasks.workunit.client.1.smithi107.stdout:4/727: fdatasync d0/d1f/d20/f5d 0 2024-09-10T10:04:21.228 INFO:tasks.workunit.client.1.smithi107.stdout:6/620: dread d0/d70/faf [0,4194304] 0 2024-09-10T10:04:21.228 INFO:tasks.workunit.client.1.smithi107.stdout:8/504: dwrite d5/d8/d66/d8b/d21/d83/f84 [0,4194304] 0 2024-09-10T10:04:21.231 INFO:tasks.workunit.client.1.smithi107.stdout:4/728: symlink d0/d1f/d72/lf8 0 2024-09-10T10:04:21.235 INFO:tasks.workunit.client.1.smithi107.stdout:8/505: symlink d5/d8/d66/d8b/d1a/da3/la6 0 2024-09-10T10:04:21.236 INFO:tasks.workunit.client.1.smithi107.stdout:8/506: write d5/d8/d2a/d47/f53 [5399049,23280] 0 2024-09-10T10:04:21.237 INFO:tasks.workunit.client.1.smithi107.stdout:9/570: rmdir d5/d7/d1d 39 2024-09-10T10:04:21.238 INFO:tasks.workunit.client.1.smithi107.stdout:4/729: rename d0/cd to d0/d1f/d20/d47/dbe/cf9 0 2024-09-10T10:04:21.238 INFO:tasks.workunit.client.1.smithi107.stdout:6/621: link d0/d3d/d14/c87 d0/d3d/d14/d21/d8a/da7/dc1/cd5 0 2024-09-10T10:04:21.239 INFO:tasks.workunit.client.1.smithi107.stdout:1/717: truncate d2/d12/d5a/f73 92666 0 2024-09-10T10:04:21.241 INFO:tasks.workunit.client.1.smithi107.stdout:1/718: chown d2/f21 2098971 1 2024-09-10T10:04:21.242 INFO:tasks.workunit.client.1.smithi107.stdout:6/622: write d0/d3d/d14/d21/f33 [562783,117779] 0 2024-09-10T10:04:21.242 INFO:tasks.workunit.client.1.smithi107.stdout:9/571: write d5/d7/d1d/d41/f91 [3629209,20365] 0 2024-09-10T10:04:21.243 INFO:tasks.workunit.client.1.smithi107.stdout:1/719: chown d2/d36/f4d 206 1 2024-09-10T10:04:21.244 INFO:tasks.workunit.client.1.smithi107.stdout:9/572: readlink d5/d1e/l2b 0 2024-09-10T10:04:21.245 INFO:tasks.workunit.client.1.smithi107.stdout:8/507: dread d5/d8/d66/d8b/d21/d83/f84 [0,4194304] 0 2024-09-10T10:04:21.245 INFO:tasks.workunit.client.1.smithi107.stdout:8/508: stat d5/l17 0 2024-09-10T10:04:21.246 INFO:tasks.workunit.client.1.smithi107.stdout:1/720: creat d2/d35/fe7 x:0 0 0 2024-09-10T10:04:21.246 INFO:tasks.workunit.client.1.smithi107.stdout:8/509: chown d5/d8/f32 654547 1 2024-09-10T10:04:21.247 INFO:tasks.workunit.client.1.smithi107.stdout:1/721: write d2/d6/d67/f9b [66136,119691] 0 2024-09-10T10:04:21.250 INFO:tasks.workunit.client.1.smithi107.stdout:8/510: creat d5/d8/d5b/fa7 x:0 0 0 2024-09-10T10:04:21.253 INFO:tasks.workunit.client.1.smithi107.stdout:9/573: write d5/f6a [198647,38099] 0 2024-09-10T10:04:21.254 INFO:tasks.workunit.client.1.smithi107.stdout:8/511: rename d5/d42/f94 to d5/d8/d66/d8b/d1a/fa8 0 2024-09-10T10:04:21.256 INFO:tasks.workunit.client.1.smithi107.stdout:6/623: truncate d0/d3d/d14/d21/f25 4928839 0 2024-09-10T10:04:21.257 INFO:tasks.workunit.client.1.smithi107.stdout:1/722: dwrite d2/d6/d24/d81/fb2 [0,4194304] 0 2024-09-10T10:04:21.258 INFO:tasks.workunit.client.1.smithi107.stdout:8/512: chown d5/d8/d66/d8b/d18/l5f 791207 1 2024-09-10T10:04:21.261 INFO:tasks.workunit.client.1.smithi107.stdout:1/723: mkdir d2/d6/dc6/de8 0 2024-09-10T10:04:21.261 INFO:tasks.workunit.client.1.smithi107.stdout:4/730: dread d0/d40/d75/f44 [0,4194304] 0 2024-09-10T10:04:21.262 INFO:tasks.workunit.client.1.smithi107.stdout:8/513: fsync d5/f19 0 2024-09-10T10:04:21.264 INFO:tasks.workunit.client.1.smithi107.stdout:6/624: write d0/d3d/f64 [1242817,123061] 0 2024-09-10T10:04:21.265 INFO:tasks.workunit.client.1.smithi107.stdout:8/514: stat d5/d8/d66/d8b/d21/f3c 0 2024-09-10T10:04:21.266 INFO:tasks.workunit.client.0.smithi071.stdout:8/522: sync 2024-09-10T10:04:21.267 INFO:tasks.workunit.client.1.smithi107.stdout:9/574: dwrite d5/d7/d1d/d9b/dab/d57/d87/fc4 [0,4194304] 0 2024-09-10T10:04:21.267 INFO:tasks.workunit.client.1.smithi107.stdout:8/515: dread - d5/d8/d66/d8b/d1a/d64/f72 zero size 2024-09-10T10:04:21.267 INFO:tasks.workunit.client.1.smithi107.stdout:9/575: write d5/d7/d3c/fac [1280757,71803] 0 2024-09-10T10:04:21.269 INFO:tasks.workunit.client.1.smithi107.stdout:1/724: mkdir d2/d12/d65/de9 0 2024-09-10T10:04:21.269 INFO:tasks.workunit.client.0.smithi071.stdout:8/523: creat d5/df/d57/fba x:0 0 0 2024-09-10T10:04:21.270 INFO:tasks.workunit.client.1.smithi107.stdout:4/731: truncate d0/fb5 948958 0 2024-09-10T10:04:21.272 INFO:tasks.workunit.client.1.smithi107.stdout:1/725: read d2/d89/f9e [18710,45269] 0 2024-09-10T10:04:21.272 INFO:tasks.workunit.client.1.smithi107.stdout:4/732: write d0/d1f/d90/fdb [495142,86206] 0 2024-09-10T10:04:21.275 INFO:tasks.workunit.client.1.smithi107.stdout:9/576: rename d5/d7/d1d/d41/d83/d9a/d8c/db6 to d5/d7/d1d/d41/dc8 0 2024-09-10T10:04:21.276 INFO:tasks.workunit.client.0.smithi071.stdout:8/524: dwrite d5/d36/f65 [0,4194304] 0 2024-09-10T10:04:21.279 INFO:tasks.workunit.client.1.smithi107.stdout:8/516: unlink d5/d8/d66/d8b/d18/l27 0 2024-09-10T10:04:21.280 INFO:tasks.workunit.client.0.smithi071.stdout:8/525: creat d5/df/d1e/d38/d9f/fbb x:0 0 0 2024-09-10T10:04:21.281 INFO:tasks.workunit.client.1.smithi107.stdout:4/733: unlink d0/ccf 0 2024-09-10T10:04:21.282 INFO:tasks.workunit.client.0.smithi071.stdout:8/526: write d5/d36/d49/fb8 [689428,32167] 0 2024-09-10T10:04:21.283 INFO:tasks.workunit.client.1.smithi107.stdout:9/577: symlink d5/d7/d1d/d9b/dab/d57/d87/lc9 0 2024-09-10T10:04:21.284 INFO:tasks.workunit.client.1.smithi107.stdout:1/726: dwrite d2/d12/d65/d6b/f2e [4194304,4194304] 0 2024-09-10T10:04:21.284 INFO:tasks.workunit.client.0.smithi071.stdout:8/527: truncate d5/df/d1e/d38/d9f/fbb 380895 0 2024-09-10T10:04:21.286 INFO:tasks.workunit.client.0.smithi071.stdout:8/528: write d5/df/d1d/d81/d9b/fab [627544,121023] 0 2024-09-10T10:04:21.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:20 smithi071 ceph-mon[27559]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:04:21.289 INFO:tasks.workunit.client.1.smithi107.stdout:8/517: fdatasync d5/d42/f65 0 2024-09-10T10:04:21.290 INFO:tasks.workunit.client.1.smithi107.stdout:6/625: write d0/d76/faa [1738287,26362] 0 2024-09-10T10:04:21.291 INFO:tasks.workunit.client.1.smithi107.stdout:1/727: mkdir d2/dcc/dea 0 2024-09-10T10:04:21.291 INFO:tasks.workunit.client.1.smithi107.stdout:9/578: mknod d5/d7/d1d/d41/d83/d9a/d8c/cca 0 2024-09-10T10:04:21.292 INFO:tasks.workunit.client.0.smithi071.stdout:8/529: rmdir d5/df/da1 0 2024-09-10T10:04:21.292 INFO:tasks.workunit.client.1.smithi107.stdout:9/579: truncate d5/f85 934156 0 2024-09-10T10:04:21.292 INFO:tasks.workunit.client.0.smithi071.stdout:8/530: chown d5/df/d1e/l2a 87856905 1 2024-09-10T10:04:21.293 INFO:tasks.workunit.client.1.smithi107.stdout:8/518: creat d5/d8/d66/fa9 x:0 0 0 2024-09-10T10:04:21.293 INFO:tasks.workunit.client.1.smithi107.stdout:6/626: creat d0/d3d/d14/d17/d49/d55/d56/fd6 x:0 0 0 2024-09-10T10:04:21.294 INFO:tasks.workunit.client.0.smithi071.stdout:8/531: mknod d5/df/d67/cbc 0 2024-09-10T10:04:21.296 INFO:tasks.workunit.client.0.smithi071.stdout:8/532: write d5/df/d1d/d86/f63 [3064432,4744] 0 2024-09-10T10:04:21.297 INFO:tasks.workunit.client.0.smithi071.stdout:8/533: write d5/df/d1d/f92 [51100,30867] 0 2024-09-10T10:04:21.297 INFO:tasks.workunit.client.1.smithi107.stdout:8/519: symlink d5/d8/d66/d8b/d1a/laa 0 2024-09-10T10:04:21.301 INFO:tasks.workunit.client.1.smithi107.stdout:4/734: write d0/f14 [1180063,78057] 0 2024-09-10T10:04:21.301 INFO:tasks.workunit.client.0.smithi071.stdout:8/534: link d5/df/d1d/d86/l20 d5/d30/lbd 0 2024-09-10T10:04:21.302 INFO:tasks.workunit.client.1.smithi107.stdout:9/580: dwrite d5/f85 [0,4194304] 0 2024-09-10T10:04:21.307 INFO:tasks.workunit.client.1.smithi107.stdout:9/581: stat d5/d7/d1d/d41/lc3 0 2024-09-10T10:04:21.311 INFO:tasks.workunit.client.0.smithi071.stdout:8/535: truncate d5/df/d1d/d86/f29 938934 0 2024-09-10T10:04:21.312 INFO:tasks.workunit.client.1.smithi107.stdout:8/520: dwrite d5/d8/d5b/f90 [0,4194304] 0 2024-09-10T10:04:21.312 INFO:tasks.workunit.client.0.smithi071.stdout:8/536: fdatasync d5/d36/d49/f61 0 2024-09-10T10:04:21.313 INFO:tasks.workunit.client.1.smithi107.stdout:4/735: dread d0/d40/f41 [0,4194304] 0 2024-09-10T10:04:21.320 INFO:tasks.workunit.client.1.smithi107.stdout:5/659: sync 2024-09-10T10:04:21.321 INFO:tasks.workunit.client.0.smithi071.stdout:8/537: rename d5/d36/d49/l64 to d5/d36/d49/lbe 0 2024-09-10T10:04:21.322 INFO:tasks.workunit.client.1.smithi107.stdout:9/582: mknod d5/d7/d1d/d29/db4/ccb 0 2024-09-10T10:04:21.323 INFO:tasks.workunit.client.0.smithi071.stdout:8/538: creat d5/d36/d49/fbf x:0 0 0 2024-09-10T10:04:21.324 INFO:tasks.workunit.client.1.smithi107.stdout:8/521: chown d5/d8/d2a/d35/d70/f95 0 1 2024-09-10T10:04:21.324 INFO:tasks.workunit.client.1.smithi107.stdout:1/728: dwrite d2/d12/d5a/f5d [0,4194304] 0 2024-09-10T10:04:21.325 INFO:tasks.workunit.client.1.smithi107.stdout:6/627: dwrite d0/d3d/d14/d21/f43 [0,4194304] 0 2024-09-10T10:04:21.325 INFO:tasks.workunit.client.0.smithi071.stdout:8/539: creat d5/df/d1d/d86/fc0 x:0 0 0 2024-09-10T10:04:21.325 INFO:tasks.workunit.client.1.smithi107.stdout:9/583: chown d5/d7/d1d/d29/l4b 0 1 2024-09-10T10:04:21.326 INFO:tasks.workunit.client.1.smithi107.stdout:4/736: write d0/d40/d57/d76/fd4 [2269670,121617] 0 2024-09-10T10:04:21.326 INFO:tasks.workunit.client.1.smithi107.stdout:5/660: write de/f48 [3616399,36537] 0 2024-09-10T10:04:21.327 INFO:tasks.workunit.client.0.smithi071.stdout:8/540: write d5/df/d74/f96 [4233603,2642] 0 2024-09-10T10:04:21.328 INFO:tasks.workunit.client.0.smithi071.stdout:8/541: read - d5/df/d1d/d81/fa6 zero size 2024-09-10T10:04:21.329 INFO:tasks.workunit.client.1.smithi107.stdout:6/628: fdatasync d0/d3d/d14/d9f/dca/fcf 0 2024-09-10T10:04:21.333 INFO:tasks.workunit.client.1.smithi107.stdout:5/661: mknod de/d4a/d5c/ce8 0 2024-09-10T10:04:21.335 INFO:tasks.workunit.client.0.smithi071.stdout:8/542: dwrite d5/df/d1e/d38/d9f/fbb [0,4194304] 0 2024-09-10T10:04:21.337 INFO:tasks.workunit.client.0.smithi071.stdout:8/543: stat d5/df/d1d/d86/l47 0 2024-09-10T10:04:21.339 INFO:tasks.workunit.client.1.smithi107.stdout:4/737: getdents d0/d82 0 2024-09-10T10:04:21.339 INFO:tasks.workunit.client.1.smithi107.stdout:6/629: dread d0/d76/faa [0,4194304] 0 2024-09-10T10:04:21.340 INFO:tasks.workunit.client.0.smithi071.stdout:8/544: mknod d5/df/d1e/d38/d62/cc1 0 2024-09-10T10:04:21.340 INFO:tasks.workunit.client.1.smithi107.stdout:6/630: chown d0/d70/fb6 162983882 1 2024-09-10T10:04:21.343 INFO:tasks.workunit.client.1.smithi107.stdout:4/738: rename d0/d1f/d5e/f73 to d0/d1f/d90/ffa 0 2024-09-10T10:04:21.344 INFO:tasks.workunit.client.0.smithi071.stdout:8/545: creat d5/df/d1e/fc2 x:0 0 0 2024-09-10T10:04:21.345 INFO:tasks.workunit.client.0.smithi071.stdout:8/546: stat d5/df/d1d/d86/c58 0 2024-09-10T10:04:21.345 INFO:tasks.workunit.client.1.smithi107.stdout:6/631: mknod d0/d3d/d14/d42/cd7 0 2024-09-10T10:04:21.346 INFO:tasks.workunit.client.1.smithi107.stdout:4/739: mkdir d0/d1f/d90/dfb 0 2024-09-10T10:04:21.347 INFO:tasks.workunit.client.1.smithi107.stdout:4/740: stat d0/d1f/d20/d80/lbf 0 2024-09-10T10:04:21.348 INFO:tasks.workunit.client.1.smithi107.stdout:4/741: fsync d0/d1f/d20/f4c 0 2024-09-10T10:04:21.350 INFO:tasks.workunit.client.1.smithi107.stdout:4/742: fsync d0/d40/d57/d4f/fb6 0 2024-09-10T10:04:21.356 INFO:tasks.workunit.client.1.smithi107.stdout:4/743: dwrite d0/d40/d75/f44 [0,4194304] 0 2024-09-10T10:04:21.359 INFO:tasks.workunit.client.1.smithi107.stdout:4/744: mknod d0/d40/d57/d76/d77/da1/d59/cfc 0 2024-09-10T10:04:21.361 INFO:tasks.workunit.client.1.smithi107.stdout:4/745: read d0/d1f/f60 [439228,118556] 0 2024-09-10T10:04:21.363 INFO:tasks.workunit.client.1.smithi107.stdout:8/522: dread d5/fb [0,4194304] 0 2024-09-10T10:04:21.365 INFO:tasks.workunit.client.1.smithi107.stdout:4/746: chown d0/d1f/d20/d80/cbc 2127 1 2024-09-10T10:04:21.367 INFO:tasks.workunit.client.1.smithi107.stdout:5/662: dwrite de/d20/d2b/f3e [0,4194304] 0 2024-09-10T10:04:21.369 INFO:tasks.workunit.client.1.smithi107.stdout:4/747: write d0/d40/fb2 [534097,123098] 0 2024-09-10T10:04:21.371 INFO:tasks.workunit.client.1.smithi107.stdout:6/632: dwrite d0/f2c [4194304,4194304] 0 2024-09-10T10:04:21.374 INFO:tasks.workunit.client.1.smithi107.stdout:5/663: getdents de 0 2024-09-10T10:04:21.377 INFO:tasks.workunit.client.1.smithi107.stdout:4/748: dread d0/d40/d75/f46 [0,4194304] 0 2024-09-10T10:04:21.379 INFO:tasks.workunit.client.1.smithi107.stdout:4/749: fsync d0/f14 0 2024-09-10T10:04:21.382 INFO:tasks.workunit.client.1.smithi107.stdout:4/750: write d0/d1f/d90/fc1 [1142777,27928] 0 2024-09-10T10:04:21.384 INFO:tasks.workunit.client.1.smithi107.stdout:8/523: dread d5/d8/d66/d8b/d18/f4b [0,4194304] 0 2024-09-10T10:04:21.385 INFO:tasks.workunit.client.1.smithi107.stdout:4/751: symlink d0/d6b/lfd 0 2024-09-10T10:04:21.385 INFO:tasks.workunit.client.1.smithi107.stdout:8/524: stat d5/d8/d66/d8b/d1a/da3 0 2024-09-10T10:04:21.386 INFO:tasks.workunit.client.1.smithi107.stdout:8/525: read - d5/d8/d2a/d47/f9c zero size 2024-09-10T10:04:21.401 INFO:tasks.workunit.client.1.smithi107.stdout:5/664: dwrite de/f2d [0,4194304] 0 2024-09-10T10:04:21.402 INFO:tasks.workunit.client.1.smithi107.stdout:6/633: dread d0/d3d/d14/d17/f47 [0,4194304] 0 2024-09-10T10:04:21.402 INFO:tasks.workunit.client.1.smithi107.stdout:4/752: dwrite d0/d1f/d20/d47/f85 [0,4194304] 0 2024-09-10T10:04:21.405 INFO:tasks.workunit.client.1.smithi107.stdout:8/526: dread d5/d8/d66/d8b/f16 [0,4194304] 0 2024-09-10T10:04:21.405 INFO:tasks.workunit.client.1.smithi107.stdout:4/753: write d0/d1f/d5e/feb [1608277,37635] 0 2024-09-10T10:04:21.406 INFO:tasks.workunit.client.1.smithi107.stdout:8/527: stat d5/f19 0 2024-09-10T10:04:21.407 INFO:tasks.workunit.client.1.smithi107.stdout:5/665: unlink de/d4a/d7e/db2/fb4 0 2024-09-10T10:04:21.410 INFO:tasks.workunit.client.1.smithi107.stdout:4/754: dread d0/d1f/d5e/feb [0,4194304] 0 2024-09-10T10:04:21.411 INFO:tasks.workunit.client.1.smithi107.stdout:6/634: symlink d0/d3d/d14/d21/d8a/da2/da3/ld8 0 2024-09-10T10:04:21.413 INFO:tasks.workunit.client.1.smithi107.stdout:5/666: unlink de/d9c/fd7 0 2024-09-10T10:04:21.413 INFO:tasks.workunit.client.1.smithi107.stdout:5/667: readlink de/l84 0 2024-09-10T10:04:21.415 INFO:tasks.workunit.client.1.smithi107.stdout:8/528: mkdir d5/d8/d66/d8b/d18/dab 0 2024-09-10T10:04:21.416 INFO:tasks.workunit.client.1.smithi107.stdout:6/635: symlink d0/d76/ld9 0 2024-09-10T10:04:21.417 INFO:tasks.workunit.client.1.smithi107.stdout:8/529: chown d5/d8/d66/d8b/d1a/d64/f6b 828277 1 2024-09-10T10:04:21.417 INFO:tasks.workunit.client.1.smithi107.stdout:4/755: mkdir d0/d1f/d20/d47/d8c/dfe 0 2024-09-10T10:04:21.419 INFO:tasks.workunit.client.1.smithi107.stdout:4/756: dread - d0/d1f/d20/fcd zero size 2024-09-10T10:04:21.420 INFO:tasks.workunit.client.1.smithi107.stdout:6/636: symlink d0/d3d/d14/d17/d49/d55/d73/lda 0 2024-09-10T10:04:21.420 INFO:tasks.workunit.client.1.smithi107.stdout:8/530: creat d5/d8/d66/d8b/d1a/d75/fac x:0 0 0 2024-09-10T10:04:21.422 INFO:tasks.workunit.client.1.smithi107.stdout:4/757: mkdir d0/d1f/d20/d47/d8c/dfe/dff 0 2024-09-10T10:04:21.422 INFO:tasks.workunit.client.1.smithi107.stdout:8/531: chown d5/d8/d66/d8b/d1a/fa8 326858 1 2024-09-10T10:04:21.422 INFO:tasks.workunit.client.1.smithi107.stdout:4/758: fdatasync d0/d40/db3/fd2 0 2024-09-10T10:04:21.423 INFO:tasks.workunit.client.1.smithi107.stdout:4/759: write d0/d6b/d9d/fc5 [3510813,46388] 0 2024-09-10T10:04:21.425 INFO:tasks.workunit.client.1.smithi107.stdout:6/637: link d0/d70/c72 d0/d3d/d14/d17/d24/cdb 0 2024-09-10T10:04:21.426 INFO:tasks.workunit.client.1.smithi107.stdout:5/668: truncate de/d20/d2b/d4b/d8c/fdf 2334993 0 2024-09-10T10:04:21.427 INFO:tasks.workunit.client.1.smithi107.stdout:8/532: rename d5/d8/d66/d8b/d1a/da3/la6 to d5/d8/d66/d8b/d18/dab/lad 0 2024-09-10T10:04:21.427 INFO:tasks.workunit.client.1.smithi107.stdout:8/533: read d5/f4a [2695401,46166] 0 2024-09-10T10:04:21.428 INFO:tasks.workunit.client.1.smithi107.stdout:6/638: symlink d0/d3d/d14/d42/d88/ldc 0 2024-09-10T10:04:21.428 INFO:tasks.workunit.client.1.smithi107.stdout:5/669: creat de/d4a/d7e/db2/dbc/fe9 x:0 0 0 2024-09-10T10:04:21.429 INFO:tasks.workunit.client.1.smithi107.stdout:4/760: creat d0/d1f/d90/dfb/f100 x:0 0 0 2024-09-10T10:04:21.430 INFO:tasks.workunit.client.1.smithi107.stdout:6/639: mknod d0/d3d/d14/d17/d24/cdd 0 2024-09-10T10:04:21.431 INFO:tasks.workunit.client.1.smithi107.stdout:8/534: unlink d5/d8/d66/d8b/d21/d83/l93 0 2024-09-10T10:04:21.431 INFO:tasks.workunit.client.1.smithi107.stdout:6/640: truncate d0/d3d/d14/d17/fb4 845949 0 2024-09-10T10:04:21.431 INFO:tasks.workunit.client.1.smithi107.stdout:5/670: symlink de/d4a/d4e/d89/lea 0 2024-09-10T10:04:21.433 INFO:tasks.workunit.client.1.smithi107.stdout:4/761: rename d0/d1f/c37 to d0/d6b/c101 0 2024-09-10T10:04:21.434 INFO:tasks.workunit.client.1.smithi107.stdout:2/650: sync 2024-09-10T10:04:21.435 INFO:tasks.workunit.client.1.smithi107.stdout:6/641: mkdir d0/d3d/d14/dde 0 2024-09-10T10:04:21.436 INFO:tasks.workunit.client.1.smithi107.stdout:2/651: write d3/da/df/d20/d36/d39/f4e [2167091,74493] 0 2024-09-10T10:04:21.437 INFO:tasks.workunit.client.1.smithi107.stdout:8/535: rename d5/d8/d66/d8b/d1a/d64/f6b to d5/d8/d66/d8b/d1a/d71/fae 0 2024-09-10T10:04:21.441 INFO:tasks.workunit.client.1.smithi107.stdout:5/671: rmdir de/d4a/d7e/db2/dbc 39 2024-09-10T10:04:21.442 INFO:tasks.workunit.client.1.smithi107.stdout:8/536: readlink d5/d8/l7e 0 2024-09-10T10:04:21.444 INFO:tasks.workunit.client.1.smithi107.stdout:2/652: creat d3/d21/d95/fe2 x:0 0 0 2024-09-10T10:04:21.444 INFO:tasks.workunit.client.1.smithi107.stdout:4/762: dwrite d0/d6b/f96 [0,4194304] 0 2024-09-10T10:04:21.451 INFO:tasks.workunit.client.0.smithi071.stdout:6/470: sync 2024-09-10T10:04:21.451 INFO:tasks.workunit.client.0.smithi071.stdout:6/471: dread - d4/d20/f7d zero size 2024-09-10T10:04:21.453 INFO:tasks.workunit.client.1.smithi107.stdout:2/653: dread d3/da/d1e/d40/d8a/f8c [0,4194304] 0 2024-09-10T10:04:21.454 INFO:tasks.workunit.client.1.smithi107.stdout:4/763: dwrite d0/d1f/d20/d47/f85 [0,4194304] 0 2024-09-10T10:04:21.455 INFO:tasks.workunit.client.1.smithi107.stdout:6/642: dread d0/d3d/d14/d17/d4b/f6e [0,4194304] 0 2024-09-10T10:04:21.455 INFO:tasks.workunit.client.1.smithi107.stdout:2/654: stat d3/da/c52 0 2024-09-10T10:04:21.457 INFO:tasks.workunit.client.0.smithi071.stdout:6/472: dwrite d4/d61/f8a [0,4194304] 0 2024-09-10T10:04:21.460 INFO:tasks.workunit.client.1.smithi107.stdout:6/643: rename d0/d3d/d14/d21/d8a/da2/da3 to d0/d3d/d14/d21/d8a/da2/da3/dac/ddf 22 2024-09-10T10:04:21.460 INFO:tasks.workunit.client.1.smithi107.stdout:8/537: dwrite d5/d8/d66/d8b/d21/f56 [0,4194304] 0 2024-09-10T10:04:21.461 INFO:tasks.workunit.client.1.smithi107.stdout:4/764: creat d0/d40/d57/d76/d77/da9/f102 x:0 0 0 2024-09-10T10:04:21.461 INFO:tasks.workunit.client.0.smithi071.stdout:6/473: rename d4/d1c/f4b to d4/d20/f9d 0 2024-09-10T10:04:21.463 INFO:tasks.workunit.client.0.smithi071.stdout:6/474: dread - d4/da/df/d2e/d3a/d3e/d45/f5c zero size 2024-09-10T10:04:21.465 INFO:tasks.workunit.client.1.smithi107.stdout:2/655: creat d3/da/d1e/fe3 x:0 0 0 2024-09-10T10:04:21.467 INFO:tasks.workunit.client.1.smithi107.stdout:6/644: creat d0/d3d/d14/d17/d4b/fe0 x:0 0 0 2024-09-10T10:04:21.468 INFO:tasks.workunit.client.1.smithi107.stdout:8/538: rmdir d5/d8/d66/d8b/d18/dab 39 2024-09-10T10:04:21.470 INFO:tasks.workunit.client.1.smithi107.stdout:4/765: fsync d0/d40/d6d/ff0 0 2024-09-10T10:04:21.472 INFO:tasks.workunit.client.0.smithi071.stdout:6/475: read f3 [4192597,48099] 0 2024-09-10T10:04:21.472 INFO:tasks.workunit.client.1.smithi107.stdout:2/656: mkdir d3/da/d1e/d40/d8a/d7f/d55/d85/de4 0 2024-09-10T10:04:21.472 INFO:tasks.workunit.client.1.smithi107.stdout:8/539: rmdir d5/d8/d2a/d35 39 2024-09-10T10:04:21.473 INFO:tasks.workunit.client.1.smithi107.stdout:4/766: creat d0/d40/d57/d76/d77/da1/f103 x:0 0 0 2024-09-10T10:04:21.474 INFO:tasks.workunit.client.1.smithi107.stdout:6/645: creat d0/d3d/fe1 x:0 0 0 2024-09-10T10:04:21.475 INFO:tasks.workunit.client.1.smithi107.stdout:8/540: chown d5/d8/d66/d8b/d18/l5e 0 1 2024-09-10T10:04:21.476 INFO:tasks.workunit.client.1.smithi107.stdout:2/657: symlink d3/da/d66/d91/dae/le5 0 2024-09-10T10:04:21.476 INFO:tasks.workunit.client.1.smithi107.stdout:8/541: chown d5/f38 20 1 2024-09-10T10:04:21.479 INFO:tasks.workunit.client.1.smithi107.stdout:6/646: truncate d0/d3d/d14/d21/f25 1646974 0 2024-09-10T10:04:21.483 INFO:tasks.workunit.client.0.smithi071.stdout:6/476: dwrite d4/da/f82 [0,4194304] 0 2024-09-10T10:04:21.483 INFO:tasks.workunit.client.1.smithi107.stdout:6/647: link d0/d3d/d14/d17/d49/d55/ld3 d0/d3d/d14/d21/d8a/da2/le2 0 2024-09-10T10:04:21.485 INFO:tasks.workunit.client.1.smithi107.stdout:6/648: dread d0/d3d/d14/d17/fb4 [0,4194304] 0 2024-09-10T10:04:21.485 INFO:tasks.workunit.client.0.smithi071.stdout:6/477: write d4/da/df/d2e/d3a/d3e/d45/f99 [323141,123768] 0 2024-09-10T10:04:21.485 INFO:tasks.workunit.client.1.smithi107.stdout:6/649: write d0/d3d/d14/d9f/dca/fcf [714298,17050] 0 2024-09-10T10:04:21.489 INFO:tasks.workunit.client.1.smithi107.stdout:6/650: write d0/d3d/d14/d17/d49/d55/d73/f74 [299747,14523] 0 2024-09-10T10:04:21.497 INFO:tasks.workunit.client.0.smithi071.stdout:6/478: truncate d4/da/f33 3097059 0 2024-09-10T10:04:21.498 INFO:tasks.workunit.client.0.smithi071.stdout:6/479: write d4/d20/f86 [416185,69431] 0 2024-09-10T10:04:21.499 INFO:tasks.workunit.client.0.smithi071.stdout:6/480: write d4/d1c/f93 [3489834,99873] 0 2024-09-10T10:04:21.501 INFO:tasks.workunit.client.1.smithi107.stdout:6/651: dwrite d0/d3d/d14/d17/d49/d55/d73/f82 [0,4194304] 0 2024-09-10T10:04:21.502 INFO:tasks.workunit.client.0.smithi071.stdout:6/481: creat d4/da/df/d2e/d3a/d51/d64/f9e x:0 0 0 2024-09-10T10:04:21.505 INFO:tasks.workunit.client.1.smithi107.stdout:4/767: dwrite d0/d40/d57/d4f/fb6 [0,4194304] 0 2024-09-10T10:04:21.505 INFO:tasks.workunit.client.1.smithi107.stdout:6/652: rename d0/d3d/d14/d21 to d0/d3d/d14/d21/d8a/de3 22 2024-09-10T10:04:21.506 INFO:tasks.workunit.client.0.smithi071.stdout:6/482: rename f3 to d4/d61/d83/f9f 0 2024-09-10T10:04:21.507 INFO:tasks.workunit.client.1.smithi107.stdout:2/658: dwrite d3/d21/f32 [0,4194304] 0 2024-09-10T10:04:21.511 INFO:tasks.workunit.client.0.smithi071.stdout:6/483: creat d4/da/df/d2e/d3a/d3e/d5d/d81/d95/fa0 x:0 0 0 2024-09-10T10:04:21.513 INFO:tasks.workunit.client.1.smithi107.stdout:8/542: dread d5/d8/f13 [0,4194304] 0 2024-09-10T10:04:21.516 INFO:tasks.workunit.client.1.smithi107.stdout:6/653: mknod d0/d3d/d14/d17/d49/dbe/ce4 0 2024-09-10T10:04:21.518 INFO:tasks.workunit.client.1.smithi107.stdout:2/659: mknod d3/da/df/d20/ce6 0 2024-09-10T10:04:21.519 INFO:tasks.workunit.client.0.smithi071.stdout:6/484: dwrite d4/da/df/d2e/d3a/d51/f9a [0,4194304] 0 2024-09-10T10:04:21.521 INFO:tasks.workunit.client.0.smithi071.stdout:6/485: creat d4/d20/fa1 x:0 0 0 2024-09-10T10:04:21.524 INFO:tasks.workunit.client.0.smithi071.stdout:6/486: write d4/f25 [3018598,41126] 0 2024-09-10T10:04:21.525 INFO:tasks.workunit.client.0.smithi071.stdout:6/487: write d4/da/df/d2e/d3a/f66 [606807,45932] 0 2024-09-10T10:04:21.526 INFO:tasks.workunit.client.1.smithi107.stdout:6/654: dwrite d0/d3d/d14/d42/f8b [0,4194304] 0 2024-09-10T10:04:21.526 INFO:tasks.workunit.client.0.smithi071.stdout:6/488: fdatasync d4/d1c/f93 0 2024-09-10T10:04:21.527 INFO:tasks.workunit.client.0.smithi071.stdout:6/489: dread - d4/d20/f7d zero size 2024-09-10T10:04:21.530 INFO:tasks.workunit.client.0.smithi071.stdout:6/490: rmdir d4/da/df/d2e/d3a 39 2024-09-10T10:04:21.530 INFO:tasks.workunit.client.1.smithi107.stdout:2/660: dwrite d3/da/df/d20/d36/d4f/faa [0,4194304] 0 2024-09-10T10:04:21.530 INFO:tasks.workunit.client.1.smithi107.stdout:6/655: read d0/d3d/d14/d17/f47 [60080,60179] 0 2024-09-10T10:04:21.533 INFO:tasks.workunit.client.1.smithi107.stdout:2/661: write d3/da/d1e/d40/fc4 [195496,34025] 0 2024-09-10T10:04:21.538 INFO:tasks.workunit.client.1.smithi107.stdout:2/662: symlink d3/da/d1e/d27/d5b/le7 0 2024-09-10T10:04:21.539 INFO:tasks.workunit.client.1.smithi107.stdout:7/554: sync 2024-09-10T10:04:21.542 INFO:tasks.workunit.client.1.smithi107.stdout:7/555: creat d0/d8/d5c/d6d/fac x:0 0 0 2024-09-10T10:04:21.544 INFO:tasks.workunit.client.1.smithi107.stdout:2/663: link d3/da/df/d20/d36/d4f/d92/cbb d3/da/d1e/d27/d5b/ce8 0 2024-09-10T10:04:21.547 INFO:tasks.workunit.client.1.smithi107.stdout:4/768: dwrite d0/d40/d57/d76/d77/da1/fac [0,4194304] 0 2024-09-10T10:04:21.549 INFO:tasks.workunit.client.1.smithi107.stdout:8/543: write d5/f26 [1616897,86318] 0 2024-09-10T10:04:21.551 INFO:tasks.workunit.client.1.smithi107.stdout:2/664: rename d3/da/df/d20/d36/d4f/d92/f87 to d3/da/d1e/d40/d8a/d7f/d55/d85/de4/fe9 0 2024-09-10T10:04:21.554 INFO:tasks.workunit.client.1.smithi107.stdout:8/544: mknod d5/d8/d66/d8b/d18/caf 0 2024-09-10T10:04:21.555 INFO:tasks.workunit.client.1.smithi107.stdout:2/665: truncate d3/d21/f47 520935 0 2024-09-10T10:04:21.558 INFO:tasks.workunit.client.1.smithi107.stdout:2/666: rename d3/d6d to d3/da/d66/d91/dea 0 2024-09-10T10:04:21.560 INFO:tasks.workunit.client.1.smithi107.stdout:8/545: dwrite d5/d8/d66/d8b/d21/d83/f84 [0,4194304] 0 2024-09-10T10:04:21.560 INFO:tasks.workunit.client.1.smithi107.stdout:2/667: truncate d3/da/df/d20/fdd 129152 0 2024-09-10T10:04:21.561 INFO:tasks.workunit.client.0.smithi071.stdout:6/491: dread d4/d1c/f42 [0,4194304] 0 2024-09-10T10:04:21.562 INFO:tasks.workunit.client.1.smithi107.stdout:8/546: dread - d5/d8/d66/d8b/d81/f8c zero size 2024-09-10T10:04:21.564 INFO:tasks.workunit.client.1.smithi107.stdout:2/668: mkdir d3/da/d1e/d5f/dad/deb 0 2024-09-10T10:04:21.564 INFO:tasks.workunit.client.1.smithi107.stdout:8/547: chown d5/d8/d66/d8b/d21/d83/fa1 1859 1 2024-09-10T10:04:21.566 INFO:tasks.workunit.client.1.smithi107.stdout:8/548: fsync d5/f38 0 2024-09-10T10:04:21.567 INFO:tasks.workunit.client.0.smithi071.stdout:6/492: dread d4/f19 [0,4194304] 0 2024-09-10T10:04:21.568 INFO:tasks.workunit.client.1.smithi107.stdout:2/669: mkdir d3/da/df/d20/d36/d4f/d92/dec 0 2024-09-10T10:04:21.572 INFO:tasks.workunit.client.0.smithi071.stdout:6/493: dread - d4/da/df/d2e/d3a/d3e/d45/f5c zero size 2024-09-10T10:04:21.572 INFO:tasks.workunit.client.1.smithi107.stdout:6/656: dwrite d0/d3d/d14/d21/d8a/da2/f69 [0,4194304] 0 2024-09-10T10:04:21.572 INFO:tasks.workunit.client.1.smithi107.stdout:8/549: creat d5/d8/d5b/fb0 x:0 0 0 2024-09-10T10:04:21.574 INFO:tasks.workunit.client.0.smithi071.stdout:6/494: creat d4/da/df/d2e/d3a/d40/fa2 x:0 0 0 2024-09-10T10:04:21.577 INFO:tasks.workunit.client.1.smithi107.stdout:7/556: dread d0/d1b/d4d/d69/d97/d68/f58 [0,4194304] 0 2024-09-10T10:04:21.578 INFO:tasks.workunit.client.0.smithi071.stdout:6/495: truncate d4/da/df/d2e/f32 7658758 0 2024-09-10T10:04:21.578 INFO:tasks.workunit.client.1.smithi107.stdout:4/769: write d0/d1f/d20/f50 [261659,2141] 0 2024-09-10T10:04:21.579 INFO:tasks.workunit.client.1.smithi107.stdout:0/594: sync 2024-09-10T10:04:21.579 INFO:tasks.workunit.client.1.smithi107.stdout:3/954: sync 2024-09-10T10:04:21.580 INFO:tasks.workunit.client.1.smithi107.stdout:7/557: truncate d0/d8/dc/d2c/f7e 776945 0 2024-09-10T10:04:21.581 INFO:tasks.workunit.client.1.smithi107.stdout:8/550: symlink d5/d8/d66/d8b/d18/lb1 0 2024-09-10T10:04:21.581 INFO:tasks.workunit.client.1.smithi107.stdout:4/770: write d0/d1f/d20/d47/d8c/fe8 [496053,72015] 0 2024-09-10T10:04:21.582 INFO:tasks.workunit.client.1.smithi107.stdout:3/955: creat dc/d56/f141 x:0 0 0 2024-09-10T10:04:21.583 INFO:tasks.workunit.client.1.smithi107.stdout:2/670: link d3/da/d1e/d5f/la9 d3/da/df/d20/d36/d4f/d92/led 0 2024-09-10T10:04:21.584 INFO:tasks.workunit.client.0.smithi071.stdout:6/496: dwrite d4/da/fb [0,4194304] 0 2024-09-10T10:04:21.585 INFO:tasks.workunit.client.1.smithi107.stdout:8/551: write d5/d8/d66/d8b/d1a/d71/f7d [2213457,59233] 0 2024-09-10T10:04:21.585 INFO:tasks.workunit.client.1.smithi107.stdout:3/956: fsync dc/dd/d20/d23/d2f/d9c/f13b 0 2024-09-10T10:04:21.586 INFO:tasks.workunit.client.1.smithi107.stdout:3/957: readlink dc/dd/d20/l2c 0 2024-09-10T10:04:21.586 INFO:tasks.workunit.client.1.smithi107.stdout:7/558: creat d0/d1b/d4d/d69/d97/d3d/d81/fad x:0 0 0 2024-09-10T10:04:21.587 INFO:tasks.workunit.client.1.smithi107.stdout:2/671: write d3/da/df/d20/d36/fd8 [1008861,4100] 0 2024-09-10T10:04:21.588 INFO:tasks.workunit.client.1.smithi107.stdout:2/672: write d3/d21/d79/f7e [771570,125598] 0 2024-09-10T10:04:21.590 INFO:tasks.workunit.client.1.smithi107.stdout:0/595: truncate d6/d8/d2f/da3/da5/fab 1036436 0 2024-09-10T10:04:21.591 INFO:tasks.workunit.client.1.smithi107.stdout:4/771: getdents d0/d40 0 2024-09-10T10:04:21.592 INFO:tasks.workunit.client.1.smithi107.stdout:7/559: creat d0/d8/d5c/fae x:0 0 0 2024-09-10T10:04:21.593 INFO:tasks.workunit.client.1.smithi107.stdout:7/560: read d0/d8/f84 [38120,21016] 0 2024-09-10T10:04:21.594 INFO:tasks.workunit.client.1.smithi107.stdout:3/958: unlink dc/dd/d20/d23/d39/d69/fe6 0 2024-09-10T10:04:21.597 INFO:tasks.workunit.client.1.smithi107.stdout:0/596: write d6/d8/d2f/d35/d3c/d58/d69/f88 [2834081,128537] 0 2024-09-10T10:04:21.598 INFO:tasks.workunit.client.1.smithi107.stdout:6/657: write d0/d3d/d14/d17/f47 [2575291,74879] 0 2024-09-10T10:04:21.598 INFO:tasks.workunit.client.0.smithi071.stdout:6/497: write d4/d1c/f42 [3194962,91565] 0 2024-09-10T10:04:21.599 INFO:tasks.workunit.client.1.smithi107.stdout:4/772: write d0/d1f/d20/f30 [4348824,32837] 0 2024-09-10T10:04:21.600 INFO:tasks.workunit.client.0.smithi071.stdout:6/498: dread - d4/da/df/d2e/d3a/d3e/d5d/f9c zero size 2024-09-10T10:04:21.600 INFO:tasks.workunit.client.0.smithi071.stdout:0/535: sync 2024-09-10T10:04:21.600 INFO:tasks.workunit.client.1.smithi107.stdout:7/561: write d0/d8/f84 [151533,11163] 0 2024-09-10T10:04:21.601 INFO:tasks.workunit.client.1.smithi107.stdout:8/552: creat d5/d8/d66/d8b/d18/fb2 x:0 0 0 2024-09-10T10:04:21.602 INFO:tasks.workunit.client.0.smithi071.stdout:6/499: write d4/da/df/d2e/d3a/f66 [320454,75176] 0 2024-09-10T10:04:21.604 INFO:tasks.workunit.client.0.smithi071.stdout:6/500: fsync d4/da/df/d2e/d3a/d3e/d45/f99 0 2024-09-10T10:04:21.605 INFO:tasks.workunit.client.1.smithi107.stdout:0/597: symlink d6/d5a/lb8 0 2024-09-10T10:04:21.610 INFO:tasks.workunit.client.1.smithi107.stdout:4/773: mknod d0/d40/d75/c104 0 2024-09-10T10:04:21.612 INFO:tasks.workunit.client.1.smithi107.stdout:2/673: dread d3/da/df/d20/d36/d4f/f50 [0,4194304] 0 2024-09-10T10:04:21.612 INFO:tasks.workunit.client.1.smithi107.stdout:2/674: stat d3/da/d1e/d27 0 2024-09-10T10:04:21.613 INFO:tasks.workunit.client.1.smithi107.stdout:4/774: creat d0/d40/d57/d76/d77/da1/f105 x:0 0 0 2024-09-10T10:04:21.613 INFO:tasks.workunit.client.0.smithi071.stdout:6/501: dwrite d4/f6c [4194304,4194304] 0 2024-09-10T10:04:21.616 INFO:tasks.workunit.client.0.smithi071.stdout:0/536: dwrite d11/d1e/f83 [0,4194304] 0 2024-09-10T10:04:21.616 INFO:tasks.workunit.client.1.smithi107.stdout:4/775: fdatasync d0/d1f/f60 0 2024-09-10T10:04:21.620 INFO:tasks.workunit.client.1.smithi107.stdout:9/584: sync 2024-09-10T10:04:21.620 INFO:tasks.workunit.client.1.smithi107.stdout:1/729: sync 2024-09-10T10:04:21.620 INFO:tasks.workunit.client.1.smithi107.stdout:5/672: sync 2024-09-10T10:04:21.621 INFO:tasks.workunit.client.1.smithi107.stdout:9/585: dread - d5/d7/d1d/d95/fa4 zero size 2024-09-10T10:04:21.622 INFO:tasks.workunit.client.1.smithi107.stdout:4/776: dread - d0/d40/db3/fc9 zero size 2024-09-10T10:04:21.623 INFO:tasks.workunit.client.1.smithi107.stdout:2/675: mknod d3/da/df/d20/d36/cee 0 2024-09-10T10:04:21.624 INFO:tasks.workunit.client.0.smithi071.stdout:0/537: symlink d11/lbd 0 2024-09-10T10:04:21.624 INFO:tasks.workunit.client.1.smithi107.stdout:9/586: fsync d5/d7/d1d/d95/fa4 0 2024-09-10T10:04:21.625 INFO:tasks.workunit.client.1.smithi107.stdout:5/673: dread de/d20/d3d/f88 [0,4194304] 0 2024-09-10T10:04:21.627 INFO:tasks.workunit.client.0.smithi071.stdout:6/502: rename d4/da/df/d2e/d3a/d3e/d45/f48 to d4/da/df/d2e/d3a/fa3 0 2024-09-10T10:04:21.628 INFO:tasks.workunit.client.1.smithi107.stdout:1/730: symlink d2/d6/dc6/de8/leb 0 2024-09-10T10:04:21.628 INFO:tasks.workunit.client.1.smithi107.stdout:2/676: creat d3/da/df/d78/fef x:0 0 0 2024-09-10T10:04:21.629 INFO:tasks.workunit.client.0.smithi071.stdout:0/538: creat d11/d30/d52/d79/fbe x:0 0 0 2024-09-10T10:04:21.630 INFO:tasks.workunit.client.1.smithi107.stdout:9/587: stat d5/d7/d1d/d9b 0 2024-09-10T10:04:21.630 INFO:tasks.workunit.client.1.smithi107.stdout:7/562: write d0/d1b/d4d/d69/d97/d3d/f55 [158632,17523] 0 2024-09-10T10:04:21.630 INFO:tasks.workunit.client.0.smithi071.stdout:0/539: dread - d11/d22/f82 zero size 2024-09-10T10:04:21.632 INFO:tasks.workunit.client.1.smithi107.stdout:4/777: creat d0/d1f/d20/d47/d8c/dfe/f106 x:0 0 0 2024-09-10T10:04:21.633 INFO:tasks.workunit.client.1.smithi107.stdout:5/674: stat de/d4a/d4e/c78 0 2024-09-10T10:04:21.633 INFO:tasks.workunit.client.1.smithi107.stdout:7/563: chown d0/d1b/d4d/d69/d97/d95 1104722 1 2024-09-10T10:04:21.634 INFO:tasks.workunit.client.1.smithi107.stdout:6/658: truncate d0/f3e 3642287 0 2024-09-10T10:04:21.636 INFO:tasks.workunit.client.0.smithi071.stdout:0/540: getdents d11/d22 0 2024-09-10T10:04:21.636 INFO:tasks.workunit.client.0.smithi071.stdout:0/541: chown d11/d30/d52 225208 1 2024-09-10T10:04:21.637 INFO:tasks.workunit.client.0.smithi071.stdout:0/542: chown d11/l88 256210871 1 2024-09-10T10:04:21.637 INFO:tasks.workunit.client.1.smithi107.stdout:3/959: dread dc/dd/d45/d26/d41/d44/f2d [0,4194304] 0 2024-09-10T10:04:21.638 INFO:tasks.workunit.client.1.smithi107.stdout:4/778: symlink d0/d1f/d20/d80/l107 0 2024-09-10T10:04:21.639 INFO:tasks.workunit.client.0.smithi071.stdout:0/543: creat d11/d22/d9a/fbf x:0 0 0 2024-09-10T10:04:21.640 INFO:tasks.workunit.client.1.smithi107.stdout:1/731: creat d2/d6/dc6/dd4/fec x:0 0 0 2024-09-10T10:04:21.640 INFO:tasks.workunit.client.1.smithi107.stdout:5/675: symlink de/db3/leb 0 2024-09-10T10:04:21.641 INFO:tasks.workunit.client.0.smithi071.stdout:0/544: mknod d11/d30/d52/d5f/cc0 0 2024-09-10T10:04:21.642 INFO:tasks.workunit.client.0.smithi071.stdout:7/634: sync 2024-09-10T10:04:21.643 INFO:tasks.workunit.client.0.smithi071.stdout:2/587: sync 2024-09-10T10:04:21.643 INFO:tasks.workunit.client.0.smithi071.stdout:8/547: sync 2024-09-10T10:04:21.643 INFO:tasks.workunit.client.0.smithi071.stdout:1/636: sync 2024-09-10T10:04:21.643 INFO:tasks.workunit.client.0.smithi071.stdout:3/553: sync 2024-09-10T10:04:21.643 INFO:tasks.workunit.client.0.smithi071.stdout:4/550: sync 2024-09-10T10:04:21.643 INFO:tasks.workunit.client.0.smithi071.stdout:5/475: sync 2024-09-10T10:04:21.643 INFO:tasks.workunit.client.0.smithi071.stdout:9/876: sync 2024-09-10T10:04:21.644 INFO:tasks.workunit.client.0.smithi071.stdout:0/545: mknod d11/d1e/cc1 0 2024-09-10T10:04:21.644 INFO:tasks.workunit.client.1.smithi107.stdout:6/659: mknod d0/d3d/d14/d21/d8a/da7/dc1/ce5 0 2024-09-10T10:04:21.644 INFO:tasks.workunit.client.1.smithi107.stdout:7/564: read d0/d8/f6f [604094,122115] 0 2024-09-10T10:04:21.645 INFO:tasks.workunit.client.0.smithi071.stdout:0/546: fsync d11/d22/d9a/fab 0 2024-09-10T10:04:21.646 INFO:tasks.workunit.client.0.smithi071.stdout:4/551: write db/d15/d17/d24/f2b [140972,20976] 0 2024-09-10T10:04:21.646 INFO:tasks.workunit.client.1.smithi107.stdout:1/732: symlink d2/d12/d5a/led 0 2024-09-10T10:04:21.648 INFO:tasks.workunit.client.0.smithi071.stdout:9/877: chown d0/fa 60 1 2024-09-10T10:04:21.648 INFO:tasks.workunit.client.0.smithi071.stdout:7/635: fsync d9/d15/d1f/d98/fc1 0 2024-09-10T10:04:21.648 INFO:tasks.workunit.client.1.smithi107.stdout:0/598: dwrite d6/d8/d2f/d35/d3c/f74 [0,4194304] 0 2024-09-10T10:04:21.649 INFO:tasks.workunit.client.1.smithi107.stdout:5/676: write de/d20/d2b/d4b/d8c/fe2 [690347,37997] 0 2024-09-10T10:04:21.650 INFO:tasks.workunit.client.0.smithi071.stdout:2/588: unlink d8/f48 0 2024-09-10T10:04:21.651 INFO:tasks.workunit.client.1.smithi107.stdout:7/565: fdatasync d0/d8/f38 0 2024-09-10T10:04:21.651 INFO:tasks.workunit.client.1.smithi107.stdout:8/553: dwrite d5/d8/d66/d8b/d1a/f43 [4194304,4194304] 0 2024-09-10T10:04:21.651 INFO:tasks.workunit.client.0.smithi071.stdout:6/503: dread d4/da/df/d2e/d3a/d3e/d45/f46 [0,4194304] 0 2024-09-10T10:04:21.651 INFO:tasks.workunit.client.0.smithi071.stdout:8/548: read d5/df/d1d/f92 [15919,108073] 0 2024-09-10T10:04:21.655 INFO:tasks.workunit.client.0.smithi071.stdout:0/547: write d11/d30/d70/f8c [1035191,9353] 0 2024-09-10T10:04:21.655 INFO:tasks.workunit.client.1.smithi107.stdout:7/566: stat d0/d8/fa8 0 2024-09-10T10:04:21.657 INFO:tasks.workunit.client.0.smithi071.stdout:4/552: write db/d15/d17/f72 [916861,73840] 0 2024-09-10T10:04:21.658 INFO:tasks.workunit.client.1.smithi107.stdout:9/588: write d5/d7/f9 [2503272,6931] 0 2024-09-10T10:04:21.658 INFO:tasks.workunit.client.1.smithi107.stdout:8/554: chown d5/f19 117 1 2024-09-10T10:04:21.659 INFO:tasks.workunit.client.0.smithi071.stdout:0/548: write d11/d1e/f74 [1000709,112233] 0 2024-09-10T10:04:21.660 INFO:tasks.workunit.client.1.smithi107.stdout:4/779: rename d0/c48 to d0/d40/d57/c108 0 2024-09-10T10:04:21.661 INFO:tasks.workunit.client.0.smithi071.stdout:8/549: write d5/df/d1e/d38/d9f/fbb [1687487,8578] 0 2024-09-10T10:04:21.664 INFO:tasks.workunit.client.0.smithi071.stdout:1/637: dread d1/d70/f7b [0,4194304] 0 2024-09-10T10:04:21.666 INFO:tasks.workunit.client.0.smithi071.stdout:5/476: link dc/df/d17/d22/d87/f92 dc/df/d29/fa1 0 2024-09-10T10:04:21.668 INFO:tasks.workunit.client.0.smithi071.stdout:1/638: dread - d1/d21/d3d/d4a/fa6 zero size 2024-09-10T10:04:21.669 INFO:tasks.workunit.client.1.smithi107.stdout:3/960: dwrite dc/dd/d45/d26/d41/d44/d63/f7b [0,4194304] 0 2024-09-10T10:04:21.669 INFO:tasks.workunit.client.0.smithi071.stdout:7/636: rename d9/d15/d55/d58 to d9/d15/d1f/d74/da1/dcf/ddf 0 2024-09-10T10:04:21.670 INFO:tasks.workunit.client.0.smithi071.stdout:9/878: fsync d0/db/d1b/d1d/d5b/f70 0 2024-09-10T10:04:21.671 INFO:tasks.workunit.client.0.smithi071.stdout:8/550: symlink d5/df/d1d/d81/lc3 0 2024-09-10T10:04:21.672 INFO:tasks.workunit.client.0.smithi071.stdout:5/477: stat dc/df/d3e/d5a/f71 0 2024-09-10T10:04:21.673 INFO:tasks.workunit.client.1.smithi107.stdout:8/555: chown d5/d8/d66/d8b/d21/f73 5 1 2024-09-10T10:04:21.673 INFO:tasks.workunit.client.1.smithi107.stdout:5/677: rmdir de/d4a/d4e/d89 39 2024-09-10T10:04:21.674 INFO:tasks.workunit.client.0.smithi071.stdout:7/637: chown d9/ff 20 1 2024-09-10T10:04:21.674 INFO:tasks.workunit.client.1.smithi107.stdout:1/733: dwrite d2/d35/f98 [0,4194304] 0 2024-09-10T10:04:21.675 INFO:tasks.workunit.client.1.smithi107.stdout:2/677: dread d3/da/df/d20/d36/d39/fce [0,4194304] 0 2024-09-10T10:04:21.675 INFO:tasks.workunit.client.0.smithi071.stdout:4/553: rename db/d15/d26/d43/c73 to db/d15/d26/cb5 0 2024-09-10T10:04:21.676 INFO:tasks.workunit.client.0.smithi071.stdout:1/639: mkdir d1/d3f/d58/daf/ddc 0 2024-09-10T10:04:21.676 INFO:tasks.workunit.client.1.smithi107.stdout:3/961: rmdir dc/dd/d45/d26/d41/d44/d35 39 2024-09-10T10:04:21.676 INFO:tasks.workunit.client.1.smithi107.stdout:0/599: dwrite d6/d8/d2f/d2e/d32/d59/f67 [4194304,4194304] 0 2024-09-10T10:04:21.679 INFO:tasks.workunit.client.0.smithi071.stdout:8/551: truncate d5/df/fad 1851855 0 2024-09-10T10:04:21.679 INFO:tasks.workunit.client.0.smithi071.stdout:5/478: creat dc/df/d17/fa2 x:0 0 0 2024-09-10T10:04:21.680 INFO:tasks.workunit.client.1.smithi107.stdout:4/780: mknod d0/d1f/d20/d47/d8c/dfe/c109 0 2024-09-10T10:04:21.681 INFO:tasks.workunit.client.0.smithi071.stdout:5/479: fdatasync dc/df/f7b 0 2024-09-10T10:04:21.682 INFO:tasks.workunit.client.1.smithi107.stdout:0/600: chown d6/d8/d2f/d2e 15 1 2024-09-10T10:04:21.682 INFO:tasks.workunit.client.0.smithi071.stdout:0/549: getdents d11/d30/d52/d79 0 2024-09-10T10:04:21.683 INFO:tasks.workunit.client.1.smithi107.stdout:3/962: mkdir dc/dd/d45/d26/d41/d44/d63/d101/d142 0 2024-09-10T10:04:21.683 INFO:tasks.workunit.client.0.smithi071.stdout:7/638: link d9/d15/d55/fcc d9/d15/d1f/d98/fe0 0 2024-09-10T10:04:21.685 INFO:tasks.workunit.client.1.smithi107.stdout:2/678: symlink d3/da/d1e/d40/d8a/d7f/d55/d85/d7c/lf0 0 2024-09-10T10:04:21.687 INFO:tasks.workunit.client.0.smithi071.stdout:1/640: rename d1/d3f/fd3 to d1/d3f/fdd 0 2024-09-10T10:04:21.688 INFO:tasks.workunit.client.1.smithi107.stdout:1/734: truncate d2/d35/f5b 700736 0 2024-09-10T10:04:21.689 INFO:tasks.workunit.client.1.smithi107.stdout:3/963: rmdir dc/dd/d45/d26/d41/d10e 39 2024-09-10T10:04:21.690 INFO:tasks.workunit.client.1.smithi107.stdout:2/679: chown d3/da/df/d20/d36/d39/fb2 0 1 2024-09-10T10:04:21.690 INFO:tasks.workunit.client.1.smithi107.stdout:6/660: rename d0/d3d/d14/d21/l59 to d0/d3d/d14/d42/le6 0 2024-09-10T10:04:21.691 INFO:tasks.workunit.client.0.smithi071.stdout:9/879: dwrite d0/db/d1b/d1d/d4b/db9/dba/feb [0,4194304] 0 2024-09-10T10:04:21.691 INFO:tasks.workunit.client.1.smithi107.stdout:0/601: truncate d6/d8/d2f/d35/d3c/d58/d69/f6b 104608 0 2024-09-10T10:04:21.693 INFO:tasks.workunit.client.1.smithi107.stdout:4/781: dwrite d0/d1f/d20/f70 [0,4194304] 0 2024-09-10T10:04:21.694 INFO:tasks.workunit.client.1.smithi107.stdout:6/661: write d0/d3d/d14/d17/d4b/fa8 [497162,81595] 0 2024-09-10T10:04:21.695 INFO:tasks.workunit.client.1.smithi107.stdout:9/589: write d5/d7/d1d/d9b/dab/f5d [954161,88487] 0 2024-09-10T10:04:21.695 INFO:tasks.workunit.client.1.smithi107.stdout:7/567: write d0/d1b/f28 [1474963,89975] 0 2024-09-10T10:04:21.700 INFO:tasks.workunit.client.0.smithi071.stdout:1/641: dread d1/d21/f63 [0,4194304] 0 2024-09-10T10:04:21.701 INFO:tasks.workunit.client.1.smithi107.stdout:9/590: stat d5/d7/d3c/lc2 0 2024-09-10T10:04:21.703 INFO:tasks.workunit.client.1.smithi107.stdout:2/680: mkdir d3/da/d1e/d5f/df1 0 2024-09-10T10:04:21.704 INFO:tasks.workunit.client.1.smithi107.stdout:9/591: dread - d5/d7/d1d/d41/d83/d9a/fb7 zero size 2024-09-10T10:04:21.706 INFO:tasks.workunit.client.0.smithi071.stdout:4/554: dwrite db/d15/d4b/f58 [0,4194304] 0 2024-09-10T10:04:21.706 INFO:tasks.workunit.client.1.smithi107.stdout:6/662: read - d0/d3d/d14/d21/f7f zero size 2024-09-10T10:04:21.707 INFO:tasks.workunit.client.1.smithi107.stdout:2/681: chown d3/da/d1e/d40/d8a/d7f/d55/fba 1542931 1 2024-09-10T10:04:21.708 INFO:tasks.workunit.client.0.smithi071.stdout:0/550: dread d11/d30/d70/f8c [4194304,4194304] 0 2024-09-10T10:04:21.710 INFO:tasks.workunit.client.0.smithi071.stdout:6/504: dwrite d4/d1c/f4d [0,4194304] 0 2024-09-10T10:04:21.711 INFO:tasks.workunit.client.0.smithi071.stdout:2/589: dread d8/d24/fa5 [0,4194304] 0 2024-09-10T10:04:21.712 INFO:tasks.workunit.client.1.smithi107.stdout:7/568: rename d0/d8/d56/f6c to d0/d1b/d9b/faf 0 2024-09-10T10:04:21.713 INFO:tasks.workunit.client.0.smithi071.stdout:7/639: dread d9/d1a/f4d [0,4194304] 0 2024-09-10T10:04:21.713 INFO:tasks.workunit.client.0.smithi071.stdout:4/555: mkdir db/d15/d17/d24/db6 0 2024-09-10T10:04:21.714 INFO:tasks.workunit.client.1.smithi107.stdout:4/782: mknod d0/d40/d57/d76/c10a 0 2024-09-10T10:04:21.715 INFO:tasks.workunit.client.1.smithi107.stdout:7/569: readlink d0/d1b/d4d/d69/d97/l53 0 2024-09-10T10:04:21.717 INFO:tasks.workunit.client.1.smithi107.stdout:2/682: dwrite d3/da/df/d20/d36/fcd [0,4194304] 0 2024-09-10T10:04:21.717 INFO:tasks.workunit.client.0.smithi071.stdout:6/505: creat d4/d61/fa4 x:0 0 0 2024-09-10T10:04:21.720 INFO:tasks.workunit.client.1.smithi107.stdout:1/735: getdents d2/d6/d24 0 2024-09-10T10:04:21.722 INFO:tasks.workunit.client.1.smithi107.stdout:1/736: stat d2/d6/d67/f9b 0 2024-09-10T10:04:21.723 INFO:tasks.workunit.client.1.smithi107.stdout:1/737: fdatasync d2/d12/d94/fc9 0 2024-09-10T10:04:21.723 INFO:tasks.workunit.client.1.smithi107.stdout:6/663: rename d0/d3d/d14/d17/d49/f7e to d0/d3d/d14/d17/d4b/fe7 0 2024-09-10T10:04:21.723 INFO:tasks.workunit.client.1.smithi107.stdout:2/683: chown d3/da/df/d20/d36/d39/da3/ddb 113 1 2024-09-10T10:04:21.723 INFO:tasks.workunit.client.0.smithi071.stdout:7/640: mkdir d9/d15/d1f/d74/da1/dcf/de1 0 2024-09-10T10:04:21.723 INFO:tasks.workunit.client.1.smithi107.stdout:9/592: creat d5/d7/d1d/db5/fcc x:0 0 0 2024-09-10T10:04:21.725 INFO:tasks.workunit.client.0.smithi071.stdout:7/641: chown d9/d2c 847 1 2024-09-10T10:04:21.725 INFO:tasks.workunit.client.1.smithi107.stdout:2/684: dread - d3/da/df/d78/fef zero size 2024-09-10T10:04:21.725 INFO:tasks.workunit.client.1.smithi107.stdout:7/570: creat d0/d8/dc/fb0 x:0 0 0 2024-09-10T10:04:21.727 INFO:tasks.workunit.client.1.smithi107.stdout:0/602: link d6/d8/d2f/d35/c51 d6/d8/d2f/d2e/d32/d85/cb9 0 2024-09-10T10:04:21.728 INFO:tasks.workunit.client.0.smithi071.stdout:7/642: stat d9/d11/dd2/fb4 0 2024-09-10T10:04:21.728 INFO:tasks.workunit.client.1.smithi107.stdout:3/964: chown dc/dd/d45/d26/d41/d44/d35/d4a/c93 127279956 1 2024-09-10T10:04:21.728 INFO:tasks.workunit.client.0.smithi071.stdout:5/480: dwrite dc/df/d17/d22/f35 [0,4194304] 0 2024-09-10T10:04:21.728 INFO:tasks.workunit.client.0.smithi071.stdout:0/551: creat d11/d22/d31/fc2 x:0 0 0 2024-09-10T10:04:21.729 INFO:tasks.workunit.client.1.smithi107.stdout:6/664: creat d0/d3d/d14/d9f/fe8 x:0 0 0 2024-09-10T10:04:21.730 INFO:tasks.workunit.client.1.smithi107.stdout:4/783: rename d0/d1f/d5e/fdf to d0/d1f/d20/d47/d8c/dfe/f10b 0 2024-09-10T10:04:21.730 INFO:tasks.workunit.client.0.smithi071.stdout:4/556: dread db/d15/d4b/f58 [0,4194304] 0 2024-09-10T10:04:21.733 INFO:tasks.workunit.client.1.smithi107.stdout:7/571: dread - d0/d8/dc/f4f zero size 2024-09-10T10:04:21.734 INFO:tasks.workunit.client.1.smithi107.stdout:9/593: unlink d5/d7/d1d/d41/d83/d9a/l1c 0 2024-09-10T10:04:21.736 INFO:tasks.workunit.client.1.smithi107.stdout:2/685: creat d3/da/df/d20/d36/d4f/d92/ff2 x:0 0 0 2024-09-10T10:04:21.737 INFO:tasks.workunit.client.0.smithi071.stdout:8/552: dread d5/f73 [0,4194304] 0 2024-09-10T10:04:21.737 INFO:tasks.workunit.client.0.smithi071.stdout:6/506: dwrite d4/da/df/d2e/d3a/d3e/d45/f99 [0,4194304] 0 2024-09-10T10:04:21.737 INFO:tasks.workunit.client.1.smithi107.stdout:1/738: rename d2/d35/f4a to d2/d36/dbc/fee 0 2024-09-10T10:04:21.739 INFO:tasks.workunit.client.1.smithi107.stdout:6/665: creat d0/d3d/d14/d9f/fe9 x:0 0 0 2024-09-10T10:04:21.740 INFO:tasks.workunit.client.1.smithi107.stdout:3/965: mknod dc/dd/d45/d26/d59/d5f/c143 0 2024-09-10T10:04:21.740 INFO:tasks.workunit.client.0.smithi071.stdout:5/481: dread f4 [0,4194304] 0 2024-09-10T10:04:21.741 INFO:tasks.workunit.client.1.smithi107.stdout:9/594: mknod d5/d7/d3c/ccd 0 2024-09-10T10:04:21.742 INFO:tasks.workunit.client.1.smithi107.stdout:2/686: chown d3/da/df/d20/d36/d39/c3b 3788153 1 2024-09-10T10:04:21.742 INFO:tasks.workunit.client.1.smithi107.stdout:0/603: dwrite d6/d8/d2f/d2e/d32/d59/f67 [4194304,4194304] 0 2024-09-10T10:04:21.742 INFO:tasks.workunit.client.0.smithi071.stdout:5/482: write dc/df/d3e/d5a/d80/f86 [218994,102469] 0 2024-09-10T10:04:21.742 INFO:tasks.workunit.client.0.smithi071.stdout:2/590: symlink d8/d87/d33/d41/d4d/d52/lc3 0 2024-09-10T10:04:21.743 INFO:tasks.workunit.client.1.smithi107.stdout:1/739: symlink d2/d12/d65/db4/lef 0 2024-09-10T10:04:21.743 INFO:tasks.workunit.client.1.smithi107.stdout:6/666: chown d0/c9c 2896 1 2024-09-10T10:04:21.746 INFO:tasks.workunit.client.1.smithi107.stdout:2/687: fsync d3/da/df/d20/fc0 0 2024-09-10T10:04:21.746 INFO:tasks.workunit.client.0.smithi071.stdout:7/643: dread d9/d15/d1f/d74/d9b/fb1 [0,4194304] 0 2024-09-10T10:04:21.747 INFO:tasks.workunit.client.1.smithi107.stdout:3/966: fsync dc/dd/d45/d26/d41/d44/d35/ffe 0 2024-09-10T10:04:21.748 INFO:tasks.workunit.client.0.smithi071.stdout:4/557: rename db/d15/d17/f47 to db/d15/d26/d43/d4d/d9f/da6/fb7 0 2024-09-10T10:04:21.748 INFO:tasks.workunit.client.1.smithi107.stdout:6/667: rmdir d0/d3d/d14/d17/d49/dbe 39 2024-09-10T10:04:21.751 INFO:tasks.workunit.client.1.smithi107.stdout:1/740: mknod d2/d36/dbc/cf0 0 2024-09-10T10:04:21.751 INFO:tasks.workunit.client.0.smithi071.stdout:2/591: mkdir d8/d87/dc4 0 2024-09-10T10:04:21.752 INFO:tasks.workunit.client.1.smithi107.stdout:7/572: mknod d0/d1b/d4d/d69/d97/d3d/cb1 0 2024-09-10T10:04:21.753 INFO:tasks.workunit.client.1.smithi107.stdout:7/573: write d0/d8/d5c/d6d/f8c [457604,25412] 0 2024-09-10T10:04:21.754 INFO:tasks.workunit.client.1.smithi107.stdout:7/574: dread - d0/d8/d5c/d6d/fac zero size 2024-09-10T10:04:21.755 INFO:tasks.workunit.client.1.smithi107.stdout:3/967: mkdir dc/dd/d45/d26/df5/d144 0 2024-09-10T10:04:21.757 INFO:tasks.workunit.client.1.smithi107.stdout:7/575: write d0/d20/d35/f98 [1509808,99677] 0 2024-09-10T10:04:21.758 INFO:tasks.workunit.client.0.smithi071.stdout:5/483: mkdir dc/df/d3e/d5a/d80/d8a/da3 0 2024-09-10T10:04:21.759 INFO:tasks.workunit.client.1.smithi107.stdout:0/604: rename d6/d8/d2f/d35/d3c/d58/d69/d84/la4 to d6/d8/d2f/d35/d4f/lba 0 2024-09-10T10:04:21.761 INFO:tasks.workunit.client.1.smithi107.stdout:2/688: mknod d3/da/df/d20/d36/d39/da3/ddb/cf3 0 2024-09-10T10:04:21.761 INFO:tasks.workunit.client.1.smithi107.stdout:7/576: read d0/d8/f11 [1350899,51938] 0 2024-09-10T10:04:21.761 INFO:tasks.workunit.client.0.smithi071.stdout:4/558: creat db/da0/fb8 x:0 0 0 2024-09-10T10:04:21.762 INFO:tasks.workunit.client.1.smithi107.stdout:0/605: dread d6/d8/d3e/f50 [4194304,4194304] 0 2024-09-10T10:04:21.763 INFO:tasks.workunit.client.0.smithi071.stdout:8/553: rename d5/c44 to d5/df/d57/cc4 0 2024-09-10T10:04:21.763 INFO:tasks.workunit.client.0.smithi071.stdout:6/507: dwrite d4/da/df/f2c [0,4194304] 0 2024-09-10T10:04:21.763 INFO:tasks.workunit.client.0.smithi071.stdout:5/484: chown dc/df/d17/d8d 51595 1 2024-09-10T10:04:21.764 INFO:tasks.workunit.client.1.smithi107.stdout:0/606: write d6/d8/d3e/d43/f4b [534132,88602] 0 2024-09-10T10:04:21.767 INFO:tasks.workunit.client.0.smithi071.stdout:1/642: dwrite d1/d21/d65/f4e [0,4194304] 0 2024-09-10T10:04:21.767 INFO:tasks.workunit.client.1.smithi107.stdout:6/668: link d0/d3d/d14/d42/fcc d0/d3d/d14/d21/d8a/da2/da3/dac/fea 0 2024-09-10T10:04:21.769 INFO:tasks.workunit.client.1.smithi107.stdout:7/577: rmdir d0/d8/d5c 39 2024-09-10T10:04:21.770 INFO:tasks.workunit.client.0.smithi071.stdout:7/644: dwrite d9/d76/f42 [0,4194304] 0 2024-09-10T10:04:21.770 INFO:tasks.workunit.client.1.smithi107.stdout:7/578: fsync d0/d8/f84 0 2024-09-10T10:04:21.771 INFO:tasks.workunit.client.0.smithi071.stdout:9/880: dread d0/db/ff [0,4194304] 0 2024-09-10T10:04:21.772 INFO:tasks.workunit.client.0.smithi071.stdout:0/552: rmdir d11/d22/d31 39 2024-09-10T10:04:21.773 INFO:tasks.workunit.client.1.smithi107.stdout:1/741: creat d2/ff1 x:0 0 0 2024-09-10T10:04:21.776 INFO:tasks.workunit.client.1.smithi107.stdout:3/968: dwrite dc/dd/d45/d26/d41/d44/d35/f136 [0,4194304] 0 2024-09-10T10:04:21.776 INFO:tasks.workunit.client.0.smithi071.stdout:6/508: creat d4/da/df/d2e/d3a/d51/d64/fa5 x:0 0 0 2024-09-10T10:04:21.777 INFO:tasks.workunit.client.0.smithi071.stdout:5/485: mknod dc/df/d17/ca4 0 2024-09-10T10:04:21.781 INFO:tasks.workunit.client.0.smithi071.stdout:1/643: write d1/d21/d65/f4e [705704,38761] 0 2024-09-10T10:04:21.783 INFO:tasks.workunit.client.1.smithi107.stdout:6/669: dwrite d0/d3d/d14/d17/d49/d55/d73/f74 [0,4194304] 0 2024-09-10T10:04:21.784 INFO:tasks.workunit.client.0.smithi071.stdout:2/592: getdents d8/d4a 0 2024-09-10T10:04:21.784 INFO:tasks.workunit.client.0.smithi071.stdout:6/509: creat d4/da/df/d2e/d3a/d91/fa6 x:0 0 0 2024-09-10T10:04:21.785 INFO:tasks.workunit.client.0.smithi071.stdout:6/510: write d4/f27 [3534539,42827] 0 2024-09-10T10:04:21.788 INFO:tasks.workunit.client.1.smithi107.stdout:3/969: write dc/dd/d45/d26/d41/d44/d35/f12c [671692,81847] 0 2024-09-10T10:04:21.790 INFO:tasks.workunit.client.0.smithi071.stdout:1/644: symlink d1/d21/d3d/d83/lde 0 2024-09-10T10:04:21.795 INFO:tasks.workunit.client.0.smithi071.stdout:9/881: unlink d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/ca9 0 2024-09-10T10:04:21.797 INFO:tasks.workunit.client.1.smithi107.stdout:9/595: dwrite d5/d1e/f5b [0,4194304] 0 2024-09-10T10:04:21.797 INFO:tasks.workunit.client.1.smithi107.stdout:6/670: unlink d0/d3d/d14/d17/d49/d55/d73/f82 0 2024-09-10T10:04:21.799 INFO:tasks.workunit.client.1.smithi107.stdout:3/970: symlink dc/dd/d45/d26/d41/d44/d35/d104/l145 0 2024-09-10T10:04:21.799 INFO:tasks.workunit.client.0.smithi071.stdout:7/645: dwrite d9/d1a/d1d/f5a [0,4194304] 0 2024-09-10T10:04:21.799 INFO:tasks.workunit.client.1.smithi107.stdout:3/971: fsync dc/dd/f75 0 2024-09-10T10:04:21.800 INFO:tasks.workunit.client.0.smithi071.stdout:1/645: truncate d1/d21/d3d/d4a/fa6 926718 0 2024-09-10T10:04:21.800 INFO:tasks.workunit.client.1.smithi107.stdout:3/972: chown dc/dd/d45/fb5 10237 1 2024-09-10T10:04:21.800 INFO:tasks.workunit.client.1.smithi107.stdout:0/607: link d6/d8/c29 d6/d8e/cbb 0 2024-09-10T10:04:21.801 INFO:tasks.workunit.client.1.smithi107.stdout:0/608: dread - d6/d8/d2f/d2e/d32/d95/fb6 zero size 2024-09-10T10:04:21.802 INFO:tasks.workunit.client.0.smithi071.stdout:9/882: chown d0/l13 7 1 2024-09-10T10:04:21.802 INFO:tasks.workunit.client.1.smithi107.stdout:9/596: creat d5/d7/d1d/db5/fce x:0 0 0 2024-09-10T10:04:21.803 INFO:tasks.workunit.client.0.smithi071.stdout:2/593: dwrite d8/d24/f5c [0,4194304] 0 2024-09-10T10:04:21.803 INFO:tasks.workunit.client.1.smithi107.stdout:9/597: readlink d5/d7/d1d/d41/dc8/lb9 0 2024-09-10T10:04:21.807 INFO:tasks.workunit.client.0.smithi071.stdout:1/646: stat d1/d21/d2f/d30/l7e 0 2024-09-10T10:04:21.808 INFO:tasks.workunit.client.1.smithi107.stdout:0/609: unlink d6/c1f 0 2024-09-10T10:04:21.808 INFO:tasks.workunit.client.1.smithi107.stdout:3/973: creat dc/dd/d45/d26/d41/d44/d63/d101/f146 x:0 0 0 2024-09-10T10:04:21.814 INFO:tasks.workunit.client.0.smithi071.stdout:9/883: write d0/d3b/f48 [5093412,47021] 0 2024-09-10T10:04:21.814 INFO:tasks.workunit.client.0.smithi071.stdout:2/594: chown d8/d87/c6e 45039 1 2024-09-10T10:04:21.814 INFO:tasks.workunit.client.1.smithi107.stdout:9/598: dwrite d5/d7/d1d/d29/db4/fc0 [0,4194304] 0 2024-09-10T10:04:21.814 INFO:tasks.workunit.client.0.smithi071.stdout:6/511: dwrite d4/da/df/d2e/d3a/d51/f9a [4194304,4194304] 0 2024-09-10T10:04:21.815 INFO:tasks.workunit.client.0.smithi071.stdout:7/646: mkdir d9/d15/d40/d80/ddd/de2 0 2024-09-10T10:04:21.816 INFO:tasks.workunit.client.1.smithi107.stdout:0/610: creat d6/d8/d2f/da3/da5/fbc x:0 0 0 2024-09-10T10:04:21.817 INFO:tasks.workunit.client.1.smithi107.stdout:6/671: dread d0/d3d/d14/d17/d24/f6f [0,4194304] 0 2024-09-10T10:04:21.817 INFO:tasks.workunit.client.0.smithi071.stdout:6/512: chown d4/f6c 924630339 1 2024-09-10T10:04:21.822 INFO:tasks.workunit.client.0.smithi071.stdout:2/595: truncate d8/d87/d33/d41/d4d/d52/f9b 777574 0 2024-09-10T10:04:21.822 INFO:tasks.workunit.client.0.smithi071.stdout:1/647: link d1/d35/fa8 d1/d21/d3d/d83/fdf 0 2024-09-10T10:04:21.822 INFO:tasks.workunit.client.0.smithi071.stdout:6/513: symlink d4/da/la7 0 2024-09-10T10:04:21.824 INFO:tasks.workunit.client.0.smithi071.stdout:6/514: chown d4/d1c/f42 10580 1 2024-09-10T10:04:21.824 INFO:tasks.workunit.client.1.smithi107.stdout:6/672: creat d0/d3d/d14/d17/feb x:0 0 0 2024-09-10T10:04:21.825 INFO:tasks.workunit.client.0.smithi071.stdout:7/647: rename d9/d15/d55 to d9/d15/d40/d80/ddd/de2/de3 0 2024-09-10T10:04:21.826 INFO:tasks.workunit.client.1.smithi107.stdout:7/579: dread d0/d8/f18 [0,4194304] 0 2024-09-10T10:04:21.828 INFO:tasks.workunit.client.0.smithi071.stdout:5/486: dread dc/df/f3b [0,4194304] 0 2024-09-10T10:04:21.829 INFO:tasks.workunit.client.1.smithi107.stdout:1/742: dread d2/d6/fa [0,4194304] 0 2024-09-10T10:04:21.831 INFO:tasks.workunit.client.1.smithi107.stdout:0/611: getdents d6/d8/d2f/d2e/d32/d85/d8a 0 2024-09-10T10:04:21.831 INFO:tasks.workunit.client.1.smithi107.stdout:3/974: dwrite dc/dd/d20/d23/d39/fa5 [4194304,4194304] 0 2024-09-10T10:04:21.831 INFO:tasks.workunit.client.1.smithi107.stdout:9/599: dwrite d5/d7/d1d/d41/d83/d9a/fb0 [0,4194304] 0 2024-09-10T10:04:21.832 INFO:tasks.workunit.client.0.smithi071.stdout:7/648: read d9/d76/f9a [2313520,111766] 0 2024-09-10T10:04:21.832 INFO:tasks.workunit.client.1.smithi107.stdout:1/743: stat d2/d6/d67/f77 0 2024-09-10T10:04:21.833 INFO:tasks.workunit.client.0.smithi071.stdout:6/515: getdents d4/da/df/d2e/d3a/d3e/d45 0 2024-09-10T10:04:21.833 INFO:tasks.workunit.client.0.smithi071.stdout:2/596: getdents d8/d38/d99 0 2024-09-10T10:04:21.833 INFO:tasks.workunit.client.1.smithi107.stdout:6/673: symlink d0/d3d/d14/lec 0 2024-09-10T10:04:21.834 INFO:tasks.workunit.client.0.smithi071.stdout:7/649: truncate d9/d15/fb3 1317541 0 2024-09-10T10:04:21.834 INFO:tasks.workunit.client.0.smithi071.stdout:9/884: getdents d0/db/d1b/d1d/d4b/dad 0 2024-09-10T10:04:21.835 INFO:tasks.workunit.client.0.smithi071.stdout:2/597: write d8/d38/d63/fb7 [848244,5344] 0 2024-09-10T10:04:21.835 INFO:tasks.workunit.client.1.smithi107.stdout:7/580: rmdir d0/d8/dc/d2c 39 2024-09-10T10:04:21.836 INFO:tasks.workunit.client.1.smithi107.stdout:3/975: rmdir dc/dd/d45/d26/d59 39 2024-09-10T10:04:21.836 INFO:tasks.workunit.client.0.smithi071.stdout:7/650: chown d9/d76/f42 346868 1 2024-09-10T10:04:21.837 INFO:tasks.workunit.client.0.smithi071.stdout:6/516: chown d4/da/df/d2e/d3a/d43/f6a 3028 1 2024-09-10T10:04:21.837 INFO:tasks.workunit.client.1.smithi107.stdout:3/976: dread - dc/dd/d45/f100 zero size 2024-09-10T10:04:21.839 INFO:tasks.workunit.client.0.smithi071.stdout:2/598: mknod d8/d87/d51/cc5 0 2024-09-10T10:04:21.839 INFO:tasks.workunit.client.1.smithi107.stdout:0/612: read d6/d8/d2f/da3/da5/fab [725954,78641] 0 2024-09-10T10:04:21.842 INFO:tasks.workunit.client.0.smithi071.stdout:7/651: creat d9/d11/fe4 x:0 0 0 2024-09-10T10:04:21.845 INFO:tasks.workunit.client.1.smithi107.stdout:7/581: dread d0/d8/d5c/d6d/f8c [0,4194304] 0 2024-09-10T10:04:21.846 INFO:tasks.workunit.client.1.smithi107.stdout:3/977: unlink dc/dd/d20/d23/d39/dac/c103 0 2024-09-10T10:04:21.848 INFO:tasks.workunit.client.0.smithi071.stdout:6/517: getdents d4/d20 0 2024-09-10T10:04:21.848 INFO:tasks.workunit.client.0.smithi071.stdout:9/885: link d0/d3b/d44/f63 d0/d3b/d5c/d6a/d96/f106 0 2024-09-10T10:04:21.848 INFO:tasks.workunit.client.0.smithi071.stdout:7/652: creat d9/d2c/d85/fe5 x:0 0 0 2024-09-10T10:04:21.849 INFO:tasks.workunit.client.1.smithi107.stdout:0/613: dwrite d6/d8/d2f/d35/d3c/d58/d69/f6b [0,4194304] 0 2024-09-10T10:04:21.849 INFO:tasks.workunit.client.0.smithi071.stdout:6/518: chown d4/da/fb 85107412 1 2024-09-10T10:04:21.851 INFO:tasks.workunit.client.0.smithi071.stdout:2/599: getdents d8/d24 0 2024-09-10T10:04:21.852 INFO:tasks.workunit.client.0.smithi071.stdout:6/519: chown d4/da/df/c67 44118183 1 2024-09-10T10:04:21.853 INFO:tasks.workunit.client.0.smithi071.stdout:7/653: truncate d9/d1a/f52 899401 0 2024-09-10T10:04:21.854 INFO:tasks.workunit.client.0.smithi071.stdout:2/600: chown d8/db6 0 1 2024-09-10T10:04:21.855 INFO:tasks.workunit.client.1.smithi107.stdout:3/978: stat dc/dd/d45/d26/d41/fd3 0 2024-09-10T10:04:21.856 INFO:tasks.workunit.client.0.smithi071.stdout:9/886: creat d0/d3b/d5c/f107 x:0 0 0 2024-09-10T10:04:21.856 INFO:tasks.workunit.client.0.smithi071.stdout:6/520: dread d4/f19 [0,4194304] 0 2024-09-10T10:04:21.857 INFO:tasks.workunit.client.1.smithi107.stdout:0/614: rename d6/d5a/d5c/l64 to d6/d8/d2f/d2e/d7b/lbd 0 2024-09-10T10:04:21.858 INFO:tasks.workunit.client.1.smithi107.stdout:1/744: getdents d2/d12/d94 0 2024-09-10T10:04:21.859 INFO:tasks.workunit.client.1.smithi107.stdout:1/745: dread - d2/d35/d9c/fe5 zero size 2024-09-10T10:04:21.859 INFO:tasks.workunit.client.1.smithi107.stdout:1/746: fsync d2/f49 0 2024-09-10T10:04:21.860 INFO:tasks.workunit.client.1.smithi107.stdout:7/582: creat d0/d1b/d9d/fb2 x:0 0 0 2024-09-10T10:04:21.861 INFO:tasks.workunit.client.0.smithi071.stdout:2/601: dread d8/d24/fa5 [0,4194304] 0 2024-09-10T10:04:21.861 INFO:tasks.workunit.client.0.smithi071.stdout:6/521: unlink d4/d1c/f93 0 2024-09-10T10:04:21.863 INFO:tasks.workunit.client.0.smithi071.stdout:6/522: stat d4/da/df/d2e/d3a/d3e/d5d/d81/c8b 0 2024-09-10T10:04:21.865 INFO:tasks.workunit.client.1.smithi107.stdout:0/615: creat d6/d8/d2f/d2e/d32/d85/fbe x:0 0 0 2024-09-10T10:04:21.868 INFO:tasks.workunit.client.1.smithi107.stdout:7/583: write d0/d8/dc/d2c/f7e [1234810,69241] 0 2024-09-10T10:04:21.868 INFO:tasks.workunit.client.1.smithi107.stdout:3/979: mkdir dc/dd/d147 0 2024-09-10T10:04:21.869 INFO:tasks.workunit.client.0.smithi071.stdout:6/523: rename d4/da/df/d2e/d3a/d3e/d45 to d4/d61/d83/da8 0 2024-09-10T10:04:21.870 INFO:tasks.workunit.client.0.smithi071.stdout:9/887: creat d0/db/d1b/f108 x:0 0 0 2024-09-10T10:04:21.870 INFO:tasks.workunit.client.1.smithi107.stdout:7/584: dread - d0/d99/fa4 zero size 2024-09-10T10:04:21.870 INFO:tasks.workunit.client.1.smithi107.stdout:7/585: chown d0/ca 2785028 1 2024-09-10T10:04:21.871 INFO:tasks.workunit.client.1.smithi107.stdout:0/616: creat d6/d8/d2f/d2e/d32/d85/fbf x:0 0 0 2024-09-10T10:04:21.871 INFO:tasks.workunit.client.0.smithi071.stdout:2/602: dwrite d8/f80 [0,4194304] 0 2024-09-10T10:04:21.872 INFO:tasks.workunit.client.0.smithi071.stdout:0/553: read d11/d1e/f74 [1874350,129680] 0 2024-09-10T10:04:21.873 INFO:tasks.workunit.client.0.smithi071.stdout:2/603: write d8/d38/d47/fa9 [362012,83856] 0 2024-09-10T10:04:21.874 INFO:tasks.workunit.client.0.smithi071.stdout:6/524: mkdir d4/da/df/d2e/d3a/da9 0 2024-09-10T10:04:21.877 INFO:tasks.workunit.client.0.smithi071.stdout:4/559: truncate db/d15/d17/f75 269091 0 2024-09-10T10:04:21.880 INFO:tasks.workunit.client.0.smithi071.stdout:2/604: write d8/d38/d47/f5f [4167189,27474] 0 2024-09-10T10:04:21.884 INFO:tasks.workunit.client.1.smithi107.stdout:9/600: write d5/d7/d1d/d9b/dab/d57/d87/d37/f63 [1955984,8368] 0 2024-09-10T10:04:21.884 INFO:tasks.workunit.client.0.smithi071.stdout:6/525: mknod d4/da/df/d2e/d3a/d40/d60/caa 0 2024-09-10T10:04:21.884 INFO:tasks.workunit.client.0.smithi071.stdout:4/560: rename db/d15/d26/d43/d4d/d9f/da6/fb7 to db/d15/d26/fb9 0 2024-09-10T10:04:21.885 INFO:tasks.workunit.client.0.smithi071.stdout:9/888: mknod d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/c109 0 2024-09-10T10:04:21.886 INFO:tasks.workunit.client.0.smithi071.stdout:6/526: fsync d4/da/df/d2e/d3a/d51/d64/f7e 0 2024-09-10T10:04:21.887 INFO:tasks.workunit.client.1.smithi107.stdout:7/586: getdents d0/d20 0 2024-09-10T10:04:21.888 INFO:tasks.workunit.client.1.smithi107.stdout:9/601: mknod d5/d1e/ccf 0 2024-09-10T10:04:21.889 INFO:tasks.workunit.client.0.smithi071.stdout:6/527: write d4/da/df/d2e/d3a/d51/d64/f7e [273567,16521] 0 2024-09-10T10:04:21.890 INFO:tasks.workunit.client.1.smithi107.stdout:6/674: dwrite d0/d3d/d14/d21/d8a/da2/da3/dac/fea [0,4194304] 0 2024-09-10T10:04:21.890 INFO:tasks.workunit.client.1.smithi107.stdout:7/587: stat d0/d8/d5c/d6d/f8c 0 2024-09-10T10:04:21.891 INFO:tasks.workunit.client.1.smithi107.stdout:9/602: chown d5/d7/d1d/l98 207057 1 2024-09-10T10:04:21.892 INFO:tasks.workunit.client.0.smithi071.stdout:5/487: write dc/f1b [1674530,59150] 0 2024-09-10T10:04:21.896 INFO:tasks.workunit.client.0.smithi071.stdout:9/889: dwrite d0/fb1 [0,4194304] 0 2024-09-10T10:04:21.896 INFO:tasks.workunit.client.1.smithi107.stdout:6/675: symlink d0/d3d/d14/d42/led 0 2024-09-10T10:04:21.897 INFO:tasks.workunit.client.0.smithi071.stdout:5/488: creat dc/d4a/fa5 x:0 0 0 2024-09-10T10:04:21.898 INFO:tasks.workunit.client.0.smithi071.stdout:7/654: dread d9/f7f [0,4194304] 0 2024-09-10T10:04:21.900 INFO:tasks.workunit.client.1.smithi107.stdout:9/603: dwrite d5/d7/f9 [0,4194304] 0 2024-09-10T10:04:21.901 INFO:tasks.workunit.client.1.smithi107.stdout:6/676: fsync d0/d3d/d14/d17/d4b/f5c 0 2024-09-10T10:04:21.902 INFO:tasks.workunit.client.1.smithi107.stdout:7/588: dread d0/d8/f84 [0,4194304] 0 2024-09-10T10:04:21.904 INFO:tasks.workunit.client.1.smithi107.stdout:0/617: dread d6/d8/d2f/d2e/f75 [0,4194304] 0 2024-09-10T10:04:21.904 INFO:tasks.workunit.client.0.smithi071.stdout:0/554: write d11/d22/d31/f41 [2680528,3] 0 2024-09-10T10:04:21.905 INFO:tasks.workunit.client.0.smithi071.stdout:1/648: dread d1/f19 [0,4194304] 0 2024-09-10T10:04:21.909 INFO:tasks.workunit.client.1.smithi107.stdout:7/589: rmdir d0/d1b/d4d/d69 39 2024-09-10T10:04:21.910 INFO:tasks.workunit.client.0.smithi071.stdout:5/489: write dc/df/d29/f99 [932987,111768] 0 2024-09-10T10:04:21.910 INFO:tasks.workunit.client.0.smithi071.stdout:2/605: write d8/d4a/f55 [674578,83427] 0 2024-09-10T10:04:21.911 INFO:tasks.workunit.client.1.smithi107.stdout:9/604: dwrite d5/d7/f9 [4194304,4194304] 0 2024-09-10T10:04:21.911 INFO:tasks.workunit.client.0.smithi071.stdout:6/528: dwrite d4/da/df/d2e/d3a/d40/d60/f7c [0,4194304] 0 2024-09-10T10:04:21.913 INFO:tasks.workunit.client.0.smithi071.stdout:6/529: dread - d4/da/df/d2e/d3a/d3e/d5d/f9c zero size 2024-09-10T10:04:21.914 INFO:tasks.workunit.client.0.smithi071.stdout:6/530: fdatasync d4/d61/f89 0 2024-09-10T10:04:21.916 INFO:tasks.workunit.client.0.smithi071.stdout:5/490: mkdir dc/df/da6 0 2024-09-10T10:04:21.916 INFO:tasks.workunit.client.1.smithi107.stdout:3/980: dwrite dc/dd/d45/d26/d41/d44/fb8 [0,4194304] 0 2024-09-10T10:04:21.918 INFO:tasks.workunit.client.0.smithi071.stdout:6/531: truncate d4/da/df/d2e/d3a/d51/d64/fa5 777304 0 2024-09-10T10:04:21.918 INFO:tasks.workunit.client.1.smithi107.stdout:3/981: chown dc/dd/d20/d23/d39/c129 323 1 2024-09-10T10:04:21.920 INFO:tasks.workunit.client.1.smithi107.stdout:6/677: rename d0/d3d/d14/d21/d8a/da7/dc1 to d0/d3d/d14/d21/d8a/dee 0 2024-09-10T10:04:21.921 INFO:tasks.workunit.client.0.smithi071.stdout:5/491: write dc/df/d3e/d5a/d80/f86 [3661475,51291] 0 2024-09-10T10:04:21.923 INFO:tasks.workunit.client.0.smithi071.stdout:7/655: link d9/d11/c32 d9/d2c/d4f/ce6 0 2024-09-10T10:04:21.923 INFO:tasks.workunit.client.0.smithi071.stdout:6/532: chown d4/da/df/d2e/d3a/d3e/d5d/d81/d95/fa0 22946 1 2024-09-10T10:04:21.924 INFO:tasks.workunit.client.1.smithi107.stdout:9/605: creat d5/d7/d1d/d9b/dab/fd0 x:0 0 0 2024-09-10T10:04:21.924 INFO:tasks.workunit.client.0.smithi071.stdout:7/656: read - d9/d2c/d85/fe5 zero size 2024-09-10T10:04:21.925 INFO:tasks.workunit.client.0.smithi071.stdout:0/555: link cb d11/d22/d31/cc3 0 2024-09-10T10:04:21.925 INFO:tasks.workunit.client.1.smithi107.stdout:9/606: write d5/d7/d1d/d95/faf [432488,49158] 0 2024-09-10T10:04:21.926 INFO:tasks.workunit.client.0.smithi071.stdout:5/492: fsync dc/df/f33 0 2024-09-10T10:04:21.926 INFO:tasks.workunit.client.0.smithi071.stdout:0/556: chown d11/d30/d52 65496311 1 2024-09-10T10:04:21.928 INFO:tasks.workunit.client.0.smithi071.stdout:1/649: creat d1/d3f/d58/daf/ddc/fe0 x:0 0 0 2024-09-10T10:04:21.928 INFO:tasks.workunit.client.1.smithi107.stdout:3/982: truncate dc/dd/d20/d23/d2f/d9c/fa7 1497957 0 2024-09-10T10:04:21.929 INFO:tasks.workunit.client.0.smithi071.stdout:5/493: chown dc/df/d17/d22/l85 11177431 1 2024-09-10T10:04:21.929 INFO:tasks.workunit.client.0.smithi071.stdout:7/657: rmdir d9/d15/d1f/d98 39 2024-09-10T10:04:21.929 INFO:tasks.workunit.client.1.smithi107.stdout:0/618: creat d6/d8/d3e/d43/fc0 x:0 0 0 2024-09-10T10:04:21.931 INFO:tasks.workunit.client.0.smithi071.stdout:6/533: creat d4/d20/fab x:0 0 0 2024-09-10T10:04:21.931 INFO:tasks.workunit.client.0.smithi071.stdout:2/606: dread d8/d87/d33/d41/d4d/f8c [0,4194304] 0 2024-09-10T10:04:21.932 INFO:tasks.workunit.client.1.smithi107.stdout:6/678: creat d0/fef x:0 0 0 2024-09-10T10:04:21.932 INFO:tasks.workunit.client.0.smithi071.stdout:6/534: stat d4/d61/d83/da8/l52 0 2024-09-10T10:04:21.933 INFO:tasks.workunit.client.0.smithi071.stdout:0/557: symlink d11/d22/d31/lc4 0 2024-09-10T10:04:21.934 INFO:tasks.workunit.client.0.smithi071.stdout:7/658: dread d9/d15/d1f/f65 [0,4194304] 0 2024-09-10T10:04:21.934 INFO:tasks.workunit.client.1.smithi107.stdout:3/983: read dc/dd/d20/d23/d2f/fb4 [1640466,85598] 0 2024-09-10T10:04:21.934 INFO:tasks.workunit.client.0.smithi071.stdout:6/535: fdatasync d4/da/df/d2e/d3a/d40/fa2 0 2024-09-10T10:04:21.935 INFO:tasks.workunit.client.1.smithi107.stdout:7/590: rename d0/d1b/d4d/d69/d97/c48 to d0/d8/dc/cb3 0 2024-09-10T10:04:21.935 INFO:tasks.workunit.client.0.smithi071.stdout:0/558: write d11/f18 [378819,116035] 0 2024-09-10T10:04:21.936 INFO:tasks.workunit.client.1.smithi107.stdout:0/619: creat d6/d8/d2f/da3/da5/fc1 x:0 0 0 2024-09-10T10:04:21.937 INFO:tasks.workunit.client.1.smithi107.stdout:0/620: stat d6/d8/d2f/d2e/d32/d95/f97 0 2024-09-10T10:04:21.939 INFO:tasks.workunit.client.1.smithi107.stdout:0/621: chown d6/d8/f15 60087256 1 2024-09-10T10:04:21.939 INFO:tasks.workunit.client.1.smithi107.stdout:9/607: rename d5/d7/d1d/d9b/dab/d57/d87/c43 to d5/d7/d1d/d9b/cd1 0 2024-09-10T10:04:21.940 INFO:tasks.workunit.client.0.smithi071.stdout:1/650: mknod d1/d57/dbf/ce1 0 2024-09-10T10:04:21.940 INFO:tasks.workunit.client.0.smithi071.stdout:2/607: link d8/d87/d51/f54 d8/d38/d47/d59/d65/fc6 0 2024-09-10T10:04:21.942 INFO:tasks.workunit.client.1.smithi107.stdout:7/591: rename d0/ca to d0/d20/cb4 0 2024-09-10T10:04:21.942 INFO:tasks.workunit.client.1.smithi107.stdout:3/984: dwrite dc/dd/d20/d23/d2f/d9c/f109 [0,4194304] 0 2024-09-10T10:04:21.943 INFO:tasks.workunit.client.0.smithi071.stdout:1/651: stat d1/d21/c38 0 2024-09-10T10:04:21.944 INFO:tasks.workunit.client.0.smithi071.stdout:0/559: creat d11/d22/d31/fc5 x:0 0 0 2024-09-10T10:04:21.944 INFO:tasks.workunit.client.0.smithi071.stdout:6/536: dwrite d4/da/df/d2e/d3a/d40/f58 [0,4194304] 0 2024-09-10T10:04:21.948 INFO:tasks.workunit.client.1.smithi107.stdout:3/985: mkdir dc/dd/d45/d26/d41/d44/d12a/d148 0 2024-09-10T10:04:21.949 INFO:tasks.workunit.client.0.smithi071.stdout:1/652: mknod d1/ce2 0 2024-09-10T10:04:21.950 INFO:tasks.workunit.client.1.smithi107.stdout:3/986: write dc/fca [665994,114462] 0 2024-09-10T10:04:21.954 INFO:tasks.workunit.client.1.smithi107.stdout:7/592: dwrite d0/d1b/d4d/f6b [0,4194304] 0 2024-09-10T10:04:21.961 INFO:tasks.workunit.client.0.smithi071.stdout:2/608: dwrite d8/d38/d63/fb7 [0,4194304] 0 2024-09-10T10:04:21.962 INFO:tasks.workunit.client.0.smithi071.stdout:6/537: truncate d4/da/df/d2e/d3a/d3e/d5d/f9c 458312 0 2024-09-10T10:04:21.965 INFO:tasks.workunit.client.1.smithi107.stdout:3/987: mkdir dc/dd/d45/d26/df5/d149 0 2024-09-10T10:04:21.967 INFO:tasks.workunit.client.0.smithi071.stdout:6/538: stat d4/da/df/d2e/d3a/d40/d60/d7a/l8d 0 2024-09-10T10:04:21.968 INFO:tasks.workunit.client.1.smithi107.stdout:0/622: link d6/d8/d3e/l76 d6/d8/d2f/d35/d3c/d58/d69/d84/lc2 0 2024-09-10T10:04:21.969 INFO:tasks.workunit.client.0.smithi071.stdout:0/560: dwrite d11/d30/d52/d5f/f77 [0,4194304] 0 2024-09-10T10:04:21.970 INFO:tasks.workunit.client.0.smithi071.stdout:1/653: unlink d1/d70/f8b 0 2024-09-10T10:04:21.972 INFO:tasks.workunit.client.0.smithi071.stdout:7/659: dwrite d9/d15/d1f/f6d [0,4194304] 0 2024-09-10T10:04:21.974 INFO:tasks.workunit.client.0.smithi071.stdout:6/539: chown d4/da/df/d2e/d3a/d40/d60/l8e 12349 1 2024-09-10T10:04:21.974 INFO:tasks.workunit.client.0.smithi071.stdout:9/890: dwrite d0/db/d1b/d1d/d30/d54/f1a [0,4194304] 0 2024-09-10T10:04:21.977 INFO:tasks.workunit.client.1.smithi107.stdout:0/623: dwrite d6/d8/faa [0,4194304] 0 2024-09-10T10:04:21.979 INFO:tasks.workunit.client.1.smithi107.stdout:9/608: dwrite d5/d7/d1d/d41/d83/d9a/f56 [0,4194304] 0 2024-09-10T10:04:21.979 INFO:tasks.workunit.client.0.smithi071.stdout:2/609: creat d8/d24/d7f/fc7 x:0 0 0 2024-09-10T10:04:21.981 INFO:tasks.workunit.client.0.smithi071.stdout:0/561: dread - d11/d22/d9a/fbf zero size 2024-09-10T10:04:21.983 INFO:tasks.workunit.client.0.smithi071.stdout:1/654: rename d1/d3f/cb4 to d1/d3f/d58/daf/ddc/ce3 0 2024-09-10T10:04:21.984 INFO:tasks.workunit.client.0.smithi071.stdout:6/540: creat d4/da/df/d2e/d3a/d51/d64/fac x:0 0 0 2024-09-10T10:04:21.987 INFO:tasks.workunit.client.1.smithi107.stdout:0/624: creat d6/d14/d93/dae/fc3 x:0 0 0 2024-09-10T10:04:21.988 INFO:tasks.workunit.client.0.smithi071.stdout:2/610: chown d8/d87/d33/d41/d4d/d52/lc3 5093712 1 2024-09-10T10:04:21.988 INFO:tasks.workunit.client.0.smithi071.stdout:9/891: mknod d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/c10a 0 2024-09-10T10:04:21.989 INFO:tasks.workunit.client.0.smithi071.stdout:0/562: symlink d11/d1e/lc6 0 2024-09-10T10:04:21.991 INFO:tasks.workunit.client.0.smithi071.stdout:1/655: rename d1/d21/d3d/d83 to d1/d21/d2f/d81/de4 0 2024-09-10T10:04:21.994 INFO:tasks.workunit.client.1.smithi107.stdout:0/625: unlink d6/d8/d2f/f1b 0 2024-09-10T10:04:21.994 INFO:tasks.workunit.client.0.smithi071.stdout:2/611: unlink d8/d87/d49/c72 0 2024-09-10T10:04:21.995 INFO:tasks.workunit.client.0.smithi071.stdout:9/892: mkdir d0/d3b/d5c/d10b 0 2024-09-10T10:04:21.997 INFO:tasks.workunit.client.0.smithi071.stdout:2/612: mkdir d8/d87/d33/d41/d4d/dc8 0 2024-09-10T10:04:22.002 INFO:tasks.workunit.client.0.smithi071.stdout:2/613: getdents d8/d87 0 2024-09-10T10:04:22.003 INFO:tasks.workunit.client.0.smithi071.stdout:1/656: link d1/f29 d1/d3f/d58/fe5 0 2024-09-10T10:04:22.004 INFO:tasks.workunit.client.0.smithi071.stdout:2/614: mkdir d8/d38/d63/dc9 0 2024-09-10T10:04:22.005 INFO:tasks.workunit.client.0.smithi071.stdout:1/657: truncate d1/d21/d2f/d30/d6a/d91/fa1 1000414 0 2024-09-10T10:04:22.005 INFO:tasks.workunit.client.0.smithi071.stdout:2/615: creat d8/d38/fca x:0 0 0 2024-09-10T10:04:22.007 INFO:tasks.workunit.client.0.smithi071.stdout:1/658: symlink d1/d21/d2f/d30/d6a/ddb/le6 0 2024-09-10T10:04:22.008 INFO:tasks.workunit.client.0.smithi071.stdout:2/616: rename d8/c1e to d8/d87/ccb 0 2024-09-10T10:04:22.011 INFO:tasks.workunit.client.0.smithi071.stdout:9/893: dread d0/db/d1b/d1d/d30/d54/d27/d6e/f9a [0,4194304] 0 2024-09-10T10:04:22.012 INFO:tasks.workunit.client.0.smithi071.stdout:9/894: readlink d0/l13 0 2024-09-10T10:04:22.016 INFO:tasks.workunit.client.0.smithi071.stdout:2/617: dwrite d8/d87/f76 [0,4194304] 0 2024-09-10T10:04:22.017 INFO:tasks.workunit.client.0.smithi071.stdout:9/895: mknod d0/db/d1b/d1d/d5b/d9f/c10c 0 2024-09-10T10:04:22.019 INFO:tasks.workunit.client.0.smithi071.stdout:9/896: write d0/db/d20/d21/f4f [2919301,41899] 0 2024-09-10T10:04:22.021 INFO:tasks.workunit.client.1.smithi107.stdout:9/609: fdatasync d5/d7/d1d/d41/d83/d9a/f56 0 2024-09-10T10:04:22.023 INFO:tasks.workunit.client.0.smithi071.stdout:7/660: truncate d9/d76/f9a 1811225 0 2024-09-10T10:04:22.023 INFO:tasks.workunit.client.0.smithi071.stdout:6/541: dread d4/da/df/f53 [0,4194304] 0 2024-09-10T10:04:22.023 INFO:tasks.workunit.client.0.smithi071.stdout:9/897: creat d0/db/d1b/d1d/d5b/d9f/f10d x:0 0 0 2024-09-10T10:04:22.024 INFO:tasks.workunit.client.0.smithi071.stdout:0/563: write d11/d30/f71 [1594602,31883] 0 2024-09-10T10:04:22.024 INFO:tasks.workunit.client.1.smithi107.stdout:9/610: readlink d5/d7/d1d/d9b/dab/d57/d87/d27/l30 0 2024-09-10T10:04:22.024 INFO:tasks.workunit.client.1.smithi107.stdout:3/988: write dc/dd/d45/d26/d41/d44/d35/d52/f92 [1048115,72028] 0 2024-09-10T10:04:22.025 INFO:tasks.workunit.client.0.smithi071.stdout:6/542: dread - d4/d61/d83/da8/f71 zero size 2024-09-10T10:04:22.027 INFO:tasks.workunit.client.1.smithi107.stdout:9/611: write d5/d7/d1d/d9b/dab/d57/d87/d27/fa1 [1984895,101052] 0 2024-09-10T10:04:22.027 INFO:tasks.workunit.client.0.smithi071.stdout:9/898: chown d0/db/d1b/d1d/d30/d54/df7/c100 2389719 1 2024-09-10T10:04:22.028 INFO:tasks.workunit.client.0.smithi071.stdout:7/661: dread d9/d15/d1f/fab [0,4194304] 0 2024-09-10T10:04:22.028 INFO:tasks.workunit.client.0.smithi071.stdout:6/543: read f1 [7538664,13259] 0 2024-09-10T10:04:22.030 INFO:tasks.workunit.client.0.smithi071.stdout:9/899: write d0/db/d1b/d1d/d4b/fb5 [286751,21879] 0 2024-09-10T10:04:22.030 INFO:tasks.workunit.client.1.smithi107.stdout:0/626: dread d6/f7 [4194304,4194304] 0 2024-09-10T10:04:22.032 INFO:tasks.workunit.client.0.smithi071.stdout:9/900: chown d0/db/d1b/d1d/cd1 451579 1 2024-09-10T10:04:22.034 INFO:tasks.workunit.client.0.smithi071.stdout:6/544: rename d4/da/df/l2a to d4/d61/d83/lad 0 2024-09-10T10:04:22.037 INFO:tasks.workunit.client.0.smithi071.stdout:1/659: rmdir d1 39 2024-09-10T10:04:22.038 INFO:tasks.workunit.client.1.smithi107.stdout:0/627: dwrite d6/d8/d2f/d2e/d32/f4c [0,4194304] 0 2024-09-10T10:04:22.038 INFO:tasks.workunit.client.0.smithi071.stdout:7/662: getdents d9/d2c 0 2024-09-10T10:04:22.038 INFO:tasks.workunit.client.0.smithi071.stdout:0/564: link d11/d22/d9a/ca1 d11/d22/d40/cc7 0 2024-09-10T10:04:22.040 INFO:tasks.workunit.client.0.smithi071.stdout:6/545: write d4/da/df/d2e/d3a/d3e/d5d/f76 [948021,19994] 0 2024-09-10T10:04:22.043 INFO:tasks.workunit.client.0.smithi071.stdout:7/663: symlink d9/d11/dd2/dae/le7 0 2024-09-10T10:04:22.043 INFO:tasks.workunit.client.1.smithi107.stdout:3/989: truncate dc/dd/d45/f64 5981008 0 2024-09-10T10:04:22.044 INFO:tasks.workunit.client.0.smithi071.stdout:0/565: creat d11/d22/d40/fc8 x:0 0 0 2024-09-10T10:04:22.045 INFO:tasks.workunit.client.0.smithi071.stdout:9/901: dwrite d0/db/f29 [0,4194304] 0 2024-09-10T10:04:22.047 INFO:tasks.workunit.client.0.smithi071.stdout:6/546: write d4/da/df/d2e/d3a/d51/d64/f9e [241874,100957] 0 2024-09-10T10:04:22.048 INFO:tasks.workunit.client.0.smithi071.stdout:0/566: rmdir d11/d1e 39 2024-09-10T10:04:22.050 INFO:tasks.workunit.client.0.smithi071.stdout:0/567: chown d11/f17 0 1 2024-09-10T10:04:22.050 INFO:tasks.workunit.client.1.smithi107.stdout:9/612: truncate d5/d7/d1d/d9b/dab/d57/f7a 731016 0 2024-09-10T10:04:22.052 INFO:tasks.workunit.client.1.smithi107.stdout:3/990: dwrite dc/dd/d45/d26/feb [0,4194304] 0 2024-09-10T10:04:22.053 INFO:tasks.workunit.client.0.smithi071.stdout:2/618: dread d8/d38/d47/f5f [0,4194304] 0 2024-09-10T10:04:22.054 INFO:tasks.workunit.client.1.smithi107.stdout:0/628: link d6/d8/d2f/d35/d3c/d58/c77 d6/d8/d2f/da3/da5/cc4 0 2024-09-10T10:04:22.055 INFO:tasks.workunit.client.1.smithi107.stdout:9/613: chown d5/d7/d1d/d3b/ca7 3173 1 2024-09-10T10:04:22.055 INFO:tasks.workunit.client.0.smithi071.stdout:9/902: getdents d0/db/d1b/d1d/d30/d54/df7 0 2024-09-10T10:04:22.059 INFO:tasks.workunit.client.0.smithi071.stdout:9/903: symlink d0/d3b/d5c/l10e 0 2024-09-10T10:04:22.059 INFO:tasks.workunit.client.1.smithi107.stdout:0/629: write d6/d8/d3e/d43/f4b [414663,58517] 0 2024-09-10T10:04:22.061 INFO:tasks.workunit.client.0.smithi071.stdout:1/660: read d1/d21/d2f/d30/f33 [3988858,37464] 0 2024-09-10T10:04:22.062 INFO:tasks.workunit.client.0.smithi071.stdout:2/619: rmdir d8/d87/d49/d66 39 2024-09-10T10:04:22.062 INFO:tasks.workunit.client.0.smithi071.stdout:9/904: mknod d0/db/c10f 0 2024-09-10T10:04:22.062 INFO:tasks.workunit.client.1.smithi107.stdout:3/991: dwrite dc/dd/f75 [0,4194304] 0 2024-09-10T10:04:22.064 INFO:tasks.workunit.client.1.smithi107.stdout:0/630: stat d6/d8/d2f/d2e/d7b 0 2024-09-10T10:04:22.065 INFO:tasks.workunit.client.0.smithi071.stdout:1/661: mknod d1/d57/ce7 0 2024-09-10T10:04:22.066 INFO:tasks.workunit.client.0.smithi071.stdout:9/905: write d0/db/d1b/d1d/d30/d54/f1a [13603349,68527] 0 2024-09-10T10:04:22.067 INFO:tasks.workunit.client.1.smithi107.stdout:9/614: dwrite d5/f6a [0,4194304] 0 2024-09-10T10:04:22.068 INFO:tasks.workunit.client.1.smithi107.stdout:0/631: mkdir d6/d8/d2f/d6e/dc5 0 2024-09-10T10:04:22.068 INFO:tasks.workunit.client.0.smithi071.stdout:1/662: symlink d1/d21/d2f/d81/de4/db6/le8 0 2024-09-10T10:04:22.071 INFO:tasks.workunit.client.0.smithi071.stdout:7/664: write d9/d2c/f7e [641149,77918] 0 2024-09-10T10:04:22.071 INFO:tasks.workunit.client.0.smithi071.stdout:1/663: truncate d1/d21/d2f/d30/d6a/d91/fa1 1505491 0 2024-09-10T10:04:22.072 INFO:tasks.workunit.client.1.smithi107.stdout:9/615: mknod d5/d7/d1d/d29/db4/cd2 0 2024-09-10T10:04:22.072 INFO:tasks.workunit.client.1.smithi107.stdout:0/632: mknod d6/d8/cc6 0 2024-09-10T10:04:22.073 INFO:tasks.workunit.client.0.smithi071.stdout:6/547: getdents d4/da/df/d2e 0 2024-09-10T10:04:22.073 INFO:tasks.workunit.client.1.smithi107.stdout:0/633: fsync d6/d8/d3e/d43/f79 0 2024-09-10T10:04:22.075 INFO:tasks.workunit.client.0.smithi071.stdout:9/906: creat d0/db/d20/f110 x:0 0 0 2024-09-10T10:04:22.076 INFO:tasks.workunit.client.0.smithi071.stdout:2/620: mknod d8/d87/d33/d41/d4d/d5e/ccc 0 2024-09-10T10:04:22.078 INFO:tasks.workunit.client.0.smithi071.stdout:7/665: mkdir d9/d11/de8 0 2024-09-10T10:04:22.078 INFO:tasks.workunit.client.1.smithi107.stdout:0/634: dread d6/d8/d2f/d2e/d32/f4c [0,4194304] 0 2024-09-10T10:04:22.079 INFO:tasks.workunit.client.0.smithi071.stdout:6/548: mknod d4/da/df/d2e/d3a/d51/d64/cae 0 2024-09-10T10:04:22.080 INFO:tasks.workunit.client.0.smithi071.stdout:2/621: chown d8/d87/d33/d53 17150739 1 2024-09-10T10:04:22.080 INFO:tasks.workunit.client.0.smithi071.stdout:1/664: unlink d1/d21/d2f/d30/d6a/d91/c92 0 2024-09-10T10:04:22.081 INFO:tasks.workunit.client.1.smithi107.stdout:0/635: mkdir d6/d8/d3e/d43/dc7 0 2024-09-10T10:04:22.081 INFO:tasks.workunit.client.0.smithi071.stdout:9/907: dread d0/db/ff [0,4194304] 0 2024-09-10T10:04:22.083 INFO:tasks.workunit.client.0.smithi071.stdout:1/665: write d1/d21/d2f/f39 [3400289,89697] 0 2024-09-10T10:04:22.085 INFO:tasks.workunit.client.0.smithi071.stdout:7/666: getdents d9/d15/d1f/d74 0 2024-09-10T10:04:22.085 INFO:tasks.workunit.client.1.smithi107.stdout:0/636: truncate d6/d14/f2d 4439583 0 2024-09-10T10:04:22.086 INFO:tasks.workunit.client.0.smithi071.stdout:6/549: dread d4/d61/f8a [0,4194304] 0 2024-09-10T10:04:22.088 INFO:tasks.workunit.client.0.smithi071.stdout:9/908: mkdir d0/db/d1b/d1d/d30/d54/d27/d6e/d111 0 2024-09-10T10:04:22.089 INFO:tasks.workunit.client.0.smithi071.stdout:6/550: creat d4/d61/d83/faf x:0 0 0 2024-09-10T10:04:22.089 INFO:tasks.workunit.client.0.smithi071.stdout:6/551: write d4/d61/f69 [160964,28915] 0 2024-09-10T10:04:22.090 INFO:tasks.workunit.client.0.smithi071.stdout:7/667: rename d9/d11/dd2/dae/fc9 to d9/d15/d1f/fe9 0 2024-09-10T10:04:22.092 INFO:tasks.workunit.client.0.smithi071.stdout:6/552: symlink d4/da/df/d2e/d3a/lb0 0 2024-09-10T10:04:22.095 INFO:tasks.workunit.client.0.smithi071.stdout:7/668: rename d9/d15/f51 to d9/d1a/d1d/fea 0 2024-09-10T10:04:22.096 INFO:tasks.workunit.client.0.smithi071.stdout:6/553: dread d4/da/df/d2e/d3a/d40/f58 [0,4194304] 0 2024-09-10T10:04:22.098 INFO:tasks.workunit.client.0.smithi071.stdout:6/554: dread - d4/da/df/d2e/d3a/d40/d60/d7a/f9b zero size 2024-09-10T10:04:22.098 INFO:tasks.workunit.client.0.smithi071.stdout:7/669: unlink d9/d1a/f35 0 2024-09-10T10:04:22.100 INFO:tasks.workunit.client.0.smithi071.stdout:0/568: truncate d11/d22/f4f 3851502 0 2024-09-10T10:04:22.103 INFO:tasks.workunit.client.1.smithi107.stdout:0/637: dread d6/d8/d2f/d2e/d32/d56/f8c [0,4194304] 0 2024-09-10T10:04:22.104 INFO:tasks.workunit.client.0.smithi071.stdout:7/670: mknod d9/d2c/ceb 0 2024-09-10T10:04:22.105 INFO:tasks.workunit.client.0.smithi071.stdout:7/671: fsync f7 0 2024-09-10T10:04:22.105 INFO:tasks.workunit.client.0.smithi071.stdout:0/569: readlink d11/d22/l55 0 2024-09-10T10:04:22.108 INFO:tasks.workunit.client.1.smithi107.stdout:0/638: creat d6/d8/d2f/d35/d3c/d58/d69/d84/fc8 x:0 0 0 2024-09-10T10:04:22.108 INFO:tasks.workunit.client.0.smithi071.stdout:6/555: dwrite d4/d1c/f4d [4194304,4194304] 0 2024-09-10T10:04:22.108 INFO:tasks.workunit.client.0.smithi071.stdout:0/570: chown d11/d30/l9c 851305 1 2024-09-10T10:04:22.110 INFO:tasks.workunit.client.1.smithi107.stdout:9/616: dread d5/d7/d1d/d41/f71 [0,4194304] 0 2024-09-10T10:04:22.110 INFO:tasks.workunit.client.0.smithi071.stdout:1/666: getdents d1/d21/d2f/d81/de4/db6 0 2024-09-10T10:04:22.113 INFO:tasks.workunit.client.1.smithi107.stdout:9/617: read d5/d7/d1d/f47 [266872,97992] 0 2024-09-10T10:04:22.115 INFO:tasks.workunit.client.0.smithi071.stdout:6/556: mkdir d4/da/df/d2e/d3a/d3e/d5d/d81/db1 0 2024-09-10T10:04:22.117 INFO:tasks.workunit.client.0.smithi071.stdout:2/622: dread d8/f14 [0,4194304] 0 2024-09-10T10:04:22.118 INFO:tasks.workunit.client.0.smithi071.stdout:0/571: getdents d11/d30/d70 0 2024-09-10T10:04:22.119 INFO:tasks.workunit.client.0.smithi071.stdout:0/572: dread - d11/d30/d70/faa zero size 2024-09-10T10:04:22.121 INFO:tasks.workunit.client.0.smithi071.stdout:6/557: mkdir d4/da/df/d2e/d3a/d3e/d5d/d81/db2 0 2024-09-10T10:04:22.121 INFO:tasks.workunit.client.0.smithi071.stdout:6/558: readlink l2 0 2024-09-10T10:04:22.121 INFO:tasks.workunit.client.0.smithi071.stdout:0/573: chown d11/d30/d52/d5f/f9e 24502 1 2024-09-10T10:04:22.122 INFO:tasks.workunit.client.0.smithi071.stdout:2/623: creat d8/d24/fcd x:0 0 0 2024-09-10T10:04:22.122 INFO:tasks.workunit.client.1.smithi107.stdout:0/639: truncate d6/f10 2213305 0 2024-09-10T10:04:22.123 INFO:tasks.workunit.client.1.smithi107.stdout:9/618: dread f3 [0,4194304] 0 2024-09-10T10:04:22.124 INFO:tasks.workunit.client.1.smithi107.stdout:9/619: readlink d5/d7/d1d/l98 0 2024-09-10T10:04:22.125 INFO:tasks.workunit.client.1.smithi107.stdout:0/640: truncate d6/f45 789529 0 2024-09-10T10:04:22.125 INFO:tasks.workunit.client.0.smithi071.stdout:6/559: getdents d4/d20 0 2024-09-10T10:04:22.126 INFO:tasks.workunit.client.0.smithi071.stdout:2/624: mkdir d8/d87/d49/dce 0 2024-09-10T10:04:22.126 INFO:tasks.workunit.client.1.smithi107.stdout:0/641: fdatasync d6/d8/d3e/f50 0 2024-09-10T10:04:22.128 INFO:tasks.workunit.client.0.smithi071.stdout:0/574: rename d11/d22/d40/f68 to d11/d30/d52/fc9 0 2024-09-10T10:04:22.129 INFO:tasks.workunit.client.0.smithi071.stdout:2/625: read d8/d24/f2d [1028904,47919] 0 2024-09-10T10:04:22.129 INFO:tasks.workunit.client.1.smithi107.stdout:9/620: getdents d5/d7/d1d/d41/d83/d9a 0 2024-09-10T10:04:22.130 INFO:tasks.workunit.client.0.smithi071.stdout:1/667: dwrite d1/d21/d3d/d4a/f82 [0,4194304] 0 2024-09-10T10:04:22.131 INFO:tasks.workunit.client.0.smithi071.stdout:2/626: stat d8/d87/f25 0 2024-09-10T10:04:22.131 INFO:tasks.workunit.client.0.smithi071.stdout:6/560: rmdir d4/da/df/d2e/d3a/d3e/d5d/d81/d95 39 2024-09-10T10:04:22.132 INFO:tasks.workunit.client.0.smithi071.stdout:2/627: chown d8/d38/fca 29236 1 2024-09-10T10:04:22.132 INFO:tasks.workunit.client.1.smithi107.stdout:9/621: symlink d5/d7/d1d/d41/d83/ld3 0 2024-09-10T10:04:22.133 INFO:tasks.workunit.client.0.smithi071.stdout:7/672: dread d9/d11/d91/f9e [0,4194304] 0 2024-09-10T10:04:22.134 INFO:tasks.workunit.client.0.smithi071.stdout:0/575: creat d11/d30/d52/d79/fca x:0 0 0 2024-09-10T10:04:22.135 INFO:tasks.workunit.client.0.smithi071.stdout:1/668: rename d1/d21/d3d/d9a/fd1 to d1/d57/fe9 0 2024-09-10T10:04:22.136 INFO:tasks.workunit.client.1.smithi107.stdout:9/622: fsync d5/d7/d1d/d3b/f4a 0 2024-09-10T10:04:22.136 INFO:tasks.workunit.client.0.smithi071.stdout:2/628: fdatasync d8/d87/d33/d41/d4d/f8c 0 2024-09-10T10:04:22.138 INFO:tasks.workunit.client.1.smithi107.stdout:9/623: chown d5/d7/d1d/d9b/dab/d57/d87/d27/l30 194734 1 2024-09-10T10:04:22.139 INFO:tasks.workunit.client.0.smithi071.stdout:6/561: dread d4/d1c/f4d [0,4194304] 0 2024-09-10T10:04:22.141 INFO:tasks.workunit.client.0.smithi071.stdout:2/629: symlink d8/d4a/lcf 0 2024-09-10T10:04:22.141 INFO:tasks.workunit.client.1.smithi107.stdout:9/624: creat d5/d7/d1d/d9b/dab/d57/fd4 x:0 0 0 2024-09-10T10:04:22.142 INFO:tasks.workunit.client.0.smithi071.stdout:7/673: write d9/d15/d40/d80/ddd/de2/de3/fa0 [2778104,13266] 0 2024-09-10T10:04:22.143 INFO:tasks.workunit.client.1.smithi107.stdout:9/625: dread d5/d7/d1d/fa0 [0,4194304] 0 2024-09-10T10:04:22.144 INFO:tasks.workunit.client.1.smithi107.stdout:9/626: fdatasync d5/d1e/f9f 0 2024-09-10T10:04:22.145 INFO:tasks.workunit.client.0.smithi071.stdout:7/674: write d9/d70/fa3 [688183,9865] 0 2024-09-10T10:04:22.145 INFO:tasks.workunit.client.0.smithi071.stdout:6/562: truncate d4/da/df/d2e/d3a/d43/f49 1879622 0 2024-09-10T10:04:22.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:21 smithi107 ceph-mon[34215]: pgmap v261: 65 pgs: 65 active+clean; 2.2 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 77 MiB/s rd, 284 MiB/s wr, 521 op/s 2024-09-10T10:04:22.146 INFO:tasks.workunit.client.0.smithi071.stdout:7/675: stat d9/d15/l16 0 2024-09-10T10:04:22.147 INFO:tasks.workunit.client.1.smithi107.stdout:9/627: symlink d5/d1e/ld5 0 2024-09-10T10:04:22.148 INFO:tasks.workunit.client.1.smithi107.stdout:9/628: write d5/d7/d1d/d9b/dab/d57/d87/fc4 [1102169,91253] 0 2024-09-10T10:04:22.151 INFO:tasks.workunit.client.1.smithi107.stdout:9/629: creat d5/d7/d1d/d9b/dab/fd6 x:0 0 0 2024-09-10T10:04:22.152 INFO:tasks.workunit.client.0.smithi071.stdout:6/563: rename d4/da/c1f to d4/cb3 0 2024-09-10T10:04:22.153 INFO:tasks.workunit.client.0.smithi071.stdout:2/630: dwrite d8/d38/d47/d59/d65/faf [0,4194304] 0 2024-09-10T10:04:22.153 INFO:tasks.workunit.client.1.smithi107.stdout:9/630: symlink d5/d7/d1d/db5/ld7 0 2024-09-10T10:04:22.154 INFO:tasks.workunit.client.0.smithi071.stdout:1/669: write d1/f19 [1602959,42303] 0 2024-09-10T10:04:22.154 INFO:tasks.workunit.client.0.smithi071.stdout:6/564: write d4/da/df/d2e/d3a/f66 [1607301,73353] 0 2024-09-10T10:04:22.155 INFO:tasks.workunit.client.0.smithi071.stdout:2/631: chown d8/d38/l6a 11 1 2024-09-10T10:04:22.158 INFO:tasks.workunit.client.0.smithi071.stdout:2/632: creat d8/d38/d99/fd0 x:0 0 0 2024-09-10T10:04:22.159 INFO:tasks.workunit.client.0.smithi071.stdout:3/554: sync 2024-09-10T10:04:22.160 INFO:tasks.workunit.client.0.smithi071.stdout:1/670: mkdir d1/d35/dea 0 2024-09-10T10:04:22.161 INFO:tasks.workunit.client.1.smithi107.stdout:9/631: mknod d5/d7/d1d/d41/cd8 0 2024-09-10T10:04:22.161 INFO:tasks.workunit.client.0.smithi071.stdout:2/633: write d8/d24/d7f/fa6 [3106352,3348] 0 2024-09-10T10:04:22.161 INFO:tasks.workunit.client.0.smithi071.stdout:7/676: write d9/d1a/d1d/f61 [630893,40264] 0 2024-09-10T10:04:22.163 INFO:tasks.workunit.client.0.smithi071.stdout:7/677: chown d9 7 1 2024-09-10T10:04:22.165 INFO:tasks.workunit.client.0.smithi071.stdout:3/555: symlink d3/d1c/d3c/da1/d42/d4a/lc5 0 2024-09-10T10:04:22.165 INFO:tasks.workunit.client.0.smithi071.stdout:0/576: dread d11/f14 [0,4194304] 0 2024-09-10T10:04:22.167 INFO:tasks.workunit.client.1.smithi107.stdout:9/632: dwrite d5/d7/d1d/d41/f91 [0,4194304] 0 2024-09-10T10:04:22.170 INFO:tasks.workunit.client.0.smithi071.stdout:1/671: dread d1/d21/d65/f4e [0,4194304] 0 2024-09-10T10:04:22.173 INFO:tasks.workunit.client.0.smithi071.stdout:3/556: write d3/d1c/d3c/da1/d42/d4a/d60/f6b [584094,11888] 0 2024-09-10T10:04:22.176 INFO:tasks.workunit.client.0.smithi071.stdout:3/557: chown d3/d10/d24/dab/fbb 72 1 2024-09-10T10:04:22.176 INFO:tasks.workunit.client.0.smithi071.stdout:2/634: dwrite d8/d87/d33/f40 [0,4194304] 0 2024-09-10T10:04:22.180 INFO:tasks.workunit.client.1.smithi107.stdout:9/633: mknod d5/d7/d1d/d3b/cd9 0 2024-09-10T10:04:22.181 INFO:tasks.workunit.client.0.smithi071.stdout:2/635: fsync d8/d4a/f97 0 2024-09-10T10:04:22.184 INFO:tasks.workunit.client.0.smithi071.stdout:0/577: dwrite d11/d30/f50 [0,4194304] 0 2024-09-10T10:04:22.185 INFO:tasks.workunit.client.0.smithi071.stdout:7/678: dread d9/d76/f9a [0,4194304] 0 2024-09-10T10:04:22.185 INFO:tasks.workunit.client.0.smithi071.stdout:1/672: dwrite d1/d21/d65/f25 [0,4194304] 0 2024-09-10T10:04:22.185 INFO:tasks.workunit.client.0.smithi071.stdout:3/558: getdents d3/d1c/d3c/da1/d3a 0 2024-09-10T10:04:22.186 INFO:tasks.workunit.client.0.smithi071.stdout:0/578: chown d11/d22/d9a/fab 0 1 2024-09-10T10:04:22.187 INFO:tasks.workunit.client.0.smithi071.stdout:3/559: chown d3/d10/d24/c71 57465722 1 2024-09-10T10:04:22.188 INFO:tasks.workunit.client.0.smithi071.stdout:2/636: mkdir d8/d87/dad/dd1 0 2024-09-10T10:04:22.190 INFO:tasks.workunit.client.0.smithi071.stdout:1/673: truncate d1/fd 1914968 0 2024-09-10T10:04:22.190 INFO:tasks.workunit.client.0.smithi071.stdout:7/679: creat d9/d15/d40/d80/ddd/de2/fec x:0 0 0 2024-09-10T10:04:22.194 INFO:tasks.workunit.client.0.smithi071.stdout:7/680: mknod d9/d2c/ced 0 2024-09-10T10:04:22.194 INFO:tasks.workunit.client.0.smithi071.stdout:1/674: fdatasync d1/d57/fc6 0 2024-09-10T10:04:22.195 INFO:tasks.workunit.client.0.smithi071.stdout:3/560: creat d3/fc6 x:0 0 0 2024-09-10T10:04:22.196 INFO:tasks.workunit.client.0.smithi071.stdout:0/579: rename d11/d22/d31/fc5 to d11/d22/d31/fcb 0 2024-09-10T10:04:22.198 INFO:tasks.workunit.client.0.smithi071.stdout:1/675: creat d1/d21/d2f/d30/d75/feb x:0 0 0 2024-09-10T10:04:22.201 INFO:tasks.workunit.client.0.smithi071.stdout:7/681: creat d9/d15/d40/d80/ddd/de2/de3/fee x:0 0 0 2024-09-10T10:04:22.201 INFO:tasks.workunit.client.0.smithi071.stdout:2/637: dwrite d8/d87/d33/d41/d4d/f8c [0,4194304] 0 2024-09-10T10:04:22.202 INFO:tasks.workunit.client.0.smithi071.stdout:0/580: creat d11/d22/d31/fcc x:0 0 0 2024-09-10T10:04:22.205 INFO:tasks.workunit.client.0.smithi071.stdout:7/682: read d9/d15/d1f/f68 [593045,31286] 0 2024-09-10T10:04:22.206 INFO:tasks.workunit.client.0.smithi071.stdout:1/676: link d1/d21/d2f/d30/d6a/ddb/le6 d1/d57/lec 0 2024-09-10T10:04:22.209 INFO:tasks.workunit.client.0.smithi071.stdout:1/677: creat d1/d21/d3d/d4a/fed x:0 0 0 2024-09-10T10:04:22.210 INFO:tasks.workunit.client.0.smithi071.stdout:7/683: creat d9/d15/d1f/fef x:0 0 0 2024-09-10T10:04:22.212 INFO:tasks.workunit.client.0.smithi071.stdout:2/638: dwrite d8/d38/f70 [0,4194304] 0 2024-09-10T10:04:22.213 INFO:tasks.workunit.client.0.smithi071.stdout:7/684: chown d9/d2c/ced 514495186 1 2024-09-10T10:04:22.214 INFO:tasks.workunit.client.1.smithi107.stdout:9/634: dread d5/d1e/f9f [0,4194304] 0 2024-09-10T10:04:22.217 INFO:tasks.workunit.client.0.smithi071.stdout:7/685: mknod d9/d15/d40/d80/ddd/de2/de3/cf0 0 2024-09-10T10:04:22.218 INFO:tasks.workunit.client.0.smithi071.stdout:2/639: symlink d8/d87/dad/dd1/ld2 0 2024-09-10T10:04:22.218 INFO:tasks.workunit.client.0.smithi071.stdout:7/686: write d9/d70/fa3 [198486,71174] 0 2024-09-10T10:04:22.219 INFO:tasks.workunit.client.0.smithi071.stdout:7/687: chown d9/d15/d1f/f3f 43184 1 2024-09-10T10:04:22.220 INFO:tasks.workunit.client.0.smithi071.stdout:2/640: rmdir d8/d87/dad/dd1 39 2024-09-10T10:04:22.221 INFO:tasks.workunit.client.0.smithi071.stdout:2/641: read d8/d87/f25 [2574338,9976] 0 2024-09-10T10:04:22.221 INFO:tasks.workunit.client.0.smithi071.stdout:7/688: chown d9/d15/d1f/d74/da1/dcf/ddf/lc3 197947 1 2024-09-10T10:04:22.223 INFO:tasks.workunit.client.0.smithi071.stdout:2/642: creat d8/d87/fd3 x:0 0 0 2024-09-10T10:04:22.224 INFO:tasks.workunit.client.0.smithi071.stdout:7/689: symlink d9/d11/d91/lf1 0 2024-09-10T10:04:22.225 INFO:tasks.workunit.client.0.smithi071.stdout:7/690: truncate d9/d1a/f30 4332036 0 2024-09-10T10:04:22.226 INFO:tasks.workunit.client.0.smithi071.stdout:2/643: write d8/d87/d33/d53/f86 [2930652,10829] 0 2024-09-10T10:04:22.228 INFO:tasks.workunit.client.0.smithi071.stdout:3/561: dread d3/d10/fa3 [0,4194304] 0 2024-09-10T10:04:22.228 INFO:tasks.workunit.client.0.smithi071.stdout:7/691: chown d9/d15/d40/d80/dd6/fd5 57 1 2024-09-10T10:04:22.229 INFO:tasks.workunit.client.0.smithi071.stdout:3/562: chown d3/cb 39734 1 2024-09-10T10:04:22.231 INFO:tasks.workunit.client.0.smithi071.stdout:2/644: link d8/d24/d7f/fc7 d8/d87/d33/d41/d4d/d5e/fd4 0 2024-09-10T10:04:22.231 INFO:tasks.workunit.client.0.smithi071.stdout:2/645: chown d8/d87/d33/d41/d4d/d5e/fbc 123578040 1 2024-09-10T10:04:22.232 INFO:tasks.workunit.client.0.smithi071.stdout:3/563: creat d3/d1c/d3c/da1/d3a/dbd/fc7 x:0 0 0 2024-09-10T10:04:22.232 INFO:tasks.workunit.client.0.smithi071.stdout:2/646: chown d8/d87/d33/d53/l90 898 1 2024-09-10T10:04:22.233 INFO:tasks.workunit.client.0.smithi071.stdout:7/692: rmdir d9/d15/d1f/d74/da5 0 2024-09-10T10:04:22.235 INFO:tasks.workunit.client.0.smithi071.stdout:7/693: mknod d9/d2c/d4f/cf2 0 2024-09-10T10:04:22.236 INFO:tasks.workunit.client.0.smithi071.stdout:2/647: rmdir d8/d87/d33/d41/d4d/d52 39 2024-09-10T10:04:22.237 INFO:tasks.workunit.client.0.smithi071.stdout:7/694: symlink d9/d11/dd2/lf3 0 2024-09-10T10:04:22.237 INFO:tasks.workunit.client.0.smithi071.stdout:3/564: link d3/d1c/d3c/da1/cc3 d3/d1c/d3c/da1/cc8 0 2024-09-10T10:04:22.238 INFO:tasks.workunit.client.0.smithi071.stdout:0/581: dread d11/d30/d52/f7f [0,4194304] 0 2024-09-10T10:04:22.238 INFO:tasks.workunit.client.0.smithi071.stdout:7/695: fsync d9/d15/d40/d80/ddd/de2/fec 0 2024-09-10T10:04:22.239 INFO:tasks.workunit.client.0.smithi071.stdout:7/696: chown d9/d11/dd2 2 1 2024-09-10T10:04:22.239 INFO:tasks.workunit.client.0.smithi071.stdout:2/648: dread d8/d87/f7a [0,4194304] 0 2024-09-10T10:04:22.240 INFO:tasks.workunit.client.0.smithi071.stdout:0/582: dread - d11/d22/f82 zero size 2024-09-10T10:04:22.242 INFO:tasks.workunit.client.0.smithi071.stdout:0/583: mknod d11/d22/d9a/ccd 0 2024-09-10T10:04:22.244 INFO:tasks.workunit.client.0.smithi071.stdout:3/565: dwrite d3/d1c/d3c/da1/fb7 [0,4194304] 0 2024-09-10T10:04:22.244 INFO:tasks.workunit.client.0.smithi071.stdout:0/584: creat d11/d30/d70/fce x:0 0 0 2024-09-10T10:04:22.267 INFO:tasks.workunit.client.1.smithi107.stdout:5/678: sync 2024-09-10T10:04:22.267 INFO:tasks.workunit.client.1.smithi107.stdout:8/556: sync 2024-09-10T10:04:22.272 INFO:tasks.workunit.client.1.smithi107.stdout:5/679: dwrite de/db3/fd3 [0,4194304] 0 2024-09-10T10:04:22.279 INFO:tasks.workunit.client.0.smithi071.stdout:8/554: sync 2024-09-10T10:04:22.283 INFO:tasks.workunit.client.0.smithi071.stdout:2/649: dread d8/f80 [0,4194304] 0 2024-09-10T10:04:22.283 INFO:tasks.workunit.client.0.smithi071.stdout:1/678: getdents d1/d21/d2f/d30/d6a 0 2024-09-10T10:04:22.284 INFO:tasks.workunit.client.1.smithi107.stdout:5/680: creat de/d20/d2b/d4b/d8c/fec x:0 0 0 2024-09-10T10:04:22.284 INFO:tasks.workunit.client.0.smithi071.stdout:8/555: write d5/df/d1e/d38/f4c [402988,14124] 0 2024-09-10T10:04:22.284 INFO:tasks.workunit.client.0.smithi071.stdout:3/566: creat d3/d49/d2f/d7f/fc9 x:0 0 0 2024-09-10T10:04:22.285 INFO:tasks.workunit.client.1.smithi107.stdout:5/681: write de/db3/fd3 [890856,121171] 0 2024-09-10T10:04:22.287 INFO:tasks.workunit.client.1.smithi107.stdout:9/635: dwrite d5/d7/d1d/d41/d83/d9a/f65 [0,4194304] 0 2024-09-10T10:04:22.288 INFO:tasks.workunit.client.1.smithi107.stdout:9/636: read - d5/d7/d1d/d9b/dab/d57/d87/d27/fc1 zero size 2024-09-10T10:04:22.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:21 smithi071 ceph-mon[27559]: pgmap v261: 65 pgs: 65 active+clean; 2.2 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 77 MiB/s rd, 284 MiB/s wr, 521 op/s 2024-09-10T10:04:22.289 INFO:tasks.workunit.client.0.smithi071.stdout:0/585: link d11/d30/d52/f80 d11/d22/fcf 0 2024-09-10T10:04:22.289 INFO:tasks.workunit.client.0.smithi071.stdout:2/650: getdents d8/d87/dc4 0 2024-09-10T10:04:22.290 INFO:tasks.workunit.client.1.smithi107.stdout:8/557: link d5/d8/d66/d8b/d18/d4f/f5c d5/d8/d66/d8b/d21/fb3 0 2024-09-10T10:04:22.290 INFO:tasks.workunit.client.1.smithi107.stdout:5/682: dread - de/d20/d2b/d4b/f71 zero size 2024-09-10T10:04:22.290 INFO:tasks.workunit.client.1.smithi107.stdout:9/637: read - d5/d7/d1d/db5/fce zero size 2024-09-10T10:04:22.292 INFO:tasks.workunit.client.1.smithi107.stdout:5/683: read - de/d20/d2b/d4b/d5e/f94 zero size 2024-09-10T10:04:22.294 INFO:tasks.workunit.client.1.smithi107.stdout:9/638: mkdir d5/d7/d1d/d29/db4/dbd/dda 0 2024-09-10T10:04:22.295 INFO:tasks.workunit.client.0.smithi071.stdout:3/567: dwrite d3/d20/f63 [0,4194304] 0 2024-09-10T10:04:22.296 INFO:tasks.workunit.client.0.smithi071.stdout:2/651: truncate d8/d24/d7f/fa6 4859586 0 2024-09-10T10:04:22.297 INFO:tasks.workunit.client.0.smithi071.stdout:7/697: dread f4 [0,4194304] 0 2024-09-10T10:04:22.301 INFO:tasks.workunit.client.0.smithi071.stdout:7/698: write d9/f8f [1009626,1351] 0 2024-09-10T10:04:22.301 INFO:tasks.workunit.client.1.smithi107.stdout:9/639: dwrite d5/d7/d1d/d9b/dab/f5d [0,4194304] 0 2024-09-10T10:04:22.305 INFO:tasks.workunit.client.1.smithi107.stdout:9/640: chown d5/d7/d1d/d41/d83/d9a/l33 9605 1 2024-09-10T10:04:22.306 INFO:tasks.workunit.client.0.smithi071.stdout:3/568: dwrite d3/d1c/f22 [0,4194304] 0 2024-09-10T10:04:22.306 INFO:tasks.workunit.client.0.smithi071.stdout:7/699: write d9/d15/d40/f79 [5212288,79900] 0 2024-09-10T10:04:22.311 INFO:tasks.workunit.client.0.smithi071.stdout:7/700: mknod d9/d15/d1f/cf4 0 2024-09-10T10:04:22.312 INFO:tasks.workunit.client.0.smithi071.stdout:3/569: symlink d3/d1c/d3c/da1/d5d/d7a/lca 0 2024-09-10T10:04:22.312 INFO:tasks.workunit.client.1.smithi107.stdout:9/641: symlink d5/d7/d1d/d9b/dab/d57/d87/ldb 0 2024-09-10T10:04:22.314 INFO:tasks.workunit.client.1.smithi107.stdout:9/642: write d5/d7/d1d/d95/fa4 [884778,101920] 0 2024-09-10T10:04:22.318 INFO:tasks.workunit.client.0.smithi071.stdout:3/570: rename d3/d49/f4c to d3/d1c/d3c/da1/d3a/dc0/fcb 0 2024-09-10T10:04:22.320 INFO:tasks.workunit.client.0.smithi071.stdout:3/571: chown d3/d1c/d3c/da1/fa9 37537 1 2024-09-10T10:04:22.320 INFO:tasks.workunit.client.0.smithi071.stdout:8/556: dread d5/df/d1e/d38/f48 [0,4194304] 0 2024-09-10T10:04:22.322 INFO:tasks.workunit.client.1.smithi107.stdout:9/643: dread d5/d7/d1d/d95/faf [0,4194304] 0 2024-09-10T10:04:22.323 INFO:tasks.workunit.client.1.smithi107.stdout:8/558: dread d5/fb [0,4194304] 0 2024-09-10T10:04:22.323 INFO:tasks.workunit.client.0.smithi071.stdout:2/652: dread d8/d87/d51/f84 [0,4194304] 0 2024-09-10T10:04:22.326 INFO:tasks.workunit.client.1.smithi107.stdout:8/559: creat d5/d8/d66/d8b/d21/d83/fb4 x:0 0 0 2024-09-10T10:04:22.327 INFO:tasks.workunit.client.1.smithi107.stdout:8/560: mknod d5/d8/d66/cb5 0 2024-09-10T10:04:22.328 INFO:tasks.workunit.client.0.smithi071.stdout:2/653: creat d8/d87/d33/d41/d4d/d5e/fd5 x:0 0 0 2024-09-10T10:04:22.328 INFO:tasks.workunit.client.0.smithi071.stdout:3/572: dwrite d3/d20/f2c [0,4194304] 0 2024-09-10T10:04:22.330 INFO:tasks.workunit.client.0.smithi071.stdout:8/557: dwrite d5/df/d74/f96 [4194304,4194304] 0 2024-09-10T10:04:22.331 INFO:tasks.workunit.client.0.smithi071.stdout:8/558: dread - d5/df/d1d/d86/d75/f9d zero size 2024-09-10T10:04:22.334 INFO:tasks.workunit.client.0.smithi071.stdout:2/654: mknod d8/d24/cd6 0 2024-09-10T10:04:22.338 INFO:tasks.workunit.client.0.smithi071.stdout:2/655: creat d8/d87/d33/d41/d56/fd7 x:0 0 0 2024-09-10T10:04:22.338 INFO:tasks.workunit.client.0.smithi071.stdout:0/586: truncate d11/d22/d31/f92 1908074 0 2024-09-10T10:04:22.344 INFO:tasks.workunit.client.0.smithi071.stdout:7/701: truncate d9/d15/d40/f79 1200937 0 2024-09-10T10:04:22.345 INFO:tasks.workunit.client.0.smithi071.stdout:7/702: fsync d9/d15/d40/d80/ddd/de2/fec 0 2024-09-10T10:04:22.345 INFO:tasks.workunit.client.0.smithi071.stdout:8/559: rmdir d5/d36/da7 0 2024-09-10T10:04:22.345 INFO:tasks.workunit.client.0.smithi071.stdout:7/703: chown d9/d76 284414 1 2024-09-10T10:04:22.346 INFO:tasks.workunit.client.0.smithi071.stdout:3/573: getdents d3/d49/d2f/d7f 0 2024-09-10T10:04:22.346 INFO:tasks.workunit.client.0.smithi071.stdout:2/656: mknod d8/d87/d33/cd8 0 2024-09-10T10:04:22.348 INFO:tasks.workunit.client.0.smithi071.stdout:3/574: write d3/d1c/f22 [11297902,43768] 0 2024-09-10T10:04:22.349 INFO:tasks.workunit.client.0.smithi071.stdout:0/587: rename d11/d22/f4e to d11/d30/fd0 0 2024-09-10T10:04:22.350 INFO:tasks.workunit.client.0.smithi071.stdout:7/704: mkdir d9/d15/d1f/d74/d9b/dd8/df5 0 2024-09-10T10:04:22.351 INFO:tasks.workunit.client.0.smithi071.stdout:2/657: mkdir d8/d38/d47/dd9 0 2024-09-10T10:04:22.352 INFO:tasks.workunit.client.0.smithi071.stdout:0/588: creat d11/d22/d40/fd1 x:0 0 0 2024-09-10T10:04:22.353 INFO:tasks.workunit.client.0.smithi071.stdout:7/705: fsync d9/d2c/f93 0 2024-09-10T10:04:22.354 INFO:tasks.workunit.client.0.smithi071.stdout:7/706: fdatasync d9/d2c/f7e 0 2024-09-10T10:04:22.354 INFO:tasks.workunit.client.0.smithi071.stdout:2/658: rename d8/d87/d33/d41/d4d/d5e/dac to d8/d24/dda 0 2024-09-10T10:04:22.355 INFO:tasks.workunit.client.0.smithi071.stdout:0/589: symlink d11/d22/d9a/ld2 0 2024-09-10T10:04:22.355 INFO:tasks.workunit.client.0.smithi071.stdout:7/707: write d9/d15/d40/d80/dd6/fd5 [747385,42323] 0 2024-09-10T10:04:22.356 INFO:tasks.workunit.client.0.smithi071.stdout:0/590: fsync d11/d22/d31/fc2 0 2024-09-10T10:04:22.356 INFO:tasks.workunit.client.0.smithi071.stdout:7/708: readlink d9/d15/d1f/d74/d9b/lb5 0 2024-09-10T10:04:22.356 INFO:tasks.workunit.client.1.smithi107.stdout:9/644: dread d5/d7/d1d/d9b/dab/d57/d87/d37/f80 [4194304,4194304] 0 2024-09-10T10:04:22.358 INFO:tasks.workunit.client.0.smithi071.stdout:0/591: chown d11/c1b 0 1 2024-09-10T10:04:22.359 INFO:tasks.workunit.client.0.smithi071.stdout:0/592: read - d11/d22/d31/fcc zero size 2024-09-10T10:04:22.361 INFO:tasks.workunit.client.1.smithi107.stdout:8/561: dread d5/d8/d66/d8b/d21/f3e [0,4194304] 0 2024-09-10T10:04:22.362 INFO:tasks.workunit.client.0.smithi071.stdout:2/659: dwrite d8/d4a/f55 [0,4194304] 0 2024-09-10T10:04:22.362 INFO:tasks.workunit.client.0.smithi071.stdout:7/709: link d9/d1a/d1d/f5a d9/d11/de8/ff6 0 2024-09-10T10:04:22.362 INFO:tasks.workunit.client.0.smithi071.stdout:0/593: dread - d11/d30/d70/fce zero size 2024-09-10T10:04:22.363 INFO:tasks.workunit.client.1.smithi107.stdout:8/562: write d5/d8/d5b/f90 [1302383,89927] 0 2024-09-10T10:04:22.364 INFO:tasks.workunit.client.0.smithi071.stdout:7/710: chown d9/d15/d1f/f68 29554969 1 2024-09-10T10:04:22.365 INFO:tasks.workunit.client.0.smithi071.stdout:8/560: dread d5/f45 [0,4194304] 0 2024-09-10T10:04:22.365 INFO:tasks.workunit.client.1.smithi107.stdout:9/645: dwrite d5/d7/d1d/d41/d83/d9a/fb0 [0,4194304] 0 2024-09-10T10:04:22.368 INFO:tasks.workunit.client.0.smithi071.stdout:2/660: rename d8/d24/c45 to d8/db6/cdb 0 2024-09-10T10:04:22.369 INFO:tasks.workunit.client.1.smithi107.stdout:8/563: rename d5/d8/d66/d8b/d21/l7c to d5/d8/d66/d8b/d18/da4/lb6 0 2024-09-10T10:04:22.370 INFO:tasks.workunit.client.1.smithi107.stdout:9/646: read - d5/d7/d1d/f4d zero size 2024-09-10T10:04:22.370 INFO:tasks.workunit.client.0.smithi071.stdout:7/711: chown d9/d15/d1f/l29 6094 1 2024-09-10T10:04:22.372 INFO:tasks.workunit.client.0.smithi071.stdout:0/594: mknod d11/d30/d52/cd3 0 2024-09-10T10:04:22.374 INFO:tasks.workunit.client.0.smithi071.stdout:0/595: stat d11/d22/d9a/fab 0 2024-09-10T10:04:22.374 INFO:tasks.workunit.client.0.smithi071.stdout:8/561: rmdir d5/df/d1d 39 2024-09-10T10:04:22.376 INFO:tasks.workunit.client.1.smithi107.stdout:8/564: getdents d5/d8/d2a 0 2024-09-10T10:04:22.379 INFO:tasks.workunit.client.0.smithi071.stdout:0/596: unlink d11/d30/f3c 0 2024-09-10T10:04:22.383 INFO:tasks.workunit.client.1.smithi107.stdout:8/565: dwrite d5/d8/d2a/d35/f59 [0,4194304] 0 2024-09-10T10:04:22.385 INFO:tasks.workunit.client.0.smithi071.stdout:0/597: chown d11/d30/d52/f53 80 1 2024-09-10T10:04:22.386 INFO:tasks.workunit.client.1.smithi107.stdout:8/566: creat d5/d8/d66/d8b/d81/fb7 x:0 0 0 2024-09-10T10:04:22.389 INFO:tasks.workunit.client.1.smithi107.stdout:8/567: creat d5/d42/fb8 x:0 0 0 2024-09-10T10:04:22.395 INFO:tasks.workunit.client.0.smithi071.stdout:7/712: creat d9/ff7 x:0 0 0 2024-09-10T10:04:22.396 INFO:tasks.workunit.client.0.smithi071.stdout:2/661: getdents d8/d87/d33 0 2024-09-10T10:04:22.397 INFO:tasks.workunit.client.0.smithi071.stdout:0/598: mknod d11/d22/d40/cd4 0 2024-09-10T10:04:22.399 INFO:tasks.workunit.client.0.smithi071.stdout:0/599: chown cb 2389 1 2024-09-10T10:04:22.399 INFO:tasks.workunit.client.1.smithi107.stdout:8/568: write d5/d8/d5b/f6f [835641,38268] 0 2024-09-10T10:04:22.399 INFO:tasks.workunit.client.0.smithi071.stdout:2/662: fsync d8/d87/d33/d41/d4d/f8c 0 2024-09-10T10:04:22.400 INFO:tasks.workunit.client.1.smithi107.stdout:8/569: chown d5/d8/d2a/d35/d70/f8f 37280945 1 2024-09-10T10:04:22.400 INFO:tasks.workunit.client.0.smithi071.stdout:0/600: chown d11/d22/d31/l3e 4212232 1 2024-09-10T10:04:22.400 INFO:tasks.workunit.client.0.smithi071.stdout:7/713: getdents d9/d15/d1f/d74/d9b/dd8/df5 0 2024-09-10T10:04:22.401 INFO:tasks.workunit.client.0.smithi071.stdout:2/663: chown d8/fb 319516 1 2024-09-10T10:04:22.401 INFO:tasks.workunit.client.0.smithi071.stdout:0/601: creat d11/d22/d9a/fd5 x:0 0 0 2024-09-10T10:04:22.402 INFO:tasks.workunit.client.0.smithi071.stdout:7/714: write d9/d11/d91/f9e [5168271,33918] 0 2024-09-10T10:04:22.403 INFO:tasks.workunit.client.0.smithi071.stdout:2/664: mkdir d8/d38/d8d/ddc 0 2024-09-10T10:04:22.404 INFO:tasks.workunit.client.0.smithi071.stdout:7/715: chown d9/d76/fa8 1113 1 2024-09-10T10:04:22.404 INFO:tasks.workunit.client.0.smithi071.stdout:2/665: write d8/d38/fa0 [903697,64747] 0 2024-09-10T10:04:22.405 INFO:tasks.workunit.client.0.smithi071.stdout:0/602: creat d11/d30/d52/d5f/fd6 x:0 0 0 2024-09-10T10:04:22.405 INFO:tasks.workunit.client.0.smithi071.stdout:8/562: dread d5/d36/d49/f4f [0,4194304] 0 2024-09-10T10:04:22.407 INFO:tasks.workunit.client.1.smithi107.stdout:8/570: dwrite d5/d8/d66/d8b/d1a/d71/fae [0,4194304] 0 2024-09-10T10:04:22.411 INFO:tasks.workunit.client.1.smithi107.stdout:8/571: mkdir d5/d8/d66/d8b/d1a/d64/db9 0 2024-09-10T10:04:22.413 INFO:tasks.workunit.client.0.smithi071.stdout:7/716: dwrite d9/d15/f5d [0,4194304] 0 2024-09-10T10:04:22.414 INFO:tasks.workunit.client.0.smithi071.stdout:8/563: link d5/df/d1d/d86/f9c d5/df/d1d/fc5 0 2024-09-10T10:04:22.416 INFO:tasks.workunit.client.0.smithi071.stdout:0/603: dwrite d11/d1e/f90 [0,4194304] 0 2024-09-10T10:04:22.418 INFO:tasks.workunit.client.1.smithi107.stdout:8/572: dwrite d5/d8/d66/d8b/f67 [0,4194304] 0 2024-09-10T10:04:22.419 INFO:tasks.workunit.client.1.smithi107.stdout:8/573: write d5/d8/d66/d8b/d1a/f43 [8963651,47102] 0 2024-09-10T10:04:22.420 INFO:tasks.workunit.client.0.smithi071.stdout:8/564: rename d5/d36/d49/d8f/f94 to d5/d30/fc6 0 2024-09-10T10:04:22.422 INFO:tasks.workunit.client.0.smithi071.stdout:0/604: symlink d11/d30/d52/d5f/ld7 0 2024-09-10T10:04:22.423 INFO:tasks.workunit.client.1.smithi107.stdout:8/574: rename d5/d42/fb8 to d5/d8/d66/d8b/fba 0 2024-09-10T10:04:22.425 INFO:tasks.workunit.client.0.smithi071.stdout:7/717: mkdir d9/d15/d1f/db9/df8 0 2024-09-10T10:04:22.426 INFO:tasks.workunit.client.0.smithi071.stdout:7/718: chown d9/d11/c37 1671579 1 2024-09-10T10:04:22.426 INFO:tasks.workunit.client.0.smithi071.stdout:0/605: mknod d11/d1e/cd8 0 2024-09-10T10:04:22.427 INFO:tasks.workunit.client.0.smithi071.stdout:7/719: write d9/d2c/d49/fde [669800,42450] 0 2024-09-10T10:04:22.429 INFO:tasks.workunit.client.0.smithi071.stdout:8/565: dwrite d5/df/f80 [0,4194304] 0 2024-09-10T10:04:22.434 INFO:tasks.workunit.client.0.smithi071.stdout:2/666: write d8/f20 [771469,19619] 0 2024-09-10T10:04:22.434 INFO:tasks.workunit.client.0.smithi071.stdout:7/720: dread d9/d1a/f4d [0,4194304] 0 2024-09-10T10:04:22.434 INFO:tasks.workunit.client.1.smithi107.stdout:8/575: truncate d5/d8/d66/d8b/d1a/d71/f7d 1119130 0 2024-09-10T10:04:22.436 INFO:tasks.workunit.client.0.smithi071.stdout:2/667: readlink d8/d87/d33/d53/l90 0 2024-09-10T10:04:22.437 INFO:tasks.workunit.client.0.smithi071.stdout:2/668: creat d8/d4a/fdd x:0 0 0 2024-09-10T10:04:22.439 INFO:tasks.workunit.client.0.smithi071.stdout:7/721: mkdir d9/d1a/d1d/df9 0 2024-09-10T10:04:22.440 INFO:tasks.workunit.client.0.smithi071.stdout:2/669: mkdir d8/d87/d33/dde 0 2024-09-10T10:04:22.441 INFO:tasks.workunit.client.1.smithi107.stdout:8/576: dwrite d5/d8/d2a/d35/d70/f95 [0,4194304] 0 2024-09-10T10:04:22.443 INFO:tasks.workunit.client.1.smithi107.stdout:8/577: dread - d5/d8/d66/d8b/d1a/d64/f72 zero size 2024-09-10T10:04:22.444 INFO:tasks.workunit.client.0.smithi071.stdout:7/722: link d9/d11/c37 d9/d15/d1f/d98/cfa 0 2024-09-10T10:04:22.446 INFO:tasks.workunit.client.1.smithi107.stdout:8/578: mknod d5/d8/d66/d8e/cbb 0 2024-09-10T10:04:22.447 INFO:tasks.workunit.client.0.smithi071.stdout:7/723: symlink d9/d15/d1f/lfb 0 2024-09-10T10:04:22.448 INFO:tasks.workunit.client.1.smithi107.stdout:8/579: fdatasync d5/d8/d66/d8b/d21/f3c 0 2024-09-10T10:04:22.449 INFO:tasks.workunit.client.0.smithi071.stdout:8/566: dread d5/df/f5f [0,4194304] 0 2024-09-10T10:04:22.449 INFO:tasks.workunit.client.1.smithi107.stdout:8/580: write d5/d8/d66/d8b/f67 [1618471,11453] 0 2024-09-10T10:04:22.450 INFO:tasks.workunit.client.0.smithi071.stdout:7/724: creat d9/d1a/dc8/ffc x:0 0 0 2024-09-10T10:04:22.450 INFO:tasks.workunit.client.0.smithi071.stdout:8/567: chown d5/df/d1e/d38/d62/c6c 6 1 2024-09-10T10:04:22.451 INFO:tasks.workunit.client.0.smithi071.stdout:8/568: fsync d5/df/d1d/d81/fa6 0 2024-09-10T10:04:22.452 INFO:tasks.workunit.client.0.smithi071.stdout:8/569: chown d5/df/d1d/f8d 221003268 1 2024-09-10T10:04:22.456 INFO:tasks.workunit.client.0.smithi071.stdout:8/570: rename d5/df/d1e/d38/d62 to d5/df/d1e/d70/dc7 0 2024-09-10T10:04:22.456 INFO:tasks.workunit.client.0.smithi071.stdout:8/571: fsync d5/f73 0 2024-09-10T10:04:22.458 INFO:tasks.workunit.client.0.smithi071.stdout:8/572: symlink d5/df/d1e/d70/lc8 0 2024-09-10T10:04:22.460 INFO:tasks.workunit.client.0.smithi071.stdout:8/573: creat d5/df/d1d/d86/d75/fc9 x:0 0 0 2024-09-10T10:04:22.461 INFO:tasks.workunit.client.0.smithi071.stdout:8/574: readlink d5/df/d1e/d38/l69 0 2024-09-10T10:04:22.462 INFO:tasks.workunit.client.0.smithi071.stdout:8/575: truncate d5/f19 46466 0 2024-09-10T10:04:22.467 INFO:tasks.workunit.client.0.smithi071.stdout:8/576: getdents d5/df/d1d/d86 0 2024-09-10T10:04:22.468 INFO:tasks.workunit.client.1.smithi107.stdout:8/581: write d5/d8/d66/d8b/d1a/f4d [1024714,61569] 0 2024-09-10T10:04:22.469 INFO:tasks.workunit.client.0.smithi071.stdout:0/606: write d11/d22/d31/f64 [465956,28776] 0 2024-09-10T10:04:22.470 INFO:tasks.workunit.client.1.smithi107.stdout:8/582: creat d5/d8/d66/d8b/fbc x:0 0 0 2024-09-10T10:04:22.471 INFO:tasks.workunit.client.1.smithi107.stdout:8/583: write d5/d8/d66/d8b/d1a/f4d [554847,68617] 0 2024-09-10T10:04:22.472 INFO:tasks.workunit.client.0.smithi071.stdout:0/607: creat d11/d30/d70/fd9 x:0 0 0 2024-09-10T10:04:22.473 INFO:tasks.workunit.client.0.smithi071.stdout:2/670: rename d8/d87/d51/f54 to d8/d87/d33/dde/fdf 0 2024-09-10T10:04:22.473 INFO:tasks.workunit.client.0.smithi071.stdout:7/725: write d9/d11/dd2/fb4 [502356,67593] 0 2024-09-10T10:04:22.474 INFO:tasks.workunit.client.0.smithi071.stdout:2/671: chown d8/d87/fc2 60645345 1 2024-09-10T10:04:22.475 INFO:tasks.workunit.client.0.smithi071.stdout:7/726: truncate d9/d1a/d1d/fea 4726074 0 2024-09-10T10:04:22.476 INFO:tasks.workunit.client.0.smithi071.stdout:0/608: write d11/d22/f97 [1308933,117878] 0 2024-09-10T10:04:22.476 INFO:tasks.workunit.client.0.smithi071.stdout:2/672: creat d8/d24/dda/fe0 x:0 0 0 2024-09-10T10:04:22.477 INFO:tasks.workunit.client.0.smithi071.stdout:2/673: dread - d8/d38/d63/fc1 zero size 2024-09-10T10:04:22.478 INFO:tasks.workunit.client.0.smithi071.stdout:7/727: mknod d9/d76/d66/cfd 0 2024-09-10T10:04:22.478 INFO:tasks.workunit.client.0.smithi071.stdout:2/674: chown d8/d38/d47/d59/c9f 55 1 2024-09-10T10:04:22.479 INFO:tasks.workunit.client.0.smithi071.stdout:2/675: chown d8/d38/d99 3035 1 2024-09-10T10:04:22.480 INFO:tasks.workunit.client.0.smithi071.stdout:0/609: getdents d11/d22 0 2024-09-10T10:04:22.481 INFO:tasks.workunit.client.0.smithi071.stdout:2/676: mkdir d8/d24/d7f/de1 0 2024-09-10T10:04:22.485 INFO:tasks.workunit.client.0.smithi071.stdout:7/728: dwrite d9/f34 [0,4194304] 0 2024-09-10T10:04:22.487 INFO:tasks.workunit.client.0.smithi071.stdout:7/729: mkdir d9/d15/d1f/d74/da1/dcf/dfe 0 2024-09-10T10:04:22.488 INFO:tasks.workunit.client.0.smithi071.stdout:0/610: dwrite d11/d1e/f74 [8388608,4194304] 0 2024-09-10T10:04:22.488 INFO:tasks.workunit.client.0.smithi071.stdout:2/677: link d8/d87/ccb d8/d87/d33/dde/ce2 0 2024-09-10T10:04:22.490 INFO:tasks.workunit.client.0.smithi071.stdout:2/678: write d8/d38/f57 [2177016,71290] 0 2024-09-10T10:04:22.492 INFO:tasks.workunit.client.0.smithi071.stdout:4/561: sync 2024-09-10T10:04:22.493 INFO:tasks.workunit.client.0.smithi071.stdout:4/562: dread - db/da0/fa8 zero size 2024-09-10T10:04:22.494 INFO:tasks.workunit.client.0.smithi071.stdout:0/611: rename d11/d22/l55 to d11/d22/d31/d72/lda 0 2024-09-10T10:04:22.494 INFO:tasks.workunit.client.0.smithi071.stdout:4/563: readlink db/d1d/d61/la3 0 2024-09-10T10:04:22.495 INFO:tasks.workunit.client.0.smithi071.stdout:4/564: write f3 [4874503,15433] 0 2024-09-10T10:04:22.496 INFO:tasks.workunit.client.0.smithi071.stdout:4/565: dread - db/d1d/faa zero size 2024-09-10T10:04:22.504 INFO:tasks.workunit.client.0.smithi071.stdout:7/730: write d9/d2c/d49/f62 [1610639,39920] 0 2024-09-10T10:04:22.504 INFO:tasks.workunit.client.0.smithi071.stdout:2/679: dwrite d8/d87/d33/d41/d4d/d5e/f9a [0,4194304] 0 2024-09-10T10:04:22.506 INFO:tasks.workunit.client.0.smithi071.stdout:0/612: dwrite f2 [0,4194304] 0 2024-09-10T10:04:22.510 INFO:tasks.workunit.client.0.smithi071.stdout:0/613: chown d11/d1e/cb3 6420 1 2024-09-10T10:04:22.516 INFO:tasks.workunit.client.0.smithi071.stdout:2/680: dread d8/f20 [0,4194304] 0 2024-09-10T10:04:22.519 INFO:tasks.workunit.client.0.smithi071.stdout:0/614: dread d11/d30/f71 [0,4194304] 0 2024-09-10T10:04:22.520 INFO:tasks.workunit.client.0.smithi071.stdout:2/681: mknod d8/d87/d49/dce/ce3 0 2024-09-10T10:04:22.521 INFO:tasks.workunit.client.0.smithi071.stdout:0/615: symlink d11/d30/d70/ldb 0 2024-09-10T10:04:22.523 INFO:tasks.workunit.client.0.smithi071.stdout:7/731: dwrite d9/d1a/d1d/f5a [0,4194304] 0 2024-09-10T10:04:22.525 INFO:tasks.workunit.client.0.smithi071.stdout:0/616: mkdir d11/d30/d52/d79/ddc 0 2024-09-10T10:04:22.526 INFO:tasks.workunit.client.0.smithi071.stdout:7/732: mknod d9/d11/dd2/cff 0 2024-09-10T10:04:22.529 INFO:tasks.workunit.client.0.smithi071.stdout:0/617: chown d11/d22/d31/f41 553 1 2024-09-10T10:04:22.531 INFO:tasks.workunit.client.0.smithi071.stdout:2/682: dwrite d8/d38/d47/fb9 [0,4194304] 0 2024-09-10T10:04:22.533 INFO:tasks.workunit.client.0.smithi071.stdout:0/618: write d11/d22/d40/fb8 [947332,21357] 0 2024-09-10T10:04:22.533 INFO:tasks.workunit.client.0.smithi071.stdout:7/733: dread d9/d15/d40/d80/f84 [0,4194304] 0 2024-09-10T10:04:22.540 INFO:tasks.workunit.client.0.smithi071.stdout:7/734: dwrite d9/d15/d40/d80/ddd/de2/fec [0,4194304] 0 2024-09-10T10:04:22.552 INFO:tasks.workunit.client.0.smithi071.stdout:4/566: dread db/d15/d17/f3f [0,4194304] 0 2024-09-10T10:04:22.553 INFO:tasks.workunit.client.0.smithi071.stdout:4/567: chown db/d15/d26/d43/d4d/d9f/da6 0 1 2024-09-10T10:04:22.555 INFO:tasks.workunit.client.0.smithi071.stdout:4/568: mknod db/d1d/d7a/cba 0 2024-09-10T10:04:22.556 INFO:tasks.workunit.client.0.smithi071.stdout:4/569: mknod db/d15/d17/d24/db6/cbb 0 2024-09-10T10:04:22.558 INFO:tasks.workunit.client.0.smithi071.stdout:4/570: unlink db/d1d/d61/f87 0 2024-09-10T10:04:22.560 INFO:tasks.workunit.client.0.smithi071.stdout:4/571: rename db/d15/d26/d43/d4d/c67 to db/d15/d4b/cbc 0 2024-09-10T10:04:22.563 INFO:tasks.workunit.client.0.smithi071.stdout:4/572: link db/d15/d4b/fb3 db/d15/d26/d43/d4d/d77/fbd 0 2024-09-10T10:04:22.564 INFO:tasks.workunit.client.0.smithi071.stdout:4/573: creat db/d15/d17/d24/db6/fbe x:0 0 0 2024-09-10T10:04:22.566 INFO:tasks.workunit.client.0.smithi071.stdout:4/574: truncate db/f62 749983 0 2024-09-10T10:04:22.569 INFO:tasks.workunit.client.0.smithi071.stdout:7/735: write d9/d1a/d1d/f1e [2409332,52426] 0 2024-09-10T10:04:22.571 INFO:tasks.workunit.client.0.smithi071.stdout:4/575: dwrite db/da0/fb8 [0,4194304] 0 2024-09-10T10:04:22.573 INFO:tasks.workunit.client.0.smithi071.stdout:7/736: link d9/d15/d1f/f68 d9/d11/dd2/dae/f100 0 2024-09-10T10:04:22.576 INFO:tasks.workunit.client.0.smithi071.stdout:7/737: mknod d9/d2c/c101 0 2024-09-10T10:04:22.577 INFO:tasks.workunit.client.0.smithi071.stdout:7/738: read d9/d2c/f56 [92471,49414] 0 2024-09-10T10:04:22.580 INFO:tasks.workunit.client.0.smithi071.stdout:7/739: dread d9/d2c/f7e [0,4194304] 0 2024-09-10T10:04:22.589 INFO:tasks.workunit.client.0.smithi071.stdout:4/576: dread db/d15/d17/f18 [0,4194304] 0 2024-09-10T10:04:22.590 INFO:tasks.workunit.client.0.smithi071.stdout:4/577: chown db/d15/d17/d24/l2d 1 1 2024-09-10T10:04:22.592 INFO:tasks.workunit.client.0.smithi071.stdout:4/578: write db/da0/fb8 [414823,129093] 0 2024-09-10T10:04:22.592 INFO:tasks.workunit.client.0.smithi071.stdout:4/579: write db/d15/d26/d43/d82/f83 [3797251,85543] 0 2024-09-10T10:04:22.634 INFO:tasks.workunit.client.0.smithi071.stdout:4/580: creat db/d8f/fbf x:0 0 0 2024-09-10T10:04:22.642 INFO:tasks.workunit.client.0.smithi071.stdout:7/740: getdents d9/d1a/d1d/df9 0 2024-09-10T10:04:22.643 INFO:tasks.workunit.client.0.smithi071.stdout:4/581: mkdir db/d15/d17/d4e/dc0 0 2024-09-10T10:04:22.648 INFO:tasks.workunit.client.0.smithi071.stdout:5/494: sync 2024-09-10T10:04:22.650 INFO:tasks.workunit.client.0.smithi071.stdout:5/495: creat dc/df/d3e/d5a/fa7 x:0 0 0 2024-09-10T10:04:22.651 INFO:tasks.workunit.client.0.smithi071.stdout:5/496: readlink dc/df/d3e/l73 0 2024-09-10T10:04:22.653 INFO:tasks.workunit.client.0.smithi071.stdout:5/497: write dc/df/d17/d22/f81 [502738,21537] 0 2024-09-10T10:04:22.655 INFO:tasks.workunit.client.0.smithi071.stdout:7/741: dwrite d9/d15/d1f/f2a [0,4194304] 0 2024-09-10T10:04:22.657 INFO:tasks.workunit.client.0.smithi071.stdout:5/498: symlink dc/d4a/d61/la8 0 2024-09-10T10:04:22.658 INFO:tasks.workunit.client.0.smithi071.stdout:5/499: chown dc/df/d17/d22 148044795 1 2024-09-10T10:04:22.659 INFO:tasks.workunit.client.0.smithi071.stdout:5/500: chown dc/df/d29/d94 3 1 2024-09-10T10:04:22.661 INFO:tasks.workunit.client.0.smithi071.stdout:4/582: dread db/d15/d26/d43/d82/f83 [0,4194304] 0 2024-09-10T10:04:22.662 INFO:tasks.workunit.client.0.smithi071.stdout:5/501: symlink dc/d4a/la9 0 2024-09-10T10:04:22.663 INFO:tasks.workunit.client.0.smithi071.stdout:7/742: dread d9/f34 [0,4194304] 0 2024-09-10T10:04:22.666 INFO:tasks.workunit.client.0.smithi071.stdout:7/743: getdents d9/d70 0 2024-09-10T10:04:22.670 INFO:tasks.workunit.client.0.smithi071.stdout:7/744: dread d9/f10 [0,4194304] 0 2024-09-10T10:04:22.672 INFO:tasks.workunit.client.0.smithi071.stdout:7/745: creat d9/d15/d1f/d98/f102 x:0 0 0 2024-09-10T10:04:22.675 INFO:tasks.workunit.client.0.smithi071.stdout:7/746: dread d9/d15/d1f/f2a [0,4194304] 0 2024-09-10T10:04:22.677 INFO:tasks.workunit.client.0.smithi071.stdout:7/747: symlink d9/d2c/l103 0 2024-09-10T10:04:22.678 INFO:tasks.workunit.client.0.smithi071.stdout:5/502: dread dc/df/d3e/d5a/d80/f86 [0,4194304] 0 2024-09-10T10:04:22.678 INFO:tasks.workunit.client.0.smithi071.stdout:7/748: fsync d9/d15/d40/db8/fbe 0 2024-09-10T10:04:22.681 INFO:tasks.workunit.client.0.smithi071.stdout:7/749: creat d9/d15/d40/f104 x:0 0 0 2024-09-10T10:04:22.681 INFO:tasks.workunit.client.0.smithi071.stdout:5/503: getdents dc/df/d17/d8d 0 2024-09-10T10:04:22.682 INFO:tasks.workunit.client.0.smithi071.stdout:5/504: mknod dc/d4a/d61/caa 0 2024-09-10T10:04:22.685 INFO:tasks.workunit.client.0.smithi071.stdout:5/505: symlink dc/df/d3e/d5a/lab 0 2024-09-10T10:04:22.687 INFO:tasks.workunit.client.0.smithi071.stdout:5/506: symlink dc/d53/d79/lac 0 2024-09-10T10:04:22.687 INFO:tasks.workunit.client.0.smithi071.stdout:7/750: dwrite d9/d15/d1f/fe9 [0,4194304] 0 2024-09-10T10:04:22.689 INFO:tasks.workunit.client.0.smithi071.stdout:7/751: write d9/d15/d40/d80/ddd/de2/de3/fa0 [5102540,67036] 0 2024-09-10T10:04:22.692 INFO:tasks.workunit.client.0.smithi071.stdout:7/752: mkdir d9/d15/d40/d80/ddd/de2/de3/d105 0 2024-09-10T10:04:22.693 INFO:tasks.workunit.client.0.smithi071.stdout:5/507: symlink dc/df/d29/lad 0 2024-09-10T10:04:22.694 INFO:tasks.workunit.client.0.smithi071.stdout:7/753: fsync d9/d11/de8/ff6 0 2024-09-10T10:04:22.694 INFO:tasks.workunit.client.0.smithi071.stdout:7/754: dread - d9/d1a/dc8/ffc zero size 2024-09-10T10:04:22.700 INFO:tasks.workunit.client.0.smithi071.stdout:5/508: dwrite f4 [0,4194304] 0 2024-09-10T10:04:22.701 INFO:tasks.workunit.client.0.smithi071.stdout:5/509: readlink dc/d53/l6b 0 2024-09-10T10:04:22.702 INFO:tasks.workunit.client.0.smithi071.stdout:7/755: rmdir d9/d15/d40/d80 39 2024-09-10T10:04:22.703 INFO:tasks.workunit.client.0.smithi071.stdout:5/510: mkdir dc/df/d29/d48/dae 0 2024-09-10T10:04:22.704 INFO:tasks.workunit.client.0.smithi071.stdout:5/511: creat dc/df/d17/faf x:0 0 0 2024-09-10T10:04:22.705 INFO:tasks.workunit.client.0.smithi071.stdout:5/512: fsync dc/f1b 0 2024-09-10T10:04:22.707 INFO:tasks.workunit.client.0.smithi071.stdout:5/513: write dc/df/d3e/d5a/f88 [4974888,107106] 0 2024-09-10T10:04:22.710 INFO:tasks.workunit.client.0.smithi071.stdout:5/514: creat dc/df/d17/d8d/fb0 x:0 0 0 2024-09-10T10:04:22.712 INFO:tasks.workunit.client.0.smithi071.stdout:5/515: symlink dc/df/d29/d48/lb1 0 2024-09-10T10:04:22.714 INFO:tasks.workunit.client.0.smithi071.stdout:5/516: rename dc/d4a/d61 to dc/d53/db2 0 2024-09-10T10:04:22.717 INFO:tasks.workunit.client.0.smithi071.stdout:5/517: link dc/df/d17/d22/d87/f9f dc/df/d29/d94/fb3 0 2024-09-10T10:04:22.719 INFO:tasks.workunit.client.0.smithi071.stdout:5/518: truncate dc/d53/db2/f8f 96192 0 2024-09-10T10:04:22.721 INFO:tasks.workunit.client.0.smithi071.stdout:5/519: rename dc/df/d17/d22/c56 to dc/d53/cb4 0 2024-09-10T10:04:22.722 INFO:tasks.workunit.client.0.smithi071.stdout:5/520: dread - dc/df/d17/d8d/fb0 zero size 2024-09-10T10:04:22.759 INFO:tasks.workunit.client.1.smithi107.stdout:1/747: sync 2024-09-10T10:04:22.759 INFO:tasks.workunit.client.1.smithi107.stdout:4/784: sync 2024-09-10T10:04:22.759 INFO:tasks.workunit.client.1.smithi107.stdout:2/689: sync 2024-09-10T10:04:22.761 INFO:tasks.workunit.client.1.smithi107.stdout:2/690: write d3/da/df/d20/f33 [1410857,1205] 0 2024-09-10T10:04:22.762 INFO:tasks.workunit.client.1.smithi107.stdout:1/748: mkdir d2/dcc/dea/df2 0 2024-09-10T10:04:22.762 INFO:tasks.workunit.client.1.smithi107.stdout:2/691: fdatasync d3/da/d66/fd1 0 2024-09-10T10:04:22.763 INFO:tasks.workunit.client.1.smithi107.stdout:1/749: fdatasync d2/d12/f95 0 2024-09-10T10:04:22.764 INFO:tasks.workunit.client.1.smithi107.stdout:4/785: rename d0/l19 to d0/d40/d75/l10c 0 2024-09-10T10:04:22.765 INFO:tasks.workunit.client.1.smithi107.stdout:2/692: mkdir d3/d8f/df4 0 2024-09-10T10:04:22.766 INFO:tasks.workunit.client.1.smithi107.stdout:1/750: creat d2/da8/ff3 x:0 0 0 2024-09-10T10:04:22.766 INFO:tasks.workunit.client.1.smithi107.stdout:2/693: chown d3/da/d1e/d27/d5b 22979801 1 2024-09-10T10:04:22.766 INFO:tasks.workunit.client.1.smithi107.stdout:4/786: mkdir d0/d40/d57/d76/d77/d10d 0 2024-09-10T10:04:22.768 INFO:tasks.workunit.client.1.smithi107.stdout:2/694: symlink d3/da/df/d20/d36/d39/lf5 0 2024-09-10T10:04:22.772 INFO:tasks.workunit.client.1.smithi107.stdout:4/787: dread d0/d1f/d90/fc1 [0,4194304] 0 2024-09-10T10:04:22.775 INFO:tasks.workunit.client.1.smithi107.stdout:4/788: dread d0/d1f/f66 [0,4194304] 0 2024-09-10T10:04:22.776 INFO:tasks.workunit.client.1.smithi107.stdout:4/789: fsync d0/d40/f41 0 2024-09-10T10:04:22.782 INFO:tasks.workunit.client.1.smithi107.stdout:1/751: truncate d2/d6/dc6/f75 375238 0 2024-09-10T10:04:22.782 INFO:tasks.workunit.client.1.smithi107.stdout:4/790: link d0/d1f/d20/l2d d0/d40/d75/d53/l10e 0 2024-09-10T10:04:22.784 INFO:tasks.workunit.client.1.smithi107.stdout:1/752: creat d2/da8/ff4 x:0 0 0 2024-09-10T10:04:22.788 INFO:tasks.workunit.client.1.smithi107.stdout:1/753: truncate d2/d6/d67/f92 3729866 0 2024-09-10T10:04:22.788 INFO:tasks.workunit.client.1.smithi107.stdout:1/754: readlink d2/d6/l22 0 2024-09-10T10:04:22.788 INFO:tasks.workunit.client.1.smithi107.stdout:1/755: stat d2/d35/f61 0 2024-09-10T10:04:22.788 INFO:tasks.workunit.client.1.smithi107.stdout:4/791: rename d0/d40/d57/d76/d77/da1/d59/cfc to d0/d1f/d90/dfb/c10f 0 2024-09-10T10:04:22.790 INFO:tasks.workunit.client.1.smithi107.stdout:1/756: truncate d2/f93 225644 0 2024-09-10T10:04:22.790 INFO:tasks.workunit.client.1.smithi107.stdout:4/792: mknod d0/d40/d75/d53/c110 0 2024-09-10T10:04:22.802 INFO:tasks.workunit.client.1.smithi107.stdout:4/793: truncate d0/d40/fb2 164138 0 2024-09-10T10:04:22.804 INFO:tasks.workunit.client.1.smithi107.stdout:4/794: chown d0/d40/d57/d76/d77/ff1 4024 1 2024-09-10T10:04:22.806 INFO:tasks.workunit.client.1.smithi107.stdout:1/757: dwrite d2/d35/f5b [0,4194304] 0 2024-09-10T10:04:22.806 INFO:tasks.workunit.client.1.smithi107.stdout:4/795: creat d0/d82/f111 x:0 0 0 2024-09-10T10:04:22.809 INFO:tasks.workunit.client.0.smithi071.stdout:9/909: sync 2024-09-10T10:04:22.809 INFO:tasks.workunit.client.0.smithi071.stdout:1/679: sync 2024-09-10T10:04:22.809 INFO:tasks.workunit.client.0.smithi071.stdout:6/565: sync 2024-09-10T10:04:22.810 INFO:tasks.workunit.client.1.smithi107.stdout:1/758: creat d2/da8/ff5 x:0 0 0 2024-09-10T10:04:22.810 INFO:tasks.workunit.client.1.smithi107.stdout:4/796: stat d0/d40/d57/d76/d77/da1/l7d 0 2024-09-10T10:04:22.810 INFO:tasks.workunit.client.0.smithi071.stdout:1/680: chown d1/d21/f63 1197 1 2024-09-10T10:04:22.812 INFO:tasks.workunit.client.0.smithi071.stdout:9/910: truncate d0/db/d1b/f108 874254 0 2024-09-10T10:04:22.812 INFO:tasks.workunit.client.0.smithi071.stdout:6/566: mkdir d4/da/df/db4 0 2024-09-10T10:04:22.814 INFO:tasks.workunit.client.0.smithi071.stdout:1/681: mkdir d1/d21/d2f/d30/d75/d97/dee 0 2024-09-10T10:04:22.817 INFO:tasks.workunit.client.0.smithi071.stdout:9/911: mkdir d0/db/d20/d112 0 2024-09-10T10:04:22.818 INFO:tasks.workunit.client.0.smithi071.stdout:1/682: symlink d1/d21/d2f/d81/de4/lef 0 2024-09-10T10:04:22.818 INFO:tasks.workunit.client.0.smithi071.stdout:6/567: unlink d4/da/df/d2e/d3a/d3e/d5d/d81/d95/fa0 0 2024-09-10T10:04:22.820 INFO:tasks.workunit.client.0.smithi071.stdout:6/568: mknod d4/d61/d83/cb5 0 2024-09-10T10:04:22.821 INFO:tasks.workunit.client.1.smithi107.stdout:4/797: fsync d0/d40/fb2 0 2024-09-10T10:04:22.824 INFO:tasks.workunit.client.0.smithi071.stdout:9/912: getdents d0/db/d1b/d1d/d5b 0 2024-09-10T10:04:22.825 INFO:tasks.workunit.client.1.smithi107.stdout:1/759: dwrite d2/d6/d67/fbb [0,4194304] 0 2024-09-10T10:04:22.825 INFO:tasks.workunit.client.1.smithi107.stdout:4/798: symlink d0/d6b/l112 0 2024-09-10T10:04:22.828 INFO:tasks.workunit.client.0.smithi071.stdout:9/913: creat d0/db/d20/d21/f113 x:0 0 0 2024-09-10T10:04:22.830 INFO:tasks.workunit.client.1.smithi107.stdout:1/760: chown d2/d12/d65/d6b/l45 259747 1 2024-09-10T10:04:22.830 INFO:tasks.workunit.client.1.smithi107.stdout:1/761: chown d2/d89/dd1/ce6 86201507 1 2024-09-10T10:04:22.835 INFO:tasks.workunit.client.1.smithi107.stdout:1/762: creat d2/d6/d24/d81/ff6 x:0 0 0 2024-09-10T10:04:22.838 INFO:tasks.workunit.client.1.smithi107.stdout:1/763: mkdir d2/d12/d65/db4/dd9/df7 0 2024-09-10T10:04:22.843 INFO:tasks.workunit.client.1.smithi107.stdout:1/764: dwrite d2/da8/ff4 [0,4194304] 0 2024-09-10T10:04:22.848 INFO:tasks.workunit.client.0.smithi071.stdout:9/914: dwrite d0/d3b/d5c/f74 [0,4194304] 0 2024-09-10T10:04:22.852 INFO:tasks.workunit.client.1.smithi107.stdout:4/799: dwrite d0/f8 [0,4194304] 0 2024-09-10T10:04:22.853 INFO:tasks.workunit.client.1.smithi107.stdout:1/765: dwrite d2/d12/d65/db4/dd9/fe3 [0,4194304] 0 2024-09-10T10:04:22.854 INFO:tasks.workunit.client.1.smithi107.stdout:4/800: dread - d0/d40/d57/d76/d77/da1/f103 zero size 2024-09-10T10:04:22.857 INFO:tasks.workunit.client.1.smithi107.stdout:1/766: unlink d2/d6/dc6/l79 0 2024-09-10T10:04:22.859 INFO:tasks.workunit.client.1.smithi107.stdout:4/801: creat d0/d1f/d72/f113 x:0 0 0 2024-09-10T10:04:22.860 INFO:tasks.workunit.client.1.smithi107.stdout:1/767: chown d2/d12/d65/d6b/l8a 1 1 2024-09-10T10:04:22.865 INFO:tasks.workunit.client.1.smithi107.stdout:4/802: dwrite d0/d40/d6d/f84 [0,4194304] 0 2024-09-10T10:04:22.869 INFO:tasks.workunit.client.1.smithi107.stdout:1/768: fdatasync d2/d35/d7b/fd5 0 2024-09-10T10:04:22.872 INFO:tasks.workunit.client.1.smithi107.stdout:6/679: sync 2024-09-10T10:04:22.876 INFO:tasks.workunit.client.1.smithi107.stdout:1/769: truncate d2/d36/fba 570154 0 2024-09-10T10:04:22.877 INFO:tasks.workunit.client.1.smithi107.stdout:4/803: dwrite d0/d40/d57/fd6 [0,4194304] 0 2024-09-10T10:04:22.877 INFO:tasks.workunit.client.0.smithi071.stdout:9/915: dread d0/db/d1b/d1d/d30/d54/fc6 [0,4194304] 0 2024-09-10T10:04:22.878 INFO:tasks.workunit.client.1.smithi107.stdout:1/770: write d2/da8/ff4 [2126394,46659] 0 2024-09-10T10:04:22.881 INFO:tasks.workunit.client.1.smithi107.stdout:4/804: creat d0/d1f/d5e/f114 x:0 0 0 2024-09-10T10:04:22.881 INFO:tasks.workunit.client.1.smithi107.stdout:1/771: write d2/d36/fa3 [637589,23573] 0 2024-09-10T10:04:22.885 INFO:tasks.workunit.client.1.smithi107.stdout:1/772: dread - d2/f46 zero size 2024-09-10T10:04:22.886 INFO:tasks.workunit.client.1.smithi107.stdout:4/805: symlink d0/d1f/d90/dfb/l115 0 2024-09-10T10:04:22.888 INFO:tasks.workunit.client.1.smithi107.stdout:1/773: creat d2/d6/dc6/dd4/ff8 x:0 0 0 2024-09-10T10:04:22.888 INFO:tasks.workunit.client.1.smithi107.stdout:1/774: dread - d2/d12/d5a/fe4 zero size 2024-09-10T10:04:22.889 INFO:tasks.workunit.client.1.smithi107.stdout:4/806: mkdir d0/d40/d6d/d8a/d116 0 2024-09-10T10:04:22.889 INFO:tasks.workunit.client.1.smithi107.stdout:1/775: chown d2/d12/d5a/fe4 492644573 1 2024-09-10T10:04:22.890 INFO:tasks.workunit.client.1.smithi107.stdout:4/807: chown d0/d6b/c101 973 1 2024-09-10T10:04:22.891 INFO:tasks.workunit.client.1.smithi107.stdout:1/776: mknod d2/d89/dd1/cf9 0 2024-09-10T10:04:22.893 INFO:tasks.workunit.client.1.smithi107.stdout:4/808: mknod d0/d1f/d20/d47/d8c/dfe/dff/c117 0 2024-09-10T10:04:22.894 INFO:tasks.workunit.client.1.smithi107.stdout:4/809: dread - d0/d40/d57/d76/d77/da1/fdd zero size 2024-09-10T10:04:22.900 INFO:tasks.workunit.client.1.smithi107.stdout:4/810: dwrite d0/d40/d57/d76/d77/da1/f103 [0,4194304] 0 2024-09-10T10:04:22.908 INFO:tasks.workunit.client.0.smithi071.stdout:9/916: truncate d0/d3b/d44/f5f 4122474 0 2024-09-10T10:04:22.909 INFO:tasks.workunit.client.1.smithi107.stdout:6/680: truncate d0/d3d/d14/d21/f43 4673464 0 2024-09-10T10:04:22.910 INFO:tasks.workunit.client.1.smithi107.stdout:6/681: readlink d0/d3d/d14/d17/d49/d55/d73/lda 0 2024-09-10T10:04:22.913 INFO:tasks.workunit.client.1.smithi107.stdout:6/682: unlink d0/d3d/d14/fbc 0 2024-09-10T10:04:22.914 INFO:tasks.workunit.client.1.smithi107.stdout:6/683: stat d0/d3d/d14/d9f/dca/fad 0 2024-09-10T10:04:22.915 INFO:tasks.workunit.client.1.smithi107.stdout:6/684: dread - d0/d3d/d14/d17/d49/d55/d56/fd6 zero size 2024-09-10T10:04:22.917 INFO:tasks.workunit.client.1.smithi107.stdout:4/811: write d0/d40/db3/fc9 [351303,102352] 0 2024-09-10T10:04:22.923 INFO:tasks.workunit.client.0.smithi071.stdout:9/917: rename d0/d3b/d5c/d6a/d96 to d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/d114 0 2024-09-10T10:04:22.924 INFO:tasks.workunit.client.1.smithi107.stdout:6/685: getdents d0/d3d/d14/d17/d49/dbe 0 2024-09-10T10:04:22.924 INFO:tasks.workunit.client.1.smithi107.stdout:1/777: dwrite d2/d36/fba [0,4194304] 0 2024-09-10T10:04:22.925 INFO:tasks.workunit.client.1.smithi107.stdout:1/778: chown d2/f4c 602 1 2024-09-10T10:04:22.931 INFO:tasks.workunit.client.0.smithi071.stdout:9/918: creat d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/d114/f115 x:0 0 0 2024-09-10T10:04:22.935 INFO:tasks.workunit.client.1.smithi107.stdout:6/686: mkdir d0/df0 0 2024-09-10T10:04:22.936 INFO:tasks.workunit.client.1.smithi107.stdout:1/779: symlink d2/d12/d65/d6b/lfa 0 2024-09-10T10:04:22.938 INFO:tasks.workunit.client.1.smithi107.stdout:4/812: dwrite d0/d40/d57/d76/faf [0,4194304] 0 2024-09-10T10:04:22.938 INFO:tasks.workunit.client.0.smithi071.stdout:9/919: mkdir d0/db/d1b/d1d/d30/d54/d116 0 2024-09-10T10:04:22.940 INFO:tasks.workunit.client.1.smithi107.stdout:6/687: rmdir d0/d3d/d14/d17/d49/d55 39 2024-09-10T10:04:22.941 INFO:tasks.workunit.client.0.smithi071.stdout:9/920: symlink d0/db/d1b/d1d/d5b/d60/l117 0 2024-09-10T10:04:22.945 INFO:tasks.workunit.client.1.smithi107.stdout:1/780: dwrite d2/d12/f3c [0,4194304] 0 2024-09-10T10:04:22.946 INFO:tasks.workunit.client.1.smithi107.stdout:4/813: truncate d0/d40/db3/fd2 2720273 0 2024-09-10T10:04:22.948 INFO:tasks.workunit.client.1.smithi107.stdout:6/688: rmdir d0/d3d/d14/d17/d49/d55/d73 39 2024-09-10T10:04:22.950 INFO:tasks.workunit.client.1.smithi107.stdout:6/689: dread - d0/d3d/d14/d9f/fe9 zero size 2024-09-10T10:04:22.951 INFO:tasks.workunit.client.0.smithi071.stdout:9/921: rename d0/d3b/d5c/d10b to d0/db/d1b/d1d/d30/d54/d118 0 2024-09-10T10:04:22.951 INFO:tasks.workunit.client.1.smithi107.stdout:6/690: read d0/d3d/d14/d9f/dca/f86 [382181,98645] 0 2024-09-10T10:04:22.951 INFO:tasks.workunit.client.1.smithi107.stdout:1/781: stat d2/d35/le2 0 2024-09-10T10:04:22.952 INFO:tasks.workunit.client.1.smithi107.stdout:1/782: stat d2/d6 0 2024-09-10T10:04:22.953 INFO:tasks.workunit.client.1.smithi107.stdout:4/814: rmdir d0/d6b/d9d 39 2024-09-10T10:04:22.954 INFO:tasks.workunit.client.1.smithi107.stdout:4/815: truncate d0/d40/d75/fbd 876053 0 2024-09-10T10:04:22.955 INFO:tasks.workunit.client.1.smithi107.stdout:4/816: dread - d0/d40/d57/d76/d77/ff1 zero size 2024-09-10T10:04:22.955 INFO:tasks.workunit.client.0.smithi071.stdout:9/922: creat d0/db/d1b/d1d/d30/d54/df7/dfc/f119 x:0 0 0 2024-09-10T10:04:22.957 INFO:tasks.workunit.client.1.smithi107.stdout:6/691: mkdir d0/d3d/d14/d21/d8a/dee/df1 0 2024-09-10T10:04:22.957 INFO:tasks.workunit.client.1.smithi107.stdout:5/684: sync 2024-09-10T10:04:22.957 INFO:tasks.workunit.client.1.smithi107.stdout:3/992: sync 2024-09-10T10:04:22.957 INFO:tasks.workunit.client.1.smithi107.stdout:9/647: sync 2024-09-10T10:04:22.957 INFO:tasks.workunit.client.1.smithi107.stdout:7/593: sync 2024-09-10T10:04:22.957 INFO:tasks.workunit.client.1.smithi107.stdout:0/642: sync 2024-09-10T10:04:22.957 INFO:tasks.workunit.client.1.smithi107.stdout:8/584: sync 2024-09-10T10:04:22.959 INFO:tasks.workunit.client.1.smithi107.stdout:4/817: creat d0/d1f/d20/d47/dbe/f118 x:0 0 0 2024-09-10T10:04:22.960 INFO:tasks.workunit.client.0.smithi071.stdout:9/923: rmdir d0/db/d20/d21 39 2024-09-10T10:04:22.960 INFO:tasks.workunit.client.1.smithi107.stdout:2/695: sync 2024-09-10T10:04:22.962 INFO:tasks.workunit.client.1.smithi107.stdout:2/696: chown d3/da/d1e/d5f/f34 9199 1 2024-09-10T10:04:22.962 INFO:tasks.workunit.client.1.smithi107.stdout:1/783: link d2/d6/d24/d81/fac d2/d6/ffb 0 2024-09-10T10:04:22.963 INFO:tasks.workunit.client.1.smithi107.stdout:5/685: dread - de/d4a/d7e/fab zero size 2024-09-10T10:04:22.964 INFO:tasks.workunit.client.1.smithi107.stdout:0/643: creat d6/d5a/d5c/fc9 x:0 0 0 2024-09-10T10:04:22.964 INFO:tasks.workunit.client.1.smithi107.stdout:5/686: stat de/db3/leb 0 2024-09-10T10:04:22.967 INFO:tasks.workunit.client.1.smithi107.stdout:6/692: mkdir d0/d3d/d14/d17/d49/d55/d56/df2 0 2024-09-10T10:04:22.968 INFO:tasks.workunit.client.1.smithi107.stdout:8/585: symlink d5/d8/d2a/d47/lbd 0 2024-09-10T10:04:22.968 INFO:tasks.workunit.client.1.smithi107.stdout:7/594: dwrite d0/d1b/d4d/d69/d97/d3d/f60 [0,4194304] 0 2024-09-10T10:04:22.970 INFO:tasks.workunit.client.1.smithi107.stdout:4/818: mknod d0/d1f/d72/c119 0 2024-09-10T10:04:22.973 INFO:tasks.workunit.client.0.smithi071.stdout:9/924: rmdir d0/db 39 2024-09-10T10:04:22.973 INFO:tasks.workunit.client.1.smithi107.stdout:9/648: read d5/d7/d1d/d9b/dab/d57/d87/d27/f51 [1670439,54634] 0 2024-09-10T10:04:22.973 INFO:tasks.workunit.client.1.smithi107.stdout:0/644: dwrite d6/d8/d2f/d2e/d32/f6c [0,4194304] 0 2024-09-10T10:04:22.974 INFO:tasks.workunit.client.1.smithi107.stdout:9/649: chown d5/f35 48 1 2024-09-10T10:04:22.975 INFO:tasks.workunit.client.1.smithi107.stdout:9/650: chown d5/d7/d3c/c8f 39 1 2024-09-10T10:04:22.977 INFO:tasks.workunit.client.1.smithi107.stdout:2/697: mknod d3/da/d66/d91/dae/cf6 0 2024-09-10T10:04:22.980 INFO:tasks.workunit.client.0.smithi071.stdout:8/577: sync 2024-09-10T10:04:22.980 INFO:tasks.workunit.client.0.smithi071.stdout:3/575: sync 2024-09-10T10:04:22.980 INFO:tasks.workunit.client.0.smithi071.stdout:0/619: sync 2024-09-10T10:04:22.980 INFO:tasks.workunit.client.0.smithi071.stdout:2/683: sync 2024-09-10T10:04:22.981 INFO:tasks.workunit.client.1.smithi107.stdout:7/595: mknod d0/d1b/d9b/cb5 0 2024-09-10T10:04:22.982 INFO:tasks.workunit.client.0.smithi071.stdout:0/620: read d11/d30/f50 [3263684,122152] 0 2024-09-10T10:04:22.983 INFO:tasks.workunit.client.0.smithi071.stdout:9/925: dread d0/db/d1b/d1d/d30/d54/d27/d6e/f92 [0,4194304] 0 2024-09-10T10:04:22.984 INFO:tasks.workunit.client.0.smithi071.stdout:0/621: fdatasync d11/d30/d52/f53 0 2024-09-10T10:04:22.986 INFO:tasks.workunit.client.0.smithi071.stdout:8/578: creat d5/df/d57/d82/fca x:0 0 0 2024-09-10T10:04:22.987 INFO:tasks.workunit.client.1.smithi107.stdout:9/651: creat d5/d7/d1d/d29/fdc x:0 0 0 2024-09-10T10:04:22.988 INFO:tasks.workunit.client.0.smithi071.stdout:8/579: fdatasync d5/df/d1e/f37 0 2024-09-10T10:04:22.990 INFO:tasks.workunit.client.0.smithi071.stdout:8/580: fsync d5/df/d1d/fa5 0 2024-09-10T10:04:22.992 INFO:tasks.workunit.client.0.smithi071.stdout:3/576: mknod d3/d1c/d3c/da1/d42/d4a/ccc 0 2024-09-10T10:04:22.992 INFO:tasks.workunit.client.1.smithi107.stdout:5/687: link de/d4a/d4e/c78 de/ced 0 2024-09-10T10:04:22.994 INFO:tasks.workunit.client.0.smithi071.stdout:2/684: dwrite d8/d38/d63/fc1 [0,4194304] 0 2024-09-10T10:04:22.994 INFO:tasks.workunit.client.1.smithi107.stdout:5/688: write de/f48 [4765798,109094] 0 2024-09-10T10:04:22.997 INFO:tasks.workunit.client.0.smithi071.stdout:3/577: symlink d3/d1c/d3e/lcd 0 2024-09-10T10:04:22.998 INFO:tasks.workunit.client.0.smithi071.stdout:8/581: symlink d5/df/d57/d82/lcb 0 2024-09-10T10:04:22.998 INFO:tasks.workunit.client.0.smithi071.stdout:3/578: write d3/d10/d24/dab/fbb [890953,79856] 0 2024-09-10T10:04:23.000 INFO:tasks.workunit.client.0.smithi071.stdout:8/582: chown d5/df/d1d/d86/f3b 15 1 2024-09-10T10:04:23.000 INFO:tasks.workunit.client.0.smithi071.stdout:3/579: chown d3/d1c/d3c/da1/d42/d4a/f95 13 1 2024-09-10T10:04:23.001 INFO:tasks.workunit.client.0.smithi071.stdout:2/685: creat d8/d87/d33/d41/d4d/d52/fe4 x:0 0 0 2024-09-10T10:04:23.001 INFO:tasks.workunit.client.0.smithi071.stdout:8/583: chown d5/d30/fc6 1229055 1 2024-09-10T10:04:23.004 INFO:tasks.workunit.client.0.smithi071.stdout:3/580: mkdir d3/d10/d24/d2b/dce 0 2024-09-10T10:04:23.004 INFO:tasks.workunit.client.1.smithi107.stdout:9/652: getdents d5/d7/d1d/d9b/dab/d57/d87/d37 0 2024-09-10T10:04:23.005 INFO:tasks.workunit.client.0.smithi071.stdout:8/584: rmdir d5/df/d95 39 2024-09-10T10:04:23.005 INFO:tasks.workunit.client.1.smithi107.stdout:8/586: link d5/d8/d66/d8b/d21/f41 d5/d8/d66/d8b/d18/fbe 0 2024-09-10T10:04:23.009 INFO:tasks.workunit.client.1.smithi107.stdout:9/653: mknod d5/d7/d1d/d9b/dab/d57/cdd 0 2024-09-10T10:04:23.009 INFO:tasks.workunit.client.0.smithi071.stdout:3/581: rename d3/d49/d2f/l46 to d3/d1c/d3c/da1/d42/d4a/lcf 0 2024-09-10T10:04:23.011 INFO:tasks.workunit.client.1.smithi107.stdout:1/784: dread d2/d6/d24/f50 [0,4194304] 0 2024-09-10T10:04:23.011 INFO:tasks.workunit.client.1.smithi107.stdout:6/693: rename d0/d3d/d14/d17/d49 to d0/d3d/d14/d17/d24/df3 0 2024-09-10T10:04:23.014 INFO:tasks.workunit.client.1.smithi107.stdout:9/654: creat d5/d7/d3c/fde x:0 0 0 2024-09-10T10:04:23.015 INFO:tasks.workunit.client.1.smithi107.stdout:5/689: getdents de/db3/db6 0 2024-09-10T10:04:23.016 INFO:tasks.workunit.client.1.smithi107.stdout:1/785: mknod d2/d6/d24/d81/cfc 0 2024-09-10T10:04:23.017 INFO:tasks.workunit.client.1.smithi107.stdout:1/786: stat d2/d12 0 2024-09-10T10:04:23.018 INFO:tasks.workunit.client.1.smithi107.stdout:1/787: chown d2/d6/dc6/dd4 737072189 1 2024-09-10T10:04:23.019 INFO:tasks.workunit.client.1.smithi107.stdout:1/788: chown d2/dcc/cd3 43 1 2024-09-10T10:04:23.020 INFO:tasks.workunit.client.1.smithi107.stdout:3/993: truncate dc/dd/d20/d23/d39/fa5 381367 0 2024-09-10T10:04:23.022 INFO:tasks.workunit.client.0.smithi071.stdout:8/585: write d5/df/d1d/d86/f29 [411403,5582] 0 2024-09-10T10:04:23.023 INFO:tasks.workunit.client.1.smithi107.stdout:9/655: dwrite d5/d7/d1d/d9b/dab/d57/d87/fc4 [0,4194304] 0 2024-09-10T10:04:23.024 INFO:tasks.workunit.client.1.smithi107.stdout:7/596: write d0/d1b/d4d/d69/d97/f4c [235499,77] 0 2024-09-10T10:04:23.024 INFO:tasks.workunit.client.0.smithi071.stdout:8/586: stat d5/df/d67/c7e 0 2024-09-10T10:04:23.024 INFO:tasks.workunit.client.0.smithi071.stdout:0/622: dwrite d11/d22/d31/f92 [0,4194304] 0 2024-09-10T10:04:23.025 INFO:tasks.workunit.client.0.smithi071.stdout:8/587: chown d5/fa0 1 1 2024-09-10T10:04:23.026 INFO:tasks.workunit.client.1.smithi107.stdout:5/690: chown de/d4a/d4e/d89/d99 57558 1 2024-09-10T10:04:23.026 INFO:tasks.workunit.client.0.smithi071.stdout:9/926: truncate d0/db/d1b/d1d/d4b/fb5 117735 0 2024-09-10T10:04:23.027 INFO:tasks.workunit.client.1.smithi107.stdout:5/691: stat de/d41/c49 0 2024-09-10T10:04:23.031 INFO:tasks.workunit.client.1.smithi107.stdout:4/819: rename d0/d40/d57/c108 to d0/d40/d6d/d8a/dbb/de1/c11a 0 2024-09-10T10:04:23.032 INFO:tasks.workunit.client.1.smithi107.stdout:2/698: dwrite d3/f49 [0,4194304] 0 2024-09-10T10:04:23.034 INFO:tasks.workunit.client.1.smithi107.stdout:4/820: fdatasync d0/d1f/d20/f50 0 2024-09-10T10:04:23.035 INFO:tasks.workunit.client.1.smithi107.stdout:4/821: chown d0/d1f/d90/fdb 41 1 2024-09-10T10:04:23.040 INFO:tasks.workunit.client.1.smithi107.stdout:5/692: dwrite de/f1f [0,4194304] 0 2024-09-10T10:04:23.041 INFO:tasks.workunit.client.0.smithi071.stdout:3/582: dread d3/f41 [0,4194304] 0 2024-09-10T10:04:23.045 INFO:tasks.workunit.client.0.smithi071.stdout:0/623: link d11/d30/d52/d79/l98 d11/ldd 0 2024-09-10T10:04:23.046 INFO:tasks.workunit.client.0.smithi071.stdout:3/583: write d3/d1c/d3c/da1/d5d/d9d/fa6 [873134,129486] 0 2024-09-10T10:04:23.046 INFO:tasks.workunit.client.0.smithi071.stdout:8/588: getdents d5/df/d1d/d86 0 2024-09-10T10:04:23.047 INFO:tasks.workunit.client.0.smithi071.stdout:8/589: chown d5/df/d67/l76 1360255446 1 2024-09-10T10:04:23.047 INFO:tasks.workunit.client.0.smithi071.stdout:0/624: write d11/d30/f9b [4334880,84641] 0 2024-09-10T10:04:23.049 INFO:tasks.workunit.client.0.smithi071.stdout:3/584: chown d3/d1c/d3c/da1/d3a/dbd/c50 3445178 1 2024-09-10T10:04:23.051 INFO:tasks.workunit.client.0.smithi071.stdout:3/585: chown d3/d1c/d3c/da1/fb7 32 1 2024-09-10T10:04:23.055 INFO:tasks.workunit.client.0.smithi071.stdout:0/625: dread d11/d1e/f74 [0,4194304] 0 2024-09-10T10:04:23.059 INFO:tasks.workunit.client.0.smithi071.stdout:0/626: mkdir d11/d22/dde 0 2024-09-10T10:04:23.060 INFO:tasks.workunit.client.1.smithi107.stdout:1/789: fdatasync d2/d6/d24/f50 0 2024-09-10T10:04:23.061 INFO:tasks.workunit.client.1.smithi107.stdout:1/790: read - d2/d6/d67/f77 zero size 2024-09-10T10:04:23.064 INFO:tasks.workunit.client.0.smithi071.stdout:0/627: unlink d11/d22/faf 0 2024-09-10T10:04:23.068 INFO:tasks.workunit.client.0.smithi071.stdout:0/628: mkdir d11/d22/d9a/ddf 0 2024-09-10T10:04:23.071 INFO:tasks.workunit.client.0.smithi071.stdout:0/629: mknod d11/d22/d9a/ce0 0 2024-09-10T10:04:23.072 INFO:tasks.workunit.client.0.smithi071.stdout:0/630: truncate d11/d22/d40/fd1 871884 0 2024-09-10T10:04:23.074 INFO:tasks.workunit.client.0.smithi071.stdout:0/631: creat d11/d30/d70/fe1 x:0 0 0 2024-09-10T10:04:23.076 INFO:tasks.workunit.client.0.smithi071.stdout:3/586: truncate d3/d1c/d3e/f97 160365 0 2024-09-10T10:04:23.085 INFO:tasks.workunit.client.0.smithi071.stdout:9/927: rename d0/db/d1b/d1d/d5b/lc4 to d0/db/d1b/d1d/d30/d54/d27/l11a 0 2024-09-10T10:04:23.088 INFO:tasks.workunit.client.1.smithi107.stdout:3/994: mkdir dc/dd/d42/de8/d14a 0 2024-09-10T10:04:23.089 INFO:tasks.workunit.client.0.smithi071.stdout:9/928: chown d0/db/d1b/d1d/f3a 4832 1 2024-09-10T10:04:23.089 INFO:tasks.workunit.client.0.smithi071.stdout:8/590: rename d5/d30/l4b to d5/df/d1d/d86/d90/lcc 0 2024-09-10T10:04:23.092 INFO:tasks.workunit.client.0.smithi071.stdout:8/591: write d5/d36/d49/fb8 [464855,41084] 0 2024-09-10T10:04:23.092 INFO:tasks.workunit.client.0.smithi071.stdout:3/587: dwrite d3/d1c/d3c/da1/d3a/dc0/fcb [0,4194304] 0 2024-09-10T10:04:23.097 INFO:tasks.workunit.client.1.smithi107.stdout:6/694: dwrite d0/d3d/d14/d21/f23 [4194304,4194304] 0 2024-09-10T10:04:23.098 INFO:tasks.workunit.client.0.smithi071.stdout:9/929: symlink d0/db/d1b/d1d/d4b/dad/l11b 0 2024-09-10T10:04:23.099 INFO:tasks.workunit.client.1.smithi107.stdout:6/695: write d0/d3d/d14/d21/fce [169223,122487] 0 2024-09-10T10:04:23.100 INFO:tasks.workunit.client.0.smithi071.stdout:3/588: rmdir d3/d1c/d3c/da1/d3a/dba/dbe 0 2024-09-10T10:04:23.101 INFO:tasks.workunit.client.1.smithi107.stdout:9/656: write d5/d7/d1d/d9b/dab/d57/d87/d37/f80 [9266041,115479] 0 2024-09-10T10:04:23.102 INFO:tasks.workunit.client.1.smithi107.stdout:9/657: stat d5/d7/d3c/ccd 0 2024-09-10T10:04:23.102 INFO:tasks.workunit.client.0.smithi071.stdout:8/592: dwrite d5/df/d57/d82/fca [0,4194304] 0 2024-09-10T10:04:23.103 INFO:tasks.workunit.client.0.smithi071.stdout:3/589: fdatasync d3/d1c/d3c/d66/fad 0 2024-09-10T10:04:23.105 INFO:tasks.workunit.client.1.smithi107.stdout:9/658: write d5/d7/d1d/d41/f48 [8244446,65654] 0 2024-09-10T10:04:23.105 INFO:tasks.workunit.client.0.smithi071.stdout:0/632: dread d11/d22/d31/f41 [0,4194304] 0 2024-09-10T10:04:23.108 INFO:tasks.workunit.client.0.smithi071.stdout:3/590: readlink d3/d1c/d3c/da1/d5d/d7a/l88 0 2024-09-10T10:04:23.110 INFO:tasks.workunit.client.0.smithi071.stdout:0/633: mkdir d11/d30/d70/de2 0 2024-09-10T10:04:23.111 INFO:tasks.workunit.client.0.smithi071.stdout:0/634: truncate d11/d22/d9a/fab 171250 0 2024-09-10T10:04:23.112 INFO:tasks.workunit.client.0.smithi071.stdout:8/593: mkdir d5/df/d1d/d86/d75/dcd 0 2024-09-10T10:04:23.112 INFO:tasks.workunit.client.1.smithi107.stdout:0/645: sync 2024-09-10T10:04:23.113 INFO:tasks.workunit.client.1.smithi107.stdout:9/659: dwrite d5/d7/d1d/d41/f48 [0,4194304] 0 2024-09-10T10:04:23.115 INFO:tasks.workunit.client.0.smithi071.stdout:3/591: symlink d3/d1c/d3c/da1/d5d/ld0 0 2024-09-10T10:04:23.117 INFO:tasks.workunit.client.0.smithi071.stdout:9/930: dread d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/d114/fdd [0,4194304] 0 2024-09-10T10:04:23.117 INFO:tasks.workunit.client.1.smithi107.stdout:8/587: rename d5/d8/d2a/d47/f9c to d5/d8/d66/d8b/d1a/d64/db9/fbf 0 2024-09-10T10:04:23.120 INFO:tasks.workunit.client.1.smithi107.stdout:2/699: mkdir d3/da/d66/d91/dea/df7 0 2024-09-10T10:04:23.123 INFO:tasks.workunit.client.0.smithi071.stdout:4/583: sync 2024-09-10T10:04:23.123 INFO:tasks.workunit.client.1.smithi107.stdout:5/693: rmdir de/d20/d2b/d4b/d5e/d9a 39 2024-09-10T10:04:23.125 INFO:tasks.workunit.client.0.smithi071.stdout:8/594: dwrite d5/d36/d49/fbf [0,4194304] 0 2024-09-10T10:04:23.127 INFO:tasks.workunit.client.0.smithi071.stdout:4/584: stat db/d15/d26/f3c 0 2024-09-10T10:04:23.128 INFO:tasks.workunit.client.0.smithi071.stdout:3/592: getdents d3 0 2024-09-10T10:04:23.129 INFO:tasks.workunit.client.0.smithi071.stdout:0/635: link d11/d22/f6f d11/d22/d40/fe3 0 2024-09-10T10:04:23.130 INFO:tasks.workunit.client.1.smithi107.stdout:3/995: unlink dc/dd/d42/d55/d58/ffa 0 2024-09-10T10:04:23.131 INFO:tasks.workunit.client.0.smithi071.stdout:3/593: write d3/d1c/f79 [1195625,103132] 0 2024-09-10T10:04:23.132 INFO:tasks.workunit.client.0.smithi071.stdout:8/595: truncate d5/df/d1e/d38/d9f/fb9 833393 0 2024-09-10T10:04:23.134 INFO:tasks.workunit.client.0.smithi071.stdout:0/636: creat d11/d30/d52/d79/fe4 x:0 0 0 2024-09-10T10:04:23.135 INFO:tasks.workunit.client.0.smithi071.stdout:3/594: fsync d3/d49/d2f/d7f/fa0 0 2024-09-10T10:04:23.135 INFO:tasks.workunit.client.0.smithi071.stdout:9/931: creat d0/db/d1b/db4/f11c x:0 0 0 2024-09-10T10:04:23.136 INFO:tasks.workunit.client.1.smithi107.stdout:6/696: creat d0/d3d/d14/d42/d88/ff4 x:0 0 0 2024-09-10T10:04:23.140 INFO:tasks.workunit.client.0.smithi071.stdout:4/585: dread db/d15/d26/f3c [0,4194304] 0 2024-09-10T10:04:23.141 INFO:tasks.workunit.client.0.smithi071.stdout:0/637: creat d11/d22/d9a/ddf/fe5 x:0 0 0 2024-09-10T10:04:23.143 INFO:tasks.workunit.client.0.smithi071.stdout:3/595: creat d3/d1c/d3c/da1/d5d/da5/fd1 x:0 0 0 2024-09-10T10:04:23.145 INFO:tasks.workunit.client.0.smithi071.stdout:4/586: write db/d15/d17/d4e/f5b [923050,61468] 0 2024-09-10T10:04:23.145 INFO:tasks.workunit.client.1.smithi107.stdout:8/588: truncate d5/d8/d66/d8b/d21/f3c 711156 0 2024-09-10T10:04:23.146 INFO:tasks.workunit.client.0.smithi071.stdout:0/638: fsync d11/d22/d40/f44 0 2024-09-10T10:04:23.147 INFO:tasks.workunit.client.1.smithi107.stdout:8/589: readlink d5/d8/d66/d8b/d1a/d75/l9e 0 2024-09-10T10:04:23.148 INFO:tasks.workunit.client.1.smithi107.stdout:8/590: chown d5/l49 4764038 1 2024-09-10T10:04:23.149 INFO:tasks.workunit.client.1.smithi107.stdout:8/591: write d5/d8/f13 [423844,96366] 0 2024-09-10T10:04:23.150 INFO:tasks.workunit.client.0.smithi071.stdout:0/639: dread - d11/d22/d9a/fa6 zero size 2024-09-10T10:04:23.152 INFO:tasks.workunit.client.0.smithi071.stdout:4/587: truncate db/d15/d4b/fb3 786767 0 2024-09-10T10:04:23.152 INFO:tasks.workunit.client.0.smithi071.stdout:8/596: dwrite d5/d30/fc6 [0,4194304] 0 2024-09-10T10:04:23.156 INFO:tasks.workunit.client.1.smithi107.stdout:1/791: dread d2/d12/d65/d6b/f74 [0,4194304] 0 2024-09-10T10:04:23.156 INFO:tasks.workunit.client.0.smithi071.stdout:0/640: mkdir d11/d30/d52/d79/de6 0 2024-09-10T10:04:23.158 INFO:tasks.workunit.client.1.smithi107.stdout:3/996: dwrite dc/dd/d45/d26/d41/d44/f2d [4194304,4194304] 0 2024-09-10T10:04:23.159 INFO:tasks.workunit.client.0.smithi071.stdout:8/597: symlink d5/df/d1d/d86/db7/lce 0 2024-09-10T10:04:23.160 INFO:tasks.workunit.client.1.smithi107.stdout:1/792: read - d2/d12/d94/fc9 zero size 2024-09-10T10:04:23.160 INFO:tasks.workunit.client.0.smithi071.stdout:3/596: dwrite d3/d1c/d3c/da1/d42/d4a/f54 [0,4194304] 0 2024-09-10T10:04:23.160 INFO:tasks.workunit.client.0.smithi071.stdout:4/588: rename db/c11 to db/d15/d17/d4e/d5a/cc1 0 2024-09-10T10:04:23.163 INFO:tasks.workunit.client.0.smithi071.stdout:0/641: symlink d11/d1e/le7 0 2024-09-10T10:04:23.163 INFO:tasks.workunit.client.0.smithi071.stdout:8/598: write d5/df/f5f [4052975,129055] 0 2024-09-10T10:04:23.166 INFO:tasks.workunit.client.1.smithi107.stdout:5/694: unlink de/d4a/d7e/db2/dbc/cc1 0 2024-09-10T10:04:23.167 INFO:tasks.workunit.client.1.smithi107.stdout:5/695: write f8 [5298867,98308] 0 2024-09-10T10:04:23.167 INFO:tasks.workunit.client.1.smithi107.stdout:8/592: unlink d5/d8/d2a/l69 0 2024-09-10T10:04:23.168 INFO:tasks.workunit.client.1.smithi107.stdout:6/697: mkdir d0/d3d/d14/d17/d24/dc5/df5 0 2024-09-10T10:04:23.171 INFO:tasks.workunit.client.1.smithi107.stdout:6/698: truncate d0/d3d/d14/d42/fc8 53188 0 2024-09-10T10:04:23.171 INFO:tasks.workunit.client.1.smithi107.stdout:4/822: getdents d0/d40/d57/d76/d77/da1 0 2024-09-10T10:04:23.172 INFO:tasks.workunit.client.0.smithi071.stdout:0/642: rename d11/d30/fad to d11/d22/d9a/fe8 0 2024-09-10T10:04:23.174 INFO:tasks.workunit.client.0.smithi071.stdout:8/599: dread d5/f19 [0,4194304] 0 2024-09-10T10:04:23.177 INFO:tasks.workunit.client.0.smithi071.stdout:0/643: readlink d11/l46 0 2024-09-10T10:04:23.178 INFO:tasks.workunit.client.0.smithi071.stdout:4/589: write db/d15/d26/d43/d4d/f4a [60397,47831] 0 2024-09-10T10:04:23.182 INFO:tasks.workunit.client.0.smithi071.stdout:0/644: rename d11/d22/d40/lb6 to d11/d30/d52/d79/de6/le9 0 2024-09-10T10:04:23.183 INFO:tasks.workunit.client.0.smithi071.stdout:4/590: mkdir db/d15/d17/d4e/dc0/dc2 0 2024-09-10T10:04:23.184 INFO:tasks.workunit.client.0.smithi071.stdout:4/591: chown db/d15/d26/d43/d4d/f3b 0 1 2024-09-10T10:04:23.185 INFO:tasks.workunit.client.0.smithi071.stdout:0/645: mknod d11/d22/d9a/cea 0 2024-09-10T10:04:23.186 INFO:tasks.workunit.client.0.smithi071.stdout:4/592: chown db/d15/d26/d43/f66 853099 1 2024-09-10T10:04:23.186 INFO:tasks.workunit.client.0.smithi071.stdout:0/646: fsync d11/d30/d52/f7f 0 2024-09-10T10:04:23.188 INFO:tasks.workunit.client.0.smithi071.stdout:0/647: rmdir d11/d22/d31/d72 39 2024-09-10T10:04:23.189 INFO:tasks.workunit.client.0.smithi071.stdout:0/648: fsync d11/d30/d52/d5f/f9e 0 2024-09-10T10:04:23.189 INFO:tasks.workunit.client.0.smithi071.stdout:4/593: rmdir db/d15/d26/d43/d4d/d9f/da6 39 2024-09-10T10:04:23.192 INFO:tasks.workunit.client.0.smithi071.stdout:0/649: dread d11/d22/d40/fd1 [0,4194304] 0 2024-09-10T10:04:23.194 INFO:tasks.workunit.client.0.smithi071.stdout:4/594: truncate db/d15/d4b/f5c 3117638 0 2024-09-10T10:04:23.195 INFO:tasks.workunit.client.0.smithi071.stdout:0/650: mknod d11/d22/d9a/ceb 0 2024-09-10T10:04:23.202 INFO:tasks.workunit.client.1.smithi107.stdout:5/696: dread de/d20/d2b/f3e [0,4194304] 0 2024-09-10T10:04:23.202 INFO:tasks.workunit.client.0.smithi071.stdout:0/651: dwrite d11/d30/d52/d79/fe4 [0,4194304] 0 2024-09-10T10:04:23.203 INFO:tasks.workunit.client.1.smithi107.stdout:5/697: read - de/d4a/d4e/d89/d99/fd9 zero size 2024-09-10T10:04:23.204 INFO:tasks.workunit.client.0.smithi071.stdout:0/652: write d11/d30/f45 [3456179,20929] 0 2024-09-10T10:04:23.204 INFO:tasks.workunit.client.1.smithi107.stdout:1/793: dread d2/d35/f47 [0,4194304] 0 2024-09-10T10:04:23.205 INFO:tasks.workunit.client.1.smithi107.stdout:5/698: chown de/d4a/d7e/d79/f7d 0 1 2024-09-10T10:04:23.210 INFO:tasks.workunit.client.0.smithi071.stdout:0/653: link d11/d30/d70/faa d11/d22/d9a/ddf/fec 0 2024-09-10T10:04:23.210 INFO:tasks.workunit.client.1.smithi107.stdout:1/794: dwrite d2/d6/fc [0,4194304] 0 2024-09-10T10:04:23.214 INFO:tasks.workunit.client.0.smithi071.stdout:0/654: unlink d11/d30/d52/f7f 0 2024-09-10T10:04:23.217 INFO:tasks.workunit.client.1.smithi107.stdout:0/646: getdents d6/d8/d3e 0 2024-09-10T10:04:23.218 INFO:tasks.workunit.client.0.smithi071.stdout:0/655: rename d11/d22/d9a/ca9 to d11/d22/d40/ced 0 2024-09-10T10:04:23.221 INFO:tasks.workunit.client.0.smithi071.stdout:4/595: dread db/d15/d26/fb9 [0,4194304] 0 2024-09-10T10:04:23.222 INFO:tasks.workunit.client.0.smithi071.stdout:0/656: creat d11/fee x:0 0 0 2024-09-10T10:04:23.224 INFO:tasks.workunit.client.0.smithi071.stdout:4/596: mknod db/cc3 0 2024-09-10T10:04:23.224 INFO:tasks.workunit.client.0.smithi071.stdout:0/657: fsync d11/d30/d52/d79/f7a 0 2024-09-10T10:04:23.225 INFO:tasks.workunit.client.1.smithi107.stdout:3/997: unlink dc/dd/c1b 0 2024-09-10T10:04:23.226 INFO:tasks.workunit.client.0.smithi071.stdout:0/658: write d11/d30/d52/d79/fbe [102244,111868] 0 2024-09-10T10:04:23.228 INFO:tasks.workunit.client.1.smithi107.stdout:9/660: dwrite d5/d1e/f88 [0,4194304] 0 2024-09-10T10:04:23.229 INFO:tasks.workunit.client.1.smithi107.stdout:5/699: rmdir de/d20/d3d 39 2024-09-10T10:04:23.231 INFO:tasks.workunit.client.0.smithi071.stdout:0/659: rename d11/d22/d31/l3e to d11/d30/d52/d79/de6/lef 0 2024-09-10T10:04:23.233 INFO:tasks.workunit.client.0.smithi071.stdout:0/660: fsync d11/d22/d9a/fbf 0 2024-09-10T10:04:23.233 INFO:tasks.workunit.client.1.smithi107.stdout:4/823: mkdir d0/d6b/d11b 0 2024-09-10T10:04:23.234 INFO:tasks.workunit.client.1.smithi107.stdout:4/824: write d0/d40/d57/d76/d77/da1/f4b [561117,121405] 0 2024-09-10T10:04:23.236 INFO:tasks.workunit.client.0.smithi071.stdout:4/597: write db/d15/f94 [331304,127082] 0 2024-09-10T10:04:23.237 INFO:tasks.workunit.client.1.smithi107.stdout:3/998: mkdir dc/dd/d42/de8/d14b 0 2024-09-10T10:04:23.237 INFO:tasks.workunit.client.0.smithi071.stdout:0/661: read d11/d1e/f2d [980113,104556] 0 2024-09-10T10:04:23.238 INFO:tasks.workunit.client.1.smithi107.stdout:5/700: readlink de/d20/d2b/l8f 0 2024-09-10T10:04:23.241 INFO:tasks.workunit.client.1.smithi107.stdout:7/597: creat d0/d8/fb6 x:0 0 0 2024-09-10T10:04:23.242 INFO:tasks.workunit.client.0.smithi071.stdout:0/662: creat d11/d30/d52/ff0 x:0 0 0 2024-09-10T10:04:23.243 INFO:tasks.workunit.client.1.smithi107.stdout:0/647: symlink d6/d8e/lca 0 2024-09-10T10:04:23.243 INFO:tasks.workunit.client.0.smithi071.stdout:9/932: truncate d0/db/d1b/f78 3850883 0 2024-09-10T10:04:23.245 INFO:tasks.workunit.client.0.smithi071.stdout:0/663: creat d11/d22/d31/d72/ff1 x:0 0 0 2024-09-10T10:04:23.248 INFO:tasks.workunit.client.0.smithi071.stdout:0/664: mkdir d11/d22/dde/df2 0 2024-09-10T10:04:23.248 INFO:tasks.workunit.client.0.smithi071.stdout:9/933: creat d0/db/d1b/d1d/d4b/db9/f11d x:0 0 0 2024-09-10T10:04:23.249 INFO:tasks.workunit.client.0.smithi071.stdout:0/665: chown d11/d22/d31/f41 4893991 1 2024-09-10T10:04:23.251 INFO:tasks.workunit.client.0.smithi071.stdout:0/666: mkdir d11/d22/d31/d72/df3 0 2024-09-10T10:04:23.253 INFO:tasks.workunit.client.0.smithi071.stdout:0/667: symlink d11/d30/d52/d5f/lf4 0 2024-09-10T10:04:23.253 INFO:tasks.workunit.client.0.smithi071.stdout:9/934: truncate d0/db/d1b/d1d/d4b/db9/dba/fd7 1021670 0 2024-09-10T10:04:23.256 INFO:tasks.workunit.client.0.smithi071.stdout:9/935: symlink d0/db/d20/d112/l11e 0 2024-09-10T10:04:23.257 INFO:tasks.workunit.client.1.smithi107.stdout:4/825: dread d0/d1f/d20/f30 [0,4194304] 0 2024-09-10T10:04:23.257 INFO:tasks.workunit.client.0.smithi071.stdout:0/668: unlink d11/d22/d31/d72/l9f 0 2024-09-10T10:04:23.258 INFO:tasks.workunit.client.0.smithi071.stdout:0/669: fdatasync d11/d30/d52/d5f/fd6 0 2024-09-10T10:04:23.258 INFO:tasks.workunit.client.1.smithi107.stdout:0/648: rmdir d6/d8/d2f/d2e/d7b/d89 39 2024-09-10T10:04:23.259 INFO:tasks.workunit.client.0.smithi071.stdout:0/670: write d11/d22/d40/fb8 [1521661,101431] 0 2024-09-10T10:04:23.261 INFO:tasks.workunit.client.1.smithi107.stdout:9/661: getdents d5/d7/d1d/d3b 0 2024-09-10T10:04:23.263 INFO:tasks.workunit.client.1.smithi107.stdout:4/826: fsync d0/d40/d57/fce 0 2024-09-10T10:04:23.264 INFO:tasks.workunit.client.0.smithi071.stdout:0/671: symlink d11/d30/d52/d79/ddc/lf5 0 2024-09-10T10:04:23.265 INFO:tasks.workunit.client.0.smithi071.stdout:0/672: chown d11/d30/d52/d79/lbb 1 1 2024-09-10T10:04:23.265 INFO:tasks.workunit.client.0.smithi071.stdout:9/936: dread d0/db/d1b/d1d/d30/d54/f94 [0,4194304] 0 2024-09-10T10:04:23.266 INFO:tasks.workunit.client.1.smithi107.stdout:8/593: creat d5/d8/d2a/d35/d85/fc0 x:0 0 0 2024-09-10T10:04:23.267 INFO:tasks.workunit.client.1.smithi107.stdout:4/827: stat d0/d1f/d90/dfb/c10f 0 2024-09-10T10:04:23.268 INFO:tasks.workunit.client.0.smithi071.stdout:0/673: mkdir d11/d22/d40/df6 0 2024-09-10T10:04:23.268 INFO:tasks.workunit.client.0.smithi071.stdout:0/674: chown la 37430140 1 2024-09-10T10:04:23.269 INFO:tasks.workunit.client.0.smithi071.stdout:0/675: dread - d11/d22/d31/fc2 zero size 2024-09-10T10:04:23.269 INFO:tasks.workunit.client.1.smithi107.stdout:3/999: dread dc/dd/d45/d26/d59/f7a [0,4194304] 0 2024-09-10T10:04:23.269 INFO:tasks.workunit.client.1.smithi107.stdout:6/699: rename d0/d3d/d14/f58 to d0/d3d/d14/d17/d24/ff6 0 2024-09-10T10:04:23.270 INFO:tasks.workunit.client.0.smithi071.stdout:9/937: write d0/db/d20/d21/f113 [889669,57146] 0 2024-09-10T10:04:23.272 INFO:tasks.workunit.client.0.smithi071.stdout:0/676: symlink d11/lf7 0 2024-09-10T10:04:23.273 INFO:tasks.workunit.client.0.smithi071.stdout:0/677: fsync d11/d30/f45 0 2024-09-10T10:04:23.275 INFO:tasks.workunit.client.1.smithi107.stdout:8/594: link d5/d8/d66/d8b/d1a/d75/fac d5/d8/d66/fc1 0 2024-09-10T10:04:23.277 INFO:tasks.workunit.client.1.smithi107.stdout:0/649: dread d6/d8/d3e/f50 [0,4194304] 0 2024-09-10T10:04:23.278 INFO:tasks.workunit.client.1.smithi107.stdout:4/828: getdents d0/d40/d57/d76/d77/da9 0 2024-09-10T10:04:23.279 INFO:tasks.workunit.client.1.smithi107.stdout:4/829: chown d0/f10 6 1 2024-09-10T10:04:23.280 INFO:tasks.workunit.client.1.smithi107.stdout:4/830: readlink d0/d1f/d20/d80/l92 0 2024-09-10T10:04:23.281 INFO:tasks.workunit.client.1.smithi107.stdout:0/650: creat d6/d8/d2f/d35/d3c/d58/d86/fcb x:0 0 0 2024-09-10T10:04:23.281 INFO:tasks.workunit.client.1.smithi107.stdout:8/595: dread d5/d8/d2a/d35/d70/f95 [0,4194304] 0 2024-09-10T10:04:23.283 INFO:tasks.workunit.client.0.smithi071.stdout:9/938: rename d0/db/d1b/d1d/d5b/d9f/fc3 to d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/f11f 0 2024-09-10T10:04:23.283 INFO:tasks.workunit.client.1.smithi107.stdout:8/596: chown d5/d8/d66/d8b/fba 1 1 2024-09-10T10:04:23.284 INFO:tasks.workunit.client.0.smithi071.stdout:9/939: chown d0/db/d20/dd8/lf8 203398059 1 2024-09-10T10:04:23.284 INFO:tasks.workunit.client.1.smithi107.stdout:4/831: truncate d0/d40/d57/d76/d77/da1/f5b 4322111 0 2024-09-10T10:04:23.285 INFO:tasks.workunit.client.0.smithi071.stdout:9/940: stat d0/db/d20/d21/fa5 0 2024-09-10T10:04:23.286 INFO:tasks.workunit.client.1.smithi107.stdout:4/832: readlink d0/d40/d75/l10c 0 2024-09-10T10:04:23.288 INFO:tasks.workunit.client.0.smithi071.stdout:9/941: symlink d0/l120 0 2024-09-10T10:04:23.291 INFO:tasks.workunit.client.1.smithi107.stdout:4/833: mknod d0/d1f/d20/d80/c11c 0 2024-09-10T10:04:23.293 INFO:tasks.workunit.client.1.smithi107.stdout:1/795: truncate d2/f6a 813750 0 2024-09-10T10:04:23.294 INFO:tasks.workunit.client.0.smithi071.stdout:9/942: read d0/db/d1b/d1d/d5b/d60/f98 [1843266,126019] 0 2024-09-10T10:04:23.295 INFO:tasks.workunit.client.1.smithi107.stdout:8/597: dread d5/d42/f65 [0,4194304] 0 2024-09-10T10:04:23.298 INFO:tasks.workunit.client.0.smithi071.stdout:9/943: dread - d0/db/fac zero size 2024-09-10T10:04:23.301 INFO:tasks.workunit.client.1.smithi107.stdout:4/834: link d0/d1f/d20/fcd d0/d6b/f11d 0 2024-09-10T10:04:23.303 INFO:tasks.workunit.client.0.smithi071.stdout:9/944: rename d0/db/d1b/d1d/d30/dab/c9e to d0/db/d20/d112/c121 0 2024-09-10T10:04:23.303 INFO:tasks.workunit.client.1.smithi107.stdout:4/835: chown d0/d40/d6d/fd7 486420134 1 2024-09-10T10:04:23.306 INFO:tasks.workunit.client.1.smithi107.stdout:5/701: dwrite de/d20/d2b/d4b/f71 [0,4194304] 0 2024-09-10T10:04:23.307 INFO:tasks.workunit.client.1.smithi107.stdout:9/662: write d5/f55 [752528,72770] 0 2024-09-10T10:04:23.311 INFO:tasks.workunit.client.0.smithi071.stdout:6/569: sync 2024-09-10T10:04:23.311 INFO:tasks.workunit.client.0.smithi071.stdout:7/756: sync 2024-09-10T10:04:23.311 INFO:tasks.workunit.client.0.smithi071.stdout:5/521: sync 2024-09-10T10:04:23.311 INFO:tasks.workunit.client.0.smithi071.stdout:1/683: sync 2024-09-10T10:04:23.313 INFO:tasks.workunit.client.1.smithi107.stdout:7/598: dwrite d0/d8/d56/f9e [0,4194304] 0 2024-09-10T10:04:23.313 INFO:tasks.workunit.client.0.smithi071.stdout:5/522: chown dc/df/d3e/d5a/d80 312 1 2024-09-10T10:04:23.315 INFO:tasks.workunit.client.0.smithi071.stdout:5/523: fsync dc/df/d17/d8d/fb0 0 2024-09-10T10:04:23.317 INFO:tasks.workunit.client.0.smithi071.stdout:7/757: mkdir d9/d11/d106 0 2024-09-10T10:04:23.317 INFO:tasks.workunit.client.0.smithi071.stdout:5/524: write dc/df/d17/d8d/fb0 [196064,114120] 0 2024-09-10T10:04:23.318 INFO:tasks.workunit.client.0.smithi071.stdout:7/758: dread - d9/d15/d1f/d98/fd1 zero size 2024-09-10T10:04:23.327 INFO:tasks.workunit.client.0.smithi071.stdout:5/525: dwrite dc/df/d17/d22/f7d [0,4194304] 0 2024-09-10T10:04:23.329 INFO:tasks.workunit.client.0.smithi071.stdout:5/526: symlink dc/d53/lb5 0 2024-09-10T10:04:23.333 INFO:tasks.workunit.client.0.smithi071.stdout:5/527: mkdir dc/df/d29/d48/dae/db6 0 2024-09-10T10:04:23.334 INFO:tasks.workunit.client.0.smithi071.stdout:7/759: write d9/d2c/f93 [897479,91728] 0 2024-09-10T10:04:23.337 INFO:tasks.workunit.client.0.smithi071.stdout:5/528: getdents dc/df/d3e/d5a/d80/d8a 0 2024-09-10T10:04:23.338 INFO:tasks.workunit.client.0.smithi071.stdout:7/760: truncate d9/d15/d40/d80/ddd/de2/de3/fcc 532389 0 2024-09-10T10:04:23.341 INFO:tasks.workunit.client.0.smithi071.stdout:7/761: symlink d9/d15/d1f/d74/da1/l107 0 2024-09-10T10:04:23.343 INFO:tasks.workunit.client.0.smithi071.stdout:7/762: mkdir d9/d15/d1f/d74/da1/dcf/dfe/d108 0 2024-09-10T10:04:23.345 INFO:tasks.workunit.client.0.smithi071.stdout:7/763: truncate d9/d76/f96 781486 0 2024-09-10T10:04:23.347 INFO:tasks.workunit.client.0.smithi071.stdout:7/764: mkdir d9/d15/d40/d80/ddd/de2/d109 0 2024-09-10T10:04:23.350 INFO:tasks.workunit.client.0.smithi071.stdout:7/765: creat d9/d15/d40/d80/ddd/de2/de3/d105/f10a x:0 0 0 2024-09-10T10:04:23.354 INFO:tasks.workunit.client.0.smithi071.stdout:5/529: dread dc/f13 [0,4194304] 0 2024-09-10T10:04:23.356 INFO:tasks.workunit.client.0.smithi071.stdout:7/766: dwrite d9/d15/d40/d80/ddd/de2/de3/fa0 [0,4194304] 0 2024-09-10T10:04:23.362 INFO:tasks.workunit.client.0.smithi071.stdout:7/767: fdatasync d9/d1a/f52 0 2024-09-10T10:04:23.369 INFO:tasks.workunit.client.0.smithi071.stdout:7/768: link d9/d15/d1f/d74/d9b/fb1 d9/f10b 0 2024-09-10T10:04:23.371 INFO:tasks.workunit.client.0.smithi071.stdout:7/769: write d9/d11/f59 [1075384,55786] 0 2024-09-10T10:04:23.417 INFO:tasks.workunit.client.1.smithi107.stdout:2/700: sync 2024-09-10T10:04:23.418 INFO:tasks.workunit.client.1.smithi107.stdout:2/701: chown d3/da/d1e/d5f/f34 1679050 1 2024-09-10T10:04:23.422 INFO:tasks.workunit.client.1.smithi107.stdout:2/702: dwrite d3/da/fc6 [0,4194304] 0 2024-09-10T10:04:23.424 INFO:tasks.workunit.client.1.smithi107.stdout:2/703: write d3/da/df/d20/d36/d39/f4e [4840559,52067] 0 2024-09-10T10:04:23.436 INFO:tasks.workunit.client.0.smithi071.stdout:1/684: rename d1/d21/d2f/d81/de4/f8c to d1/d3f/d58/ff0 0 2024-09-10T10:04:23.438 INFO:tasks.workunit.client.1.smithi107.stdout:0/651: truncate d6/d8/d2f/d35/d3c/d58/f73 669831 0 2024-09-10T10:04:23.440 INFO:tasks.workunit.client.1.smithi107.stdout:1/796: write d2/d12/d7e/faf [870220,10665] 0 2024-09-10T10:04:23.440 INFO:tasks.workunit.client.0.smithi071.stdout:5/530: rename dc/d53/db2/f6f to dc/d4a/fb7 0 2024-09-10T10:04:23.444 INFO:tasks.workunit.client.1.smithi107.stdout:6/700: sync 2024-09-10T10:04:23.444 INFO:tasks.workunit.client.1.smithi107.stdout:4/836: rename d0/d40/d57/d76/d77/da1/d59/l8f to d0/d40/d57/d76/d77/da1/d59/l11e 0 2024-09-10T10:04:23.445 INFO:tasks.workunit.client.0.smithi071.stdout:7/770: rename d9/d2c/d85 to d9/d15/d1f/d74/da1/dcf/dfe/d108/d10c 0 2024-09-10T10:04:23.447 INFO:tasks.workunit.client.0.smithi071.stdout:5/531: symlink dc/d53/lb8 0 2024-09-10T10:04:23.448 INFO:tasks.workunit.client.1.smithi107.stdout:4/837: write d0/d6b/f96 [4382855,13183] 0 2024-09-10T10:04:23.448 INFO:tasks.workunit.client.1.smithi107.stdout:8/598: dwrite d5/d8/d66/d8b/d18/d4f/f5c [0,4194304] 0 2024-09-10T10:04:23.449 INFO:tasks.workunit.client.0.smithi071.stdout:9/945: truncate d0/f87 3914188 0 2024-09-10T10:04:23.451 INFO:tasks.workunit.client.0.smithi071.stdout:5/532: rmdir dc/df/d17/d22/d87 39 2024-09-10T10:04:23.456 INFO:tasks.workunit.client.0.smithi071.stdout:5/533: creat dc/df/d3e/fb9 x:0 0 0 2024-09-10T10:04:23.457 INFO:tasks.workunit.client.0.smithi071.stdout:9/946: dwrite d0/db/d1b/d1d/d30/d54/f1a [4194304,4194304] 0 2024-09-10T10:04:23.461 INFO:tasks.workunit.client.1.smithi107.stdout:5/702: dwrite de/db3/fbf [0,4194304] 0 2024-09-10T10:04:23.461 INFO:tasks.workunit.client.1.smithi107.stdout:7/599: dwrite d0/d20/f44 [0,4194304] 0 2024-09-10T10:04:23.461 INFO:tasks.workunit.client.0.smithi071.stdout:7/771: dread d9/d1a/f30 [0,4194304] 0 2024-09-10T10:04:23.464 INFO:tasks.workunit.client.0.smithi071.stdout:1/685: mkdir d1/d21/d2f/d30/d75/d97/df1 0 2024-09-10T10:04:23.465 INFO:tasks.workunit.client.0.smithi071.stdout:5/534: dwrite dc/df/f14 [0,4194304] 0 2024-09-10T10:04:23.467 INFO:tasks.workunit.client.1.smithi107.stdout:6/701: creat d0/d3d/d14/d21/ff7 x:0 0 0 2024-09-10T10:04:23.467 INFO:tasks.workunit.client.1.smithi107.stdout:8/599: dwrite d5/d8/d66/d8b/d1a/f1f [0,4194304] 0 2024-09-10T10:04:23.467 INFO:tasks.workunit.client.1.smithi107.stdout:2/704: symlink d3/da/d1e/d5f/d54/dc2/lf8 0 2024-09-10T10:04:23.469 INFO:tasks.workunit.client.0.smithi071.stdout:7/772: mkdir d9/d2c/d49/d10d 0 2024-09-10T10:04:23.472 INFO:tasks.workunit.client.1.smithi107.stdout:0/652: symlink d6/d8/d2f/d2e/d7b/lcc 0 2024-09-10T10:04:23.472 INFO:tasks.workunit.client.1.smithi107.stdout:2/705: rename d3/da/d1e/d5f to d3/da/d1e/d5f/df1/df9 22 2024-09-10T10:04:23.473 INFO:tasks.workunit.client.0.smithi071.stdout:1/686: chown d1/l1c 54 1 2024-09-10T10:04:23.475 INFO:tasks.workunit.client.1.smithi107.stdout:2/706: write d3/da/df/d20/fdd [450223,90821] 0 2024-09-10T10:04:23.477 INFO:tasks.workunit.client.0.smithi071.stdout:9/947: mkdir d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/d114/dda/d122 0 2024-09-10T10:04:23.477 INFO:tasks.workunit.client.1.smithi107.stdout:9/663: dwrite d5/d7/d1d/d41/f71 [0,4194304] 0 2024-09-10T10:04:23.478 INFO:tasks.workunit.client.0.smithi071.stdout:1/687: fdatasync d1/d3f/d58/fe5 0 2024-09-10T10:04:23.481 INFO:tasks.workunit.client.0.smithi071.stdout:9/948: truncate d0/f42 716369 0 2024-09-10T10:04:23.482 INFO:tasks.workunit.client.1.smithi107.stdout:9/664: write d5/d7/d1d/d41/d83/d9a/f65 [1178248,120150] 0 2024-09-10T10:04:23.482 INFO:tasks.workunit.client.0.smithi071.stdout:5/535: symlink dc/d53/lba 0 2024-09-10T10:04:23.484 INFO:tasks.workunit.client.1.smithi107.stdout:1/797: dread d2/d12/d5a/f5d [0,4194304] 0 2024-09-10T10:04:23.486 INFO:tasks.workunit.client.1.smithi107.stdout:7/600: symlink d0/d1b/d9d/lb7 0 2024-09-10T10:04:23.487 INFO:tasks.workunit.client.0.smithi071.stdout:9/949: creat d0/db/d1b/d1d/d4b/db9/dba/f123 x:0 0 0 2024-09-10T10:04:23.490 INFO:tasks.workunit.client.1.smithi107.stdout:8/600: symlink d5/d42/lc2 0 2024-09-10T10:04:23.490 INFO:tasks.workunit.client.1.smithi107.stdout:0/653: dwrite d6/d8/f15 [0,4194304] 0 2024-09-10T10:04:23.491 INFO:tasks.workunit.client.0.smithi071.stdout:1/688: link d1/d35/fa8 d1/d35/dea/ff2 0 2024-09-10T10:04:23.493 INFO:tasks.workunit.client.1.smithi107.stdout:1/798: chown d2/d12/d65/d6b/f2e 410 1 2024-09-10T10:04:23.495 INFO:tasks.workunit.client.1.smithi107.stdout:9/665: write d5/d7/d3c/fac [2625496,37887] 0 2024-09-10T10:04:23.497 INFO:tasks.workunit.client.0.smithi071.stdout:2/686: sync 2024-09-10T10:04:23.499 INFO:tasks.workunit.client.1.smithi107.stdout:9/666: chown d5/d7/d1d/d29/db4/dbd/dda 30 1 2024-09-10T10:04:23.500 INFO:tasks.workunit.client.0.smithi071.stdout:9/950: mkdir d0/db/d1b/d1d/d30/d54/df7/d124 0 2024-09-10T10:04:23.501 INFO:tasks.workunit.client.0.smithi071.stdout:1/689: dwrite d1/d21/d2f/d30/f7d [0,4194304] 0 2024-09-10T10:04:23.501 INFO:tasks.workunit.client.0.smithi071.stdout:5/536: getdents dc/df/d29/d48 0 2024-09-10T10:04:23.504 INFO:tasks.workunit.client.0.smithi071.stdout:5/537: read - dc/d4a/fa5 zero size 2024-09-10T10:04:23.504 INFO:tasks.workunit.client.0.smithi071.stdout:1/690: write d1/d21/f61 [1500662,81175] 0 2024-09-10T10:04:23.506 INFO:tasks.workunit.client.0.smithi071.stdout:9/951: creat d0/db/d1b/db4/f125 x:0 0 0 2024-09-10T10:04:23.507 INFO:tasks.workunit.client.0.smithi071.stdout:2/687: truncate d8/d87/d33/d41/d4d/d5e/f8a 873533 0 2024-09-10T10:04:23.508 INFO:tasks.workunit.client.1.smithi107.stdout:7/601: symlink d0/lb8 0 2024-09-10T10:04:23.509 INFO:tasks.workunit.client.0.smithi071.stdout:5/538: mkdir dc/d4a/dbb 0 2024-09-10T10:04:23.509 INFO:tasks.workunit.client.1.smithi107.stdout:4/838: link d0/d1f/d20/d47/d8c/dfe/dff/c117 d0/d1f/d20/d47/c11f 0 2024-09-10T10:04:23.511 INFO:tasks.workunit.client.1.smithi107.stdout:9/667: dwrite d5/d7/d1d/d9b/dab/fd0 [0,4194304] 0 2024-09-10T10:04:23.515 INFO:tasks.workunit.client.0.smithi071.stdout:7/773: dread d9/d76/f42 [0,4194304] 0 2024-09-10T10:04:23.515 INFO:tasks.workunit.client.0.smithi071.stdout:2/688: dread d8/d38/d47/fb9 [0,4194304] 0 2024-09-10T10:04:23.516 INFO:tasks.workunit.client.1.smithi107.stdout:1/799: dread d2/d12/d5a/f62 [0,4194304] 0 2024-09-10T10:04:23.516 INFO:tasks.workunit.client.1.smithi107.stdout:0/654: mknod d6/d8/d2f/d2e/d32/d85/ccd 0 2024-09-10T10:04:23.518 INFO:tasks.workunit.client.1.smithi107.stdout:7/602: write d0/d20/d35/faa [159320,53448] 0 2024-09-10T10:04:23.519 INFO:tasks.workunit.client.0.smithi071.stdout:2/689: mknod d8/d87/d33/dde/ce5 0 2024-09-10T10:04:23.520 INFO:tasks.workunit.client.0.smithi071.stdout:2/690: write d8/d38/fa0 [1450741,94880] 0 2024-09-10T10:04:23.521 INFO:tasks.workunit.client.0.smithi071.stdout:7/774: truncate f7 2484868 0 2024-09-10T10:04:23.523 INFO:tasks.workunit.client.0.smithi071.stdout:2/691: symlink d8/d38/d47/le6 0 2024-09-10T10:04:23.524 INFO:tasks.workunit.client.1.smithi107.stdout:8/601: creat d5/d8/d66/d8b/d18/fc3 x:0 0 0 2024-09-10T10:04:23.525 INFO:tasks.workunit.client.0.smithi071.stdout:2/692: chown d8/d38/d47/d59/d65/f79 1005570756 1 2024-09-10T10:04:23.525 INFO:tasks.workunit.client.0.smithi071.stdout:7/775: symlink d9/d11/dd2/l10e 0 2024-09-10T10:04:23.525 INFO:tasks.workunit.client.1.smithi107.stdout:9/668: truncate d5/d7/d3c/fde 206673 0 2024-09-10T10:04:23.526 INFO:tasks.workunit.client.0.smithi071.stdout:2/693: mkdir d8/db6/de7 0 2024-09-10T10:04:23.528 INFO:tasks.workunit.client.0.smithi071.stdout:7/776: mkdir d9/d15/d1f/d74/d10f 0 2024-09-10T10:04:23.530 INFO:tasks.workunit.client.0.smithi071.stdout:2/694: creat d8/d24/d7f/fe8 x:0 0 0 2024-09-10T10:04:23.531 INFO:tasks.workunit.client.0.smithi071.stdout:7/777: write d9/d15/d40/f95 [1714012,71420] 0 2024-09-10T10:04:23.532 INFO:tasks.workunit.client.1.smithi107.stdout:1/800: dwrite d2/d35/d7b/d8b/fa2 [0,4194304] 0 2024-09-10T10:04:23.532 INFO:tasks.workunit.client.1.smithi107.stdout:4/839: symlink d0/d40/d57/d76/d77/da9/l120 0 2024-09-10T10:04:23.532 INFO:tasks.workunit.client.1.smithi107.stdout:9/669: rmdir d5/d7 39 2024-09-10T10:04:23.533 INFO:tasks.workunit.client.0.smithi071.stdout:7/778: read - d9/d15/d1f/d74/fac zero size 2024-09-10T10:04:23.534 INFO:tasks.workunit.client.1.smithi107.stdout:2/707: dread d3/da/df/f15 [0,4194304] 0 2024-09-10T10:04:23.535 INFO:tasks.workunit.client.0.smithi071.stdout:7/779: dread d9/d1a/f4d [0,4194304] 0 2024-09-10T10:04:23.537 INFO:tasks.workunit.client.1.smithi107.stdout:1/801: creat d2/da8/ffd x:0 0 0 2024-09-10T10:04:23.538 INFO:tasks.workunit.client.1.smithi107.stdout:5/703: dread de/d4a/d4e/f70 [0,4194304] 0 2024-09-10T10:04:23.539 INFO:tasks.workunit.client.0.smithi071.stdout:7/780: mkdir d9/d15/d40/d80/ddd/d110 0 2024-09-10T10:04:23.539 INFO:tasks.workunit.client.1.smithi107.stdout:7/603: creat d0/d1b/d4d/fb9 x:0 0 0 2024-09-10T10:04:23.539 INFO:tasks.workunit.client.1.smithi107.stdout:8/602: symlink d5/da2/lc4 0 2024-09-10T10:04:23.539 INFO:tasks.workunit.client.1.smithi107.stdout:7/604: chown d0/d8/f38 145 1 2024-09-10T10:04:23.540 INFO:tasks.workunit.client.1.smithi107.stdout:4/840: creat d0/d40/d57/d71/f121 x:0 0 0 2024-09-10T10:04:23.541 INFO:tasks.workunit.client.1.smithi107.stdout:2/708: creat d3/da/d66/d91/ffa x:0 0 0 2024-09-10T10:04:23.541 INFO:tasks.workunit.client.1.smithi107.stdout:9/670: rmdir d5/d7/d1d/d3b 39 2024-09-10T10:04:23.543 INFO:tasks.workunit.client.1.smithi107.stdout:7/605: write d0/d8/dc/f71 [570626,101708] 0 2024-09-10T10:04:23.543 INFO:tasks.workunit.client.0.smithi071.stdout:7/781: getdents d9/d15/d1f/d74/da1/dcf/dfe 0 2024-09-10T10:04:23.544 INFO:tasks.workunit.client.1.smithi107.stdout:5/704: mkdir de/d4a/d7e/db2/dee 0 2024-09-10T10:04:23.545 INFO:tasks.workunit.client.0.smithi071.stdout:2/695: dread d8/d38/d47/d59/d65/f79 [0,4194304] 0 2024-09-10T10:04:23.546 INFO:tasks.workunit.client.1.smithi107.stdout:7/606: read - d0/d8/d5c/fa2 zero size 2024-09-10T10:04:23.546 INFO:tasks.workunit.client.0.smithi071.stdout:2/696: dread - d8/d87/d33/d41/d4d/d5e/fd4 zero size 2024-09-10T10:04:23.546 INFO:tasks.workunit.client.1.smithi107.stdout:8/603: symlink d5/d8/d66/d8b/d21/d83/lc5 0 2024-09-10T10:04:23.547 INFO:tasks.workunit.client.1.smithi107.stdout:5/705: mknod de/db3/db6/cef 0 2024-09-10T10:04:23.549 INFO:tasks.workunit.client.1.smithi107.stdout:4/841: creat d0/d1f/d72/f122 x:0 0 0 2024-09-10T10:04:23.549 INFO:tasks.workunit.client.1.smithi107.stdout:7/607: chown d0/d8/dc/l1d 18321032 1 2024-09-10T10:04:23.550 INFO:tasks.workunit.client.1.smithi107.stdout:8/604: symlink d5/d8/d66/d8e/lc6 0 2024-09-10T10:04:23.552 INFO:tasks.workunit.client.1.smithi107.stdout:9/671: rmdir d5/db3 0 2024-09-10T10:04:23.552 INFO:tasks.workunit.client.1.smithi107.stdout:4/842: unlink d0/d1f/d20/d47/la4 0 2024-09-10T10:04:23.554 INFO:tasks.workunit.client.1.smithi107.stdout:5/706: symlink de/d20/d2b/d4b/lf0 0 2024-09-10T10:04:23.554 INFO:tasks.workunit.client.1.smithi107.stdout:7/608: mkdir d0/d1b/d4d/dba 0 2024-09-10T10:04:23.554 INFO:tasks.workunit.client.0.smithi071.stdout:2/697: creat d8/fe9 x:0 0 0 2024-09-10T10:04:23.555 INFO:tasks.workunit.client.0.smithi071.stdout:2/698: readlink d8/d87/l2c 0 2024-09-10T10:04:23.556 INFO:tasks.workunit.client.0.smithi071.stdout:5/539: truncate dc/df/d3e/d5a/f5e 984243 0 2024-09-10T10:04:23.557 INFO:tasks.workunit.client.1.smithi107.stdout:9/672: rmdir d5/d7/d1d/d29/db4/dbd 39 2024-09-10T10:04:23.557 INFO:tasks.workunit.client.1.smithi107.stdout:4/843: truncate d0/d40/fb2 450838 0 2024-09-10T10:04:23.558 INFO:tasks.workunit.client.1.smithi107.stdout:7/609: unlink d0/d1b/fa3 0 2024-09-10T10:04:23.558 INFO:tasks.workunit.client.0.smithi071.stdout:9/952: dread d0/db/d1b/d1d/d5b/f4d [0,4194304] 0 2024-09-10T10:04:23.559 INFO:tasks.workunit.client.1.smithi107.stdout:9/673: readlink d5/d7/d1d/d9b/dab/d57/d87/lc9 0 2024-09-10T10:04:23.561 INFO:tasks.workunit.client.1.smithi107.stdout:4/844: mkdir d0/d1f/d90/d123 0 2024-09-10T10:04:23.562 INFO:tasks.workunit.client.0.smithi071.stdout:7/782: rmdir d9/d15/d1f 39 2024-09-10T10:04:23.565 INFO:tasks.workunit.client.0.smithi071.stdout:7/783: mknod d9/d15/d40/d80/dd6/c111 0 2024-09-10T10:04:23.567 INFO:tasks.workunit.client.0.smithi071.stdout:2/699: truncate d8/d38/d47/d59/d65/faf 355713 0 2024-09-10T10:04:23.567 INFO:tasks.workunit.client.0.smithi071.stdout:2/700: chown d8/d87/dc4 3373038 1 2024-09-10T10:04:23.568 INFO:tasks.workunit.client.0.smithi071.stdout:7/784: dread - d9/d15/d1f/d98/f102 zero size 2024-09-10T10:04:23.570 INFO:tasks.workunit.client.0.smithi071.stdout:7/785: write d9/d15/d40/db8/fbe [812753,73151] 0 2024-09-10T10:04:23.572 INFO:tasks.workunit.client.0.smithi071.stdout:7/786: fdatasync d9/d11/dd2/fba 0 2024-09-10T10:04:23.575 INFO:tasks.workunit.client.0.smithi071.stdout:7/787: symlink d9/d15/d1f/d74/da1/dcf/ddf/l112 0 2024-09-10T10:04:23.577 INFO:tasks.workunit.client.1.smithi107.stdout:1/802: dread d2/d12/d65/d6b/f2e [4194304,4194304] 0 2024-09-10T10:04:23.583 INFO:tasks.workunit.client.1.smithi107.stdout:1/803: dwrite d2/d6/d24/f56 [0,4194304] 0 2024-09-10T10:04:23.584 INFO:tasks.workunit.client.0.smithi071.stdout:7/788: write d9/d76/d66/fb7 [353744,84862] 0 2024-09-10T10:04:23.586 INFO:tasks.workunit.client.1.smithi107.stdout:7/610: dread d0/d8/d56/d5d/f67 [0,4194304] 0 2024-09-10T10:04:23.586 INFO:tasks.workunit.client.0.smithi071.stdout:7/789: chown d9/d15/d40/l44 7741389 1 2024-09-10T10:04:23.588 INFO:tasks.workunit.client.0.smithi071.stdout:7/790: mkdir d9/d1a/dc8/d113 0 2024-09-10T10:04:23.588 INFO:tasks.workunit.client.0.smithi071.stdout:7/791: fsync f2 0 2024-09-10T10:04:23.589 INFO:tasks.workunit.client.0.smithi071.stdout:7/792: stat d9/d1a/dc8 0 2024-09-10T10:04:23.589 INFO:tasks.workunit.client.0.smithi071.stdout:7/793: stat d9/d15/d40/d80/ddd/d110 0 2024-09-10T10:04:23.590 INFO:tasks.workunit.client.0.smithi071.stdout:7/794: fsync d9/d1a/dc8/ffc 0 2024-09-10T10:04:23.595 INFO:tasks.workunit.client.0.smithi071.stdout:7/795: dwrite d9/d11/dd2/fb4 [0,4194304] 0 2024-09-10T10:04:23.605 INFO:tasks.workunit.client.0.smithi071.stdout:7/796: dwrite d9/d11/faf [0,4194304] 0 2024-09-10T10:04:23.609 INFO:tasks.workunit.client.0.smithi071.stdout:7/797: creat d9/d15/d40/db8/f114 x:0 0 0 2024-09-10T10:04:23.631 INFO:tasks.workunit.client.0.smithi071.stdout:9/953: rename d0/db/d20/d21/fa5 to d0/d3b/d44/f126 0 2024-09-10T10:04:23.633 INFO:tasks.workunit.client.1.smithi107.stdout:4/845: mkdir d0/d40/d57/d76/d77/d8d/d124 0 2024-09-10T10:04:23.634 INFO:tasks.workunit.client.1.smithi107.stdout:1/804: rmdir d2/dcc/dea 39 2024-09-10T10:04:23.634 INFO:tasks.workunit.client.0.smithi071.stdout:2/701: rename d8/d24/d7f/de1 to d8/d87/dc4/dea 0 2024-09-10T10:04:23.635 INFO:tasks.workunit.client.1.smithi107.stdout:1/805: chown d2/d35/fb0 107014118 1 2024-09-10T10:04:23.637 INFO:tasks.workunit.client.0.smithi071.stdout:2/702: symlink d8/d87/d33/leb 0 2024-09-10T10:04:23.639 INFO:tasks.workunit.client.1.smithi107.stdout:4/846: rename d0/d40/ca5 to d0/d1f/d90/dfb/c125 0 2024-09-10T10:04:23.641 INFO:tasks.workunit.client.1.smithi107.stdout:1/806: mkdir d2/d6/d67/dfe 0 2024-09-10T10:04:23.648 INFO:tasks.workunit.client.1.smithi107.stdout:7/611: link d0/d8/dc/f4f d0/d1b/fbb 0 2024-09-10T10:04:23.650 INFO:tasks.workunit.client.1.smithi107.stdout:4/847: creat d0/d40/d75/f126 x:0 0 0 2024-09-10T10:04:23.651 INFO:tasks.workunit.client.1.smithi107.stdout:7/612: read d0/d8/fa8 [2970571,47790] 0 2024-09-10T10:04:23.651 INFO:tasks.workunit.client.1.smithi107.stdout:1/807: getdents d2/d36/dbc 0 2024-09-10T10:04:23.652 INFO:tasks.workunit.client.1.smithi107.stdout:4/848: dread d0/d1f/d90/fc1 [0,4194304] 0 2024-09-10T10:04:23.653 INFO:tasks.workunit.client.1.smithi107.stdout:1/808: write d2/f21 [4900397,117601] 0 2024-09-10T10:04:23.655 INFO:tasks.workunit.client.1.smithi107.stdout:2/709: dread d3/da/df/d20/d36/d4f/d92/f77 [0,4194304] 0 2024-09-10T10:04:23.655 INFO:tasks.workunit.client.1.smithi107.stdout:7/613: mkdir d0/d1b/d4d/d69/d97/d3d/d81/dbc 0 2024-09-10T10:04:23.657 INFO:tasks.workunit.client.1.smithi107.stdout:4/849: symlink d0/d40/d6d/d8a/d116/l127 0 2024-09-10T10:04:23.658 INFO:tasks.workunit.client.1.smithi107.stdout:2/710: rmdir d3/d21/d95 39 2024-09-10T10:04:23.660 INFO:tasks.workunit.client.1.smithi107.stdout:7/614: unlink d0/d8/d5c/d6d/f8c 0 2024-09-10T10:04:23.661 INFO:tasks.workunit.client.1.smithi107.stdout:7/615: chown d0/d20/f44 14 1 2024-09-10T10:04:23.664 INFO:tasks.workunit.client.1.smithi107.stdout:4/850: creat d0/d1f/d90/d123/f128 x:0 0 0 2024-09-10T10:04:23.666 INFO:tasks.workunit.client.1.smithi107.stdout:6/702: truncate d0/d3d/d14/d42/d88/f97 1563412 0 2024-09-10T10:04:23.670 INFO:tasks.workunit.client.1.smithi107.stdout:4/851: truncate d0/d1f/d20/f4c 224779 0 2024-09-10T10:04:23.672 INFO:tasks.workunit.client.1.smithi107.stdout:4/852: fdatasync d0/d1f/d20/d47/d8c/fe8 0 2024-09-10T10:04:23.675 INFO:tasks.workunit.client.1.smithi107.stdout:0/655: write d6/f45 [1428792,113082] 0 2024-09-10T10:04:23.685 INFO:tasks.workunit.client.1.smithi107.stdout:1/809: dread d2/f49 [0,4194304] 0 2024-09-10T10:04:23.688 INFO:tasks.workunit.client.1.smithi107.stdout:8/605: dwrite d5/d8/d66/d8b/d21/f73 [0,4194304] 0 2024-09-10T10:04:23.690 INFO:tasks.workunit.client.1.smithi107.stdout:5/707: dwrite de/d4a/d4e/d89/d99/fac [0,4194304] 0 2024-09-10T10:04:23.690 INFO:tasks.workunit.client.1.smithi107.stdout:2/711: write d3/da/df/d20/d36/f76 [906160,33934] 0 2024-09-10T10:04:23.691 INFO:tasks.workunit.client.1.smithi107.stdout:7/616: write d0/d20/d72/f7b [1250133,41327] 0 2024-09-10T10:04:23.693 INFO:tasks.workunit.client.0.smithi071.stdout:3/597: sync 2024-09-10T10:04:23.693 INFO:tasks.workunit.client.1.smithi107.stdout:8/606: creat d5/d8/d66/d8b/fc7 x:0 0 0 2024-09-10T10:04:23.695 INFO:tasks.workunit.client.1.smithi107.stdout:6/703: write d0/d3d/d14/d17/f36 [7953633,87714] 0 2024-09-10T10:04:23.698 INFO:tasks.workunit.client.1.smithi107.stdout:6/704: creat d0/d70/ff8 x:0 0 0 2024-09-10T10:04:23.700 INFO:tasks.workunit.client.1.smithi107.stdout:1/810: write d2/d35/f8c [1534995,32867] 0 2024-09-10T10:04:23.701 INFO:tasks.workunit.client.1.smithi107.stdout:2/712: dwrite d3/da/df/d20/d36/f76 [0,4194304] 0 2024-09-10T10:04:23.704 INFO:tasks.workunit.client.1.smithi107.stdout:4/853: dwrite d0/d1f/d20/f5d [0,4194304] 0 2024-09-10T10:04:23.705 INFO:tasks.workunit.client.0.smithi071.stdout:1/691: write d1/d21/d2f/d30/d6a/d91/f9c [577936,59180] 0 2024-09-10T10:04:23.705 INFO:tasks.workunit.client.0.smithi071.stdout:9/954: write d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/d114/dda/f7b [3941822,8947] 0 2024-09-10T10:04:23.706 INFO:tasks.workunit.client.1.smithi107.stdout:4/854: fdatasync d0/d40/fd3 0 2024-09-10T10:04:23.707 INFO:tasks.workunit.client.0.smithi071.stdout:2/703: dwrite d8/f8f [0,4194304] 0 2024-09-10T10:04:23.712 INFO:tasks.workunit.client.0.smithi071.stdout:2/704: creat d8/d87/d51/fec x:0 0 0 2024-09-10T10:04:23.714 INFO:tasks.workunit.client.1.smithi107.stdout:2/713: mkdir d3/da/df/d20/dfb 0 2024-09-10T10:04:23.714 INFO:tasks.workunit.client.0.smithi071.stdout:2/705: stat d8/d38/d8d/f98 0 2024-09-10T10:04:23.715 INFO:tasks.workunit.client.0.smithi071.stdout:3/598: write d3/d49/d34/f6e [1254336,103105] 0 2024-09-10T10:04:23.715 INFO:tasks.workunit.client.0.smithi071.stdout:2/706: chown d8/d87/l1f 5 1 2024-09-10T10:04:23.718 INFO:tasks.workunit.client.1.smithi107.stdout:2/714: stat d3/da/df/d20/d36/d4f/d92/led 0 2024-09-10T10:04:23.720 INFO:tasks.workunit.client.1.smithi107.stdout:2/715: chown d3/da/df/cd7 6865 1 2024-09-10T10:04:23.722 INFO:tasks.workunit.client.0.smithi071.stdout:3/599: truncate d3/d10/d24/f27 1184683 0 2024-09-10T10:04:23.723 INFO:tasks.workunit.client.0.smithi071.stdout:2/707: mkdir d8/d87/d33/d41/d4d/d52/ded 0 2024-09-10T10:04:23.724 INFO:tasks.workunit.client.0.smithi071.stdout:2/708: fdatasync d8/d38/d63/fc1 0 2024-09-10T10:04:23.725 INFO:tasks.workunit.client.1.smithi107.stdout:2/716: unlink d3/da/df/d20/d36/cee 0 2024-09-10T10:04:23.728 INFO:tasks.workunit.client.1.smithi107.stdout:1/811: write d2/d6/d24/f69 [86898,28152] 0 2024-09-10T10:04:23.729 INFO:tasks.workunit.client.1.smithi107.stdout:1/812: chown d2/d12/f31 4 1 2024-09-10T10:04:23.731 INFO:tasks.workunit.client.1.smithi107.stdout:1/813: chown d2/d12/d65/d6b/c2b 4400481 1 2024-09-10T10:04:23.740 INFO:tasks.workunit.client.1.smithi107.stdout:8/607: truncate d5/fb 1575936 0 2024-09-10T10:04:23.743 INFO:tasks.workunit.client.0.smithi071.stdout:9/955: write d0/db/d1b/f78 [3385066,10748] 0 2024-09-10T10:04:23.745 INFO:tasks.workunit.client.0.smithi071.stdout:9/956: stat d0/db/d1b/d1d/d30/d54/f94 0 2024-09-10T10:04:23.752 INFO:tasks.workunit.client.0.smithi071.stdout:9/957: truncate d0/db/d1b/d1d/d5b/d9f/fe6 157838 0 2024-09-10T10:04:23.756 INFO:tasks.workunit.client.0.smithi071.stdout:9/958: creat d0/db/d1b/d1d/d30/d54/d27/d6e/f127 x:0 0 0 2024-09-10T10:04:23.757 INFO:tasks.workunit.client.0.smithi071.stdout:2/709: dread d8/fb [0,4194304] 0 2024-09-10T10:04:23.759 INFO:tasks.workunit.client.0.smithi071.stdout:2/710: write d8/f80 [1246311,100174] 0 2024-09-10T10:04:23.759 INFO:tasks.workunit.client.0.smithi071.stdout:3/600: dread d3/ff [0,4194304] 0 2024-09-10T10:04:23.762 INFO:tasks.workunit.client.0.smithi071.stdout:3/601: write d3/d1c/d3c/da1/d42/d4a/f59 [3003106,35853] 0 2024-09-10T10:04:23.764 INFO:tasks.workunit.client.0.smithi071.stdout:2/711: getdents d8/d4a 0 2024-09-10T10:04:23.771 INFO:tasks.workunit.client.0.smithi071.stdout:3/602: dwrite d3/d49/f6c [0,4194304] 0 2024-09-10T10:04:23.772 INFO:tasks.workunit.client.0.smithi071.stdout:2/712: dread d8/f20 [0,4194304] 0 2024-09-10T10:04:23.773 INFO:tasks.workunit.client.0.smithi071.stdout:3/603: dread - d3/d1c/d3c/da1/d5d/d9d/fb8 zero size 2024-09-10T10:04:23.775 INFO:tasks.workunit.client.0.smithi071.stdout:9/959: rename d0/db/d1b/d1d/d5b to d0/db/d20/d128 0 2024-09-10T10:04:23.776 INFO:tasks.workunit.client.0.smithi071.stdout:3/604: mkdir d3/d1c/d3c/da1/dd2 0 2024-09-10T10:04:23.781 INFO:tasks.workunit.client.0.smithi071.stdout:9/960: mkdir d0/db/d20/d112/d129 0 2024-09-10T10:04:23.782 INFO:tasks.workunit.client.0.smithi071.stdout:2/713: dwrite d8/d87/f76 [0,4194304] 0 2024-09-10T10:04:23.785 INFO:tasks.workunit.client.0.smithi071.stdout:2/714: chown d8/f28 52027 1 2024-09-10T10:04:23.789 INFO:tasks.workunit.client.0.smithi071.stdout:3/605: dwrite d3/d1c/d3c/da1/d3a/f45 [0,4194304] 0 2024-09-10T10:04:23.789 INFO:tasks.workunit.client.0.smithi071.stdout:2/715: chown d8/d87/d33/d41/d4d/d5e/ccc 3 1 2024-09-10T10:04:23.794 INFO:tasks.workunit.client.0.smithi071.stdout:9/961: dwrite d0/db/d1b/d1d/f1f [4194304,4194304] 0 2024-09-10T10:04:23.796 INFO:tasks.workunit.client.0.smithi071.stdout:3/606: mkdir d3/d49/d34/d67/dd3 0 2024-09-10T10:04:23.799 INFO:tasks.workunit.client.0.smithi071.stdout:3/607: fdatasync d3/d20/f2c 0 2024-09-10T10:04:23.802 INFO:tasks.workunit.client.1.smithi107.stdout:9/674: sync 2024-09-10T10:04:23.802 INFO:tasks.workunit.client.1.smithi107.stdout:7/617: dread d0/d1b/d4d/f61 [0,4194304] 0 2024-09-10T10:04:23.802 INFO:tasks.workunit.client.1.smithi107.stdout:2/717: write d3/da/d1e/d40/d8a/d7f/d55/f64 [285719,34165] 0 2024-09-10T10:04:23.803 INFO:tasks.workunit.client.0.smithi071.stdout:2/716: dwrite d8/f80 [0,4194304] 0 2024-09-10T10:04:23.803 INFO:tasks.workunit.client.1.smithi107.stdout:1/814: write d2/d36/f4d [3955186,129283] 0 2024-09-10T10:04:23.805 INFO:tasks.workunit.client.1.smithi107.stdout:1/815: readlink d2/d12/d94/l99 0 2024-09-10T10:04:23.805 INFO:tasks.workunit.client.1.smithi107.stdout:8/608: read d5/d8/d2a/f6e [275706,94097] 0 2024-09-10T10:04:23.807 INFO:tasks.workunit.client.1.smithi107.stdout:9/675: symlink d5/d1e/ldf 0 2024-09-10T10:04:23.807 INFO:tasks.workunit.client.0.smithi071.stdout:3/608: symlink d3/d49/d2f/ld4 0 2024-09-10T10:04:23.809 INFO:tasks.workunit.client.0.smithi071.stdout:2/717: rename d8/d87/d33/d41/d4d/d52/lc3 to d8/d38/d99/lee 0 2024-09-10T10:04:23.810 INFO:tasks.workunit.client.1.smithi107.stdout:7/618: creat d0/d8/dc/d2c/d47/fbd x:0 0 0 2024-09-10T10:04:23.810 INFO:tasks.workunit.client.1.smithi107.stdout:7/619: chown d0/d20/f44 3132164 1 2024-09-10T10:04:23.811 INFO:tasks.workunit.client.1.smithi107.stdout:2/718: mknod d3/da/df/d20/d36/d39/da3/ddb/cfc 0 2024-09-10T10:04:23.812 INFO:tasks.workunit.client.0.smithi071.stdout:3/609: write d3/d1c/d3c/da1/d3a/dbd/f53 [3080237,55726] 0 2024-09-10T10:04:23.812 INFO:tasks.workunit.client.0.smithi071.stdout:2/718: chown d8/d24/f5c 808223 1 2024-09-10T10:04:23.814 INFO:tasks.workunit.client.0.smithi071.stdout:2/719: dread - d8/d87/d33/fb5 zero size 2024-09-10T10:04:23.817 INFO:tasks.workunit.client.0.smithi071.stdout:3/610: link d3/d1c/d3c/da1/f5f d3/d1c/d3c/da1/d5d/da5/db3/fd5 0 2024-09-10T10:04:23.817 INFO:tasks.workunit.client.0.smithi071.stdout:2/720: write d8/d87/d33/f3c [4530818,31341] 0 2024-09-10T10:04:23.818 INFO:tasks.workunit.client.0.smithi071.stdout:2/721: chown d8/d87/d33/leb 7 1 2024-09-10T10:04:23.819 INFO:tasks.workunit.client.0.smithi071.stdout:3/611: mknod d3/d1c/d3c/da1/d42/d4a/d60/d78/cd6 0 2024-09-10T10:04:23.820 INFO:tasks.workunit.client.0.smithi071.stdout:2/722: write d8/d87/d33/d53/f86 [4780632,47245] 0 2024-09-10T10:04:23.820 INFO:tasks.workunit.client.0.smithi071.stdout:3/612: dread - d3/d1c/d3c/da1/d3a/dbd/fc7 zero size 2024-09-10T10:04:23.822 INFO:tasks.workunit.client.0.smithi071.stdout:3/613: truncate d3/d1c/d3c/da1/d3a/dbd/f53 4753433 0 2024-09-10T10:04:23.824 INFO:tasks.workunit.client.0.smithi071.stdout:3/614: symlink d3/d49/d34/ld7 0 2024-09-10T10:04:23.826 INFO:tasks.workunit.client.0.smithi071.stdout:3/615: creat d3/d10/d24/fd8 x:0 0 0 2024-09-10T10:04:23.831 INFO:tasks.workunit.client.0.smithi071.stdout:2/723: write d8/d38/d47/d59/d65/faf [664460,93133] 0 2024-09-10T10:04:23.832 INFO:tasks.workunit.client.0.smithi071.stdout:3/616: getdents d3/d10/d24 0 2024-09-10T10:04:23.833 INFO:tasks.workunit.client.0.smithi071.stdout:3/617: write d3/d1c/d3c/da1/d3a/dbd/f53 [1630961,100642] 0 2024-09-10T10:04:23.835 INFO:tasks.workunit.client.0.smithi071.stdout:3/618: chown d3/d1c/d3c/da1/d42/d4a/d60/d78/fac 2839041 1 2024-09-10T10:04:23.836 INFO:tasks.workunit.client.0.smithi071.stdout:2/724: rmdir d8/d87/d33/d41/d4d/d52/ded 0 2024-09-10T10:04:23.839 INFO:tasks.workunit.client.0.smithi071.stdout:9/962: truncate d0/db/d1b/f78 3685372 0 2024-09-10T10:04:23.839 INFO:tasks.workunit.client.0.smithi071.stdout:2/725: creat d8/d4a/fef x:0 0 0 2024-09-10T10:04:23.841 INFO:tasks.workunit.client.0.smithi071.stdout:9/963: mknod d0/db/d1b/d1d/d30/d54/df7/c12a 0 2024-09-10T10:04:23.842 INFO:tasks.workunit.client.0.smithi071.stdout:2/726: mkdir d8/d87/d49/d66/df0 0 2024-09-10T10:04:23.842 INFO:tasks.workunit.client.0.smithi071.stdout:9/964: creat d0/db/d20/dd8/f12b x:0 0 0 2024-09-10T10:04:23.845 INFO:tasks.workunit.client.0.smithi071.stdout:2/727: creat d8/d87/d49/d66/ff1 x:0 0 0 2024-09-10T10:04:23.845 INFO:tasks.workunit.client.0.smithi071.stdout:2/728: dread - d8/d38/d47/d59/fc0 zero size 2024-09-10T10:04:23.846 INFO:tasks.workunit.client.0.smithi071.stdout:9/965: creat d0/db/d1b/d1d/d30/d54/f12c x:0 0 0 2024-09-10T10:04:23.846 INFO:tasks.workunit.client.0.smithi071.stdout:2/729: readlink d8/d24/l7e 0 2024-09-10T10:04:23.847 INFO:tasks.workunit.client.0.smithi071.stdout:2/730: write d8/d87/d51/fec [664195,91860] 0 2024-09-10T10:04:23.849 INFO:tasks.workunit.client.0.smithi071.stdout:9/966: rmdir d0/d3b/d5c 39 2024-09-10T10:04:23.850 INFO:tasks.workunit.client.0.smithi071.stdout:2/731: creat d8/d87/d49/dce/ff2 x:0 0 0 2024-09-10T10:04:23.851 INFO:tasks.workunit.client.0.smithi071.stdout:2/732: read - d8/d87/fc2 zero size 2024-09-10T10:04:23.852 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:04:23.852 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:04:23.852 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:23.852 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:23.852 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:04:23.852 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:23.852 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr fail", "who": "smithi071.gtqytr"}]: dispatch 2024-09-10T10:04:23.852 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: Activating manager daemon smithi107.qurtcs 2024-09-10T10:04:23.852 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: osdmap e46: 6 total, 6 up, 6 in 2024-09-10T10:04:23.852 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T10:04:23.852 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "mgr fail", "who": "smithi071.gtqytr"}]': finished 2024-09-10T10:04:23.852 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T10:04:23.853 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: mgrmap e21: smithi107.qurtcs(active, starting, since 0.00778202s) 2024-09-10T10:04:23.853 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.omoqqq"}]: dispatch 2024-09-10T10:04:23.853 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:04:23.853 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:04:23.853 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:04:23.853 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mgr metadata", "who": "smithi107.qurtcs", "id": "smithi107.qurtcs"}]: dispatch 2024-09-10T10:04:23.853 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:04:23.853 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:04:23.853 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:04:23.853 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:04:23.853 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:23.853 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: Manager daemon smithi107.qurtcs is now available 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: Checking for cert/key for grafana.smithi071 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: Migrating grafana.smithi071 cert to cert store 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: Migrating grafana.smithi071 key to cert store 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.qurtcs/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:04:23.854 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.qurtcs/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:04:23.855 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.qurtcs/trash_purge_schedule"}]: dispatch 2024-09-10T10:04:23.855 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:23 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.qurtcs/trash_purge_schedule"}]: dispatch 2024-09-10T10:04:23.855 INFO:tasks.workunit.client.0.smithi071.stdout:9/967: rename d0/db/d20/d21/f113 to d0/db/d1b/db4/f12d 0 2024-09-10T10:04:23.858 INFO:tasks.workunit.client.0.smithi071.stdout:9/968: mkdir d0/d3b/d5c/d6a/d12e 0 2024-09-10T10:04:23.858 INFO:tasks.workunit.client.0.smithi071.stdout:2/733: dread d8/d38/d47/d59/d65/f79 [0,4194304] 0 2024-09-10T10:04:23.862 INFO:tasks.workunit.client.0.smithi071.stdout:9/969: rename d0/db/d20/d128/fbc to d0/db/d20/d128/f12f 0 2024-09-10T10:04:23.864 INFO:tasks.workunit.client.0.smithi071.stdout:9/970: truncate d0/db/d1b/d1d/d30/d54/d27/d6e/d8a/d8c/d114/f115 168544 0 2024-09-10T10:04:23.864 INFO:tasks.workunit.client.0.smithi071.stdout:9/971: dread - d0/d3b/d5c/f107 zero size 2024-09-10T10:04:23.866 INFO:tasks.workunit.client.0.smithi071.stdout:9/972: chown d0/d3b/d5c/ca4 4565 1 2024-09-10T10:04:23.868 INFO:tasks.workunit.client.0.smithi071.stdout:9/973: mknod d0/db/d1b/d1d/d4b/db9/c130 0 2024-09-10T10:04:23.869 INFO:tasks.workunit.client.0.smithi071.stdout:9/974: rmdir d0/db/d20/d128/d9f 39 2024-09-10T10:04:23.871 INFO:tasks.workunit.client.0.smithi071.stdout:9/975: mknod d0/db/d20/d21/c131 0 2024-09-10T10:04:23.872 INFO:tasks.workunit.client.0.smithi071.stdout:9/976: creat d0/db/d1b/db4/f132 x:0 0 0 2024-09-10T10:04:23.874 INFO:tasks.workunit.client.0.smithi071.stdout:9/977: chown d0/db/d1b/d1d/d4b/db9/dba/fd7 792 1 2024-09-10T10:04:23.877 INFO:tasks.workunit.client.0.smithi071.stdout:9/978: creat d0/db/d20/d128/d9f/f133 x:0 0 0 2024-09-10T10:04:23.878 INFO:tasks.workunit.client.0.smithi071.stdout:9/979: mknod d0/db/d20/dd8/c134 0 2024-09-10T10:04:23.879 INFO:tasks.workunit.client.0.smithi071.stdout:9/980: fsync d0/d3b/d5c/ff4 0 2024-09-10T10:04:23.881 INFO:tasks.workunit.client.0.smithi071.stdout:9/981: mkdir d0/db/d20/d135 0 2024-09-10T10:04:23.882 INFO:tasks.workunit.client.0.smithi071.stdout:9/982: mknod d0/db/d1b/d1d/d30/d54/df7/dfc/c136 0 2024-09-10T10:04:23.886 INFO:tasks.workunit.client.0.smithi071.stdout:9/983: dread d0/db/d1b/d1d/d30/d54/fc6 [0,4194304] 0 2024-09-10T10:04:23.886 INFO:tasks.workunit.client.1.smithi107.stdout:9/676: write d5/d7/d1d/d9b/dab/d57/d87/f89 [435316,122713] 0 2024-09-10T10:04:23.887 INFO:tasks.workunit.client.1.smithi107.stdout:2/719: getdents d3/da/d66/db7 0 2024-09-10T10:04:23.889 INFO:tasks.workunit.client.0.smithi071.stdout:9/984: creat d0/db/d1b/d1d/d4b/f137 x:0 0 0 2024-09-10T10:04:23.891 INFO:tasks.workunit.client.1.smithi107.stdout:2/720: rmdir d3/da/d66/d91/dae 39 2024-09-10T10:04:23.891 INFO:tasks.workunit.client.1.smithi107.stdout:2/721: fdatasync d3/f49 0 2024-09-10T10:04:23.892 INFO:tasks.workunit.client.1.smithi107.stdout:7/620: dwrite d0/d8/dc/d2c/f3b [0,4194304] 0 2024-09-10T10:04:23.893 INFO:tasks.workunit.client.0.smithi071.stdout:9/985: mknod d0/db/d20/d128/d9f/c138 0 2024-09-10T10:04:23.899 INFO:tasks.workunit.client.1.smithi107.stdout:2/722: dwrite d3/d21/f3a [0,4194304] 0 2024-09-10T10:04:23.904 INFO:tasks.workunit.client.1.smithi107.stdout:2/723: fdatasync d3/da/df/d78/f80 0 2024-09-10T10:04:23.909 INFO:tasks.workunit.client.1.smithi107.stdout:2/724: creat d3/da/d66/d91/dea/ffd x:0 0 0 2024-09-10T10:04:23.909 INFO:tasks.workunit.client.1.smithi107.stdout:9/677: write d5/d7/d1d/d9b/dab/d57/f62 [16378,83752] 0 2024-09-10T10:04:23.910 INFO:tasks.workunit.client.0.smithi071.stdout:9/986: link d0/db/d20/dd8/cdb d0/db/d1b/d1d/d30/d54/d27/d6e/c139 0 2024-09-10T10:04:23.911 INFO:tasks.workunit.client.1.smithi107.stdout:9/678: readlink d5/d7/d1d/d41/d83/d9a/l34 0 2024-09-10T10:04:23.915 INFO:tasks.workunit.client.1.smithi107.stdout:2/725: rename d3/da/df/d20/fdd to d3/da/d66/d91/dea/ffe 0 2024-09-10T10:04:23.915 INFO:tasks.workunit.client.0.smithi071.stdout:9/987: dread - d0/db/d1b/d1d/d30/d54/df7/dfc/f9c zero size 2024-09-10T10:04:23.916 INFO:tasks.workunit.client.1.smithi107.stdout:9/679: mkdir d5/d1e/dc5/de0 0 2024-09-10T10:04:23.917 INFO:tasks.workunit.client.1.smithi107.stdout:7/621: truncate d0/d20/d72/f7b 2866858 0 2024-09-10T10:04:23.920 INFO:tasks.workunit.client.0.smithi071.stdout:9/988: creat d0/db/d1b/d1d/d4b/dad/f13a x:0 0 0 2024-09-10T10:04:23.921 INFO:tasks.workunit.client.1.smithi107.stdout:9/680: fsync f3 0 2024-09-10T10:04:23.922 INFO:tasks.workunit.client.1.smithi107.stdout:7/622: write d0/d8/dc/d2c/f6e [1804172,67551] 0 2024-09-10T10:04:23.923 INFO:tasks.workunit.client.1.smithi107.stdout:7/623: fsync d0/d8/dc/d2c/f3b 0 2024-09-10T10:04:23.926 INFO:tasks.workunit.client.1.smithi107.stdout:2/726: rename d3/da/fc6 to d3/d21/fff 0 2024-09-10T10:04:23.927 INFO:tasks.workunit.client.0.smithi071.stdout:9/989: dwrite d0/db/d20/dd8/f12b [0,4194304] 0 2024-09-10T10:04:23.929 INFO:tasks.workunit.client.0.smithi071.stdout:9/990: chown d0/db/d1b/d1d/d30 37089091 1 2024-09-10T10:04:23.931 INFO:tasks.workunit.client.1.smithi107.stdout:7/624: rename d0/d8/d5c/d6d/fac to d0/d8/d5c/fbe 0 2024-09-10T10:04:23.933 INFO:tasks.workunit.client.1.smithi107.stdout:9/681: dwrite d5/d7/d1d/db5/fcc [0,4194304] 0 2024-09-10T10:04:23.942 INFO:tasks.workunit.client.1.smithi107.stdout:9/682: dwrite d5/d7/d1d/d41/f91 [4194304,4194304] 0 2024-09-10T10:04:23.959 INFO:tasks.workunit.client.1.smithi107.stdout:0/656: sync 2024-09-10T10:04:23.965 INFO:tasks.workunit.client.1.smithi107.stdout:0/657: dwrite d6/d14/f99 [0,4194304] 0 2024-09-10T10:04:23.967 INFO:tasks.workunit.client.1.smithi107.stdout:0/658: write d6/d8/d2f/d35/d3c/d58/d69/f6b [4286576,20950] 0 2024-09-10T10:04:24.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:04:24.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:04:24.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:24.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:24.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' 2024-09-10T10:04:24.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:24.030 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr fail", "who": "smithi071.gtqytr"}]: dispatch 2024-09-10T10:04:24.031 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: Activating manager daemon smithi107.qurtcs 2024-09-10T10:04:24.031 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: osdmap e46: 6 total, 6 up, 6 in 2024-09-10T10:04:24.031 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T10:04:24.031 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.14208 172.21.15.71:0/681088528' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "mgr fail", "who": "smithi071.gtqytr"}]': finished 2024-09-10T10:04:24.031 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T10:04:24.031 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: mgrmap e21: smithi107.qurtcs(active, starting, since 0.00778202s) 2024-09-10T10:04:24.031 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.omoqqq"}]: dispatch 2024-09-10T10:04:24.031 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:04:24.031 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:04:24.031 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:04:24.031 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mgr metadata", "who": "smithi107.qurtcs", "id": "smithi107.qurtcs"}]: dispatch 2024-09-10T10:04:24.031 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:04:24.031 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:04:24.032 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:04:24.032 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:04:24.032 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:24.032 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:24.032 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:04:24.032 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:04:24.032 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:04:24.032 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: Manager daemon smithi107.qurtcs is now available 2024-09-10T10:04:24.032 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: Checking for cert/key for grafana.smithi071 2024-09-10T10:04:24.032 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: Migrating grafana.smithi071 cert to cert store 2024-09-10T10:04:24.032 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:24.032 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: Migrating grafana.smithi071 key to cert store 2024-09-10T10:04:24.032 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:24.033 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:24.033 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:24.033 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:04:24.033 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.qurtcs/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:04:24.033 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.qurtcs/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:04:24.033 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.qurtcs/trash_purge_schedule"}]: dispatch 2024-09-10T10:04:24.033 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:23 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi107.qurtcs/trash_purge_schedule"}]: dispatch 2024-09-10T10:04:24.053 INFO:tasks.workunit.client.0.smithi071.stdout:8/600: sync 2024-09-10T10:04:24.054 INFO:tasks.workunit.client.1.smithi107.stdout:2/727: mknod d3/da/d1e/d5f/d54/dc2/c100 0 2024-09-10T10:04:24.055 INFO:tasks.workunit.client.0.smithi071.stdout:8/601: creat d5/df/fcf x:0 0 0 2024-09-10T10:04:24.057 INFO:tasks.workunit.client.1.smithi107.stdout:7/625: rmdir d0/d20 39 2024-09-10T10:04:24.058 INFO:tasks.workunit.client.1.smithi107.stdout:7/626: write d0/d1b/d9d/fb2 [493514,43158] 0 2024-09-10T10:04:24.059 INFO:tasks.workunit.client.0.smithi071.stdout:8/602: getdents d5/df/d1e/d70 0 2024-09-10T10:04:24.059 INFO:tasks.workunit.client.1.smithi107.stdout:7/627: chown d0/f7 72 1 2024-09-10T10:04:24.062 INFO:tasks.workunit.client.0.smithi071.stdout:8/603: creat d5/df/d1e/d70/fd0 x:0 0 0 2024-09-10T10:04:24.063 INFO:tasks.workunit.client.1.smithi107.stdout:0/659: read d6/d8/d2f/d35/d3c/f41 [2072833,15722] 0 2024-09-10T10:04:24.064 INFO:tasks.workunit.client.0.smithi071.stdout:8/604: unlink d5/df/d74/f96 0 2024-09-10T10:04:24.066 INFO:tasks.workunit.client.1.smithi107.stdout:7/628: creat d0/d8/d5c/d6d/fbf x:0 0 0 2024-09-10T10:04:24.066 INFO:tasks.workunit.client.0.smithi071.stdout:8/605: unlink d5/d36/l3a 0 2024-09-10T10:04:24.066 INFO:tasks.workunit.client.1.smithi107.stdout:7/629: write d0/f27 [3432040,117275] 0 2024-09-10T10:04:24.067 INFO:tasks.workunit.client.1.smithi107.stdout:2/728: creat d3/da/df/d20/d36/d4f/d92/dec/f101 x:0 0 0 2024-09-10T10:04:24.068 INFO:tasks.workunit.client.1.smithi107.stdout:7/630: readlink d0/d1b/d4d/d69/d97/l34 0 2024-09-10T10:04:24.069 INFO:tasks.workunit.client.1.smithi107.stdout:0/660: chown d6/d8/d2f/d2e/d7b/d89/cb7 8 1 2024-09-10T10:04:24.070 INFO:tasks.workunit.client.1.smithi107.stdout:9/683: link d5/d7/d1d/d9b/dab/d57/cdd d5/d7/d1d/d41/d97/ce1 0 2024-09-10T10:04:24.071 INFO:tasks.workunit.client.0.smithi071.stdout:9/991: dwrite d0/f87 [0,4194304] 0 2024-09-10T10:04:24.072 INFO:tasks.workunit.client.1.smithi107.stdout:9/684: write d5/d7/d1d/d9b/dab/d57/fd4 [875522,123660] 0 2024-09-10T10:04:24.073 INFO:tasks.workunit.client.0.smithi071.stdout:9/992: dread - d0/db/d1b/d1d/d4b/dad/f13a zero size 2024-09-10T10:04:24.074 INFO:tasks.workunit.client.1.smithi107.stdout:9/685: chown d5/d7/d1d/d41/d83/d9a/f65 188686 1 2024-09-10T10:04:24.075 INFO:tasks.workunit.client.0.smithi071.stdout:9/993: write d0/db/d20/dd8/f12b [2727777,118218] 0 2024-09-10T10:04:24.077 INFO:tasks.workunit.client.1.smithi107.stdout:0/661: mkdir d6/d8/d2f/d2e/d32/d95/dce 0 2024-09-10T10:04:24.077 INFO:tasks.workunit.client.0.smithi071.stdout:8/606: dread d5/df/fad [0,4194304] 0 2024-09-10T10:04:24.078 INFO:tasks.workunit.client.0.smithi071.stdout:9/994: chown d0/db/d1b/d1d/d30/d54/l84 1 1 2024-09-10T10:04:24.078 INFO:tasks.workunit.client.0.smithi071.stdout:8/607: readlink d5/df/d1e/d70/lc8 0 2024-09-10T10:04:24.079 INFO:tasks.workunit.client.1.smithi107.stdout:0/662: stat d6/d8/d2f/d2e/d32/f37 0 2024-09-10T10:04:24.080 INFO:tasks.workunit.client.1.smithi107.stdout:9/686: unlink d5/d7/d1d/f47 0 2024-09-10T10:04:24.082 INFO:tasks.workunit.client.1.smithi107.stdout:9/687: dread - d5/d7/d1d/f82 zero size 2024-09-10T10:04:24.082 INFO:tasks.workunit.client.1.smithi107.stdout:0/663: mknod d6/d5a/d5c/ccf 0 2024-09-10T10:04:24.083 INFO:tasks.workunit.client.0.smithi071.stdout:8/608: rename d5/df/d1d/f23 to d5/df/d74/fd1 0 2024-09-10T10:04:24.083 INFO:tasks.workunit.client.0.smithi071.stdout:9/995: mkdir d0/db/d1b/d1d/d30/d54/df7/d124/d13b 0 2024-09-10T10:04:24.083 INFO:tasks.workunit.client.1.smithi107.stdout:9/688: write d5/d7/fb2 [3876803,104277] 0 2024-09-10T10:04:24.083 INFO:tasks.workunit.client.0.smithi071.stdout:8/609: truncate d5/f19 992764 0 2024-09-10T10:04:24.084 INFO:tasks.workunit.client.0.smithi071.stdout:9/996: fdatasync d0/f2e 0 2024-09-10T10:04:24.088 INFO:tasks.workunit.client.1.smithi107.stdout:0/664: creat d6/d8/d2f/d2e/d32/d85/d8a/fd0 x:0 0 0 2024-09-10T10:04:24.089 INFO:tasks.workunit.client.1.smithi107.stdout:7/631: dread d0/f4 [0,4194304] 0 2024-09-10T10:04:24.089 INFO:tasks.workunit.client.0.smithi071.stdout:8/610: rename d5/df/d95/fa4 to d5/fd2 0 2024-09-10T10:04:24.090 INFO:tasks.workunit.client.1.smithi107.stdout:2/729: write d3/da/df/d20/d36/d4f/dcc/fcf [639156,49039] 0 2024-09-10T10:04:24.090 INFO:tasks.workunit.client.0.smithi071.stdout:9/997: fsync d0/fa 0 2024-09-10T10:04:24.092 INFO:tasks.workunit.client.1.smithi107.stdout:0/665: truncate d6/d8/d2f/d2e/d32/f9c 974796 0 2024-09-10T10:04:24.093 INFO:tasks.workunit.client.1.smithi107.stdout:7/632: mkdir d0/d20/d72/dc0 0 2024-09-10T10:04:24.095 INFO:tasks.workunit.client.0.smithi071.stdout:9/998: fsync d0/db/d1b/d1d/d30/d54/d27/d6e/f92 0 2024-09-10T10:04:24.095 INFO:tasks.workunit.client.1.smithi107.stdout:0/666: chown d6/d8/d2f/da3/da5/lb1 18221137 1 2024-09-10T10:04:24.096 INFO:tasks.workunit.client.1.smithi107.stdout:2/730: rename d3/da/d66/d91/dae to d3/d8f/df4/d102 0 2024-09-10T10:04:24.097 INFO:tasks.workunit.client.0.smithi071.stdout:8/611: link d5/df/d1d/d86/d75/f87 d5/df/d1d/d81/d9b/fd3 0 2024-09-10T10:04:24.098 INFO:tasks.workunit.client.0.smithi071.stdout:9/999: fdatasync d0/fb1 0 2024-09-10T10:04:24.098 INFO:tasks.workunit.client.0.smithi071.stdout:8/612: read d5/f19 [442351,77546] 0 2024-09-10T10:04:24.100 INFO:tasks.workunit.client.0.smithi071.stdout:8/613: chown d5/df/d1e/l46 722440 1 2024-09-10T10:04:24.104 INFO:tasks.workunit.client.1.smithi107.stdout:7/633: link d0/d20/d35/faa d0/d1b/d4d/d69/d97/d3d/d81/dbc/fc1 0 2024-09-10T10:04:24.104 INFO:tasks.workunit.client.1.smithi107.stdout:2/731: dwrite d3/f49 [0,4194304] 0 2024-09-10T10:04:24.105 INFO:tasks.workunit.client.1.smithi107.stdout:0/667: rename d6/d14/l48 to d6/d8/d2f/d35/d3c/d58/ld1 0 2024-09-10T10:04:24.105 INFO:tasks.workunit.client.0.smithi071.stdout:8/614: rename d5/df/d67/cbc to d5/df/d1d/d86/db7/cd4 0 2024-09-10T10:04:24.106 INFO:tasks.workunit.client.1.smithi107.stdout:9/689: dread d5/d7/d1d/d3b/f4a [4194304,4194304] 0 2024-09-10T10:04:24.106 INFO:tasks.workunit.client.1.smithi107.stdout:9/690: stat d5/f35 0 2024-09-10T10:04:24.109 INFO:tasks.workunit.client.1.smithi107.stdout:9/691: chown d5/d7/d1d/d9b/dab/d57/d87/d27/f42 800500872 1 2024-09-10T10:04:24.110 INFO:tasks.workunit.client.1.smithi107.stdout:0/668: rename d6/d14/c98 to d6/d5a/da9/cd2 0 2024-09-10T10:04:24.111 INFO:tasks.workunit.client.1.smithi107.stdout:7/634: creat d0/d1b/d4d/d69/d97/d3d/d81/dbc/fc2 x:0 0 0 2024-09-10T10:04:24.113 INFO:tasks.workunit.client.1.smithi107.stdout:2/732: creat d3/d21/f103 x:0 0 0 2024-09-10T10:04:24.119 INFO:tasks.workunit.client.1.smithi107.stdout:7/635: creat d0/d1b/d4d/d69/fc3 x:0 0 0 2024-09-10T10:04:24.120 INFO:tasks.workunit.client.1.smithi107.stdout:0/669: dwrite d6/d8/d2f/d6e/f9d [4194304,4194304] 0 2024-09-10T10:04:24.126 INFO:tasks.workunit.client.1.smithi107.stdout:7/636: write d0/d8/d5c/f93 [4670310,103523] 0 2024-09-10T10:04:24.126 INFO:tasks.workunit.client.1.smithi107.stdout:2/733: link d3/da/df/d20/d36/d4f/f83 d3/da/df/d20/d36/d4f/dcc/f104 0 2024-09-10T10:04:24.127 INFO:tasks.workunit.client.0.smithi071.stdout:8/615: dwrite d5/df/f5b [4194304,4194304] 0 2024-09-10T10:04:24.129 INFO:tasks.workunit.client.1.smithi107.stdout:7/637: rename d0/d8/dc to d0/d8/dc/d2c/dc4 22 2024-09-10T10:04:24.130 INFO:tasks.workunit.client.1.smithi107.stdout:9/692: dread d5/d7/d1d/d9b/dab/d57/f69 [0,4194304] 0 2024-09-10T10:04:24.131 INFO:tasks.workunit.client.1.smithi107.stdout:7/638: mknod d0/d1b/d4d/d69/d97/d3d/d81/dbc/cc5 0 2024-09-10T10:04:24.133 INFO:tasks.workunit.client.1.smithi107.stdout:9/693: creat d5/d7/d1d/d29/fe2 x:0 0 0 2024-09-10T10:04:24.135 INFO:tasks.workunit.client.1.smithi107.stdout:0/670: dread d6/d8/d2f/da3/da5/fab [0,4194304] 0 2024-09-10T10:04:24.136 INFO:tasks.workunit.client.1.smithi107.stdout:9/694: chown d5/d7/d1d/d9b/dab/d57/d87/d27/fc1 8676 1 2024-09-10T10:04:24.138 INFO:tasks.workunit.client.1.smithi107.stdout:7/639: mknod d0/d8/dc/cc6 0 2024-09-10T10:04:24.141 INFO:tasks.workunit.client.1.smithi107.stdout:0/671: write d6/f7 [5245636,48102] 0 2024-09-10T10:04:24.141 INFO:tasks.workunit.client.1.smithi107.stdout:2/734: link d3/da/d1e/d40/fc7 d3/da/f105 0 2024-09-10T10:04:24.142 INFO:tasks.workunit.client.1.smithi107.stdout:0/672: chown d6/c46 571 1 2024-09-10T10:04:24.143 INFO:tasks.workunit.client.1.smithi107.stdout:2/735: truncate d3/d21/d79/fd5 908557 0 2024-09-10T10:04:24.144 INFO:tasks.workunit.client.1.smithi107.stdout:7/640: link d0/d8/dc/d2c/f7e d0/d1b/d4d/d69/d97/d68/fc7 0 2024-09-10T10:04:24.145 INFO:tasks.workunit.client.1.smithi107.stdout:2/736: rmdir d3/d21/d79 39 2024-09-10T10:04:24.147 INFO:tasks.workunit.client.1.smithi107.stdout:7/641: creat d0/d8/d5c/d6d/fc8 x:0 0 0 2024-09-10T10:04:24.157 INFO:tasks.workunit.client.1.smithi107.stdout:6/705: sync 2024-09-10T10:04:24.157 INFO:tasks.workunit.client.1.smithi107.stdout:5/708: sync 2024-09-10T10:04:24.157 INFO:tasks.workunit.client.1.smithi107.stdout:2/737: symlink d3/da/df/d20/d36/d39/l106 0 2024-09-10T10:04:24.158 INFO:tasks.workunit.client.1.smithi107.stdout:0/673: write d6/f4a [2995050,74330] 0 2024-09-10T10:04:24.159 INFO:tasks.workunit.client.1.smithi107.stdout:7/642: symlink d0/d1b/d4d/d69/lc9 0 2024-09-10T10:04:24.160 INFO:tasks.workunit.client.1.smithi107.stdout:2/738: stat d3/da/df/d20/f33 0 2024-09-10T10:04:24.163 INFO:tasks.workunit.client.1.smithi107.stdout:7/643: mkdir d0/d1b/d4d/d69/dca 0 2024-09-10T10:04:24.164 INFO:tasks.workunit.client.1.smithi107.stdout:0/674: truncate d6/f10 1435138 0 2024-09-10T10:04:24.176 INFO:tasks.workunit.client.1.smithi107.stdout:5/709: dread de/f3b [0,4194304] 0 2024-09-10T10:04:24.178 INFO:tasks.workunit.client.1.smithi107.stdout:6/706: dread d0/d3d/d14/d17/f36 [0,4194304] 0 2024-09-10T10:04:24.178 INFO:tasks.workunit.client.1.smithi107.stdout:5/710: dread - de/d4a/d7e/db2/dbc/fe9 zero size 2024-09-10T10:04:24.190 INFO:tasks.workunit.client.1.smithi107.stdout:2/739: link d3/da/d66/l6a d3/da/d1e/d40/d8a/l107 0 2024-09-10T10:04:24.190 INFO:tasks.workunit.client.1.smithi107.stdout:0/675: mknod d6/d8/d2f/d2e/d32/d59/cd3 0 2024-09-10T10:04:24.191 INFO:tasks.workunit.client.1.smithi107.stdout:7/644: symlink d0/d1b/d4d/d69/d97/d3d/d81/lcb 0 2024-09-10T10:04:24.193 INFO:tasks.workunit.client.1.smithi107.stdout:2/740: fsync d3/da/d66/d91/f9e 0 2024-09-10T10:04:24.193 INFO:tasks.workunit.client.1.smithi107.stdout:5/711: dread de/f1f [0,4194304] 0 2024-09-10T10:04:24.194 INFO:tasks.workunit.client.1.smithi107.stdout:6/707: unlink d0/f3e 0 2024-09-10T10:04:24.195 INFO:tasks.workunit.client.1.smithi107.stdout:5/712: chown de/d20/d2b/d4b/d8c/fe2 1836 1 2024-09-10T10:04:24.198 INFO:tasks.workunit.client.1.smithi107.stdout:0/676: symlink d6/d8/d2f/d2e/d32/d95/dce/ld4 0 2024-09-10T10:04:24.201 INFO:tasks.workunit.client.1.smithi107.stdout:0/677: rmdir d6/d8/d3e/d43 39 2024-09-10T10:04:24.205 INFO:tasks.workunit.client.1.smithi107.stdout:5/713: truncate fc 1442604 0 2024-09-10T10:04:24.208 INFO:tasks.workunit.client.1.smithi107.stdout:5/714: unlink de/d20/d2b/l8f 0 2024-09-10T10:04:24.213 INFO:tasks.workunit.client.1.smithi107.stdout:5/715: dread de/d20/f7c [4194304,4194304] 0 2024-09-10T10:04:24.220 INFO:tasks.workunit.client.1.smithi107.stdout:7/645: rename d0/d1b/d4d/d69/d97/d3d to d0/d8/d56/dcc 0 2024-09-10T10:04:24.222 INFO:tasks.workunit.client.1.smithi107.stdout:6/708: rename d0/d3d/d14/d9f/fe9 to d0/d3d/d14/d21/d8a/da2/da3/dac/ff9 0 2024-09-10T10:04:24.223 INFO:tasks.workunit.client.1.smithi107.stdout:7/646: dread d0/d8/dc/f71 [0,4194304] 0 2024-09-10T10:04:24.225 INFO:tasks.workunit.client.1.smithi107.stdout:7/647: write d0/d8/d56/f9e [4961087,11936] 0 2024-09-10T10:04:24.228 INFO:tasks.workunit.client.1.smithi107.stdout:0/678: write d6/d8/d2f/d35/d3c/f41 [4360133,77403] 0 2024-09-10T10:04:24.228 INFO:tasks.workunit.client.1.smithi107.stdout:6/709: getdents d0/d3d/d14/dde 0 2024-09-10T10:04:24.228 INFO:tasks.workunit.client.1.smithi107.stdout:5/716: truncate f8 5037833 0 2024-09-10T10:04:24.229 INFO:tasks.workunit.client.1.smithi107.stdout:7/648: rmdir d0/d8/d5c 39 2024-09-10T10:04:24.231 INFO:tasks.workunit.client.1.smithi107.stdout:0/679: symlink d6/d8/d2f/d2e/d32/ld5 0 2024-09-10T10:04:24.231 INFO:tasks.workunit.client.1.smithi107.stdout:2/741: dwrite d3/da/d1e/d40/d8a/d7f/f44 [0,4194304] 0 2024-09-10T10:04:24.232 INFO:tasks.workunit.client.1.smithi107.stdout:5/717: mkdir de/d4a/d5c/d6d/df1 0 2024-09-10T10:04:24.232 INFO:tasks.workunit.client.1.smithi107.stdout:2/742: chown d3/da/df/d20/d36/d39/fb2 9123545 1 2024-09-10T10:04:24.234 INFO:tasks.workunit.client.1.smithi107.stdout:6/710: symlink d0/d3d/d14/d21/d8a/da7/lfa 0 2024-09-10T10:04:24.236 INFO:tasks.workunit.client.1.smithi107.stdout:5/718: stat de/ced 0 2024-09-10T10:04:24.236 INFO:tasks.workunit.client.1.smithi107.stdout:5/719: write f9 [3796824,95943] 0 2024-09-10T10:04:24.240 INFO:tasks.workunit.client.1.smithi107.stdout:2/743: dread d3/d21/d79/fbe [0,4194304] 0 2024-09-10T10:04:24.244 INFO:tasks.workunit.client.1.smithi107.stdout:0/680: rename d6/d8/d3e/d43/l6d to d6/d8/d2f/d2e/ld6 0 2024-09-10T10:04:24.244 INFO:tasks.workunit.client.1.smithi107.stdout:6/711: link d0/d3d/d14/d42/le6 d0/df0/lfb 0 2024-09-10T10:04:24.246 INFO:tasks.workunit.client.1.smithi107.stdout:2/744: link d3/d21/d79/f93 d3/da/d66/d91/dea/df7/f108 0 2024-09-10T10:04:24.248 INFO:tasks.workunit.client.1.smithi107.stdout:0/681: rename d6/d8/d2f/d2e/d32/d85/fbf to d6/d8/d2f/d2e/d32/d85/d8a/fd7 0 2024-09-10T10:04:24.252 INFO:tasks.workunit.client.1.smithi107.stdout:0/682: creat d6/d8/d2f/d2e/d32/d95/dce/fd8 x:0 0 0 2024-09-10T10:04:24.254 INFO:tasks.workunit.client.1.smithi107.stdout:0/683: symlink d6/d8/d3e/d43/dc7/ld9 0 2024-09-10T10:04:24.287 INFO:tasks.workunit.client.1.smithi107.stdout:5/720: write de/f90 [81795,104346] 0 2024-09-10T10:04:24.287 INFO:tasks.workunit.client.1.smithi107.stdout:5/721: symlink de/d4a/d7e/d79/lf2 0 2024-09-10T10:04:24.287 INFO:tasks.workunit.client.1.smithi107.stdout:0/684: dread - d6/d8/d2f/d35/d3c/d58/d86/f87 zero size 2024-09-10T10:04:24.287 INFO:tasks.workunit.client.1.smithi107.stdout:6/712: dwrite d0/d3d/d14/d9f/dca/fad [0,4194304] 0 2024-09-10T10:04:24.287 INFO:tasks.workunit.client.1.smithi107.stdout:5/722: truncate de/f2d 1029997 0 2024-09-10T10:04:24.287 INFO:tasks.workunit.client.1.smithi107.stdout:0/685: dwrite d6/d5a/da9/fa7 [0,4194304] 0 2024-09-10T10:04:24.288 INFO:tasks.workunit.client.1.smithi107.stdout:5/723: chown de/d4a/d5c/ce8 105551178 1 2024-09-10T10:04:24.288 INFO:tasks.workunit.client.1.smithi107.stdout:5/724: mknod de/d4a/cf3 0 2024-09-10T10:04:24.288 INFO:tasks.workunit.client.1.smithi107.stdout:6/713: fsync d0/d3d/d14/d21/f25 0 2024-09-10T10:04:24.288 INFO:tasks.workunit.client.1.smithi107.stdout:0/686: rename d6/d8/d2f/d2e/d32/d95/dce/ld4 to d6/d8/d2f/d35/d3c/d58/lda 0 2024-09-10T10:04:24.288 INFO:tasks.workunit.client.1.smithi107.stdout:6/714: link d0/d3d/d14/d42/fa9 d0/d3d/d14/d21/d8a/da7/ffc 0 2024-09-10T10:04:24.288 INFO:tasks.workunit.client.1.smithi107.stdout:6/715: creat d0/d3d/d14/d21/d8a/da2/ffd x:0 0 0 2024-09-10T10:04:24.288 INFO:tasks.workunit.client.0.smithi071.stdout:5/540: sync 2024-09-10T10:04:24.289 INFO:tasks.workunit.client.0.smithi071.stdout:0/678: sync 2024-09-10T10:04:24.289 INFO:tasks.workunit.client.0.smithi071.stdout:3/619: sync 2024-09-10T10:04:24.289 INFO:tasks.workunit.client.0.smithi071.stdout:6/570: sync 2024-09-10T10:04:24.289 INFO:tasks.workunit.client.0.smithi071.stdout:7/798: sync 2024-09-10T10:04:24.289 INFO:tasks.workunit.client.0.smithi071.stdout:4/598: sync 2024-09-10T10:04:24.289 INFO:tasks.workunit.client.0.smithi071.stdout:1/692: sync 2024-09-10T10:04:24.289 INFO:tasks.workunit.client.0.smithi071.stdout:6/571: chown d4/da/c35 26235 1 2024-09-10T10:04:24.289 INFO:tasks.workunit.client.0.smithi071.stdout:1/693: readlink d1/d21/d2f/d81/de4/lde 0 2024-09-10T10:04:24.289 INFO:tasks.workunit.client.0.smithi071.stdout:0/679: write d11/d22/d31/fc2 [849786,24927] 0 2024-09-10T10:04:24.289 INFO:tasks.workunit.client.0.smithi071.stdout:3/620: readlink d3/d1c/d3c/da1/d42/d4a/lc5 0 2024-09-10T10:04:24.289 INFO:tasks.workunit.client.0.smithi071.stdout:4/599: creat db/da0/fc4 x:0 0 0 2024-09-10T10:04:24.289 INFO:tasks.workunit.client.0.smithi071.stdout:6/572: read - d4/d61/fa4 zero size 2024-09-10T10:04:24.289 INFO:tasks.workunit.client.0.smithi071.stdout:7/799: write d9/d15/d1f/d98/fd1 [194187,21700] 0 2024-09-10T10:04:24.290 INFO:tasks.workunit.client.0.smithi071.stdout:6/573: chown d4/d1c/c78 774858 1 2024-09-10T10:04:24.290 INFO:tasks.workunit.client.0.smithi071.stdout:3/621: write d3/d10/fa3 [3666409,114871] 0 2024-09-10T10:04:24.290 INFO:tasks.workunit.client.0.smithi071.stdout:0/680: dread d11/d22/d31/f92 [0,4194304] 0 2024-09-10T10:04:24.290 INFO:tasks.workunit.client.0.smithi071.stdout:7/800: dwrite d9/d70/fa3 [0,4194304] 0 2024-09-10T10:04:24.290 INFO:tasks.workunit.client.0.smithi071.stdout:6/574: readlink d4/d61/d83/lad 0 2024-09-10T10:04:24.290 INFO:tasks.workunit.client.0.smithi071.stdout:7/801: write d9/d2c/f93 [843626,36620] 0 2024-09-10T10:04:24.290 INFO:tasks.workunit.client.0.smithi071.stdout:3/622: read d3/f8c [1540426,111585] 0 2024-09-10T10:04:24.290 INFO:tasks.workunit.client.0.smithi071.stdout:0/681: mkdir d11/d30/d52/d79/df8 0 2024-09-10T10:04:24.291 INFO:tasks.workunit.client.0.smithi071.stdout:4/600: dwrite db/d15/d26/d43/f66 [0,4194304] 0 2024-09-10T10:04:24.292 INFO:tasks.workunit.client.0.smithi071.stdout:6/575: unlink d4/d61/l7f 0 2024-09-10T10:04:24.293 INFO:tasks.workunit.client.1.smithi107.stdout:6/716: dwrite d0/d3d/d14/d17/d24/df3/d55/d56/f84 [0,4194304] 0 2024-09-10T10:04:24.293 INFO:tasks.workunit.client.0.smithi071.stdout:7/802: mknod d9/d11/d91/c115 0 2024-09-10T10:04:24.293 INFO:tasks.workunit.client.0.smithi071.stdout:3/623: write d3/d1c/d3c/da1/d3a/f45 [2579220,76364] 0 2024-09-10T10:04:24.294 INFO:tasks.workunit.client.0.smithi071.stdout:4/601: truncate db/d8f/fb1 129267 0 2024-09-10T10:04:24.295 INFO:tasks.workunit.client.0.smithi071.stdout:0/682: symlink d11/d22/d31/d72/lf9 0 2024-09-10T10:04:24.297 INFO:tasks.workunit.client.1.smithi107.stdout:6/717: mknod d0/d3d/d14/d42/d88/cfe 0 2024-09-10T10:04:24.298 INFO:tasks.workunit.client.0.smithi071.stdout:7/803: dread - d9/d15/d40/d80/ddd/de2/de3/fee zero size 2024-09-10T10:04:24.300 INFO:tasks.workunit.client.0.smithi071.stdout:5/541: dread f6 [0,4194304] 0 2024-09-10T10:04:24.305 INFO:tasks.workunit.client.0.smithi071.stdout:6/576: creat d4/da/df/d2e/d3a/d3e/d5d/d81/db2/fb6 x:0 0 0 2024-09-10T10:04:24.306 INFO:tasks.workunit.client.0.smithi071.stdout:6/577: write d4/f38 [2971803,113427] 0 2024-09-10T10:04:24.308 INFO:tasks.workunit.client.0.smithi071.stdout:7/804: symlink d9/d2c/l116 0 2024-09-10T10:04:24.309 INFO:tasks.workunit.client.0.smithi071.stdout:1/694: dwrite d1/d21/f24 [0,4194304] 0 2024-09-10T10:04:24.310 INFO:tasks.workunit.client.1.smithi107.stdout:6/718: dwrite d0/d3d/d14/d21/f33 [0,4194304] 0 2024-09-10T10:04:24.312 INFO:tasks.workunit.client.0.smithi071.stdout:1/695: symlink d1/d21/d3d/lf3 0 2024-09-10T10:04:24.312 INFO:tasks.workunit.client.1.smithi107.stdout:6/719: write d0/d70/ff8 [682211,52198] 0 2024-09-10T10:04:24.314 INFO:tasks.workunit.client.0.smithi071.stdout:3/624: creat d3/d1c/d3c/da1/d5d/d8f/fd9 x:0 0 0 2024-09-10T10:04:24.314 INFO:tasks.workunit.client.0.smithi071.stdout:6/578: symlink d4/lb7 0 2024-09-10T10:04:24.315 INFO:tasks.workunit.client.0.smithi071.stdout:1/696: readlink d1/l1b 0 2024-09-10T10:04:24.316 INFO:tasks.workunit.client.0.smithi071.stdout:3/625: stat d3/d20/f2c 0 2024-09-10T10:04:24.316 INFO:tasks.workunit.client.0.smithi071.stdout:7/805: symlink d9/d76/l117 0 2024-09-10T10:04:24.316 INFO:tasks.workunit.client.1.smithi107.stdout:5/725: dwrite de/d20/fcd [0,4194304] 0 2024-09-10T10:04:24.317 INFO:tasks.workunit.client.0.smithi071.stdout:3/626: chown d3/d1c/d3c/da1/d3a/dc0 248 1 2024-09-10T10:04:24.318 INFO:tasks.workunit.client.0.smithi071.stdout:5/542: link dc/df/d17/d22/l39 dc/df/lbc 0 2024-09-10T10:04:24.320 INFO:tasks.workunit.client.0.smithi071.stdout:6/579: write d4/da/df/d2e/d3a/d43/f4c [3737965,61108] 0 2024-09-10T10:04:24.320 INFO:tasks.workunit.client.0.smithi071.stdout:1/697: symlink d1/d21/d2f/d30/d75/d97/lf4 0 2024-09-10T10:04:24.321 INFO:tasks.workunit.client.1.smithi107.stdout:0/687: dwrite d6/d8/d2f/d2e/d32/f5d [0,4194304] 0 2024-09-10T10:04:24.322 INFO:tasks.workunit.client.0.smithi071.stdout:3/627: symlink d3/d10/d24/lda 0 2024-09-10T10:04:24.323 INFO:tasks.workunit.client.0.smithi071.stdout:6/580: creat d4/fb8 x:0 0 0 2024-09-10T10:04:24.328 INFO:tasks.workunit.client.0.smithi071.stdout:0/683: rename d11/d30/d52 to d11/d1e/dfa 0 2024-09-10T10:04:24.329 INFO:tasks.workunit.client.1.smithi107.stdout:6/720: creat d0/d3d/d14/d17/d24/df3/d55/fff x:0 0 0 2024-09-10T10:04:24.331 INFO:tasks.workunit.client.1.smithi107.stdout:6/721: write d0/d3d/d14/d17/fb4 [5156974,57322] 0 2024-09-10T10:04:24.331 INFO:tasks.workunit.client.0.smithi071.stdout:6/581: unlink d4/d20/f9d 0 2024-09-10T10:04:24.335 INFO:tasks.workunit.client.1.smithi107.stdout:1/816: sync 2024-09-10T10:04:24.335 INFO:tasks.workunit.client.1.smithi107.stdout:4/855: sync 2024-09-10T10:04:24.335 INFO:tasks.workunit.client.1.smithi107.stdout:0/688: truncate d6/d8/d3e/d43/f79 742233 0 2024-09-10T10:04:24.336 INFO:tasks.workunit.client.0.smithi071.stdout:1/698: fsync d1/d70/d76/f99 0 2024-09-10T10:04:24.336 INFO:tasks.workunit.client.1.smithi107.stdout:1/817: dread - d2/d12/d5a/fe4 zero size 2024-09-10T10:04:24.337 INFO:tasks.workunit.client.0.smithi071.stdout:7/806: rename d9/d15/d40/d80/ddd/de2/de3 to d9/d15/d1f/d74/da1/dcf/dfe/d108/d10c/d118 0 2024-09-10T10:04:24.337 INFO:tasks.workunit.client.1.smithi107.stdout:4/856: fdatasync d0/d40/d57/d4f/f61 0 2024-09-10T10:04:24.338 INFO:tasks.workunit.client.0.smithi071.stdout:1/699: chown d1/d35/fb7 9470 1 2024-09-10T10:04:24.342 INFO:tasks.workunit.client.0.smithi071.stdout:1/700: chown d1/d57/fc6 933 1 2024-09-10T10:04:24.342 INFO:tasks.workunit.client.1.smithi107.stdout:6/722: dwrite d0/d3d/f64 [0,4194304] 0 2024-09-10T10:04:24.343 INFO:tasks.workunit.client.0.smithi071.stdout:6/582: dwrite d4/d61/fa4 [0,4194304] 0 2024-09-10T10:04:24.345 INFO:tasks.workunit.client.0.smithi071.stdout:3/628: link d3/d1c/d3c/da1/d3a/dbd/fc7 d3/d1c/d3c/da1/d5d/d8f/fdb 0 2024-09-10T10:04:24.346 INFO:tasks.workunit.client.1.smithi107.stdout:4/857: dread d0/d1f/f66 [0,4194304] 0 2024-09-10T10:04:24.346 INFO:tasks.workunit.client.1.smithi107.stdout:0/689: mkdir d6/d8/d2f/d6e/dc5/ddb 0 2024-09-10T10:04:24.347 INFO:tasks.workunit.client.0.smithi071.stdout:4/602: dread db/d15/d26/d43/d82/f83 [0,4194304] 0 2024-09-10T10:04:24.347 INFO:tasks.workunit.client.0.smithi071.stdout:1/701: symlink d1/d3f/lf5 0 2024-09-10T10:04:24.348 INFO:tasks.workunit.client.1.smithi107.stdout:0/690: fsync d6/d8/d2f/d2e/d32/d95/dce/fd8 0 2024-09-10T10:04:24.348 INFO:tasks.workunit.client.0.smithi071.stdout:1/702: stat d1/d21/d2f/d30/d75/l8a 0 2024-09-10T10:04:24.351 INFO:tasks.workunit.client.0.smithi071.stdout:5/543: link dc/c83 dc/df/d17/d22/cbd 0 2024-09-10T10:04:24.351 INFO:tasks.workunit.client.1.smithi107.stdout:6/723: mkdir d0/d3d/d14/d21/d8a/da7/dc9/d100 0 2024-09-10T10:04:24.352 INFO:tasks.workunit.client.1.smithi107.stdout:4/858: rmdir d0/d1f/d20 39 2024-09-10T10:04:24.353 INFO:tasks.workunit.client.0.smithi071.stdout:2/734: sync 2024-09-10T10:04:24.353 INFO:tasks.workunit.client.0.smithi071.stdout:6/583: write d4/d1c/f4d [8789596,99071] 0 2024-09-10T10:04:24.353 INFO:tasks.workunit.client.0.smithi071.stdout:2/735: chown d8/d87 6982122 1 2024-09-10T10:04:24.357 INFO:tasks.workunit.client.0.smithi071.stdout:7/807: truncate d9/d11/de8/ff6 1913527 0 2024-09-10T10:04:24.357 INFO:tasks.workunit.client.1.smithi107.stdout:4/859: unlink d0/d40/d57/d76/d77/f98 0 2024-09-10T10:04:24.358 INFO:tasks.workunit.client.0.smithi071.stdout:6/584: chown d4/d61/d83/faf 1245 1 2024-09-10T10:04:24.359 INFO:tasks.workunit.client.0.smithi071.stdout:6/585: write d4/da/f82 [1518317,60093] 0 2024-09-10T10:04:24.360 INFO:tasks.workunit.client.1.smithi107.stdout:6/724: rename d0/d3d/d14/d9f/fd2 to d0/d3d/d14/d17/d24/f101 0 2024-09-10T10:04:24.360 INFO:tasks.workunit.client.0.smithi071.stdout:7/808: symlink d9/d15/d1f/d74/d9b/dd8/l119 0 2024-09-10T10:04:24.361 INFO:tasks.workunit.client.0.smithi071.stdout:4/603: dwrite db/d15/d26/d43/f66 [0,4194304] 0 2024-09-10T10:04:24.362 INFO:tasks.workunit.client.0.smithi071.stdout:5/544: link dc/l76 dc/d53/d6a/lbe 0 2024-09-10T10:04:24.364 INFO:tasks.workunit.client.1.smithi107.stdout:4/860: dwrite d0/d6b/f96 [0,4194304] 0 2024-09-10T10:04:24.364 INFO:tasks.workunit.client.0.smithi071.stdout:1/703: rename d1/l10 to d1/d57/dbf/lf6 0 2024-09-10T10:04:24.365 INFO:tasks.workunit.client.0.smithi071.stdout:7/809: creat d9/d1a/da2/f11a x:0 0 0 2024-09-10T10:04:24.365 INFO:tasks.workunit.client.0.smithi071.stdout:4/604: dread - db/d15/d26/d43/d4d/f2f zero size 2024-09-10T10:04:24.367 INFO:tasks.workunit.client.0.smithi071.stdout:6/586: mkdir d4/da/df/d2e/d3a/d3e/d5d/d81/db2/db9 0 2024-09-10T10:04:24.369 INFO:tasks.workunit.client.0.smithi071.stdout:2/736: rename d8/d87/c27 to d8/d87/d49/d66/df0/cf3 0 2024-09-10T10:04:24.370 INFO:tasks.workunit.client.1.smithi107.stdout:4/861: unlink d0/d40/d57/d76/d77/da1/cd0 0 2024-09-10T10:04:24.371 INFO:tasks.workunit.client.0.smithi071.stdout:7/810: symlink d9/d15/d1f/d98/l11b 0 2024-09-10T10:04:24.374 INFO:tasks.workunit.client.1.smithi107.stdout:5/726: write de/d20/f2c [952554,130772] 0 2024-09-10T10:04:24.375 INFO:tasks.workunit.client.0.smithi071.stdout:0/684: getdents d11/d30 0 2024-09-10T10:04:24.377 INFO:tasks.workunit.client.1.smithi107.stdout:5/727: fdatasync de/d20/d2b/f3e 0 2024-09-10T10:04:24.378 INFO:tasks.workunit.client.0.smithi071.stdout:4/605: creat db/d15/d17/d24/db6/fc5 x:0 0 0 2024-09-10T10:04:24.381 INFO:tasks.workunit.client.0.smithi071.stdout:6/587: unlink d4/da/df/d2e/f32 0 2024-09-10T10:04:24.381 INFO:tasks.workunit.client.0.smithi071.stdout:4/606: read - db/d15/f9e zero size 2024-09-10T10:04:24.382 INFO:tasks.workunit.client.1.smithi107.stdout:5/728: symlink de/d4a/d5c/d6d/lf4 0 2024-09-10T10:04:24.383 INFO:tasks.workunit.client.0.smithi071.stdout:2/737: creat d8/d87/dc4/ff4 x:0 0 0 2024-09-10T10:04:24.384 INFO:tasks.workunit.client.0.smithi071.stdout:2/738: readlink d8/d38/d47/d59/l71 0 2024-09-10T10:04:24.387 INFO:tasks.workunit.client.0.smithi071.stdout:4/607: symlink db/d1d/d61/lc6 0 2024-09-10T10:04:24.387 INFO:tasks.workunit.client.1.smithi107.stdout:1/818: dwrite d2/d12/d65/d6b/f74 [0,4194304] 0 2024-09-10T10:04:24.387 INFO:tasks.workunit.client.0.smithi071.stdout:2/739: fdatasync d8/d38/d47/fb9 0 2024-09-10T10:04:24.389 INFO:tasks.workunit.client.1.smithi107.stdout:0/691: write d6/d8/d2f/d2e/d32/f71 [1901727,74087] 0 2024-09-10T10:04:24.391 INFO:tasks.workunit.client.1.smithi107.stdout:0/692: chown d6/d8/d2f/d2e/d32/f71 76139652 1 2024-09-10T10:04:24.395 INFO:tasks.workunit.client.0.smithi071.stdout:2/740: write d8/f80 [5685138,2480] 0 2024-09-10T10:04:24.396 INFO:tasks.workunit.client.1.smithi107.stdout:6/725: dwrite d0/d3d/d14/d21/f25 [0,4194304] 0 2024-09-10T10:04:24.396 INFO:tasks.workunit.client.1.smithi107.stdout:5/729: rename de/db3/db6/fe7 to de/d4a/d5c/ff5 0 2024-09-10T10:04:24.397 INFO:tasks.workunit.client.0.smithi071.stdout:2/741: write d8/d38/d47/f5f [5050241,97091] 0 2024-09-10T10:04:24.400 INFO:tasks.workunit.client.1.smithi107.stdout:5/730: dread - de/db3/fd1 zero size 2024-09-10T10:04:24.402 INFO:tasks.workunit.client.1.smithi107.stdout:0/693: creat d6/d8/d2f/d35/d3c/d58/fdc x:0 0 0 2024-09-10T10:04:24.404 INFO:tasks.workunit.client.1.smithi107.stdout:6/726: mkdir d0/d3d/d14/d17/d4b/d102 0 2024-09-10T10:04:24.405 INFO:tasks.workunit.client.0.smithi071.stdout:0/685: dread d11/d1e/dfa/f80 [0,4194304] 0 2024-09-10T10:04:24.407 INFO:tasks.workunit.client.1.smithi107.stdout:1/819: getdents d2/d36 0 2024-09-10T10:04:24.409 INFO:tasks.workunit.client.0.smithi071.stdout:1/704: chown d1/d21/d2f/d30/d75/d97/df1 348306 1 2024-09-10T10:04:24.412 INFO:tasks.workunit.client.1.smithi107.stdout:1/820: mknod d2/d35/cff 0 2024-09-10T10:04:24.417 INFO:tasks.workunit.client.0.smithi071.stdout:4/608: truncate db/f1b 2586221 0 2024-09-10T10:04:24.419 INFO:tasks.workunit.client.0.smithi071.stdout:2/742: rename d8/d87/d33/d41/d4d/d5e/f7d to d8/d87/d33/dde/ff5 0 2024-09-10T10:04:24.421 INFO:tasks.workunit.client.0.smithi071.stdout:2/743: mknod d8/d87/d33/d53/cf6 0 2024-09-10T10:04:24.423 INFO:tasks.workunit.client.1.smithi107.stdout:1/821: creat d2/d12/d65/db4/dd9/ddd/f100 x:0 0 0 2024-09-10T10:04:24.428 INFO:tasks.workunit.client.1.smithi107.stdout:0/694: write d6/d8/d2f/d35/d3c/f7a [2449663,93035] 0 2024-09-10T10:04:24.428 INFO:tasks.workunit.client.1.smithi107.stdout:6/727: write d0/d3d/d14/d17/d24/df3/d55/d73/f93 [5129372,112933] 0 2024-09-10T10:04:24.432 INFO:tasks.workunit.client.0.smithi071.stdout:1/705: dwrite d1/d35/dea/ff2 [0,4194304] 0 2024-09-10T10:04:24.433 INFO:tasks.workunit.client.1.smithi107.stdout:6/728: rmdir d0/d3d/d14/d17/d24 39 2024-09-10T10:04:24.433 INFO:tasks.workunit.client.1.smithi107.stdout:5/731: dwrite de/f2d [0,4194304] 0 2024-09-10T10:04:24.434 INFO:tasks.workunit.client.0.smithi071.stdout:0/686: dread d11/d1e/dfa/fc9 [0,4194304] 0 2024-09-10T10:04:24.436 INFO:tasks.workunit.client.1.smithi107.stdout:5/732: truncate de/f3b 4644624 0 2024-09-10T10:04:24.437 INFO:tasks.workunit.client.1.smithi107.stdout:0/695: dread d6/d5a/da9/fa7 [0,4194304] 0 2024-09-10T10:04:24.437 INFO:tasks.workunit.client.0.smithi071.stdout:1/706: creat d1/d21/d2f/d81/ff7 x:0 0 0 2024-09-10T10:04:24.438 INFO:tasks.workunit.client.0.smithi071.stdout:4/609: dread db/d1d/f38 [0,4194304] 0 2024-09-10T10:04:24.438 INFO:tasks.workunit.client.0.smithi071.stdout:2/744: dread d8/f28 [0,4194304] 0 2024-09-10T10:04:24.439 INFO:tasks.workunit.client.1.smithi107.stdout:5/733: read de/d4a/d4e/d89/d99/fac [2855447,34653] 0 2024-09-10T10:04:24.444 INFO:tasks.workunit.client.1.smithi107.stdout:5/734: read de/f1e [1879646,294] 0 2024-09-10T10:04:24.445 INFO:tasks.workunit.client.1.smithi107.stdout:1/822: dread d2/d12/f3c [0,4194304] 0 2024-09-10T10:04:24.445 INFO:tasks.workunit.client.0.smithi071.stdout:1/707: rename d1/ce2 to d1/d57/cf8 0 2024-09-10T10:04:24.446 INFO:tasks.workunit.client.1.smithi107.stdout:6/729: rename d0/d3d/d14/d17/d24/df3/d55/d56/f84 to d0/d3d/d14/d17/d24/df3/f103 0 2024-09-10T10:04:24.447 INFO:tasks.workunit.client.0.smithi071.stdout:0/687: getdents d11/d22/d31 0 2024-09-10T10:04:24.447 INFO:tasks.workunit.client.0.smithi071.stdout:2/745: creat d8/d87/dad/dd1/ff7 x:0 0 0 2024-09-10T10:04:24.447 INFO:tasks.workunit.client.0.smithi071.stdout:4/610: mkdir db/d15/d17/dc7 0 2024-09-10T10:04:24.448 INFO:tasks.workunit.client.0.smithi071.stdout:0/688: chown d11/l19 1333150 1 2024-09-10T10:04:24.448 INFO:tasks.workunit.client.0.smithi071.stdout:4/611: dread - db/d1d/d7a/fb4 zero size 2024-09-10T10:04:24.449 INFO:tasks.workunit.client.0.smithi071.stdout:4/612: fdatasync f3 0 2024-09-10T10:04:24.449 INFO:tasks.workunit.client.1.smithi107.stdout:5/735: mknod de/d20/d2b/cf6 0 2024-09-10T10:04:24.449 INFO:tasks.workunit.client.0.smithi071.stdout:0/689: chown d11/d22/d40/df6 6 1 2024-09-10T10:04:24.450 INFO:tasks.workunit.client.0.smithi071.stdout:2/746: symlink d8/d4a/lf8 0 2024-09-10T10:04:24.451 INFO:tasks.workunit.client.0.smithi071.stdout:0/690: readlink d11/l37 0 2024-09-10T10:04:24.452 INFO:tasks.workunit.client.1.smithi107.stdout:1/823: rename d2/ff1 to d2/dcc/dea/df2/f101 0 2024-09-10T10:04:24.453 INFO:tasks.workunit.client.1.smithi107.stdout:6/730: dread d0/d3d/d14/d9f/dca/fad [0,4194304] 0 2024-09-10T10:04:24.454 INFO:tasks.workunit.client.0.smithi071.stdout:4/613: rename db/cd to db/d1d/d61/d6a/d88/cc8 0 2024-09-10T10:04:24.455 INFO:tasks.workunit.client.1.smithi107.stdout:1/824: unlink d2/d12/c15 0 2024-09-10T10:04:24.457 INFO:tasks.workunit.client.1.smithi107.stdout:5/736: truncate de/d4a/d4e/d89/d99/fac 3125908 0 2024-09-10T10:04:24.458 INFO:tasks.workunit.client.1.smithi107.stdout:5/737: write de/d4a/d4e/fa9 [520573,109411] 0 2024-09-10T10:04:24.459 INFO:tasks.workunit.client.1.smithi107.stdout:1/825: mknod d2/d6/d24/d81/c102 0 2024-09-10T10:04:24.460 INFO:tasks.workunit.client.0.smithi071.stdout:0/691: creat d11/d30/d70/de2/ffb x:0 0 0 2024-09-10T10:04:24.461 INFO:tasks.workunit.client.0.smithi071.stdout:4/614: symlink db/d15/lc9 0 2024-09-10T10:04:24.464 INFO:tasks.workunit.client.0.smithi071.stdout:0/692: link d11/d30/f45 d11/ffc 0 2024-09-10T10:04:24.464 INFO:tasks.workunit.client.0.smithi071.stdout:0/693: readlink d11/l46 0 2024-09-10T10:04:24.465 INFO:tasks.workunit.client.1.smithi107.stdout:1/826: mkdir d2/d12/d65/db4/dd9/d103 0 2024-09-10T10:04:24.465 INFO:tasks.workunit.client.0.smithi071.stdout:0/694: write d11/d1e/dfa/d5f/fd6 [466208,4247] 0 2024-09-10T10:04:24.467 INFO:tasks.workunit.client.0.smithi071.stdout:0/695: truncate d11/d1e/dfa/d79/fbe 656448 0 2024-09-10T10:04:24.469 INFO:tasks.workunit.client.0.smithi071.stdout:0/696: creat d11/d22/d9a/ddf/ffd x:0 0 0 2024-09-10T10:04:24.469 INFO:tasks.workunit.client.1.smithi107.stdout:6/731: dwrite d0/d3d/d14/d9f/dca/f86 [0,4194304] 0 2024-09-10T10:04:24.472 INFO:tasks.workunit.client.1.smithi107.stdout:1/827: rename d2/f93 to d2/d35/f104 0 2024-09-10T10:04:24.473 INFO:tasks.workunit.client.0.smithi071.stdout:1/708: rename d1/d21/d2f/d81 to d1/d21/d3d/d9a/df9 0 2024-09-10T10:04:24.475 INFO:tasks.workunit.client.1.smithi107.stdout:6/732: stat d0/d3d/d14/d17/c20 0 2024-09-10T10:04:24.478 INFO:tasks.workunit.client.1.smithi107.stdout:6/733: read d0/d3d/d14/d42/fc8 [27609,101851] 0 2024-09-10T10:04:24.479 INFO:tasks.workunit.client.0.smithi071.stdout:1/709: rename d1/d21/d3d/d9a/df9/de4/db6/le8 to d1/d21/d3d/d9a/df9/de4/db6/lfa 0 2024-09-10T10:04:24.480 INFO:tasks.workunit.client.0.smithi071.stdout:1/710: write d1/d21/d65/f25 [4140383,59098] 0 2024-09-10T10:04:24.480 INFO:tasks.workunit.client.0.smithi071.stdout:4/615: rename db/l1c to db/d15/d17/d4e/dc0/dc2/lca 0 2024-09-10T10:04:24.482 INFO:tasks.workunit.client.1.smithi107.stdout:6/734: symlink d0/d3d/d14/d9f/l104 0 2024-09-10T10:04:24.486 INFO:tasks.workunit.client.1.smithi107.stdout:6/735: unlink d0/d76/fb8 0 2024-09-10T10:04:24.487 INFO:tasks.workunit.client.0.smithi071.stdout:2/747: write d8/d87/d33/d41/d4d/d5e/fd4 [915166,106770] 0 2024-09-10T10:04:24.488 INFO:tasks.workunit.client.1.smithi107.stdout:5/738: dread de/d20/d3d/f4c [0,4194304] 0 2024-09-10T10:04:24.488 INFO:tasks.workunit.client.1.smithi107.stdout:5/739: fdatasync f9 0 2024-09-10T10:04:24.489 INFO:tasks.workunit.client.1.smithi107.stdout:6/736: read d0/d3d/d14/d21/f53 [1259428,81782] 0 2024-09-10T10:04:24.489 INFO:tasks.workunit.client.1.smithi107.stdout:1/828: dread d2/d6/fa [4194304,4194304] 0 2024-09-10T10:04:24.491 INFO:tasks.workunit.client.1.smithi107.stdout:5/740: write de/d4a/d4e/fe1 [4159075,130059] 0 2024-09-10T10:04:24.491 INFO:tasks.workunit.client.0.smithi071.stdout:1/711: rename d1/d35/fb0 to d1/d21/d2f/ffb 0 2024-09-10T10:04:24.492 INFO:tasks.workunit.client.0.smithi071.stdout:1/712: chown d1/d35/fb7 2217733 1 2024-09-10T10:04:24.494 INFO:tasks.workunit.client.1.smithi107.stdout:1/829: mkdir d2/d12/d65/db4/dd9/ddd/d105 0 2024-09-10T10:04:24.495 INFO:tasks.workunit.client.0.smithi071.stdout:0/697: dwrite d11/d1e/f58 [0,4194304] 0 2024-09-10T10:04:24.497 INFO:tasks.workunit.client.1.smithi107.stdout:6/737: unlink d0/l39 0 2024-09-10T10:04:24.498 INFO:tasks.workunit.client.0.smithi071.stdout:2/748: truncate d8/d24/fa5 1512681 0 2024-09-10T10:04:24.501 INFO:tasks.workunit.client.0.smithi071.stdout:0/698: link d11/d1e/dfa/d79/f7a d11/d22/d31/d72/ffe 0 2024-09-10T10:04:24.501 INFO:tasks.workunit.client.1.smithi107.stdout:5/741: symlink de/d4a/d7e/db2/lf7 0 2024-09-10T10:04:24.502 INFO:tasks.workunit.client.0.smithi071.stdout:2/749: creat d8/d38/d8d/ff9 x:0 0 0 2024-09-10T10:04:24.503 INFO:tasks.workunit.client.0.smithi071.stdout:1/713: creat d1/d3f/d58/ffc x:0 0 0 2024-09-10T10:04:24.503 INFO:tasks.workunit.client.0.smithi071.stdout:0/699: chown d11/d22/f29 48 1 2024-09-10T10:04:24.503 INFO:tasks.workunit.client.0.smithi071.stdout:2/750: chown d8/d87/d51/c73 337730 1 2024-09-10T10:04:24.505 INFO:tasks.workunit.client.0.smithi071.stdout:1/714: write d1/d3f/f84 [3518154,116648] 0 2024-09-10T10:04:24.505 INFO:tasks.workunit.client.1.smithi107.stdout:1/830: rename d2/d36/dbc to d2/d6/dc6/dd4/d106 0 2024-09-10T10:04:24.506 INFO:tasks.workunit.client.0.smithi071.stdout:0/700: symlink d11/d1e/dfa/d5f/lff 0 2024-09-10T10:04:24.506 INFO:tasks.workunit.client.1.smithi107.stdout:1/831: write d2/d36/f4d [3511585,113204] 0 2024-09-10T10:04:24.509 INFO:tasks.workunit.client.1.smithi107.stdout:6/738: creat d0/d3d/d14/d17/d24/df3/d55/d56/f105 x:0 0 0 2024-09-10T10:04:24.511 INFO:tasks.workunit.client.1.smithi107.stdout:6/739: fsync d0/d3d/d14/d9f/dca/fd4 0 2024-09-10T10:04:24.512 INFO:tasks.workunit.client.1.smithi107.stdout:9/695: sync 2024-09-10T10:04:24.513 INFO:tasks.workunit.client.1.smithi107.stdout:8/609: sync 2024-09-10T10:04:24.513 INFO:tasks.workunit.client.1.smithi107.stdout:7/649: sync 2024-09-10T10:04:24.513 INFO:tasks.workunit.client.0.smithi071.stdout:2/751: dwrite d8/d87/dad/dd1/ff7 [0,4194304] 0 2024-09-10T10:04:24.515 INFO:tasks.workunit.client.1.smithi107.stdout:1/832: dwrite d2/d6/d67/fbb [0,4194304] 0 2024-09-10T10:04:24.516 INFO:tasks.workunit.client.0.smithi071.stdout:2/752: creat d8/d4a/ffa x:0 0 0 2024-09-10T10:04:24.518 INFO:tasks.workunit.client.1.smithi107.stdout:1/833: chown d2/ldb 22 1 2024-09-10T10:04:24.519 INFO:tasks.workunit.client.1.smithi107.stdout:8/610: symlink d5/d8/d66/d8e/lc8 0 2024-09-10T10:04:24.522 INFO:tasks.workunit.client.0.smithi071.stdout:2/753: mknod d8/db6/de7/cfb 0 2024-09-10T10:04:24.523 INFO:tasks.workunit.client.0.smithi071.stdout:2/754: chown d8/d87/dc4/ff4 1494 1 2024-09-10T10:04:24.524 INFO:tasks.workunit.client.1.smithi107.stdout:1/834: mknod d2/d6/dc6/c107 0 2024-09-10T10:04:24.525 INFO:tasks.workunit.client.1.smithi107.stdout:7/650: creat d0/d1b/d4d/d69/d97/d95/fcd x:0 0 0 2024-09-10T10:04:24.526 INFO:tasks.workunit.client.1.smithi107.stdout:8/611: dread - d5/d8/d66/d8b/d18/fbe zero size 2024-09-10T10:04:24.527 INFO:tasks.workunit.client.0.smithi071.stdout:8/616: sync 2024-09-10T10:04:24.528 INFO:tasks.workunit.client.1.smithi107.stdout:8/612: readlink d5/d8/d66/d8b/d21/d83/l33 0 2024-09-10T10:04:24.529 INFO:tasks.workunit.client.0.smithi071.stdout:2/755: fdatasync d8/f94 0 2024-09-10T10:04:24.530 INFO:tasks.workunit.client.1.smithi107.stdout:7/651: read d0/d1b/d4d/f6b [3239464,24022] 0 2024-09-10T10:04:24.531 INFO:tasks.workunit.client.1.smithi107.stdout:7/652: fsync d0/d8/f32 0 2024-09-10T10:04:24.533 INFO:tasks.workunit.client.1.smithi107.stdout:8/613: creat d5/d8/d66/d8b/d21/d83/fc9 x:0 0 0 2024-09-10T10:04:24.535 INFO:tasks.workunit.client.0.smithi071.stdout:8/617: dwrite d5/d36/f39 [0,4194304] 0 2024-09-10T10:04:24.536 INFO:tasks.workunit.client.1.smithi107.stdout:1/835: creat d2/d12/d65/db4/dd9/d103/f108 x:0 0 0 2024-09-10T10:04:24.537 INFO:tasks.workunit.client.0.smithi071.stdout:8/618: chown d5/df/d1e/d70/fd0 243 1 2024-09-10T10:04:24.539 INFO:tasks.workunit.client.1.smithi107.stdout:1/836: truncate d2/d36/f4d 9074203 0 2024-09-10T10:04:24.540 INFO:tasks.workunit.client.0.smithi071.stdout:2/756: dwrite d8/d87/d33/f3c [0,4194304] 0 2024-09-10T10:04:24.544 INFO:tasks.workunit.client.1.smithi107.stdout:7/653: rename d0/d8/dc/d2c/f6e to d0/d1b/d9d/fce 0 2024-09-10T10:04:24.546 INFO:tasks.workunit.client.1.smithi107.stdout:5/742: dwrite de/d20/d2b/faf [0,4194304] 0 2024-09-10T10:04:24.546 INFO:tasks.workunit.client.0.smithi071.stdout:8/619: dwrite d5/df/d57/d82/fca [0,4194304] 0 2024-09-10T10:04:24.547 INFO:tasks.workunit.client.0.smithi071.stdout:0/701: dread d11/d22/f4f [0,4194304] 0 2024-09-10T10:04:24.549 INFO:tasks.workunit.client.0.smithi071.stdout:2/757: symlink d8/d38/d47/d59/d65/lfc 0 2024-09-10T10:04:24.549 INFO:tasks.workunit.client.1.smithi107.stdout:6/740: write d0/d3d/d14/d17/d4b/f5c [443334,88879] 0 2024-09-10T10:04:24.551 INFO:tasks.workunit.client.1.smithi107.stdout:8/614: rename d5/d8/d66/d8b/d1a/f43 to d5/d8/d66/fca 0 2024-09-10T10:04:24.553 INFO:tasks.workunit.client.1.smithi107.stdout:7/654: write d0/d8/f6f [3314674,48815] 0 2024-09-10T10:04:24.555 INFO:tasks.workunit.client.0.smithi071.stdout:0/702: mkdir d11/d22/dde/d100 0 2024-09-10T10:04:24.556 INFO:tasks.workunit.client.0.smithi071.stdout:8/620: dread - d5/df/d1d/d86/d75/d85/f98 zero size 2024-09-10T10:04:24.557 INFO:tasks.workunit.client.0.smithi071.stdout:2/758: fsync d8/d24/fa5 0 2024-09-10T10:04:24.560 INFO:tasks.workunit.client.0.smithi071.stdout:0/703: getdents d11/d1e/dfa/d79/df8 0 2024-09-10T10:04:24.561 INFO:tasks.workunit.client.0.smithi071.stdout:0/704: readlink d11/d1e/dfa/d79/ddc/lf5 0 2024-09-10T10:04:24.561 INFO:tasks.workunit.client.0.smithi071.stdout:8/621: mknod d5/df/d1e/d70/cd5 0 2024-09-10T10:04:24.562 INFO:tasks.workunit.client.0.smithi071.stdout:2/759: creat d8/d38/d99/ffd x:0 0 0 2024-09-10T10:04:24.566 INFO:tasks.workunit.client.0.smithi071.stdout:0/705: creat d11/d22/f101 x:0 0 0 2024-09-10T10:04:24.567 INFO:tasks.workunit.client.0.smithi071.stdout:8/622: mkdir d5/df/d1d/d86/d90/db4/dd6 0 2024-09-10T10:04:24.568 INFO:tasks.workunit.client.0.smithi071.stdout:0/706: mknod d11/d1e/dfa/c102 0 2024-09-10T10:04:24.569 INFO:tasks.workunit.client.0.smithi071.stdout:8/623: readlink d5/d36/d49/lbe 0 2024-09-10T10:04:24.571 INFO:tasks.workunit.client.0.smithi071.stdout:0/707: mkdir d11/d22/d31/d72/df3/d103 0 2024-09-10T10:04:24.573 INFO:tasks.workunit.client.0.smithi071.stdout:8/624: rename d5/df/d1d/d86/f63 to d5/df/d1e/d38/d9f/fd7 0 2024-09-10T10:04:24.575 INFO:tasks.workunit.client.0.smithi071.stdout:0/708: mknod d11/d1e/dfa/d79/ddc/c104 0 2024-09-10T10:04:24.579 INFO:tasks.workunit.client.0.smithi071.stdout:0/709: rename d11/d1e/c51 to d11/d1e/dfa/d79/df8/c105 0 2024-09-10T10:04:24.586 INFO:tasks.workunit.client.0.smithi071.stdout:2/760: dwrite d8/d38/d8d/f98 [0,4194304] 0 2024-09-10T10:04:24.590 INFO:tasks.workunit.client.0.smithi071.stdout:2/761: symlink d8/lfe 0 2024-09-10T10:04:24.596 INFO:tasks.workunit.client.0.smithi071.stdout:8/625: dread d5/d36/f41 [0,4194304] 0 2024-09-10T10:04:24.596 INFO:tasks.workunit.client.0.smithi071.stdout:0/710: dwrite d11/d1e/dfa/d5f/f95 [0,4194304] 0 2024-09-10T10:04:24.597 INFO:tasks.workunit.client.0.smithi071.stdout:0/711: stat d11/d1e/c5a 0 2024-09-10T10:04:24.597 INFO:tasks.workunit.client.0.smithi071.stdout:8/626: truncate d5/fd2 889667 0 2024-09-10T10:04:24.599 INFO:tasks.workunit.client.0.smithi071.stdout:0/712: mkdir d11/d22/d9a/d106 0 2024-09-10T10:04:24.601 INFO:tasks.workunit.client.0.smithi071.stdout:8/627: creat d5/d36/d49/fd8 x:0 0 0 2024-09-10T10:04:24.605 INFO:tasks.workunit.client.0.smithi071.stdout:2/762: write d8/d4a/fab [655493,95356] 0 2024-09-10T10:04:24.607 INFO:tasks.workunit.client.0.smithi071.stdout:2/763: chown d8/d24/l3f 16806481 1 2024-09-10T10:04:24.609 INFO:tasks.workunit.client.0.smithi071.stdout:8/628: dwrite d5/df/d1d/f92 [0,4194304] 0 2024-09-10T10:04:24.612 INFO:tasks.workunit.client.0.smithi071.stdout:8/629: creat d5/df/d1e/d70/fd9 x:0 0 0 2024-09-10T10:04:24.614 INFO:tasks.workunit.client.0.smithi071.stdout:2/764: dwrite d8/f10 [0,4194304] 0 2024-09-10T10:04:24.616 INFO:tasks.workunit.client.1.smithi107.stdout:8/615: chown d5/da2/lc4 5 1 2024-09-10T10:04:24.616 INFO:tasks.workunit.client.0.smithi071.stdout:2/765: fdatasync d8/d38/d47/d59/d65/f79 0 2024-09-10T10:04:24.620 INFO:tasks.workunit.client.1.smithi107.stdout:8/616: mkdir d5/d8/d2a/d35/d85/dcb 0 2024-09-10T10:04:24.620 INFO:tasks.workunit.client.1.smithi107.stdout:6/741: creat d0/d3d/d14/f106 x:0 0 0 2024-09-10T10:04:24.621 INFO:tasks.workunit.client.0.smithi071.stdout:2/766: symlink d8/d4a/lff 0 2024-09-10T10:04:24.622 INFO:tasks.workunit.client.0.smithi071.stdout:2/767: write d8/d24/dda/fe0 [752271,67810] 0 2024-09-10T10:04:24.622 INFO:tasks.workunit.client.0.smithi071.stdout:0/713: dread d11/d1e/dfa/d5f/f77 [0,4194304] 0 2024-09-10T10:04:24.623 INFO:tasks.workunit.client.0.smithi071.stdout:0/714: dread - d11/d22/d9a/ddf/fe5 zero size 2024-09-10T10:04:24.624 INFO:tasks.workunit.client.1.smithi107.stdout:7/655: rename d0/f4 to d0/fcf 0 2024-09-10T10:04:24.625 INFO:tasks.workunit.client.0.smithi071.stdout:0/715: write d11/d22/d40/fc8 [743195,9776] 0 2024-09-10T10:04:24.627 INFO:tasks.workunit.client.1.smithi107.stdout:9/696: dread d5/d7/d1d/d9b/dab/d57/d87/d27/f51 [0,4194304] 0 2024-09-10T10:04:24.628 INFO:tasks.workunit.client.1.smithi107.stdout:5/743: dwrite de/d4a/d7e/d79/f7d [0,4194304] 0 2024-09-10T10:04:24.629 INFO:tasks.workunit.client.0.smithi071.stdout:2/768: truncate d8/d38/d47/d59/f7b 165050 0 2024-09-10T10:04:24.632 INFO:tasks.workunit.client.1.smithi107.stdout:7/656: mkdir d0/d1b/d9d/dd0 0 2024-09-10T10:04:24.636 INFO:tasks.workunit.client.0.smithi071.stdout:8/630: dread d5/f45 [0,4194304] 0 2024-09-10T10:04:24.639 INFO:tasks.workunit.client.0.smithi071.stdout:8/631: creat d5/df/d1e/fda x:0 0 0 2024-09-10T10:04:24.641 INFO:tasks.workunit.client.0.smithi071.stdout:8/632: creat d5/d36/d49/fdb x:0 0 0 2024-09-10T10:04:24.642 INFO:tasks.workunit.client.0.smithi071.stdout:8/633: chown d5/df/d67/la2 13418 1 2024-09-10T10:04:24.643 INFO:tasks.workunit.client.0.smithi071.stdout:8/634: chown d5/df/d1d/c2b 470815220 1 2024-09-10T10:04:24.644 INFO:tasks.workunit.client.0.smithi071.stdout:8/635: rmdir d5/df/d1d 39 2024-09-10T10:04:24.646 INFO:tasks.workunit.client.0.smithi071.stdout:8/636: mknod d5/d30/cdc 0 2024-09-10T10:04:24.647 INFO:tasks.workunit.client.0.smithi071.stdout:8/637: read d5/df/d1e/d38/d9f/fbb [1327414,39177] 0 2024-09-10T10:04:24.649 INFO:tasks.workunit.client.0.smithi071.stdout:8/638: stat d5/df/d1d/f93 0 2024-09-10T10:04:24.650 INFO:tasks.workunit.client.0.smithi071.stdout:8/639: write d5/d30/f3c [109706,23675] 0 2024-09-10T10:04:24.651 INFO:tasks.workunit.client.0.smithi071.stdout:8/640: fsync d5/d36/d49/fb8 0 2024-09-10T10:04:24.653 INFO:tasks.workunit.client.0.smithi071.stdout:2/769: write d8/f94 [2422746,62883] 0 2024-09-10T10:04:24.654 INFO:tasks.workunit.client.0.smithi071.stdout:8/641: rmdir d5/df/d1d/d86/d75/d85 39 2024-09-10T10:04:24.656 INFO:tasks.workunit.client.0.smithi071.stdout:8/642: symlink d5/df/d1d/d86/d90/db4/ldd 0 2024-09-10T10:04:24.657 INFO:tasks.workunit.client.0.smithi071.stdout:0/716: dwrite d11/d22/d31/f49 [0,4194304] 0 2024-09-10T10:04:24.658 INFO:tasks.workunit.client.0.smithi071.stdout:2/770: creat d8/d87/d49/f100 x:0 0 0 2024-09-10T10:04:24.660 INFO:tasks.workunit.client.0.smithi071.stdout:8/643: mknod d5/df/d95/cde 0 2024-09-10T10:04:24.664 INFO:tasks.workunit.client.0.smithi071.stdout:0/717: link d11/d1e/dfa/d79/fe4 d11/d22/d31/d72/df3/f107 0 2024-09-10T10:04:24.666 INFO:tasks.workunit.client.0.smithi071.stdout:0/718: symlink d11/d22/d40/l108 0 2024-09-10T10:04:24.667 INFO:tasks.workunit.client.0.smithi071.stdout:8/644: dwrite d5/d36/d49/fb8 [0,4194304] 0 2024-09-10T10:04:24.669 INFO:tasks.workunit.client.0.smithi071.stdout:0/719: read f7 [736263,13889] 0 2024-09-10T10:04:24.673 INFO:tasks.workunit.client.0.smithi071.stdout:0/720: unlink d11/d22/d40/l59 0 2024-09-10T10:04:24.674 INFO:tasks.workunit.client.0.smithi071.stdout:8/645: dwrite d5/df/d1e/d38/f99 [0,4194304] 0 2024-09-10T10:04:24.676 INFO:tasks.workunit.client.0.smithi071.stdout:0/721: truncate d11/d30/d70/fe1 828827 0 2024-09-10T10:04:24.676 INFO:tasks.workunit.client.0.smithi071.stdout:2/771: dread d8/d38/f70 [0,4194304] 0 2024-09-10T10:04:24.678 INFO:tasks.workunit.client.0.smithi071.stdout:8/646: symlink d5/df/d1e/d70/dc7/ldf 0 2024-09-10T10:04:24.678 INFO:tasks.workunit.client.0.smithi071.stdout:0/722: rmdir d11/d22/d31 39 2024-09-10T10:04:24.680 INFO:tasks.workunit.client.0.smithi071.stdout:2/772: creat d8/d87/d49/d66/df0/f101 x:0 0 0 2024-09-10T10:04:24.682 INFO:tasks.workunit.client.0.smithi071.stdout:0/723: unlink cb 0 2024-09-10T10:04:24.684 INFO:tasks.workunit.client.0.smithi071.stdout:2/773: symlink d8/d87/d33/d41/d4d/d5e/l102 0 2024-09-10T10:04:24.685 INFO:tasks.workunit.client.0.smithi071.stdout:8/647: creat d5/df/d1d/d86/d75/fe0 x:0 0 0 2024-09-10T10:04:24.687 INFO:tasks.workunit.client.0.smithi071.stdout:8/648: creat d5/df/d67/fe1 x:0 0 0 2024-09-10T10:04:24.689 INFO:tasks.workunit.client.0.smithi071.stdout:0/724: dwrite d11/d22/d9a/ddf/fe5 [0,4194304] 0 2024-09-10T10:04:24.689 INFO:tasks.workunit.client.0.smithi071.stdout:2/774: unlink d8/d87/d33/d41/d4d/d5e/fbc 0 2024-09-10T10:04:24.697 INFO:tasks.workunit.client.0.smithi071.stdout:0/725: dwrite d11/f14 [4194304,4194304] 0 2024-09-10T10:04:24.704 INFO:tasks.workunit.client.1.smithi107.stdout:2/745: sync 2024-09-10T10:04:24.731 INFO:tasks.workunit.client.1.smithi107.stdout:0/696: sync 2024-09-10T10:04:24.732 INFO:tasks.workunit.client.1.smithi107.stdout:4/862: sync 2024-09-10T10:04:24.733 INFO:tasks.workunit.client.1.smithi107.stdout:0/697: truncate d6/d8/d2f/d2e/d32/d95/fb6 308509 0 2024-09-10T10:04:24.742 INFO:tasks.workunit.client.1.smithi107.stdout:6/742: rename d0/d3d/d14/d17/d24/df3/d55/d73/l8f to d0/d3d/d14/d17/d24/dc5/l107 0 2024-09-10T10:04:24.745 INFO:tasks.workunit.client.1.smithi107.stdout:9/697: mkdir d5/d1e/dc5/de3 0 2024-09-10T10:04:24.745 INFO:tasks.workunit.client.1.smithi107.stdout:8/617: write d5/d8/f6d [1406679,125790] 0 2024-09-10T10:04:24.746 INFO:tasks.workunit.client.1.smithi107.stdout:5/744: symlink de/d20/d2b/d4b/d8c/lf8 0 2024-09-10T10:04:24.748 INFO:tasks.workunit.client.1.smithi107.stdout:0/698: symlink d6/d14/d93/ldd 0 2024-09-10T10:04:24.749 INFO:tasks.workunit.client.1.smithi107.stdout:7/657: mkdir d0/d8/dd1 0 2024-09-10T10:04:24.751 INFO:tasks.workunit.client.1.smithi107.stdout:9/698: readlink d5/d7/lf 0 2024-09-10T10:04:24.752 INFO:tasks.workunit.client.1.smithi107.stdout:5/745: creat de/d4a/ff9 x:0 0 0 2024-09-10T10:04:24.755 INFO:tasks.workunit.client.1.smithi107.stdout:7/658: creat d0/d8/d56/d5d/fd2 x:0 0 0 2024-09-10T10:04:24.756 INFO:tasks.workunit.client.1.smithi107.stdout:7/659: chown d0/d8/d56/l62 1 1 2024-09-10T10:04:24.757 INFO:tasks.workunit.client.0.smithi071.stdout:0/726: dwrite d11/d22/d31/f49 [0,4194304] 0 2024-09-10T10:04:24.758 INFO:tasks.workunit.client.1.smithi107.stdout:9/699: fsync d5/d7/d1d/d9b/dab/d57/f8a 0 2024-09-10T10:04:24.760 INFO:tasks.workunit.client.0.smithi071.stdout:8/649: dwrite d5/df/d1d/d81/d9b/fd3 [0,4194304] 0 2024-09-10T10:04:24.764 INFO:tasks.workunit.client.1.smithi107.stdout:9/700: stat d5/d7/d1d/d9b/dab/d57/d87/fc4 0 2024-09-10T10:04:24.767 INFO:tasks.workunit.client.1.smithi107.stdout:7/660: truncate d0/d1b/d4d/d69/d97/f30 102873 0 2024-09-10T10:04:24.767 INFO:tasks.workunit.client.1.smithi107.stdout:2/746: dwrite d3/da/d1e/d40/f9f [0,4194304] 0 2024-09-10T10:04:24.770 INFO:tasks.workunit.client.1.smithi107.stdout:0/699: write d6/d8/d2f/d35/f8f [855692,73649] 0 2024-09-10T10:04:24.770 INFO:tasks.workunit.client.1.smithi107.stdout:2/747: readlink d3/d21/l2b 0 2024-09-10T10:04:24.772 INFO:tasks.workunit.client.1.smithi107.stdout:2/748: dread - d3/da/d1e/d40/d8a/d7f/fb9 zero size 2024-09-10T10:04:24.772 INFO:tasks.workunit.client.1.smithi107.stdout:9/701: truncate d5/d7/d1d/d9b/dab/d57/f69 1512606 0 2024-09-10T10:04:24.772 INFO:tasks.workunit.client.1.smithi107.stdout:8/618: rename d5/d8/d66/d8b/d18/da4/lb6 to d5/d8/lcc 0 2024-09-10T10:04:24.775 INFO:tasks.workunit.client.1.smithi107.stdout:0/700: getdents d6/d8/d2f/d6e/dc5/ddb 0 2024-09-10T10:04:24.780 INFO:tasks.workunit.client.1.smithi107.stdout:0/701: symlink d6/d8/d2f/d35/d3c/d58/d86/lde 0 2024-09-10T10:04:24.783 INFO:tasks.workunit.client.1.smithi107.stdout:9/702: rename d5/la2 to d5/d7/d1d/d41/d83/d9a/d8c/le4 0 2024-09-10T10:04:24.786 INFO:tasks.workunit.client.1.smithi107.stdout:5/746: dwrite de/d20/d2b/d4b/d5e/f93 [0,4194304] 0 2024-09-10T10:04:24.787 INFO:tasks.workunit.client.0.smithi071.stdout:0/727: dread - d11/d22/d9a/fd5 zero size 2024-09-10T10:04:24.788 INFO:tasks.workunit.client.1.smithi107.stdout:6/743: dread d0/d3d/d14/d42/f4e [0,4194304] 0 2024-09-10T10:04:24.790 INFO:tasks.workunit.client.1.smithi107.stdout:0/702: write d6/d8/d2f/d2e/d32/d59/f67 [1479313,7127] 0 2024-09-10T10:04:24.791 INFO:tasks.workunit.client.1.smithi107.stdout:2/749: creat d3/da/d1e/d40/d8a/d7f/d55/f109 x:0 0 0 2024-09-10T10:04:24.796 INFO:tasks.workunit.client.1.smithi107.stdout:0/703: mkdir d6/d8/d2f/d2e/d32/d56/ddf 0 2024-09-10T10:04:24.797 INFO:tasks.workunit.client.1.smithi107.stdout:0/704: rename d6/d8/d2f to d6/d8/d2f/d2e/d32/d85/d8a/de0 22 2024-09-10T10:04:24.798 INFO:tasks.workunit.client.0.smithi071.stdout:8/650: dread d5/d30/fc6 [0,4194304] 0 2024-09-10T10:04:24.799 INFO:tasks.workunit.client.1.smithi107.stdout:6/744: unlink d0/d3d/fe1 0 2024-09-10T10:04:24.800 INFO:tasks.workunit.client.1.smithi107.stdout:7/661: write d0/d1b/d4d/f6b [4867867,99372] 0 2024-09-10T10:04:24.801 INFO:tasks.workunit.client.0.smithi071.stdout:0/728: unlink d11/c1d 0 2024-09-10T10:04:24.801 INFO:tasks.workunit.client.1.smithi107.stdout:2/750: mknod d3/da/d66/db7/c10a 0 2024-09-10T10:04:24.802 INFO:tasks.workunit.client.0.smithi071.stdout:0/729: read d11/d1e/dfa/f53 [3888241,89095] 0 2024-09-10T10:04:24.803 INFO:tasks.workunit.client.1.smithi107.stdout:7/662: write d0/f2b [1920658,103285] 0 2024-09-10T10:04:24.804 INFO:tasks.workunit.client.1.smithi107.stdout:2/751: dread - d3/da/d66/d91/ffa zero size 2024-09-10T10:04:24.806 INFO:tasks.workunit.client.1.smithi107.stdout:5/747: unlink de/f9b 0 2024-09-10T10:04:24.807 INFO:tasks.workunit.client.0.smithi071.stdout:0/730: mkdir d11/d1e/dfa/d79/ddc/d109 0 2024-09-10T10:04:24.810 INFO:tasks.workunit.client.1.smithi107.stdout:6/745: mknod d0/d3d/d14/d17/d24/df3/d55/d56/c108 0 2024-09-10T10:04:24.810 INFO:tasks.workunit.client.0.smithi071.stdout:0/731: creat d11/d1e/dfa/d79/ddc/d109/f10a x:0 0 0 2024-09-10T10:04:24.811 INFO:tasks.workunit.client.0.smithi071.stdout:0/732: chown d11/d1e/dfa/f53 26525 1 2024-09-10T10:04:24.811 INFO:tasks.workunit.client.1.smithi107.stdout:6/746: stat d0/d70/fc3 0 2024-09-10T10:04:24.812 INFO:tasks.workunit.client.1.smithi107.stdout:8/619: dwrite d5/d8/d2a/f5d [0,4194304] 0 2024-09-10T10:04:24.815 INFO:tasks.workunit.client.1.smithi107.stdout:2/752: creat d3/d8f/df4/f10b x:0 0 0 2024-09-10T10:04:24.816 INFO:tasks.workunit.client.1.smithi107.stdout:5/748: truncate de/f28 3103915 0 2024-09-10T10:04:24.820 INFO:tasks.workunit.client.1.smithi107.stdout:7/663: creat d0/d1b/d4d/fd3 x:0 0 0 2024-09-10T10:04:24.820 INFO:tasks.workunit.client.1.smithi107.stdout:8/620: dread d5/d8/d66/d8b/d21/f3c [0,4194304] 0 2024-09-10T10:04:24.821 INFO:tasks.workunit.client.1.smithi107.stdout:2/753: mkdir d3/da/d66/d91/d10c 0 2024-09-10T10:04:24.826 INFO:tasks.workunit.client.1.smithi107.stdout:2/754: creat d3/da/df/d20/d36/d39/da3/f10d x:0 0 0 2024-09-10T10:04:24.827 INFO:tasks.workunit.client.1.smithi107.stdout:8/621: symlink d5/lcd 0 2024-09-10T10:04:24.832 INFO:tasks.workunit.client.1.smithi107.stdout:8/622: read d5/d8/f34 [434827,124966] 0 2024-09-10T10:04:24.833 INFO:tasks.workunit.client.1.smithi107.stdout:7/664: creat d0/d8/dc/fd4 x:0 0 0 2024-09-10T10:04:24.834 INFO:tasks.workunit.client.1.smithi107.stdout:2/755: unlink d3/c69 0 2024-09-10T10:04:24.837 INFO:tasks.workunit.client.1.smithi107.stdout:7/665: chown d0/d8/d56/l62 792490 1 2024-09-10T10:04:24.842 INFO:tasks.workunit.client.1.smithi107.stdout:0/705: dwrite d6/d8/d2f/d2e/d7b/f8b [4194304,4194304] 0 2024-09-10T10:04:24.842 INFO:tasks.workunit.client.1.smithi107.stdout:0/706: dread - d6/d8/d2f/d2e/d32/d85/fbe zero size 2024-09-10T10:04:24.846 INFO:tasks.workunit.client.1.smithi107.stdout:2/756: chown d3/da/df/d20/d36/d4f/d92 44133 1 2024-09-10T10:04:24.846 INFO:tasks.workunit.client.1.smithi107.stdout:6/747: write d0/d3d/d14/d17/d24/df3/f5a [5896809,17636] 0 2024-09-10T10:04:24.848 INFO:tasks.workunit.client.1.smithi107.stdout:8/623: mknod d5/d8/d2a/d35/cce 0 2024-09-10T10:04:24.850 INFO:tasks.workunit.client.1.smithi107.stdout:0/707: mkdir d6/d8/d2f/d2e/d32/d95/dce/de1 0 2024-09-10T10:04:24.851 INFO:tasks.workunit.client.0.smithi071.stdout:0/733: getdents d11 0 2024-09-10T10:04:24.853 INFO:tasks.workunit.client.1.smithi107.stdout:2/757: write d3/da/df/d20/f33 [2580499,104793] 0 2024-09-10T10:04:24.854 INFO:tasks.workunit.client.0.smithi071.stdout:0/734: symlink d11/d1e/dfa/d5f/l10b 0 2024-09-10T10:04:24.855 INFO:tasks.workunit.client.1.smithi107.stdout:8/624: write d5/d8/d66/d8b/d18/f4b [2496812,74570] 0 2024-09-10T10:04:24.856 INFO:tasks.workunit.client.0.smithi071.stdout:0/735: stat d11/d22/d31/cc3 0 2024-09-10T10:04:24.858 INFO:tasks.workunit.client.0.smithi071.stdout:0/736: fsync d11/d30/d70/fa7 0 2024-09-10T10:04:24.859 INFO:tasks.workunit.client.0.smithi071.stdout:0/737: chown d11/c12 94 1 2024-09-10T10:04:24.859 INFO:tasks.workunit.client.1.smithi107.stdout:7/666: dwrite d0/d8/f31 [0,4194304] 0 2024-09-10T10:04:24.862 INFO:tasks.workunit.client.1.smithi107.stdout:8/625: write d5/d8/f34 [2304654,116301] 0 2024-09-10T10:04:24.863 INFO:tasks.workunit.client.0.smithi071.stdout:0/738: read d11/d22/d9a/fab [63922,88168] 0 2024-09-10T10:04:24.869 INFO:tasks.workunit.client.1.smithi107.stdout:8/626: creat d5/d8/d66/d8b/d21/d83/fcf x:0 0 0 2024-09-10T10:04:24.870 INFO:tasks.workunit.client.1.smithi107.stdout:2/758: dread d3/da/df/f15 [0,4194304] 0 2024-09-10T10:04:24.871 INFO:tasks.workunit.client.1.smithi107.stdout:1/837: sync 2024-09-10T10:04:24.871 INFO:tasks.workunit.client.0.smithi071.stdout:0/739: dwrite d11/d22/f97 [8388608,4194304] 0 2024-09-10T10:04:24.873 INFO:tasks.workunit.client.1.smithi107.stdout:8/627: dread - d5/d8/d66/d8b/d21/f3a zero size 2024-09-10T10:04:24.875 INFO:tasks.workunit.client.0.smithi071.stdout:0/740: symlink d11/d22/dde/d100/l10c 0 2024-09-10T10:04:24.875 INFO:tasks.workunit.client.1.smithi107.stdout:7/667: dwrite d0/d8/d5c/fbe [0,4194304] 0 2024-09-10T10:04:24.878 INFO:tasks.workunit.client.0.smithi071.stdout:0/741: fsync d11/d1e/dfa/d5f/f67 0 2024-09-10T10:04:24.879 INFO:tasks.workunit.client.1.smithi107.stdout:2/759: symlink d3/da/d1e/d40/d8a/d7f/d55/d85/l10e 0 2024-09-10T10:04:24.880 INFO:tasks.workunit.client.1.smithi107.stdout:8/628: fsync d5/d8/d2a/d35/d70/f95 0 2024-09-10T10:04:24.882 INFO:tasks.workunit.client.1.smithi107.stdout:0/708: dread d6/d8/d2f/d35/d3c/d58/d69/f88 [0,4194304] 0 2024-09-10T10:04:24.885 INFO:tasks.workunit.client.0.smithi071.stdout:0/742: getdents d11/d1e/dfa 0 2024-09-10T10:04:24.887 INFO:tasks.workunit.client.0.smithi071.stdout:0/743: mknod d11/d1e/dfa/d79/df8/c10d 0 2024-09-10T10:04:24.889 INFO:tasks.workunit.client.1.smithi107.stdout:8/629: symlink d5/da2/ld0 0 2024-09-10T10:04:24.890 INFO:tasks.workunit.client.1.smithi107.stdout:2/760: write d3/da/d66/d91/dea/ffd [1046626,106901] 0 2024-09-10T10:04:24.890 INFO:tasks.workunit.client.0.smithi071.stdout:0/744: creat d11/d1e/dfa/d5f/f10e x:0 0 0 2024-09-10T10:04:24.890 INFO:tasks.workunit.client.0.smithi071.stdout:3/629: sync 2024-09-10T10:04:24.891 INFO:tasks.workunit.client.1.smithi107.stdout:1/838: dwrite d2/d6/fd2 [0,4194304] 0 2024-09-10T10:04:24.891 INFO:tasks.workunit.client.0.smithi071.stdout:3/630: chown d3/c4 27 1 2024-09-10T10:04:24.893 INFO:tasks.workunit.client.1.smithi107.stdout:9/703: dread d5/d7/d1d/d9b/dab/f5d [0,4194304] 0 2024-09-10T10:04:24.894 INFO:tasks.workunit.client.0.smithi071.stdout:3/631: symlink d3/d20/d99/ldc 0 2024-09-10T10:04:24.894 INFO:tasks.workunit.client.1.smithi107.stdout:6/748: dread d0/d3d/d14/d21/fb3 [0,4194304] 0 2024-09-10T10:04:24.894 INFO:tasks.workunit.client.1.smithi107.stdout:8/630: readlink d5/d8/d66/d8b/d1a/d75/l9e 0 2024-09-10T10:04:24.895 INFO:tasks.workunit.client.0.smithi071.stdout:3/632: readlink d3/d1c/d3c/da1/d5d/d7a/l88 0 2024-09-10T10:04:24.898 INFO:tasks.workunit.client.0.smithi071.stdout:3/633: creat d3/fdd x:0 0 0 2024-09-10T10:04:24.898 INFO:tasks.workunit.client.1.smithi107.stdout:7/668: rename d0/d1b/d4d/c5b to d0/d8/dc/d2c/d47/cd5 0 2024-09-10T10:04:24.900 INFO:tasks.workunit.client.1.smithi107.stdout:9/704: mkdir d5/d7/d1d/d9b/de5 0 2024-09-10T10:04:24.901 INFO:tasks.workunit.client.1.smithi107.stdout:2/761: mkdir d3/da/df/d20/d36/d10f 0 2024-09-10T10:04:24.903 INFO:tasks.workunit.client.1.smithi107.stdout:7/669: readlink d0/d1b/d4d/d69/lc9 0 2024-09-10T10:04:24.904 INFO:tasks.workunit.client.1.smithi107.stdout:0/709: dwrite d6/d8/d2f/d2e/d7b/fa2 [0,4194304] 0 2024-09-10T10:04:24.904 INFO:tasks.workunit.client.1.smithi107.stdout:8/631: creat d5/d8/d2a/d35/d85/dcb/fd1 x:0 0 0 2024-09-10T10:04:24.912 INFO:tasks.workunit.client.1.smithi107.stdout:7/670: write d0/d8/dc/d2c/d47/fbd [975982,83503] 0 2024-09-10T10:04:24.912 INFO:tasks.workunit.client.0.smithi071.stdout:0/745: write d11/d1e/dfa/d5f/f96 [615285,39357] 0 2024-09-10T10:04:24.914 INFO:tasks.workunit.client.1.smithi107.stdout:9/705: creat d5/d7/d1d/d29/fe6 x:0 0 0 2024-09-10T10:04:24.915 INFO:tasks.workunit.client.0.smithi071.stdout:0/746: mknod d11/d1e/dfa/d79/df8/c10f 0 2024-09-10T10:04:24.917 INFO:tasks.workunit.client.1.smithi107.stdout:2/762: dwrite d3/da/d1e/d40/fc4 [0,4194304] 0 2024-09-10T10:04:24.917 INFO:tasks.workunit.client.1.smithi107.stdout:0/710: read d6/d8/d2f/d2e/d32/d56/f8c [1369987,77577] 0 2024-09-10T10:04:24.918 INFO:tasks.workunit.client.0.smithi071.stdout:3/634: chown d3/d10/f84 1040423 1 2024-09-10T10:04:24.918 INFO:tasks.workunit.client.1.smithi107.stdout:8/632: mknod d5/cd2 0 2024-09-10T10:04:24.918 INFO:tasks.workunit.client.1.smithi107.stdout:1/839: write d2/d6/d24/d81/fac [870208,29160] 0 2024-09-10T10:04:24.919 INFO:tasks.workunit.client.0.smithi071.stdout:0/747: creat d11/d1e/dfa/f110 x:0 0 0 2024-09-10T10:04:24.920 INFO:tasks.workunit.client.1.smithi107.stdout:6/749: dwrite d0/d3d/d14/d17/d24/f8e [4194304,4194304] 0 2024-09-10T10:04:24.921 INFO:tasks.workunit.client.1.smithi107.stdout:1/840: fdatasync d2/d6/fd2 0 2024-09-10T10:04:24.922 INFO:tasks.workunit.client.1.smithi107.stdout:0/711: read - d6/d8/d2f/da3/da5/fbc zero size 2024-09-10T10:04:24.923 INFO:tasks.workunit.client.1.smithi107.stdout:8/633: creat d5/da2/fd3 x:0 0 0 2024-09-10T10:04:24.923 INFO:tasks.workunit.client.1.smithi107.stdout:2/763: write d3/da/d1e/fe3 [585142,53653] 0 2024-09-10T10:04:24.925 INFO:tasks.workunit.client.0.smithi071.stdout:0/748: dwrite d11/d22/d31/f49 [0,4194304] 0 2024-09-10T10:04:24.927 INFO:tasks.workunit.client.1.smithi107.stdout:9/706: creat d5/d7/d1d/d9b/dab/d57/d87/d37/fe7 x:0 0 0 2024-09-10T10:04:24.928 INFO:tasks.workunit.client.1.smithi107.stdout:9/707: stat d5/d7/d1d/d41/dc8/lb9 0 2024-09-10T10:04:24.931 INFO:tasks.workunit.client.0.smithi071.stdout:0/749: chown d11/d22/d40/cc7 1 1 2024-09-10T10:04:24.932 INFO:tasks.workunit.client.1.smithi107.stdout:7/671: creat d0/d1b/d4d/d69/dca/fd6 x:0 0 0 2024-09-10T10:04:24.933 INFO:tasks.workunit.client.1.smithi107.stdout:0/712: rename d6/d8/d2f/d35/fb2 to d6/d14/d93/fe2 0 2024-09-10T10:04:24.934 INFO:tasks.workunit.client.1.smithi107.stdout:7/672: readlink d0/d1b/d9d/lb7 0 2024-09-10T10:04:24.935 INFO:tasks.workunit.client.0.smithi071.stdout:0/750: creat d11/d22/d9a/d106/f111 x:0 0 0 2024-09-10T10:04:24.937 INFO:tasks.workunit.client.1.smithi107.stdout:9/708: symlink d5/d7/d1d/d29/db4/dbd/le8 0 2024-09-10T10:04:24.938 INFO:tasks.workunit.client.1.smithi107.stdout:8/634: rename d5/d8/d2a/d35/d70/f8f to d5/d8/d66/d8b/d18/dab/fd4 0 2024-09-10T10:04:24.938 INFO:tasks.workunit.client.0.smithi071.stdout:0/751: symlink d11/d22/d9a/l112 0 2024-09-10T10:04:24.938 INFO:tasks.workunit.client.1.smithi107.stdout:7/673: symlink d0/d8/d5c/d6d/ld7 0 2024-09-10T10:04:24.940 INFO:tasks.workunit.client.1.smithi107.stdout:9/709: chown d5/d7/d1d/d9b/dab/d57/d87/d37 164 1 2024-09-10T10:04:24.940 INFO:tasks.workunit.client.1.smithi107.stdout:0/713: mknod d6/d8/d2f/d35/d3c/d58/d69/d84/ce3 0 2024-09-10T10:04:24.942 INFO:tasks.workunit.client.1.smithi107.stdout:0/714: stat d6/d8/l20 0 2024-09-10T10:04:24.943 INFO:tasks.workunit.client.1.smithi107.stdout:8/635: readlink d5/d8/d66/d8b/d18/dab/lad 0 2024-09-10T10:04:24.944 INFO:tasks.workunit.client.1.smithi107.stdout:2/764: dwrite d3/da/df/d20/d36/d4f/f50 [0,4194304] 0 2024-09-10T10:04:24.947 INFO:tasks.workunit.client.1.smithi107.stdout:7/674: mknod d0/d8/d56/dcc/d81/cd8 0 2024-09-10T10:04:24.948 INFO:tasks.workunit.client.1.smithi107.stdout:9/710: unlink d5/d7/d1d/d9b/dab/d57/d87/d27/fc1 0 2024-09-10T10:04:24.949 INFO:tasks.workunit.client.1.smithi107.stdout:0/715: mknod d6/d8/d2f/d6e/ce4 0 2024-09-10T10:04:24.955 INFO:tasks.workunit.client.1.smithi107.stdout:9/711: mknod d5/ce9 0 2024-09-10T10:04:24.957 INFO:tasks.workunit.client.1.smithi107.stdout:7/675: getdents d0/d20/d72 0 2024-09-10T10:04:24.962 INFO:tasks.workunit.client.1.smithi107.stdout:0/716: link d6/d14/l54 d6/d8/d2f/d2e/d32/d95/dce/de1/le5 0 2024-09-10T10:04:24.964 INFO:tasks.workunit.client.1.smithi107.stdout:7/676: creat d0/fd9 x:0 0 0 2024-09-10T10:04:24.965 INFO:tasks.workunit.client.1.smithi107.stdout:9/712: creat d5/d7/d1d/d9b/dab/d57/d87/fea x:0 0 0 2024-09-10T10:04:24.968 INFO:tasks.workunit.client.1.smithi107.stdout:0/717: rmdir d6/d8/d2f/d6e 39 2024-09-10T10:04:24.969 INFO:tasks.workunit.client.1.smithi107.stdout:6/750: dread d0/d3d/d14/d17/d4b/fe7 [0,4194304] 0 2024-09-10T10:04:24.970 INFO:tasks.workunit.client.1.smithi107.stdout:1/841: dread d2/d6/d67/f92 [0,4194304] 0 2024-09-10T10:04:24.970 INFO:tasks.workunit.client.1.smithi107.stdout:8/636: write d5/d8/d66/d8b/d21/f41 [723113,32638] 0 2024-09-10T10:04:24.971 INFO:tasks.workunit.client.0.smithi071.stdout:5/545: sync 2024-09-10T10:04:24.972 INFO:tasks.workunit.client.0.smithi071.stdout:0/752: unlink d11/d1e/dfa/d5f/ld7 0 2024-09-10T10:04:24.973 INFO:tasks.workunit.client.0.smithi071.stdout:3/635: dwrite d3/d49/d34/d67/f94 [0,4194304] 0 2024-09-10T10:04:24.973 INFO:tasks.workunit.client.1.smithi107.stdout:0/718: creat d6/d5a/da9/fe6 x:0 0 0 2024-09-10T10:04:24.974 INFO:tasks.workunit.client.0.smithi071.stdout:0/753: write d11/d22/f29 [5624244,102266] 0 2024-09-10T10:04:24.976 INFO:tasks.workunit.client.1.smithi107.stdout:1/842: write d2/d6/d24/d81/ff6 [474706,74962] 0 2024-09-10T10:04:24.977 INFO:tasks.workunit.client.1.smithi107.stdout:8/637: mknod d5/d42/cd5 0 2024-09-10T10:04:24.978 INFO:tasks.workunit.client.1.smithi107.stdout:6/751: unlink d0/d3d/d14/d42/fa9 0 2024-09-10T10:04:24.983 INFO:tasks.workunit.client.0.smithi071.stdout:5/546: rename dc/df/d29/ca0 to dc/df/d3e/d5a/d80/cbf 0 2024-09-10T10:04:24.984 INFO:tasks.workunit.client.1.smithi107.stdout:9/713: dread d5/d7/d1d/d9b/dab/d57/fd4 [0,4194304] 0 2024-09-10T10:04:24.984 INFO:tasks.workunit.client.0.smithi071.stdout:3/636: mkdir d3/d20/d99/d9b/dde 0 2024-09-10T10:04:24.984 INFO:tasks.workunit.client.1.smithi107.stdout:0/719: dwrite d6/d8/d2f/f33 [4194304,4194304] 0 2024-09-10T10:04:24.986 INFO:tasks.workunit.client.0.smithi071.stdout:5/547: creat dc/df/d29/d48/dae/fc0 x:0 0 0 2024-09-10T10:04:24.987 INFO:tasks.workunit.client.1.smithi107.stdout:6/752: unlink d0/d3d/d14/d17/d4b/f8c 0 2024-09-10T10:04:24.988 INFO:tasks.workunit.client.0.smithi071.stdout:3/637: chown d3/fa 0 1 2024-09-10T10:04:24.988 INFO:tasks.workunit.client.1.smithi107.stdout:0/720: symlink d6/d8/d2f/d35/d3c/le7 0 2024-09-10T10:04:24.991 INFO:tasks.workunit.client.1.smithi107.stdout:9/714: rename d5/d7/d1d/d9b/dab/f90 to d5/d7/d1d/d9b/dab/d57/d87/d27/feb 0 2024-09-10T10:04:24.992 INFO:tasks.workunit.client.0.smithi071.stdout:0/754: link d11/d1e/dfa/lba d11/d1e/dfa/d79/ddc/d109/l113 0 2024-09-10T10:04:24.997 INFO:tasks.workunit.client.1.smithi107.stdout:0/721: dwrite d6/d5a/d5c/fc9 [0,4194304] 0 2024-09-10T10:04:24.997 INFO:tasks.workunit.client.0.smithi071.stdout:0/755: dread d11/d22/d9a/fe8 [0,4194304] 0 2024-09-10T10:04:24.998 INFO:tasks.workunit.client.1.smithi107.stdout:7/677: truncate d0/d1b/d4d/d69/d97/d68/f58 3427787 0 2024-09-10T10:04:24.998 INFO:tasks.workunit.client.1.smithi107.stdout:0/722: write d6/f45 [742900,111327] 0 2024-09-10T10:04:24.999 INFO:tasks.workunit.client.0.smithi071.stdout:0/756: chown d11/d22/d31 838551492 1 2024-09-10T10:04:25.000 INFO:tasks.workunit.client.1.smithi107.stdout:8/638: write d5/d8/d66/fc1 [355191,16295] 0 2024-09-10T10:04:25.002 INFO:tasks.workunit.client.0.smithi071.stdout:0/757: fsync d11/d30/d70/faa 0 2024-09-10T10:04:25.003 INFO:tasks.workunit.client.1.smithi107.stdout:0/723: fdatasync d6/d8/d3e/d43/fb3 0 2024-09-10T10:04:25.003 INFO:tasks.workunit.client.0.smithi071.stdout:5/548: dwrite dc/df/d29/fa1 [0,4194304] 0 2024-09-10T10:04:25.005 INFO:tasks.workunit.client.0.smithi071.stdout:0/758: stat d11/d30/l36 0 2024-09-10T10:04:25.006 INFO:tasks.workunit.client.1.smithi107.stdout:7/678: creat d0/d1b/d4d/d69/dca/fda x:0 0 0 2024-09-10T10:04:25.006 INFO:tasks.workunit.client.1.smithi107.stdout:7/679: chown d0 10936 1 2024-09-10T10:04:25.006 INFO:tasks.workunit.client.0.smithi071.stdout:0/759: chown d11/d22/d31/fcc 5 1 2024-09-10T10:04:25.008 INFO:tasks.workunit.client.0.smithi071.stdout:5/549: truncate dc/d53/f60 702609 0 2024-09-10T10:04:25.008 INFO:tasks.workunit.client.1.smithi107.stdout:0/724: unlink d6/d8/d2f/l9a 0 2024-09-10T10:04:25.010 INFO:tasks.workunit.client.0.smithi071.stdout:5/550: chown dc/df/d29/l6c 97 1 2024-09-10T10:04:25.014 INFO:tasks.workunit.client.0.smithi071.stdout:0/760: creat d11/d1e/dfa/f114 x:0 0 0 2024-09-10T10:04:25.018 INFO:tasks.workunit.client.0.smithi071.stdout:3/638: dread d3/d49/d34/f75 [0,4194304] 0 2024-09-10T10:04:25.024 INFO:tasks.workunit.client.0.smithi071.stdout:0/761: dwrite d11/d1e/dfa/d5f/f77 [0,4194304] 0 2024-09-10T10:04:25.026 INFO:tasks.workunit.client.0.smithi071.stdout:3/639: dwrite d3/d10/d24/dab/fbb [0,4194304] 0 2024-09-10T10:04:25.028 INFO:tasks.workunit.client.0.smithi071.stdout:3/640: write d3/d20/f2c [888746,98965] 0 2024-09-10T10:04:25.033 INFO:tasks.workunit.client.1.smithi107.stdout:1/843: dread d2/d12/d65/d6b/f42 [4194304,4194304] 0 2024-09-10T10:04:25.035 INFO:tasks.workunit.client.0.smithi071.stdout:5/551: write dc/d4a/f5b [945128,19349] 0 2024-09-10T10:04:25.036 INFO:tasks.workunit.client.0.smithi071.stdout:3/641: dread d3/d1c/d3c/da1/fa9 [0,4194304] 0 2024-09-10T10:04:25.036 INFO:tasks.workunit.client.1.smithi107.stdout:1/844: truncate d2/d6/dc6/dd4/fec 35754 0 2024-09-10T10:04:25.037 INFO:tasks.workunit.client.1.smithi107.stdout:1/845: write d2/d6/fd2 [907132,82567] 0 2024-09-10T10:04:25.038 INFO:tasks.workunit.client.1.smithi107.stdout:1/846: fsync d2/d6/d24/f50 0 2024-09-10T10:04:25.038 INFO:tasks.workunit.client.0.smithi071.stdout:5/552: mknod dc/d53/d79/cc1 0 2024-09-10T10:04:25.039 INFO:tasks.workunit.client.0.smithi071.stdout:3/642: creat d3/d1c/d3c/da1/d5d/d7a/fdf x:0 0 0 2024-09-10T10:04:25.040 INFO:tasks.workunit.client.0.smithi071.stdout:0/762: dwrite d11/d30/f45 [0,4194304] 0 2024-09-10T10:04:25.045 INFO:tasks.workunit.client.0.smithi071.stdout:3/643: mkdir d3/d1c/d3e/de0 0 2024-09-10T10:04:25.048 INFO:tasks.workunit.client.1.smithi107.stdout:8/639: creat d5/d8/d2a/fd6 x:0 0 0 2024-09-10T10:04:25.049 INFO:tasks.workunit.client.0.smithi071.stdout:3/644: fsync d3/d1c/d3c/da1/d42/d4a/d60/d78/fac 0 2024-09-10T10:04:25.050 INFO:tasks.workunit.client.1.smithi107.stdout:8/640: truncate d5/d8/d66/d8b/fba 1009392 0 2024-09-10T10:04:25.051 INFO:tasks.workunit.client.0.smithi071.stdout:3/645: chown d3/f70 631 1 2024-09-10T10:04:25.052 INFO:tasks.workunit.client.1.smithi107.stdout:1/847: creat d2/dcc/dea/f109 x:0 0 0 2024-09-10T10:04:25.052 INFO:tasks.workunit.client.1.smithi107.stdout:6/753: truncate d0/d3d/d14/d21/f53 175678 0 2024-09-10T10:04:25.053 INFO:tasks.workunit.client.1.smithi107.stdout:7/680: creat d0/d8/d56/dcc/da0/fdb x:0 0 0 2024-09-10T10:04:25.053 INFO:tasks.workunit.client.1.smithi107.stdout:1/848: chown d2/d12/d7e/f7f 196 1 2024-09-10T10:04:25.054 INFO:tasks.workunit.client.1.smithi107.stdout:6/754: write d0/fd [683227,91417] 0 2024-09-10T10:04:25.055 INFO:tasks.workunit.client.0.smithi071.stdout:5/553: dread dc/fe [0,4194304] 0 2024-09-10T10:04:25.056 INFO:tasks.workunit.client.1.smithi107.stdout:6/755: write d0/d3d/d14/d21/fa0 [2199197,65062] 0 2024-09-10T10:04:25.058 INFO:tasks.workunit.client.0.smithi071.stdout:3/646: dwrite d3/d1c/f79 [0,4194304] 0 2024-09-10T10:04:25.061 INFO:tasks.workunit.client.0.smithi071.stdout:5/554: creat dc/df/d29/d48/dae/db6/fc2 x:0 0 0 2024-09-10T10:04:25.062 INFO:tasks.workunit.client.0.smithi071.stdout:3/647: creat d3/d1c/d3c/da1/d5d/d7a/fe1 x:0 0 0 2024-09-10T10:04:25.064 INFO:tasks.workunit.client.0.smithi071.stdout:3/648: mkdir d3/d49/d2f/d7f/de2 0 2024-09-10T10:04:25.066 INFO:tasks.workunit.client.0.smithi071.stdout:5/555: creat dc/df/d29/fc3 x:0 0 0 2024-09-10T10:04:25.067 INFO:tasks.workunit.client.0.smithi071.stdout:3/649: symlink d3/d20/d8d/le3 0 2024-09-10T10:04:25.070 INFO:tasks.workunit.client.0.smithi071.stdout:3/650: mknod d3/d1c/d3c/da1/d3a/dba/ce4 0 2024-09-10T10:04:25.073 INFO:tasks.workunit.client.0.smithi071.stdout:0/763: dread d11/d1e/dfa/f7e [0,4194304] 0 2024-09-10T10:04:25.073 INFO:tasks.workunit.client.0.smithi071.stdout:0/764: chown d11/d22 112917368 1 2024-09-10T10:04:25.075 INFO:tasks.workunit.client.0.smithi071.stdout:0/765: stat d11/d22/d31/d72/fb7 0 2024-09-10T10:04:25.075 INFO:tasks.workunit.client.0.smithi071.stdout:5/556: dwrite dc/df/d17/d22/d87/f92 [0,4194304] 0 2024-09-10T10:04:25.077 INFO:tasks.workunit.client.0.smithi071.stdout:3/651: truncate d3/d49/d34/f44 422240 0 2024-09-10T10:04:25.083 INFO:tasks.workunit.client.0.smithi071.stdout:0/766: dwrite d11/d30/f9b [4194304,4194304] 0 2024-09-10T10:04:25.087 INFO:tasks.workunit.client.0.smithi071.stdout:0/767: mknod d11/d22/d9a/ddf/c115 0 2024-09-10T10:04:25.088 INFO:tasks.workunit.client.0.smithi071.stdout:0/768: chown d11/d30/fd0 27557158 1 2024-09-10T10:04:25.088 INFO:tasks.workunit.client.0.smithi071.stdout:5/557: truncate dc/df/f38 1825244 0 2024-09-10T10:04:25.091 INFO:tasks.workunit.client.0.smithi071.stdout:0/769: creat d11/d22/d40/f116 x:0 0 0 2024-09-10T10:04:25.091 INFO:tasks.workunit.client.0.smithi071.stdout:5/558: creat dc/d53/db2/fc4 x:0 0 0 2024-09-10T10:04:25.092 INFO:tasks.workunit.client.0.smithi071.stdout:0/770: stat d11/d22/l3f 0 2024-09-10T10:04:25.093 INFO:tasks.workunit.client.0.smithi071.stdout:5/559: truncate dc/df/d17/d22/f81 839593 0 2024-09-10T10:04:25.096 INFO:tasks.workunit.client.0.smithi071.stdout:5/560: rename dc/df/d29/d48/l9b to dc/d4a/dbb/lc5 0 2024-09-10T10:04:25.099 INFO:tasks.workunit.client.0.smithi071.stdout:0/771: link d11/d22/d9a/ld2 d11/d1e/dfa/d79/ddc/l117 0 2024-09-10T10:04:25.105 INFO:tasks.workunit.client.0.smithi071.stdout:3/652: dread d3/d1c/d3c/da1/f51 [0,4194304] 0 2024-09-10T10:04:25.107 INFO:tasks.workunit.client.0.smithi071.stdout:3/653: creat d3/d10/d24/d2b/fe5 x:0 0 0 2024-09-10T10:04:25.110 INFO:tasks.workunit.client.0.smithi071.stdout:5/561: write dc/df/f3b [4841894,14326] 0 2024-09-10T10:04:25.114 INFO:tasks.workunit.client.0.smithi071.stdout:3/654: write d3/d10/f84 [4519825,66413] 0 2024-09-10T10:04:25.116 INFO:tasks.workunit.client.1.smithi107.stdout:4/863: sync 2024-09-10T10:04:25.116 INFO:tasks.workunit.client.1.smithi107.stdout:4/864: readlink d0/d1f/d72/ld5 0 2024-09-10T10:04:25.117 INFO:tasks.workunit.client.0.smithi071.stdout:0/772: dwrite d11/d22/d9a/fab [0,4194304] 0 2024-09-10T10:04:25.118 INFO:tasks.workunit.client.1.smithi107.stdout:4/865: chown d0/d40/d57/d76/d77/da1/f103 78 1 2024-09-10T10:04:25.119 INFO:tasks.workunit.client.0.smithi071.stdout:0/773: symlink d11/d22/d31/l118 0 2024-09-10T10:04:25.121 INFO:tasks.workunit.client.0.smithi071.stdout:0/774: mkdir d11/d1e/dfa/d79/d119 0 2024-09-10T10:04:25.122 INFO:tasks.workunit.client.0.smithi071.stdout:0/775: write d11/d22/f29 [5646002,86379] 0 2024-09-10T10:04:25.129 INFO:tasks.workunit.client.0.smithi071.stdout:3/655: dwrite d3/d1c/d3c/da1/d42/d4a/d60/fb6 [0,4194304] 0 2024-09-10T10:04:25.130 INFO:tasks.workunit.client.0.smithi071.stdout:0/776: getdents d11/d1e/dfa/d5f 0 2024-09-10T10:04:25.130 INFO:tasks.workunit.client.0.smithi071.stdout:5/562: dread dc/d53/f7f [0,4194304] 0 2024-09-10T10:04:25.131 INFO:tasks.workunit.client.0.smithi071.stdout:0/777: chown d11/d22/f101 717670248 1 2024-09-10T10:04:25.134 INFO:tasks.workunit.client.0.smithi071.stdout:5/563: truncate dc/df/d29/d94/fb3 940084 0 2024-09-10T10:04:25.136 INFO:tasks.workunit.client.0.smithi071.stdout:5/564: chown dc/c2c 252519 1 2024-09-10T10:04:25.139 INFO:tasks.workunit.client.0.smithi071.stdout:3/656: dwrite d3/d10/d24/d2b/fe5 [0,4194304] 0 2024-09-10T10:04:25.141 INFO:tasks.workunit.client.0.smithi071.stdout:5/565: creat dc/df/d17/d22/fc6 x:0 0 0 2024-09-10T10:04:25.143 INFO:tasks.workunit.client.0.smithi071.stdout:5/566: readlink dc/d53/db2/la8 0 2024-09-10T10:04:25.145 INFO:tasks.workunit.client.0.smithi071.stdout:5/567: mknod dc/df/cc7 0 2024-09-10T10:04:25.147 INFO:tasks.workunit.client.0.smithi071.stdout:3/657: dwrite d3/d1c/d3c/da1/d42/d4a/f59 [0,4194304] 0 2024-09-10T10:04:25.149 INFO:tasks.workunit.client.0.smithi071.stdout:5/568: symlink dc/df/d17/lc8 0 2024-09-10T10:04:25.157 INFO:tasks.workunit.client.0.smithi071.stdout:5/569: dread dc/df/f7b [0,4194304] 0 2024-09-10T10:04:25.158 INFO:tasks.workunit.client.0.smithi071.stdout:0/778: dread f2 [8388608,4194304] 0 2024-09-10T10:04:25.160 INFO:tasks.workunit.client.0.smithi071.stdout:3/658: dwrite d3/f8c [0,4194304] 0 2024-09-10T10:04:25.162 INFO:tasks.workunit.client.0.smithi071.stdout:0/779: truncate d11/d1e/dfa/d79/ddc/d109/f10a 95249 0 2024-09-10T10:04:25.164 INFO:tasks.workunit.client.0.smithi071.stdout:3/659: creat d3/d49/d2f/dc2/fe6 x:0 0 0 2024-09-10T10:04:25.166 INFO:tasks.workunit.client.0.smithi071.stdout:0/780: creat d11/d22/dde/d100/f11a x:0 0 0 2024-09-10T10:04:25.166 INFO:tasks.workunit.client.0.smithi071.stdout:3/660: read d3/d1c/d3c/f82 [2539895,42880] 0 2024-09-10T10:04:25.168 INFO:tasks.workunit.client.0.smithi071.stdout:0/781: write d11/d22/d31/fcb [572368,79546] 0 2024-09-10T10:04:25.168 INFO:tasks.workunit.client.0.smithi071.stdout:5/570: truncate dc/df/d3e/f43 3425883 0 2024-09-10T10:04:25.169 INFO:tasks.workunit.client.0.smithi071.stdout:3/661: symlink d3/d1c/d3c/da1/d5d/d7a/le7 0 2024-09-10T10:04:25.173 INFO:tasks.workunit.client.0.smithi071.stdout:3/662: truncate d3/d1c/d3c/da1/d5d/da5/fd1 747937 0 2024-09-10T10:04:25.173 INFO:tasks.workunit.client.0.smithi071.stdout:0/782: dread d11/d1e/dfa/d5f/f77 [0,4194304] 0 2024-09-10T10:04:25.175 INFO:tasks.workunit.client.0.smithi071.stdout:5/571: link dc/d53/d6a/c89 dc/d53/db2/cc9 0 2024-09-10T10:04:25.176 INFO:tasks.workunit.client.0.smithi071.stdout:0/783: fsync d11/d1e/f89 0 2024-09-10T10:04:25.183 INFO:tasks.workunit.client.0.smithi071.stdout:3/663: link d3/d1c/d3c/da1/d3a/f45 d3/d1c/d3c/da1/d5d/d7a/fe8 0 2024-09-10T10:04:25.187 INFO:tasks.workunit.client.0.smithi071.stdout:3/664: creat d3/d1c/d3c/da1/d5d/d9d/fe9 x:0 0 0 2024-09-10T10:04:25.189 INFO:tasks.workunit.client.0.smithi071.stdout:3/665: readlink d3/d1c/d3c/da1/d5d/d7a/l88 0 2024-09-10T10:04:25.189 INFO:tasks.workunit.client.0.smithi071.stdout:0/784: link d11/d22/dde/d100/l10c d11/d22/d9a/l11b 0 2024-09-10T10:04:25.190 INFO:tasks.workunit.client.0.smithi071.stdout:0/785: chown d11/d30/l36 32603 1 2024-09-10T10:04:25.191 INFO:tasks.workunit.client.0.smithi071.stdout:0/786: chown d11/d22/d9a/d106/f111 5 1 2024-09-10T10:04:25.193 INFO:tasks.workunit.client.1.smithi107.stdout:0/725: truncate d6/d8/d2f/d35/d3c/d58/d69/f88 166089 0 2024-09-10T10:04:25.194 INFO:tasks.workunit.client.0.smithi071.stdout:0/787: write d11/d30/fd0 [498743,109237] 0 2024-09-10T10:04:25.195 INFO:tasks.workunit.client.1.smithi107.stdout:8/641: dread d5/d8/d66/d8b/d1a/d71/f7d [0,4194304] 0 2024-09-10T10:04:25.199 INFO:tasks.workunit.client.0.smithi071.stdout:5/572: dread dc/df/f38 [0,4194304] 0 2024-09-10T10:04:25.201 INFO:tasks.workunit.client.1.smithi107.stdout:7/681: dwrite d0/d20/d35/faa [0,4194304] 0 2024-09-10T10:04:25.202 INFO:tasks.workunit.client.0.smithi071.stdout:5/573: getdents dc/df/da6 0 2024-09-10T10:04:25.203 INFO:tasks.workunit.client.1.smithi107.stdout:7/682: dread - d0/d8/d56/dcc/d81/fad zero size 2024-09-10T10:04:25.204 INFO:tasks.workunit.client.0.smithi071.stdout:5/574: fdatasync dc/d53/db2/f8f 0 2024-09-10T10:04:25.207 INFO:tasks.workunit.client.0.smithi071.stdout:5/575: write dc/df/d3e/f52 [1916551,10820] 0 2024-09-10T10:04:25.211 INFO:tasks.workunit.client.0.smithi071.stdout:3/666: dread d3/f70 [0,4194304] 0 2024-09-10T10:04:25.212 INFO:tasks.workunit.client.0.smithi071.stdout:3/667: stat d3/d1c/d3e/d77/l96 0 2024-09-10T10:04:25.213 INFO:tasks.workunit.client.0.smithi071.stdout:5/576: getdents dc/d53/db2 0 2024-09-10T10:04:25.215 INFO:tasks.workunit.client.0.smithi071.stdout:5/577: write dc/df/d29/d48/dae/db6/fc2 [910295,7960] 0 2024-09-10T10:04:25.215 INFO:tasks.workunit.client.0.smithi071.stdout:3/668: mknod d3/d49/cea 0 2024-09-10T10:04:25.216 INFO:tasks.workunit.client.1.smithi107.stdout:1/849: link d2/d35/d9c/fc0 d2/da8/f10a 0 2024-09-10T10:04:25.217 INFO:tasks.workunit.client.1.smithi107.stdout:0/726: readlink d6/d8/d2f/d2e/d32/d95/dce/de1/le5 0 2024-09-10T10:04:25.218 INFO:tasks.workunit.client.0.smithi071.stdout:5/578: truncate dc/df/d17/d22/d87/f92 5007176 0 2024-09-10T10:04:25.218 INFO:tasks.workunit.client.1.smithi107.stdout:8/642: write d5/d8/d66/d8b/d1a/d64/db9/fbf [424059,45124] 0 2024-09-10T10:04:25.219 INFO:tasks.workunit.client.0.smithi071.stdout:3/669: truncate d3/d1c/d3c/da1/d3a/f68 1552621 0 2024-09-10T10:04:25.219 INFO:tasks.workunit.client.1.smithi107.stdout:0/727: dread - d6/d8/d2f/d35/d3c/d58/d86/f87 zero size 2024-09-10T10:04:25.219 INFO:tasks.workunit.client.0.smithi071.stdout:5/579: dread - dc/df/d3e/d5a/fa7 zero size 2024-09-10T10:04:25.220 INFO:tasks.workunit.client.0.smithi071.stdout:3/670: dread - d3/d49/d34/faf zero size 2024-09-10T10:04:25.221 INFO:tasks.workunit.client.1.smithi107.stdout:1/850: rmdir d2/d6/dc6 39 2024-09-10T10:04:25.224 INFO:tasks.workunit.client.1.smithi107.stdout:6/756: rename d0/d76/f80 to d0/d3d/d14/d21/d8a/dee/df1/f109 0 2024-09-10T10:04:25.225 INFO:tasks.workunit.client.1.smithi107.stdout:8/643: fdatasync d5/f79 0 2024-09-10T10:04:25.225 INFO:tasks.workunit.client.1.smithi107.stdout:7/683: symlink d0/d8/d56/dcc/ldc 0 2024-09-10T10:04:25.226 INFO:tasks.workunit.client.0.smithi071.stdout:5/580: getdents dc/df/d29/d48/dae 0 2024-09-10T10:04:25.226 INFO:tasks.workunit.client.0.smithi071.stdout:3/671: write d3/d1c/d3c/da1/d5d/d7a/fe8 [509395,14430] 0 2024-09-10T10:04:25.226 INFO:tasks.workunit.client.1.smithi107.stdout:0/728: symlink d6/d5a/da9/le8 0 2024-09-10T10:04:25.230 INFO:tasks.workunit.client.0.smithi071.stdout:3/672: mkdir d3/d49/d34/deb 0 2024-09-10T10:04:25.230 INFO:tasks.workunit.client.1.smithi107.stdout:1/851: dwrite d2/d12/d5a/fe4 [0,4194304] 0 2024-09-10T10:04:25.232 INFO:tasks.workunit.client.1.smithi107.stdout:1/852: read d2/d89/f9e [3000844,29665] 0 2024-09-10T10:04:25.232 INFO:tasks.workunit.client.1.smithi107.stdout:7/684: mkdir d0/d20/ddd 0 2024-09-10T10:04:25.234 INFO:tasks.workunit.client.0.smithi071.stdout:5/581: dwrite dc/f3c [4194304,4194304] 0 2024-09-10T10:04:25.234 INFO:tasks.workunit.client.0.smithi071.stdout:7/811: sync 2024-09-10T10:04:25.235 INFO:tasks.workunit.client.1.smithi107.stdout:8/644: symlink d5/ld7 0 2024-09-10T10:04:25.236 INFO:tasks.workunit.client.0.smithi071.stdout:5/582: stat dc/df/d3e/d5a 0 2024-09-10T10:04:25.236 INFO:tasks.workunit.client.1.smithi107.stdout:8/645: fdatasync d5/d8/d66/d8b/d81/fb7 0 2024-09-10T10:04:25.237 INFO:tasks.workunit.client.0.smithi071.stdout:5/583: chown dc/d53/d79/l8b 27 1 2024-09-10T10:04:25.238 INFO:tasks.workunit.client.1.smithi107.stdout:7/685: creat d0/d8/dc/d2c/fde x:0 0 0 2024-09-10T10:04:25.240 INFO:tasks.workunit.client.0.smithi071.stdout:5/584: dread dc/df/f7b [0,4194304] 0 2024-09-10T10:04:25.241 INFO:tasks.workunit.client.0.smithi071.stdout:3/673: link d3/d10/d24/d2b/fe5 d3/d1c/d3c/da1/d3a/dbd/fec 0 2024-09-10T10:04:25.241 INFO:tasks.workunit.client.1.smithi107.stdout:0/729: rename d6/d8/d2f/d2e/ld6 to d6/d8e/le9 0 2024-09-10T10:04:25.243 INFO:tasks.workunit.client.0.smithi071.stdout:5/585: creat dc/df/d3e/d5a/fca x:0 0 0 2024-09-10T10:04:25.244 INFO:tasks.workunit.client.0.smithi071.stdout:3/674: mknod d3/d49/ced 0 2024-09-10T10:04:25.246 INFO:tasks.workunit.client.1.smithi107.stdout:1/853: rename d2/d35/d7b/d8b to d2/d12/d5a/d10b 0 2024-09-10T10:04:25.247 INFO:tasks.workunit.client.0.smithi071.stdout:3/675: chown d3/d1c/d3c/da1/c33 68496 1 2024-09-10T10:04:25.247 INFO:tasks.workunit.client.0.smithi071.stdout:3/676: fdatasync d3/d1c/d3c/f6f 0 2024-09-10T10:04:25.248 INFO:tasks.workunit.client.1.smithi107.stdout:0/730: creat d6/d8/d2f/d2e/d32/d95/dce/fea x:0 0 0 2024-09-10T10:04:25.250 INFO:tasks.workunit.client.0.smithi071.stdout:5/586: dwrite dc/df/d3e/f63 [0,4194304] 0 2024-09-10T10:04:25.250 INFO:tasks.workunit.client.0.smithi071.stdout:5/587: readlink dc/d53/l6b 0 2024-09-10T10:04:25.251 INFO:tasks.workunit.client.1.smithi107.stdout:1/854: mknod d2/d6/d67/c10c 0 2024-09-10T10:04:25.252 INFO:tasks.workunit.client.0.smithi071.stdout:3/677: symlink d3/d1c/d3c/da1/d5d/d7a/lee 0 2024-09-10T10:04:25.252 INFO:tasks.workunit.client.1.smithi107.stdout:0/731: rmdir d6/d8/d2f/d2e 39 2024-09-10T10:04:25.254 INFO:tasks.workunit.client.0.smithi071.stdout:5/588: mknod dc/df/d17/d22/ccb 0 2024-09-10T10:04:25.256 INFO:tasks.workunit.client.1.smithi107.stdout:1/855: getdents d2/d12/d65/de9 0 2024-09-10T10:04:25.257 INFO:tasks.workunit.client.1.smithi107.stdout:1/856: chown d2/d6/f5e 7 1 2024-09-10T10:04:25.258 INFO:tasks.workunit.client.0.smithi071.stdout:3/678: dread d3/d1c/d3c/f6f [0,4194304] 0 2024-09-10T10:04:25.260 INFO:tasks.workunit.client.0.smithi071.stdout:3/679: dread - d3/d1c/d3c/da1/d5d/d7a/fdf zero size 2024-09-10T10:04:25.260 INFO:tasks.workunit.client.1.smithi107.stdout:1/857: mkdir d2/d12/d65/db4/dd9/ddd/d10d 0 2024-09-10T10:04:25.261 INFO:tasks.workunit.client.0.smithi071.stdout:5/589: rename dc/df/d29/f99 to dc/df/d29/d94/fcc 0 2024-09-10T10:04:25.262 INFO:tasks.workunit.client.0.smithi071.stdout:5/590: chown dc/df/d3e/d5a/d80/d8a/da3 11715 1 2024-09-10T10:04:25.263 INFO:tasks.workunit.client.0.smithi071.stdout:3/680: truncate d3/fa 567729 0 2024-09-10T10:04:25.265 INFO:tasks.workunit.client.1.smithi107.stdout:6/757: write d0/d3d/d14/d42/f4e [1475931,24582] 0 2024-09-10T10:04:25.265 INFO:tasks.workunit.client.1.smithi107.stdout:1/858: dwrite d2/da8/ff3 [0,4194304] 0 2024-09-10T10:04:25.265 INFO:tasks.workunit.client.0.smithi071.stdout:3/681: mknod d3/d49/d34/d67/cef 0 2024-09-10T10:04:25.266 INFO:tasks.workunit.client.1.smithi107.stdout:5/749: sync 2024-09-10T10:04:25.267 INFO:tasks.workunit.client.1.smithi107.stdout:1/859: write d2/d6/d67/f9b [366607,96671] 0 2024-09-10T10:04:25.268 INFO:tasks.workunit.client.1.smithi107.stdout:7/686: rmdir d0/d8/dc/d2c 39 2024-09-10T10:04:25.270 INFO:tasks.workunit.client.0.smithi071.stdout:3/682: mkdir d3/d49/d4f/df0 0 2024-09-10T10:04:25.271 INFO:tasks.workunit.client.1.smithi107.stdout:1/860: fdatasync d2/d12/f3c 0 2024-09-10T10:04:25.273 INFO:tasks.workunit.client.0.smithi071.stdout:3/683: fsync d3/d10/d24/f27 0 2024-09-10T10:04:25.274 INFO:tasks.workunit.client.0.smithi071.stdout:7/812: dread d9/d70/fa3 [0,4194304] 0 2024-09-10T10:04:25.275 INFO:tasks.workunit.client.1.smithi107.stdout:0/732: write f4 [1193652,102552] 0 2024-09-10T10:04:25.278 INFO:tasks.workunit.client.0.smithi071.stdout:3/684: creat d3/d49/d34/deb/ff1 x:0 0 0 2024-09-10T10:04:25.278 INFO:tasks.workunit.client.0.smithi071.stdout:7/813: mkdir d9/ddb/d11c 0 2024-09-10T10:04:25.281 INFO:tasks.workunit.client.0.smithi071.stdout:3/685: mknod d3/d1c/d3c/da1/d42/d4a/cf2 0 2024-09-10T10:04:25.282 INFO:tasks.workunit.client.0.smithi071.stdout:7/814: mknod d9/d15/d40/d80/ddd/d110/c11d 0 2024-09-10T10:04:25.284 INFO:tasks.workunit.client.0.smithi071.stdout:7/815: dread - d9/d15/d1f/d74/da1/dcf/dfe/d108/d10c/fe5 zero size 2024-09-10T10:04:25.286 INFO:tasks.workunit.client.1.smithi107.stdout:6/758: dwrite d0/d3d/d14/d17/d24/df3/d55/d56/fd1 [0,4194304] 0 2024-09-10T10:04:25.288 INFO:tasks.workunit.client.0.smithi071.stdout:7/816: chown d9/d15/d1f/d74/da1/dcf/dfe/d108/d10c/lcb 95666 1 2024-09-10T10:04:25.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:24 smithi071 ceph-mon[27559]: mgrmap e22: smithi107.qurtcs(active, since 1.13476s) 2024-09-10T10:04:25.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:24 smithi071 ceph-mon[27559]: pgmap v3: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-10T10:04:25.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:24 smithi071 ceph-mon[27559]: Deploying cephadm binary to smithi071 2024-09-10T10:04:25.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:24 smithi071 ceph-mon[27559]: Deploying cephadm binary to smithi107 2024-09-10T10:04:25.289 INFO:tasks.workunit.client.1.smithi107.stdout:5/750: dwrite de/d20/d3d/dd4/fe4 [0,4194304] 0 2024-09-10T10:04:25.290 INFO:tasks.workunit.client.0.smithi071.stdout:5/591: dread dc/d4a/fb7 [4194304,4194304] 0 2024-09-10T10:04:25.294 INFO:tasks.workunit.client.1.smithi107.stdout:1/861: rename d2/d35/d7b/cbf to d2/d12/d65/db4/dd9/df7/c10e 0 2024-09-10T10:04:25.294 INFO:tasks.workunit.client.1.smithi107.stdout:5/751: readlink de/db3/leb 0 2024-09-10T10:04:25.294 INFO:tasks.workunit.client.1.smithi107.stdout:8/646: dwrite d5/d8/d66/d8b/d1a/f46 [0,4194304] 0 2024-09-10T10:04:25.296 INFO:tasks.workunit.client.1.smithi107.stdout:7/687: dwrite d0/d1b/d4d/d69/d97/d68/f75 [0,4194304] 0 2024-09-10T10:04:25.297 INFO:tasks.workunit.client.0.smithi071.stdout:7/817: dwrite d9/d76/f42 [0,4194304] 0 2024-09-10T10:04:25.300 INFO:tasks.workunit.client.0.smithi071.stdout:5/592: rename dc/d4a/f5b to dc/df/d17/d8d/fcd 0 2024-09-10T10:04:25.300 INFO:tasks.workunit.client.1.smithi107.stdout:5/752: readlink de/d4a/d7e/db2/dbc/lba 0 2024-09-10T10:04:25.300 INFO:tasks.workunit.client.1.smithi107.stdout:7/688: rmdir d0/d1b 39 2024-09-10T10:04:25.300 INFO:tasks.workunit.client.1.smithi107.stdout:0/733: dwrite d6/f4a [0,4194304] 0 2024-09-10T10:04:25.301 INFO:tasks.workunit.client.1.smithi107.stdout:1/862: mkdir d2/d6/d24/d81/d10f 0 2024-09-10T10:04:25.305 INFO:tasks.workunit.client.1.smithi107.stdout:6/759: truncate d0/d3d/d14/d21/d8a/da2/da3/dac/ff9 423605 0 2024-09-10T10:04:25.305 INFO:tasks.workunit.client.1.smithi107.stdout:8/647: creat d5/d8/d66/d8b/d18/d4f/fd8 x:0 0 0 2024-09-10T10:04:25.305 INFO:tasks.workunit.client.1.smithi107.stdout:0/734: read - d6/d8/d2f/da3/da5/fc1 zero size 2024-09-10T10:04:25.309 INFO:tasks.workunit.client.1.smithi107.stdout:1/863: mkdir d2/d12/d65/db4/dd9/df7/d110 0 2024-09-10T10:04:25.313 INFO:tasks.workunit.client.1.smithi107.stdout:8/648: stat d5/d8/d2a/d35/c4c 0 2024-09-10T10:04:25.313 INFO:tasks.workunit.client.1.smithi107.stdout:1/864: symlink d2/d6/d24/d81/l111 0 2024-09-10T10:04:25.314 INFO:tasks.workunit.client.1.smithi107.stdout:8/649: fdatasync d5/d8/d5b/fa7 0 2024-09-10T10:04:25.315 INFO:tasks.workunit.client.1.smithi107.stdout:6/760: symlink d0/d3d/d14/d21/d8a/dee/l10a 0 2024-09-10T10:04:25.316 INFO:tasks.workunit.client.0.smithi071.stdout:5/593: unlink dc/d53/d79/l8b 0 2024-09-10T10:04:25.317 INFO:tasks.workunit.client.1.smithi107.stdout:0/735: creat d6/d8/d2f/d2e/d32/d85/d8a/feb x:0 0 0 2024-09-10T10:04:25.318 INFO:tasks.workunit.client.1.smithi107.stdout:6/761: read - d0/d3d/d14/d21/f7f zero size 2024-09-10T10:04:25.319 INFO:tasks.workunit.client.0.smithi071.stdout:7/818: getdents d9/d15/d1f/d74/da1/dcf/dfe 0 2024-09-10T10:04:25.320 INFO:tasks.workunit.client.1.smithi107.stdout:7/689: getdents d0/d8 0 2024-09-10T10:04:25.320 INFO:tasks.workunit.client.1.smithi107.stdout:7/690: chown d0/d8/l49 344861 1 2024-09-10T10:04:25.321 INFO:tasks.workunit.client.1.smithi107.stdout:1/865: mknod d2/d6/d24/dce/c112 0 2024-09-10T10:04:25.322 INFO:tasks.workunit.client.1.smithi107.stdout:7/691: chown d0/d20/c65 4 1 2024-09-10T10:04:25.323 INFO:tasks.workunit.client.0.smithi071.stdout:3/686: dwrite d3/d1c/d3c/da1/d5d/d8f/fdb [0,4194304] 0 2024-09-10T10:04:25.323 INFO:tasks.workunit.client.1.smithi107.stdout:6/762: symlink d0/d3d/d14/d42/d88/l10b 0 2024-09-10T10:04:25.325 INFO:tasks.workunit.client.1.smithi107.stdout:8/650: truncate d5/d8/d66/d8b/d21/d83/fb4 970958 0 2024-09-10T10:04:25.326 INFO:tasks.workunit.client.1.smithi107.stdout:8/651: readlink d5/ld7 0 2024-09-10T10:04:25.327 INFO:tasks.workunit.client.1.smithi107.stdout:0/736: truncate d6/d8/d2f/d35/d3c/d58/f73 1447067 0 2024-09-10T10:04:25.329 INFO:tasks.workunit.client.0.smithi071.stdout:7/819: rename d9/d11/c32 to d9/d11/dd2/dae/c11e 0 2024-09-10T10:04:25.330 INFO:tasks.workunit.client.1.smithi107.stdout:6/763: mkdir d0/d3d/d14/dde/d10c 0 2024-09-10T10:04:25.331 INFO:tasks.workunit.client.1.smithi107.stdout:0/737: creat d6/d8/d2f/d2e/fec x:0 0 0 2024-09-10T10:04:25.332 INFO:tasks.workunit.client.0.smithi071.stdout:7/820: mkdir d9/d15/d40/d80/ddd/de2/d11f 0 2024-09-10T10:04:25.334 INFO:tasks.workunit.client.1.smithi107.stdout:0/738: write d6/faf [53384,98324] 0 2024-09-10T10:04:25.335 INFO:tasks.workunit.client.1.smithi107.stdout:6/764: symlink d0/d3d/d14/d42/d88/l10d 0 2024-09-10T10:04:25.335 INFO:tasks.workunit.client.1.smithi107.stdout:8/652: mknod d5/d8/d2a/d47/cd9 0 2024-09-10T10:04:25.337 INFO:tasks.workunit.client.1.smithi107.stdout:7/692: dwrite d0/d20/d35/f9f [0,4194304] 0 2024-09-10T10:04:25.339 INFO:tasks.workunit.client.1.smithi107.stdout:7/693: write d0/d8/d5c/d6d/fc8 [860527,16539] 0 2024-09-10T10:04:25.341 INFO:tasks.workunit.client.1.smithi107.stdout:7/694: write d0/d8/f31 [2419809,19680] 0 2024-09-10T10:04:25.344 INFO:tasks.workunit.client.1.smithi107.stdout:0/739: rename d6/d8/d2f/d35/c51 to d6/d14/d93/dae/ced 0 2024-09-10T10:04:25.345 INFO:tasks.workunit.client.1.smithi107.stdout:7/695: mkdir d0/d20/ddf 0 2024-09-10T10:04:25.348 INFO:tasks.workunit.client.1.smithi107.stdout:0/740: dread d6/f4a [0,4194304] 0 2024-09-10T10:04:25.349 INFO:tasks.workunit.client.1.smithi107.stdout:7/696: truncate d0/d8/dc/d2c/f7e 2052577 0 2024-09-10T10:04:25.352 INFO:tasks.workunit.client.1.smithi107.stdout:7/697: mkdir d0/d99/de0 0 2024-09-10T10:04:25.354 INFO:tasks.workunit.client.1.smithi107.stdout:7/698: mknod d0/d20/ce1 0 2024-09-10T10:04:25.355 INFO:tasks.workunit.client.0.smithi071.stdout:5/594: write dc/df/f14 [1332132,116552] 0 2024-09-10T10:04:25.357 INFO:tasks.workunit.client.0.smithi071.stdout:3/687: write d3/d49/d34/f44 [893021,46446] 0 2024-09-10T10:04:25.360 INFO:tasks.workunit.client.1.smithi107.stdout:5/753: dwrite de/d4a/f53 [0,4194304] 0 2024-09-10T10:04:25.361 INFO:tasks.workunit.client.0.smithi071.stdout:3/688: creat d3/d49/d4f/ff3 x:0 0 0 2024-09-10T10:04:25.361 INFO:tasks.workunit.client.1.smithi107.stdout:1/866: write d2/d6/d24/f54 [1648966,88183] 0 2024-09-10T10:04:25.363 INFO:tasks.workunit.client.1.smithi107.stdout:6/765: write d0/d3d/d14/d42/d88/f97 [119164,5489] 0 2024-09-10T10:04:25.364 INFO:tasks.workunit.client.1.smithi107.stdout:0/741: rename d6/d14/d93 to d6/d8/d2f/da3/dee 0 2024-09-10T10:04:25.364 INFO:tasks.workunit.client.1.smithi107.stdout:1/867: dread - d2/f46 zero size 2024-09-10T10:04:25.366 INFO:tasks.workunit.client.0.smithi071.stdout:3/689: read d3/d1c/f22 [10791381,54542] 0 2024-09-10T10:04:25.366 INFO:tasks.workunit.client.0.smithi071.stdout:5/595: dread dc/df/d29/d94/fcc [0,4194304] 0 2024-09-10T10:04:25.367 INFO:tasks.workunit.client.1.smithi107.stdout:5/754: unlink de/d20/f91 0 2024-09-10T10:04:25.367 INFO:tasks.workunit.client.0.smithi071.stdout:7/821: dwrite d9/d15/d1f/d74/da1/dcf/dfe/d108/d10c/d118/fcc [0,4194304] 0 2024-09-10T10:04:25.368 INFO:tasks.workunit.client.1.smithi107.stdout:0/742: stat d6/d8/d2f/da3/da5/lac 0 2024-09-10T10:04:25.372 INFO:tasks.workunit.client.1.smithi107.stdout:1/868: creat d2/d12/d7e/f113 x:0 0 0 2024-09-10T10:04:25.373 INFO:tasks.workunit.client.0.smithi071.stdout:7/822: mknod d9/d2c/d4f/c120 0 2024-09-10T10:04:25.374 INFO:tasks.workunit.client.1.smithi107.stdout:6/766: creat d0/d3d/d14/d21/d8a/d8d/f10e x:0 0 0 2024-09-10T10:04:25.374 INFO:tasks.workunit.client.0.smithi071.stdout:4/616: sync 2024-09-10T10:04:25.374 INFO:tasks.workunit.client.0.smithi071.stdout:1/715: sync 2024-09-10T10:04:25.374 INFO:tasks.workunit.client.0.smithi071.stdout:6/588: sync 2024-09-10T10:04:25.377 INFO:tasks.workunit.client.0.smithi071.stdout:1/716: mkdir d1/d21/d3d/d9a/d72/dfd 0 2024-09-10T10:04:25.377 INFO:tasks.workunit.client.1.smithi107.stdout:0/743: creat d6/d8/d2f/da3/dee/dae/fef x:0 0 0 2024-09-10T10:04:25.379 INFO:tasks.workunit.client.0.smithi071.stdout:5/596: link dc/d53/d6a/c70 dc/d53/db2/cce 0 2024-09-10T10:04:25.380 INFO:tasks.workunit.client.0.smithi071.stdout:1/717: write d1/d70/d76/fcf [772357,127465] 0 2024-09-10T10:04:25.381 INFO:tasks.workunit.client.0.smithi071.stdout:5/597: dread - dc/df/d17/d22/fc6 zero size 2024-09-10T10:04:25.381 INFO:tasks.workunit.client.1.smithi107.stdout:0/744: fsync d6/d8/d2f/d2e/d32/f9c 0 2024-09-10T10:04:25.382 INFO:tasks.workunit.client.1.smithi107.stdout:5/755: creat de/d4a/d4e/ffa x:0 0 0 2024-09-10T10:04:25.382 INFO:tasks.workunit.client.1.smithi107.stdout:1/869: symlink d2/d12/d65/de9/l114 0 2024-09-10T10:04:25.382 INFO:tasks.workunit.client.0.smithi071.stdout:3/690: link d3/d1c/d3c/da1/d42/d4a/d60/d78/l7d d3/d1c/d3e/lf4 0 2024-09-10T10:04:25.382 INFO:tasks.workunit.client.1.smithi107.stdout:7/699: dwrite d0/d8/f38 [0,4194304] 0 2024-09-10T10:04:25.384 INFO:tasks.workunit.client.0.smithi071.stdout:1/718: mkdir d1/d70/d76/dd4/dfe 0 2024-09-10T10:04:25.384 INFO:tasks.workunit.client.0.smithi071.stdout:4/617: rename db/d15/d17/c74 to db/d15/d17/d4e/dc0/ccb 0 2024-09-10T10:04:25.386 INFO:tasks.workunit.client.0.smithi071.stdout:5/598: mknod dc/df/d3e/d5a/d80/ccf 0 2024-09-10T10:04:25.387 INFO:tasks.workunit.client.1.smithi107.stdout:6/767: dwrite d0/d70/fc7 [0,4194304] 0 2024-09-10T10:04:25.388 INFO:tasks.workunit.client.0.smithi071.stdout:1/719: mknod d1/d21/d2f/d30/d6a/ddb/cff 0 2024-09-10T10:04:25.388 INFO:tasks.workunit.client.0.smithi071.stdout:3/691: rename d3/d1c/d3c/da1/d42/d4a/f54 to d3/d49/d34/ff5 0 2024-09-10T10:04:25.389 INFO:tasks.workunit.client.1.smithi107.stdout:5/756: symlink de/db3/db6/lfb 0 2024-09-10T10:04:25.390 INFO:tasks.workunit.client.0.smithi071.stdout:1/720: fdatasync d1/d21/d2f/d30/d6a/fba 0 2024-09-10T10:04:25.391 INFO:tasks.workunit.client.0.smithi071.stdout:1/721: read - d1/d21/d2f/f46 zero size 2024-09-10T10:04:25.392 INFO:tasks.workunit.client.0.smithi071.stdout:6/589: rename d4/da/df/d2e/d3a/d3e/d5d/f76 to d4/da/df/d2e/d3a/d40/d60/d7a/fba 0 2024-09-10T10:04:25.395 INFO:tasks.workunit.client.1.smithi107.stdout:7/700: creat d0/d99/fe2 x:0 0 0 2024-09-10T10:04:25.395 INFO:tasks.workunit.client.1.smithi107.stdout:0/745: creat d6/d8/d2f/d2e/d32/d56/ff0 x:0 0 0 2024-09-10T10:04:25.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:24 smithi107 ceph-mon[34215]: mgrmap e22: smithi107.qurtcs(active, since 1.13476s) 2024-09-10T10:04:25.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:24 smithi107 ceph-mon[34215]: pgmap v3: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-10T10:04:25.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:24 smithi107 ceph-mon[34215]: Deploying cephadm binary to smithi071 2024-09-10T10:04:25.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:24 smithi107 ceph-mon[34215]: Deploying cephadm binary to smithi107 2024-09-10T10:04:25.398 INFO:tasks.workunit.client.1.smithi107.stdout:1/870: rename d2/d6/dc6 to d2/d6/dc6/dd4/d106/d115 22 2024-09-10T10:04:25.398 INFO:tasks.workunit.client.1.smithi107.stdout:6/768: creat d0/d3d/d14/d17/d24/f10f x:0 0 0 2024-09-10T10:04:25.401 INFO:tasks.workunit.client.1.smithi107.stdout:0/746: write d6/d8/d2f/d35/d3c/f74 [4470039,23439] 0 2024-09-10T10:04:25.404 INFO:tasks.workunit.client.0.smithi071.stdout:4/618: creat db/d15/fcc x:0 0 0 2024-09-10T10:04:25.404 INFO:tasks.workunit.client.1.smithi107.stdout:1/871: read d2/d6/dc6/dd4/d106/fee [1493056,94957] 0 2024-09-10T10:04:25.405 INFO:tasks.workunit.client.1.smithi107.stdout:7/701: creat d0/d1b/d4d/d69/d97/d68/fe3 x:0 0 0 2024-09-10T10:04:25.405 INFO:tasks.workunit.client.1.smithi107.stdout:0/747: truncate d6/d8/d2f/d2e/d32/d85/d8a/fd0 486358 0 2024-09-10T10:04:25.409 INFO:tasks.workunit.client.0.smithi071.stdout:6/590: creat d4/d1c/fbb x:0 0 0 2024-09-10T10:04:25.411 INFO:tasks.workunit.client.1.smithi107.stdout:7/702: rename d0/f2f to d0/d8/dc/d2c/d47/fe4 0 2024-09-10T10:04:25.417 INFO:tasks.workunit.client.1.smithi107.stdout:7/703: mknod d0/d20/d72/ce5 0 2024-09-10T10:04:25.422 INFO:tasks.workunit.client.1.smithi107.stdout:0/748: mkdir d6/d8/d2f/d6e/dc5/ddb/df1 0 2024-09-10T10:04:25.423 INFO:tasks.workunit.client.1.smithi107.stdout:1/872: link d2/d36/cc2 d2/d12/d65/db4/dd9/ddd/d10d/c116 0 2024-09-10T10:04:25.425 INFO:tasks.workunit.client.1.smithi107.stdout:6/769: getdents d0/d3d/d14/d21/d8a/dee/df1 0 2024-09-10T10:04:25.425 INFO:tasks.workunit.client.1.smithi107.stdout:7/704: getdents d0/d20/ddd 0 2024-09-10T10:04:25.426 INFO:tasks.workunit.client.0.smithi071.stdout:8/651: sync 2024-09-10T10:04:25.426 INFO:tasks.workunit.client.0.smithi071.stdout:2/775: sync 2024-09-10T10:04:25.426 INFO:tasks.workunit.client.0.smithi071.stdout:0/788: sync 2024-09-10T10:04:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:8/652: truncate d5/fd2 910288 0 2024-09-10T10:04:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:7/823: dread d9/ff [0,4194304] 0 2024-09-10T10:04:25.428 INFO:tasks.workunit.client.1.smithi107.stdout:0/749: creat d6/d8/d2f/da3/dee/ff2 x:0 0 0 2024-09-10T10:04:25.430 INFO:tasks.workunit.client.1.smithi107.stdout:5/757: write de/d4a/d7e/db2/dbc/fb5 [675429,55264] 0 2024-09-10T10:04:25.434 INFO:tasks.workunit.client.0.smithi071.stdout:5/599: rename dc/df/d17/d8d/c90 to dc/df/d3e/d5a/d80/d8a/da3/cd0 0 2024-09-10T10:04:25.435 INFO:tasks.workunit.client.0.smithi071.stdout:4/619: mkdir db/d1d/d61/dcd 0 2024-09-10T10:04:25.436 INFO:tasks.workunit.client.1.smithi107.stdout:6/770: mkdir d0/d3d/d14/d21/d8a/db9/d110 0 2024-09-10T10:04:25.437 INFO:tasks.workunit.client.0.smithi071.stdout:0/789: chown d11/d1e/dfa/c62 1732626716 1 2024-09-10T10:04:25.437 INFO:tasks.workunit.client.1.smithi107.stdout:0/750: symlink d6/d8/d2f/d35/lf3 0 2024-09-10T10:04:25.437 INFO:tasks.workunit.client.0.smithi071.stdout:4/620: stat db/d1d/d61/c7b 0 2024-09-10T10:04:25.438 INFO:tasks.workunit.client.0.smithi071.stdout:2/776: mkdir d8/d87/dc4/d103 0 2024-09-10T10:04:25.438 INFO:tasks.workunit.client.1.smithi107.stdout:6/771: dread - d0/d3d/d14/d42/d88/ff4 zero size 2024-09-10T10:04:25.439 INFO:tasks.workunit.client.0.smithi071.stdout:1/722: dwrite d1/d21/d2f/d30/d6a/f69 [0,4194304] 0 2024-09-10T10:04:25.440 INFO:tasks.workunit.client.1.smithi107.stdout:7/705: dwrite d0/d1b/d4d/d69/d97/d95/fcd [0,4194304] 0 2024-09-10T10:04:25.441 INFO:tasks.workunit.client.0.smithi071.stdout:8/653: creat d5/df/d57/fe2 x:0 0 0 2024-09-10T10:04:25.444 INFO:tasks.workunit.client.1.smithi107.stdout:6/772: stat d0/d3d/d14/d21/d8a/da2/da3/dac/fea 0 2024-09-10T10:04:25.446 INFO:tasks.workunit.client.0.smithi071.stdout:6/591: mkdir d4/da/df/d2e/d3a/da9/dbc 0 2024-09-10T10:04:25.447 INFO:tasks.workunit.client.1.smithi107.stdout:0/751: mknod d6/d8/d2f/d2e/d7b/cf4 0 2024-09-10T10:04:25.448 INFO:tasks.workunit.client.0.smithi071.stdout:7/824: creat d9/d15/d1f/d74/d10f/f121 x:0 0 0 2024-09-10T10:04:25.449 INFO:tasks.workunit.client.1.smithi107.stdout:5/758: dwrite de/d20/d3d/f88 [0,4194304] 0 2024-09-10T10:04:25.451 INFO:tasks.workunit.client.1.smithi107.stdout:5/759: read de/d20/d3d/f4c [267853,66536] 0 2024-09-10T10:04:25.453 INFO:tasks.workunit.client.1.smithi107.stdout:7/706: write d0/d1b/d9d/fce [787213,114753] 0 2024-09-10T10:04:25.453 INFO:tasks.workunit.client.1.smithi107.stdout:0/752: write d6/d8/d2f/d2e/d32/d95/fb6 [1350139,115840] 0 2024-09-10T10:04:25.453 INFO:tasks.workunit.client.1.smithi107.stdout:1/873: write d2/da8/f10a [738711,43426] 0 2024-09-10T10:04:25.453 INFO:tasks.workunit.client.0.smithi071.stdout:0/790: creat d11/d1e/f11c x:0 0 0 2024-09-10T10:04:25.454 INFO:tasks.workunit.client.0.smithi071.stdout:5/600: dwrite dc/d53/db2/f8f [0,4194304] 0 2024-09-10T10:04:25.455 INFO:tasks.workunit.client.1.smithi107.stdout:7/707: truncate d0/d8/dc/fb0 224813 0 2024-09-10T10:04:25.456 INFO:tasks.workunit.client.0.smithi071.stdout:4/621: dwrite db/d8f/fb1 [0,4194304] 0 2024-09-10T10:04:25.457 INFO:tasks.workunit.client.1.smithi107.stdout:6/773: write d0/d3d/d14/d17/d24/df3/f103 [4621917,112718] 0 2024-09-10T10:04:25.459 INFO:tasks.workunit.client.0.smithi071.stdout:7/825: chown d9/d1a/d1d/f57 30 1 2024-09-10T10:04:25.459 INFO:tasks.workunit.client.0.smithi071.stdout:0/791: dread - d11/f7b zero size 2024-09-10T10:04:25.460 INFO:tasks.workunit.client.1.smithi107.stdout:5/760: fsync de/db3/fd3 0 2024-09-10T10:04:25.461 INFO:tasks.workunit.client.0.smithi071.stdout:8/654: dread d5/df/d1e/d38/f99 [0,4194304] 0 2024-09-10T10:04:25.463 INFO:tasks.workunit.client.0.smithi071.stdout:6/592: mkdir d4/da/df/d2e/d3a/d40/d60/d7a/dbd 0 2024-09-10T10:04:25.463 INFO:tasks.workunit.client.1.smithi107.stdout:0/753: truncate d6/d8/d2f/d2e/d32/d85/fbe 505794 0 2024-09-10T10:04:25.463 INFO:tasks.workunit.client.0.smithi071.stdout:3/692: truncate d3/d1c/d3c/da1/d42/d4a/f95 3683391 0 2024-09-10T10:04:25.464 INFO:tasks.workunit.client.1.smithi107.stdout:5/761: fsync de/d20/d2b/d4b/d8c/fdf 0 2024-09-10T10:04:25.466 INFO:tasks.workunit.client.0.smithi071.stdout:3/693: chown d3/d1c/d3c/da1/d5d/d7a/lca 863 1 2024-09-10T10:04:25.467 INFO:tasks.workunit.client.1.smithi107.stdout:0/754: chown d6/d8/d2f/d2e/d32/d95/f97 13257 1 2024-09-10T10:04:25.467 INFO:tasks.workunit.client.0.smithi071.stdout:4/622: write db/d15/d17/d4e/d5a/d8d/faf [1112258,74028] 0 2024-09-10T10:04:25.469 INFO:tasks.workunit.client.0.smithi071.stdout:0/792: unlink d11/ffc 0 2024-09-10T10:04:25.469 INFO:tasks.workunit.client.0.smithi071.stdout:7/826: dread - d9/d15/d1f/d74/da1/dcf/dfe/d108/d10c/d118/fee zero size 2024-09-10T10:04:25.470 INFO:tasks.workunit.client.1.smithi107.stdout:1/874: creat d2/d12/d5a/d10b/f117 x:0 0 0 2024-09-10T10:04:25.471 INFO:tasks.workunit.client.0.smithi071.stdout:6/593: write d4/f19 [1483048,24131] 0 2024-09-10T10:04:25.472 INFO:tasks.workunit.client.0.smithi071.stdout:7/827: write d9/d15/d1f/fe9 [1345559,35522] 0 2024-09-10T10:04:25.472 INFO:tasks.workunit.client.0.smithi071.stdout:3/694: mknod d3/d1c/cf6 0 2024-09-10T10:04:25.473 INFO:tasks.workunit.client.1.smithi107.stdout:1/875: fdatasync d2/d12/d7e/f7f 0 2024-09-10T10:04:25.473 INFO:tasks.workunit.client.1.smithi107.stdout:6/774: rename d0/d70/fc3 to d0/d3d/d14/d21/d8a/db9/d110/f111 0 2024-09-10T10:04:25.474 INFO:tasks.workunit.client.0.smithi071.stdout:7/828: stat d9/d1a/d1d/f57 0 2024-09-10T10:04:25.474 INFO:tasks.workunit.client.0.smithi071.stdout:6/594: write d4/da/df/d2e/d3a/f74 [3142157,45039] 0 2024-09-10T10:04:25.476 INFO:tasks.workunit.client.0.smithi071.stdout:7/829: write d9/d15/d40/f104 [92090,107732] 0 2024-09-10T10:04:25.477 INFO:tasks.workunit.client.0.smithi071.stdout:6/595: readlink d4/da/df/d5e/l6e 0 2024-09-10T10:04:25.478 INFO:tasks.workunit.client.1.smithi107.stdout:6/775: unlink d0/d3d/fb1 0 2024-09-10T10:04:25.479 INFO:tasks.workunit.client.0.smithi071.stdout:4/623: creat db/d15/d17/d4e/fce x:0 0 0 2024-09-10T10:04:25.479 INFO:tasks.workunit.client.1.smithi107.stdout:6/776: stat d0/d3d/d14/d21/fa0 0 2024-09-10T10:04:25.480 INFO:tasks.workunit.client.0.smithi071.stdout:6/596: chown d4/da/df/d2e/d3a/d43/f73 630444 1 2024-09-10T10:04:25.480 INFO:tasks.workunit.client.1.smithi107.stdout:0/755: creat d6/d8/d2f/da3/ff5 x:0 0 0 2024-09-10T10:04:25.480 INFO:tasks.workunit.client.1.smithi107.stdout:1/876: dwrite d2/d12/f1e [4194304,4194304] 0 2024-09-10T10:04:25.481 INFO:tasks.workunit.client.1.smithi107.stdout:7/708: dread d0/d20/d35/f54 [0,4194304] 0 2024-09-10T10:04:25.483 INFO:tasks.workunit.client.0.smithi071.stdout:4/624: dread db/d15/d26/d43/d4d/d77/fbd [0,4194304] 0 2024-09-10T10:04:25.485 INFO:tasks.workunit.client.0.smithi071.stdout:8/655: rename d5/df/d1e/d38/l54 to d5/df/d1d/d86/d90/db4/le3 0 2024-09-10T10:04:25.486 INFO:tasks.workunit.client.1.smithi107.stdout:7/709: creat d0/d20/d72/fe6 x:0 0 0 2024-09-10T10:04:25.488 INFO:tasks.workunit.client.1.smithi107.stdout:2/765: sync 2024-09-10T10:04:25.489 INFO:tasks.workunit.client.1.smithi107.stdout:0/756: symlink d6/d8/d2f/d6e/dc5/lf6 0 2024-09-10T10:04:25.490 INFO:tasks.workunit.client.1.smithi107.stdout:6/777: mkdir d0/d3d/d14/d21/d8a/dee/d112 0 2024-09-10T10:04:25.491 INFO:tasks.workunit.client.0.smithi071.stdout:8/656: creat d5/d36/d49/d8f/fe4 x:0 0 0 2024-09-10T10:04:25.491 INFO:tasks.workunit.client.1.smithi107.stdout:1/877: creat d2/d6/f118 x:0 0 0 2024-09-10T10:04:25.492 INFO:tasks.workunit.client.0.smithi071.stdout:4/625: mkdir db/d15/d17/dc7/dcf 0 2024-09-10T10:04:25.493 INFO:tasks.workunit.client.1.smithi107.stdout:2/766: creat d3/d8f/df4/d102/f110 x:0 0 0 2024-09-10T10:04:25.494 INFO:tasks.workunit.client.0.smithi071.stdout:7/830: rmdir d9/ddb/d11c 0 2024-09-10T10:04:25.496 INFO:tasks.workunit.client.0.smithi071.stdout:4/626: fsync db/d15/d17/d4e/d5a/f92 0 2024-09-10T10:04:25.498 INFO:tasks.workunit.client.0.smithi071.stdout:8/657: creat d5/d36/d49/d8f/fe5 x:0 0 0 2024-09-10T10:04:25.498 INFO:tasks.workunit.client.0.smithi071.stdout:6/597: dwrite d4/d61/d83/da8/f5c [0,4194304] 0 2024-09-10T10:04:25.503 INFO:tasks.workunit.client.0.smithi071.stdout:4/627: mkdir db/d1d/d7a/dd0 0 2024-09-10T10:04:25.504 INFO:tasks.workunit.client.0.smithi071.stdout:7/831: mkdir d9/d15/d1f/d122 0 2024-09-10T10:04:25.505 INFO:tasks.workunit.client.1.smithi107.stdout:5/762: write de/d20/d3d/fd2 [3152807,7717] 0 2024-09-10T10:04:25.506 INFO:tasks.workunit.client.1.smithi107.stdout:2/767: dwrite d3/da/d1e/d40/d8a/d7f/fb9 [0,4194304] 0 2024-09-10T10:04:25.510 INFO:tasks.workunit.client.0.smithi071.stdout:6/598: symlink d4/da/df/d2e/d3a/d40/lbe 0 2024-09-10T10:04:25.511 INFO:tasks.workunit.client.0.smithi071.stdout:3/695: write d3/d1c/d3c/f69 [3527260,77136] 0 2024-09-10T10:04:25.511 INFO:tasks.workunit.client.0.smithi071.stdout:5/601: write dc/df/d17/f2b [2967098,35860] 0 2024-09-10T10:04:25.513 INFO:tasks.workunit.client.0.smithi071.stdout:0/793: truncate d11/d1e/dfa/d5f/f77 1639880 0 2024-09-10T10:04:25.517 INFO:tasks.workunit.client.0.smithi071.stdout:7/832: unlink d9/d15/d40/f104 0 2024-09-10T10:04:25.517 INFO:tasks.workunit.client.1.smithi107.stdout:2/768: truncate d3/da/d1e/f24 4452988 0 2024-09-10T10:04:25.517 INFO:tasks.workunit.client.1.smithi107.stdout:0/757: dwrite d6/d14/f40 [0,4194304] 0 2024-09-10T10:04:25.519 INFO:tasks.workunit.client.0.smithi071.stdout:8/658: link d5/df/d1d/d86/d75/f87 d5/df/d74/fe6 0 2024-09-10T10:04:25.527 INFO:tasks.workunit.client.1.smithi107.stdout:2/769: link d3/da/c52 d3/da/df/d20/d36/d4f/d92/dec/c111 0 2024-09-10T10:04:25.529 INFO:tasks.workunit.client.0.smithi071.stdout:5/602: rename dc/df/d29/fc3 to dc/df/d3e/fd1 0 2024-09-10T10:04:25.530 INFO:tasks.workunit.client.1.smithi107.stdout:2/770: truncate d3/da/df/d20/f57 199808 0 2024-09-10T10:04:25.534 INFO:tasks.workunit.client.0.smithi071.stdout:7/833: symlink d9/d15/l123 0 2024-09-10T10:04:25.535 INFO:tasks.workunit.client.0.smithi071.stdout:8/659: dwrite d5/df/fcf [0,4194304] 0 2024-09-10T10:04:25.536 INFO:tasks.workunit.client.1.smithi107.stdout:1/878: dread d2/d6/fa [0,4194304] 0 2024-09-10T10:04:25.536 INFO:tasks.workunit.client.0.smithi071.stdout:5/603: mkdir dc/df/d3e/d5a/dd2 0 2024-09-10T10:04:25.536 INFO:tasks.workunit.client.0.smithi071.stdout:7/834: dread - d9/d11/f5f zero size 2024-09-10T10:04:25.537 INFO:tasks.workunit.client.0.smithi071.stdout:0/794: dwrite d11/d22/d9a/fbf [0,4194304] 0 2024-09-10T10:04:25.538 INFO:tasks.workunit.client.1.smithi107.stdout:2/771: dwrite d3/d21/d79/fab [0,4194304] 0 2024-09-10T10:04:25.539 INFO:tasks.workunit.client.1.smithi107.stdout:1/879: rmdir d2/d12/d65/db4 39 2024-09-10T10:04:25.541 INFO:tasks.workunit.client.0.smithi071.stdout:7/835: stat d9/d15/d1f/d74/d10f/f121 0 2024-09-10T10:04:25.542 INFO:tasks.workunit.client.1.smithi107.stdout:2/772: rmdir d3/da/d66 39 2024-09-10T10:04:25.549 INFO:tasks.workunit.client.1.smithi107.stdout:2/773: symlink d3/da/d1e/d5f/dad/l112 0 2024-09-10T10:04:25.549 INFO:tasks.workunit.client.0.smithi071.stdout:8/660: dread d5/df/d1e/d38/f99 [0,4194304] 0 2024-09-10T10:04:25.550 INFO:tasks.workunit.client.1.smithi107.stdout:1/880: mknod d2/d35/d7b/c119 0 2024-09-10T10:04:25.550 INFO:tasks.workunit.client.1.smithi107.stdout:2/774: write d3/f49 [441241,44315] 0 2024-09-10T10:04:25.552 INFO:tasks.workunit.client.0.smithi071.stdout:5/604: getdents dc/df 0 2024-09-10T10:04:25.553 INFO:tasks.workunit.client.1.smithi107.stdout:1/881: rmdir d2/d35/d7b 39 2024-09-10T10:04:25.554 INFO:tasks.workunit.client.0.smithi071.stdout:8/661: write d5/df/d1d/f59 [3507867,98590] 0 2024-09-10T10:04:25.555 INFO:tasks.workunit.client.0.smithi071.stdout:5/605: mknod dc/df/d3e/d5a/dd2/cd3 0 2024-09-10T10:04:25.557 INFO:tasks.workunit.client.1.smithi107.stdout:2/775: creat d3/da/d1e/f113 x:0 0 0 2024-09-10T10:04:25.558 INFO:tasks.workunit.client.1.smithi107.stdout:1/882: mknod d2/d12/d7e/c11a 0 2024-09-10T10:04:25.558 INFO:tasks.workunit.client.0.smithi071.stdout:5/606: mkdir dc/df/d3e/d5a/dd4 0 2024-09-10T10:04:25.559 INFO:tasks.workunit.client.1.smithi107.stdout:5/763: write de/d4a/d7e/f6e [3249501,76797] 0 2024-09-10T10:04:25.561 INFO:tasks.workunit.client.1.smithi107.stdout:2/776: mkdir d3/da/d1e/d5f/d54/d114 0 2024-09-10T10:04:25.563 INFO:tasks.workunit.client.0.smithi071.stdout:5/607: symlink dc/df/ld5 0 2024-09-10T10:04:25.563 INFO:tasks.workunit.client.0.smithi071.stdout:8/662: dwrite d5/df/fcf [0,4194304] 0 2024-09-10T10:04:25.565 INFO:tasks.workunit.client.1.smithi107.stdout:1/883: rename d2/d6/d24/f50 to d2/d6/dc6/de8/f11b 0 2024-09-10T10:04:25.566 INFO:tasks.workunit.client.1.smithi107.stdout:0/758: truncate d6/d8/d2f/d35/fad 7503984 0 2024-09-10T10:04:25.567 INFO:tasks.workunit.client.0.smithi071.stdout:8/663: creat d5/df/d1d/d81/fe7 x:0 0 0 2024-09-10T10:04:25.570 INFO:tasks.workunit.client.1.smithi107.stdout:0/759: write d6/d8/d3e/d43/fb3 [746336,80330] 0 2024-09-10T10:04:25.570 INFO:tasks.workunit.client.1.smithi107.stdout:0/760: write f4 [2499012,63020] 0 2024-09-10T10:04:25.572 INFO:tasks.workunit.client.1.smithi107.stdout:1/884: rename d2/dcc/dea to d2/d6/d67/d11c 0 2024-09-10T10:04:25.573 INFO:tasks.workunit.client.0.smithi071.stdout:8/664: unlink d5/df/l35 0 2024-09-10T10:04:25.573 INFO:tasks.workunit.client.1.smithi107.stdout:0/761: readlink d6/d8/d2f/d2e/d32/d95/dce/de1/le5 0 2024-09-10T10:04:25.574 INFO:tasks.workunit.client.0.smithi071.stdout:8/665: truncate d5/df/d67/fe1 71067 0 2024-09-10T10:04:25.578 INFO:tasks.workunit.client.1.smithi107.stdout:1/885: rename d2/d89/ca6 to d2/d6/c11d 0 2024-09-10T10:04:25.579 INFO:tasks.workunit.client.0.smithi071.stdout:4/628: write db/d15/d4b/f64 [2997416,28553] 0 2024-09-10T10:04:25.581 INFO:tasks.workunit.client.0.smithi071.stdout:4/629: chown db/d15/d17/d4e/d5a/f7c 71321 1 2024-09-10T10:04:25.582 INFO:tasks.workunit.client.1.smithi107.stdout:1/886: symlink d2/d12/l11e 0 2024-09-10T10:04:25.584 INFO:tasks.workunit.client.1.smithi107.stdout:1/887: unlink d2/d36/caa 0 2024-09-10T10:04:25.584 INFO:tasks.workunit.client.0.smithi071.stdout:4/630: rename db/d15/d17/f72 to db/d15/d26/d43/d4d/fd1 0 2024-09-10T10:04:25.586 INFO:tasks.workunit.client.0.smithi071.stdout:0/795: write f7 [1214835,51356] 0 2024-09-10T10:04:25.586 INFO:tasks.workunit.client.0.smithi071.stdout:7/836: write d9/ff [2285316,7175] 0 2024-09-10T10:04:25.587 INFO:tasks.workunit.client.0.smithi071.stdout:4/631: dread - db/da0/fa8 zero size 2024-09-10T10:04:25.588 INFO:tasks.workunit.client.1.smithi107.stdout:1/888: mkdir d2/d6/dc6/dd4/d106/d11f 0 2024-09-10T10:04:25.591 INFO:tasks.workunit.client.1.smithi107.stdout:5/764: write de/f1b [1448603,49907] 0 2024-09-10T10:04:25.592 INFO:tasks.workunit.client.0.smithi071.stdout:3/696: dwrite d3/d10/d24/d2b/fe5 [0,4194304] 0 2024-09-10T10:04:25.592 INFO:tasks.workunit.client.1.smithi107.stdout:5/765: stat de/d20/f7c 0 2024-09-10T10:04:25.593 INFO:tasks.workunit.client.1.smithi107.stdout:1/889: creat d2/d6/d24/f120 x:0 0 0 2024-09-10T10:04:25.595 INFO:tasks.workunit.client.0.smithi071.stdout:3/697: fsync d3/d1c/d3c/da1/d5d/d7a/fe1 0 2024-09-10T10:04:25.595 INFO:tasks.workunit.client.0.smithi071.stdout:0/796: fsync d11/d22/d31/d72/ff1 0 2024-09-10T10:04:25.595 INFO:tasks.workunit.client.1.smithi107.stdout:2/777: write d3/da/df/d20/d36/d39/fbc [724754,81290] 0 2024-09-10T10:04:25.596 INFO:tasks.workunit.client.0.smithi071.stdout:5/608: write dc/df/d17/f1f [5015752,66703] 0 2024-09-10T10:04:25.599 INFO:tasks.workunit.client.0.smithi071.stdout:7/837: dread d9/d76/f42 [0,4194304] 0 2024-09-10T10:04:25.599 INFO:tasks.workunit.client.1.smithi107.stdout:5/766: symlink de/d20/d2b/d4b/lfc 0 2024-09-10T10:04:25.600 INFO:tasks.workunit.client.1.smithi107.stdout:1/890: readlink d2/d35/d7b/l7c 0 2024-09-10T10:04:25.600 INFO:tasks.workunit.client.0.smithi071.stdout:3/698: chown d3/fd 177861 1 2024-09-10T10:04:25.601 INFO:tasks.workunit.client.1.smithi107.stdout:1/891: stat d2/d35/d9c 0 2024-09-10T10:04:25.601 INFO:tasks.workunit.client.0.smithi071.stdout:3/699: write d3/fdd [309839,1742] 0 2024-09-10T10:04:25.602 INFO:tasks.workunit.client.1.smithi107.stdout:1/892: readlink d2/d6/d67/lb7 0 2024-09-10T10:04:25.602 INFO:tasks.workunit.client.1.smithi107.stdout:5/767: mknod de/d9c/cfd 0 2024-09-10T10:04:25.604 INFO:tasks.workunit.client.1.smithi107.stdout:0/762: truncate d6/f7 2692694 0 2024-09-10T10:04:25.605 INFO:tasks.workunit.client.0.smithi071.stdout:8/666: dwrite d5/df/d1e/d38/f42 [0,4194304] 0 2024-09-10T10:04:25.606 INFO:tasks.workunit.client.0.smithi071.stdout:7/838: fdatasync d9/d15/d1f/d74/d9b/fd7 0 2024-09-10T10:04:25.607 INFO:tasks.workunit.client.0.smithi071.stdout:5/609: creat dc/d53/d6a/fd6 x:0 0 0 2024-09-10T10:04:25.608 INFO:tasks.workunit.client.1.smithi107.stdout:1/893: link d2/l37 d2/d89/dd1/l121 0 2024-09-10T10:04:25.609 INFO:tasks.workunit.client.1.smithi107.stdout:0/763: symlink d6/d8/d2f/d2e/d7b/lf7 0 2024-09-10T10:04:25.611 INFO:tasks.workunit.client.1.smithi107.stdout:1/894: creat d2/d12/d65/de9/f122 x:0 0 0 2024-09-10T10:04:25.612 INFO:tasks.workunit.client.0.smithi071.stdout:8/667: fdatasync d5/df/fad 0 2024-09-10T10:04:25.613 INFO:tasks.workunit.client.1.smithi107.stdout:0/764: mkdir d6/d5a/da9/df8 0 2024-09-10T10:04:25.615 INFO:tasks.workunit.client.0.smithi071.stdout:7/839: rename d9/d2c/d4f/c120 to d9/d15/d40/d80/ddd/d110/c124 0 2024-09-10T10:04:25.616 INFO:tasks.workunit.client.0.smithi071.stdout:7/840: fdatasync d9/ff7 0 2024-09-10T10:04:25.616 INFO:tasks.workunit.client.1.smithi107.stdout:1/895: read d2/d6/d24/d81/fb2 [3697306,65683] 0 2024-09-10T10:04:25.617 INFO:tasks.workunit.client.0.smithi071.stdout:7/841: read - d9/d11/f5f zero size 2024-09-10T10:04:25.619 INFO:tasks.workunit.client.0.smithi071.stdout:4/632: dread db/d15/d17/f3d [0,4194304] 0 2024-09-10T10:04:25.619 INFO:tasks.workunit.client.1.smithi107.stdout:0/765: rename d6/d5a/da9/fe6 to d6/d8/ff9 0 2024-09-10T10:04:25.619 INFO:tasks.workunit.client.0.smithi071.stdout:3/700: getdents d3/d10/d24/dab 0 2024-09-10T10:04:25.622 INFO:tasks.workunit.client.0.smithi071.stdout:5/610: rename dc/df/d17/d22 to dc/df/dd7 0 2024-09-10T10:04:25.622 INFO:tasks.workunit.client.1.smithi107.stdout:1/896: truncate d2/d12/d65/db4/dd9/ddd/f100 423631 0 2024-09-10T10:04:25.623 INFO:tasks.workunit.client.1.smithi107.stdout:1/897: read - d2/d12/d65/fdf zero size 2024-09-10T10:04:25.625 INFO:tasks.workunit.client.1.smithi107.stdout:0/766: fdatasync d6/d8/d2f/d35/d3c/d58/d69/f88 0 2024-09-10T10:04:25.625 INFO:tasks.workunit.client.0.smithi071.stdout:0/797: write d11/d22/d40/f44 [1829652,117423] 0 2024-09-10T10:04:25.626 INFO:tasks.workunit.client.0.smithi071.stdout:4/633: fdatasync db/d15/d4b/f5f 0 2024-09-10T10:04:25.629 INFO:tasks.workunit.client.0.smithi071.stdout:3/701: unlink d3/d49/d34/d67/f94 0 2024-09-10T10:04:25.631 INFO:tasks.workunit.client.1.smithi107.stdout:1/898: dread d2/d6/d67/f9b [0,4194304] 0 2024-09-10T10:04:25.632 INFO:tasks.workunit.client.0.smithi071.stdout:5/611: creat dc/df/d29/d94/fd8 x:0 0 0 2024-09-10T10:04:25.634 INFO:tasks.workunit.client.0.smithi071.stdout:7/842: symlink d9/d15/d40/d80/ddd/de2/d11f/l125 0 2024-09-10T10:04:25.634 INFO:tasks.workunit.client.1.smithi107.stdout:1/899: symlink d2/d6/d67/d11c/df2/l123 0 2024-09-10T10:04:25.635 INFO:tasks.workunit.client.1.smithi107.stdout:5/768: dwrite de/d20/f80 [0,4194304] 0 2024-09-10T10:04:25.636 INFO:tasks.workunit.client.1.smithi107.stdout:1/900: chown d2/d6/d24/f69 1402126270 1 2024-09-10T10:04:25.639 INFO:tasks.workunit.client.1.smithi107.stdout:5/769: mknod de/db3/db6/dc8/cfe 0 2024-09-10T10:04:25.642 INFO:tasks.workunit.client.1.smithi107.stdout:5/770: truncate de/d20/d3d/f88 4965427 0 2024-09-10T10:04:25.643 INFO:tasks.workunit.client.0.smithi071.stdout:8/668: link d5/df/l34 d5/df/d95/le8 0 2024-09-10T10:04:25.643 INFO:tasks.workunit.client.0.smithi071.stdout:0/798: dwrite d11/d30/d70/de2/ffb [0,4194304] 0 2024-09-10T10:04:25.644 INFO:tasks.workunit.client.1.smithi107.stdout:5/771: rmdir de/d4a/d7e/db2 39 2024-09-10T10:04:25.645 INFO:tasks.workunit.client.0.smithi071.stdout:0/799: dread - d11/d30/d70/fce zero size 2024-09-10T10:04:25.645 INFO:tasks.workunit.client.1.smithi107.stdout:5/772: chown de/d41/lbd 2 1 2024-09-10T10:04:25.649 INFO:tasks.workunit.client.1.smithi107.stdout:1/901: dwrite d2/d6/d67/d11c/f109 [0,4194304] 0 2024-09-10T10:04:25.650 INFO:tasks.workunit.client.0.smithi071.stdout:5/612: creat dc/df/d3e/d5a/dd4/fd9 x:0 0 0 2024-09-10T10:04:25.651 INFO:tasks.workunit.client.1.smithi107.stdout:0/767: dread d6/d8/d2f/d2e/d32/f6c [0,4194304] 0 2024-09-10T10:04:25.654 INFO:tasks.workunit.client.0.smithi071.stdout:0/800: stat d11/c28 0 2024-09-10T10:04:25.654 INFO:tasks.workunit.client.0.smithi071.stdout:8/669: mkdir d5/df/d57/d82/de9 0 2024-09-10T10:04:25.654 INFO:tasks.workunit.client.1.smithi107.stdout:0/768: symlink d6/d8/d2f/d35/d3c/d58/lfa 0 2024-09-10T10:04:25.655 INFO:tasks.workunit.client.0.smithi071.stdout:5/613: write dc/df/d3e/d5a/d80/f86 [1133103,60966] 0 2024-09-10T10:04:25.655 INFO:tasks.workunit.client.1.smithi107.stdout:5/773: unlink de/d4a/d4e/d89/d99/fac 0 2024-09-10T10:04:25.655 INFO:tasks.workunit.client.0.smithi071.stdout:3/702: getdents d3/d1c/d3c/da1/d3a/dbd 0 2024-09-10T10:04:25.656 INFO:tasks.workunit.client.0.smithi071.stdout:0/801: fsync d11/d1e/dfa/d5f/f10e 0 2024-09-10T10:04:25.657 INFO:tasks.workunit.client.1.smithi107.stdout:5/774: creat de/fff x:0 0 0 2024-09-10T10:04:25.658 INFO:tasks.workunit.client.0.smithi071.stdout:5/614: dread - dc/df/d3e/fd1 zero size 2024-09-10T10:04:25.658 INFO:tasks.workunit.client.0.smithi071.stdout:3/703: chown d3/d1c/d3c/c5c 606225 1 2024-09-10T10:04:25.658 INFO:tasks.workunit.client.0.smithi071.stdout:5/615: chown dc/f3c 52798 1 2024-09-10T10:04:25.659 INFO:tasks.workunit.client.0.smithi071.stdout:8/670: write d5/df/d1d/d86/d75/f7b [1582167,57713] 0 2024-09-10T10:04:25.660 INFO:tasks.workunit.client.0.smithi071.stdout:0/802: mknod d11/d1e/c11d 0 2024-09-10T10:04:25.661 INFO:tasks.workunit.client.1.smithi107.stdout:5/775: creat de/d4a/d7e/d79/f100 x:0 0 0 2024-09-10T10:04:25.664 INFO:tasks.workunit.client.0.smithi071.stdout:0/803: mknod d11/d22/dde/d100/c11e 0 2024-09-10T10:04:25.665 INFO:tasks.workunit.client.1.smithi107.stdout:5/776: symlink de/d20/d2b/d4b/d8c/l101 0 2024-09-10T10:04:25.665 INFO:tasks.workunit.client.1.smithi107.stdout:9/715: sync 2024-09-10T10:04:25.665 INFO:tasks.workunit.client.1.smithi107.stdout:8/653: sync 2024-09-10T10:04:25.666 INFO:tasks.workunit.client.1.smithi107.stdout:4/866: sync 2024-09-10T10:04:25.666 INFO:tasks.workunit.client.0.smithi071.stdout:0/804: chown d11/d22/dde/d100/c11e 122173532 1 2024-09-10T10:04:25.666 INFO:tasks.workunit.client.1.smithi107.stdout:4/867: chown d0/f8 19759 1 2024-09-10T10:04:25.667 INFO:tasks.workunit.client.0.smithi071.stdout:5/616: getdents dc/d53 0 2024-09-10T10:04:25.667 INFO:tasks.workunit.client.1.smithi107.stdout:5/777: dread - de/d4a/f81 zero size 2024-09-10T10:04:25.669 INFO:tasks.workunit.client.0.smithi071.stdout:8/671: dread d5/df/fad [0,4194304] 0 2024-09-10T10:04:25.671 INFO:tasks.workunit.client.0.smithi071.stdout:5/617: mkdir dc/df/d3e/d5a/d80/d8a/dda 0 2024-09-10T10:04:25.671 INFO:tasks.workunit.client.1.smithi107.stdout:8/654: truncate d5/d8/d66/d8b/d21/d83/f55 3429487 0 2024-09-10T10:04:25.672 INFO:tasks.workunit.client.1.smithi107.stdout:8/655: readlink d5/d8/d66/d8b/d18/d4f/l51 0 2024-09-10T10:04:25.673 INFO:tasks.workunit.client.0.smithi071.stdout:0/805: dread d11/d22/d40/fc8 [0,4194304] 0 2024-09-10T10:04:25.673 INFO:tasks.workunit.client.0.smithi071.stdout:8/672: write d5/f19 [11993,91097] 0 2024-09-10T10:04:25.675 INFO:tasks.workunit.client.0.smithi071.stdout:5/618: mknod dc/df/d29/d48/cdb 0 2024-09-10T10:04:25.675 INFO:tasks.workunit.client.1.smithi107.stdout:8/656: mknod d5/da2/cda 0 2024-09-10T10:04:25.675 INFO:tasks.workunit.client.0.smithi071.stdout:8/673: chown d5/df/d57/f8a 6319 1 2024-09-10T10:04:25.676 INFO:tasks.workunit.client.1.smithi107.stdout:8/657: fsync d5/d8/f6d 0 2024-09-10T10:04:25.676 INFO:tasks.workunit.client.0.smithi071.stdout:0/806: readlink d11/d1e/dfa/d79/ddc/l117 0 2024-09-10T10:04:25.676 INFO:tasks.workunit.client.1.smithi107.stdout:8/658: fdatasync d5/d8/d2a/d35/d70/f95 0 2024-09-10T10:04:25.677 INFO:tasks.workunit.client.0.smithi071.stdout:8/674: fsync d5/df/d1d/d86/d75/f9d 0 2024-09-10T10:04:25.677 INFO:tasks.workunit.client.0.smithi071.stdout:0/807: fsync d11/d30/f50 0 2024-09-10T10:04:25.678 INFO:tasks.workunit.client.1.smithi107.stdout:8/659: mkdir d5/d42/ddb 0 2024-09-10T10:04:25.678 INFO:tasks.workunit.client.0.smithi071.stdout:8/675: chown d5/df/d74/lb2 14820236 1 2024-09-10T10:04:25.682 INFO:tasks.workunit.client.1.smithi107.stdout:8/660: link d5/d8/d66/d8b/d21/c50 d5/d8/d66/d8b/d18/dab/cdc 0 2024-09-10T10:04:25.683 INFO:tasks.workunit.client.1.smithi107.stdout:8/661: write d5/d8/d66/d8b/d1a/d75/fac [126852,32255] 0 2024-09-10T10:04:25.686 INFO:tasks.workunit.client.1.smithi107.stdout:8/662: unlink d5/d8/d2a/f5d 0 2024-09-10T10:04:25.688 INFO:tasks.workunit.client.1.smithi107.stdout:8/663: rmdir d5/d8/d66/d8b/d18/dab 39 2024-09-10T10:04:25.690 INFO:tasks.workunit.client.1.smithi107.stdout:1/902: write d2/d12/f1a [774874,124556] 0 2024-09-10T10:04:25.691 INFO:tasks.workunit.client.0.smithi071.stdout:4/634: write db/d15/d17/d24/f25 [822543,80738] 0 2024-09-10T10:04:25.693 INFO:tasks.workunit.client.1.smithi107.stdout:0/769: truncate d6/d8/d2f/d2e/d32/f5d 739993 0 2024-09-10T10:04:25.694 INFO:tasks.workunit.client.1.smithi107.stdout:1/903: creat d2/d12/d65/de9/f124 x:0 0 0 2024-09-10T10:04:25.696 INFO:tasks.workunit.client.1.smithi107.stdout:9/716: write d5/d7/d1d/d9b/dab/d57/d87/d27/f60 [4632547,1625] 0 2024-09-10T10:04:25.699 INFO:tasks.workunit.client.0.smithi071.stdout:7/843: dwrite d9/d15/d1f/d74/da1/dcf/dfe/d108/d10c/d118/f6e [0,4194304] 0 2024-09-10T10:04:25.699 INFO:tasks.workunit.client.1.smithi107.stdout:5/778: truncate de/fb8 3710833 0 2024-09-10T10:04:25.699 INFO:tasks.workunit.client.0.smithi071.stdout:4/635: truncate db/d15/d17/f6f 3708450 0 2024-09-10T10:04:25.700 INFO:tasks.workunit.client.0.smithi071.stdout:5/619: write dc/f21 [2337003,13273] 0 2024-09-10T10:04:25.702 INFO:tasks.workunit.client.1.smithi107.stdout:1/904: truncate d2/d6/d67/fbb 4827803 0 2024-09-10T10:04:25.703 INFO:tasks.workunit.client.1.smithi107.stdout:0/770: dread d6/d5a/d5c/fc9 [0,4194304] 0 2024-09-10T10:04:25.705 INFO:tasks.workunit.client.0.smithi071.stdout:5/620: read dc/df/d3e/d5a/f5e [106182,77061] 0 2024-09-10T10:04:25.706 INFO:tasks.workunit.client.0.smithi071.stdout:4/636: unlink db/d8f/fac 0 2024-09-10T10:04:25.707 INFO:tasks.workunit.client.0.smithi071.stdout:8/676: write d5/df/d74/fe6 [334622,55668] 0 2024-09-10T10:04:25.708 INFO:tasks.workunit.client.1.smithi107.stdout:9/717: symlink d5/d7/d1d/d41/dc8/lec 0 2024-09-10T10:04:25.708 INFO:tasks.workunit.client.1.smithi107.stdout:0/771: read d6/d8/d2f/d2e/d7b/f8b [6164583,73437] 0 2024-09-10T10:04:25.709 INFO:tasks.workunit.client.0.smithi071.stdout:7/844: rename d9/d70/fca to d9/d15/d1f/d74/d9b/f126 0 2024-09-10T10:04:25.710 INFO:tasks.workunit.client.1.smithi107.stdout:8/664: dread d5/d8/d2a/d35/d70/f95 [0,4194304] 0 2024-09-10T10:04:25.712 INFO:tasks.workunit.client.1.smithi107.stdout:4/868: dwrite d0/d40/fb2 [0,4194304] 0 2024-09-10T10:04:25.713 INFO:tasks.workunit.client.0.smithi071.stdout:7/845: chown d9/d1a/l38 0 1 2024-09-10T10:04:25.714 INFO:tasks.workunit.client.1.smithi107.stdout:5/779: creat de/db3/db6/dc8/f102 x:0 0 0 2024-09-10T10:04:25.714 INFO:tasks.workunit.client.1.smithi107.stdout:8/665: write d5/d8/d66/d8b/d18/fb2 [872061,96620] 0 2024-09-10T10:04:25.715 INFO:tasks.workunit.client.0.smithi071.stdout:5/621: stat dc/df/dd7/l39 0 2024-09-10T10:04:25.717 INFO:tasks.workunit.client.0.smithi071.stdout:0/808: dwrite d11/d22/d9a/ddf/fec [0,4194304] 0 2024-09-10T10:04:25.719 INFO:tasks.workunit.client.0.smithi071.stdout:5/622: write dc/df/d3e/d5a/fca [918534,94899] 0 2024-09-10T10:04:25.721 INFO:tasks.workunit.client.0.smithi071.stdout:0/809: chown d11/d30/d70/fe1 1601 1 2024-09-10T10:04:25.725 INFO:tasks.workunit.client.1.smithi107.stdout:8/666: dwrite d5/d8/f34 [0,4194304] 0 2024-09-10T10:04:25.726 INFO:tasks.workunit.client.0.smithi071.stdout:7/846: creat d9/d15/d40/d80/ddd/f127 x:0 0 0 2024-09-10T10:04:25.727 INFO:tasks.workunit.client.0.smithi071.stdout:0/810: symlink d11/d22/d9a/d106/l11f 0 2024-09-10T10:04:25.730 INFO:tasks.workunit.client.0.smithi071.stdout:0/811: write d11/d22/d31/d72/fb7 [853474,118325] 0 2024-09-10T10:04:25.733 INFO:tasks.workunit.client.0.smithi071.stdout:0/812: chown d11/d1e/dfa/d79/df8/c10d 98358195 1 2024-09-10T10:04:25.736 INFO:tasks.workunit.client.1.smithi107.stdout:1/905: dread d2/d6/d24/f54 [0,4194304] 0 2024-09-10T10:04:25.737 INFO:tasks.workunit.client.0.smithi071.stdout:5/623: getdents dc/df 0 2024-09-10T10:04:25.741 INFO:tasks.workunit.client.1.smithi107.stdout:1/906: symlink d2/d12/d5a/d10b/l125 0 2024-09-10T10:04:25.743 INFO:tasks.workunit.client.1.smithi107.stdout:1/907: dread - d2/d35/fe7 zero size 2024-09-10T10:04:25.743 INFO:tasks.workunit.client.1.smithi107.stdout:8/667: getdents d5/d8/d2a/d47 0 2024-09-10T10:04:25.743 INFO:tasks.workunit.client.0.smithi071.stdout:8/677: write d5/df/d57/f8a [67091,7527] 0 2024-09-10T10:04:25.746 INFO:tasks.workunit.client.0.smithi071.stdout:7/847: link d9/d11/c18 d9/d15/d1f/d74/da1/dcf/dfe/d108/c128 0 2024-09-10T10:04:25.746 INFO:tasks.workunit.client.1.smithi107.stdout:1/908: chown d2/d12/d5a/lb5 1329 1 2024-09-10T10:04:25.747 INFO:tasks.workunit.client.0.smithi071.stdout:7/848: truncate d9/ff7 252733 0 2024-09-10T10:04:25.747 INFO:tasks.workunit.client.0.smithi071.stdout:7/849: fsync d9/d15/d1f/d98/fc1 0 2024-09-10T10:04:25.748 INFO:tasks.workunit.client.0.smithi071.stdout:8/678: mkdir d5/df/d1d/d86/d90/db4/dea 0 2024-09-10T10:04:25.750 INFO:tasks.workunit.client.0.smithi071.stdout:5/624: getdents dc/df/dd7/d87 0 2024-09-10T10:04:25.751 INFO:tasks.workunit.client.1.smithi107.stdout:1/909: creat d2/d6/d67/d11c/df2/f126 x:0 0 0 2024-09-10T10:04:25.752 INFO:tasks.workunit.client.0.smithi071.stdout:7/850: mkdir d9/d15/d1f/d74/da1/dcf/d129 0 2024-09-10T10:04:25.753 INFO:tasks.workunit.client.1.smithi107.stdout:1/910: fdatasync d2/d6/fa 0 2024-09-10T10:04:25.754 INFO:tasks.workunit.client.1.smithi107.stdout:8/668: dwrite d5/d8/d66/d8b/d18/fbe [0,4194304] 0 2024-09-10T10:04:25.756 INFO:tasks.workunit.client.0.smithi071.stdout:8/679: creat d5/df/d1d/d86/d75/d85/feb x:0 0 0 2024-09-10T10:04:25.757 INFO:tasks.workunit.client.0.smithi071.stdout:5/625: getdents dc/d4a 0 2024-09-10T10:04:25.757 INFO:tasks.workunit.client.1.smithi107.stdout:9/718: dread d5/d7/d1d/d9b/dab/d57/f8a [0,4194304] 0 2024-09-10T10:04:25.762 INFO:tasks.workunit.client.1.smithi107.stdout:0/772: dread d6/d14/f2d [0,4194304] 0 2024-09-10T10:04:25.763 INFO:tasks.workunit.client.0.smithi071.stdout:7/851: dread d9/d15/d40/f79 [0,4194304] 0 2024-09-10T10:04:25.763 INFO:tasks.workunit.client.1.smithi107.stdout:9/719: write d5/d7/d1d/d9b/dab/d57/d87/d27/feb [160371,19232] 0 2024-09-10T10:04:25.765 INFO:tasks.workunit.client.1.smithi107.stdout:5/780: write de/d20/fd8 [161439,50100] 0 2024-09-10T10:04:25.765 INFO:tasks.workunit.client.0.smithi071.stdout:5/626: dwrite dc/df/d3e/d5a/d80/f86 [0,4194304] 0 2024-09-10T10:04:25.767 INFO:tasks.workunit.client.1.smithi107.stdout:5/781: readlink de/d4a/d5c/d6d/le3 0 2024-09-10T10:04:25.767 INFO:tasks.workunit.client.0.smithi071.stdout:4/637: dread f3 [0,4194304] 0 2024-09-10T10:04:25.767 INFO:tasks.workunit.client.1.smithi107.stdout:0/773: dread - d6/d8/d2f/d2e/d32/d95/dce/fd8 zero size 2024-09-10T10:04:25.768 INFO:tasks.workunit.client.1.smithi107.stdout:8/669: dwrite d5/d8/d66/f6a [0,4194304] 0 2024-09-10T10:04:25.769 INFO:tasks.workunit.client.0.smithi071.stdout:7/852: mkdir d9/d15/d1f/d74/da1/dcf/dfe/d108/d10c/d118/d105/d12a 0 2024-09-10T10:04:25.769 INFO:tasks.workunit.client.0.smithi071.stdout:7/853: readlink d9/d15/d1f/lb2 0 2024-09-10T10:04:25.770 INFO:tasks.workunit.client.0.smithi071.stdout:4/638: creat db/d15/d17/d4e/d5a/fd2 x:0 0 0 2024-09-10T10:04:25.770 INFO:tasks.workunit.client.1.smithi107.stdout:9/720: symlink d5/d7/d1d/d41/led 0 2024-09-10T10:04:25.771 INFO:tasks.workunit.client.0.smithi071.stdout:7/854: fsync d9/d1a/d1d/f1e 0 2024-09-10T10:04:25.776 INFO:tasks.workunit.client.1.smithi107.stdout:5/782: mkdir de/d20/d2b/dcc/d103 0 2024-09-10T10:04:25.777 INFO:tasks.workunit.client.0.smithi071.stdout:4/639: mkdir db/d15/d17/d4e/d5a/dd3 0 2024-09-10T10:04:25.779 INFO:tasks.workunit.client.0.smithi071.stdout:4/640: stat db/d15/d17/d4e/c5d 0 2024-09-10T10:04:25.783 INFO:tasks.workunit.client.1.smithi107.stdout:0/774: dwrite d6/d8/d2f/d2e/d32/d85/d8a/feb [0,4194304] 0 2024-09-10T10:04:25.784 INFO:tasks.workunit.client.0.smithi071.stdout:0/813: truncate d11/d22/f97 5657846 0 2024-09-10T10:04:25.785 INFO:tasks.workunit.client.1.smithi107.stdout:9/721: symlink d5/d7/d1d/d9b/dab/lee 0 2024-09-10T10:04:25.785 INFO:tasks.workunit.client.1.smithi107.stdout:8/670: dwrite d5/d8/d66/d8b/d18/d4f/f5c [0,4194304] 0 2024-09-10T10:04:25.786 INFO:tasks.workunit.client.0.smithi071.stdout:4/641: rename f3 to db/d1d/d61/d6a/fd4 0 2024-09-10T10:04:25.790 INFO:tasks.workunit.client.1.smithi107.stdout:1/911: truncate d2/d12/d65/d6b/f42 5210770 0 2024-09-10T10:04:25.793 INFO:tasks.workunit.client.1.smithi107.stdout:1/912: write d2/d12/d94/fc9 [574112,85685] 0 2024-09-10T10:04:25.793 INFO:tasks.workunit.client.0.smithi071.stdout:0/814: creat d11/d1e/dfa/d79/ddc/f120 x:0 0 0 2024-09-10T10:04:25.794 INFO:tasks.workunit.client.1.smithi107.stdout:5/783: creat de/d4a/d5c/d6d/f104 x:0 0 0 2024-09-10T10:04:25.795 INFO:tasks.workunit.client.1.smithi107.stdout:8/671: creat d5/d42/fdd x:0 0 0 2024-09-10T10:04:25.796 INFO:tasks.workunit.client.0.smithi071.stdout:5/627: dread dc/df/d29/f3f [0,4194304] 0 2024-09-10T10:04:25.798 INFO:tasks.workunit.client.1.smithi107.stdout:1/913: symlink d2/d6/dc6/dd4/l127 0 2024-09-10T10:04:25.799 INFO:tasks.workunit.client.0.smithi071.stdout:0/815: rename d11/d22/f101 to d11/d22/d31/f121 0 2024-09-10T10:04:25.801 INFO:tasks.workunit.client.0.smithi071.stdout:5/628: rmdir dc/df/d3e 39 2024-09-10T10:04:25.801 INFO:tasks.workunit.client.1.smithi107.stdout:0/775: dwrite d6/d8/d2f/da3/dee/dae/fc3 [0,4194304] 0 2024-09-10T10:04:25.803 INFO:tasks.workunit.client.1.smithi107.stdout:5/784: creat de/d20/d2b/d4b/d5e/db1/f105 x:0 0 0 2024-09-10T10:04:25.803 INFO:tasks.workunit.client.1.smithi107.stdout:8/672: creat d5/d8/d66/d8b/d1a/d64/fde x:0 0 0 2024-09-10T10:04:25.803 INFO:tasks.workunit.client.0.smithi071.stdout:0/816: creat d11/d1e/f122 x:0 0 0 2024-09-10T10:04:25.805 INFO:tasks.workunit.client.1.smithi107.stdout:1/914: write d2/d12/d65/d6b/f2e [4451160,126762] 0 2024-09-10T10:04:25.805 INFO:tasks.workunit.client.0.smithi071.stdout:5/629: fdatasync dc/d53/db2/f7c 0 2024-09-10T10:04:25.809 INFO:tasks.workunit.client.1.smithi107.stdout:1/915: creat d2/d12/d65/db4/dd9/df7/f128 x:0 0 0 2024-09-10T10:04:25.811 INFO:tasks.workunit.client.0.smithi071.stdout:0/817: dwrite d11/d1e/dfa/d5f/f9e [0,4194304] 0 2024-09-10T10:04:25.812 INFO:tasks.workunit.client.1.smithi107.stdout:5/785: mkdir de/d20/d2b/d106 0 2024-09-10T10:04:25.812 INFO:tasks.workunit.client.1.smithi107.stdout:0/776: dread d6/d8/d2f/da3/da5/fab [0,4194304] 0 2024-09-10T10:04:25.813 INFO:tasks.workunit.client.1.smithi107.stdout:1/916: mknod d2/d36/c129 0 2024-09-10T10:04:25.813 INFO:tasks.workunit.client.0.smithi071.stdout:5/630: getdents dc/df/d3e/d5a/d80/d8a/dda 0 2024-09-10T10:04:25.818 INFO:tasks.workunit.client.1.smithi107.stdout:5/786: mkdir de/db3/d107 0 2024-09-10T10:04:25.819 INFO:tasks.workunit.client.1.smithi107.stdout:1/917: creat d2/d12/d65/db4/dd9/df7/f12a x:0 0 0 2024-09-10T10:04:25.820 INFO:tasks.workunit.client.0.smithi071.stdout:0/818: dread d11/d22/d9a/fbf [0,4194304] 0 2024-09-10T10:04:25.821 INFO:tasks.workunit.client.1.smithi107.stdout:1/918: write d2/d6/d67/d11c/f109 [1218167,67062] 0 2024-09-10T10:04:25.821 INFO:tasks.workunit.client.1.smithi107.stdout:5/787: write de/d4a/d7e/fdc [668985,80002] 0 2024-09-10T10:04:25.823 INFO:tasks.workunit.client.0.smithi071.stdout:5/631: dwrite dc/df/d3e/fb9 [0,4194304] 0 2024-09-10T10:04:25.823 INFO:tasks.workunit.client.0.smithi071.stdout:2/777: sync 2024-09-10T10:04:25.823 INFO:tasks.workunit.client.0.smithi071.stdout:1/723: sync 2024-09-10T10:04:25.824 INFO:tasks.workunit.client.0.smithi071.stdout:2/778: truncate d8/d87/fd3 656997 0 2024-09-10T10:04:25.826 INFO:tasks.workunit.client.0.smithi071.stdout:0/819: symlink d11/l123 0 2024-09-10T10:04:25.827 INFO:tasks.workunit.client.1.smithi107.stdout:9/722: dread d5/d7/d1d/d41/d83/fa6 [0,4194304] 0 2024-09-10T10:04:25.829 INFO:tasks.workunit.client.0.smithi071.stdout:0/820: write d11/d1e/f11c [948970,25128] 0 2024-09-10T10:04:25.829 INFO:tasks.workunit.client.1.smithi107.stdout:5/788: rename de/d20/f2c to de/db3/db6/f108 0 2024-09-10T10:04:25.830 INFO:tasks.workunit.client.0.smithi071.stdout:2/779: rename d8/d38/d47/d59 to d8/d4a/d104 0 2024-09-10T10:04:25.831 INFO:tasks.workunit.client.0.smithi071.stdout:1/724: dread - d1/d57/fc6 zero size 2024-09-10T10:04:25.832 INFO:tasks.workunit.client.0.smithi071.stdout:2/780: truncate d8/d4a/fef 600151 0 2024-09-10T10:04:25.833 INFO:tasks.workunit.client.1.smithi107.stdout:1/919: mkdir d2/d6/d24/d81/d10f/d12b 0 2024-09-10T10:04:25.834 INFO:tasks.workunit.client.0.smithi071.stdout:2/781: creat d8/d38/d8d/f105 x:0 0 0 2024-09-10T10:04:25.837 INFO:tasks.workunit.client.1.smithi107.stdout:9/723: link d5/d7/f78 d5/d7/d1d/d3b/fef 0 2024-09-10T10:04:25.837 INFO:tasks.workunit.client.0.smithi071.stdout:0/821: getdents d11/d22/d31/d72 0 2024-09-10T10:04:25.838 INFO:tasks.workunit.client.1.smithi107.stdout:9/724: readlink d5/d7/d1d/d41/d83/d9a/l33 0 2024-09-10T10:04:25.839 INFO:tasks.workunit.client.0.smithi071.stdout:1/725: creat d1/d21/f100 x:0 0 0 2024-09-10T10:04:25.840 INFO:tasks.workunit.client.1.smithi107.stdout:5/789: dread de/d4a/d4e/fa9 [0,4194304] 0 2024-09-10T10:04:25.841 INFO:tasks.workunit.client.0.smithi071.stdout:0/822: mknod d11/d22/dde/df2/c124 0 2024-09-10T10:04:25.842 INFO:tasks.workunit.client.0.smithi071.stdout:1/726: mkdir d1/d21/d3d/d9a/d101 0 2024-09-10T10:04:25.843 INFO:tasks.workunit.client.0.smithi071.stdout:0/823: creat d11/d1e/dfa/d79/f125 x:0 0 0 2024-09-10T10:04:25.844 INFO:tasks.workunit.client.0.smithi071.stdout:0/824: write d11/d22/d9a/ddf/ffd [108277,32943] 0 2024-09-10T10:04:25.845 INFO:tasks.workunit.client.0.smithi071.stdout:1/727: mkdir d1/d3f/d58/d102 0 2024-09-10T10:04:25.847 INFO:tasks.workunit.client.0.smithi071.stdout:0/825: truncate d11/d1e/dfa/f110 91120 0 2024-09-10T10:04:25.850 INFO:tasks.workunit.client.0.smithi071.stdout:0/826: mknod d11/d22/dde/df2/c126 0 2024-09-10T10:04:25.850 INFO:tasks.workunit.client.0.smithi071.stdout:2/782: dread d8/d4a/d104/f7b [0,4194304] 0 2024-09-10T10:04:25.853 INFO:tasks.workunit.client.0.smithi071.stdout:2/783: mknod d8/d4a/c106 0 2024-09-10T10:04:25.853 INFO:tasks.workunit.client.0.smithi071.stdout:1/728: dwrite d1/d57/f6b [0,4194304] 0 2024-09-10T10:04:25.853 INFO:tasks.workunit.client.0.smithi071.stdout:2/784: stat d8/f94 0 2024-09-10T10:04:25.854 INFO:tasks.workunit.client.0.smithi071.stdout:1/729: chown d1/d70/fcd 82680877 1 2024-09-10T10:04:25.855 INFO:tasks.workunit.client.0.smithi071.stdout:0/827: creat d11/d22/d31/d72/df3/f127 x:0 0 0 2024-09-10T10:04:25.860 INFO:tasks.workunit.client.0.smithi071.stdout:0/828: getdents d11/d22/d9a/ddf 0 2024-09-10T10:04:25.861 INFO:tasks.workunit.client.1.smithi107.stdout:9/725: dread d5/d7/d1d/d41/d83/d9a/fb0 [0,4194304] 0 2024-09-10T10:04:25.865 INFO:tasks.workunit.client.1.smithi107.stdout:9/726: mkdir d5/d7/d1d/d29/db4/df0 0 2024-09-10T10:04:25.871 INFO:tasks.workunit.client.0.smithi071.stdout:1/730: dread d1/d3f/f43 [0,4194304] 0 2024-09-10T10:04:25.872 INFO:tasks.workunit.client.0.smithi071.stdout:1/731: chown d1/d57/f6b 0 1 2024-09-10T10:04:25.874 INFO:tasks.workunit.client.0.smithi071.stdout:1/732: read d1/d21/d2f/d30/d6a/f69 [3063373,75860] 0 2024-09-10T10:04:25.876 INFO:tasks.workunit.client.0.smithi071.stdout:1/733: truncate d1/d21/d2f/d30/d6a/d91/fb2 98134 0 2024-09-10T10:04:25.879 INFO:tasks.workunit.client.0.smithi071.stdout:1/734: write d1/d3f/d58/ff0 [706671,43215] 0 2024-09-10T10:04:25.885 INFO:tasks.workunit.client.1.smithi107.stdout:7/710: sync 2024-09-10T10:04:25.885 INFO:tasks.workunit.client.0.smithi071.stdout:1/735: rename d1/d21/f63 to d1/d21/d3d/d9a/f103 0 2024-09-10T10:04:25.886 INFO:tasks.workunit.client.1.smithi107.stdout:8/673: dwrite d5/f2f [0,4194304] 0 2024-09-10T10:04:25.888 INFO:tasks.workunit.client.1.smithi107.stdout:0/777: write d6/d8/d2f/f33 [659626,43323] 0 2024-09-10T10:04:25.889 INFO:tasks.workunit.client.1.smithi107.stdout:1/920: rmdir d2/d12/d65/db4/dd9 39 2024-09-10T10:04:25.890 INFO:tasks.workunit.client.0.smithi071.stdout:7/855: dwrite d9/d2c/d4f/fc6 [0,4194304] 0 2024-09-10T10:04:25.892 INFO:tasks.workunit.client.0.smithi071.stdout:0/829: dread d11/d30/d70/f75 [0,4194304] 0 2024-09-10T10:04:25.892 INFO:tasks.workunit.client.1.smithi107.stdout:0/778: read d6/f45 [265631,43581] 0 2024-09-10T10:04:25.893 INFO:tasks.workunit.client.0.smithi071.stdout:7/856: stat d9/d1a/l20 0 2024-09-10T10:04:25.894 INFO:tasks.workunit.client.1.smithi107.stdout:0/779: chown d6/d8/d2f/d2e/d32/f6c 390 1 2024-09-10T10:04:25.896 INFO:tasks.workunit.client.1.smithi107.stdout:0/780: stat d6/d8/d2f/d35/d3c/d58/lfa 0 2024-09-10T10:04:25.896 INFO:tasks.workunit.client.0.smithi071.stdout:0/830: fdatasync d11/d30/f9b 0 2024-09-10T10:04:25.898 INFO:tasks.workunit.client.1.smithi107.stdout:5/790: read de/d4a/d7e/fdc [664346,72141] 0 2024-09-10T10:04:25.899 INFO:tasks.workunit.client.0.smithi071.stdout:4/642: dwrite db/d15/d26/d43/d4d/f3b [0,4194304] 0 2024-09-10T10:04:25.902 INFO:tasks.workunit.client.0.smithi071.stdout:5/632: fdatasync dc/df/d3e/fb9 0 2024-09-10T10:04:25.902 INFO:tasks.workunit.client.0.smithi071.stdout:1/736: read d1/f8e [217093,67719] 0 2024-09-10T10:04:25.903 INFO:tasks.workunit.client.0.smithi071.stdout:4/643: readlink db/lc 0 2024-09-10T10:04:25.903 INFO:tasks.workunit.client.0.smithi071.stdout:4/644: stat db/f12 0 2024-09-10T10:04:25.904 INFO:tasks.workunit.client.0.smithi071.stdout:5/633: write dc/df/d3e/d5a/fa7 [239212,7488] 0 2024-09-10T10:04:25.905 INFO:tasks.workunit.client.1.smithi107.stdout:7/711: unlink d0/d8/dc/d2c/d47/cd5 0 2024-09-10T10:04:25.905 INFO:tasks.workunit.client.1.smithi107.stdout:9/727: dread d5/f6a [0,4194304] 0 2024-09-10T10:04:25.906 INFO:tasks.workunit.client.1.smithi107.stdout:7/712: fdatasync d0/d8/f6f 0 2024-09-10T10:04:25.909 INFO:tasks.workunit.client.0.smithi071.stdout:1/737: symlink d1/d3f/l104 0 2024-09-10T10:04:25.910 INFO:tasks.workunit.client.0.smithi071.stdout:5/634: fsync f6 0 2024-09-10T10:04:25.913 INFO:tasks.workunit.client.0.smithi071.stdout:4/645: fsync db/d15/d26/d43/d4d/fad 0 2024-09-10T10:04:25.914 INFO:tasks.workunit.client.0.smithi071.stdout:4/646: chown db/d15/d17/d4e/d5a/f7c 5625329 1 2024-09-10T10:04:25.915 INFO:tasks.workunit.client.0.smithi071.stdout:1/738: creat d1/d21/d3d/f105 x:0 0 0 2024-09-10T10:04:25.915 INFO:tasks.workunit.client.0.smithi071.stdout:2/785: write d8/d87/d33/d41/d56/fb3 [48879,12270] 0 2024-09-10T10:04:25.917 INFO:tasks.workunit.client.0.smithi071.stdout:2/786: fsync d8/d38/d47/fa9 0 2024-09-10T10:04:25.917 INFO:tasks.workunit.client.0.smithi071.stdout:1/739: readlink d1/l17 0 2024-09-10T10:04:25.918 INFO:tasks.workunit.client.1.smithi107.stdout:9/728: mknod d5/d7/d1d/d41/d83/cf1 0 2024-09-10T10:04:25.918 INFO:tasks.workunit.client.0.smithi071.stdout:4/647: fsync db/d15/d26/d43/d82/f89 0 2024-09-10T10:04:25.920 INFO:tasks.workunit.client.1.smithi107.stdout:0/781: creat d6/d8/d2f/d2e/d32/d56/ddf/ffb x:0 0 0 2024-09-10T10:04:25.920 INFO:tasks.workunit.client.0.smithi071.stdout:0/831: getdents d11/d1e 0 2024-09-10T10:04:25.921 INFO:tasks.workunit.client.1.smithi107.stdout:7/713: mkdir d0/d8/d56/dcc/de7 0 2024-09-10T10:04:25.921 INFO:tasks.workunit.client.0.smithi071.stdout:2/787: mkdir d8/d87/d33/d41/d56/d107 0 2024-09-10T10:04:25.922 INFO:tasks.workunit.client.0.smithi071.stdout:0/832: rmdir d11/d22/d31/d72 39 2024-09-10T10:04:25.922 INFO:tasks.workunit.client.1.smithi107.stdout:5/791: creat de/d4a/d4e/f109 x:0 0 0 2024-09-10T10:04:25.925 INFO:tasks.workunit.client.1.smithi107.stdout:0/782: mkdir d6/d8/d2f/dfc 0 2024-09-10T10:04:25.926 INFO:tasks.workunit.client.0.smithi071.stdout:0/833: dread - d11/f7b zero size 2024-09-10T10:04:25.927 INFO:tasks.workunit.client.0.smithi071.stdout:0/834: stat d11/d1e/dfa/d5f 0 2024-09-10T10:04:25.929 INFO:tasks.workunit.client.1.smithi107.stdout:0/783: read d6/d8/d2f/d2e/d32/f4c [2493068,92586] 0 2024-09-10T10:04:25.930 INFO:tasks.workunit.client.1.smithi107.stdout:0/784: readlink d6/d8/d2f/d2e/lb5 0 2024-09-10T10:04:25.931 INFO:tasks.workunit.client.0.smithi071.stdout:1/740: rename d1/d21/f100 to d1/d21/d2f/d30/d6a/d91/f106 0 2024-09-10T10:04:25.932 INFO:tasks.workunit.client.0.smithi071.stdout:2/788: getdents d8/d87/d33/d41/d56/d107 0 2024-09-10T10:04:25.933 INFO:tasks.workunit.client.0.smithi071.stdout:4/648: rmdir db/d15/d17/dc7/dcf 0 2024-09-10T10:04:25.934 INFO:tasks.workunit.client.1.smithi107.stdout:9/729: getdents d5/d7/d1d 0 2024-09-10T10:04:25.934 INFO:tasks.workunit.client.0.smithi071.stdout:0/835: read d11/d1e/dfa/d5f/f95 [2775667,84328] 0 2024-09-10T10:04:25.935 INFO:tasks.workunit.client.0.smithi071.stdout:7/857: dwrite d9/d15/d1f/f68 [0,4194304] 0 2024-09-10T10:04:25.936 INFO:tasks.workunit.client.0.smithi071.stdout:5/635: truncate dc/df/d29/fa1 2653274 0 2024-09-10T10:04:25.937 INFO:tasks.workunit.client.1.smithi107.stdout:1/921: write d2/d35/fb0 [320661,6855] 0 2024-09-10T10:04:25.938 INFO:tasks.workunit.client.0.smithi071.stdout:2/789: dread - d8/d87/d33/dde/ff5 zero size 2024-09-10T10:04:25.940 INFO:tasks.workunit.client.1.smithi107.stdout:8/674: truncate d5/d8/d66/d8b/d18/fb2 908284 0 2024-09-10T10:04:25.941 INFO:tasks.workunit.client.0.smithi071.stdout:7/858: read d9/d1a/d1d/fea [2997910,89841] 0 2024-09-10T10:04:25.942 INFO:tasks.workunit.client.1.smithi107.stdout:0/785: mkdir d6/d8/d2f/d2e/d32/d56/dfd 0 2024-09-10T10:04:25.942 INFO:tasks.workunit.client.0.smithi071.stdout:4/649: symlink db/d1d/d7a/dd0/ld5 0 2024-09-10T10:04:25.942 INFO:tasks.workunit.client.0.smithi071.stdout:2/790: creat d8/d38/f108 x:0 0 0 2024-09-10T10:04:25.943 INFO:tasks.workunit.client.1.smithi107.stdout:0/786: chown d6/d8/d2f/da3/dee 54 1 2024-09-10T10:04:25.944 INFO:tasks.workunit.client.0.smithi071.stdout:7/859: chown d9/d15/d40/f95 9239 1 2024-09-10T10:04:25.947 INFO:tasks.workunit.client.0.smithi071.stdout:5/636: dwrite dc/df/dd7/f35 [0,4194304] 0 2024-09-10T10:04:25.947 INFO:tasks.workunit.client.0.smithi071.stdout:4/650: read - db/d15/d17/d4e/d5a/fd2 zero size 2024-09-10T10:04:25.948 INFO:tasks.workunit.client.1.smithi107.stdout:5/792: truncate de/d4a/d7e/f6e 3219382 0 2024-09-10T10:04:25.950 INFO:tasks.workunit.client.0.smithi071.stdout:1/741: creat d1/d21/d3d/d9a/d72/dfd/f107 x:0 0 0 2024-09-10T10:04:25.952 INFO:tasks.workunit.client.1.smithi107.stdout:0/787: dwrite d6/d14/f99 [4194304,4194304] 0 2024-09-10T10:04:25.952 INFO:tasks.workunit.client.0.smithi071.stdout:7/860: mknod d9/d15/d40/d80/dd6/c12b 0 2024-09-10T10:04:25.953 INFO:tasks.workunit.client.0.smithi071.stdout:4/651: unlink db/d15/d17/d24/l9d 0 2024-09-10T10:04:25.953 INFO:tasks.workunit.client.1.smithi107.stdout:9/730: mknod d5/d7/d1d/d41/cf2 0 2024-09-10T10:04:25.955 INFO:tasks.workunit.client.1.smithi107.stdout:8/675: mkdir d5/d8/d2a/d35/d85/dcb/ddf 0 2024-09-10T10:04:25.956 INFO:tasks.workunit.client.0.smithi071.stdout:7/861: write d9/d15/d1f/d74/d10f/f121 [734138,110323] 0 2024-09-10T10:04:25.958 INFO:tasks.workunit.client.0.smithi071.stdout:7/862: chown d9/d1a/da2/f11a 3403786 1 2024-09-10T10:04:25.959 INFO:tasks.workunit.client.1.smithi107.stdout:1/922: mkdir d2/d35/d7b/d12c 0 2024-09-10T10:04:25.966 INFO:tasks.workunit.client.1.smithi107.stdout:7/714: dwrite d0/d1b/d9b/faf [0,4194304] 0 2024-09-10T10:04:25.966 INFO:tasks.workunit.client.1.smithi107.stdout:0/788: creat d6/d8/d2f/da3/dee/ffe x:0 0 0 2024-09-10T10:04:25.968 INFO:tasks.workunit.client.1.smithi107.stdout:5/793: read de/d4a/d5c/f8e [741849,73618] 0 2024-09-10T10:04:25.970 INFO:tasks.workunit.client.1.smithi107.stdout:1/923: symlink d2/d6/d24/d81/d10f/d12b/l12d 0 2024-09-10T10:04:25.970 INFO:tasks.workunit.client.0.smithi071.stdout:7/863: creat d9/d15/d1f/d74/da1/dcf/de1/f12c x:0 0 0 2024-09-10T10:04:25.971 INFO:tasks.workunit.client.0.smithi071.stdout:7/864: dread - d9/d15/d1f/d74/da1/dcf/dfe/d108/d10c/d118/fee zero size 2024-09-10T10:04:25.971 INFO:tasks.workunit.client.0.smithi071.stdout:7/865: write d9/d15/d1f/d74/da1/dcf/dfe/d108/d10c/d118/f6e [3328545,113586] 0 2024-09-10T10:04:25.971 INFO:tasks.workunit.client.1.smithi107.stdout:5/794: chown de/d4a/f53 28639 1 2024-09-10T10:04:25.971 INFO:tasks.workunit.client.1.smithi107.stdout:8/676: link d5/d8/d66/d8b/d21/d83/c7f d5/d8/d66/d8b/d1a/ce0 0 2024-09-10T10:04:25.972 INFO:tasks.workunit.client.1.smithi107.stdout:0/789: symlink d6/d8/d2f/d2e/lff 0 2024-09-10T10:04:25.974 INFO:tasks.workunit.client.1.smithi107.stdout:1/924: readlink d2/d12/d65/d6b/l33 0 2024-09-10T10:04:25.974 INFO:tasks.workunit.client.0.smithi071.stdout:2/791: dread d8/d87/d33/d41/d4d/f85 [0,4194304] 0 2024-09-10T10:04:25.974 INFO:tasks.workunit.client.0.smithi071.stdout:2/792: fsync d8/f20 0 2024-09-10T10:04:25.975 INFO:tasks.workunit.client.1.smithi107.stdout:5/795: rmdir de/db3/db6/dc8 39 2024-09-10T10:04:25.975 INFO:tasks.workunit.client.0.smithi071.stdout:7/866: creat d9/d15/d40/d80/ddd/de2/d11f/f12d x:0 0 0 2024-09-10T10:04:25.976 INFO:tasks.workunit.client.0.smithi071.stdout:2/793: write d8/d4a/ffa [704749,61198] 0 2024-09-10T10:04:25.978 INFO:tasks.workunit.client.0.smithi071.stdout:6/599: sync 2024-09-10T10:04:25.979 INFO:tasks.workunit.client.0.smithi071.stdout:3/704: sync 2024-09-10T10:04:25.979 INFO:tasks.workunit.client.1.smithi107.stdout:8/677: creat d5/d8/d66/d8b/d1a/da3/fe1 x:0 0 0 2024-09-10T10:04:25.982 INFO:tasks.workunit.client.1.smithi107.stdout:0/790: dwrite d6/d8/d2f/d2e/fec [0,4194304] 0 2024-09-10T10:04:25.982 INFO:tasks.workunit.client.0.smithi071.stdout:3/705: stat d3/d1c/d3c/da1/d42/d4a/lcf 0 2024-09-10T10:04:25.984 INFO:tasks.workunit.client.1.smithi107.stdout:8/678: creat d5/d8/d5b/fe2 x:0 0 0 2024-09-10T10:04:25.985 INFO:tasks.workunit.client.1.smithi107.stdout:1/925: rename d2/d6/d24/dce to d2/d12/d65/db4/dd9/df7/d110/d12e 0 2024-09-10T10:04:25.986 INFO:tasks.workunit.client.0.smithi071.stdout:2/794: rename d8/c30 to d8/d4a/c109 0 2024-09-10T10:04:25.986 INFO:tasks.workunit.client.1.smithi107.stdout:0/791: creat d6/d8/d2f/da3/dee/f100 x:0 0 0 2024-09-10T10:04:25.987 INFO:tasks.workunit.client.0.smithi071.stdout:6/600: getdents d4/d61/d83/da8 0 2024-09-10T10:04:25.987 INFO:tasks.workunit.client.1.smithi107.stdout:8/679: write d5/d8/d2a/fd6 [766623,24950] 0 2024-09-10T10:04:25.988 INFO:tasks.workunit.client.0.smithi071.stdout:7/867: dwrite d9/d15/d1f/d74/da1/dcf/de1/f12c [0,4194304] 0 2024-09-10T10:04:25.990 INFO:tasks.workunit.client.1.smithi107.stdout:0/792: stat d6/d8/d2f/d35/d3c/d58/c82 0 2024-09-10T10:04:25.992 INFO:tasks.workunit.client.1.smithi107.stdout:5/796: dwrite de/d20/d2b/d4b/d5e/d9a/fe6 [0,4194304] 0 2024-09-10T10:04:25.993 INFO:tasks.workunit.client.1.smithi107.stdout:1/926: mkdir d2/d12/d65/db4/dd9/ddd/d12f 0 2024-09-10T10:04:25.993 INFO:tasks.workunit.client.0.smithi071.stdout:3/706: rename d3/d1c/c29 to d3/d20/d99/cf7 0 2024-09-10T10:04:25.996 INFO:tasks.workunit.client.1.smithi107.stdout:6/778: sync 2024-09-10T10:04:25.996 INFO:tasks.workunit.client.1.smithi107.stdout:4/869: sync 2024-09-10T10:04:25.996 INFO:tasks.workunit.client.1.smithi107.stdout:2/778: sync 2024-09-10T10:04:25.996 INFO:tasks.workunit.client.0.smithi071.stdout:6/601: creat d4/da/df/d2e/d3a/d40/d60/fbf x:0 0 0 2024-09-10T10:04:25.997 INFO:tasks.workunit.client.1.smithi107.stdout:8/680: mkdir d5/d8/d66/d8b/d81/de3 0 2024-09-10T10:04:26.004 INFO:tasks.workunit.client.0.smithi071.stdout:3/707: dread d3/d49/d2f/fb5 [0,4194304] 0 2024-09-10T10:04:26.006 INFO:tasks.workunit.client.0.smithi071.stdout:2/795: rename d8/d24/fa5 to d8/d24/d7f/f10a 0 2024-09-10T10:04:26.006 INFO:tasks.workunit.client.0.smithi071.stdout:7/868: dwrite d9/d1a/da2/f11a [0,4194304] 0 2024-09-10T10:04:26.007 INFO:tasks.workunit.client.0.smithi071.stdout:6/602: creat d4/da/df/d2e/d3a/d51/fc0 x:0 0 0 2024-09-10T10:04:26.008 INFO:tasks.workunit.client.0.smithi071.stdout:1/742: write d1/f74 [133097,31845] 0 2024-09-10T10:04:26.008 INFO:tasks.workunit.client.1.smithi107.stdout:5/797: truncate de/d4a/d7e/db2/dbc/fe9 842237 0 2024-09-10T10:04:26.008 INFO:tasks.workunit.client.1.smithi107.stdout:6/779: creat d0/d3d/d14/d9f/dca/f113 x:0 0 0 2024-09-10T10:04:26.009 INFO:tasks.workunit.client.1.smithi107.stdout:5/798: readlink de/d41/lbd 0 2024-09-10T10:04:26.010 INFO:tasks.workunit.client.1.smithi107.stdout:0/793: dwrite d6/d8/d2f/da3/da5/fc1 [0,4194304] 0 2024-09-10T10:04:26.011 INFO:tasks.workunit.client.0.smithi071.stdout:7/869: dread - d9/d11/fe4 zero size 2024-09-10T10:04:26.012 INFO:tasks.workunit.client.1.smithi107.stdout:5/799: readlink de/d4a/d7e/db2/lf7 0 2024-09-10T10:04:26.013 INFO:tasks.workunit.client.0.smithi071.stdout:3/708: readlink d3/d1c/d3c/da1/d5d/da5/lbc 0 2024-09-10T10:04:26.014 INFO:tasks.workunit.client.1.smithi107.stdout:2/779: creat d3/da/d1e/d5f/d54/d114/f115 x:0 0 0 2024-09-10T10:04:26.014 INFO:tasks.workunit.client.1.smithi107.stdout:8/681: creat d5/d42/ddb/fe4 x:0 0 0 2024-09-10T10:04:26.014 INFO:tasks.workunit.client.1.smithi107.stdout:4/870: creat d0/d6b/d11b/f129 x:0 0 0 2024-09-10T10:04:26.016 INFO:tasks.workunit.client.0.smithi071.stdout:7/870: mkdir d9/ddb/d12e 0 2024-09-10T10:04:26.016 INFO:tasks.workunit.client.0.smithi071.stdout:3/709: fsync d3/d10/d24/dab/fbb 0 2024-09-10T10:04:26.017 INFO:tasks.workunit.client.1.smithi107.stdout:1/927: write d2/d12/d5a/f5d [926148,78583] 0 2024-09-10T10:04:26.018 INFO:tasks.workunit.client.0.smithi071.stdout:8/680: sync 2024-09-10T10:04:26.021 INFO:tasks.workunit.client.0.smithi071.stdout:7/871: symlink d9/d15/d1f/d74/da1/dcf/de1/l12f 0 2024-09-10T10:04:26.024 INFO:tasks.workunit.client.1.smithi107.stdout:4/871: creat d0/d82/f12a x:0 0 0 2024-09-10T10:04:26.024 INFO:tasks.workunit.client.0.smithi071.stdout:8/681: rmdir d5/d30 39 2024-09-10T10:04:26.027 INFO:tasks.workunit.client.1.smithi107.stdout:0/794: creat d6/d8/f101 x:0 0 0 2024-09-10T10:04:26.028 INFO:tasks.workunit.client.0.smithi071.stdout:8/682: rmdir d5/d36/d49/d8f 39 2024-09-10T10:04:26.029 INFO:tasks.workunit.client.1.smithi107.stdout:2/780: dwrite d3/da/d1e/d40/f9f [0,4194304] 0 2024-09-10T10:04:26.031 INFO:tasks.workunit.client.1.smithi107.stdout:1/928: truncate d2/f49 399066 0 2024-09-10T10:04:26.033 INFO:tasks.workunit.client.1.smithi107.stdout:6/780: link d0/l37 d0/d3d/d14/d21/d8a/da2/da3/l114 0 2024-09-10T10:04:26.033 INFO:tasks.workunit.client.1.smithi107.stdout:1/929: write d2/d12/f95 [1070492,58550] 0 2024-09-10T10:04:26.035 INFO:tasks.workunit.client.0.smithi071.stdout:8/683: creat d5/df/d1d/d86/d75/fec x:0 0 0 2024-09-10T10:04:26.037 INFO:tasks.workunit.client.1.smithi107.stdout:9/731: truncate d5/d7/d1d/d9b/dab/d57/fd4 887861 0 2024-09-10T10:04:26.038 INFO:tasks.workunit.client.0.smithi071.stdout:8/684: creat d5/df/d67/fed x:0 0 0 2024-09-10T10:04:26.039 INFO:tasks.workunit.client.1.smithi107.stdout:4/872: creat d0/d40/d57/d76/d77/d10d/f12b x:0 0 0 2024-09-10T10:04:26.042 INFO:tasks.workunit.client.0.smithi071.stdout:4/652: dread db/d15/d26/d43/f66 [0,4194304] 0 2024-09-10T10:04:26.042 INFO:tasks.workunit.client.0.smithi071.stdout:4/653: truncate db/d15/d17/f3f 4576274 0 2024-09-10T10:04:26.042 INFO:tasks.workunit.client.0.smithi071.stdout:0/836: dread d11/d1e/dfa/f80 [0,4194304] 0 2024-09-10T10:04:26.042 INFO:tasks.workunit.client.1.smithi107.stdout:0/795: mknod d6/d8/d2f/d6e/dc5/ddb/df1/c102 0 2024-09-10T10:04:26.044 INFO:tasks.workunit.client.0.smithi071.stdout:8/685: chown d5/d36/d49/f78 362070 1 2024-09-10T10:04:26.044 INFO:tasks.workunit.client.1.smithi107.stdout:2/781: fsync d3/da/d1e/d5f/d54/f7d 0 2024-09-10T10:04:26.046 INFO:tasks.workunit.client.1.smithi107.stdout:2/782: chown d3/da/d1e/d40/d8a/d7f/d55/d85 1 1 2024-09-10T10:04:26.046 INFO:tasks.workunit.client.0.smithi071.stdout:8/686: dread d5/df/fad [0,4194304] 0 2024-09-10T10:04:26.047 INFO:tasks.workunit.client.1.smithi107.stdout:4/873: symlink d0/d40/d57/d76/d77/da1/l12c 0 2024-09-10T10:04:26.048 INFO:tasks.workunit.client.0.smithi071.stdout:0/837: mkdir d11/d30/d70/d128 0 2024-09-10T10:04:26.048 INFO:tasks.workunit.client.1.smithi107.stdout:1/930: truncate d2/d12/d5a/f73 408286 0 2024-09-10T10:04:26.049 INFO:tasks.workunit.client.0.smithi071.stdout:8/687: mknod d5/df/d1d/d86/cee 0 2024-09-10T10:04:26.049 INFO:tasks.workunit.client.1.smithi107.stdout:0/796: stat d6/d8/d3e/c5f 0 2024-09-10T10:04:26.051 INFO:tasks.workunit.client.0.smithi071.stdout:8/688: creat d5/df/d1e/d38/fef x:0 0 0 2024-09-10T10:04:26.052 INFO:tasks.workunit.client.1.smithi107.stdout:0/797: rmdir d6/d8/d2f/da3/dee 39 2024-09-10T10:04:26.053 INFO:tasks.workunit.client.0.smithi071.stdout:0/838: unlink d11/d22/dde/d100/l10c 0 2024-09-10T10:04:26.053 INFO:tasks.workunit.client.0.smithi071.stdout:1/743: dread d1/fd [0,4194304] 0 2024-09-10T10:04:26.054 INFO:tasks.workunit.client.1.smithi107.stdout:4/874: creat d0/d40/d57/d76/d77/da1/f12d x:0 0 0 2024-09-10T10:04:26.056 INFO:tasks.workunit.client.1.smithi107.stdout:1/931: symlink d2/d6/d67/dfe/l130 0 2024-09-10T10:04:26.056 INFO:tasks.workunit.client.1.smithi107.stdout:0/798: dread - d6/d8/d2f/da3/dee/ffe zero size 2024-09-10T10:04:26.058 INFO:tasks.workunit.client.0.smithi071.stdout:8/689: link d5/df/d57/f8e d5/d36/d49/d8f/ff0 0 2024-09-10T10:04:26.061 INFO:tasks.workunit.client.1.smithi107.stdout:1/932: mkdir d2/d6/d24/d81/d131 0 2024-09-10T10:04:26.061 INFO:tasks.workunit.client.0.smithi071.stdout:8/690: chown d5/df/d1d/d81/ca9 3205 1 2024-09-10T10:04:26.061 INFO:tasks.workunit.client.1.smithi107.stdout:0/799: symlink d6/d8/d2f/dfc/l103 0 2024-09-10T10:04:26.062 INFO:tasks.workunit.client.1.smithi107.stdout:1/933: write d2/d35/d9c/f9d [4765157,9030] 0 2024-09-10T10:04:26.062 INFO:tasks.workunit.client.0.smithi071.stdout:2/796: dread d8/d87/f76 [0,4194304] 0 2024-09-10T10:04:26.063 INFO:tasks.workunit.client.0.smithi071.stdout:0/839: dwrite d11/d22/d9a/d106/f111 [0,4194304] 0 2024-09-10T10:04:26.063 INFO:tasks.workunit.client.1.smithi107.stdout:1/934: fsync d2/d12/d94/fc9 0 2024-09-10T10:04:26.063 INFO:tasks.workunit.client.0.smithi071.stdout:1/744: getdents d1/d57/dbf 0 2024-09-10T10:04:26.064 INFO:tasks.workunit.client.1.smithi107.stdout:0/800: write d6/d5a/d5c/fc9 [1351259,30312] 0 2024-09-10T10:04:26.066 INFO:tasks.workunit.client.0.smithi071.stdout:2/797: write d8/d87/fc2 [68045,64976] 0 2024-09-10T10:04:26.067 INFO:tasks.workunit.client.0.smithi071.stdout:1/745: readlink d1/d21/lb9 0 2024-09-10T10:04:26.070 INFO:tasks.workunit.client.0.smithi071.stdout:2/798: symlink d8/d87/d33/dde/l10b 0 2024-09-10T10:04:26.070 INFO:tasks.workunit.client.1.smithi107.stdout:1/935: fsync d2/d89/f9e 0 2024-09-10T10:04:26.072 INFO:tasks.workunit.client.1.smithi107.stdout:0/801: rename d6/d8/d3e/c42 to d6/d8/d2f/d35/d3c/d58/d86/c104 0 2024-09-10T10:04:26.072 INFO:tasks.workunit.client.0.smithi071.stdout:2/799: chown d8/d87/d49/d66/fb4 647107801 1 2024-09-10T10:04:26.073 INFO:tasks.workunit.client.0.smithi071.stdout:8/691: rmdir d5/df/d1d/d86/d90/db4/dd6 0 2024-09-10T10:04:26.075 INFO:tasks.workunit.client.0.smithi071.stdout:1/746: symlink d1/d3f/d58/d102/l108 0 2024-09-10T10:04:26.076 INFO:tasks.workunit.client.0.smithi071.stdout:2/800: dread d8/d87/d33/d41/d56/fb3 [0,4194304] 0 2024-09-10T10:04:26.077 INFO:tasks.workunit.client.1.smithi107.stdout:0/802: mknod d6/d8/c105 0 2024-09-10T10:04:26.078 INFO:tasks.workunit.client.0.smithi071.stdout:8/692: rename d5/df/d1e/d38/f4c to d5/df/d1e/d38/d9f/ff1 0 2024-09-10T10:04:26.079 INFO:tasks.workunit.client.1.smithi107.stdout:1/936: dwrite d2/d12/d5a/f5d [0,4194304] 0 2024-09-10T10:04:26.080 INFO:tasks.workunit.client.0.smithi071.stdout:1/747: mknod d1/c109 0 2024-09-10T10:04:26.082 INFO:tasks.workunit.client.1.smithi107.stdout:1/937: mknod d2/c132 0 2024-09-10T10:04:26.085 INFO:tasks.workunit.client.0.smithi071.stdout:1/748: dread d1/d57/f6b [0,4194304] 0 2024-09-10T10:04:26.085 INFO:tasks.workunit.client.0.smithi071.stdout:8/693: creat d5/df/ff2 x:0 0 0 2024-09-10T10:04:26.087 INFO:tasks.workunit.client.1.smithi107.stdout:0/803: dwrite f4 [0,4194304] 0 2024-09-10T10:04:26.092 INFO:tasks.workunit.client.1.smithi107.stdout:0/804: symlink d6/l106 0 2024-09-10T10:04:26.093 INFO:tasks.workunit.client.0.smithi071.stdout:8/694: unlink d5/df/d1e/d70/fd9 0 2024-09-10T10:04:26.094 INFO:tasks.workunit.client.0.smithi071.stdout:1/749: dwrite d1/d21/d65/f4e [4194304,4194304] 0 2024-09-10T10:04:26.099 INFO:tasks.workunit.client.1.smithi107.stdout:1/938: dwrite d2/d35/f57 [0,4194304] 0 2024-09-10T10:04:26.100 INFO:tasks.workunit.client.0.smithi071.stdout:1/750: mknod d1/d21/d3d/d9a/df9/c10a 0 2024-09-10T10:04:26.102 INFO:tasks.workunit.client.0.smithi071.stdout:8/695: dread - d5/df/d57/d82/f84 zero size 2024-09-10T10:04:26.105 INFO:tasks.workunit.client.1.smithi107.stdout:1/939: mkdir d2/d35/d9c/d133 0 2024-09-10T10:04:26.106 INFO:tasks.workunit.client.1.smithi107.stdout:5/800: write de/d4a/d7e/fab [292576,24223] 0 2024-09-10T10:04:26.107 INFO:tasks.workunit.client.0.smithi071.stdout:6/603: write d4/da/df/d2e/d3a/d40/f55 [4368608,127083] 0 2024-09-10T10:04:26.107 INFO:tasks.workunit.client.1.smithi107.stdout:7/715: truncate d0/d8/d56/f9e 1021404 0 2024-09-10T10:04:26.108 INFO:tasks.workunit.client.1.smithi107.stdout:5/801: chown de/d4a/d5c/d6d 9 1 2024-09-10T10:04:26.109 INFO:tasks.workunit.client.1.smithi107.stdout:1/940: chown d2/f32 241203 1 2024-09-10T10:04:26.110 INFO:tasks.workunit.client.0.smithi071.stdout:3/710: write d3/f36 [477608,79056] 0 2024-09-10T10:04:26.111 INFO:tasks.workunit.client.1.smithi107.stdout:1/941: write d2/d35/d9c/fe5 [497533,75508] 0 2024-09-10T10:04:26.111 INFO:tasks.workunit.client.1.smithi107.stdout:5/802: symlink de/db3/l10a 0 2024-09-10T10:04:26.116 INFO:tasks.workunit.client.0.smithi071.stdout:6/604: creat d4/d61/d83/da8/fc1 x:0 0 0 2024-09-10T10:04:26.116 INFO:tasks.workunit.client.0.smithi071.stdout:3/711: read d3/d1c/d3c/da1/d5d/d7a/f89 [247788,19025] 0 2024-09-10T10:04:26.117 INFO:tasks.workunit.client.0.smithi071.stdout:6/605: fdatasync d4/da/df/d2e/d3a/d43/f73 0 2024-09-10T10:04:26.120 INFO:tasks.workunit.client.1.smithi107.stdout:2/783: write d3/da/d1e/d40/d8a/d7f/d55/fb6 [461075,79985] 0 2024-09-10T10:04:26.120 INFO:tasks.workunit.client.1.smithi107.stdout:4/875: truncate d0/d1f/d90/fdb 22449 0 2024-09-10T10:04:26.124 INFO:tasks.workunit.client.0.smithi071.stdout:6/606: dwrite d4/d1c/f4d [4194304,4194304] 0 2024-09-10T10:04:26.124 INFO:tasks.workunit.client.1.smithi107.stdout:6/781: dwrite d0/d3d/d14/d21/f53 [0,4194304] 0 2024-09-10T10:04:26.126 INFO:tasks.workunit.client.1.smithi107.stdout:7/716: unlink d0/d1b/d4d/d69/d97/f30 0 2024-09-10T10:04:26.126 INFO:tasks.workunit.client.0.smithi071.stdout:0/840: truncate d11/d1e/dfa/d5f/f9e 891731 0 2024-09-10T10:04:26.129 INFO:tasks.workunit.client.0.smithi071.stdout:2/801: truncate d8/d4a/f55 2446880 0 2024-09-10T10:04:26.131 INFO:tasks.workunit.client.0.smithi071.stdout:1/751: getdents d1 0 2024-09-10T10:04:26.132 INFO:tasks.workunit.client.0.smithi071.stdout:6/607: rmdir d4 39 2024-09-10T10:04:26.132 INFO:tasks.workunit.client.0.smithi071.stdout:0/841: stat d11/d22/la8 0 2024-09-10T10:04:26.133 INFO:tasks.workunit.client.1.smithi107.stdout:6/782: creat d0/d70/f115 x:0 0 0 2024-09-10T10:04:26.134 INFO:tasks.workunit.client.0.smithi071.stdout:0/842: dread - d11/f7b zero size 2024-09-10T10:04:26.134 INFO:tasks.workunit.client.0.smithi071.stdout:5/637: write dc/df/dd7/d87/f92 [2096277,116983] 0 2024-09-10T10:04:26.138 INFO:tasks.workunit.client.1.smithi107.stdout:0/805: write d6/d8/d2f/d2e/d32/f5d [1771478,24770] 0 2024-09-10T10:04:26.139 INFO:tasks.workunit.client.0.smithi071.stdout:2/802: rmdir d8/d87/d49/dce 39 2024-09-10T10:04:26.140 INFO:tasks.workunit.client.0.smithi071.stdout:2/803: read - d8/d87/d33/dde/ff5 zero size 2024-09-10T10:04:26.140 INFO:tasks.workunit.client.1.smithi107.stdout:9/732: dwrite d5/d7/d1d/d9b/dab/d57/d87/f79 [0,4194304] 0 2024-09-10T10:04:26.146 INFO:tasks.workunit.client.1.smithi107.stdout:5/803: link de/d20/d2b/d4b/d5e/l8a de/db3/l10b 0 2024-09-10T10:04:26.146 INFO:tasks.workunit.client.1.smithi107.stdout:4/876: creat d0/d1f/d90/f12e x:0 0 0 2024-09-10T10:04:26.147 INFO:tasks.workunit.client.0.smithi071.stdout:8/696: dread d5/df/d74/fd1 [0,4194304] 0 2024-09-10T10:04:26.147 INFO:tasks.workunit.client.0.smithi071.stdout:2/804: fsync d8/d87/d33/d41/d4d/d5e/f9a 0 2024-09-10T10:04:26.148 INFO:tasks.workunit.client.0.smithi071.stdout:1/752: fsync d1/d57/f5f 0 2024-09-10T10:04:26.148 INFO:tasks.workunit.client.0.smithi071.stdout:0/843: mkdir d11/d22/d31/d72/d129 0 2024-09-10T10:04:26.149 INFO:tasks.workunit.client.1.smithi107.stdout:4/877: chown d0/d40/d57/d76/d77/da9/l120 15328422 1 2024-09-10T10:04:26.149 INFO:tasks.workunit.client.0.smithi071.stdout:5/638: dwrite dc/d53/db2/fc4 [0,4194304] 0 2024-09-10T10:04:26.152 INFO:tasks.workunit.client.0.smithi071.stdout:5/639: read - dc/d53/d6a/f96 zero size 2024-09-10T10:04:26.153 INFO:tasks.workunit.client.1.smithi107.stdout:0/806: read d6/d8/d3e/d43/f79 [676198,6176] 0 2024-09-10T10:04:26.153 INFO:tasks.workunit.client.0.smithi071.stdout:2/805: write d8/d38/d47/fb9 [1768098,15716] 0 2024-09-10T10:04:26.154 INFO:tasks.workunit.client.0.smithi071.stdout:8/697: symlink d5/df/d1d/d86/db7/lf3 0 2024-09-10T10:04:26.154 INFO:tasks.workunit.client.1.smithi107.stdout:7/717: truncate d0/d8/d56/d5d/f8b 698334 0 2024-09-10T10:04:26.155 INFO:tasks.workunit.client.0.smithi071.stdout:2/806: stat d8/d87/dc4 0 2024-09-10T10:04:26.155 INFO:tasks.workunit.client.0.smithi071.stdout:6/608: dread d4/da/df/d2e/d3a/d43/f6a [0,4194304] 0 2024-09-10T10:04:26.156 INFO:tasks.workunit.client.0.smithi071.stdout:5/640: symlink dc/d53/d79/ldc 0 2024-09-10T10:04:26.158 INFO:tasks.workunit.client.1.smithi107.stdout:4/878: mknod d0/d6b/d9d/c12f 0 2024-09-10T10:04:26.160 INFO:tasks.workunit.client.0.smithi071.stdout:8/698: symlink d5/d36/d49/d8f/lf4 0 2024-09-10T10:04:26.161 INFO:tasks.workunit.client.1.smithi107.stdout:6/783: rename d0/d3d/d14/d17/d24/f6f to d0/d3d/f116 0 2024-09-10T10:04:26.161 INFO:tasks.workunit.client.0.smithi071.stdout:2/807: symlink d8/d87/d49/l10c 0 2024-09-10T10:04:26.162 INFO:tasks.workunit.client.0.smithi071.stdout:8/699: write d5/d36/d49/d8f/fe4 [125299,3168] 0 2024-09-10T10:04:26.162 INFO:tasks.workunit.client.0.smithi071.stdout:3/712: write d3/d10/d24/f27 [811573,59874] 0 2024-09-10T10:04:26.163 INFO:tasks.workunit.client.1.smithi107.stdout:1/942: dread d2/d35/f47 [0,4194304] 0 2024-09-10T10:04:26.164 INFO:tasks.workunit.client.0.smithi071.stdout:2/808: write d8/d87/d49/d66/df0/f101 [768795,99843] 0 2024-09-10T10:04:26.165 INFO:tasks.workunit.client.1.smithi107.stdout:0/807: link d6/d8/d2f/d35/f8f d6/d8/d2f/d35/f107 0 2024-09-10T10:04:26.167 INFO:tasks.workunit.client.0.smithi071.stdout:6/609: mkdir d4/da/df/d2e/dc2 0 2024-09-10T10:04:26.167 INFO:tasks.workunit.client.1.smithi107.stdout:6/784: read d0/d3d/f40 [106503,23980] 0 2024-09-10T10:04:26.169 INFO:tasks.workunit.client.1.smithi107.stdout:1/943: creat d2/d12/d65/db4/dd9/d103/f134 x:0 0 0 2024-09-10T10:04:26.171 INFO:tasks.workunit.client.0.smithi071.stdout:8/700: dread d5/d36/d49/f7c [4194304,4194304] 0 2024-09-10T10:04:26.171 INFO:tasks.workunit.client.0.smithi071.stdout:2/809: creat d8/d87/dc4/dea/f10d x:0 0 0 2024-09-10T10:04:26.173 INFO:tasks.workunit.client.0.smithi071.stdout:2/810: truncate d8/fe9 529921 0 2024-09-10T10:04:26.173 INFO:tasks.workunit.client.1.smithi107.stdout:0/808: creat d6/d5a/f108 x:0 0 0 2024-09-10T10:04:26.174 INFO:tasks.workunit.client.1.smithi107.stdout:9/733: dread d5/d1e/f9f [0,4194304] 0 2024-09-10T10:04:26.174 INFO:tasks.workunit.client.1.smithi107.stdout:6/785: creat d0/d3d/d14/d21/d8a/d8d/f117 x:0 0 0 2024-09-10T10:04:26.174 INFO:tasks.workunit.client.1.smithi107.stdout:2/784: dread d3/d21/f3a [0,4194304] 0 2024-09-10T10:04:26.175 INFO:tasks.workunit.client.0.smithi071.stdout:3/713: mkdir d3/d1c/d3e/df8 0 2024-09-10T10:04:26.175 INFO:tasks.workunit.client.0.smithi071.stdout:8/701: mkdir d5/df/d1e/d38/df5 0 2024-09-10T10:04:26.176 INFO:tasks.workunit.client.1.smithi107.stdout:1/944: rename d2/ldb to d2/d35/d7b/d12c/l135 0 2024-09-10T10:04:26.177 INFO:tasks.workunit.client.0.smithi071.stdout:3/714: write d3/d1c/d3c/da1/d3a/dbd/fec [4385718,74658] 0 2024-09-10T10:04:26.181 INFO:tasks.workunit.client.0.smithi071.stdout:5/641: getdents dc/df/d29/d48 0 2024-09-10T10:04:26.185 INFO:tasks.workunit.client.1.smithi107.stdout:2/785: stat d3/da/d1e/d27/c59 0 2024-09-10T10:04:26.186 INFO:tasks.workunit.client.1.smithi107.stdout:5/804: truncate de/d20/d2b/f60 478843 0 2024-09-10T10:04:26.188 INFO:tasks.workunit.client.0.smithi071.stdout:6/610: mkdir d4/da/df/d2e/d3a/da9/dbc/dc3 0 2024-09-10T10:04:26.191 INFO:tasks.workunit.client.0.smithi071.stdout:8/702: write d5/d36/f41 [1621000,110083] 0 2024-09-10T10:04:26.191 INFO:tasks.workunit.client.0.smithi071.stdout:0/844: dwrite d11/d1e/dfa/d5f/f9e [0,4194304] 0 2024-09-10T10:04:26.194 INFO:tasks.workunit.client.0.smithi071.stdout:2/811: dwrite d8/d87/d49/d66/fb2 [0,4194304] 0 2024-09-10T10:04:26.195 INFO:tasks.workunit.client.1.smithi107.stdout:7/718: truncate d0/d8/dc/d2c/f7e 151606 0 2024-09-10T10:04:26.199 INFO:tasks.workunit.client.0.smithi071.stdout:5/642: getdents dc/df/d3e/d5a/d80/d8a/da3 0 2024-09-10T10:04:26.200 INFO:tasks.workunit.client.0.smithi071.stdout:1/753: dread d1/d21/d65/f7a [0,4194304] 0 2024-09-10T10:04:26.200 INFO:tasks.workunit.client.0.smithi071.stdout:8/703: creat d5/df/d74/ff6 x:0 0 0 2024-09-10T10:04:26.201 INFO:tasks.workunit.client.0.smithi071.stdout:6/611: write d4/da/df/d2e/d3a/d3e/d5d/d81/db2/fb6 [446855,44872] 0 2024-09-10T10:04:26.204 INFO:tasks.workunit.client.0.smithi071.stdout:8/704: write d5/d36/d49/fbf [4200725,16930] 0 2024-09-10T10:04:26.206 INFO:tasks.workunit.client.0.smithi071.stdout:3/715: dwrite d3/d49/d2f/d7f/f83 [0,4194304] 0 2024-09-10T10:04:26.206 INFO:tasks.workunit.client.0.smithi071.stdout:6/612: chown d4/da/df/l12 0 1 2024-09-10T10:04:26.207 INFO:tasks.workunit.client.0.smithi071.stdout:5/643: creat dc/d53/fdd x:0 0 0 2024-09-10T10:04:26.210 INFO:tasks.workunit.client.0.smithi071.stdout:0/845: truncate d11/d22/d9a/fa6 826886 0 2024-09-10T10:04:26.214 INFO:tasks.workunit.client.1.smithi107.stdout:6/786: mknod d0/d3d/d14/d17/d24/c118 0 2024-09-10T10:04:26.215 INFO:tasks.workunit.client.0.smithi071.stdout:5/644: rename dc/d53/l72 to dc/df/d3e/d5a/dd4/lde 0 2024-09-10T10:04:26.215 INFO:tasks.workunit.client.0.smithi071.stdout:3/716: rmdir d3/d49/d2f/dc2 39 2024-09-10T10:04:26.217 INFO:tasks.workunit.client.0.smithi071.stdout:0/846: symlink d11/d30/d70/l12a 0 2024-09-10T10:04:26.217 INFO:tasks.workunit.client.1.smithi107.stdout:9/734: rename d5/d1e/ldf to d5/d7/d1d/db5/lf3 0 2024-09-10T10:04:26.219 INFO:tasks.workunit.client.0.smithi071.stdout:5/645: chown dc/d53/cb4 457 1 2024-09-10T10:04:26.222 INFO:tasks.workunit.client.0.smithi071.stdout:1/754: link d1/d21/d2f/d30/d75/d97/ld6 d1/d21/d2f/d30/d75/d97/l10b 0 2024-09-10T10:04:26.223 INFO:tasks.workunit.client.1.smithi107.stdout:1/945: mknod d2/d35/d9c/d133/c136 0 2024-09-10T10:04:26.224 INFO:tasks.workunit.client.1.smithi107.stdout:7/719: symlink d0/d1b/le8 0 2024-09-10T10:04:26.225 INFO:tasks.workunit.client.1.smithi107.stdout:2/786: dwrite d3/da/df/d20/d36/d39/fa5 [0,4194304] 0 2024-09-10T10:04:26.226 INFO:tasks.workunit.client.0.smithi071.stdout:8/705: dwrite d5/df/d1d/d86/d75/fc9 [0,4194304] 0 2024-09-10T10:04:26.228 INFO:tasks.workunit.client.1.smithi107.stdout:9/735: link d5/f6a d5/d7/d1d/d9b/de5/ff4 0 2024-09-10T10:04:26.228 INFO:tasks.workunit.client.1.smithi107.stdout:5/805: creat de/d4a/d7e/f10c x:0 0 0 2024-09-10T10:04:26.229 INFO:tasks.workunit.client.0.smithi071.stdout:0/847: dwrite d11/d1e/dfa/d79/ddc/f120 [0,4194304] 0 2024-09-10T10:04:26.230 INFO:tasks.workunit.client.0.smithi071.stdout:8/706: dread - d5/df/d1e/fda zero size 2024-09-10T10:04:26.230 INFO:tasks.workunit.client.0.smithi071.stdout:5/646: rename dc/d53/lb8 to dc/df/d29/d94/ldf 0 2024-09-10T10:04:26.231 INFO:tasks.workunit.client.1.smithi107.stdout:0/809: getdents d6/d8/d2f/d2e/d32/d95 0 2024-09-10T10:04:26.232 INFO:tasks.workunit.client.1.smithi107.stdout:1/946: rename d2/d89/f9e to d2/d89/f137 0 2024-09-10T10:04:26.233 INFO:tasks.workunit.client.0.smithi071.stdout:1/755: creat d1/d21/d2f/d30/d75/d97/dee/f10c x:0 0 0 2024-09-10T10:04:26.234 INFO:tasks.workunit.client.1.smithi107.stdout:2/787: mknod d3/da/df/d20/d36/d39/da3/c116 0 2024-09-10T10:04:26.234 INFO:tasks.workunit.client.0.smithi071.stdout:0/848: write d11/d22/d31/fcb [1178427,114757] 0 2024-09-10T10:04:26.235 INFO:tasks.workunit.client.1.smithi107.stdout:9/736: rmdir d5/d7/d1d/d41/dc8 39 2024-09-10T10:04:26.235 INFO:tasks.workunit.client.0.smithi071.stdout:0/849: readlink d11/d1e/dfa/d5f/l10b 0 2024-09-10T10:04:26.236 INFO:tasks.workunit.client.1.smithi107.stdout:1/947: symlink d2/d12/d5a/d10b/l138 0 2024-09-10T10:04:26.236 INFO:tasks.workunit.client.1.smithi107.stdout:7/720: creat d0/d8/d56/d5d/fe9 x:0 0 0 2024-09-10T10:04:26.236 INFO:tasks.workunit.client.1.smithi107.stdout:5/806: rmdir de/d4a/d7e/db2/dbc 39 2024-09-10T10:04:26.239 INFO:tasks.workunit.client.1.smithi107.stdout:2/788: readlink d3/da/df/d20/d36/d4f/d92/lb4 0 2024-09-10T10:04:26.240 INFO:tasks.workunit.client.1.smithi107.stdout:1/948: fsync d2/f4c 0 2024-09-10T10:04:26.242 INFO:tasks.workunit.client.1.smithi107.stdout:5/807: unlink de/d20/d2b/d4b/d5e/d9a/fe6 0 2024-09-10T10:04:26.247 INFO:tasks.workunit.client.1.smithi107.stdout:0/810: creat d6/d8/d2f/da3/f109 x:0 0 0 2024-09-10T10:04:26.250 INFO:tasks.workunit.client.0.smithi071.stdout:8/707: unlink d5/df/d1e/d70/dc7/l7a 0 2024-09-10T10:04:26.251 INFO:tasks.workunit.client.1.smithi107.stdout:7/721: dwrite d0/d8/d56/d5d/fe9 [0,4194304] 0 2024-09-10T10:04:26.251 INFO:tasks.workunit.client.1.smithi107.stdout:1/949: creat d2/d6/d67/f139 x:0 0 0 2024-09-10T10:04:26.251 INFO:tasks.workunit.client.0.smithi071.stdout:0/850: rmdir d11/d22/dde/d100 39 2024-09-10T10:04:26.254 INFO:tasks.workunit.client.0.smithi071.stdout:3/717: dwrite d3/fa [0,4194304] 0 2024-09-10T10:04:26.254 INFO:tasks.workunit.client.0.smithi071.stdout:5/647: mknod dc/df/da6/ce0 0 2024-09-10T10:04:26.259 INFO:tasks.workunit.client.1.smithi107.stdout:5/808: rename de/d4a/d5c/d6d/cbb to de/d20/d2b/d4b/d5e/d9a/c10d 0 2024-09-10T10:04:26.262 INFO:tasks.workunit.client.1.smithi107.stdout:5/809: write de/db3/fbf [4725228,100228] 0 2024-09-10T10:04:26.262 INFO:tasks.workunit.client.1.smithi107.stdout:0/811: symlink d6/d8/d2f/d2e/l10a 0 2024-09-10T10:04:26.263 INFO:tasks.workunit.client.0.smithi071.stdout:6/613: dread d4/da/df/d2e/d3a/d43/f4c [0,4194304] 0 2024-09-10T10:04:26.263 INFO:tasks.workunit.client.1.smithi107.stdout:5/810: chown de/db3/leb 26146 1 2024-09-10T10:04:26.264 INFO:tasks.workunit.client.0.smithi071.stdout:0/851: dwrite d11/d22/d31/d72/f8b [0,4194304] 0 2024-09-10T10:04:26.265 INFO:tasks.workunit.client.0.smithi071.stdout:0/852: chown d11/d1e/f122 19 1 2024-09-10T10:04:26.267 INFO:tasks.workunit.client.1.smithi107.stdout:5/811: fdatasync de/d4a/d7e/d79/f100 0 2024-09-10T10:04:26.268 INFO:tasks.workunit.client.0.smithi071.stdout:2/812: dread d8/d87/f25 [0,4194304] 0 2024-09-10T10:04:26.269 INFO:tasks.workunit.client.0.smithi071.stdout:3/718: mkdir d3/d49/d34/d67/df9 0 2024-09-10T10:04:26.269 INFO:tasks.workunit.client.0.smithi071.stdout:8/708: mkdir d5/df/df7 0 2024-09-10T10:04:26.273 INFO:tasks.workunit.client.0.smithi071.stdout:0/853: creat d11/d1e/f12b x:0 0 0 2024-09-10T10:04:26.274 INFO:tasks.workunit.client.1.smithi107.stdout:7/722: getdents d0/d20 0 2024-09-10T10:04:26.274 INFO:tasks.workunit.client.0.smithi071.stdout:8/709: creat d5/df/d1d/d86/ff8 x:0 0 0 2024-09-10T10:04:26.275 INFO:tasks.workunit.client.1.smithi107.stdout:0/812: link d6/d8/d2f/d2e/d32/d59/f62 d6/d5a/f10b 0 2024-09-10T10:04:26.276 INFO:tasks.workunit.client.0.smithi071.stdout:5/648: getdents dc/df 0 2024-09-10T10:04:26.277 INFO:tasks.workunit.client.0.smithi071.stdout:0/854: chown d11/d1e/dfa/d79/ddc/lf5 52680960 1 2024-09-10T10:04:26.277 INFO:tasks.workunit.client.1.smithi107.stdout:5/812: unlink de/d20/f26 0 2024-09-10T10:04:26.281 INFO:tasks.workunit.client.1.smithi107.stdout:5/813: creat de/d4a/d7e/d79/f10e x:0 0 0 2024-09-10T10:04:26.281 INFO:tasks.workunit.client.0.smithi071.stdout:2/813: creat d8/d87/d33/d41/d4d/f10e x:0 0 0 2024-09-10T10:04:26.282 INFO:tasks.workunit.client.1.smithi107.stdout:0/813: creat d6/d8/d2f/d2e/d32/d56/dfd/f10c x:0 0 0 2024-09-10T10:04:26.282 INFO:tasks.workunit.client.1.smithi107.stdout:6/787: write d0/d3d/f40 [732450,72679] 0 2024-09-10T10:04:26.283 INFO:tasks.workunit.client.0.smithi071.stdout:3/719: link d3/d20/d8d/le3 d3/d49/d2f/d7f/lfa 0 2024-09-10T10:04:26.284 INFO:tasks.workunit.client.0.smithi071.stdout:8/710: dwrite d5/df/d1e/d38/d9f/fbb [0,4194304] 0 2024-09-10T10:04:26.285 INFO:tasks.workunit.client.1.smithi107.stdout:0/814: readlink d6/d8/d2f/d35/d4f/l57 0 2024-09-10T10:04:26.286 INFO:tasks.workunit.client.1.smithi107.stdout:6/788: write d0/d3d/d14/d21/d8a/da2/da3/dac/fea [1373641,85763] 0 2024-09-10T10:04:26.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:25 smithi071 ceph-mon[27559]: pgmap v4: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-10T10:04:26.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:25 smithi071 ceph-mon[27559]: mgrmap e23: smithi107.qurtcs(active, since 2s) 2024-09-10T10:04:26.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:25 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:26.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:25 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:26.290 INFO:tasks.workunit.client.1.smithi107.stdout:5/814: read de/d20/d3d/dd4/fe4 [1979469,27934] 0 2024-09-10T10:04:26.291 INFO:tasks.workunit.client.0.smithi071.stdout:6/614: rename d4/da/df/d2e/c34 to d4/da/df/d2e/cc4 0 2024-09-10T10:04:26.292 INFO:tasks.workunit.client.0.smithi071.stdout:6/615: fsync d4/d61/d83/faf 0 2024-09-10T10:04:26.292 INFO:tasks.workunit.client.0.smithi071.stdout:8/711: dwrite d5/df/fcf [0,4194304] 0 2024-09-10T10:04:26.294 INFO:tasks.workunit.client.0.smithi071.stdout:6/616: chown d4/da/df/l12 112 1 2024-09-10T10:04:26.296 INFO:tasks.workunit.client.0.smithi071.stdout:2/814: fsync d8/d24/f61 0 2024-09-10T10:04:26.297 INFO:tasks.workunit.client.0.smithi071.stdout:8/712: symlink d5/df/d74/lf9 0 2024-09-10T10:04:26.298 INFO:tasks.workunit.client.1.smithi107.stdout:1/950: write d2/d36/f78 [945847,54551] 0 2024-09-10T10:04:26.301 INFO:tasks.workunit.client.1.smithi107.stdout:0/815: dwrite d6/d14/f40 [0,4194304] 0 2024-09-10T10:04:26.302 INFO:tasks.workunit.client.0.smithi071.stdout:3/720: fdatasync d3/d1c/d3c/da1/f5f 0 2024-09-10T10:04:26.303 INFO:tasks.workunit.client.1.smithi107.stdout:9/737: dwrite d5/d7/d1d/d41/d83/fa6 [0,4194304] 0 2024-09-10T10:04:26.304 INFO:tasks.workunit.client.1.smithi107.stdout:1/951: symlink d2/d12/d65/db4/dd9/l13a 0 2024-09-10T10:04:26.304 INFO:tasks.workunit.client.0.smithi071.stdout:6/617: dwrite d4/da/df/d2e/d3a/f66 [0,4194304] 0 2024-09-10T10:04:26.306 INFO:tasks.workunit.client.1.smithi107.stdout:0/816: chown d6/d14/f40 342775 1 2024-09-10T10:04:26.309 INFO:tasks.workunit.client.1.smithi107.stdout:2/789: dwrite d3/da/d1e/d40/d8a/d7f/d55/d85/f8e [0,4194304] 0 2024-09-10T10:04:26.311 INFO:tasks.workunit.client.1.smithi107.stdout:1/952: stat d2/d12/d65/d6b/fcd 0 2024-09-10T10:04:26.312 INFO:tasks.workunit.client.1.smithi107.stdout:5/815: getdents de/d20/d2b/d4b/d5e/d9a 0 2024-09-10T10:04:26.313 INFO:tasks.workunit.client.0.smithi071.stdout:6/618: creat d4/fc5 x:0 0 0 2024-09-10T10:04:26.317 INFO:tasks.workunit.client.0.smithi071.stdout:0/855: getdents d11/d22/d9a 0 2024-09-10T10:04:26.318 INFO:tasks.workunit.client.0.smithi071.stdout:5/649: dwrite dc/df/d29/f3f [0,4194304] 0 2024-09-10T10:04:26.318 INFO:tasks.workunit.client.1.smithi107.stdout:1/953: write d2/d12/d65/de9/f124 [617570,59882] 0 2024-09-10T10:04:26.323 INFO:tasks.workunit.client.0.smithi071.stdout:0/856: mknod d11/d22/d9a/ddf/c12c 0 2024-09-10T10:04:26.328 INFO:tasks.workunit.client.1.smithi107.stdout:5/816: dwrite de/d20/f80 [4194304,4194304] 0 2024-09-10T10:04:26.329 INFO:tasks.workunit.client.1.smithi107.stdout:1/954: symlink d2/d6/dc6/dd6/l13b 0 2024-09-10T10:04:26.330 INFO:tasks.workunit.client.0.smithi071.stdout:8/713: getdents d5/df/d1e/d38 0 2024-09-10T10:04:26.332 INFO:tasks.workunit.client.1.smithi107.stdout:2/790: read d3/da/d66/d91/dea/f98 [80042,86003] 0 2024-09-10T10:04:26.333 INFO:tasks.workunit.client.1.smithi107.stdout:2/791: fdatasync d3/f49 0 2024-09-10T10:04:26.335 INFO:tasks.workunit.client.0.smithi071.stdout:0/857: dwrite d11/d1e/dfa/d79/fbe [0,4194304] 0 2024-09-10T10:04:26.338 INFO:tasks.workunit.client.0.smithi071.stdout:8/714: fsync d5/df/d1e/d38/fb1 0 2024-09-10T10:04:26.340 INFO:tasks.workunit.client.1.smithi107.stdout:2/792: unlink d3/da/df/d20/f33 0 2024-09-10T10:04:26.343 INFO:tasks.workunit.client.0.smithi071.stdout:0/858: creat d11/f12d x:0 0 0 2024-09-10T10:04:26.344 INFO:tasks.workunit.client.1.smithi107.stdout:5/817: dwrite de/db3/db6/dc8/f102 [0,4194304] 0 2024-09-10T10:04:26.344 INFO:tasks.workunit.client.0.smithi071.stdout:8/715: write d5/df/d1d/d86/ff8 [156959,113254] 0 2024-09-10T10:04:26.347 INFO:tasks.workunit.client.1.smithi107.stdout:2/793: chown d3/da/d1e/d40/d8a/d7f/d55/d85/de4/fe9 13 1 2024-09-10T10:04:26.347 INFO:tasks.workunit.client.0.smithi071.stdout:2/815: dread d8/d38/d8d/fa7 [0,4194304] 0 2024-09-10T10:04:26.347 INFO:tasks.workunit.client.0.smithi071.stdout:0/859: creat d11/d1e/f12e x:0 0 0 2024-09-10T10:04:26.348 INFO:tasks.workunit.client.1.smithi107.stdout:5/818: rmdir de/d4a/d4e 39 2024-09-10T10:04:26.350 INFO:tasks.workunit.client.1.smithi107.stdout:5/819: creat de/db3/f10f x:0 0 0 2024-09-10T10:04:26.351 INFO:tasks.workunit.client.0.smithi071.stdout:0/860: symlink d11/d1e/dfa/d5f/l12f 0 2024-09-10T10:04:26.354 INFO:tasks.workunit.client.0.smithi071.stdout:0/861: truncate d11/d1e/dfa/d5f/f10e 761984 0 2024-09-10T10:04:26.356 INFO:tasks.workunit.client.1.smithi107.stdout:2/794: rename d3/da/d1e/d5f/df1 to d3/da/d66/d91/d117 0 2024-09-10T10:04:26.356 INFO:tasks.workunit.client.0.smithi071.stdout:2/816: getdents d8/d4a 0 2024-09-10T10:04:26.356 INFO:tasks.workunit.client.0.smithi071.stdout:0/862: creat d11/d1e/f130 x:0 0 0 2024-09-10T10:04:26.357 INFO:tasks.workunit.client.0.smithi071.stdout:0/863: readlink d11/d1e/dfa/d5f/lff 0 2024-09-10T10:04:26.358 INFO:tasks.workunit.client.1.smithi107.stdout:5/820: unlink de/d20/c3c 0 2024-09-10T10:04:26.360 INFO:tasks.workunit.client.1.smithi107.stdout:2/795: mkdir d3/da/df/d20/d118 0 2024-09-10T10:04:26.362 INFO:tasks.workunit.client.0.smithi071.stdout:0/864: dread d11/d1e/dfa/d79/fbe [0,4194304] 0 2024-09-10T10:04:26.362 INFO:tasks.workunit.client.0.smithi071.stdout:3/721: truncate d3/d49/d34/f6e 1341566 0 2024-09-10T10:04:26.362 INFO:tasks.workunit.client.1.smithi107.stdout:5/821: truncate de/d20/d2b/d4b/d5e/fa8 51266 0 2024-09-10T10:04:26.363 INFO:tasks.workunit.client.0.smithi071.stdout:5/650: dread dc/df/f3b [0,4194304] 0 2024-09-10T10:04:26.363 INFO:tasks.workunit.client.1.smithi107.stdout:2/796: read - d3/d8f/df4/d102/fdc zero size 2024-09-10T10:04:26.364 INFO:tasks.workunit.client.0.smithi071.stdout:6/619: fsync d4/da/df/d2e/d3a/f66 0 2024-09-10T10:04:26.364 INFO:tasks.workunit.client.1.smithi107.stdout:5/822: mknod de/c110 0 2024-09-10T10:04:26.365 INFO:tasks.workunit.client.0.smithi071.stdout:3/722: chown d3/d1c/d3c/da1/d3a/dbd/fec 686932 1 2024-09-10T10:04:26.365 INFO:tasks.workunit.client.0.smithi071.stdout:2/817: getdents d8/d24/dda 0 2024-09-10T10:04:26.366 INFO:tasks.workunit.client.1.smithi107.stdout:0/817: truncate d6/d8/d2f/da3/da5/fc1 80578 0 2024-09-10T10:04:26.367 INFO:tasks.workunit.client.0.smithi071.stdout:2/818: dread - d8/d87/d49/d66/fb4 zero size 2024-09-10T10:04:26.367 INFO:tasks.workunit.client.0.smithi071.stdout:6/620: mknod d4/da/df/d2e/d3a/d40/cc6 0 2024-09-10T10:04:26.369 INFO:tasks.workunit.client.1.smithi107.stdout:1/955: write d2/f49 [797972,89174] 0 2024-09-10T10:04:26.369 INFO:tasks.workunit.client.1.smithi107.stdout:0/818: write d6/d8/d2f/d35/d3c/d58/d86/fcb [180349,22149] 0 2024-09-10T10:04:26.370 INFO:tasks.workunit.client.0.smithi071.stdout:0/865: creat d11/f131 x:0 0 0 2024-09-10T10:04:26.370 INFO:tasks.workunit.client.1.smithi107.stdout:1/956: read - d2/d12/d7e/f7f zero size 2024-09-10T10:04:26.371 INFO:tasks.workunit.client.0.smithi071.stdout:5/651: dread dc/df/d3e/d5a/d80/f86 [0,4194304] 0 2024-09-10T10:04:26.371 INFO:tasks.workunit.client.1.smithi107.stdout:2/797: rename d3/da/df/d20/d36/d39/fa5 to d3/da/d1e/d40/d8a/d7f/d55/d85/de4/f119 0 2024-09-10T10:04:26.375 INFO:tasks.workunit.client.1.smithi107.stdout:1/957: mkdir d2/d6/d67/d13c 0 2024-09-10T10:04:26.380 INFO:tasks.workunit.client.0.smithi071.stdout:8/716: dwrite d5/d36/f6d [0,4194304] 0 2024-09-10T10:04:26.381 INFO:tasks.workunit.client.0.smithi071.stdout:0/866: link d11/d22/d31/f92 d11/d22/dde/d100/f132 0 2024-09-10T10:04:26.384 INFO:tasks.workunit.client.0.smithi071.stdout:8/717: mkdir d5/d36/dfa 0 2024-09-10T10:04:26.385 INFO:tasks.workunit.client.1.smithi107.stdout:1/958: dread d2/d12/d5a/f73 [0,4194304] 0 2024-09-10T10:04:26.385 INFO:tasks.workunit.client.0.smithi071.stdout:5/652: getdents dc/d53/d6a 0 2024-09-10T10:04:26.385 INFO:tasks.workunit.client.0.smithi071.stdout:0/867: symlink d11/d1e/dfa/d79/ddc/d109/l133 0 2024-09-10T10:04:26.386 INFO:tasks.workunit.client.0.smithi071.stdout:5/653: chown dc/df/f33 1874384 1 2024-09-10T10:04:26.387 INFO:tasks.workunit.client.0.smithi071.stdout:8/718: mknod d5/df/d1d/d86/d75/cfb 0 2024-09-10T10:04:26.387 INFO:tasks.workunit.client.0.smithi071.stdout:0/868: mkdir d11/d30/d134 0 2024-09-10T10:04:26.388 INFO:tasks.workunit.client.1.smithi107.stdout:1/959: truncate d2/d12/d94/fc7 281020 0 2024-09-10T10:04:26.388 INFO:tasks.workunit.client.0.smithi071.stdout:5/654: rmdir dc/df/d3e/d5a 39 2024-09-10T10:04:26.388 INFO:tasks.workunit.client.0.smithi071.stdout:8/719: dread - d5/df/d1d/d81/fa6 zero size 2024-09-10T10:04:26.389 INFO:tasks.workunit.client.1.smithi107.stdout:1/960: chown d2/d12/d65/db4/dd9/d103/f108 0 1 2024-09-10T10:04:26.390 INFO:tasks.workunit.client.0.smithi071.stdout:6/621: dread d4/da/f13 [0,4194304] 0 2024-09-10T10:04:26.392 INFO:tasks.workunit.client.0.smithi071.stdout:5/655: mknod dc/df/d3e/d5a/d80/ce1 0 2024-09-10T10:04:26.392 INFO:tasks.workunit.client.1.smithi107.stdout:5/823: dwrite de/d4a/f63 [0,4194304] 0 2024-09-10T10:04:26.393 INFO:tasks.workunit.client.1.smithi107.stdout:1/961: unlink d2/d12/d65/db4/dd9/l13a 0 2024-09-10T10:04:26.394 INFO:tasks.workunit.client.1.smithi107.stdout:5/824: fsync f1 0 2024-09-10T10:04:26.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:25 smithi107 ceph-mon[34215]: pgmap v4: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-10T10:04:26.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:25 smithi107 ceph-mon[34215]: mgrmap e23: smithi107.qurtcs(active, since 2s) 2024-09-10T10:04:26.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:25 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:26.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:25 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:26.396 INFO:tasks.workunit.client.1.smithi107.stdout:1/962: symlink d2/d12/d65/db4/dd9/df7/d110/l13d 0 2024-09-10T10:04:26.396 INFO:tasks.workunit.client.0.smithi071.stdout:6/622: rename d4/da/df/d2e/d3a/d3e/d5d to d4/da/df/d2e/d3a/d91/dc7 0 2024-09-10T10:04:26.397 INFO:tasks.workunit.client.1.smithi107.stdout:1/963: mknod d2/d6/d24/d81/d10f/d12b/c13e 0 2024-09-10T10:04:26.399 INFO:tasks.workunit.client.0.smithi071.stdout:5/656: rename dc/f4b to dc/df/d3e/d5a/d80/d8a/dda/fe2 0 2024-09-10T10:04:26.418 INFO:tasks.workunit.client.0.smithi071.stdout:6/623: dread d4/da/df/d2e/d3a/d40/d60/f7c [0,4194304] 0 2024-09-10T10:04:26.418 INFO:tasks.workunit.client.0.smithi071.stdout:6/624: chown d4/d20 90265 1 2024-09-10T10:04:26.420 INFO:tasks.workunit.client.0.smithi071.stdout:5/657: dread dc/df/d3e/d5a/f88 [4194304,4194304] 0 2024-09-10T10:04:26.421 INFO:tasks.workunit.client.0.smithi071.stdout:6/625: unlink d4/da/df/f2c 0 2024-09-10T10:04:26.422 INFO:tasks.workunit.client.0.smithi071.stdout:6/626: chown d4/da/df/d2e/d3a/d51/d64/f7e 409264915 1 2024-09-10T10:04:26.422 INFO:tasks.workunit.client.0.smithi071.stdout:6/627: chown d4/d1c/f3d 40184 1 2024-09-10T10:04:26.423 INFO:tasks.workunit.client.0.smithi071.stdout:5/658: symlink dc/df/d3e/d5a/d80/d8a/da3/le3 0 2024-09-10T10:04:26.423 INFO:tasks.workunit.client.0.smithi071.stdout:6/628: truncate d4/d20/f7d 68718 0 2024-09-10T10:04:26.424 INFO:tasks.workunit.client.0.smithi071.stdout:6/629: fdatasync d4/d61/f69 0 2024-09-10T10:04:26.425 INFO:tasks.workunit.client.0.smithi071.stdout:5/659: write dc/df/f28 [4794317,17433] 0 2024-09-10T10:04:26.426 INFO:tasks.workunit.client.0.smithi071.stdout:6/630: mkdir d4/da/df/d2e/d3a/d43/dc8 0 2024-09-10T10:04:26.427 INFO:tasks.workunit.client.0.smithi071.stdout:5/660: fsync dc/df/d3e/d5a/f5e 0 2024-09-10T10:04:26.427 INFO:tasks.workunit.client.0.smithi071.stdout:5/661: chown dc/df/dd7/l39 928 1 2024-09-10T10:04:26.455 INFO:tasks.workunit.client.1.smithi107.stdout:8/682: sync 2024-09-10T10:04:26.456 INFO:tasks.workunit.client.1.smithi107.stdout:4/879: sync 2024-09-10T10:04:26.458 INFO:tasks.workunit.client.1.smithi107.stdout:4/880: creat d0/f130 x:0 0 0 2024-09-10T10:04:26.461 INFO:tasks.workunit.client.1.smithi107.stdout:4/881: stat d0/d1f/d72/f122 0 2024-09-10T10:04:26.463 INFO:tasks.workunit.client.1.smithi107.stdout:8/683: dwrite d5/d8/f13 [0,4194304] 0 2024-09-10T10:04:26.484 INFO:tasks.workunit.client.0.smithi071.stdout:3/723: write d3/d49/d2f/f35 [1661083,6099] 0 2024-09-10T10:04:26.484 INFO:tasks.workunit.client.0.smithi071.stdout:2/819: write d8/d87/d33/dde/fdf [1937009,20873] 0 2024-09-10T10:04:26.484 INFO:tasks.workunit.client.0.smithi071.stdout:3/724: chown d3/d49/d2f 9781254 1 2024-09-10T10:04:26.489 INFO:tasks.workunit.client.0.smithi071.stdout:2/820: symlink d8/d87/dc4/d103/l10f 0 2024-09-10T10:04:26.491 INFO:tasks.workunit.client.0.smithi071.stdout:0/869: rename d11/d1e/dfa/d5f/f9e to d11/d30/d70/d128/f135 0 2024-09-10T10:04:26.493 INFO:tasks.workunit.client.0.smithi071.stdout:2/821: creat d8/d87/d49/d66/df0/f110 x:0 0 0 2024-09-10T10:04:26.496 INFO:tasks.workunit.client.0.smithi071.stdout:0/870: symlink d11/d22/dde/l136 0 2024-09-10T10:04:26.496 INFO:tasks.workunit.client.0.smithi071.stdout:2/822: mkdir d8/db6/de7/d111 0 2024-09-10T10:04:26.499 INFO:tasks.workunit.client.0.smithi071.stdout:2/823: chown d8/d87/d33/l92 1637 1 2024-09-10T10:04:26.503 INFO:tasks.workunit.client.0.smithi071.stdout:2/824: symlink d8/d87/d49/d66/df0/l112 0 2024-09-10T10:04:26.505 INFO:tasks.workunit.client.0.smithi071.stdout:0/871: dwrite d11/d30/fd0 [0,4194304] 0 2024-09-10T10:04:26.510 INFO:tasks.workunit.client.0.smithi071.stdout:6/631: dread f1 [0,4194304] 0 2024-09-10T10:04:26.512 INFO:tasks.workunit.client.0.smithi071.stdout:8/720: dread d5/d36/f41 [0,4194304] 0 2024-09-10T10:04:26.513 INFO:tasks.workunit.client.0.smithi071.stdout:5/662: truncate dc/d4a/fb7 3358839 0 2024-09-10T10:04:26.515 INFO:tasks.workunit.client.0.smithi071.stdout:2/825: dwrite d8/d24/dda/fe0 [0,4194304] 0 2024-09-10T10:04:26.517 INFO:tasks.workunit.client.0.smithi071.stdout:5/663: mkdir dc/df/d17/d8d/de4 0 2024-09-10T10:04:26.518 INFO:tasks.workunit.client.0.smithi071.stdout:8/721: mknod d5/df/d1d/d81/d9b/cfc 0 2024-09-10T10:04:26.519 INFO:tasks.workunit.client.0.smithi071.stdout:2/826: stat d8/d87/d33/f3c 0 2024-09-10T10:04:26.523 INFO:tasks.workunit.client.0.smithi071.stdout:3/725: dwrite d3/d1c/d3e/f97 [0,4194304] 0 2024-09-10T10:04:26.525 INFO:tasks.workunit.client.0.smithi071.stdout:5/664: creat dc/df/d3e/d5a/d80/fe5 x:0 0 0 2024-09-10T10:04:26.525 INFO:tasks.workunit.client.0.smithi071.stdout:3/726: read - d3/d49/d4f/ff3 zero size 2024-09-10T10:04:26.525 INFO:tasks.workunit.client.0.smithi071.stdout:2/827: mknod d8/d87/d49/c113 0 2024-09-10T10:04:26.527 INFO:tasks.workunit.client.0.smithi071.stdout:8/722: rename d5/df/d57/d82/fca to d5/df/d1e/d38/ffd 0 2024-09-10T10:04:26.530 INFO:tasks.workunit.client.0.smithi071.stdout:8/723: chown d5/df/d1d/d86/l20 14 1 2024-09-10T10:04:26.531 INFO:tasks.workunit.client.0.smithi071.stdout:5/665: creat dc/df/d17/d8d/de4/fe6 x:0 0 0 2024-09-10T10:04:26.532 INFO:tasks.workunit.client.0.smithi071.stdout:0/872: dread d11/d1e/f2d [0,4194304] 0 2024-09-10T10:04:26.534 INFO:tasks.workunit.client.0.smithi071.stdout:5/666: dread dc/df/d29/d94/fb3 [0,4194304] 0 2024-09-10T10:04:26.542 INFO:tasks.workunit.client.0.smithi071.stdout:6/632: read d4/da/df/d2e/d3a/f74 [4108690,21830] 0 2024-09-10T10:04:26.544 INFO:tasks.workunit.client.0.smithi071.stdout:6/633: mknod d4/da/df/d2e/d3a/da9/dbc/cc9 0 2024-09-10T10:04:26.545 INFO:tasks.workunit.client.0.smithi071.stdout:6/634: write d4/fb8 [10574,47716] 0 2024-09-10T10:04:26.549 INFO:tasks.workunit.client.1.smithi107.stdout:8/684: stat d5/d8/d66/d8b/d18/l62 0 2024-09-10T10:04:26.549 INFO:tasks.workunit.client.1.smithi107.stdout:1/964: dread d2/d12/d5a/f70 [0,4194304] 0 2024-09-10T10:04:26.551 INFO:tasks.workunit.client.0.smithi071.stdout:6/635: dwrite d4/da/df/d2e/d3a/d51/f9a [0,4194304] 0 2024-09-10T10:04:26.552 INFO:tasks.workunit.client.1.smithi107.stdout:4/882: dwrite d0/d82/f12a [0,4194304] 0 2024-09-10T10:04:26.554 INFO:tasks.workunit.client.1.smithi107.stdout:4/883: dread - d0/d1f/d5e/f114 zero size 2024-09-10T10:04:26.555 INFO:tasks.workunit.client.0.smithi071.stdout:6/636: creat d4/d61/d83/da8/fca x:0 0 0 2024-09-10T10:04:26.557 INFO:tasks.workunit.client.1.smithi107.stdout:8/685: creat d5/d8/d66/d8b/d1a/da3/fe5 x:0 0 0 2024-09-10T10:04:26.558 INFO:tasks.workunit.client.0.smithi071.stdout:8/724: dwrite d5/d36/d49/f61 [0,4194304] 0 2024-09-10T10:04:26.559 INFO:tasks.workunit.client.0.smithi071.stdout:5/667: dwrite dc/f13 [0,4194304] 0 2024-09-10T10:04:26.561 INFO:tasks.workunit.client.0.smithi071.stdout:6/637: read - d4/da/df/d2e/d3a/d51/d64/fac zero size 2024-09-10T10:04:26.563 INFO:tasks.workunit.client.0.smithi071.stdout:6/638: readlink d4/lb7 0 2024-09-10T10:04:26.566 INFO:tasks.workunit.client.0.smithi071.stdout:5/668: chown dc/df/d29/c9e 24228618 1 2024-09-10T10:04:26.568 INFO:tasks.workunit.client.0.smithi071.stdout:8/725: dwrite d5/df/d1e/d38/f42 [0,4194304] 0 2024-09-10T10:04:26.575 INFO:tasks.workunit.client.0.smithi071.stdout:5/669: mknod dc/df/d3e/d5a/dd4/ce7 0 2024-09-10T10:04:26.577 INFO:tasks.workunit.client.0.smithi071.stdout:5/670: chown dc/df/d3e/d5a/d80/d8a/da3 1031 1 2024-09-10T10:04:26.577 INFO:tasks.workunit.client.0.smithi071.stdout:8/726: mkdir d5/dfe 0 2024-09-10T10:04:26.578 INFO:tasks.workunit.client.0.smithi071.stdout:5/671: mknod dc/df/da6/ce8 0 2024-09-10T10:04:26.581 INFO:tasks.workunit.client.0.smithi071.stdout:5/672: creat dc/df/da6/fe9 x:0 0 0 2024-09-10T10:04:26.583 INFO:tasks.workunit.client.0.smithi071.stdout:8/727: rename d5/df/d1d/d86/d90/db4/le3 to d5/df/d95/lff 0 2024-09-10T10:04:26.584 INFO:tasks.workunit.client.0.smithi071.stdout:8/728: readlink d5/df/d1d/d81/lc3 0 2024-09-10T10:04:26.584 INFO:tasks.workunit.client.0.smithi071.stdout:5/673: creat dc/d53/fea x:0 0 0 2024-09-10T10:04:26.587 INFO:tasks.workunit.client.0.smithi071.stdout:5/674: rename dc/df/dd7/f81 to dc/df/d29/d48/dae/db6/feb 0 2024-09-10T10:04:26.590 INFO:tasks.workunit.client.0.smithi071.stdout:8/729: getdents d5/df/d1d/d86/d75 0 2024-09-10T10:04:26.592 INFO:tasks.workunit.client.0.smithi071.stdout:8/730: symlink d5/df/df7/l100 0 2024-09-10T10:04:26.592 INFO:tasks.workunit.client.0.smithi071.stdout:8/731: chown d5/df/d95/lb0 6545 1 2024-09-10T10:04:26.593 INFO:tasks.workunit.client.0.smithi071.stdout:5/675: link dc/df/d29/c41 dc/df/d17/cec 0 2024-09-10T10:04:26.596 INFO:tasks.workunit.client.0.smithi071.stdout:5/676: rename c0 to dc/df/dd7/d87/ced 0 2024-09-10T10:04:26.598 INFO:tasks.workunit.client.0.smithi071.stdout:8/732: dwrite d5/df/d1e/d38/f99 [0,4194304] 0 2024-09-10T10:04:26.599 INFO:tasks.workunit.client.0.smithi071.stdout:5/677: mkdir dc/d53/dee 0 2024-09-10T10:04:26.601 INFO:tasks.workunit.client.0.smithi071.stdout:5/678: write dc/df/d17/d8d/de4/fe6 [750117,964] 0 2024-09-10T10:04:26.605 INFO:tasks.workunit.client.0.smithi071.stdout:8/733: dwrite d5/df/d74/ff6 [0,4194304] 0 2024-09-10T10:04:26.615 INFO:tasks.workunit.client.1.smithi107.stdout:5/825: fsync de/f5b 0 2024-09-10T10:04:26.616 INFO:tasks.workunit.client.1.smithi107.stdout:1/965: write d2/d6/dc6/dd4/d106/fee [1136283,55930] 0 2024-09-10T10:04:26.617 INFO:tasks.workunit.client.0.smithi071.stdout:7/872: sync 2024-09-10T10:04:26.617 INFO:tasks.workunit.client.0.smithi071.stdout:8/734: dread d5/df/d1d/d86/f3b [0,4194304] 0 2024-09-10T10:04:26.617 INFO:tasks.workunit.client.0.smithi071.stdout:5/679: write dc/d4a/f74 [230611,15844] 0 2024-09-10T10:04:26.618 INFO:tasks.workunit.client.1.smithi107.stdout:5/826: write de/db3/fd3 [1924225,117507] 0 2024-09-10T10:04:26.619 INFO:tasks.workunit.client.0.smithi071.stdout:5/680: chown dc/d4a 67027435 1 2024-09-10T10:04:26.619 INFO:tasks.workunit.client.1.smithi107.stdout:4/884: read d0/d1f/f34 [2962613,126307] 0 2024-09-10T10:04:26.620 INFO:tasks.workunit.client.0.smithi071.stdout:5/681: chown dc/df/d17/c27 33 1 2024-09-10T10:04:26.621 INFO:tasks.workunit.client.1.smithi107.stdout:1/966: creat d2/d35/f13f x:0 0 0 2024-09-10T10:04:26.621 INFO:tasks.workunit.client.0.smithi071.stdout:5/682: chown dc/df/d29/d94/l95 1235940 1 2024-09-10T10:04:26.623 INFO:tasks.workunit.client.0.smithi071.stdout:8/735: creat d5/df/d1d/d86/d75/dcd/f101 x:0 0 0 2024-09-10T10:04:26.623 INFO:tasks.workunit.client.1.smithi107.stdout:5/827: chown de/d20/d3d/fd2 40484259 1 2024-09-10T10:04:26.624 INFO:tasks.workunit.client.1.smithi107.stdout:4/885: write d0/d40/d57/f3b [735262,3461] 0 2024-09-10T10:04:26.624 INFO:tasks.workunit.client.1.smithi107.stdout:5/828: dread - de/d20/d2b/d4b/d8c/fec zero size 2024-09-10T10:04:26.625 INFO:tasks.workunit.client.1.smithi107.stdout:1/967: creat d2/d12/d65/db4/f140 x:0 0 0 2024-09-10T10:04:26.625 INFO:tasks.workunit.client.0.smithi071.stdout:7/873: dread d9/d1a/d1d/f61 [0,4194304] 0 2024-09-10T10:04:26.627 INFO:tasks.workunit.client.0.smithi071.stdout:5/683: link dc/d53/f60 dc/df/d17/fef 0 2024-09-10T10:04:26.627 INFO:tasks.workunit.client.1.smithi107.stdout:1/968: write d2/d6/fa [2670722,69992] 0 2024-09-10T10:04:26.629 INFO:tasks.workunit.client.0.smithi071.stdout:7/874: symlink d9/ddb/d12e/l130 0 2024-09-10T10:04:26.630 INFO:tasks.workunit.client.0.smithi071.stdout:5/684: mknod dc/df/d29/d48/dae/db6/cf0 0 2024-09-10T10:04:26.633 INFO:tasks.workunit.client.0.smithi071.stdout:5/685: rmdir dc/df/d17/d8d 39 2024-09-10T10:04:26.634 INFO:tasks.workunit.client.1.smithi107.stdout:4/886: dwrite d0/d1f/d20/f21 [0,4194304] 0 2024-09-10T10:04:26.635 INFO:tasks.workunit.client.1.smithi107.stdout:7/723: sync 2024-09-10T10:04:26.636 INFO:tasks.workunit.client.0.smithi071.stdout:7/875: creat d9/d15/d40/d80/ddd/de2/d109/f131 x:0 0 0 2024-09-10T10:04:26.636 INFO:tasks.workunit.client.1.smithi107.stdout:7/724: chown d0/d1b/d4d/c5a 49 1 2024-09-10T10:04:26.639 INFO:tasks.workunit.client.0.smithi071.stdout:5/686: dwrite dc/df/d3e/fb9 [0,4194304] 0 2024-09-10T10:04:26.640 INFO:tasks.workunit.client.0.smithi071.stdout:7/876: symlink d9/d15/d1f/d74/d10f/l132 0 2024-09-10T10:04:26.641 INFO:tasks.workunit.client.1.smithi107.stdout:8/686: truncate d5/d8/d5b/f74 2035434 0 2024-09-10T10:04:26.642 INFO:tasks.workunit.client.0.smithi071.stdout:7/877: truncate d9/d11/fe4 394524 0 2024-09-10T10:04:26.645 INFO:tasks.workunit.client.1.smithi107.stdout:7/725: creat d0/d8/d56/dcc/d81/dbc/fea x:0 0 0 2024-09-10T10:04:26.647 INFO:tasks.workunit.client.0.smithi071.stdout:7/878: rename d9/d2c/d4f to d9/d15/d1f/d122/d133 0 2024-09-10T10:04:26.648 INFO:tasks.workunit.client.1.smithi107.stdout:4/887: rename d0/d40/d6d/d8a/dbb/de1/fe5 to d0/f131 0 2024-09-10T10:04:26.649 INFO:tasks.workunit.client.1.smithi107.stdout:4/888: dread - d0/d40/d57/d76/d77/ff1 zero size 2024-09-10T10:04:26.649 INFO:tasks.workunit.client.1.smithi107.stdout:8/687: mknod d5/d8/d66/d8b/d18/da4/ce6 0 2024-09-10T10:04:26.650 INFO:tasks.workunit.client.1.smithi107.stdout:5/829: write de/d9c/fa3 [96431,8805] 0 2024-09-10T10:04:26.651 INFO:tasks.workunit.client.1.smithi107.stdout:7/726: rename d0/d1b/le8 to d0/d20/d35/leb 0 2024-09-10T10:04:26.653 INFO:tasks.workunit.client.0.smithi071.stdout:7/879: write d9/d15/d1f/d74/da1/dcf/dfe/d108/d10c/fe5 [866332,90583] 0 2024-09-10T10:04:26.653 INFO:tasks.workunit.client.0.smithi071.stdout:8/736: dwrite d5/df/d57/fba [0,4194304] 0 2024-09-10T10:04:26.655 INFO:tasks.workunit.client.1.smithi107.stdout:4/889: fdatasync d0/d40/f6a 0 2024-09-10T10:04:26.655 INFO:tasks.workunit.client.1.smithi107.stdout:7/727: dread d0/d8/dc/fb0 [0,4194304] 0 2024-09-10T10:04:26.656 INFO:tasks.workunit.client.0.smithi071.stdout:7/880: chown d9/d15/d1f/d74/d9b/cc0 3575 1 2024-09-10T10:04:26.656 INFO:tasks.workunit.client.1.smithi107.stdout:5/830: fsync de/d20/d3d/dd4/fe4 0 2024-09-10T10:04:26.656 INFO:tasks.workunit.client.0.smithi071.stdout:5/687: dwrite dc/df/f38 [0,4194304] 0 2024-09-10T10:04:26.659 INFO:tasks.workunit.client.0.smithi071.stdout:8/737: symlink d5/df/d74/l102 0 2024-09-10T10:04:26.659 INFO:tasks.workunit.client.1.smithi107.stdout:8/688: creat d5/d8/fe7 x:0 0 0 2024-09-10T10:04:26.660 INFO:tasks.workunit.client.1.smithi107.stdout:1/969: dwrite d2/d12/d5a/f62 [0,4194304] 0 2024-09-10T10:04:26.661 INFO:tasks.workunit.client.0.smithi071.stdout:5/688: stat dc/df/d29/fa1 0 2024-09-10T10:04:26.662 INFO:tasks.workunit.client.1.smithi107.stdout:5/831: creat de/d20/d3d/f111 x:0 0 0 2024-09-10T10:04:26.662 INFO:tasks.workunit.client.1.smithi107.stdout:7/728: write d0/d1b/d4d/f6b [4981032,20753] 0 2024-09-10T10:04:26.663 INFO:tasks.workunit.client.0.smithi071.stdout:7/881: truncate d9/d15/d1f/d74/da1/dcf/dfe/d108/d10c/d118/d105/f10a 979874 0 2024-09-10T10:04:26.663 INFO:tasks.workunit.client.0.smithi071.stdout:7/882: dread - d9/d15/d1f/d74/fac zero size 2024-09-10T10:04:26.664 INFO:tasks.workunit.client.0.smithi071.stdout:5/689: creat dc/df/d3e/d5a/d80/ff1 x:0 0 0 2024-09-10T10:04:26.664 INFO:tasks.workunit.client.1.smithi107.stdout:7/729: stat d0/d8/d56/dcc/d81/lcb 0 2024-09-10T10:04:26.665 INFO:tasks.workunit.client.1.smithi107.stdout:4/890: truncate d0/d1f/d90/d123/f128 1002765 0 2024-09-10T10:04:26.665 INFO:tasks.workunit.client.0.smithi071.stdout:8/738: dread d5/fa [0,4194304] 0 2024-09-10T10:04:26.666 INFO:tasks.workunit.client.1.smithi107.stdout:7/730: chown d0/d8/d5c/fa2 490070 1 2024-09-10T10:04:26.666 INFO:tasks.workunit.client.1.smithi107.stdout:8/689: creat d5/d8/d66/d8b/d1a/d64/db9/fe8 x:0 0 0 2024-09-10T10:04:26.670 INFO:tasks.workunit.client.0.smithi071.stdout:7/883: creat d9/d15/d40/d80/ddd/de2/d109/f134 x:0 0 0 2024-09-10T10:04:26.673 INFO:tasks.workunit.client.0.smithi071.stdout:8/739: mkdir d5/df/d1d/d86/d90/db4/d103 0 2024-09-10T10:04:26.676 INFO:tasks.workunit.client.1.smithi107.stdout:5/832: creat de/d4a/d4e/d89/d99/f112 x:0 0 0 2024-09-10T10:04:26.677 INFO:tasks.workunit.client.0.smithi071.stdout:8/740: unlink d5/df/d67/f79 0 2024-09-10T10:04:26.679 INFO:tasks.workunit.client.0.smithi071.stdout:7/884: creat d9/d1a/f135 x:0 0 0 2024-09-10T10:04:26.679 INFO:tasks.workunit.client.0.smithi071.stdout:5/690: dwrite dc/df/d29/d48/dae/db6/feb [0,4194304] 0 2024-09-10T10:04:26.684 INFO:tasks.workunit.client.1.smithi107.stdout:1/970: getdents d2/d12/d7e 0 2024-09-10T10:04:26.684 INFO:tasks.workunit.client.0.smithi071.stdout:7/885: truncate d9/d15/d40/f95 4602221 0 2024-09-10T10:04:26.685 INFO:tasks.workunit.client.1.smithi107.stdout:7/731: link d0/d8/d56/dcc/cb1 d0/d20/ddd/cec 0 2024-09-10T10:04:26.687 INFO:tasks.workunit.client.1.smithi107.stdout:1/971: fsync d2/d12/d5a/d10b/fb6 0 2024-09-10T10:04:26.688 INFO:tasks.workunit.client.0.smithi071.stdout:7/886: read d9/d76/d66/fb7 [213465,84424] 0 2024-09-10T10:04:26.688 INFO:tasks.workunit.client.0.smithi071.stdout:8/741: rename d5/df/d1d/d86/d75/fec to d5/df/d1d/d81/d9b/f104 0 2024-09-10T10:04:26.689 INFO:tasks.workunit.client.0.smithi071.stdout:5/691: dwrite dc/df/f33 [0,4194304] 0 2024-09-10T10:04:26.690 INFO:tasks.workunit.client.1.smithi107.stdout:8/690: rename d5/d8/d5b/c86 to d5/d8/d66/d8b/d21/ce9 0 2024-09-10T10:04:26.692 INFO:tasks.workunit.client.0.smithi071.stdout:7/887: write d9/d15/d1f/d74/da1/dcf/dfe/d108/d10c/d118/fcc [4618126,29159] 0 2024-09-10T10:04:26.694 INFO:tasks.workunit.client.1.smithi107.stdout:8/691: fsync d5/d8/d66/d8b/d21/d83/fa1 0 2024-09-10T10:04:26.695 INFO:tasks.workunit.client.0.smithi071.stdout:5/692: fdatasync dc/df/dd7/f45 0 2024-09-10T10:04:26.695 INFO:tasks.workunit.client.1.smithi107.stdout:1/972: read d2/f4c [1459120,129240] 0 2024-09-10T10:04:26.696 INFO:tasks.workunit.client.0.smithi071.stdout:8/742: creat d5/df/df7/f105 x:0 0 0 2024-09-10T10:04:26.698 INFO:tasks.workunit.client.1.smithi107.stdout:7/732: rename d0/f7 to d0/d1b/d4d/fed 0 2024-09-10T10:04:26.699 INFO:tasks.workunit.client.1.smithi107.stdout:8/692: symlink d5/d8/d66/d8b/d1a/d64/lea 0 2024-09-10T10:04:26.700 INFO:tasks.workunit.client.1.smithi107.stdout:7/733: stat d0/d8/d56/dcc/d81/dbc/fea 0 2024-09-10T10:04:26.703 INFO:tasks.workunit.client.0.smithi071.stdout:7/888: rename d9/d15/d1f/d74/da1/dcf/dfe to d9/ddb/d12e/d136 0 2024-09-10T10:04:26.704 INFO:tasks.workunit.client.1.smithi107.stdout:8/693: mknod d5/d8/d66/d8b/d18/d4f/ceb 0 2024-09-10T10:04:26.704 INFO:tasks.workunit.client.0.smithi071.stdout:7/889: stat d9/d2c/d49/d10d 0 2024-09-10T10:04:26.704 INFO:tasks.workunit.client.1.smithi107.stdout:7/734: unlink d0/d8/dc/d2c/d47/fbd 0 2024-09-10T10:04:26.705 INFO:tasks.workunit.client.1.smithi107.stdout:4/891: dread d0/d40/db3/fd2 [0,4194304] 0 2024-09-10T10:04:26.706 INFO:tasks.workunit.client.0.smithi071.stdout:5/693: symlink dc/d53/db2/lf2 0 2024-09-10T10:04:26.706 INFO:tasks.workunit.client.1.smithi107.stdout:7/735: read - d0/d8/d56/d5d/fd2 zero size 2024-09-10T10:04:26.709 INFO:tasks.workunit.client.1.smithi107.stdout:5/833: dread de/f28 [0,4194304] 0 2024-09-10T10:04:26.710 INFO:tasks.workunit.client.1.smithi107.stdout:4/892: rename d0/d82/ld1 to d0/d1f/d20/d80/l132 0 2024-09-10T10:04:26.711 INFO:tasks.workunit.client.1.smithi107.stdout:4/893: chown d0/d40/l89 375 1 2024-09-10T10:04:26.712 INFO:tasks.workunit.client.0.smithi071.stdout:7/890: rename d9/d11 to d9/ddb/d12e/d136/d108/d10c/d118/d105/d137 0 2024-09-10T10:04:26.713 INFO:tasks.workunit.client.1.smithi107.stdout:8/694: write d5/d8/f20 [456517,33787] 0 2024-09-10T10:04:26.716 INFO:tasks.workunit.client.1.smithi107.stdout:7/736: rename d0/d1b/d4d/d69/d97/d68/f96 to d0/fee 0 2024-09-10T10:04:26.717 INFO:tasks.workunit.client.1.smithi107.stdout:1/973: dwrite d2/d12/d5a/fb8 [0,4194304] 0 2024-09-10T10:04:26.718 INFO:tasks.workunit.client.0.smithi071.stdout:7/891: truncate d9/d15/d40/d80/f9d 932127 0 2024-09-10T10:04:26.718 INFO:tasks.workunit.client.0.smithi071.stdout:7/892: chown d9/d1a/dc8/d113 5255 1 2024-09-10T10:04:26.719 INFO:tasks.workunit.client.1.smithi107.stdout:7/737: read - d0/d8/d5c/d6d/fbf zero size 2024-09-10T10:04:26.721 INFO:tasks.workunit.client.0.smithi071.stdout:5/694: getdents dc/d53/db2 0 2024-09-10T10:04:26.721 INFO:tasks.workunit.client.1.smithi107.stdout:4/894: write d0/d40/d57/fd6 [4229307,63427] 0 2024-09-10T10:04:26.723 INFO:tasks.workunit.client.0.smithi071.stdout:7/893: dread d9/d76/d66/fb7 [0,4194304] 0 2024-09-10T10:04:26.723 INFO:tasks.workunit.client.1.smithi107.stdout:7/738: truncate d0/d20/d35/f98 2451193 0 2024-09-10T10:04:26.726 INFO:tasks.workunit.client.0.smithi071.stdout:5/695: getdents dc/df/d29/d48 0 2024-09-10T10:04:26.727 INFO:tasks.workunit.client.1.smithi107.stdout:4/895: write d0/d1f/d90/fc1 [1387348,67743] 0 2024-09-10T10:04:26.727 INFO:tasks.workunit.client.1.smithi107.stdout:8/695: dwrite d5/d8/d5b/f90 [0,4194304] 0 2024-09-10T10:04:26.727 INFO:tasks.workunit.client.0.smithi071.stdout:8/743: dread d5/df/d1e/d38/f48 [0,4194304] 0 2024-09-10T10:04:26.727 INFO:tasks.workunit.client.0.smithi071.stdout:5/696: stat dc/df/c26 0 2024-09-10T10:04:26.728 INFO:tasks.workunit.client.0.smithi071.stdout:8/744: chown d5/d36/d49/lbe 4862492 1 2024-09-10T10:04:26.730 INFO:tasks.workunit.client.0.smithi071.stdout:5/697: read dc/df/d17/d8d/fcd [704736,48761] 0 2024-09-10T10:04:26.731 INFO:tasks.workunit.client.0.smithi071.stdout:5/698: fsync dc/f13 0 2024-09-10T10:04:26.732 INFO:tasks.workunit.client.0.smithi071.stdout:7/894: rename d9/d2c/f56 to d9/d15/d40/f138 0 2024-09-10T10:04:26.732 INFO:tasks.workunit.client.0.smithi071.stdout:5/699: stat dc/df/dd7/f2f 0 2024-09-10T10:04:26.737 INFO:tasks.workunit.client.0.smithi071.stdout:7/895: mknod d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/d106/c139 0 2024-09-10T10:04:26.740 INFO:tasks.workunit.client.1.smithi107.stdout:1/974: truncate d2/d6/d67/f9b 287835 0 2024-09-10T10:04:26.740 INFO:tasks.workunit.client.1.smithi107.stdout:7/739: write d0/d20/d35/f94 [327525,118160] 0 2024-09-10T10:04:26.741 INFO:tasks.workunit.client.0.smithi071.stdout:7/896: mkdir d9/d15/d13a 0 2024-09-10T10:04:26.745 INFO:tasks.workunit.client.1.smithi107.stdout:1/975: mknod d2/d12/d65/de9/c141 0 2024-09-10T10:04:26.746 INFO:tasks.workunit.client.1.smithi107.stdout:8/696: dwrite d5/d8/d66/d8b/d21/f3e [0,4194304] 0 2024-09-10T10:04:26.746 INFO:tasks.workunit.client.0.smithi071.stdout:7/897: truncate d9/d76/d66/fb7 1369818 0 2024-09-10T10:04:26.748 INFO:tasks.workunit.client.1.smithi107.stdout:1/976: readlink d2/lca 0 2024-09-10T10:04:26.749 INFO:tasks.workunit.client.1.smithi107.stdout:1/977: write d2/d12/f1a [5130099,119910] 0 2024-09-10T10:04:26.750 INFO:tasks.workunit.client.1.smithi107.stdout:7/740: mknod d0/d1b/d4d/cef 0 2024-09-10T10:04:26.750 INFO:tasks.workunit.client.1.smithi107.stdout:1/978: readlink d2/d12/l19 0 2024-09-10T10:04:26.753 INFO:tasks.workunit.client.1.smithi107.stdout:8/697: symlink d5/d8/d66/d8b/lec 0 2024-09-10T10:04:26.759 INFO:tasks.workunit.client.1.smithi107.stdout:1/979: link d2/d12/d7e/faf d2/d12/d65/de1/f142 0 2024-09-10T10:04:26.760 INFO:tasks.workunit.client.1.smithi107.stdout:8/698: unlink d5/d8/d66/d8b/d18/l5f 0 2024-09-10T10:04:26.761 INFO:tasks.workunit.client.1.smithi107.stdout:7/741: link d0/d20/d72/ce5 d0/d1b/d4d/cf0 0 2024-09-10T10:04:26.762 INFO:tasks.workunit.client.1.smithi107.stdout:8/699: chown d5/c2b 0 1 2024-09-10T10:04:26.763 INFO:tasks.workunit.client.1.smithi107.stdout:4/896: dread d0/d1f/d20/f2c [0,4194304] 0 2024-09-10T10:04:26.763 INFO:tasks.workunit.client.1.smithi107.stdout:7/742: write d0/d8/d56/dcc/d81/fad [576171,91227] 0 2024-09-10T10:04:26.764 INFO:tasks.workunit.client.0.smithi071.stdout:8/745: dread d5/df/d1d/d86/f17 [0,4194304] 0 2024-09-10T10:04:26.765 INFO:tasks.workunit.client.1.smithi107.stdout:1/980: rename d2/d12/d5a/d10b/f117 to d2/d6/d67/d13c/f143 0 2024-09-10T10:04:26.766 INFO:tasks.workunit.client.0.smithi071.stdout:8/746: write d5/df/df7/f105 [605604,108785] 0 2024-09-10T10:04:26.767 INFO:tasks.workunit.client.0.smithi071.stdout:8/747: chown d5/df/d1e/d38/d9f/fbb 3002 1 2024-09-10T10:04:26.768 INFO:tasks.workunit.client.0.smithi071.stdout:8/748: dread - d5/df/ff2 zero size 2024-09-10T10:04:26.768 INFO:tasks.workunit.client.1.smithi107.stdout:1/981: dread d2/d35/f104 [0,4194304] 0 2024-09-10T10:04:26.768 INFO:tasks.workunit.client.1.smithi107.stdout:4/897: write d0/d1f/f55 [296233,79463] 0 2024-09-10T10:04:26.769 INFO:tasks.workunit.client.0.smithi071.stdout:7/898: dread d9/d15/d40/d80/f9d [0,4194304] 0 2024-09-10T10:04:26.769 INFO:tasks.workunit.client.0.smithi071.stdout:8/749: chown d5/df/df7/f105 197332 1 2024-09-10T10:04:26.769 INFO:tasks.workunit.client.1.smithi107.stdout:4/898: stat d0/d1f/d72 0 2024-09-10T10:04:26.771 INFO:tasks.workunit.client.1.smithi107.stdout:7/743: link d0/f2b d0/d8/dc/d2c/d47/ff1 0 2024-09-10T10:04:26.771 INFO:tasks.workunit.client.0.smithi071.stdout:7/899: creat d9/d15/d1f/d122/f13b x:0 0 0 2024-09-10T10:04:26.773 INFO:tasks.workunit.client.0.smithi071.stdout:7/900: fdatasync d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/dd2/fb4 0 2024-09-10T10:04:26.774 INFO:tasks.workunit.client.0.smithi071.stdout:8/750: link d5/df/d1d/d86/f3e d5/df/d1d/d86/f106 0 2024-09-10T10:04:26.774 INFO:tasks.workunit.client.0.smithi071.stdout:7/901: readlink d9/d15/d1f/lfb 0 2024-09-10T10:04:26.774 INFO:tasks.workunit.client.1.smithi107.stdout:8/700: rename d5/da2/ld0 to d5/d8/d66/d8b/d21/led 0 2024-09-10T10:04:26.776 INFO:tasks.workunit.client.0.smithi071.stdout:8/751: creat d5/df/df7/f107 x:0 0 0 2024-09-10T10:04:26.778 INFO:tasks.workunit.client.1.smithi107.stdout:4/899: dwrite d0/d40/fb2 [0,4194304] 0 2024-09-10T10:04:26.779 INFO:tasks.workunit.client.0.smithi071.stdout:8/752: mknod d5/df/c108 0 2024-09-10T10:04:26.780 INFO:tasks.workunit.client.0.smithi071.stdout:7/902: dwrite d9/d76/f9a [0,4194304] 0 2024-09-10T10:04:26.786 INFO:tasks.workunit.client.0.smithi071.stdout:7/903: creat d9/d1a/dc8/f13c x:0 0 0 2024-09-10T10:04:26.788 INFO:tasks.workunit.client.1.smithi107.stdout:8/701: dwrite d5/d8/d5b/fe2 [0,4194304] 0 2024-09-10T10:04:26.788 INFO:tasks.workunit.client.1.smithi107.stdout:7/744: dwrite d0/d8/fa8 [0,4194304] 0 2024-09-10T10:04:26.790 INFO:tasks.workunit.client.0.smithi071.stdout:8/753: write d5/df/d57/d82/f84 [580524,16541] 0 2024-09-10T10:04:26.791 INFO:tasks.workunit.client.1.smithi107.stdout:4/900: chown d0/d40/d57/d76/d77/da1/d59/led 30632 1 2024-09-10T10:04:26.792 INFO:tasks.workunit.client.1.smithi107.stdout:4/901: chown d0/d40/d57/d76/d77/d8d/d124 0 1 2024-09-10T10:04:26.794 INFO:tasks.workunit.client.1.smithi107.stdout:1/982: truncate d2/d6/fc 3749308 0 2024-09-10T10:04:26.799 INFO:tasks.workunit.client.0.smithi071.stdout:8/754: rename d5/d30 to d5/df/d1d/d86/d90/d109 0 2024-09-10T10:04:26.800 INFO:tasks.workunit.client.1.smithi107.stdout:1/983: chown d2/d35/f8c 3939 1 2024-09-10T10:04:26.800 INFO:tasks.workunit.client.1.smithi107.stdout:7/745: rename d0/d20/d35/faa to d0/d1b/d4d/d69/d97/d68/ff2 0 2024-09-10T10:04:26.803 INFO:tasks.workunit.client.1.smithi107.stdout:7/746: creat d0/d8/d56/d5d/ff3 x:0 0 0 2024-09-10T10:04:26.804 INFO:tasks.workunit.client.1.smithi107.stdout:8/702: dread d5/d8/d66/d8b/d1a/d75/fac [0,4194304] 0 2024-09-10T10:04:26.804 INFO:tasks.workunit.client.0.smithi071.stdout:8/755: write d5/df/d1d/d86/d75/f87 [4283905,109452] 0 2024-09-10T10:04:26.804 INFO:tasks.workunit.client.0.smithi071.stdout:8/756: stat d5 0 2024-09-10T10:04:26.806 INFO:tasks.workunit.client.0.smithi071.stdout:8/757: creat d5/df/d1d/d81/f10a x:0 0 0 2024-09-10T10:04:26.807 INFO:tasks.workunit.client.1.smithi107.stdout:8/703: fsync d5/d8/d66/d8b/d1a/da3/fe5 0 2024-09-10T10:04:26.807 INFO:tasks.workunit.client.0.smithi071.stdout:7/904: truncate d9/ddb/d12e/d136/d108/d10c/d118/d105/f10a 945487 0 2024-09-10T10:04:26.809 INFO:tasks.workunit.client.1.smithi107.stdout:8/704: mkdir d5/d8/d66/d8e/dee 0 2024-09-10T10:04:26.810 INFO:tasks.workunit.client.0.smithi071.stdout:7/905: symlink d9/d15/d40/d80/ddd/l13d 0 2024-09-10T10:04:26.810 INFO:tasks.workunit.client.1.smithi107.stdout:8/705: chown d5/l2d 95836189 1 2024-09-10T10:04:26.811 INFO:tasks.workunit.client.0.smithi071.stdout:8/758: link d5/df/d1d/f93 d5/df/d1d/d86/d90/f10b 0 2024-09-10T10:04:26.813 INFO:tasks.workunit.client.0.smithi071.stdout:8/759: dread - d5/df/d1d/d81/fe7 zero size 2024-09-10T10:04:26.815 INFO:tasks.workunit.client.0.smithi071.stdout:7/906: dwrite d9/d70/faa [0,4194304] 0 2024-09-10T10:04:26.819 INFO:tasks.workunit.client.0.smithi071.stdout:7/907: creat d9/d15/d1f/d74/d9b/dd8/f13e x:0 0 0 2024-09-10T10:04:26.824 INFO:tasks.workunit.client.0.smithi071.stdout:4/654: sync 2024-09-10T10:04:26.825 INFO:tasks.workunit.client.1.smithi107.stdout:4/902: write d0/d40/d6d/fd7 [934805,76813] 0 2024-09-10T10:04:26.828 INFO:tasks.workunit.client.0.smithi071.stdout:7/908: creat d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/d106/f13f x:0 0 0 2024-09-10T10:04:26.828 INFO:tasks.workunit.client.0.smithi071.stdout:8/760: truncate d5/df/f80 1472067 0 2024-09-10T10:04:26.828 INFO:tasks.workunit.client.1.smithi107.stdout:4/903: mkdir d0/d40/d57/d76/d77/d10d/d133 0 2024-09-10T10:04:26.830 INFO:tasks.workunit.client.0.smithi071.stdout:4/655: rename db/f62 to db/d1d/fd6 0 2024-09-10T10:04:26.832 INFO:tasks.workunit.client.1.smithi107.stdout:8/706: truncate d5/f26 1710461 0 2024-09-10T10:04:26.834 INFO:tasks.workunit.client.1.smithi107.stdout:8/707: fdatasync d5/d8/d66/d8b/d1a/f46 0 2024-09-10T10:04:26.834 INFO:tasks.workunit.client.0.smithi071.stdout:7/909: unlink d9/d1a/d1d/f5a 0 2024-09-10T10:04:26.836 INFO:tasks.workunit.client.0.smithi071.stdout:8/761: rmdir d5/df/d1d/d86/d90/db4/d103 0 2024-09-10T10:04:26.838 INFO:tasks.workunit.client.0.smithi071.stdout:7/910: creat d9/ddb/d12e/d136/d108/d10c/d118/f140 x:0 0 0 2024-09-10T10:04:26.838 INFO:tasks.workunit.client.0.smithi071.stdout:8/762: dread - d5/df/d1d/d86/d75/fe0 zero size 2024-09-10T10:04:26.841 INFO:tasks.workunit.client.0.smithi071.stdout:8/763: mkdir d5/df/d1d/d81/d10c 0 2024-09-10T10:04:26.842 INFO:tasks.workunit.client.0.smithi071.stdout:7/911: truncate d9/d76/d66/fb7 1998907 0 2024-09-10T10:04:26.842 INFO:tasks.workunit.client.1.smithi107.stdout:8/708: write d5/fb [1221420,2806] 0 2024-09-10T10:04:26.843 INFO:tasks.workunit.client.0.smithi071.stdout:8/764: mkdir d5/df/df7/d10d 0 2024-09-10T10:04:26.843 INFO:tasks.workunit.client.1.smithi107.stdout:8/709: chown d5/da2 385839 1 2024-09-10T10:04:26.844 INFO:tasks.workunit.client.0.smithi071.stdout:7/912: dread d9/d15/d1f/f6d [4194304,4194304] 0 2024-09-10T10:04:26.845 INFO:tasks.workunit.client.0.smithi071.stdout:8/765: write d5/f45 [1824236,95302] 0 2024-09-10T10:04:26.848 INFO:tasks.workunit.client.1.smithi107.stdout:8/710: getdents d5/d8/d66/d8b/d21/d83 0 2024-09-10T10:04:26.852 INFO:tasks.workunit.client.0.smithi071.stdout:7/913: dwrite d9/d15/d40/f95 [4194304,4194304] 0 2024-09-10T10:04:26.852 INFO:tasks.workunit.client.0.smithi071.stdout:8/766: dwrite d5/d36/f6d [4194304,4194304] 0 2024-09-10T10:04:26.853 INFO:tasks.workunit.client.0.smithi071.stdout:8/767: stat d5/df/d1d/d86/d90/db4/ldd 0 2024-09-10T10:04:26.853 INFO:tasks.workunit.client.0.smithi071.stdout:7/914: chown d9/d15/d1f/d74/d10f/f121 7884 1 2024-09-10T10:04:26.855 INFO:tasks.workunit.client.1.smithi107.stdout:4/904: dread d0/d1f/d20/f70 [0,4194304] 0 2024-09-10T10:04:26.856 INFO:tasks.workunit.client.0.smithi071.stdout:8/768: readlink d5/df/d1d/d86/d90/d109/l5c 0 2024-09-10T10:04:26.857 INFO:tasks.workunit.client.1.smithi107.stdout:8/711: dwrite d5/d8/d66/d8b/d1a/d64/f72 [0,4194304] 0 2024-09-10T10:04:26.858 INFO:tasks.workunit.client.0.smithi071.stdout:7/915: mknod d9/d15/d1f/db9/df8/c141 0 2024-09-10T10:04:26.860 INFO:tasks.workunit.client.1.smithi107.stdout:4/905: mkdir d0/d40/d57/d76/d134 0 2024-09-10T10:04:26.861 INFO:tasks.workunit.client.1.smithi107.stdout:8/712: fdatasync d5/d8/d66/d8b/d1a/fa8 0 2024-09-10T10:04:26.862 INFO:tasks.workunit.client.0.smithi071.stdout:8/769: link d5/df/d57/d82/f91 d5/df/d1d/d81/d9b/f10e 0 2024-09-10T10:04:26.864 INFO:tasks.workunit.client.1.smithi107.stdout:4/906: creat d0/d40/d57/d76/d77/da1/d59/f135 x:0 0 0 2024-09-10T10:04:26.864 INFO:tasks.workunit.client.0.smithi071.stdout:8/770: fdatasync d5/df/d1d/f3d 0 2024-09-10T10:04:26.865 INFO:tasks.workunit.client.0.smithi071.stdout:8/771: write d5/df/d1e/fda [576557,54946] 0 2024-09-10T10:04:26.866 INFO:tasks.workunit.client.1.smithi107.stdout:8/713: mkdir d5/d8/d66/d8b/d1a/d75/def 0 2024-09-10T10:04:26.868 INFO:tasks.workunit.client.1.smithi107.stdout:4/907: creat d0/d1f/d20/d80/f136 x:0 0 0 2024-09-10T10:04:26.870 INFO:tasks.workunit.client.0.smithi071.stdout:8/772: creat d5/f10f x:0 0 0 2024-09-10T10:04:26.874 INFO:tasks.workunit.client.1.smithi107.stdout:4/908: rename d0/d40/d57/d76/faf to d0/d1f/d72/f137 0 2024-09-10T10:04:26.874 INFO:tasks.workunit.client.1.smithi107.stdout:6/789: sync 2024-09-10T10:04:26.880 INFO:tasks.workunit.client.1.smithi107.stdout:6/790: fdatasync d0/d76/f7b 0 2024-09-10T10:04:26.881 INFO:tasks.workunit.client.1.smithi107.stdout:4/909: unlink d0/d40/d57/d76/d77/da1/f12d 0 2024-09-10T10:04:26.881 INFO:tasks.workunit.client.1.smithi107.stdout:6/791: rename d0/fef to d0/d3d/d14/d42/f119 0 2024-09-10T10:04:26.882 INFO:tasks.workunit.client.1.smithi107.stdout:4/910: truncate d0/fa 525241 0 2024-09-10T10:04:26.882 INFO:tasks.workunit.client.1.smithi107.stdout:4/911: chown d0/d1f/d90/d123 0 1 2024-09-10T10:04:26.884 INFO:tasks.workunit.client.1.smithi107.stdout:9/738: sync 2024-09-10T10:04:26.885 INFO:tasks.workunit.client.1.smithi107.stdout:4/912: mkdir d0/d6b/d138 0 2024-09-10T10:04:26.885 INFO:tasks.workunit.client.1.smithi107.stdout:6/792: getdents d0/df0 0 2024-09-10T10:04:26.886 INFO:tasks.workunit.client.1.smithi107.stdout:4/913: chown d0/d1f/d5e/ce7 5954 1 2024-09-10T10:04:26.886 INFO:tasks.workunit.client.1.smithi107.stdout:9/739: write d5/d7/d1d/d9b/dab/d57/d87/fea [23299,11620] 0 2024-09-10T10:04:26.888 INFO:tasks.workunit.client.1.smithi107.stdout:6/793: mknod d0/d3d/d14/dde/c11a 0 2024-09-10T10:04:26.889 INFO:tasks.workunit.client.1.smithi107.stdout:6/794: readlink d0/d3d/l38 0 2024-09-10T10:04:26.889 INFO:tasks.workunit.client.1.smithi107.stdout:4/914: fsync d0/d40/d57/fb0 0 2024-09-10T10:04:26.891 INFO:tasks.workunit.client.1.smithi107.stdout:9/740: write d5/d7/d1d/d9b/dab/d57/f69 [1044157,61648] 0 2024-09-10T10:04:26.892 INFO:tasks.workunit.client.1.smithi107.stdout:6/795: fsync d0/d3d/d14/f1f 0 2024-09-10T10:04:26.897 INFO:tasks.workunit.client.1.smithi107.stdout:9/741: rename d5/d7/d1d/c61 to d5/d1e/dc5/de0/cf5 0 2024-09-10T10:04:26.897 INFO:tasks.workunit.client.0.smithi071.stdout:8/773: dread d5/f45 [0,4194304] 0 2024-09-10T10:04:26.898 INFO:tasks.workunit.client.1.smithi107.stdout:4/915: dread d0/d40/f41 [0,4194304] 0 2024-09-10T10:04:26.900 INFO:tasks.workunit.client.1.smithi107.stdout:6/796: mkdir d0/d3d/d14/d17/d24/df3/d55/da6/d11b 0 2024-09-10T10:04:26.901 INFO:tasks.workunit.client.1.smithi107.stdout:9/742: rmdir d5/d7/d1d/d29/db4 39 2024-09-10T10:04:26.902 INFO:tasks.workunit.client.1.smithi107.stdout:6/797: chown d0/d3d/d14/d17/d24/df3/fc6 173813 1 2024-09-10T10:04:26.904 INFO:tasks.workunit.client.0.smithi071.stdout:8/774: dwrite d5/df/d1d/d81/f10a [0,4194304] 0 2024-09-10T10:04:26.906 INFO:tasks.workunit.client.1.smithi107.stdout:4/916: dwrite d0/d1f/d20/d47/f85 [0,4194304] 0 2024-09-10T10:04:26.907 INFO:tasks.workunit.client.1.smithi107.stdout:6/798: write d0/d3d/d14/d17/f36 [4721925,57399] 0 2024-09-10T10:04:26.909 INFO:tasks.workunit.client.1.smithi107.stdout:9/743: getdents d5/d1e/dc5 0 2024-09-10T10:04:26.911 INFO:tasks.workunit.client.0.smithi071.stdout:8/775: dwrite d5/df/d1e/d38/f99 [0,4194304] 0 2024-09-10T10:04:26.913 INFO:tasks.workunit.client.1.smithi107.stdout:6/799: rename d0/d3d/d14/d17/d24/df3/d55/fff to d0/d3d/d14/d21/d8a/da7/dc9/f11c 0 2024-09-10T10:04:26.915 INFO:tasks.workunit.client.0.smithi071.stdout:8/776: fsync d5/df/d1e/d38/d9f/faf 0 2024-09-10T10:04:26.917 INFO:tasks.workunit.client.1.smithi107.stdout:6/800: chown d0/d3d/d14/d17/d4b/fe0 0 1 2024-09-10T10:04:26.924 INFO:tasks.workunit.client.1.smithi107.stdout:9/744: dwrite d5/d7/d1d/d9b/dab/d57/d87/d27/f60 [4194304,4194304] 0 2024-09-10T10:04:26.924 INFO:tasks.workunit.client.1.smithi107.stdout:6/801: creat d0/d3d/f11d x:0 0 0 2024-09-10T10:04:26.927 INFO:tasks.workunit.client.1.smithi107.stdout:9/745: write d5/d7/d1d/d95/fa4 [1779157,70172] 0 2024-09-10T10:04:26.928 INFO:tasks.workunit.client.1.smithi107.stdout:6/802: chown d0/f8 126271 1 2024-09-10T10:04:26.928 INFO:tasks.workunit.client.1.smithi107.stdout:9/746: chown d5/d7/d1d/d41/d83/c94 238420 1 2024-09-10T10:04:26.932 INFO:tasks.workunit.client.1.smithi107.stdout:4/917: dwrite d0/fb5 [0,4194304] 0 2024-09-10T10:04:26.934 INFO:tasks.workunit.client.1.smithi107.stdout:6/803: chown d0/d3d/d14/c1b 301755007 1 2024-09-10T10:04:26.938 INFO:tasks.workunit.client.1.smithi107.stdout:4/918: write d0/fb [404128,49486] 0 2024-09-10T10:04:26.944 INFO:tasks.workunit.client.1.smithi107.stdout:4/919: mkdir d0/d40/d6d/d8a/d139 0 2024-09-10T10:04:26.944 INFO:tasks.workunit.client.1.smithi107.stdout:9/747: dwrite d5/d7/d1d/d9b/dab/d57/d87/fea [0,4194304] 0 2024-09-10T10:04:26.946 INFO:tasks.workunit.client.1.smithi107.stdout:6/804: dwrite d0/d70/faf [0,4194304] 0 2024-09-10T10:04:26.951 INFO:tasks.workunit.client.1.smithi107.stdout:6/805: dread - d0/d3d/d14/d17/d24/df3/dbe/fd0 zero size 2024-09-10T10:04:26.953 INFO:tasks.workunit.client.1.smithi107.stdout:9/748: rmdir d5/d7/d1d/d29/db4/dbd/dda 0 2024-09-10T10:04:26.954 INFO:tasks.workunit.client.1.smithi107.stdout:9/749: chown d5/ca 1982648 1 2024-09-10T10:04:26.955 INFO:tasks.workunit.client.1.smithi107.stdout:6/806: creat d0/d3d/d14/d21/d8a/da7/f11e x:0 0 0 2024-09-10T10:04:26.956 INFO:tasks.workunit.client.1.smithi107.stdout:9/750: mknod d5/d7/d1d/cf6 0 2024-09-10T10:04:26.960 INFO:tasks.workunit.client.1.smithi107.stdout:9/751: truncate f3 3560466 0 2024-09-10T10:04:26.963 INFO:tasks.workunit.client.1.smithi107.stdout:6/807: getdents d0/d3d/d14/d9f/dca 0 2024-09-10T10:04:26.964 INFO:tasks.workunit.client.1.smithi107.stdout:9/752: write d5/d7/d1d/d9b/dab/d57/d87/d37/f63 [2894953,128286] 0 2024-09-10T10:04:26.965 INFO:tasks.workunit.client.1.smithi107.stdout:6/808: rename d0/d3d/d14 to d0/d3d/d14/d17/d4b/d11f 22 2024-09-10T10:04:26.968 INFO:tasks.workunit.client.1.smithi107.stdout:9/753: creat d5/d7/d1d/d9b/de5/ff7 x:0 0 0 2024-09-10T10:04:26.969 INFO:tasks.workunit.client.0.smithi071.stdout:8/777: dread d5/df/d1e/d38/d9f/fd7 [0,4194304] 0 2024-09-10T10:04:26.978 INFO:tasks.workunit.client.1.smithi107.stdout:9/754: dwrite d5/d7/d1d/db5/fce [0,4194304] 0 2024-09-10T10:04:26.978 INFO:tasks.workunit.client.1.smithi107.stdout:6/809: dwrite d0/d3d/d14/d21/d8a/dee/df1/f109 [0,4194304] 0 2024-09-10T10:04:26.980 INFO:tasks.workunit.client.1.smithi107.stdout:9/755: write d5/d7/d3c/fac [4315249,2025] 0 2024-09-10T10:04:26.980 INFO:tasks.workunit.client.0.smithi071.stdout:8/778: truncate d5/df/d1e/d38/d9f/fd7 2038415 0 2024-09-10T10:04:26.982 INFO:tasks.workunit.client.1.smithi107.stdout:4/920: dread d0/d40/d57/d76/d77/da1/f5b [0,4194304] 0 2024-09-10T10:04:26.984 INFO:tasks.workunit.client.1.smithi107.stdout:6/810: unlink d0/f8 0 2024-09-10T10:04:26.984 INFO:tasks.workunit.client.1.smithi107.stdout:4/921: fdatasync d0/d40/d75/f126 0 2024-09-10T10:04:26.987 INFO:tasks.workunit.client.1.smithi107.stdout:9/756: rename d5/d7/d1d/d29/f99 to d5/d7/d1d/d41/d83/d9a/d8c/ff8 0 2024-09-10T10:04:26.988 INFO:tasks.workunit.client.1.smithi107.stdout:6/811: rmdir d0/d3d/d14/d21/d8a/da2 39 2024-09-10T10:04:26.989 INFO:tasks.workunit.client.1.smithi107.stdout:9/757: chown d5/d7/d1d/d41/d83/d9a/f65 4145709 1 2024-09-10T10:04:26.989 INFO:tasks.workunit.client.0.smithi071.stdout:8/779: rename d5/df/d1e/d38/d9f/fd7 to d5/df/d1d/d86/d75/d85/f110 0 2024-09-10T10:04:26.990 INFO:tasks.workunit.client.0.smithi071.stdout:1/756: sync 2024-09-10T10:04:26.990 INFO:tasks.workunit.client.1.smithi107.stdout:6/812: stat d0/d3d/c10 0 2024-09-10T10:04:26.992 INFO:tasks.workunit.client.0.smithi071.stdout:8/780: mknod d5/df/d1d/d86/d90/d109/c111 0 2024-09-10T10:04:26.992 INFO:tasks.workunit.client.1.smithi107.stdout:4/922: rename d0/d40/l7f to d0/d40/d57/d76/d77/d10d/d133/l13a 0 2024-09-10T10:04:26.992 INFO:tasks.workunit.client.1.smithi107.stdout:4/923: stat d0/d6b/d9d 0 2024-09-10T10:04:26.993 INFO:tasks.workunit.client.1.smithi107.stdout:4/924: chown d0/d6b/l112 214 1 2024-09-10T10:04:26.996 INFO:tasks.workunit.client.0.smithi071.stdout:8/781: rmdir d5/df/df7/d10d 0 2024-09-10T10:04:26.998 INFO:tasks.workunit.client.1.smithi107.stdout:9/758: creat d5/d7/d3c/ff9 x:0 0 0 2024-09-10T10:04:27.005 INFO:tasks.workunit.client.0.smithi071.stdout:8/782: write d5/fd [785570,50995] 0 2024-09-10T10:04:27.008 INFO:tasks.workunit.client.1.smithi107.stdout:4/925: dwrite d0/d40/d75/f46 [0,4194304] 0 2024-09-10T10:04:27.014 INFO:tasks.workunit.client.0.smithi071.stdout:8/783: rmdir d5/df/d1d/d86/d90/db4/dea 0 2024-09-10T10:04:27.016 INFO:tasks.workunit.client.1.smithi107.stdout:4/926: symlink d0/d40/d57/d76/d77/l13b 0 2024-09-10T10:04:27.020 INFO:tasks.workunit.client.1.smithi107.stdout:6/813: read d0/d3d/d14/d17/d4b/f5c [440225,77001] 0 2024-09-10T10:04:27.021 INFO:tasks.workunit.client.0.smithi071.stdout:1/757: link d1/d21/d65/f7a d1/d21/d3d/d9a/df9/de4/db6/f10d 0 2024-09-10T10:04:27.021 INFO:tasks.workunit.client.1.smithi107.stdout:9/759: getdents d5/d7/d1d/d9b/dab/d57/d87 0 2024-09-10T10:04:27.024 INFO:tasks.workunit.client.1.smithi107.stdout:9/760: creat d5/d7/d1d/d3b/ffa x:0 0 0 2024-09-10T10:04:27.024 INFO:tasks.workunit.client.1.smithi107.stdout:4/927: link d0/d40/d6d/ff0 d0/d40/d57/d4f/f13c 0 2024-09-10T10:04:27.025 INFO:tasks.workunit.client.1.smithi107.stdout:6/814: fsync d0/d3d/d14/d21/f53 0 2024-09-10T10:04:27.028 INFO:tasks.workunit.client.1.smithi107.stdout:4/928: chown d0/d40/d57/d76/d77/da1/d59/l11e 990284630 1 2024-09-10T10:04:27.028 INFO:tasks.workunit.client.1.smithi107.stdout:9/761: read d5/d7/d1d/d9b/dab/f5d [137546,29286] 0 2024-09-10T10:04:27.028 INFO:tasks.workunit.client.1.smithi107.stdout:6/815: symlink d0/d3d/d14/l120 0 2024-09-10T10:04:27.031 INFO:tasks.workunit.client.0.smithi071.stdout:1/758: rmdir d1/d21 39 2024-09-10T10:04:27.031 INFO:tasks.workunit.client.0.smithi071.stdout:8/784: truncate d5/d36/d49/fbf 1996923 0 2024-09-10T10:04:27.033 INFO:tasks.workunit.client.0.smithi071.stdout:8/785: chown d5/d36/d49/d8f/lf4 1628 1 2024-09-10T10:04:27.034 INFO:tasks.workunit.client.1.smithi107.stdout:6/816: creat d0/d3d/d14/d17/d24/f121 x:0 0 0 2024-09-10T10:04:27.035 INFO:tasks.workunit.client.1.smithi107.stdout:9/762: rmdir d5/d7/d1d/d9b/dab/d57/d87/d27 39 2024-09-10T10:04:27.039 INFO:tasks.workunit.client.1.smithi107.stdout:6/817: mknod d0/d3d/d14/d21/d8a/dee/df1/c122 0 2024-09-10T10:04:27.039 INFO:tasks.workunit.client.1.smithi107.stdout:2/798: sync 2024-09-10T10:04:27.039 INFO:tasks.workunit.client.1.smithi107.stdout:5/834: sync 2024-09-10T10:04:27.039 INFO:tasks.workunit.client.1.smithi107.stdout:0/819: sync 2024-09-10T10:04:27.040 INFO:tasks.workunit.client.1.smithi107.stdout:2/799: stat d3/da/d66/d91/dea/ffd 0 2024-09-10T10:04:27.041 INFO:tasks.workunit.client.1.smithi107.stdout:2/800: dread - d3/da/df/d78/fe1 zero size 2024-09-10T10:04:27.041 INFO:tasks.workunit.client.0.smithi071.stdout:1/759: mkdir d1/d21/d2f/d30/d10e 0 2024-09-10T10:04:27.044 INFO:tasks.workunit.client.1.smithi107.stdout:4/929: getdents d0/d1f/d20/d47/d8c/dfe/dff 0 2024-09-10T10:04:27.046 INFO:tasks.workunit.client.0.smithi071.stdout:1/760: mkdir d1/d35/dea/d10f 0 2024-09-10T10:04:27.047 INFO:tasks.workunit.client.1.smithi107.stdout:6/818: dwrite d0/d70/fc7 [0,4194304] 0 2024-09-10T10:04:27.048 INFO:tasks.workunit.client.1.smithi107.stdout:2/801: creat d3/da/d66/db7/f11a x:0 0 0 2024-09-10T10:04:27.048 INFO:tasks.workunit.client.1.smithi107.stdout:6/819: stat d0/d3d/d14/d17/feb 0 2024-09-10T10:04:27.051 INFO:tasks.workunit.client.0.smithi071.stdout:1/761: dwrite d1/d21/f61 [0,4194304] 0 2024-09-10T10:04:27.052 INFO:tasks.workunit.client.1.smithi107.stdout:9/763: rename d5/d7/l6b to d5/lfb 0 2024-09-10T10:04:27.052 INFO:tasks.workunit.client.0.smithi071.stdout:1/762: chown d1/d21/d3d/d4a/fa6 107684 1 2024-09-10T10:04:27.055 INFO:tasks.workunit.client.0.smithi071.stdout:1/763: truncate d1/d21/d3d/d9a/d72/dfd/f107 785485 0 2024-09-10T10:04:27.057 INFO:tasks.workunit.client.1.smithi107.stdout:2/802: unlink d3/da/df/d20/d36/f71 0 2024-09-10T10:04:27.062 INFO:tasks.workunit.client.0.smithi071.stdout:1/764: truncate d1/d3f/fa3 2653294 0 2024-09-10T10:04:27.063 INFO:tasks.workunit.client.1.smithi107.stdout:0/820: link d6/d8/d2f/d2e/d32/l39 d6/d14/l10d 0 2024-09-10T10:04:27.064 INFO:tasks.workunit.client.1.smithi107.stdout:9/764: mkdir d5/d7/d1d/d41/dc8/dfc 0 2024-09-10T10:04:27.064 INFO:tasks.workunit.client.1.smithi107.stdout:5/835: link de/d4a/d4e/l83 de/d20/d2b/d4b/d5e/l113 0 2024-09-10T10:04:27.065 INFO:tasks.workunit.client.0.smithi071.stdout:1/765: dread - d1/d21/d2f/f9b zero size 2024-09-10T10:04:27.066 INFO:tasks.workunit.client.1.smithi107.stdout:4/930: link d0/d1f/d20/d80/le3 d0/d40/d75/df2/l13d 0 2024-09-10T10:04:27.066 INFO:tasks.workunit.client.1.smithi107.stdout:4/931: truncate d0/d40/d75/f44 4956943 0 2024-09-10T10:04:27.068 INFO:tasks.workunit.client.1.smithi107.stdout:5/836: fdatasync de/f28 0 2024-09-10T10:04:27.070 INFO:tasks.workunit.client.1.smithi107.stdout:5/837: chown de/d20/d2b/d4b/d5e/l75 0 1 2024-09-10T10:04:27.072 INFO:tasks.workunit.client.1.smithi107.stdout:9/765: mkdir d5/d7/d1d/d29/db4/dfd 0 2024-09-10T10:04:27.074 INFO:tasks.workunit.client.0.smithi071.stdout:1/766: unlink d1/d21/d2f/d30/d6a/d91/d9d/cac 0 2024-09-10T10:04:27.076 INFO:tasks.workunit.client.1.smithi107.stdout:5/838: truncate de/d20/d2b/d4b/d5e/f94 319577 0 2024-09-10T10:04:27.077 INFO:tasks.workunit.client.0.smithi071.stdout:1/767: mkdir d1/d35/dea/d110 0 2024-09-10T10:04:27.083 INFO:tasks.workunit.client.0.smithi071.stdout:1/768: creat d1/d70/d76/f111 x:0 0 0 2024-09-10T10:04:27.083 INFO:tasks.workunit.client.0.smithi071.stdout:1/769: chown d1/d21/fd5 846 1 2024-09-10T10:04:27.085 INFO:tasks.workunit.client.1.smithi107.stdout:4/932: dread d0/d40/d57/d76/d77/da1/fac [0,4194304] 0 2024-09-10T10:04:27.087 INFO:tasks.workunit.client.1.smithi107.stdout:4/933: read d0/d40/d57/d76/d77/d8d/fab [3356868,35157] 0 2024-09-10T10:04:27.087 INFO:tasks.workunit.client.1.smithi107.stdout:5/839: creat de/f114 x:0 0 0 2024-09-10T10:04:27.088 INFO:tasks.workunit.client.0.smithi071.stdout:1/770: symlink d1/d21/l112 0 2024-09-10T10:04:27.088 INFO:tasks.workunit.client.1.smithi107.stdout:4/934: fdatasync d0/d1f/d20/f5d 0 2024-09-10T10:04:27.089 INFO:tasks.workunit.client.0.smithi071.stdout:1/771: fdatasync d1/d21/d3d/d4a/fed 0 2024-09-10T10:04:27.090 INFO:tasks.workunit.client.1.smithi107.stdout:0/821: truncate d6/f4a 1256901 0 2024-09-10T10:04:27.091 INFO:tasks.workunit.client.0.smithi071.stdout:1/772: rmdir d1/d35/dea 39 2024-09-10T10:04:27.093 INFO:tasks.workunit.client.1.smithi107.stdout:0/822: read d6/d8/d2f/d2e/d32/d59/f62 [219941,1853] 0 2024-09-10T10:04:27.095 INFO:tasks.workunit.client.1.smithi107.stdout:5/840: dwrite de/d20/f7c [0,4194304] 0 2024-09-10T10:04:27.097 INFO:tasks.workunit.client.1.smithi107.stdout:9/766: write d5/f6 [438425,4245] 0 2024-09-10T10:04:27.099 INFO:tasks.workunit.client.1.smithi107.stdout:4/935: link d0/d1f/d20/d47/d8c/dfe/c109 d0/d40/d57/d76/d77/d10d/c13e 0 2024-09-10T10:04:27.101 INFO:tasks.workunit.client.1.smithi107.stdout:4/936: write d0/d1f/f55 [2368016,123057] 0 2024-09-10T10:04:27.103 INFO:tasks.workunit.client.1.smithi107.stdout:9/767: creat d5/d7/d3c/ffe x:0 0 0 2024-09-10T10:04:27.104 INFO:tasks.workunit.client.1.smithi107.stdout:4/937: dread - d0/d40/d6d/ff7 zero size 2024-09-10T10:04:27.105 INFO:tasks.workunit.client.1.smithi107.stdout:0/823: dwrite d6/d8/d2f/d2e/d32/d85/d8a/fd7 [0,4194304] 0 2024-09-10T10:04:27.106 INFO:tasks.workunit.client.0.smithi071.stdout:1/773: truncate d1/d21/f61 2191893 0 2024-09-10T10:04:27.109 INFO:tasks.workunit.client.0.smithi071.stdout:1/774: mkdir d1/d21/d2f/d30/d6a/d113 0 2024-09-10T10:04:27.110 INFO:tasks.workunit.client.1.smithi107.stdout:5/841: dread de/d4a/d7e/db2/dbc/fe9 [0,4194304] 0 2024-09-10T10:04:27.111 INFO:tasks.workunit.client.1.smithi107.stdout:4/938: creat d0/d40/d57/d76/d77/f13f x:0 0 0 2024-09-10T10:04:27.112 INFO:tasks.workunit.client.0.smithi071.stdout:1/775: truncate d1/d21/d2f/d30/d6a/f69 1443553 0 2024-09-10T10:04:27.114 INFO:tasks.workunit.client.0.smithi071.stdout:1/776: mkdir d1/d21/d2f/d30/d6a/d91/d9d/d114 0 2024-09-10T10:04:27.114 INFO:tasks.workunit.client.1.smithi107.stdout:4/939: chown d0/d40/d57/d76/d77/l13b 3856 1 2024-09-10T10:04:27.115 INFO:tasks.workunit.client.0.smithi071.stdout:1/777: write d1/d21/d65/f4e [3152713,78339] 0 2024-09-10T10:04:27.116 INFO:tasks.workunit.client.1.smithi107.stdout:5/842: chown de/c2a 614 1 2024-09-10T10:04:27.117 INFO:tasks.workunit.client.1.smithi107.stdout:4/940: write d0/d40/d6d/f84 [4661985,68664] 0 2024-09-10T10:04:27.117 INFO:tasks.workunit.client.0.smithi071.stdout:1/778: mkdir d1/d3f/d115 0 2024-09-10T10:04:27.119 INFO:tasks.workunit.client.1.smithi107.stdout:9/768: dwrite d5/d7/d1d/d9b/dab/d57/d87/d37/f63 [0,4194304] 0 2024-09-10T10:04:27.120 INFO:tasks.workunit.client.0.smithi071.stdout:1/779: creat d1/d3f/d58/f116 x:0 0 0 2024-09-10T10:04:27.122 INFO:tasks.workunit.client.1.smithi107.stdout:4/941: mkdir d0/d1f/d20/d47/d8c/dfe/d140 0 2024-09-10T10:04:27.123 INFO:tasks.workunit.client.1.smithi107.stdout:9/769: mknod d5/d7/d1d/d41/d83/cff 0 2024-09-10T10:04:27.123 INFO:tasks.workunit.client.1.smithi107.stdout:4/942: read - d0/d40/fd3 zero size 2024-09-10T10:04:27.124 INFO:tasks.workunit.client.0.smithi071.stdout:1/780: symlink d1/d21/d2f/d30/d75/d97/l117 0 2024-09-10T10:04:27.124 INFO:tasks.workunit.client.1.smithi107.stdout:9/770: fdatasync d5/d7/d1d/d29/fdc 0 2024-09-10T10:04:27.125 INFO:tasks.workunit.client.1.smithi107.stdout:5/843: creat de/db3/db6/f115 x:0 0 0 2024-09-10T10:04:27.126 INFO:tasks.workunit.client.0.smithi071.stdout:1/781: mknod d1/d21/d3d/d9a/d72/dfd/c118 0 2024-09-10T10:04:27.127 INFO:tasks.workunit.client.1.smithi107.stdout:5/844: read de/d4a/f63 [2718819,98579] 0 2024-09-10T10:04:27.127 INFO:tasks.workunit.client.1.smithi107.stdout:4/943: mkdir d0/d40/d75/d53/d141 0 2024-09-10T10:04:27.128 INFO:tasks.workunit.client.1.smithi107.stdout:0/824: write d6/d8/f72 [1173832,22599] 0 2024-09-10T10:04:27.128 INFO:tasks.workunit.client.1.smithi107.stdout:4/944: fsync d0/d1f/d5e/f114 0 2024-09-10T10:04:27.130 INFO:tasks.workunit.client.1.smithi107.stdout:9/771: mknod d5/d7/d1d/d9b/dab/d57/c100 0 2024-09-10T10:04:27.132 INFO:tasks.workunit.client.0.smithi071.stdout:2/828: sync 2024-09-10T10:04:27.133 INFO:tasks.workunit.client.0.smithi071.stdout:3/727: sync 2024-09-10T10:04:27.135 INFO:tasks.workunit.client.1.smithi107.stdout:5/845: fsync de/f48 0 2024-09-10T10:04:27.137 INFO:tasks.workunit.client.0.smithi071.stdout:2/829: rename d8/d87/fd3 to d8/d38/d8d/ddc/f114 0 2024-09-10T10:04:27.137 INFO:tasks.workunit.client.1.smithi107.stdout:4/945: symlink d0/d1f/d90/d123/l142 0 2024-09-10T10:04:27.137 INFO:tasks.workunit.client.1.smithi107.stdout:0/825: dwrite d6/d8/d2f/f33 [0,4194304] 0 2024-09-10T10:04:27.138 INFO:tasks.workunit.client.0.smithi071.stdout:2/830: write d8/d87/d51/f84 [1475305,33698] 0 2024-09-10T10:04:27.139 INFO:tasks.workunit.client.0.smithi071.stdout:2/831: chown d8/d4a/ffa 368974312 1 2024-09-10T10:04:27.139 INFO:tasks.workunit.client.0.smithi071.stdout:3/728: unlink d3/cb 0 2024-09-10T10:04:27.141 INFO:tasks.workunit.client.1.smithi107.stdout:9/772: mkdir d5/d7/d1d/d29/d101 0 2024-09-10T10:04:27.142 INFO:tasks.workunit.client.1.smithi107.stdout:9/773: dread - d5/d7/d3c/ffe zero size 2024-09-10T10:04:27.143 INFO:tasks.workunit.client.1.smithi107.stdout:9/774: fsync d5/d7/d1d/d29/fe2 0 2024-09-10T10:04:27.144 INFO:tasks.workunit.client.0.smithi071.stdout:2/832: rename d8/d24/fcd to d8/d87/d49/d66/df0/f115 0 2024-09-10T10:04:27.149 INFO:tasks.workunit.client.1.smithi107.stdout:0/826: rename d6/d8/d2f/d35/d3c/d58/d69/d84/ce3 to d6/d8/d2f/d2e/d32/d56/c10e 0 2024-09-10T10:04:27.151 INFO:tasks.workunit.client.0.smithi071.stdout:1/782: write d1/fd [2389667,34667] 0 2024-09-10T10:04:27.153 INFO:tasks.workunit.client.1.smithi107.stdout:9/775: dwrite d5/d7/f9 [0,4194304] 0 2024-09-10T10:04:27.154 INFO:tasks.workunit.client.0.smithi071.stdout:2/833: chown d8/d87/d49/dce/ce3 151195 1 2024-09-10T10:04:27.156 INFO:tasks.workunit.client.0.smithi071.stdout:2/834: fsync d8/f14 0 2024-09-10T10:04:27.156 INFO:tasks.workunit.client.1.smithi107.stdout:0/827: mknod d6/d8/d2f/dfc/c10f 0 2024-09-10T10:04:27.160 INFO:tasks.workunit.client.0.smithi071.stdout:3/729: truncate d3/d10/d24/f27 379328 0 2024-09-10T10:04:27.160 INFO:tasks.workunit.client.0.smithi071.stdout:1/783: dwrite d1/d21/d3d/d4a/f82 [0,4194304] 0 2024-09-10T10:04:27.161 INFO:tasks.workunit.client.1.smithi107.stdout:9/776: symlink d5/d1e/dc5/de3/l102 0 2024-09-10T10:04:27.161 INFO:tasks.workunit.client.1.smithi107.stdout:5/846: write de/d4a/d7e/f6e [1655398,27498] 0 2024-09-10T10:04:27.161 INFO:tasks.workunit.client.1.smithi107.stdout:4/946: dwrite d0/d40/d57/d4f/f58 [0,4194304] 0 2024-09-10T10:04:27.166 INFO:tasks.workunit.client.0.smithi071.stdout:3/730: symlink d3/d1c/d3c/da1/dd2/lfb 0 2024-09-10T10:04:27.167 INFO:tasks.workunit.client.1.smithi107.stdout:4/947: mknod d0/d40/db3/c143 0 2024-09-10T10:04:27.168 INFO:tasks.workunit.client.1.smithi107.stdout:0/828: dwrite d6/d8/d3e/d43/f4b [0,4194304] 0 2024-09-10T10:04:27.171 INFO:tasks.workunit.client.1.smithi107.stdout:9/777: fdatasync d5/d7/d1d/d9b/dab/d57/d87/d37/f52 0 2024-09-10T10:04:27.173 INFO:tasks.workunit.client.0.smithi071.stdout:3/731: link d3/d49/d34/f44 d3/d10/d24/d2b/db2/ffc 0 2024-09-10T10:04:27.174 INFO:tasks.workunit.client.1.smithi107.stdout:4/948: fsync d0/d40/db3/fb9 0 2024-09-10T10:04:27.175 INFO:tasks.workunit.client.1.smithi107.stdout:0/829: chown d6/d8/d2f/da3/dee/dae/ced 57348 1 2024-09-10T10:04:27.178 INFO:tasks.workunit.client.0.smithi071.stdout:3/732: creat d3/d49/ffd x:0 0 0 2024-09-10T10:04:27.181 INFO:tasks.workunit.client.0.smithi071.stdout:3/733: mknod d3/d1c/d3e/cfe 0 2024-09-10T10:04:27.184 INFO:tasks.workunit.client.0.smithi071.stdout:3/734: creat d3/d20/d99/fff x:0 0 0 2024-09-10T10:04:27.184 INFO:tasks.workunit.client.1.smithi107.stdout:0/830: dwrite d6/d8/d3e/d43/fb3 [0,4194304] 0 2024-09-10T10:04:27.187 INFO:tasks.workunit.client.0.smithi071.stdout:3/735: dread d3/d1c/d3c/f6f [0,4194304] 0 2024-09-10T10:04:27.196 INFO:tasks.workunit.client.1.smithi107.stdout:1/984: sync 2024-09-10T10:04:27.197 INFO:tasks.workunit.client.1.smithi107.stdout:1/985: chown d2/d6/fd2 1 1 2024-09-10T10:04:27.202 INFO:tasks.workunit.client.0.smithi071.stdout:3/736: truncate d3/d49/f6c 3246497 0 2024-09-10T10:04:27.212 INFO:tasks.workunit.client.0.smithi071.stdout:3/737: dwrite d3/d49/d34/f81 [0,4194304] 0 2024-09-10T10:04:27.218 INFO:tasks.workunit.client.0.smithi071.stdout:3/738: write d3/d1c/d3c/da1/d42/d4a/f95 [3072819,46730] 0 2024-09-10T10:04:27.220 INFO:tasks.workunit.client.0.smithi071.stdout:3/739: fsync d3/d49/d2f/f93 0 2024-09-10T10:04:27.222 INFO:tasks.workunit.client.0.smithi071.stdout:3/740: symlink d3/d1c/d3c/da1/dd2/l100 0 2024-09-10T10:04:27.223 INFO:tasks.workunit.client.0.smithi071.stdout:3/741: chown d3/d10/d24/d2b/c32 19844629 1 2024-09-10T10:04:27.225 INFO:tasks.workunit.client.0.smithi071.stdout:3/742: write d3/f36 [195194,36836] 0 2024-09-10T10:04:27.228 INFO:tasks.workunit.client.0.smithi071.stdout:3/743: rename d3/d1c/d3c/da1/d42/d4a/d60/f6b to d3/d1c/d3c/da1/d3a/dc0/f101 0 2024-09-10T10:04:27.230 INFO:tasks.workunit.client.0.smithi071.stdout:3/744: mkdir d3/d1c/d3c/d66/d102 0 2024-09-10T10:04:27.233 INFO:tasks.workunit.client.0.smithi071.stdout:3/745: link d3/d1c/d3c/da1/l6a d3/d20/d99/l103 0 2024-09-10T10:04:27.234 INFO:tasks.workunit.client.0.smithi071.stdout:3/746: mknod d3/d1c/d3c/da1/d5d/d9d/c104 0 2024-09-10T10:04:27.235 INFO:tasks.workunit.client.0.smithi071.stdout:3/747: chown d3/d1c/f7c 783020 1 2024-09-10T10:04:27.249 INFO:tasks.workunit.client.0.smithi071.stdout:3/748: dread d3/d10/d24/d2b/f5a [0,4194304] 0 2024-09-10T10:04:27.249 INFO:tasks.workunit.client.0.smithi071.stdout:3/749: fdatasync d3/d49/d34/f81 0 2024-09-10T10:04:27.253 INFO:tasks.workunit.client.1.smithi107.stdout:7/747: sync 2024-09-10T10:04:27.254 INFO:tasks.workunit.client.1.smithi107.stdout:6/820: sync 2024-09-10T10:04:27.254 INFO:tasks.workunit.client.1.smithi107.stdout:8/714: sync 2024-09-10T10:04:27.254 INFO:tasks.workunit.client.0.smithi071.stdout:3/750: link d3/d1c/d3c/da1/d5d/da5/fd1 d3/d1c/d3c/da1/d3a/f105 0 2024-09-10T10:04:27.256 INFO:tasks.workunit.client.0.smithi071.stdout:3/751: creat d3/d49/d34/deb/f106 x:0 0 0 2024-09-10T10:04:27.256 INFO:tasks.workunit.client.0.smithi071.stdout:3/752: fdatasync d3/fdd 0 2024-09-10T10:04:27.258 INFO:tasks.workunit.client.0.smithi071.stdout:3/753: truncate d3/d1c/d3c/da1/fa9 1040022 0 2024-09-10T10:04:27.259 INFO:tasks.workunit.client.0.smithi071.stdout:3/754: readlink d3/d1c/d3c/d66/l8a 0 2024-09-10T10:04:27.259 INFO:tasks.workunit.client.0.smithi071.stdout:3/755: chown d3/d1c/d3c/da1/d5d/d7a 0 1 2024-09-10T10:04:27.263 INFO:tasks.workunit.client.0.smithi071.stdout:3/756: rename d3/d1c/d3c/da1/d42/d4a/d60/cae to d3/d1c/d3e/d77/c107 0 2024-09-10T10:04:27.266 INFO:tasks.workunit.client.1.smithi107.stdout:7/748: dread d0/d1b/d9b/faf [0,4194304] 0 2024-09-10T10:04:27.269 INFO:tasks.workunit.client.0.smithi071.stdout:3/757: dwrite d3/f8c [0,4194304] 0 2024-09-10T10:04:27.269 INFO:tasks.workunit.client.1.smithi107.stdout:5/847: rename de/d4a to de/d20/d2b/d4b/d5e/d116 0 2024-09-10T10:04:27.273 INFO:tasks.workunit.client.1.smithi107.stdout:9/778: creat d5/d7/d1d/d29/d101/f103 x:0 0 0 2024-09-10T10:04:27.276 INFO:tasks.workunit.client.0.smithi071.stdout:3/758: dwrite d3/d1c/d3c/da1/d42/d4a/d60/d78/fac [0,4194304] 0 2024-09-10T10:04:27.278 INFO:tasks.workunit.client.0.smithi071.stdout:3/759: rmdir d3/d1c/d3c/da1/d3a 39 2024-09-10T10:04:27.280 INFO:tasks.workunit.client.1.smithi107.stdout:4/949: write d0/d40/db3/fd2 [1496902,68223] 0 2024-09-10T10:04:27.282 INFO:tasks.workunit.client.0.smithi071.stdout:3/760: symlink d3/d1c/d3e/de0/l108 0 2024-09-10T10:04:27.286 INFO:tasks.workunit.client.0.smithi071.stdout:3/761: link d3/d10/d24/d2b/c32 d3/d1c/d3e/de0/c109 0 2024-09-10T10:04:27.293 INFO:tasks.workunit.client.0.smithi071.stdout:3/762: dwrite d3/d1c/d3c/da1/d3a/dbd/f53 [0,4194304] 0 2024-09-10T10:04:27.295 INFO:tasks.workunit.client.0.smithi071.stdout:3/763: rmdir d3/d1c/d3c/da1/d5d 39 2024-09-10T10:04:27.296 INFO:tasks.workunit.client.0.smithi071.stdout:3/764: write d3/d1c/d3c/da1/fb7 [1430914,56280] 0 2024-09-10T10:04:27.301 INFO:tasks.workunit.client.0.smithi071.stdout:3/765: mknod d3/d1c/d3c/da1/d42/d4a/d60/d78/c10a 0 2024-09-10T10:04:27.302 INFO:tasks.workunit.client.0.smithi071.stdout:3/766: write d3/d1c/d3e/f97 [368268,95751] 0 2024-09-10T10:04:27.314 INFO:tasks.workunit.client.1.smithi107.stdout:8/715: chown d5/d8/d5b/f74 29 1 2024-09-10T10:04:27.315 INFO:tasks.workunit.client.1.smithi107.stdout:6/821: creat d0/d3d/d14/d17/d24/dc5/f123 x:0 0 0 2024-09-10T10:04:27.316 INFO:tasks.workunit.client.1.smithi107.stdout:1/986: mknod d2/d12/d65/c144 0 2024-09-10T10:04:27.317 INFO:tasks.workunit.client.1.smithi107.stdout:7/749: creat d0/d8/d56/dcc/de7/ff4 x:0 0 0 2024-09-10T10:04:27.318 INFO:tasks.workunit.client.1.smithi107.stdout:8/716: chown d5/d8/d66/d8b/d21/d83/f84 153156100 1 2024-09-10T10:04:27.320 INFO:tasks.workunit.client.1.smithi107.stdout:7/750: read d0/f2b [2063079,92663] 0 2024-09-10T10:04:27.320 INFO:tasks.workunit.client.1.smithi107.stdout:6/822: chown d0/d3d/d14/d17/d24/df3/d55/ld3 1468665 1 2024-09-10T10:04:27.323 INFO:tasks.workunit.client.1.smithi107.stdout:7/751: chown d0/d20/ddf 13473 1 2024-09-10T10:04:27.323 INFO:tasks.workunit.client.1.smithi107.stdout:8/717: creat d5/d8/d2a/d35/d70/ff0 x:0 0 0 2024-09-10T10:04:27.324 INFO:tasks.workunit.client.1.smithi107.stdout:1/987: mknod d2/d6/dc6/dd4/d106/d11f/c145 0 2024-09-10T10:04:27.325 INFO:tasks.workunit.client.0.smithi071.stdout:3/767: dread d3/d1c/d3c/da1/d5d/d8f/fdb [0,4194304] 0 2024-09-10T10:04:27.325 INFO:tasks.workunit.client.1.smithi107.stdout:6/823: mkdir d0/d3d/d14/d21/d124 0 2024-09-10T10:04:27.326 INFO:tasks.workunit.client.0.smithi071.stdout:6/639: sync 2024-09-10T10:04:27.326 INFO:tasks.workunit.client.0.smithi071.stdout:0/873: sync 2024-09-10T10:04:27.326 INFO:tasks.workunit.client.0.smithi071.stdout:4/656: sync 2024-09-10T10:04:27.326 INFO:tasks.workunit.client.0.smithi071.stdout:5/700: sync 2024-09-10T10:04:27.327 INFO:tasks.workunit.client.1.smithi107.stdout:1/988: chown d2/d35/fe7 100234382 1 2024-09-10T10:04:27.327 INFO:tasks.workunit.client.1.smithi107.stdout:7/752: symlink d0/d1b/d4d/d69/lf5 0 2024-09-10T10:04:27.327 INFO:tasks.workunit.client.1.smithi107.stdout:8/718: chown d5/d8/d2a/d47/lbd 3053243 1 2024-09-10T10:04:27.328 INFO:tasks.workunit.client.1.smithi107.stdout:9/779: dwrite d5/d7/d1d/d9b/dab/d57/d87/d27/feb [0,4194304] 0 2024-09-10T10:04:27.329 INFO:tasks.workunit.client.0.smithi071.stdout:3/768: truncate d3/d1c/d3c/da1/d5d/da5/fd1 1503453 0 2024-09-10T10:04:27.329 INFO:tasks.workunit.client.0.smithi071.stdout:6/640: stat d4/da/df/d2e/d3a/d43/f49 0 2024-09-10T10:04:27.330 INFO:tasks.workunit.client.0.smithi071.stdout:6/641: chown d4/da/df/d2e/d3a/lb0 1272872 1 2024-09-10T10:04:27.330 INFO:tasks.workunit.client.1.smithi107.stdout:8/719: readlink d5/l17 0 2024-09-10T10:04:27.331 INFO:tasks.workunit.client.0.smithi071.stdout:0/874: unlink d11/d22/d31/d72/ff1 0 2024-09-10T10:04:27.334 INFO:tasks.workunit.client.0.smithi071.stdout:4/657: fdatasync db/d15/d26/d43/d4d/d9f/f9a 0 2024-09-10T10:04:27.336 INFO:tasks.workunit.client.0.smithi071.stdout:6/642: dwrite d4/da/df/d2e/d3a/f66 [0,4194304] 0 2024-09-10T10:04:27.337 INFO:tasks.workunit.client.0.smithi071.stdout:5/701: symlink dc/df/d29/lf3 0 2024-09-10T10:04:27.338 INFO:tasks.workunit.client.0.smithi071.stdout:3/769: symlink d3/d10/l10b 0 2024-09-10T10:04:27.338 INFO:tasks.workunit.client.0.smithi071.stdout:0/875: symlink d11/d22/d9a/ddf/l137 0 2024-09-10T10:04:27.338 INFO:tasks.workunit.client.1.smithi107.stdout:1/989: creat d2/d6/f146 x:0 0 0 2024-09-10T10:04:27.339 INFO:tasks.workunit.client.1.smithi107.stdout:7/753: truncate d0/d8/dc/d2c/fde 835505 0 2024-09-10T10:04:27.341 INFO:tasks.workunit.client.0.smithi071.stdout:4/658: mkdir db/d15/d26/d43/d4d/d77/dd7 0 2024-09-10T10:04:27.341 INFO:tasks.workunit.client.0.smithi071.stdout:0/876: write d11/d22/f29 [5722596,5803] 0 2024-09-10T10:04:27.342 INFO:tasks.workunit.client.1.smithi107.stdout:1/990: fsync d2/d12/d65/db4/f140 0 2024-09-10T10:04:27.343 INFO:tasks.workunit.client.1.smithi107.stdout:9/780: truncate d5/d7/fe 622072 0 2024-09-10T10:04:27.343 INFO:tasks.workunit.client.0.smithi071.stdout:5/702: rename dc/df/dd7/fc6 to dc/df/ff4 0 2024-09-10T10:04:27.345 INFO:tasks.workunit.client.0.smithi071.stdout:3/770: symlink d3/d1c/d3c/da1/d3a/dc0/l10c 0 2024-09-10T10:04:27.349 INFO:tasks.workunit.client.1.smithi107.stdout:5/848: write de/f16 [878348,16317] 0 2024-09-10T10:04:27.349 INFO:tasks.workunit.client.1.smithi107.stdout:1/991: creat d2/d6/dc6/dd4/d106/d11f/f147 x:0 0 0 2024-09-10T10:04:27.349 INFO:tasks.workunit.client.1.smithi107.stdout:5/849: write de/d20/fd8 [97686,11260] 0 2024-09-10T10:04:27.350 INFO:tasks.workunit.client.1.smithi107.stdout:9/781: rename d5/c66 to d5/d7/d1d/db5/c104 0 2024-09-10T10:04:27.350 INFO:tasks.workunit.client.0.smithi071.stdout:0/877: rename d11/d1e/dfa/f114 to d11/d1e/dfa/d5f/f138 0 2024-09-10T10:04:27.352 INFO:tasks.workunit.client.0.smithi071.stdout:3/771: dwrite d3/d20/d99/fff [0,4194304] 0 2024-09-10T10:04:27.354 INFO:tasks.workunit.client.1.smithi107.stdout:1/992: chown d2/d6/dc6/dd4/d106/d11f 361974 1 2024-09-10T10:04:27.354 INFO:tasks.workunit.client.1.smithi107.stdout:0/831: dwrite d6/d8/f9 [8388608,4194304] 0 2024-09-10T10:04:27.354 INFO:tasks.workunit.client.1.smithi107.stdout:6/824: dwrite d0/d3d/d14/d17/d24/df3/d55/d73/f93 [0,4194304] 0 2024-09-10T10:04:27.355 INFO:tasks.workunit.client.0.smithi071.stdout:4/659: link db/d1d/d61/d6a/d88/d90/f97 db/d15/d26/d43/d82/fd8 0 2024-09-10T10:04:27.360 INFO:tasks.workunit.client.0.smithi071.stdout:3/772: unlink d3/d20/d8d/le3 0 2024-09-10T10:04:27.361 INFO:tasks.workunit.client.0.smithi071.stdout:0/878: dwrite d11/d1e/dfa/d79/ddc/d109/f10a [0,4194304] 0 2024-09-10T10:04:27.369 INFO:tasks.workunit.client.1.smithi107.stdout:1/993: creat d2/d12/f148 x:0 0 0 2024-09-10T10:04:27.372 INFO:tasks.workunit.client.1.smithi107.stdout:5/850: dread de/f90 [0,4194304] 0 2024-09-10T10:04:27.373 INFO:tasks.workunit.client.1.smithi107.stdout:8/720: write d5/d8/d5b/fb0 [372005,55762] 0 2024-09-10T10:04:27.373 INFO:tasks.workunit.client.1.smithi107.stdout:0/832: dwrite d6/d8/d2f/d2e/d32/d56/f8c [4194304,4194304] 0 2024-09-10T10:04:27.375 INFO:tasks.workunit.client.0.smithi071.stdout:0/879: symlink d11/d22/dde/d100/l139 0 2024-09-10T10:04:27.375 INFO:tasks.workunit.client.0.smithi071.stdout:0/880: dread - d11/d1e/f12e zero size 2024-09-10T10:04:27.375 INFO:tasks.workunit.client.0.smithi071.stdout:3/773: symlink d3/d49/l10d 0 2024-09-10T10:04:27.376 INFO:tasks.workunit.client.1.smithi107.stdout:5/851: write de/f16 [1262166,29611] 0 2024-09-10T10:04:27.376 INFO:tasks.workunit.client.0.smithi071.stdout:0/881: write f7 [1358970,38645] 0 2024-09-10T10:04:27.377 INFO:tasks.workunit.client.0.smithi071.stdout:3/774: fsync d3/d1c/d3c/da1/d5d/d9d/fe9 0 2024-09-10T10:04:27.377 INFO:tasks.workunit.client.0.smithi071.stdout:0/882: write d11/d30/d70/f8c [1639615,105246] 0 2024-09-10T10:04:27.378 INFO:tasks.workunit.client.0.smithi071.stdout:3/775: readlink d3/d1c/d3c/da1/d3a/l8e 0 2024-09-10T10:04:27.382 INFO:tasks.workunit.client.0.smithi071.stdout:5/703: mknod dc/df/da6/cf5 0 2024-09-10T10:04:27.382 INFO:tasks.workunit.client.1.smithi107.stdout:5/852: unlink de/f90 0 2024-09-10T10:04:27.383 INFO:tasks.workunit.client.1.smithi107.stdout:8/721: mknod d5/d8/d66/d8b/d18/da4/cf1 0 2024-09-10T10:04:27.385 INFO:tasks.workunit.client.0.smithi071.stdout:6/643: dread d4/da/df/d2e/d3a/d40/f58 [0,4194304] 0 2024-09-10T10:04:27.386 INFO:tasks.workunit.client.1.smithi107.stdout:0/833: mknod d6/d8/d2f/d2e/d32/c110 0 2024-09-10T10:04:27.386 INFO:tasks.workunit.client.0.smithi071.stdout:0/883: rename d11/lac to d11/d22/d9a/ddf/l13a 0 2024-09-10T10:04:27.388 INFO:tasks.workunit.client.1.smithi107.stdout:5/853: symlink de/d20/d2b/dcc/l117 0 2024-09-10T10:04:27.389 INFO:tasks.workunit.client.1.smithi107.stdout:8/722: write d5/d8/d66/d8b/d21/fb3 [2184823,55718] 0 2024-09-10T10:04:27.389 INFO:tasks.workunit.client.1.smithi107.stdout:9/782: dwrite d5/d7/d1d/f4d [0,4194304] 0 2024-09-10T10:04:27.390 INFO:tasks.workunit.client.0.smithi071.stdout:5/704: creat dc/df/d29/ff6 x:0 0 0 2024-09-10T10:04:27.391 INFO:tasks.workunit.client.0.smithi071.stdout:0/884: read d11/d30/d70/d128/f135 [1049862,1774] 0 2024-09-10T10:04:27.392 INFO:tasks.workunit.client.1.smithi107.stdout:0/834: mknod d6/d8/d2f/da3/da5/c111 0 2024-09-10T10:04:27.393 INFO:tasks.workunit.client.0.smithi071.stdout:0/885: write d11/d1e/dfa/d79/ddc/f120 [4481284,50189] 0 2024-09-10T10:04:27.393 INFO:tasks.workunit.client.1.smithi107.stdout:9/783: chown d5/d7/d3c/c9c 6 1 2024-09-10T10:04:27.394 INFO:tasks.workunit.client.0.smithi071.stdout:5/705: mknod dc/d4a/cf7 0 2024-09-10T10:04:27.395 INFO:tasks.workunit.client.1.smithi107.stdout:5/854: write de/d20/d2b/d4b/d5e/f93 [2214901,82239] 0 2024-09-10T10:04:27.395 INFO:tasks.workunit.client.0.smithi071.stdout:5/706: readlink dc/df/d29/lad 0 2024-09-10T10:04:27.396 INFO:tasks.workunit.client.0.smithi071.stdout:5/707: chown dc/d4a/la9 1018459 1 2024-09-10T10:04:27.399 INFO:tasks.workunit.client.1.smithi107.stdout:0/835: creat d6/d8/d2f/d2e/f112 x:0 0 0 2024-09-10T10:04:27.401 INFO:tasks.workunit.client.1.smithi107.stdout:5/855: rename de/d20/d2b/d4b/d5e/d116/d7e/f6e to de/d20/d2b/d4b/d5e/db1/f118 0 2024-09-10T10:04:27.402 INFO:tasks.workunit.client.0.smithi071.stdout:0/886: rename d11/d22/d31/cc3 to d11/d1e/dfa/d79/df8/c13b 0 2024-09-10T10:04:27.402 INFO:tasks.workunit.client.1.smithi107.stdout:8/723: truncate d5/d8/d66/d8b/d1a/d71/f7d 176739 0 2024-09-10T10:04:27.405 INFO:tasks.workunit.client.0.smithi071.stdout:5/708: creat dc/ff8 x:0 0 0 2024-09-10T10:04:27.405 INFO:tasks.workunit.client.1.smithi107.stdout:5/856: fsync de/db3/db6/dc8/f102 0 2024-09-10T10:04:27.406 INFO:tasks.workunit.client.1.smithi107.stdout:6/825: dread d0/d3d/d14/d21/f28 [0,4194304] 0 2024-09-10T10:04:27.408 INFO:tasks.workunit.client.1.smithi107.stdout:0/836: mkdir d6/d8/d2f/d2e/d32/d95/d113 0 2024-09-10T10:04:27.408 INFO:tasks.workunit.client.1.smithi107.stdout:8/724: write d5/d8/d66/d8b/d21/d83/fb4 [909330,92125] 0 2024-09-10T10:04:27.411 INFO:tasks.workunit.client.0.smithi071.stdout:4/660: dwrite db/d15/d26/d43/d4d/d9f/f8b [0,4194304] 0 2024-09-10T10:04:27.413 INFO:tasks.workunit.client.1.smithi107.stdout:8/725: readlink d5/d8/d2a/l63 0 2024-09-10T10:04:27.414 INFO:tasks.workunit.client.1.smithi107.stdout:1/994: dread d2/d36/f4d [4194304,4194304] 0 2024-09-10T10:04:27.415 INFO:tasks.workunit.client.0.smithi071.stdout:7/916: sync 2024-09-10T10:04:27.416 INFO:tasks.workunit.client.1.smithi107.stdout:5/857: truncate de/f25 2583834 0 2024-09-10T10:04:27.417 INFO:tasks.workunit.client.0.smithi071.stdout:6/644: write d4/da/df/d2e/d3a/fa3 [857083,117351] 0 2024-09-10T10:04:27.419 INFO:tasks.workunit.client.0.smithi071.stdout:3/776: dread d3/d49/d34/ff5 [0,4194304] 0 2024-09-10T10:04:27.422 INFO:tasks.workunit.client.1.smithi107.stdout:8/726: dread - d5/d8/d66/d8b/d21/d83/fa1 zero size 2024-09-10T10:04:27.427 INFO:tasks.workunit.client.1.smithi107.stdout:2/803: sync 2024-09-10T10:04:27.428 INFO:tasks.workunit.client.1.smithi107.stdout:0/837: dwrite d6/d8/ff9 [0,4194304] 0 2024-09-10T10:04:27.431 INFO:tasks.workunit.client.1.smithi107.stdout:1/995: rename d2/f46 to d2/d12/d65/db4/dd9/df7/f149 0 2024-09-10T10:04:27.435 INFO:tasks.workunit.client.1.smithi107.stdout:0/838: read d6/faf [100151,75347] 0 2024-09-10T10:04:27.437 INFO:tasks.workunit.client.1.smithi107.stdout:9/784: dwrite d5/d7/d1d/d9b/dab/fd6 [0,4194304] 0 2024-09-10T10:04:27.440 INFO:tasks.workunit.client.1.smithi107.stdout:0/839: chown d6/d8/d2f/d2e/d32/l4e 2507475 1 2024-09-10T10:04:27.443 INFO:tasks.workunit.client.1.smithi107.stdout:8/727: dread d5/d8/d5b/f90 [0,4194304] 0 2024-09-10T10:04:27.443 INFO:tasks.workunit.client.1.smithi107.stdout:5/858: dwrite de/d20/d2b/d4b/d5e/d116/d4e/d89/d99/fd9 [0,4194304] 0 2024-09-10T10:04:27.446 INFO:tasks.workunit.client.1.smithi107.stdout:6/826: dread d0/d3d/d14/d9f/dca/fa1 [0,4194304] 0 2024-09-10T10:04:27.448 INFO:tasks.workunit.client.1.smithi107.stdout:2/804: rename d3/da/d1e/d5f/d54/f7d to d3/f11b 0 2024-09-10T10:04:27.450 INFO:tasks.workunit.client.1.smithi107.stdout:5/859: mknod de/d20/d2b/d4b/d8c/c119 0 2024-09-10T10:04:27.453 INFO:tasks.workunit.client.1.smithi107.stdout:9/785: mknod d5/d7/d1d/d41/dc8/dfc/c105 0 2024-09-10T10:04:27.453 INFO:tasks.workunit.client.0.smithi071.stdout:0/887: getdents d11 0 2024-09-10T10:04:27.455 INFO:tasks.workunit.client.0.smithi071.stdout:7/917: creat d9/ddb/d12e/d136/d108/d10c/f142 x:0 0 0 2024-09-10T10:04:27.458 INFO:tasks.workunit.client.0.smithi071.stdout:4/661: creat db/d15/d17/d4e/d5a/dd3/fd9 x:0 0 0 2024-09-10T10:04:27.458 INFO:tasks.workunit.client.1.smithi107.stdout:5/860: creat de/d20/d2b/d4b/d8c/f11a x:0 0 0 2024-09-10T10:04:27.458 INFO:tasks.workunit.client.1.smithi107.stdout:0/840: dwrite d6/d8/d2f/da3/dee/fe2 [0,4194304] 0 2024-09-10T10:04:27.459 INFO:tasks.workunit.client.1.smithi107.stdout:8/728: rename d5/d8/d66/d8b/d1a/d64/fde to d5/ff2 0 2024-09-10T10:04:27.459 INFO:tasks.workunit.client.1.smithi107.stdout:6/827: dread d0/d3d/d14/d21/fa0 [4194304,4194304] 0 2024-09-10T10:04:27.459 INFO:tasks.workunit.client.0.smithi071.stdout:0/888: rename d11/d22/d9a/ddf/l137 to d11/d22/d9a/l13c 0 2024-09-10T10:04:27.460 INFO:tasks.workunit.client.1.smithi107.stdout:9/786: mkdir d5/d7/d106 0 2024-09-10T10:04:27.460 INFO:tasks.workunit.client.0.smithi071.stdout:6/645: creat d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/fcb x:0 0 0 2024-09-10T10:04:27.461 INFO:tasks.workunit.client.1.smithi107.stdout:2/805: dread - d3/da/df/d20/d36/d4f/d92/ff2 zero size 2024-09-10T10:04:27.464 INFO:tasks.workunit.client.1.smithi107.stdout:5/861: fsync de/d20/f37 0 2024-09-10T10:04:27.465 INFO:tasks.workunit.client.1.smithi107.stdout:6/828: mknod d0/d3d/d14/d21/d8a/da7/dc9/c125 0 2024-09-10T10:04:27.466 INFO:tasks.workunit.client.1.smithi107.stdout:2/806: dread - d3/da/d1e/d40/d8a/d7f/d55/d85/f9d zero size 2024-09-10T10:04:27.467 INFO:tasks.workunit.client.0.smithi071.stdout:0/889: dwrite d11/d30/d70/faa [4194304,4194304] 0 2024-09-10T10:04:27.470 INFO:tasks.workunit.client.1.smithi107.stdout:0/841: getdents d6/d8e 0 2024-09-10T10:04:27.470 INFO:tasks.workunit.client.1.smithi107.stdout:6/829: symlink d0/d3d/d14/d21/d8a/da7/dc9/d100/l126 0 2024-09-10T10:04:27.471 INFO:tasks.workunit.client.0.smithi071.stdout:7/918: creat d9/d15/d40/f143 x:0 0 0 2024-09-10T10:04:27.471 INFO:tasks.workunit.client.0.smithi071.stdout:7/919: chown d9/d2c/d49/f62 133 1 2024-09-10T10:04:27.472 INFO:tasks.workunit.client.1.smithi107.stdout:5/862: creat de/d20/d2b/d4b/d5e/d116/d7e/f11b x:0 0 0 2024-09-10T10:04:27.473 INFO:tasks.workunit.client.1.smithi107.stdout:0/842: write d6/d8/d2f/d2e/d32/d85/d8a/fd7 [4266670,20259] 0 2024-09-10T10:04:27.474 INFO:tasks.workunit.client.0.smithi071.stdout:6/646: getdents d4/da/df/d5e 0 2024-09-10T10:04:27.481 INFO:tasks.workunit.client.1.smithi107.stdout:6/830: symlink d0/d3d/d14/d21/d8a/da2/da3/dac/l127 0 2024-09-10T10:04:27.481 INFO:tasks.workunit.client.0.smithi071.stdout:6/647: mknod d4/da/df/d2e/d3a/d91/dc7/d97/ccc 0 2024-09-10T10:04:27.484 INFO:tasks.workunit.client.1.smithi107.stdout:6/831: dread - d0/d3d/d14/d17/d24/df3/f90 zero size 2024-09-10T10:04:27.485 INFO:tasks.workunit.client.0.smithi071.stdout:6/648: creat d4/da/df/d2e/d3a/da9/dbc/dc3/fcd x:0 0 0 2024-09-10T10:04:27.485 INFO:tasks.workunit.client.1.smithi107.stdout:0/843: dwrite d6/d8/d3e/d43/f4b [0,4194304] 0 2024-09-10T10:04:27.486 INFO:tasks.workunit.client.0.smithi071.stdout:5/709: truncate dc/df/d29/d94/fcc 227848 0 2024-09-10T10:04:27.486 INFO:tasks.workunit.client.0.smithi071.stdout:6/649: readlink d4/da/df/d2e/d3a/d91/dc7/l92 0 2024-09-10T10:04:27.489 INFO:tasks.workunit.client.0.smithi071.stdout:1/784: sync 2024-09-10T10:04:27.489 INFO:tasks.workunit.client.0.smithi071.stdout:8/786: sync 2024-09-10T10:04:27.489 INFO:tasks.workunit.client.0.smithi071.stdout:2/835: sync 2024-09-10T10:04:27.491 INFO:tasks.workunit.client.0.smithi071.stdout:6/650: rmdir d4/da/df/d5e 39 2024-09-10T10:04:27.491 INFO:tasks.workunit.client.0.smithi071.stdout:3/777: write d3/d10/d24/f27 [1420465,75889] 0 2024-09-10T10:04:27.492 INFO:tasks.workunit.client.0.smithi071.stdout:4/662: dread db/d15/d17/d24/f49 [0,4194304] 0 2024-09-10T10:04:27.493 INFO:tasks.workunit.client.1.smithi107.stdout:6/832: rename d0/d3d/d14/d21/f5f to d0/d3d/d14/d17/d24/df3/d55/d73/f128 0 2024-09-10T10:04:27.493 INFO:tasks.workunit.client.0.smithi071.stdout:7/920: dread d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/de8/ff6 [0,4194304] 0 2024-09-10T10:04:27.494 INFO:tasks.workunit.client.1.smithi107.stdout:2/807: dwrite d3/da/df/d20/f57 [0,4194304] 0 2024-09-10T10:04:27.497 INFO:tasks.workunit.client.0.smithi071.stdout:0/890: creat d11/d22/d9a/f13d x:0 0 0 2024-09-10T10:04:27.497 INFO:tasks.workunit.client.1.smithi107.stdout:5/863: dwrite de/d20/d2b/d4b/d5e/d116/f85 [0,4194304] 0 2024-09-10T10:04:27.498 INFO:tasks.workunit.client.1.smithi107.stdout:9/787: dread d5/d7/d1d/d41/d83/d9a/f28 [0,4194304] 0 2024-09-10T10:04:27.500 INFO:tasks.workunit.client.0.smithi071.stdout:6/651: symlink d4/da/df/d5e/lce 0 2024-09-10T10:04:27.501 INFO:tasks.workunit.client.0.smithi071.stdout:8/787: symlink d5/df/d1d/d86/d75/dcd/l112 0 2024-09-10T10:04:27.502 INFO:tasks.workunit.client.0.smithi071.stdout:4/663: mknod db/d15/d4b/cda 0 2024-09-10T10:04:27.502 INFO:tasks.workunit.client.0.smithi071.stdout:5/710: dwrite dc/df/f33 [0,4194304] 0 2024-09-10T10:04:27.505 INFO:tasks.workunit.client.0.smithi071.stdout:8/788: readlink d5/df/d67/la2 0 2024-09-10T10:04:27.506 INFO:tasks.workunit.client.0.smithi071.stdout:2/836: creat d8/d87/d33/d41/d4d/dc8/f116 x:0 0 0 2024-09-10T10:04:27.508 INFO:tasks.workunit.client.0.smithi071.stdout:0/891: write d11/d30/d70/d128/f135 [1674940,18592] 0 2024-09-10T10:04:27.508 INFO:tasks.workunit.client.1.smithi107.stdout:0/844: rename d6/d8/d2f/d2e/d32/d85/ccd to d6/d8/d2f/d35/d3c/d58/d69/c114 0 2024-09-10T10:04:27.508 INFO:tasks.workunit.client.1.smithi107.stdout:9/788: mkdir d5/d7/d106/d107 0 2024-09-10T10:04:27.511 INFO:tasks.workunit.client.1.smithi107.stdout:5/864: rename de/d20/d2b/d4b/d8c/fec to de/d20/d2b/d4b/d5e/d9a/f11c 0 2024-09-10T10:04:27.512 INFO:tasks.workunit.client.1.smithi107.stdout:2/808: write d3/da/df/d20/d36/d4f/d92/f53 [3784303,33353] 0 2024-09-10T10:04:27.513 INFO:tasks.workunit.client.0.smithi071.stdout:8/789: symlink d5/df/d1d/d81/l113 0 2024-09-10T10:04:27.514 INFO:tasks.workunit.client.1.smithi107.stdout:0/845: mknod d6/d8/d3e/d43/c115 0 2024-09-10T10:04:27.514 INFO:tasks.workunit.client.1.smithi107.stdout:6/833: link d0/d3d/d14/d21/d8a/d8d/l98 d0/d3d/d14/d21/d8a/db9/d110/l129 0 2024-09-10T10:04:27.516 INFO:tasks.workunit.client.0.smithi071.stdout:6/652: write d4/da/df/d2e/d3a/d40/d60/d7a/fba [1907849,85265] 0 2024-09-10T10:04:27.516 INFO:tasks.workunit.client.1.smithi107.stdout:2/809: fdatasync d3/da/d66/d91/dea/ffe 0 2024-09-10T10:04:27.518 INFO:tasks.workunit.client.0.smithi071.stdout:6/653: chown d4/da/df/d2e/d3a/d91/dc7/d97/ccc 1147863 1 2024-09-10T10:04:27.519 INFO:tasks.workunit.client.1.smithi107.stdout:5/865: fdatasync de/f31 0 2024-09-10T10:04:27.520 INFO:tasks.workunit.client.1.smithi107.stdout:0/846: truncate d6/d8/d2f/d2e/fec 4355593 0 2024-09-10T10:04:27.520 INFO:tasks.workunit.client.1.smithi107.stdout:9/789: rmdir d5/d7/d1d/da3 0 2024-09-10T10:04:27.520 INFO:tasks.workunit.client.1.smithi107.stdout:2/810: mknod d3/da/df/d20/d36/d4f/d92/dec/c11c 0 2024-09-10T10:04:27.521 INFO:tasks.workunit.client.0.smithi071.stdout:2/837: rename d8/d87/f6d to d8/d87/d33/d41/d56/d107/f117 0 2024-09-10T10:04:27.521 INFO:tasks.workunit.client.0.smithi071.stdout:3/778: link d3/d49/ced d3/d1c/d3c/da1/d5d/da5/db3/c10e 0 2024-09-10T10:04:27.523 INFO:tasks.workunit.client.0.smithi071.stdout:4/664: write db/d15/d17/d24/f2b [989796,15975] 0 2024-09-10T10:04:27.525 INFO:tasks.workunit.client.1.smithi107.stdout:6/834: rename d0/d3d/d14/d17/d4b to d0/d3d/d14/dde/d10c/d12a 0 2024-09-10T10:04:27.525 INFO:tasks.workunit.client.0.smithi071.stdout:7/921: dwrite d9/d15/d1f/d74/f86 [0,4194304] 0 2024-09-10T10:04:27.526 INFO:tasks.workunit.client.0.smithi071.stdout:6/654: symlink d4/da/df/d2e/d3a/da9/dbc/lcf 0 2024-09-10T10:04:27.526 INFO:tasks.workunit.client.0.smithi071.stdout:3/779: read d3/d1c/d3c/da1/fb7 [641334,67391] 0 2024-09-10T10:04:27.527 INFO:tasks.workunit.client.1.smithi107.stdout:6/835: dread - d0/d3d/d14/d21/d8a/da2/ffd zero size 2024-09-10T10:04:27.527 INFO:tasks.workunit.client.0.smithi071.stdout:2/838: truncate d8/d87/d33/d41/d4d/f10e 549203 0 2024-09-10T10:04:27.529 INFO:tasks.workunit.client.0.smithi071.stdout:3/780: chown d3/d1c/d3c/d66 10067 1 2024-09-10T10:04:27.530 INFO:tasks.workunit.client.1.smithi107.stdout:9/790: mkdir d5/d7/d1d/d9b/dab/d57/d87/d37/d108 0 2024-09-10T10:04:27.530 INFO:tasks.workunit.client.1.smithi107.stdout:5/866: unlink de/d41/l64 0 2024-09-10T10:04:27.530 INFO:tasks.workunit.client.0.smithi071.stdout:4/665: mknod db/d15/d26/cdb 0 2024-09-10T10:04:27.530 INFO:tasks.workunit.client.1.smithi107.stdout:2/811: dread d3/da/df/d20/f57 [0,4194304] 0 2024-09-10T10:04:27.532 INFO:tasks.workunit.client.1.smithi107.stdout:9/791: dread - d5/d7/d1d/d3b/ffa zero size 2024-09-10T10:04:27.532 INFO:tasks.workunit.client.1.smithi107.stdout:0/847: rename d6/d8/d2f/da3/dee/dae/ced to d6/d5a/d5c/c116 0 2024-09-10T10:04:27.532 INFO:tasks.workunit.client.0.smithi071.stdout:3/781: write d3/d10/d24/fd8 [346774,4285] 0 2024-09-10T10:04:27.535 INFO:tasks.workunit.client.1.smithi107.stdout:5/867: chown de/d20/d3d/l3f 4 1 2024-09-10T10:04:27.535 INFO:tasks.workunit.client.1.smithi107.stdout:2/812: chown d3/da/d1e/d40/d8a/d7f/d55/d85/d7c/lf0 32957244 1 2024-09-10T10:04:27.536 INFO:tasks.workunit.client.0.smithi071.stdout:2/839: symlink d8/d87/d51/l118 0 2024-09-10T10:04:27.536 INFO:tasks.workunit.client.0.smithi071.stdout:7/922: mkdir d9/ddb/d12e/d136/d108/d10c/d118/d105/d144 0 2024-09-10T10:04:27.537 INFO:tasks.workunit.client.1.smithi107.stdout:9/792: symlink d5/d7/d106/l109 0 2024-09-10T10:04:27.538 INFO:tasks.workunit.client.1.smithi107.stdout:9/793: chown d5/d7/d1d/d41/led 45898 1 2024-09-10T10:04:27.539 INFO:tasks.workunit.client.1.smithi107.stdout:6/836: mknod d0/df0/c12b 0 2024-09-10T10:04:27.540 INFO:tasks.workunit.client.1.smithi107.stdout:6/837: readlink d0/d3d/d14/d21/d8a/d8d/lb0 0 2024-09-10T10:04:27.541 INFO:tasks.workunit.client.0.smithi071.stdout:4/666: chown db/d15/d17/d4e/fce 3 1 2024-09-10T10:04:27.541 INFO:tasks.workunit.client.1.smithi107.stdout:0/848: creat d6/d8/d2f/d2e/d32/d56/ddf/f117 x:0 0 0 2024-09-10T10:04:27.541 INFO:tasks.workunit.client.0.smithi071.stdout:5/711: dwrite dc/df/d29/f5f [0,4194304] 0 2024-09-10T10:04:27.542 INFO:tasks.workunit.client.1.smithi107.stdout:6/838: write d0/d3d/d14/d17/d24/f10f [739590,23649] 0 2024-09-10T10:04:27.544 INFO:tasks.workunit.client.1.smithi107.stdout:2/813: creat d3/d8f/df4/d102/f11d x:0 0 0 2024-09-10T10:04:27.546 INFO:tasks.workunit.client.1.smithi107.stdout:5/868: creat de/d20/d3d/dd4/f11d x:0 0 0 2024-09-10T10:04:27.547 INFO:tasks.workunit.client.0.smithi071.stdout:6/655: dwrite d4/d1c/fbb [0,4194304] 0 2024-09-10T10:04:27.547 INFO:tasks.workunit.client.0.smithi071.stdout:4/667: fdatasync db/d15/d17/d4e/f5b 0 2024-09-10T10:04:27.549 INFO:tasks.workunit.client.0.smithi071.stdout:2/840: link d8/d87/c44 d8/d38/d8d/c119 0 2024-09-10T10:04:27.551 INFO:tasks.workunit.client.1.smithi107.stdout:0/849: creat d6/d5a/da9/f118 x:0 0 0 2024-09-10T10:04:27.552 INFO:tasks.workunit.client.0.smithi071.stdout:8/790: dwrite d5/df/f80 [0,4194304] 0 2024-09-10T10:04:27.553 INFO:tasks.workunit.client.0.smithi071.stdout:6/656: dread d4/fb8 [0,4194304] 0 2024-09-10T10:04:27.554 INFO:tasks.workunit.client.0.smithi071.stdout:4/668: chown db/d15/d17/d24/l48 3 1 2024-09-10T10:04:27.558 INFO:tasks.workunit.client.0.smithi071.stdout:5/712: write dc/d4a/fb7 [767985,28382] 0 2024-09-10T10:04:27.559 INFO:tasks.workunit.client.0.smithi071.stdout:6/657: symlink d4/da/df/d2e/d3a/da9/ld0 0 2024-09-10T10:04:27.560 INFO:tasks.workunit.client.0.smithi071.stdout:5/713: read - dc/d53/d6a/f96 zero size 2024-09-10T10:04:27.563 INFO:tasks.workunit.client.1.smithi107.stdout:6/839: write d0/d3d/d14/d17/f47 [721297,48610] 0 2024-09-10T10:04:27.563 INFO:tasks.workunit.client.0.smithi071.stdout:4/669: rename db/d15/d17/d24/f49 to db/d15/d4b/fdc 0 2024-09-10T10:04:27.563 INFO:tasks.workunit.client.0.smithi071.stdout:2/841: symlink d8/d87/d33/d41/d4d/l11a 0 2024-09-10T10:04:27.565 INFO:tasks.workunit.client.1.smithi107.stdout:5/869: rename de/d20/d3d/f6f to de/f11e 0 2024-09-10T10:04:27.566 INFO:tasks.workunit.client.0.smithi071.stdout:7/923: getdents d9/ddb/d12e/d136/d108/d10c/d118 0 2024-09-10T10:04:27.566 INFO:tasks.workunit.client.0.smithi071.stdout:3/782: dwrite d3/ff [0,4194304] 0 2024-09-10T10:04:27.567 INFO:tasks.workunit.client.1.smithi107.stdout:0/850: creat d6/d8/f119 x:0 0 0 2024-09-10T10:04:27.567 INFO:tasks.workunit.client.0.smithi071.stdout:6/658: symlink d4/da/df/d2e/d3a/d43/ld1 0 2024-09-10T10:04:27.568 INFO:tasks.workunit.client.0.smithi071.stdout:7/924: dread - d9/d1a/dc8/f13c zero size 2024-09-10T10:04:27.569 INFO:tasks.workunit.client.0.smithi071.stdout:2/842: write d8/d4a/d104/d65/faf [494113,131015] 0 2024-09-10T10:04:27.570 INFO:tasks.workunit.client.1.smithi107.stdout:2/814: getdents d3/da/d1e/d40/d8a/d7f/d55/d85/de4 0 2024-09-10T10:04:27.571 INFO:tasks.workunit.client.1.smithi107.stdout:9/794: dwrite d5/d7/d1d/d41/d83/d9a/fb7 [0,4194304] 0 2024-09-10T10:04:27.571 INFO:tasks.workunit.client.0.smithi071.stdout:3/783: write d3/d1c/d3c/da1/d3a/f45 [1166918,30265] 0 2024-09-10T10:04:27.573 INFO:tasks.workunit.client.0.smithi071.stdout:5/714: rmdir dc/df/d3e 39 2024-09-10T10:04:27.574 INFO:tasks.workunit.client.0.smithi071.stdout:4/670: creat db/d15/d26/d43/d4d/fdd x:0 0 0 2024-09-10T10:04:27.574 INFO:tasks.workunit.client.0.smithi071.stdout:8/791: getdents d5/df/d1d/d86/d75 0 2024-09-10T10:04:27.575 INFO:tasks.workunit.client.1.smithi107.stdout:6/840: mknod d0/d3d/d14/d21/d8a/dee/d112/c12c 0 2024-09-10T10:04:27.576 INFO:tasks.workunit.client.0.smithi071.stdout:0/892: dread d11/d30/d70/d128/f135 [0,4194304] 0 2024-09-10T10:04:27.577 INFO:tasks.workunit.client.1.smithi107.stdout:0/851: mknod d6/d8/d2f/d2e/d32/c11a 0 2024-09-10T10:04:27.577 INFO:tasks.workunit.client.0.smithi071.stdout:2/843: mkdir d8/db6/d11b 0 2024-09-10T10:04:27.578 INFO:tasks.workunit.client.0.smithi071.stdout:8/792: fsync d5/df/d74/fe6 0 2024-09-10T10:04:27.579 INFO:tasks.workunit.client.1.smithi107.stdout:2/815: creat d3/d8f/f11e x:0 0 0 2024-09-10T10:04:27.579 INFO:tasks.workunit.client.1.smithi107.stdout:5/870: dwrite de/d20/d2b/d4b/d5e/f93 [0,4194304] 0 2024-09-10T10:04:27.583 INFO:tasks.workunit.client.0.smithi071.stdout:4/671: mknod db/d15/d17/cde 0 2024-09-10T10:04:27.584 INFO:tasks.workunit.client.1.smithi107.stdout:2/816: readlink d3/d21/l2b 0 2024-09-10T10:04:27.584 INFO:tasks.workunit.client.1.smithi107.stdout:9/795: mkdir d5/d7/d1d/d9b/dab/d57/d87/d27/d10a 0 2024-09-10T10:04:27.585 INFO:tasks.workunit.client.0.smithi071.stdout:8/793: chown d5/df/d1d/d86/l1a 65872 1 2024-09-10T10:04:27.587 INFO:tasks.workunit.client.0.smithi071.stdout:0/893: truncate d11/d22/f4f 4546577 0 2024-09-10T10:04:27.589 INFO:tasks.workunit.client.1.smithi107.stdout:2/817: creat d3/da/df/d20/d36/d39/da3/ddb/f11f x:0 0 0 2024-09-10T10:04:27.590 INFO:tasks.workunit.client.0.smithi071.stdout:8/794: stat d5/df/d1e/d38/l72 0 2024-09-10T10:04:27.591 INFO:tasks.workunit.client.0.smithi071.stdout:5/715: dread dc/df/d17/d8d/fcd [0,4194304] 0 2024-09-10T10:04:27.591 INFO:tasks.workunit.client.1.smithi107.stdout:2/818: read - d3/da/df/d20/d36/d39/da3/ddb/f11f zero size 2024-09-10T10:04:27.591 INFO:tasks.workunit.client.1.smithi107.stdout:9/796: rename d5/d7/d1d/d29/db4/fc0 to d5/d7/d1d/d29/db4/df0/f10b 0 2024-09-10T10:04:27.592 INFO:tasks.workunit.client.0.smithi071.stdout:7/925: dwrite d9/ddb/d12e/d136/d108/d10c/d118/fee [0,4194304] 0 2024-09-10T10:04:27.593 INFO:tasks.workunit.client.1.smithi107.stdout:5/871: dwrite de/d9c/fa3 [4194304,4194304] 0 2024-09-10T10:04:27.593 INFO:tasks.workunit.client.0.smithi071.stdout:5/716: dread - dc/d53/d6a/fd6 zero size 2024-09-10T10:04:27.595 INFO:tasks.workunit.client.0.smithi071.stdout:2/844: getdents d8/d87/dc4 0 2024-09-10T10:04:27.597 INFO:tasks.workunit.client.1.smithi107.stdout:2/819: creat d3/d8f/df4/f120 x:0 0 0 2024-09-10T10:04:27.597 INFO:tasks.workunit.client.0.smithi071.stdout:4/672: creat db/d15/d26/d43/d4d/d9f/da6/fdf x:0 0 0 2024-09-10T10:04:27.599 INFO:tasks.workunit.client.1.smithi107.stdout:5/872: read de/d20/d2b/d4b/d5e/f94 [7300,89200] 0 2024-09-10T10:04:27.600 INFO:tasks.workunit.client.0.smithi071.stdout:2/845: chown d8/d87/c4f 16175 1 2024-09-10T10:04:27.601 INFO:tasks.workunit.client.0.smithi071.stdout:5/717: fdatasync dc/df/d17/f2b 0 2024-09-10T10:04:27.601 INFO:tasks.workunit.client.1.smithi107.stdout:6/841: dwrite d0/d3d/d14/d42/f8b [0,4194304] 0 2024-09-10T10:04:27.603 INFO:tasks.workunit.client.0.smithi071.stdout:0/894: dwrite d11/d30/d70/fce [0,4194304] 0 2024-09-10T10:04:27.604 INFO:tasks.workunit.client.0.smithi071.stdout:7/926: mkdir d9/ddb/d12e/d136/d108/d10c/d118/d105/d144/d145 0 2024-09-10T10:04:27.605 INFO:tasks.workunit.client.1.smithi107.stdout:5/873: mkdir de/d20/d2b/d106/d11f 0 2024-09-10T10:04:27.606 INFO:tasks.workunit.client.0.smithi071.stdout:4/673: mknod db/da0/ce0 0 2024-09-10T10:04:27.607 INFO:tasks.workunit.client.1.smithi107.stdout:6/842: mknod d0/d3d/d14/d42/d88/c12d 0 2024-09-10T10:04:27.607 INFO:tasks.workunit.client.0.smithi071.stdout:6/659: dread d4/da/f82 [0,4194304] 0 2024-09-10T10:04:27.610 INFO:tasks.workunit.client.0.smithi071.stdout:6/660: read - d4/fc5 zero size 2024-09-10T10:04:27.612 INFO:tasks.workunit.client.1.smithi107.stdout:5/874: mknod de/db3/db6/c120 0 2024-09-10T10:04:27.612 INFO:tasks.workunit.client.0.smithi071.stdout:0/895: mkdir d11/d22/d40/df6/d13e 0 2024-09-10T10:04:27.612 INFO:tasks.workunit.client.0.smithi071.stdout:5/718: write dc/d4a/fb7 [3184089,65322] 0 2024-09-10T10:04:27.613 INFO:tasks.workunit.client.0.smithi071.stdout:7/927: unlink d9/d1a/d1d/f61 0 2024-09-10T10:04:27.615 INFO:tasks.workunit.client.1.smithi107.stdout:5/875: symlink de/d20/d2b/d4b/d8c/l121 0 2024-09-10T10:04:27.616 INFO:tasks.workunit.client.1.smithi107.stdout:2/820: dread d3/da/d66/d91/dea/ffe [0,4194304] 0 2024-09-10T10:04:27.617 INFO:tasks.workunit.client.0.smithi071.stdout:4/674: rename db/da0/fa8 to db/d15/d17/d4e/dc0/dc2/fe1 0 2024-09-10T10:04:27.617 INFO:tasks.workunit.client.0.smithi071.stdout:4/675: readlink db/d1d/d61/lc6 0 2024-09-10T10:04:27.618 INFO:tasks.workunit.client.0.smithi071.stdout:4/676: readlink db/lf 0 2024-09-10T10:04:27.619 INFO:tasks.workunit.client.1.smithi107.stdout:5/876: symlink de/d20/d2b/d4b/d5e/d116/d5c/d6d/df1/l122 0 2024-09-10T10:04:27.619 INFO:tasks.workunit.client.0.smithi071.stdout:0/896: creat d11/d1e/dfa/d79/f13f x:0 0 0 2024-09-10T10:04:27.620 INFO:tasks.workunit.client.1.smithi107.stdout:2/821: mknod d3/d21/d95/c121 0 2024-09-10T10:04:27.621 INFO:tasks.workunit.client.0.smithi071.stdout:5/719: chown dc/df/d3e/c82 82 1 2024-09-10T10:04:27.621 INFO:tasks.workunit.client.0.smithi071.stdout:0/897: write d11/d30/d70/fa7 [2157404,45637] 0 2024-09-10T10:04:27.621 INFO:tasks.workunit.client.1.smithi107.stdout:2/822: rmdir d3/d21/d79 39 2024-09-10T10:04:27.622 INFO:tasks.workunit.client.1.smithi107.stdout:5/877: truncate de/d20/d2b/f39 3585688 0 2024-09-10T10:04:27.623 INFO:tasks.workunit.client.1.smithi107.stdout:5/878: chown de/db3/fbf 932998112 1 2024-09-10T10:04:27.624 INFO:tasks.workunit.client.1.smithi107.stdout:5/879: dread - de/d20/d2b/d4b/d5e/d116/d7e/f11b zero size 2024-09-10T10:04:27.625 INFO:tasks.workunit.client.0.smithi071.stdout:7/928: getdents d9/d15/d1f/d74/da1/dcf/d129 0 2024-09-10T10:04:27.626 INFO:tasks.workunit.client.1.smithi107.stdout:5/880: readlink de/d20/d2b/d4b/d5e/d9a/la1 0 2024-09-10T10:04:27.626 INFO:tasks.workunit.client.0.smithi071.stdout:3/784: truncate d3/d1c/d3c/da1/d3a/dc0/fcb 527667 0 2024-09-10T10:04:27.626 INFO:tasks.workunit.client.1.smithi107.stdout:5/881: chown de/d20/c45 247456 1 2024-09-10T10:04:27.629 INFO:tasks.workunit.client.1.smithi107.stdout:5/882: mkdir de/d20/d2b/d4b/d5e/d116/d4e/d89/d99/d123 0 2024-09-10T10:04:27.630 INFO:tasks.workunit.client.1.smithi107.stdout:5/883: stat de/fff 0 2024-09-10T10:04:27.631 INFO:tasks.workunit.client.0.smithi071.stdout:2/846: rename d8/d87/d33/cba to d8/d87/d51/c11c 0 2024-09-10T10:04:27.634 INFO:tasks.workunit.client.0.smithi071.stdout:3/785: creat d3/d1c/d3c/da1/d5d/d7a/f10f x:0 0 0 2024-09-10T10:04:27.634 INFO:tasks.workunit.client.0.smithi071.stdout:0/898: rmdir d11/d22 39 2024-09-10T10:04:27.636 INFO:tasks.workunit.client.0.smithi071.stdout:7/929: dread d9/d15/d40/d80/dd6/fd5 [0,4194304] 0 2024-09-10T10:04:27.637 INFO:tasks.workunit.client.0.smithi071.stdout:8/795: dread d5/df/d1e/d38/ffd [0,4194304] 0 2024-09-10T10:04:27.638 INFO:tasks.workunit.client.0.smithi071.stdout:8/796: chown d5/df/d67/fe1 4536393 1 2024-09-10T10:04:27.638 INFO:tasks.workunit.client.1.smithi107.stdout:2/823: write d3/da/d1e/d40/d8a/d7f/f63 [4449240,108037] 0 2024-09-10T10:04:27.639 INFO:tasks.workunit.client.0.smithi071.stdout:8/797: stat d5/df/d1d/d86/d75/f87 0 2024-09-10T10:04:27.640 INFO:tasks.workunit.client.1.smithi107.stdout:6/843: dwrite d0/f2c [4194304,4194304] 0 2024-09-10T10:04:27.641 INFO:tasks.workunit.client.1.smithi107.stdout:2/824: chown d3/da/df/d20/d36/d39/da3/ddb/cfc 999474718 1 2024-09-10T10:04:27.641 INFO:tasks.workunit.client.1.smithi107.stdout:5/884: truncate de/d20/d2b/d4b/d5e/f93 3254244 0 2024-09-10T10:04:27.643 INFO:tasks.workunit.client.1.smithi107.stdout:5/885: write de/d20/d2b/d4b/d5e/d116/d7e/fab [609897,97701] 0 2024-09-10T10:04:27.644 INFO:tasks.workunit.client.1.smithi107.stdout:6/844: fsync d0/d3d/d14/d17/f3b 0 2024-09-10T10:04:27.644 INFO:tasks.workunit.client.1.smithi107.stdout:2/825: mknod d3/da/d1e/d27/d5b/c122 0 2024-09-10T10:04:27.645 INFO:tasks.workunit.client.0.smithi071.stdout:7/930: dwrite d9/d15/d40/f143 [0,4194304] 0 2024-09-10T10:04:27.646 INFO:tasks.workunit.client.1.smithi107.stdout:6/845: read d0/d3d/d14/d17/f36 [6287376,96003] 0 2024-09-10T10:04:27.649 INFO:tasks.workunit.client.1.smithi107.stdout:5/886: mknod de/d20/d2b/d4b/c124 0 2024-09-10T10:04:27.655 INFO:tasks.workunit.client.1.smithi107.stdout:2/826: mkdir d3/da/df/d20/d36/d39/da3/d123 0 2024-09-10T10:04:27.656 INFO:tasks.workunit.client.0.smithi071.stdout:5/720: dread dc/df/f19 [0,4194304] 0 2024-09-10T10:04:27.657 INFO:tasks.workunit.client.1.smithi107.stdout:6/846: symlink d0/d3d/d14/d21/d8a/l12e 0 2024-09-10T10:04:27.658 INFO:tasks.workunit.client.1.smithi107.stdout:2/827: creat d3/da/df/d20/d36/d4f/d92/f124 x:0 0 0 2024-09-10T10:04:27.660 INFO:tasks.workunit.client.1.smithi107.stdout:2/828: mkdir d3/da/d1e/d5f/dad/d125 0 2024-09-10T10:04:27.662 INFO:tasks.workunit.client.1.smithi107.stdout:2/829: truncate d3/f31 879535 0 2024-09-10T10:04:27.663 INFO:tasks.workunit.client.1.smithi107.stdout:2/830: chown d3/da/d1e/d40/d8a/d7f 188105 1 2024-09-10T10:04:27.664 INFO:tasks.workunit.client.1.smithi107.stdout:2/831: mkdir d3/da/df/d20/d36/d39/d126 0 2024-09-10T10:04:27.667 INFO:tasks.workunit.client.1.smithi107.stdout:2/832: creat d3/da/df/f127 x:0 0 0 2024-09-10T10:04:27.667 INFO:tasks.workunit.client.1.smithi107.stdout:5/887: write de/d20/d2b/d4b/d5e/d116/d4e/f70 [5007958,56318] 0 2024-09-10T10:04:27.669 INFO:tasks.workunit.client.1.smithi107.stdout:6/847: write d0/d3d/d14/d17/d24/df3/dbe/fd0 [774226,130574] 0 2024-09-10T10:04:27.692 INFO:tasks.workunit.client.1.smithi107.stdout:2/833: unlink d3/da/d1e/d40/d8a/d7f/d55/fb6 0 2024-09-10T10:04:27.693 INFO:tasks.workunit.client.0.smithi071.stdout:6/661: write d4/f6c [5027484,95845] 0 2024-09-10T10:04:27.693 INFO:tasks.workunit.client.1.smithi107.stdout:2/834: write d3/da/d66/db7/f11a [624389,93969] 0 2024-09-10T10:04:27.695 INFO:tasks.workunit.client.1.smithi107.stdout:6/848: symlink d0/d3d/d14/d21/d8a/dee/l12f 0 2024-09-10T10:04:27.695 INFO:tasks.workunit.client.1.smithi107.stdout:4/950: sync 2024-09-10T10:04:27.696 INFO:tasks.workunit.client.0.smithi071.stdout:3/786: dread d3/d1c/d3c/da1/fa9 [0,4194304] 0 2024-09-10T10:04:27.697 INFO:tasks.workunit.client.0.smithi071.stdout:8/798: creat d5/d36/f114 x:0 0 0 2024-09-10T10:04:27.697 INFO:tasks.workunit.client.1.smithi107.stdout:5/888: getdents de/d20/d2b/d4b/d5e/d116/d5c/d6d/df1 0 2024-09-10T10:04:27.698 INFO:tasks.workunit.client.1.smithi107.stdout:6/849: readlink d0/d3d/d14/l15 0 2024-09-10T10:04:27.699 INFO:tasks.workunit.client.0.smithi071.stdout:4/677: write db/d1d/fd6 [1536905,10112] 0 2024-09-10T10:04:27.700 INFO:tasks.workunit.client.0.smithi071.stdout:7/931: creat d9/d2c/f146 x:0 0 0 2024-09-10T10:04:27.700 INFO:tasks.workunit.client.1.smithi107.stdout:2/835: rename d3/da/df/d20/d36/d4f/d92/f124 to d3/da/d1e/d40/d8a/d7f/d55/d85/d7c/f128 0 2024-09-10T10:04:27.701 INFO:tasks.workunit.client.0.smithi071.stdout:5/721: symlink dc/df/d17/d8d/de4/lf9 0 2024-09-10T10:04:27.702 INFO:tasks.workunit.client.0.smithi071.stdout:4/678: readlink db/d15/d26/d43/d4d/l80 0 2024-09-10T10:04:27.702 INFO:tasks.workunit.client.1.smithi107.stdout:6/850: unlink d0/d3d/d14/d42/led 0 2024-09-10T10:04:27.703 INFO:tasks.workunit.client.1.smithi107.stdout:4/951: creat d0/d1f/f144 x:0 0 0 2024-09-10T10:04:27.704 INFO:tasks.workunit.client.0.smithi071.stdout:2/847: getdents d8/d4a/d104/d65 0 2024-09-10T10:04:27.705 INFO:tasks.workunit.client.0.smithi071.stdout:7/932: mknod d9/d1a/dc8/c147 0 2024-09-10T10:04:27.706 INFO:tasks.workunit.client.0.smithi071.stdout:3/787: dwrite d3/d1c/d3c/da1/d5d/d7a/fe1 [0,4194304] 0 2024-09-10T10:04:27.707 INFO:tasks.workunit.client.1.smithi107.stdout:5/889: dwrite de/db3/fd1 [0,4194304] 0 2024-09-10T10:04:27.707 INFO:tasks.workunit.client.1.smithi107.stdout:4/952: chown d0/d40/d6d/d8a 58973331 1 2024-09-10T10:04:27.707 INFO:tasks.workunit.client.1.smithi107.stdout:2/836: mkdir d3/d21/d79/d129 0 2024-09-10T10:04:27.709 INFO:tasks.workunit.client.0.smithi071.stdout:4/679: chown db/c6e 64106 1 2024-09-10T10:04:27.709 INFO:tasks.workunit.client.1.smithi107.stdout:5/890: chown de/d20/d2b/d4b/d5e/d116/d5c/d6d 3 1 2024-09-10T10:04:27.710 INFO:tasks.workunit.client.0.smithi071.stdout:5/722: unlink dc/df/d3e/d5a/f88 0 2024-09-10T10:04:27.713 INFO:tasks.workunit.client.0.smithi071.stdout:0/899: creat d11/d1e/dfa/d5f/f140 x:0 0 0 2024-09-10T10:04:27.713 INFO:tasks.workunit.client.0.smithi071.stdout:4/680: write db/d15/d17/d4e/fce [826783,5297] 0 2024-09-10T10:04:27.718 INFO:tasks.workunit.client.0.smithi071.stdout:6/662: getdents d4/da 0 2024-09-10T10:04:27.719 INFO:tasks.workunit.client.0.smithi071.stdout:2/848: creat d8/d87/dad/f11d x:0 0 0 2024-09-10T10:04:27.721 INFO:tasks.workunit.client.1.smithi107.stdout:5/891: mkdir de/d20/d2b/d4b/d8c/d125 0 2024-09-10T10:04:27.721 INFO:tasks.workunit.client.0.smithi071.stdout:4/681: creat db/d15/d26/d43/d4d/fe2 x:0 0 0 2024-09-10T10:04:27.724 INFO:tasks.workunit.client.1.smithi107.stdout:2/837: creat d3/da/d66/d91/f12a x:0 0 0 2024-09-10T10:04:27.724 INFO:tasks.workunit.client.1.smithi107.stdout:6/851: dread d0/d3d/d14/d17/fb4 [0,4194304] 0 2024-09-10T10:04:27.798 INFO:tasks.workunit.client.0.smithi071.stdout:2/849: symlink d8/d4a/d104/l11e 0 2024-09-10T10:04:27.799 INFO:tasks.workunit.client.1.smithi107.stdout:5/892: rename de/d20/c45 to de/d20/d2b/d4b/d8c/c126 0 2024-09-10T10:04:27.799 INFO:tasks.workunit.client.1.smithi107.stdout:4/953: write d0/d40/d6d/ff0 [6194602,54284] 0 2024-09-10T10:04:27.801 INFO:tasks.workunit.client.1.smithi107.stdout:5/893: readlink de/d20/d2b/d4b/lfc 0 2024-09-10T10:04:27.803 INFO:tasks.workunit.client.0.smithi071.stdout:2/850: chown d8/d87/d49/d66/l8b 98055961 1 2024-09-10T10:04:27.803 INFO:tasks.workunit.client.0.smithi071.stdout:6/663: symlink d4/da/df/d2e/d3a/d40/ld2 0 2024-09-10T10:04:27.805 INFO:tasks.workunit.client.0.smithi071.stdout:3/788: dread d3/d1c/d3c/da1/d5d/da5/db3/fd5 [0,4194304] 0 2024-09-10T10:04:27.805 INFO:tasks.workunit.client.0.smithi071.stdout:7/933: dwrite d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/f59 [0,4194304] 0 2024-09-10T10:04:27.805 INFO:tasks.workunit.client.0.smithi071.stdout:4/682: creat db/d15/d4b/fe3 x:0 0 0 2024-09-10T10:04:27.806 INFO:tasks.workunit.client.1.smithi107.stdout:6/852: link d0/d3d/d14/d21/d8a/dee/l10a d0/d3d/d14/d42/d88/l130 0 2024-09-10T10:04:27.807 INFO:tasks.workunit.client.0.smithi071.stdout:2/851: stat d8/d87/dc4/dea 0 2024-09-10T10:04:27.807 INFO:tasks.workunit.client.0.smithi071.stdout:5/723: dwrite dc/d53/db2/fc4 [4194304,4194304] 0 2024-09-10T10:04:27.808 INFO:tasks.workunit.client.1.smithi107.stdout:6/853: write d0/d3d/d14/d21/f33 [3297041,26430] 0 2024-09-10T10:04:27.812 INFO:tasks.workunit.client.1.smithi107.stdout:6/854: truncate d0/d3d/d14/d42/f7a 3753662 0 2024-09-10T10:04:27.816 INFO:tasks.workunit.client.0.smithi071.stdout:6/664: symlink d4/da/df/d2e/ld3 0 2024-09-10T10:04:27.816 INFO:tasks.workunit.client.0.smithi071.stdout:7/934: creat d9/d15/d1f/db9/f148 x:0 0 0 2024-09-10T10:04:27.816 INFO:tasks.workunit.client.1.smithi107.stdout:4/954: truncate d0/d40/d57/fd6 2118062 0 2024-09-10T10:04:27.817 INFO:tasks.workunit.client.0.smithi071.stdout:6/665: stat d4/da/f82 0 2024-09-10T10:04:27.817 INFO:tasks.workunit.client.0.smithi071.stdout:2/852: symlink d8/d87/d51/l11f 0 2024-09-10T10:04:27.817 INFO:tasks.workunit.client.0.smithi071.stdout:7/935: stat d9/d15/d1f/d74/da1/dcf/de1 0 2024-09-10T10:04:27.820 INFO:tasks.workunit.client.0.smithi071.stdout:6/666: write d4/d61/d83/da8/f5c [10864,60262] 0 2024-09-10T10:04:27.820 INFO:tasks.workunit.client.0.smithi071.stdout:7/936: stat d9/d15/d40/d80/ddd/f127 0 2024-09-10T10:04:27.820 INFO:tasks.workunit.client.0.smithi071.stdout:0/900: dread d11/d22/d40/f44 [0,4194304] 0 2024-09-10T10:04:27.820 INFO:tasks.workunit.client.1.smithi107.stdout:6/855: rename d0/d3d/d14/d42/d88/l130 to d0/d3d/d14/d21/d8a/d8d/l131 0 2024-09-10T10:04:27.821 INFO:tasks.workunit.client.0.smithi071.stdout:2/853: write d8/d87/d49/f100 [613443,82071] 0 2024-09-10T10:04:27.822 INFO:tasks.workunit.client.0.smithi071.stdout:3/789: link d3/d49/d2f/ld4 d3/d49/d34/d67/l110 0 2024-09-10T10:04:27.825 INFO:tasks.workunit.client.1.smithi107.stdout:4/955: creat d0/d40/d57/f145 x:0 0 0 2024-09-10T10:04:27.825 INFO:tasks.workunit.client.1.smithi107.stdout:6/856: dread d0/f2c [4194304,4194304] 0 2024-09-10T10:04:27.825 INFO:tasks.workunit.client.0.smithi071.stdout:5/724: creat dc/df/d3e/d5a/d80/d8a/da3/ffa x:0 0 0 2024-09-10T10:04:27.826 INFO:tasks.workunit.client.0.smithi071.stdout:2/854: mkdir d8/d87/d33/d53/d120 0 2024-09-10T10:04:27.827 INFO:tasks.workunit.client.1.smithi107.stdout:6/857: chown d0/d3d/d14/d42/fcc 61 1 2024-09-10T10:04:27.827 INFO:tasks.workunit.client.1.smithi107.stdout:4/956: chown d0/d40/d57/d76/d77/da1/f5b 4 1 2024-09-10T10:04:27.829 INFO:tasks.workunit.client.1.smithi107.stdout:6/858: write d0/d3d/d14/d17/d24/ff6 [4519269,27883] 0 2024-09-10T10:04:27.831 INFO:tasks.workunit.client.1.smithi107.stdout:2/838: dread d3/da/d1e/d40/d8a/f89 [0,4194304] 0 2024-09-10T10:04:27.831 INFO:tasks.workunit.client.1.smithi107.stdout:6/859: stat d0/d3d/d14/d21/d8a/dee/df1 0 2024-09-10T10:04:27.831 INFO:tasks.workunit.client.1.smithi107.stdout:4/957: link d0/d40/d57/d76/d77/da1/f105 d0/d40/d57/d76/d77/f146 0 2024-09-10T10:04:27.833 INFO:tasks.workunit.client.1.smithi107.stdout:6/860: symlink d0/d3d/d14/d9f/l132 0 2024-09-10T10:04:27.835 INFO:tasks.workunit.client.1.smithi107.stdout:2/839: rename d3/d21/d79 to d3/da/df/d20/d36/d39/da3/ddb/d12b 0 2024-09-10T10:04:27.836 INFO:tasks.workunit.client.1.smithi107.stdout:4/958: creat d0/d40/d57/d76/d77/d8d/f147 x:0 0 0 2024-09-10T10:04:27.837 INFO:tasks.workunit.client.1.smithi107.stdout:6/861: fdatasync d0/d3d/d14/d17/fb4 0 2024-09-10T10:04:27.838 INFO:tasks.workunit.client.1.smithi107.stdout:2/840: fdatasync d3/d8f/df4/d102/fdc 0 2024-09-10T10:04:27.843 INFO:tasks.workunit.client.1.smithi107.stdout:6/862: link d0/d3d/d14/d42/d88/l10b d0/d3d/d14/d21/d124/l133 0 2024-09-10T10:04:27.844 INFO:tasks.workunit.client.1.smithi107.stdout:6/863: chown d0/d3d/d14/d21/f7f 1 1 2024-09-10T10:04:27.847 INFO:tasks.workunit.client.0.smithi071.stdout:0/901: dread d11/d1e/dfa/d79/ddc/f120 [0,4194304] 0 2024-09-10T10:04:27.849 INFO:tasks.workunit.client.1.smithi107.stdout:6/864: getdents d0/d3d/d14/d21/d8a/da2 0 2024-09-10T10:04:27.850 INFO:tasks.workunit.client.1.smithi107.stdout:6/865: read d0/d70/ff8 [608078,8835] 0 2024-09-10T10:04:27.850 INFO:tasks.workunit.client.0.smithi071.stdout:0/902: dread d11/d1e/dfa/d5f/fd6 [0,4194304] 0 2024-09-10T10:04:27.855 INFO:tasks.workunit.client.1.smithi107.stdout:4/959: dwrite d0/d1f/d20/f17 [0,4194304] 0 2024-09-10T10:04:27.855 INFO:tasks.workunit.client.1.smithi107.stdout:6/866: dread d0/d70/faf [0,4194304] 0 2024-09-10T10:04:27.856 INFO:tasks.workunit.client.1.smithi107.stdout:4/960: chown d0/d6b/l112 3 1 2024-09-10T10:04:27.857 INFO:tasks.workunit.client.1.smithi107.stdout:6/867: readlink d0/d3d/d14/l65 0 2024-09-10T10:04:27.859 INFO:tasks.workunit.client.1.smithi107.stdout:4/961: truncate d0/d40/d57/d4f/fa0 221459 0 2024-09-10T10:04:27.861 INFO:tasks.workunit.client.1.smithi107.stdout:4/962: creat d0/d1f/d20/d47/d8c/dfe/dff/f148 x:0 0 0 2024-09-10T10:04:27.865 INFO:tasks.workunit.client.1.smithi107.stdout:4/963: read d0/fa [355293,56369] 0 2024-09-10T10:04:27.868 INFO:tasks.workunit.client.1.smithi107.stdout:4/964: rmdir d0/d40/d57/d76/d77/d8d/d124 0 2024-09-10T10:04:27.869 INFO:tasks.workunit.client.1.smithi107.stdout:4/965: write d0/d1f/d20/d47/d8c/dfe/dff/f148 [433828,87702] 0 2024-09-10T10:04:27.870 INFO:tasks.workunit.client.1.smithi107.stdout:4/966: write d0/d6b/d9d/fc5 [3647532,51790] 0 2024-09-10T10:04:27.877 INFO:tasks.workunit.client.1.smithi107.stdout:4/967: write d0/d1f/d20/f4c [53451,37102] 0 2024-09-10T10:04:27.880 INFO:tasks.workunit.client.1.smithi107.stdout:4/968: unlink d0/d40/d57/d76/d77/da1/la7 0 2024-09-10T10:04:27.882 INFO:tasks.workunit.client.1.smithi107.stdout:4/969: symlink d0/d40/d57/d76/d77/d10d/d133/l149 0 2024-09-10T10:04:27.883 INFO:tasks.workunit.client.1.smithi107.stdout:4/970: creat d0/d40/db3/f14a x:0 0 0 2024-09-10T10:04:27.887 INFO:tasks.workunit.client.1.smithi107.stdout:4/971: link d0/d1f/d20/d47/dbe/cf9 d0/d40/d57/d76/c14b 0 2024-09-10T10:04:27.888 INFO:tasks.workunit.client.1.smithi107.stdout:4/972: creat d0/d6b/f14c x:0 0 0 2024-09-10T10:04:27.889 INFO:tasks.workunit.client.1.smithi107.stdout:4/973: readlink d0/d40/d57/d4f/lba 0 2024-09-10T10:04:27.900 INFO:tasks.workunit.client.0.smithi071.stdout:1/785: sync 2024-09-10T10:04:27.900 INFO:tasks.workunit.client.0.smithi071.stdout:8/799: sync 2024-09-10T10:04:27.903 INFO:tasks.workunit.client.0.smithi071.stdout:8/800: truncate d5/df/d1d/d86/f9c 673984 0 2024-09-10T10:04:27.904 INFO:tasks.workunit.client.0.smithi071.stdout:1/786: read d1/d57/f6b [1942285,78905] 0 2024-09-10T10:04:27.906 INFO:tasks.workunit.client.0.smithi071.stdout:0/903: mknod d11/d1e/dfa/d79/ddc/c141 0 2024-09-10T10:04:27.907 INFO:tasks.workunit.client.0.smithi071.stdout:8/801: chown d5/df/d1d/d86/d75/fc9 14502 1 2024-09-10T10:04:27.908 INFO:tasks.workunit.client.0.smithi071.stdout:4/683: dwrite db/d15/d4b/f4f [4194304,4194304] 0 2024-09-10T10:04:27.909 INFO:tasks.workunit.client.0.smithi071.stdout:1/787: creat d1/d3f/d115/f119 x:0 0 0 2024-09-10T10:04:27.909 INFO:tasks.workunit.client.0.smithi071.stdout:5/725: rename dc/d53/fdd to dc/df/dd7/d87/ffb 0 2024-09-10T10:04:27.910 INFO:tasks.workunit.client.0.smithi071.stdout:2/855: write d8/d24/f5c [2079421,96893] 0 2024-09-10T10:04:27.910 INFO:tasks.workunit.client.0.smithi071.stdout:8/802: read d5/f45 [2253425,56164] 0 2024-09-10T10:04:27.912 INFO:tasks.workunit.client.0.smithi071.stdout:6/667: getdents d4/da/df 0 2024-09-10T10:04:27.913 INFO:tasks.workunit.client.0.smithi071.stdout:3/790: write d3/f21 [867575,57935] 0 2024-09-10T10:04:27.914 INFO:tasks.workunit.client.0.smithi071.stdout:1/788: creat d1/d3f/f11a x:0 0 0 2024-09-10T10:04:27.914 INFO:tasks.workunit.client.0.smithi071.stdout:4/684: rmdir db/d15/d17/d24/db6 39 2024-09-10T10:04:27.986 INFO:tasks.workunit.client.0.smithi071.stdout:7/937: dwrite d9/d15/fb3 [0,4194304] 0 2024-09-10T10:04:27.987 INFO:tasks.workunit.client.1.smithi107.stdout:7/754: sync 2024-09-10T10:04:27.987 INFO:tasks.workunit.client.0.smithi071.stdout:2/856: creat d8/db6/de7/f121 x:0 0 0 2024-09-10T10:04:27.989 INFO:tasks.workunit.client.0.smithi071.stdout:8/803: mkdir d5/df/d1d/d86/d75/dcd/d115 0 2024-09-10T10:04:27.990 INFO:tasks.workunit.client.1.smithi107.stdout:7/755: creat d0/d8/dc/ff6 x:0 0 0 2024-09-10T10:04:27.992 INFO:tasks.workunit.client.0.smithi071.stdout:6/668: unlink d4/da/df/d2e/d3a/d51/d64/fac 0 2024-09-10T10:04:27.992 INFO:tasks.workunit.client.1.smithi107.stdout:7/756: mknod d0/d20/d72/cf7 0 2024-09-10T10:04:27.993 INFO:tasks.workunit.client.0.smithi071.stdout:7/938: write d9/f34 [4721678,72879] 0 2024-09-10T10:04:27.993 INFO:tasks.workunit.client.0.smithi071.stdout:3/791: mknod d3/d1c/d3c/da1/d42/d4a/d60/d78/c111 0 2024-09-10T10:04:27.994 INFO:tasks.workunit.client.0.smithi071.stdout:4/685: mkdir db/d15/de4 0 2024-09-10T10:04:27.995 INFO:tasks.workunit.client.0.smithi071.stdout:1/789: getdents d1/d21/d3d/d9a/d101 0 2024-09-10T10:04:27.995 INFO:tasks.workunit.client.0.smithi071.stdout:8/804: chown d5/df/d1e/d38/d9f 7432167 1 2024-09-10T10:04:27.995 INFO:tasks.workunit.client.1.smithi107.stdout:7/757: rmdir d0/d20/ddd 39 2024-09-10T10:04:27.997 INFO:tasks.workunit.client.0.smithi071.stdout:0/904: dwrite d11/d1e/dfa/fc9 [0,4194304] 0 2024-09-10T10:04:27.997 INFO:tasks.workunit.client.1.smithi107.stdout:7/758: chown d0/d1b/d4d/d69/d97/l77 97979 1 2024-09-10T10:04:27.998 INFO:tasks.workunit.client.1.smithi107.stdout:7/759: chown d0/d1b/d9d/fce 977045 1 2024-09-10T10:04:27.998 INFO:tasks.workunit.client.0.smithi071.stdout:6/669: getdents d4/da 0 2024-09-10T10:04:28.000 INFO:tasks.workunit.client.1.smithi107.stdout:7/760: rmdir d0/d8/dc/d2c/d47 39 2024-09-10T10:04:28.001 INFO:tasks.workunit.client.1.smithi107.stdout:7/761: rmdir d0/d20 39 2024-09-10T10:04:28.001 INFO:tasks.workunit.client.0.smithi071.stdout:4/686: read - db/d15/d26/f91 zero size 2024-09-10T10:04:28.002 INFO:tasks.workunit.client.0.smithi071.stdout:3/792: mkdir d3/d49/d34/d67/d112 0 2024-09-10T10:04:28.003 INFO:tasks.workunit.client.0.smithi071.stdout:2/857: link d8/d87/d33/c4c d8/d87/d49/d66/c122 0 2024-09-10T10:04:28.004 INFO:tasks.workunit.client.0.smithi071.stdout:6/670: readlink d4/da/df/d2e/d3a/lb0 0 2024-09-10T10:04:28.005 INFO:tasks.workunit.client.1.smithi107.stdout:7/762: mkdir d0/d8/d56/dcc/de7/df8 0 2024-09-10T10:04:28.005 INFO:tasks.workunit.client.0.smithi071.stdout:4/687: readlink db/d15/d17/d24/l9b 0 2024-09-10T10:04:28.006 INFO:tasks.workunit.client.0.smithi071.stdout:0/905: rename d11/d1e/f130 to d11/d22/d31/d72/df3/f142 0 2024-09-10T10:04:28.007 INFO:tasks.workunit.client.0.smithi071.stdout:6/671: write d4/d1c/fbb [2607341,37213] 0 2024-09-10T10:04:28.007 INFO:tasks.workunit.client.0.smithi071.stdout:7/939: mkdir d9/ddb/d12e/d136/d108/d10c/d118/d105/d12a/d149 0 2024-09-10T10:04:28.008 INFO:tasks.workunit.client.0.smithi071.stdout:6/672: chown d4/d1c 61081537 1 2024-09-10T10:04:28.009 INFO:tasks.workunit.client.0.smithi071.stdout:3/793: symlink d3/d49/d34/l113 0 2024-09-10T10:04:28.010 INFO:tasks.workunit.client.0.smithi071.stdout:2/858: mknod d8/d87/d33/d41/d56/d107/c123 0 2024-09-10T10:04:28.011 INFO:tasks.workunit.client.0.smithi071.stdout:8/805: dread d5/df/d1e/d38/ffd [0,4194304] 0 2024-09-10T10:04:28.012 INFO:tasks.workunit.client.1.smithi107.stdout:7/763: read d0/d1b/d4d/fed [2626511,101701] 0 2024-09-10T10:04:28.012 INFO:tasks.workunit.client.0.smithi071.stdout:4/688: fsync db/d15/d17/f3d 0 2024-09-10T10:04:28.013 INFO:tasks.workunit.client.0.smithi071.stdout:2/859: stat d8/d4a/d104/c9f 0 2024-09-10T10:04:28.014 INFO:tasks.workunit.client.0.smithi071.stdout:3/794: symlink d3/d1c/d3c/da1/d5d/d8f/l114 0 2024-09-10T10:04:28.014 INFO:tasks.workunit.client.0.smithi071.stdout:7/940: fsync d9/d15/d1f/d74/d9b/fb1 0 2024-09-10T10:04:28.018 INFO:tasks.workunit.client.0.smithi071.stdout:2/860: creat d8/d4a/f124 x:0 0 0 2024-09-10T10:04:28.021 INFO:tasks.workunit.client.0.smithi071.stdout:3/795: read d3/f41 [806469,115948] 0 2024-09-10T10:04:28.021 INFO:tasks.workunit.client.0.smithi071.stdout:6/673: link d4/da/f90 d4/da/df/d5e/fd4 0 2024-09-10T10:04:28.022 INFO:tasks.workunit.client.0.smithi071.stdout:8/806: dwrite d5/d36/f41 [4194304,4194304] 0 2024-09-10T10:04:28.024 INFO:tasks.workunit.client.0.smithi071.stdout:8/807: stat d5/d36/d49/d8f/fe5 0 2024-09-10T10:04:28.025 INFO:tasks.workunit.client.0.smithi071.stdout:4/689: fsync db/d15/d4b/f5c 0 2024-09-10T10:04:28.026 INFO:tasks.workunit.client.0.smithi071.stdout:1/790: dread d1/d21/f24 [0,4194304] 0 2024-09-10T10:04:28.026 INFO:tasks.workunit.client.0.smithi071.stdout:7/941: mknod d9/d1a/dc8/d113/c14a 0 2024-09-10T10:04:28.032 INFO:tasks.workunit.client.0.smithi071.stdout:3/796: creat d3/d10/d24/dab/f115 x:0 0 0 2024-09-10T10:04:28.032 INFO:tasks.workunit.client.0.smithi071.stdout:0/906: link d11/d1e/dfa/d79/fca d11/d22/d9a/d106/f143 0 2024-09-10T10:04:28.032 INFO:tasks.workunit.client.0.smithi071.stdout:1/791: fsync d1/d3f/fa3 0 2024-09-10T10:04:28.032 INFO:tasks.workunit.client.0.smithi071.stdout:2/861: mkdir d8/db6/d11b/d125 0 2024-09-10T10:04:28.032 INFO:tasks.workunit.client.0.smithi071.stdout:6/674: symlink d4/da/df/d2e/d3a/d43/ld5 0 2024-09-10T10:04:28.032 INFO:tasks.workunit.client.0.smithi071.stdout:3/797: write d3/d1c/d3c/da1/d3a/f45 [4589549,725] 0 2024-09-10T10:04:28.035 INFO:tasks.workunit.client.0.smithi071.stdout:2/862: chown d8/d87/d33/d41/d4d/d52/fe4 13249 1 2024-09-10T10:04:28.040 INFO:tasks.workunit.client.0.smithi071.stdout:6/675: symlink d4/da/df/d5e/ld6 0 2024-09-10T10:04:28.042 INFO:tasks.workunit.client.0.smithi071.stdout:4/690: creat db/d15/d26/d43/d4d/d77/dd7/fe5 x:0 0 0 2024-09-10T10:04:28.044 INFO:tasks.workunit.client.0.smithi071.stdout:2/863: symlink d8/d24/dda/l126 0 2024-09-10T10:04:28.048 INFO:tasks.workunit.client.1.smithi107.stdout:7/764: dread d0/d20/f3a [0,4194304] 0 2024-09-10T10:04:28.051 INFO:tasks.workunit.client.0.smithi071.stdout:4/691: rename db/d15/d26/d43/d4d/d9f/f8b to db/d15/d26/d43/d4d/d77/fe6 0 2024-09-10T10:04:28.052 INFO:tasks.workunit.client.0.smithi071.stdout:7/942: write d9/f8f [793695,39050] 0 2024-09-10T10:04:28.054 INFO:tasks.workunit.client.0.smithi071.stdout:8/808: dwrite d5/df/d1d/f8c [0,4194304] 0 2024-09-10T10:04:28.055 INFO:tasks.workunit.client.0.smithi071.stdout:0/907: creat d11/d22/d31/f144 x:0 0 0 2024-09-10T10:04:28.058 INFO:tasks.workunit.client.0.smithi071.stdout:6/676: getdents d4/da/df/d2e/d3a/d40/d60/d7a/dbd 0 2024-09-10T10:04:28.060 INFO:tasks.workunit.client.0.smithi071.stdout:3/798: truncate d3/d1c/d3c/f82 1470727 0 2024-09-10T10:04:28.060 INFO:tasks.workunit.client.0.smithi071.stdout:2/864: creat d8/d87/d33/d53/d120/f127 x:0 0 0 2024-09-10T10:04:28.064 INFO:tasks.workunit.client.0.smithi071.stdout:4/692: dwrite db/d15/f94 [0,4194304] 0 2024-09-10T10:04:28.064 INFO:tasks.workunit.client.0.smithi071.stdout:7/943: chown d9/d15/d1f/d74/da1/dcf/ddf/lc3 3721 1 2024-09-10T10:04:28.066 INFO:tasks.workunit.client.0.smithi071.stdout:0/908: unlink d11/d22/d31/fc2 0 2024-09-10T10:04:28.070 INFO:tasks.workunit.client.0.smithi071.stdout:6/677: fdatasync d4/da/df/d2e/d3a/d51/d64/f72 0 2024-09-10T10:04:28.072 INFO:tasks.workunit.client.0.smithi071.stdout:4/693: rename db/d1d/d7a to db/d15/d26/d43/d4d/d77/dd7/de7 0 2024-09-10T10:04:28.074 INFO:tasks.workunit.client.0.smithi071.stdout:7/944: rmdir d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/dd2/dae 39 2024-09-10T10:04:28.075 INFO:tasks.workunit.client.0.smithi071.stdout:6/678: creat d4/fd7 x:0 0 0 2024-09-10T10:04:28.078 INFO:tasks.workunit.client.0.smithi071.stdout:8/809: write d5/df/d1d/d81/d9b/f10e [3678446,52297] 0 2024-09-10T10:04:28.079 INFO:tasks.workunit.client.0.smithi071.stdout:8/810: stat d5/df/d1d/f8c 0 2024-09-10T10:04:28.080 INFO:tasks.workunit.client.0.smithi071.stdout:0/909: getdents d11/d22/d31/d72/d129 0 2024-09-10T10:04:28.081 INFO:tasks.workunit.client.0.smithi071.stdout:7/945: unlink d9/d76/f9a 0 2024-09-10T10:04:28.084 INFO:tasks.workunit.client.0.smithi071.stdout:6/679: creat d4/da/df/d5e/fd8 x:0 0 0 2024-09-10T10:04:28.086 INFO:tasks.workunit.client.0.smithi071.stdout:6/680: chown d4/da/df/d2e/d3a/d91/fa6 624 1 2024-09-10T10:04:28.091 INFO:tasks.workunit.client.0.smithi071.stdout:2/865: getdents d8 0 2024-09-10T10:04:28.092 INFO:tasks.workunit.client.0.smithi071.stdout:4/694: write db/d15/d26/d43/fa5 [1322586,113335] 0 2024-09-10T10:04:28.095 INFO:tasks.workunit.client.0.smithi071.stdout:2/866: write d8/d38/d47/f5f [305897,46053] 0 2024-09-10T10:04:28.096 INFO:tasks.workunit.client.0.smithi071.stdout:8/811: creat d5/df/d57/d82/de9/f116 x:0 0 0 2024-09-10T10:04:28.100 INFO:tasks.workunit.client.0.smithi071.stdout:0/910: dwrite d11/d1e/f2d [0,4194304] 0 2024-09-10T10:04:28.100 INFO:tasks.workunit.client.0.smithi071.stdout:2/867: mknod d8/d38/d99/c128 0 2024-09-10T10:04:28.101 INFO:tasks.workunit.client.0.smithi071.stdout:3/799: dread d3/d1c/f22 [0,4194304] 0 2024-09-10T10:04:28.103 INFO:tasks.workunit.client.0.smithi071.stdout:7/946: getdents d9/d15/d40/d80/ddd 0 2024-09-10T10:04:28.104 INFO:tasks.workunit.client.1.smithi107.stdout:7/765: symlink d0/d8/dc/d2c/lf9 0 2024-09-10T10:04:28.110 INFO:tasks.workunit.client.0.smithi071.stdout:3/800: rmdir d3/d1c/d3c/da1/d5d/da5 39 2024-09-10T10:04:28.111 INFO:tasks.workunit.client.1.smithi107.stdout:7/766: dwrite d0/d8/d56/d5d/fd2 [0,4194304] 0 2024-09-10T10:04:28.111 INFO:tasks.workunit.client.0.smithi071.stdout:6/681: dwrite d4/da/df/d2e/d3a/f74 [0,4194304] 0 2024-09-10T10:04:28.112 INFO:tasks.workunit.client.1.smithi107.stdout:7/767: chown d0/d8/dc/fd4 465033 1 2024-09-10T10:04:28.113 INFO:tasks.workunit.client.0.smithi071.stdout:1/792: getdents d1 0 2024-09-10T10:04:28.114 INFO:tasks.workunit.client.1.smithi107.stdout:1/996: sync 2024-09-10T10:04:28.115 INFO:tasks.workunit.client.1.smithi107.stdout:1/997: read - d2/d6/f118 zero size 2024-09-10T10:04:28.116 INFO:tasks.workunit.client.0.smithi071.stdout:7/947: mknod d9/d1a/da2/c14b 0 2024-09-10T10:04:28.116 INFO:tasks.workunit.client.0.smithi071.stdout:6/682: readlink d4/da/df/d2e/d3a/da9/ld0 0 2024-09-10T10:04:28.121 INFO:tasks.workunit.client.1.smithi107.stdout:7/768: creat d0/d20/d35/ffa x:0 0 0 2024-09-10T10:04:28.121 INFO:tasks.workunit.client.0.smithi071.stdout:8/812: dwrite d5/df/d1d/d86/d75/f8b [4194304,4194304] 0 2024-09-10T10:04:28.124 INFO:tasks.workunit.client.0.smithi071.stdout:3/801: fdatasync d3/d1c/d3e/d77/f9a 0 2024-09-10T10:04:28.129 INFO:tasks.workunit.client.0.smithi071.stdout:2/868: creat d8/db6/d11b/d125/f129 x:0 0 0 2024-09-10T10:04:28.132 INFO:tasks.workunit.client.0.smithi071.stdout:0/911: truncate d11/d1e/f74 3411773 0 2024-09-10T10:04:28.132 INFO:tasks.workunit.client.0.smithi071.stdout:1/793: creat d1/d3f/d58/d102/f11b x:0 0 0 2024-09-10T10:04:28.132 INFO:tasks.workunit.client.0.smithi071.stdout:7/948: creat d9/d15/d1f/d122/d133/f14c x:0 0 0 2024-09-10T10:04:28.133 INFO:tasks.workunit.client.0.smithi071.stdout:6/683: mknod d4/da/df/d2e/d3a/d43/cd9 0 2024-09-10T10:04:28.134 INFO:tasks.workunit.client.0.smithi071.stdout:8/813: mknod d5/df/d1e/d70/c117 0 2024-09-10T10:04:28.134 INFO:tasks.workunit.client.1.smithi107.stdout:7/769: creat d0/d1b/d4d/dba/ffb x:0 0 0 2024-09-10T10:04:28.135 INFO:tasks.workunit.client.0.smithi071.stdout:5/726: sync 2024-09-10T10:04:28.136 INFO:tasks.workunit.client.1.smithi107.stdout:7/770: readlink d0/d1b/d4d/d69/lc9 0 2024-09-10T10:04:28.136 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:27 smithi071 ceph-mon[27559]: pgmap v5: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-10T10:04:28.136 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:27 smithi071 ceph-mon[27559]: mgrmap e24: smithi107.qurtcs(active, since 4s) 2024-09-10T10:04:28.136 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:27 smithi071 ceph-mon[27559]: [10/Sep/2024:10:04:27] ENGINE Bus STARTING 2024-09-10T10:04:28.137 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:27 smithi071 ceph-mon[27559]: [10/Sep/2024:10:04:27] ENGINE Serving on https://172.21.15.107:7150 2024-09-10T10:04:28.137 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:27 smithi071 ceph-mon[27559]: [10/Sep/2024:10:04:27] ENGINE Error in HTTPServer.serve 2024-09-10T10:04:28.137 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Traceback (most recent call last): 2024-09-10T10:04:28.137 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:04:28.137 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:04:28.137 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:04:28.137 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._run(expiration_interval) 2024-09-10T10:04:28.137 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:04:28.137 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:04:28.138 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:04:28.138 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:04:28.138 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:04:28.138 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: s = self.context.wrap_socket( 2024-09-10T10:04:28.138 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:04:28.138 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: return self.sslsocket_class._create( 2024-09-10T10:04:28.138 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:04:28.138 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self.do_handshake() 2024-09-10T10:04:28.138 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:04:28.138 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._sslobj.do_handshake() 2024-09-10T10:04:28.139 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:04:28.139 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:27 smithi071 ceph-mon[27559]: [10/Sep/2024:10:04:27] ENGINE Serving on http://172.21.15.107:8765 2024-09-10T10:04:28.139 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:27 smithi071 ceph-mon[27559]: [10/Sep/2024:10:04:27] ENGINE Bus STARTED 2024-09-10T10:04:28.139 INFO:tasks.workunit.client.1.smithi107.stdout:7/771: truncate d0/d8/dc/d2c/fde 1652985 0 2024-09-10T10:04:28.140 INFO:tasks.workunit.client.0.smithi071.stdout:2/869: mknod d8/d87/d51/c12a 0 2024-09-10T10:04:28.140 INFO:tasks.workunit.client.0.smithi071.stdout:8/814: chown d5/df/f80 7124 1 2024-09-10T10:04:28.140 INFO:tasks.workunit.client.0.smithi071.stdout:1/794: unlink d1/d21/d3d/d9a/l8f 0 2024-09-10T10:04:28.141 INFO:tasks.workunit.client.0.smithi071.stdout:3/802: read d3/d1c/d3c/f82 [667932,107985] 0 2024-09-10T10:04:28.143 INFO:tasks.workunit.client.0.smithi071.stdout:0/912: dread - d11/f7b zero size 2024-09-10T10:04:28.144 INFO:tasks.workunit.client.1.smithi107.stdout:7/772: dwrite d0/d8/fa8 [0,4194304] 0 2024-09-10T10:04:28.149 INFO:tasks.workunit.client.0.smithi071.stdout:1/795: chown d1/d57/lec 198046815 1 2024-09-10T10:04:28.149 INFO:tasks.workunit.client.0.smithi071.stdout:0/913: symlink d11/d1e/dfa/d5f/l145 0 2024-09-10T10:04:28.152 INFO:tasks.workunit.client.0.smithi071.stdout:6/684: creat d4/da/df/d2e/d3a/d91/dc7/d81/fda x:0 0 0 2024-09-10T10:04:28.152 INFO:tasks.workunit.client.0.smithi071.stdout:4/695: dread db/d15/d4b/f5c [0,4194304] 0 2024-09-10T10:04:28.153 INFO:tasks.workunit.client.0.smithi071.stdout:5/727: dwrite dc/f3c [8388608,4194304] 0 2024-09-10T10:04:28.156 INFO:tasks.workunit.client.0.smithi071.stdout:8/815: rename d5/df/d1e/d38/fef to d5/d36/d49/d8f/f118 0 2024-09-10T10:04:28.158 INFO:tasks.workunit.client.0.smithi071.stdout:5/728: chown dc/d4a/dbb/lc5 11 1 2024-09-10T10:04:28.160 INFO:tasks.workunit.client.0.smithi071.stdout:4/696: fdatasync db/d15/d26/d43/d82/f89 0 2024-09-10T10:04:28.162 INFO:tasks.workunit.client.1.smithi107.stdout:7/773: link d0/d1b/d4d/d69/d97/d68/f58 d0/d8/d56/dcc/de7/df8/ffc 0 2024-09-10T10:04:28.163 INFO:tasks.workunit.client.1.smithi107.stdout:7/774: chown d0/d8/c89 105 1 2024-09-10T10:04:28.163 INFO:tasks.workunit.client.0.smithi071.stdout:6/685: creat d4/da/df/d2e/d3a/d91/dc7/d97/fdb x:0 0 0 2024-09-10T10:04:28.163 INFO:tasks.workunit.client.0.smithi071.stdout:0/914: symlink d11/d1e/dfa/l146 0 2024-09-10T10:04:28.164 INFO:tasks.workunit.client.1.smithi107.stdout:7/775: chown d0/d8/dc/d2c/fde 1 1 2024-09-10T10:04:28.165 INFO:tasks.workunit.client.1.smithi107.stdout:8/729: sync 2024-09-10T10:04:28.165 INFO:tasks.workunit.client.1.smithi107.stdout:2/841: sync 2024-09-10T10:04:28.165 INFO:tasks.workunit.client.1.smithi107.stdout:5/894: sync 2024-09-10T10:04:28.165 INFO:tasks.workunit.client.1.smithi107.stdout:4/974: sync 2024-09-10T10:04:28.165 INFO:tasks.workunit.client.1.smithi107.stdout:6/868: sync 2024-09-10T10:04:28.166 INFO:tasks.workunit.client.1.smithi107.stdout:0/852: sync 2024-09-10T10:04:28.166 INFO:tasks.workunit.client.0.smithi071.stdout:7/949: dwrite d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/f5f [0,4194304] 0 2024-09-10T10:04:28.166 INFO:tasks.workunit.client.1.smithi107.stdout:9/797: sync 2024-09-10T10:04:28.168 INFO:tasks.workunit.client.0.smithi071.stdout:2/870: write d8/d4a/d104/f7b [89359,41361] 0 2024-09-10T10:04:28.168 INFO:tasks.workunit.client.0.smithi071.stdout:8/816: creat d5/d36/d49/d8f/f119 x:0 0 0 2024-09-10T10:04:28.169 INFO:tasks.workunit.client.1.smithi107.stdout:5/895: dread - de/db3/db6/f115 zero size 2024-09-10T10:04:28.173 INFO:tasks.workunit.client.1.smithi107.stdout:2/842: truncate d3/d8f/df4/f120 29078 0 2024-09-10T10:04:28.176 INFO:tasks.workunit.client.0.smithi071.stdout:0/915: write d11/d22/d31/d72/df3/f142 [829954,61814] 0 2024-09-10T10:04:28.177 INFO:tasks.workunit.client.1.smithi107.stdout:5/896: symlink de/d20/d3d/dc0/l127 0 2024-09-10T10:04:28.178 INFO:tasks.workunit.client.1.smithi107.stdout:8/730: creat d5/d8/d2a/d35/d85/ff3 x:0 0 0 2024-09-10T10:04:28.179 INFO:tasks.workunit.client.0.smithi071.stdout:4/697: mknod db/d15/ce8 0 2024-09-10T10:04:28.180 INFO:tasks.workunit.client.0.smithi071.stdout:3/803: dwrite d3/d49/d34/f6e [0,4194304] 0 2024-09-10T10:04:28.181 INFO:tasks.workunit.client.1.smithi107.stdout:9/798: creat d5/d7/d1d/d29/d101/f10c x:0 0 0 2024-09-10T10:04:28.183 INFO:tasks.workunit.client.0.smithi071.stdout:0/916: chown d11/d1e/dfa/d5f/f96 1198368798 1 2024-09-10T10:04:28.186 INFO:tasks.workunit.client.0.smithi071.stdout:6/686: symlink d4/da/df/d2e/dc2/ldc 0 2024-09-10T10:04:28.187 INFO:tasks.workunit.client.1.smithi107.stdout:8/731: mknod d5/d8/d66/d8b/d1a/cf4 0 2024-09-10T10:04:28.189 INFO:tasks.workunit.client.0.smithi071.stdout:3/804: creat d3/d1c/d3c/da1/d5d/d7a/f116 x:0 0 0 2024-09-10T10:04:28.191 INFO:tasks.workunit.client.1.smithi107.stdout:4/975: dwrite d0/d40/d57/d76/d77/da1/d59/f135 [0,4194304] 0 2024-09-10T10:04:28.191 INFO:tasks.workunit.client.0.smithi071.stdout:7/950: getdents d9/d1a/da2 0 2024-09-10T10:04:28.199 INFO:tasks.workunit.client.0.smithi071.stdout:4/698: link db/d1d/fd6 db/d1d/d61/d6a/fe9 0 2024-09-10T10:04:28.199 INFO:tasks.workunit.client.1.smithi107.stdout:8/732: dread - d5/d8/d66/d8b/d21/d83/fcf zero size 2024-09-10T10:04:28.201 INFO:tasks.workunit.client.0.smithi071.stdout:7/951: write d9/d15/d1f/f6d [5614007,63000] 0 2024-09-10T10:04:28.202 INFO:tasks.workunit.client.0.smithi071.stdout:5/729: dwrite dc/f31 [0,4194304] 0 2024-09-10T10:04:28.203 INFO:tasks.workunit.client.1.smithi107.stdout:8/733: write d5/d8/d2a/fd6 [435216,123121] 0 2024-09-10T10:04:28.204 INFO:tasks.workunit.client.0.smithi071.stdout:4/699: dread - db/d15/f9e zero size 2024-09-10T10:04:28.204 INFO:tasks.workunit.client.1.smithi107.stdout:9/799: dread d5/d7/d1d/d9b/dab/d57/d87/fea [0,4194304] 0 2024-09-10T10:04:28.207 INFO:tasks.workunit.client.1.smithi107.stdout:9/800: write d5/d1e/f9f [722264,41031] 0 2024-09-10T10:04:28.208 INFO:tasks.workunit.client.0.smithi071.stdout:0/917: getdents d11/d1e/dfa/d79 0 2024-09-10T10:04:28.209 INFO:tasks.workunit.client.0.smithi071.stdout:3/805: dread d3/d1c/d3c/da1/d5d/d7a/fe1 [0,4194304] 0 2024-09-10T10:04:28.214 INFO:tasks.workunit.client.0.smithi071.stdout:6/687: dwrite d4/da/df/d2e/d3a/d40/f58 [0,4194304] 0 2024-09-10T10:04:28.215 INFO:tasks.workunit.client.0.smithi071.stdout:5/730: unlink dc/df/d17/cec 0 2024-09-10T10:04:28.217 INFO:tasks.workunit.client.0.smithi071.stdout:2/871: dread d8/d38/d8d/f98 [0,4194304] 0 2024-09-10T10:04:28.218 INFO:tasks.workunit.client.0.smithi071.stdout:5/731: dread - dc/df/dd7/d87/ffb zero size 2024-09-10T10:04:28.219 INFO:tasks.workunit.client.0.smithi071.stdout:4/700: unlink db/d15/d26/l71 0 2024-09-10T10:04:28.223 INFO:tasks.workunit.client.0.smithi071.stdout:0/918: creat d11/d22/d9a/ddf/f147 x:0 0 0 2024-09-10T10:04:28.224 INFO:tasks.workunit.client.0.smithi071.stdout:2/872: unlink d8/d38/f57 0 2024-09-10T10:04:28.224 INFO:tasks.workunit.client.0.smithi071.stdout:6/688: chown d4/d1c/c78 1 1 2024-09-10T10:04:28.227 INFO:tasks.workunit.client.0.smithi071.stdout:2/873: readlink d8/d87/l1f 0 2024-09-10T10:04:28.229 INFO:tasks.workunit.client.0.smithi071.stdout:8/817: dread d5/d36/d49/fb8 [0,4194304] 0 2024-09-10T10:04:28.229 INFO:tasks.workunit.client.0.smithi071.stdout:2/874: chown d8/d24/d7f/fa6 77 1 2024-09-10T10:04:28.230 INFO:tasks.workunit.client.1.smithi107.stdout:6/869: link d0/d3d/d14/d21/fb3 d0/d3d/d14/d17/f134 0 2024-09-10T10:04:28.232 INFO:tasks.workunit.client.0.smithi071.stdout:0/919: creat d11/d1e/dfa/d79/f148 x:0 0 0 2024-09-10T10:04:28.232 INFO:tasks.workunit.client.0.smithi071.stdout:5/732: link dc/d53/db2/f8e dc/df/d3e/d5a/ffc 0 2024-09-10T10:04:28.232 INFO:tasks.workunit.client.1.smithi107.stdout:6/870: write d0/d3d/d14/d17/d24/f10f [1383318,130607] 0 2024-09-10T10:04:28.234 INFO:tasks.workunit.client.1.smithi107.stdout:5/897: creat de/d20/d2b/d4b/d5e/d116/d7e/f128 x:0 0 0 2024-09-10T10:04:28.234 INFO:tasks.workunit.client.1.smithi107.stdout:6/871: chown d0/d3d/f11d 314584430 1 2024-09-10T10:04:28.234 INFO:tasks.workunit.client.0.smithi071.stdout:3/806: dwrite d3/d1c/d3c/da1/d5d/d9d/fe9 [0,4194304] 0 2024-09-10T10:04:28.234 INFO:tasks.workunit.client.1.smithi107.stdout:4/976: mkdir d0/d40/d6d/d8a/dbb/d14d 0 2024-09-10T10:04:28.235 INFO:tasks.workunit.client.1.smithi107.stdout:5/898: write de/d20/f7c [368349,11633] 0 2024-09-10T10:04:28.238 INFO:tasks.workunit.client.1.smithi107.stdout:8/734: unlink d5/d8/d66/d8b/f16 0 2024-09-10T10:04:28.240 INFO:tasks.workunit.client.1.smithi107.stdout:8/735: readlink d5/d8/d66/d8b/d1a/laa 0 2024-09-10T10:04:28.241 INFO:tasks.workunit.client.0.smithi071.stdout:3/807: fdatasync d3/d1c/d3c/da1/d3a/dbd/fc7 0 2024-09-10T10:04:28.244 INFO:tasks.workunit.client.1.smithi107.stdout:4/977: creat d0/d40/d57/d76/d77/d10d/f14e x:0 0 0 2024-09-10T10:04:28.244 INFO:tasks.workunit.client.0.smithi071.stdout:0/920: creat d11/d30/d70/d128/f149 x:0 0 0 2024-09-10T10:04:28.246 INFO:tasks.workunit.client.1.smithi107.stdout:5/899: mknod de/d20/d3d/dd4/c129 0 2024-09-10T10:04:28.248 INFO:tasks.workunit.client.0.smithi071.stdout:8/818: dwrite d5/df/d1e/f37 [0,4194304] 0 2024-09-10T10:04:28.248 INFO:tasks.workunit.client.1.smithi107.stdout:8/736: creat d5/d8/d66/d8b/d21/d83/ff5 x:0 0 0 2024-09-10T10:04:28.251 INFO:tasks.workunit.client.1.smithi107.stdout:6/872: symlink d0/l135 0 2024-09-10T10:04:28.251 INFO:tasks.workunit.client.0.smithi071.stdout:3/808: dread d3/fdd [0,4194304] 0 2024-09-10T10:04:28.251 INFO:tasks.workunit.client.0.smithi071.stdout:7/952: dread d9/d15/d1f/f68 [0,4194304] 0 2024-09-10T10:04:28.253 INFO:tasks.workunit.client.0.smithi071.stdout:2/875: dread d8/d87/f76 [0,4194304] 0 2024-09-10T10:04:28.253 INFO:tasks.workunit.client.1.smithi107.stdout:4/978: rename d0/d40/l69 to d0/d40/d57/d76/d77/d10d/d133/l14f 0 2024-09-10T10:04:28.254 INFO:tasks.workunit.client.1.smithi107.stdout:1/998: creat d2/d12/d65/f14a x:0 0 0 2024-09-10T10:04:28.254 INFO:tasks.workunit.client.0.smithi071.stdout:5/733: mknod dc/df/d29/cfd 0 2024-09-10T10:04:28.255 INFO:tasks.workunit.client.1.smithi107.stdout:1/999: chown d2/d35/d9c/cd7 72076 1 2024-09-10T10:04:28.255 INFO:tasks.workunit.client.0.smithi071.stdout:6/689: link d4/d20/c2b d4/da/df/d2e/d3a/d40/d60/d7a/dbd/cdd 0 2024-09-10T10:04:28.256 INFO:tasks.workunit.client.1.smithi107.stdout:5/900: dread de/d20/d2b/d4b/d5e/d116/d7e/db2/dbc/fe9 [0,4194304] 0 2024-09-10T10:04:28.257 INFO:tasks.workunit.client.0.smithi071.stdout:0/921: mkdir d11/d22/d14a 0 2024-09-10T10:04:28.258 INFO:tasks.workunit.client.0.smithi071.stdout:3/809: write d3/d1c/d3c/da1/d5d/d9d/fb8 [615405,61132] 0 2024-09-10T10:04:28.258 INFO:tasks.workunit.client.1.smithi107.stdout:8/737: creat d5/d8/d66/d8b/d1a/d64/db9/ff6 x:0 0 0 2024-09-10T10:04:28.260 INFO:tasks.workunit.client.1.smithi107.stdout:4/979: getdents d0/d40/d75/d53/d141 0 2024-09-10T10:04:28.261 INFO:tasks.workunit.client.1.smithi107.stdout:5/901: mkdir de/d20/d2b/d4b/d5e/d12a 0 2024-09-10T10:04:28.264 INFO:tasks.workunit.client.1.smithi107.stdout:8/738: rename d5/d8/d2a/d47/f54 to d5/d8/d66/d8b/d1a/d75/def/ff7 0 2024-09-10T10:04:28.264 INFO:tasks.workunit.client.1.smithi107.stdout:5/902: truncate de/d20/d2b/d4b/d5e/d9a/f11c 36642 0 2024-09-10T10:04:28.266 INFO:tasks.workunit.client.0.smithi071.stdout:4/701: dwrite db/d1d/fd6 [0,4194304] 0 2024-09-10T10:04:28.268 INFO:tasks.workunit.client.1.smithi107.stdout:4/980: creat d0/d40/d57/d4f/f150 x:0 0 0 2024-09-10T10:04:28.270 INFO:tasks.workunit.client.1.smithi107.stdout:5/903: rename de/d20/d2b/d4b/d5e/d116/d7e/db2/cda to de/d20/d2b/d4b/d5e/d116/d7e/d79/c12b 0 2024-09-10T10:04:28.271 INFO:tasks.workunit.client.1.smithi107.stdout:8/739: mkdir d5/d8/d2a/df8 0 2024-09-10T10:04:28.272 INFO:tasks.workunit.client.0.smithi071.stdout:6/690: symlink d4/da/df/d2e/dc2/lde 0 2024-09-10T10:04:28.272 INFO:tasks.workunit.client.1.smithi107.stdout:8/740: truncate d5/d42/fdd 702174 0 2024-09-10T10:04:28.273 INFO:tasks.workunit.client.0.smithi071.stdout:8/819: rename d5/df/d1d/f8d to d5/df/d1d/d86/d90/db4/f11a 0 2024-09-10T10:04:28.273 INFO:tasks.workunit.client.1.smithi107.stdout:4/981: mknod d0/d40/d57/def/c151 0 2024-09-10T10:04:28.274 INFO:tasks.workunit.client.1.smithi107.stdout:8/741: write d5/d8/f6d [2308811,84981] 0 2024-09-10T10:04:28.275 INFO:tasks.workunit.client.1.smithi107.stdout:5/904: dread - de/fa7 zero size 2024-09-10T10:04:28.276 INFO:tasks.workunit.client.1.smithi107.stdout:8/742: dread - d5/da2/fd3 zero size 2024-09-10T10:04:28.278 INFO:tasks.workunit.client.1.smithi107.stdout:4/982: symlink d0/d40/d57/def/l152 0 2024-09-10T10:04:28.278 INFO:tasks.workunit.client.1.smithi107.stdout:6/873: dread d0/d3d/f41 [0,4194304] 0 2024-09-10T10:04:28.278 INFO:tasks.workunit.client.1.smithi107.stdout:4/983: chown d0/f10 1906648324 1 2024-09-10T10:04:28.279 INFO:tasks.workunit.client.0.smithi071.stdout:0/922: dwrite d11/d1e/f11c [0,4194304] 0 2024-09-10T10:04:28.281 INFO:tasks.workunit.client.1.smithi107.stdout:8/743: creat d5/d8/d66/d8b/d21/d83/ff9 x:0 0 0 2024-09-10T10:04:28.281 INFO:tasks.workunit.client.0.smithi071.stdout:7/953: dwrite d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/d106/f13f [0,4194304] 0 2024-09-10T10:04:28.282 INFO:tasks.workunit.client.1.smithi107.stdout:6/874: fdatasync d0/d3d/d14/d17/d24/df3/f5a 0 2024-09-10T10:04:28.284 INFO:tasks.workunit.client.0.smithi071.stdout:5/734: write dc/d53/db2/f8e [717814,106366] 0 2024-09-10T10:04:28.284 INFO:tasks.workunit.client.0.smithi071.stdout:6/691: creat d4/fdf x:0 0 0 2024-09-10T10:04:28.285 INFO:tasks.workunit.client.0.smithi071.stdout:8/820: symlink d5/df/d1d/d86/l11b 0 2024-09-10T10:04:28.287 INFO:tasks.workunit.client.0.smithi071.stdout:7/954: creat d9/d15/d40/d80/ddd/f14d x:0 0 0 2024-09-10T10:04:28.288 INFO:tasks.workunit.client.0.smithi071.stdout:5/735: truncate dc/df/d3e/d5a/ffc 1775015 0 2024-09-10T10:04:28.289 INFO:tasks.workunit.client.1.smithi107.stdout:7/776: mknod d0/d8/dc/cfd 0 2024-09-10T10:04:28.291 INFO:tasks.workunit.client.0.smithi071.stdout:0/923: stat d11/fb4 0 2024-09-10T10:04:28.294 INFO:tasks.workunit.client.1.smithi107.stdout:0/853: dwrite d6/d14/f25 [0,4194304] 0 2024-09-10T10:04:28.295 INFO:tasks.workunit.client.0.smithi071.stdout:8/821: read d5/df/d1d/d86/d90/d109/f3c [1984522,66450] 0 2024-09-10T10:04:28.295 INFO:tasks.workunit.client.0.smithi071.stdout:2/876: getdents d8/d87/d33/d41/d4d/d5e 0 2024-09-10T10:04:28.296 INFO:tasks.workunit.client.0.smithi071.stdout:6/692: creat d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/fe0 x:0 0 0 2024-09-10T10:04:28.297 INFO:tasks.workunit.client.0.smithi071.stdout:8/822: chown d5/df/d74/l102 1817163 1 2024-09-10T10:04:28.298 INFO:tasks.workunit.client.0.smithi071.stdout:0/924: symlink d11/d1e/dfa/d79/de6/l14b 0 2024-09-10T10:04:28.299 INFO:tasks.workunit.client.0.smithi071.stdout:2/877: mknod d8/d38/d8d/c12b 0 2024-09-10T10:04:28.300 INFO:tasks.workunit.client.0.smithi071.stdout:2/878: stat d8/d4a/d104/f7b 0 2024-09-10T10:04:28.300 INFO:tasks.workunit.client.0.smithi071.stdout:5/736: rename dc/df/l9d to dc/d4a/lfe 0 2024-09-10T10:04:28.301 INFO:tasks.workunit.client.0.smithi071.stdout:4/702: dread db/d1d/d61/d6a/f6c [0,4194304] 0 2024-09-10T10:04:28.301 INFO:tasks.workunit.client.1.smithi107.stdout:7/777: creat d0/d20/ddf/ffe x:0 0 0 2024-09-10T10:04:28.301 INFO:tasks.workunit.client.1.smithi107.stdout:0/854: mknod d6/d5a/d5c/c11b 0 2024-09-10T10:04:28.303 INFO:tasks.workunit.client.0.smithi071.stdout:6/693: mknod d4/da/df/d2e/ce1 0 2024-09-10T10:04:28.303 INFO:tasks.workunit.client.1.smithi107.stdout:8/744: link d5/d8/d2a/c82 d5/d8/d2a/d35/d85/dcb/cfa 0 2024-09-10T10:04:28.303 INFO:tasks.workunit.client.1.smithi107.stdout:2/843: dwrite d3/da/df/d20/d36/d39/da3/ddb/d12b/fbd [0,4194304] 0 2024-09-10T10:04:28.304 INFO:tasks.workunit.client.0.smithi071.stdout:7/955: dread d9/d2c/f7e [0,4194304] 0 2024-09-10T10:04:28.306 INFO:tasks.workunit.client.0.smithi071.stdout:2/879: truncate d8/f14 1217248 0 2024-09-10T10:04:28.307 INFO:tasks.workunit.client.1.smithi107.stdout:7/778: mkdir d0/dff 0 2024-09-10T10:04:28.308 INFO:tasks.workunit.client.0.smithi071.stdout:0/925: getdents d11/d22/d9a/d106 0 2024-09-10T10:04:28.309 INFO:tasks.workunit.client.1.smithi107.stdout:0/855: fsync d6/d8/d2f/d2e/d32/f37 0 2024-09-10T10:04:28.309 INFO:tasks.workunit.client.0.smithi071.stdout:7/956: chown d9/d15/d1f/f65 0 1 2024-09-10T10:04:28.309 INFO:tasks.workunit.client.1.smithi107.stdout:7/779: dread - d0/d1b/d4d/d69/dca/fda zero size 2024-09-10T10:04:28.310 INFO:tasks.workunit.client.1.smithi107.stdout:8/745: mknod d5/d8/d66/d8b/d1a/d64/db9/cfb 0 2024-09-10T10:04:28.313 INFO:tasks.workunit.client.0.smithi071.stdout:8/823: link d5/d36/d49/lbe d5/df/d1d/d86/d75/d85/l11c 0 2024-09-10T10:04:28.314 INFO:tasks.workunit.client.1.smithi107.stdout:4/984: dread d0/d40/d57/d76/d77/da1/d59/fb1 [0,4194304] 0 2024-09-10T10:04:28.314 INFO:tasks.workunit.client.0.smithi071.stdout:7/957: creat d9/d2c/f14e x:0 0 0 2024-09-10T10:04:28.315 INFO:tasks.workunit.client.0.smithi071.stdout:3/810: dread d3/d49/f6c [0,4194304] 0 2024-09-10T10:04:28.315 INFO:tasks.workunit.client.0.smithi071.stdout:2/880: dread d8/d4a/d104/f7b [0,4194304] 0 2024-09-10T10:04:28.315 INFO:tasks.workunit.client.0.smithi071.stdout:8/824: fdatasync d5/df/fad 0 2024-09-10T10:04:28.316 INFO:tasks.workunit.client.0.smithi071.stdout:5/737: dread dc/df/d17/d8d/de4/fe6 [0,4194304] 0 2024-09-10T10:04:28.317 INFO:tasks.workunit.client.0.smithi071.stdout:8/825: readlink d5/df/d1d/l25 0 2024-09-10T10:04:28.318 INFO:tasks.workunit.client.0.smithi071.stdout:7/958: fsync d9/d76/f42 0 2024-09-10T10:04:28.318 INFO:tasks.workunit.client.0.smithi071.stdout:8/826: stat d5/df/d1d/d86 0 2024-09-10T10:04:28.318 INFO:tasks.workunit.client.0.smithi071.stdout:3/811: chown d3/d20/d99/cf7 1 1 2024-09-10T10:04:28.320 INFO:tasks.workunit.client.0.smithi071.stdout:7/959: write d9/d15/d1f/d74/f86 [282301,97462] 0 2024-09-10T10:04:28.320 INFO:tasks.workunit.client.0.smithi071.stdout:2/881: dread d8/d4a/f97 [0,4194304] 0 2024-09-10T10:04:28.321 INFO:tasks.workunit.client.0.smithi071.stdout:8/827: rmdir d5/df/d74 39 2024-09-10T10:04:28.329 INFO:tasks.workunit.client.0.smithi071.stdout:7/960: rename d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/dd2/lf3 to d9/d2c/l14f 0 2024-09-10T10:04:28.329 INFO:tasks.workunit.client.0.smithi071.stdout:2/882: dwrite d8/f8f [0,4194304] 0 2024-09-10T10:04:28.332 INFO:tasks.workunit.client.0.smithi071.stdout:5/738: write dc/df/d29/d94/fcc [176979,36117] 0 2024-09-10T10:04:28.333 INFO:tasks.workunit.client.0.smithi071.stdout:2/883: dread - d8/d38/d8d/f105 zero size 2024-09-10T10:04:28.335 INFO:tasks.workunit.client.0.smithi071.stdout:7/961: write d9/d15/d40/f143 [4952395,109729] 0 2024-09-10T10:04:28.337 INFO:tasks.workunit.client.0.smithi071.stdout:3/812: dwrite d3/d1c/f22 [4194304,4194304] 0 2024-09-10T10:04:28.339 INFO:tasks.workunit.client.0.smithi071.stdout:5/739: stat dc/df/d3e/d5a/d80/fe5 0 2024-09-10T10:04:28.339 INFO:tasks.workunit.client.0.smithi071.stdout:7/962: readlink d9/d15/d1f/d98/l11b 0 2024-09-10T10:04:28.341 INFO:tasks.workunit.client.0.smithi071.stdout:2/884: symlink d8/d38/l12c 0 2024-09-10T10:04:28.343 INFO:tasks.workunit.client.0.smithi071.stdout:5/740: chown dc/df/c26 109759569 1 2024-09-10T10:04:28.343 INFO:tasks.workunit.client.0.smithi071.stdout:8/828: dwrite d5/df/d74/ff6 [0,4194304] 0 2024-09-10T10:04:28.345 INFO:tasks.workunit.client.0.smithi071.stdout:5/741: fsync dc/df/d17/f1f 0 2024-09-10T10:04:28.346 INFO:tasks.workunit.client.0.smithi071.stdout:6/694: dread d4/da/df/d2e/d3a/d91/dc7/f8f [0,4194304] 0 2024-09-10T10:04:28.348 INFO:tasks.workunit.client.0.smithi071.stdout:7/963: symlink d9/d15/d1f/l150 0 2024-09-10T10:04:28.351 INFO:tasks.workunit.client.0.smithi071.stdout:3/813: creat d3/d49/d2f/d7f/f117 x:0 0 0 2024-09-10T10:04:28.352 INFO:tasks.workunit.client.0.smithi071.stdout:0/926: dread d11/d22/d9a/ddf/fe5 [0,4194304] 0 2024-09-10T10:04:28.352 INFO:tasks.workunit.client.0.smithi071.stdout:7/964: stat d9/d15/d1f/c92 0 2024-09-10T10:04:28.356 INFO:tasks.workunit.client.0.smithi071.stdout:8/829: mkdir d5/df/d74/d11d 0 2024-09-10T10:04:28.358 INFO:tasks.workunit.client.0.smithi071.stdout:7/965: mkdir d9/d15/d40/d80/ddd/de2/d151 0 2024-09-10T10:04:28.359 INFO:tasks.workunit.client.0.smithi071.stdout:6/695: rmdir d4/da/df/db4 0 2024-09-10T10:04:28.361 INFO:tasks.workunit.client.0.smithi071.stdout:3/814: mkdir d3/d20/d99/d9b/dde/d118 0 2024-09-10T10:04:28.361 INFO:tasks.workunit.client.0.smithi071.stdout:7/966: chown d9/d15/d1f/d74/d9b/cc0 500777 1 2024-09-10T10:04:28.363 INFO:tasks.workunit.client.0.smithi071.stdout:0/927: rename d11/lf7 to d11/d1e/dfa/d79/d119/l14c 0 2024-09-10T10:04:28.363 INFO:tasks.workunit.client.0.smithi071.stdout:5/742: dwrite dc/df/d29/d94/fb3 [0,4194304] 0 2024-09-10T10:04:28.363 INFO:tasks.workunit.client.0.smithi071.stdout:6/696: chown d4/da/df/d2e/d3a/d51/d64/f7e 19245 1 2024-09-10T10:04:28.365 INFO:tasks.workunit.client.0.smithi071.stdout:7/967: mkdir d9/d15/d40/db8/d152 0 2024-09-10T10:04:28.366 INFO:tasks.workunit.client.0.smithi071.stdout:5/743: creat dc/fff x:0 0 0 2024-09-10T10:04:28.366 INFO:tasks.workunit.client.0.smithi071.stdout:0/928: symlink d11/d1e/dfa/d79/de6/l14d 0 2024-09-10T10:04:28.367 INFO:tasks.workunit.client.0.smithi071.stdout:8/830: creat d5/df/f11e x:0 0 0 2024-09-10T10:04:28.370 INFO:tasks.workunit.client.0.smithi071.stdout:0/929: readlink la 0 2024-09-10T10:04:28.370 INFO:tasks.workunit.client.0.smithi071.stdout:5/744: dread - dc/d53/d6a/f96 zero size 2024-09-10T10:04:28.371 INFO:tasks.workunit.client.0.smithi071.stdout:8/831: creat d5/df/d1d/f11f x:0 0 0 2024-09-10T10:04:28.373 INFO:tasks.workunit.client.0.smithi071.stdout:3/815: dwrite d3/d1c/d3c/fa2 [0,4194304] 0 2024-09-10T10:04:28.373 INFO:tasks.workunit.client.0.smithi071.stdout:8/832: readlink d5/df/d1d/d86/l11b 0 2024-09-10T10:04:28.374 INFO:tasks.workunit.client.0.smithi071.stdout:5/745: read dc/d53/f7f [1781030,105447] 0 2024-09-10T10:04:28.375 INFO:tasks.workunit.client.0.smithi071.stdout:7/968: mknod d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/d91/c153 0 2024-09-10T10:04:28.376 INFO:tasks.workunit.client.0.smithi071.stdout:0/930: stat d11/d1e/dfa/cd3 0 2024-09-10T10:04:28.380 INFO:tasks.workunit.client.0.smithi071.stdout:8/833: link d5/df/d1d/d86/d75/f9d d5/df/d67/f120 0 2024-09-10T10:04:28.381 INFO:tasks.workunit.client.0.smithi071.stdout:0/931: creat d11/d22/dde/df2/f14e x:0 0 0 2024-09-10T10:04:28.381 INFO:tasks.workunit.client.0.smithi071.stdout:8/834: dread - d5/df/d1d/d81/d9b/f104 zero size 2024-09-10T10:04:28.382 INFO:tasks.workunit.client.0.smithi071.stdout:7/969: rename d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/d91/c153 to d9/d15/d1f/d74/c154 0 2024-09-10T10:04:28.384 INFO:tasks.workunit.client.0.smithi071.stdout:3/816: getdents d3/d1c/d3c/da1/d42/d4a/d60/d78 0 2024-09-10T10:04:28.385 INFO:tasks.workunit.client.0.smithi071.stdout:7/970: creat d9/d2c/d49/f155 x:0 0 0 2024-09-10T10:04:28.386 INFO:tasks.workunit.client.0.smithi071.stdout:5/746: link dc/df/d17/d8d/de4/lf9 dc/df/d17/l100 0 2024-09-10T10:04:28.389 INFO:tasks.workunit.client.0.smithi071.stdout:5/747: mkdir dc/d53/d101 0 2024-09-10T10:04:28.390 INFO:tasks.workunit.client.0.smithi071.stdout:7/971: mknod d9/d15/d40/c156 0 2024-09-10T10:04:28.391 INFO:tasks.workunit.client.0.smithi071.stdout:8/835: dwrite d5/df/d1d/d86/d75/f87 [0,4194304] 0 2024-09-10T10:04:28.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:27 smithi107 ceph-mon[34215]: pgmap v5: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-10T10:04:28.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:27 smithi107 ceph-mon[34215]: mgrmap e24: smithi107.qurtcs(active, since 4s) 2024-09-10T10:04:28.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:27 smithi107 ceph-mon[34215]: [10/Sep/2024:10:04:27] ENGINE Bus STARTING 2024-09-10T10:04:28.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:27 smithi107 ceph-mon[34215]: [10/Sep/2024:10:04:27] ENGINE Serving on https://172.21.15.107:7150 2024-09-10T10:04:28.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:27 smithi107 ceph-mon[34215]: [10/Sep/2024:10:04:27] ENGINE Error in HTTPServer.serve 2024-09-10T10:04:28.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Traceback (most recent call last): 2024-09-10T10:04:28.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:04:28.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:04:28.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:04:28.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._run(expiration_interval) 2024-09-10T10:04:28.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:04:28.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:04:28.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:04:28.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:04:28.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:04:28.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s = self.context.wrap_socket( 2024-09-10T10:04:28.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:04:28.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: return self.sslsocket_class._create( 2024-09-10T10:04:28.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:04:28.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self.do_handshake() 2024-09-10T10:04:28.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:04:28.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._sslobj.do_handshake() 2024-09-10T10:04:28.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:04:28.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:27 smithi107 ceph-mon[34215]: [10/Sep/2024:10:04:27] ENGINE Serving on http://172.21.15.107:8765 2024-09-10T10:04:28.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:27 smithi107 ceph-mon[34215]: [10/Sep/2024:10:04:27] ENGINE Bus STARTED 2024-09-10T10:04:28.433 INFO:tasks.workunit.client.0.smithi071.stdout:8/836: chown d5/df/df7/l100 251723 1 2024-09-10T10:04:28.436 INFO:tasks.workunit.client.1.smithi107.stdout:2/844: rename d3/da/d66/d91/f12a to d3/da/df/d20/d36/d4f/d92/f12c 0 2024-09-10T10:04:28.437 INFO:tasks.workunit.client.1.smithi107.stdout:2/845: chown d3/da/d1e/d40/fc4 258431 1 2024-09-10T10:04:28.443 INFO:tasks.workunit.client.0.smithi071.stdout:3/817: dwrite d3/d1c/d3e/f97 [0,4194304] 0 2024-09-10T10:04:28.445 INFO:tasks.workunit.client.1.smithi107.stdout:8/746: readlink d5/d8/l15 0 2024-09-10T10:04:28.445 INFO:tasks.workunit.client.1.smithi107.stdout:8/747: chown d5/da2/fd3 4628288 1 2024-09-10T10:04:28.446 INFO:tasks.workunit.client.1.smithi107.stdout:8/748: dread - d5/da2/fd3 zero size 2024-09-10T10:04:28.447 INFO:tasks.workunit.client.0.smithi071.stdout:6/697: dread d4/d61/d83/da8/f99 [0,4194304] 0 2024-09-10T10:04:28.452 INFO:tasks.workunit.client.0.smithi071.stdout:0/932: dwrite d11/d1e/f89 [0,4194304] 0 2024-09-10T10:04:28.453 INFO:tasks.workunit.client.0.smithi071.stdout:3/818: chown d3/d1c/d3c/da1/d42/d4a/lc5 0 1 2024-09-10T10:04:28.456 INFO:tasks.workunit.client.1.smithi107.stdout:0/856: unlink d6/d8/d3e/l83 0 2024-09-10T10:04:28.457 INFO:tasks.workunit.client.0.smithi071.stdout:8/837: creat d5/df/d1d/d86/d75/f121 x:0 0 0 2024-09-10T10:04:28.457 INFO:tasks.workunit.client.0.smithi071.stdout:5/748: dwrite dc/ff8 [0,4194304] 0 2024-09-10T10:04:28.457 INFO:tasks.workunit.client.1.smithi107.stdout:8/749: creat d5/d8/d66/d8b/d21/d83/ffc x:0 0 0 2024-09-10T10:04:28.459 INFO:tasks.workunit.client.1.smithi107.stdout:4/985: mknod d0/d40/d75/d53/d141/c153 0 2024-09-10T10:04:28.459 INFO:tasks.workunit.client.0.smithi071.stdout:7/972: dwrite d9/d70/faa [4194304,4194304] 0 2024-09-10T10:04:28.460 INFO:tasks.workunit.client.1.smithi107.stdout:2/846: truncate d3/da/df/d78/fe1 124685 0 2024-09-10T10:04:28.460 INFO:tasks.workunit.client.1.smithi107.stdout:4/986: chown d0/d1f/d90/ffa 2061867 1 2024-09-10T10:04:28.462 INFO:tasks.workunit.client.1.smithi107.stdout:4/987: fsync d0/d40/d57/d76/d77/ff1 0 2024-09-10T10:04:28.464 INFO:tasks.workunit.client.1.smithi107.stdout:8/750: mkdir d5/d8/d66/d8b/dfd 0 2024-09-10T10:04:28.464 INFO:tasks.workunit.client.1.smithi107.stdout:8/751: chown d5 457 1 2024-09-10T10:04:28.466 INFO:tasks.workunit.client.0.smithi071.stdout:5/749: readlink dc/df/d3e/d5a/lab 0 2024-09-10T10:04:28.467 INFO:tasks.workunit.client.1.smithi107.stdout:4/988: symlink d0/d40/d57/d76/d77/da1/l154 0 2024-09-10T10:04:28.467 INFO:tasks.workunit.client.1.smithi107.stdout:4/989: readlink d0/d40/d57/d76/l7b 0 2024-09-10T10:04:28.468 INFO:tasks.workunit.client.0.smithi071.stdout:6/698: creat d4/da/df/d2e/d3a/d43/dc8/fe2 x:0 0 0 2024-09-10T10:04:28.469 INFO:tasks.workunit.client.0.smithi071.stdout:8/838: creat d5/d36/dfa/f122 x:0 0 0 2024-09-10T10:04:28.470 INFO:tasks.workunit.client.0.smithi071.stdout:5/750: stat dc/d53/db2/c64 0 2024-09-10T10:04:28.471 INFO:tasks.workunit.client.1.smithi107.stdout:4/990: mkdir d0/d40/d57/d76/d77/da1/d155 0 2024-09-10T10:04:28.472 INFO:tasks.workunit.client.0.smithi071.stdout:8/839: readlink d5/df/d1d/d86/l47 0 2024-09-10T10:04:28.472 INFO:tasks.workunit.client.0.smithi071.stdout:0/933: dwrite d11/d22/d9a/d106/f111 [0,4194304] 0 2024-09-10T10:04:28.472 INFO:tasks.workunit.client.0.smithi071.stdout:5/751: write dc/d4a/fb7 [2211258,6279] 0 2024-09-10T10:04:28.474 INFO:tasks.workunit.client.0.smithi071.stdout:7/973: symlink d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/dd2/l157 0 2024-09-10T10:04:28.475 INFO:tasks.workunit.client.1.smithi107.stdout:4/991: rmdir d0/d1f/d90/dfb 39 2024-09-10T10:04:28.476 INFO:tasks.workunit.client.1.smithi107.stdout:8/752: link d5/d42/f65 d5/d8/d2a/d47/ffe 0 2024-09-10T10:04:28.478 INFO:tasks.workunit.client.0.smithi071.stdout:7/974: chown d9/f34 52294 1 2024-09-10T10:04:28.478 INFO:tasks.workunit.client.0.smithi071.stdout:8/840: read d5/df/d1e/d38/ffd [4085388,103459] 0 2024-09-10T10:04:28.480 INFO:tasks.workunit.client.0.smithi071.stdout:5/752: creat dc/df/d3e/d5a/dd4/f102 x:0 0 0 2024-09-10T10:04:28.480 INFO:tasks.workunit.client.0.smithi071.stdout:6/699: symlink d4/da/df/d2e/le3 0 2024-09-10T10:04:28.481 INFO:tasks.workunit.client.0.smithi071.stdout:0/934: creat d11/d22/d31/d72/d129/f14f x:0 0 0 2024-09-10T10:04:28.481 INFO:tasks.workunit.client.0.smithi071.stdout:7/975: truncate d9/d2c/d49/fbd 820849 0 2024-09-10T10:04:28.481 INFO:tasks.workunit.client.1.smithi107.stdout:8/753: creat d5/d8/d2a/d35/fff x:0 0 0 2024-09-10T10:04:28.483 INFO:tasks.workunit.client.0.smithi071.stdout:8/841: creat d5/df/d1d/d86/d90/d109/f123 x:0 0 0 2024-09-10T10:04:28.485 INFO:tasks.workunit.client.0.smithi071.stdout:0/935: mknod d11/d1e/dfa/d79/df8/c150 0 2024-09-10T10:04:28.487 INFO:tasks.workunit.client.0.smithi071.stdout:6/700: creat d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/fe4 x:0 0 0 2024-09-10T10:04:28.488 INFO:tasks.workunit.client.1.smithi107.stdout:5/905: dwrite de/d20/f5d [0,4194304] 0 2024-09-10T10:04:28.490 INFO:tasks.workunit.client.0.smithi071.stdout:7/976: rename d9/d15/d40/d80/dd6/c12b to d9/ddb/d12e/d136/d108/d10c/d118/d105/c158 0 2024-09-10T10:04:28.492 INFO:tasks.workunit.client.1.smithi107.stdout:7/780: write d0/d1b/d4d/fed [1202866,105564] 0 2024-09-10T10:04:28.495 INFO:tasks.workunit.client.0.smithi071.stdout:0/936: rename d11/d22/d31/c54 to d11/d22/d31/d72/c151 0 2024-09-10T10:04:28.496 INFO:tasks.workunit.client.0.smithi071.stdout:8/842: dwrite d5/df/d67/fed [0,4194304] 0 2024-09-10T10:04:28.498 INFO:tasks.workunit.client.0.smithi071.stdout:0/937: stat d11/d22/d40/fc8 0 2024-09-10T10:04:28.498 INFO:tasks.workunit.client.0.smithi071.stdout:7/977: creat d9/d76/f159 x:0 0 0 2024-09-10T10:04:28.499 INFO:tasks.workunit.client.1.smithi107.stdout:2/847: dread d3/da/d1e/d27/fd3 [0,4194304] 0 2024-09-10T10:04:28.501 INFO:tasks.workunit.client.0.smithi071.stdout:3/819: dread d3/d49/d34/f81 [0,4194304] 0 2024-09-10T10:04:28.501 INFO:tasks.workunit.client.1.smithi107.stdout:5/906: rename de/d20/d2b/d4b/c56 to de/d20/d2b/d4b/d5e/d116/c12c 0 2024-09-10T10:04:28.502 INFO:tasks.workunit.client.0.smithi071.stdout:0/938: symlink d11/d1e/dfa/d79/de6/l152 0 2024-09-10T10:04:28.505 INFO:tasks.workunit.client.0.smithi071.stdout:7/978: chown d9/d15/d1f/d74/c154 234306 1 2024-09-10T10:04:28.508 INFO:tasks.workunit.client.0.smithi071.stdout:5/753: dwrite f4 [4194304,4194304] 0 2024-09-10T10:04:28.509 INFO:tasks.workunit.client.0.smithi071.stdout:6/701: write d4/d61/d83/da8/f71 [996882,83810] 0 2024-09-10T10:04:28.510 INFO:tasks.workunit.client.0.smithi071.stdout:7/979: read d9/d1a/d1d/f57 [5005542,249] 0 2024-09-10T10:04:28.510 INFO:tasks.workunit.client.1.smithi107.stdout:2/848: link d3/da/d66/d91/dea/ffd d3/da/df/d20/d36/d39/da3/ddb/d12b/d129/f12d 0 2024-09-10T10:04:28.512 INFO:tasks.workunit.client.1.smithi107.stdout:7/781: getdents d0/d1b/d4d/d69/d97/d68 0 2024-09-10T10:04:28.513 INFO:tasks.workunit.client.0.smithi071.stdout:5/754: mknod dc/df/d29/d94/c103 0 2024-09-10T10:04:28.514 INFO:tasks.workunit.client.1.smithi107.stdout:8/754: dwrite d5/d8/f32 [0,4194304] 0 2024-09-10T10:04:28.514 INFO:tasks.workunit.client.1.smithi107.stdout:4/992: dread d0/f12 [4194304,4194304] 0 2024-09-10T10:04:28.515 INFO:tasks.workunit.client.1.smithi107.stdout:7/782: symlink d0/d8/d56/d5d/l100 0 2024-09-10T10:04:28.517 INFO:tasks.workunit.client.0.smithi071.stdout:7/980: symlink d9/d15/d1f/d98/l15a 0 2024-09-10T10:04:28.518 INFO:tasks.workunit.client.1.smithi107.stdout:4/993: chown d0/d40/d57/d76/d77/da1/l154 2802 1 2024-09-10T10:04:28.520 INFO:tasks.workunit.client.0.smithi071.stdout:6/702: rename d4/da/df/d2e/d3a/d51/d64/f70 to d4/da/df/d2e/d3a/da9/dbc/dc3/fe5 0 2024-09-10T10:04:28.522 INFO:tasks.workunit.client.0.smithi071.stdout:5/755: creat dc/d53/d101/f104 x:0 0 0 2024-09-10T10:04:28.524 INFO:tasks.workunit.client.1.smithi107.stdout:4/994: creat d0/d40/d57/d76/d77/f156 x:0 0 0 2024-09-10T10:04:28.524 INFO:tasks.workunit.client.0.smithi071.stdout:5/756: dread - dc/fff zero size 2024-09-10T10:04:28.524 INFO:tasks.workunit.client.1.smithi107.stdout:2/849: link d3/da/d1e/d40/d8a/f8c d3/da/f12e 0 2024-09-10T10:04:28.527 INFO:tasks.workunit.client.1.smithi107.stdout:7/783: dwrite d0/d1b/d4d/fed [0,4194304] 0 2024-09-10T10:04:28.529 INFO:tasks.workunit.client.1.smithi107.stdout:8/755: dwrite d5/d8/d5b/fb0 [0,4194304] 0 2024-09-10T10:04:28.530 INFO:tasks.workunit.client.1.smithi107.stdout:2/850: chown d3/f18 1824971 1 2024-09-10T10:04:28.531 INFO:tasks.workunit.client.0.smithi071.stdout:0/939: dwrite d11/d22/d31/d72/df3/f107 [0,4194304] 0 2024-09-10T10:04:28.532 INFO:tasks.workunit.client.1.smithi107.stdout:4/995: mknod d0/d1f/d20/d80/c157 0 2024-09-10T10:04:28.532 INFO:tasks.workunit.client.0.smithi071.stdout:6/703: truncate d4/da/df/d2e/d3a/d91/fa6 783296 0 2024-09-10T10:04:28.533 INFO:tasks.workunit.client.0.smithi071.stdout:8/843: dread d5/d36/f6d [4194304,4194304] 0 2024-09-10T10:04:28.534 INFO:tasks.workunit.client.1.smithi107.stdout:2/851: fdatasync d3/da/d1e/fe3 0 2024-09-10T10:04:28.534 INFO:tasks.workunit.client.1.smithi107.stdout:5/907: dwrite de/d20/d2b/d4b/d5e/d116/f81 [0,4194304] 0 2024-09-10T10:04:28.535 INFO:tasks.workunit.client.0.smithi071.stdout:5/757: truncate dc/df/dd7/f7d 5033313 0 2024-09-10T10:04:28.535 INFO:tasks.workunit.client.1.smithi107.stdout:8/756: symlink d5/d8/d5b/l100 0 2024-09-10T10:04:28.536 INFO:tasks.workunit.client.1.smithi107.stdout:7/784: symlink d0/d1b/d4d/l101 0 2024-09-10T10:04:28.536 INFO:tasks.workunit.client.0.smithi071.stdout:6/704: symlink d4/da/df/d2e/d3a/d91/le6 0 2024-09-10T10:04:28.537 INFO:tasks.workunit.client.0.smithi071.stdout:3/820: dwrite d3/f70 [0,4194304] 0 2024-09-10T10:04:28.538 INFO:tasks.workunit.client.1.smithi107.stdout:7/785: write d0/f27 [994895,78867] 0 2024-09-10T10:04:28.545 INFO:tasks.workunit.client.0.smithi071.stdout:8/844: mknod d5/df/d1e/d70/c124 0 2024-09-10T10:04:28.545 INFO:tasks.workunit.client.0.smithi071.stdout:6/705: truncate d4/da/df/d2e/d3a/d91/dc7/d81/fda 77330 0 2024-09-10T10:04:28.546 INFO:tasks.workunit.client.0.smithi071.stdout:5/758: chown dc/df/d29/d48/c84 117001717 1 2024-09-10T10:04:28.547 INFO:tasks.workunit.client.1.smithi107.stdout:7/786: symlink d0/d8/d5c/l102 0 2024-09-10T10:04:28.548 INFO:tasks.workunit.client.1.smithi107.stdout:7/787: write d0/d8/d5c/fbe [1549871,12017] 0 2024-09-10T10:04:28.550 INFO:tasks.workunit.client.0.smithi071.stdout:6/706: symlink d4/da/df/d2e/d3a/d51/d64/le7 0 2024-09-10T10:04:28.555 INFO:tasks.workunit.client.1.smithi107.stdout:5/908: creat de/d20/d2b/f12d x:0 0 0 2024-09-10T10:04:28.555 INFO:tasks.workunit.client.1.smithi107.stdout:2/852: creat d3/da/df/d20/d36/d4f/f12f x:0 0 0 2024-09-10T10:04:28.556 INFO:tasks.workunit.client.0.smithi071.stdout:5/759: dwrite dc/d53/d6a/f96 [0,4194304] 0 2024-09-10T10:04:28.556 INFO:tasks.workunit.client.1.smithi107.stdout:7/788: truncate d0/d8/dc/d2c/f7c 5068929 0 2024-09-10T10:04:28.557 INFO:tasks.workunit.client.0.smithi071.stdout:3/821: dread - d3/d49/d2f/d7f/fc9 zero size 2024-09-10T10:04:28.558 INFO:tasks.workunit.client.1.smithi107.stdout:5/909: chown de/d20/d2b/d4b/d5e/d116/d4e/fa9 2971613 1 2024-09-10T10:04:28.559 INFO:tasks.workunit.client.0.smithi071.stdout:5/760: readlink dc/d4a/l4e 0 2024-09-10T10:04:28.560 INFO:tasks.workunit.client.1.smithi107.stdout:7/789: creat d0/d8/d5c/f103 x:0 0 0 2024-09-10T10:04:28.562 INFO:tasks.workunit.client.0.smithi071.stdout:0/940: rename d11/d22/d9a/fd5 to d11/d22/d9a/f153 0 2024-09-10T10:04:28.562 INFO:tasks.workunit.client.1.smithi107.stdout:7/790: stat d0/d8/d5c/c88 0 2024-09-10T10:04:28.563 INFO:tasks.workunit.client.1.smithi107.stdout:2/853: symlink d3/da/df/d20/dfb/l130 0 2024-09-10T10:04:28.568 INFO:tasks.workunit.client.1.smithi107.stdout:7/791: mknod d0/d20/d72/c104 0 2024-09-10T10:04:28.569 INFO:tasks.workunit.client.1.smithi107.stdout:5/910: dwrite de/d20/d2b/d4b/f71 [4194304,4194304] 0 2024-09-10T10:04:28.570 INFO:tasks.workunit.client.0.smithi071.stdout:0/941: dwrite d11/d1e/dfa/fc9 [0,4194304] 0 2024-09-10T10:04:28.570 INFO:tasks.workunit.client.1.smithi107.stdout:7/792: write d0/d8/d56/dcc/f55 [1522673,48185] 0 2024-09-10T10:04:28.573 INFO:tasks.workunit.client.0.smithi071.stdout:0/942: chown d11/d22/d9a/f13d 1520726 1 2024-09-10T10:04:28.575 INFO:tasks.workunit.client.0.smithi071.stdout:0/943: read d11/d1e/dfa/d5f/fd6 [40978,86908] 0 2024-09-10T10:04:28.575 INFO:tasks.workunit.client.1.smithi107.stdout:2/854: link d3/da/d1e/f24 d3/da/d1e/d40/d8a/d7f/d55/d85/f131 0 2024-09-10T10:04:28.580 INFO:tasks.workunit.client.0.smithi071.stdout:7/981: dread d9/d15/d40/d80/ddd/de2/fec [0,4194304] 0 2024-09-10T10:04:28.581 INFO:tasks.workunit.client.0.smithi071.stdout:7/982: stat d9/d2c/l103 0 2024-09-10T10:04:28.582 INFO:tasks.workunit.client.1.smithi107.stdout:2/855: dread d3/da/d66/db7/f11a [0,4194304] 0 2024-09-10T10:04:28.583 INFO:tasks.workunit.client.0.smithi071.stdout:0/944: rename d11/d1e/dfa/ff0 to d11/d22/f154 0 2024-09-10T10:04:28.585 INFO:tasks.workunit.client.1.smithi107.stdout:4/996: truncate d0/d1f/d20/d47/d8c/dfe/f10b 1628032 0 2024-09-10T10:04:28.585 INFO:tasks.workunit.client.0.smithi071.stdout:3/822: truncate d3/d1c/d3c/f69 2950320 0 2024-09-10T10:04:28.586 INFO:tasks.workunit.client.1.smithi107.stdout:4/997: chown d0/d6b/c101 107029 1 2024-09-10T10:04:28.586 INFO:tasks.workunit.client.1.smithi107.stdout:4/998: stat d0/f12 0 2024-09-10T10:04:28.587 INFO:tasks.workunit.client.1.smithi107.stdout:8/757: truncate d5/d8/d66/d8b/fba 560880 0 2024-09-10T10:04:28.588 INFO:tasks.workunit.client.0.smithi071.stdout:7/983: mkdir d9/d15/d40/d80/d15b 0 2024-09-10T10:04:28.588 INFO:tasks.workunit.client.0.smithi071.stdout:0/945: mkdir d11/d1e/dfa/d5f/d155 0 2024-09-10T10:04:28.588 INFO:tasks.workunit.client.0.smithi071.stdout:3/823: fdatasync d3/d20/d99/fff 0 2024-09-10T10:04:28.591 INFO:tasks.workunit.client.0.smithi071.stdout:0/946: chown d11/d1e/dfa/d79/ddc/d109 46781 1 2024-09-10T10:04:28.593 INFO:tasks.workunit.client.0.smithi071.stdout:3/824: creat d3/d49/d4f/f119 x:0 0 0 2024-09-10T10:04:28.594 INFO:tasks.workunit.client.0.smithi071.stdout:6/707: dwrite d4/fb8 [0,4194304] 0 2024-09-10T10:04:28.594 INFO:tasks.workunit.client.0.smithi071.stdout:7/984: creat d9/d15/d1f/d74/da1/f15c x:0 0 0 2024-09-10T10:04:28.596 INFO:tasks.workunit.client.0.smithi071.stdout:0/947: dread d11/d1e/dfa/d5f/fd6 [0,4194304] 0 2024-09-10T10:04:28.597 INFO:tasks.workunit.client.1.smithi107.stdout:2/856: dwrite d3/da/d66/db7/f11a [0,4194304] 0 2024-09-10T10:04:28.598 INFO:tasks.workunit.client.0.smithi071.stdout:0/948: chown d11/d1e/dfa/d5f/cc0 636 1 2024-09-10T10:04:28.598 INFO:tasks.workunit.client.1.smithi107.stdout:4/999: dread d0/d40/d57/d76/d77/da1/d59/f135 [0,4194304] 0 2024-09-10T10:04:28.602 INFO:tasks.workunit.client.0.smithi071.stdout:0/949: dread d11/d1e/dfa/f110 [0,4194304] 0 2024-09-10T10:04:28.602 INFO:tasks.workunit.client.1.smithi107.stdout:5/911: dwrite de/d20/d2b/d4b/d5e/d116/d5c/faa [0,4194304] 0 2024-09-10T10:04:28.604 INFO:tasks.workunit.client.0.smithi071.stdout:5/761: dread dc/df/d3e/d5a/f71 [0,4194304] 0 2024-09-10T10:04:28.604 INFO:tasks.workunit.client.0.smithi071.stdout:3/825: creat d3/d20/d99/d9b/dde/f11a x:0 0 0 2024-09-10T10:04:28.604 INFO:tasks.workunit.client.1.smithi107.stdout:8/758: link d5/d8/d66/d8b/d18/da4/cf1 d5/d8/d66/d8b/d1a/d75/c101 0 2024-09-10T10:04:28.605 INFO:tasks.workunit.client.0.smithi071.stdout:3/826: stat d3/d49/d2f/f35 0 2024-09-10T10:04:28.606 INFO:tasks.workunit.client.0.smithi071.stdout:0/950: write d11/d1e/dfa/fc9 [4964718,64332] 0 2024-09-10T10:04:28.607 INFO:tasks.workunit.client.1.smithi107.stdout:5/912: creat de/d20/d2b/d4b/d5e/d116/d5c/f12e x:0 0 0 2024-09-10T10:04:28.607 INFO:tasks.workunit.client.1.smithi107.stdout:8/759: write d5/d8/d66/d8b/d1a/f1f [2602448,128394] 0 2024-09-10T10:04:28.609 INFO:tasks.workunit.client.1.smithi107.stdout:5/913: write de/d20/d2b/d4b/d8c/f11a [568191,40912] 0 2024-09-10T10:04:28.611 INFO:tasks.workunit.client.0.smithi071.stdout:5/762: mknod dc/c105 0 2024-09-10T10:04:28.611 INFO:tasks.workunit.client.1.smithi107.stdout:2/857: rename d3/da/d1e/d27/d5b/c6b to d3/da/d1e/d40/d8a/d7f/d55/d85/c132 0 2024-09-10T10:04:28.612 INFO:tasks.workunit.client.0.smithi071.stdout:5/763: fdatasync dc/df/dd7/f35 0 2024-09-10T10:04:28.612 INFO:tasks.workunit.client.0.smithi071.stdout:3/827: chown d3/d1c/d3c/da1/d5d/d9d/fa6 1 1 2024-09-10T10:04:28.613 INFO:tasks.workunit.client.0.smithi071.stdout:6/708: creat d4/da/df/d2e/d3a/fe8 x:0 0 0 2024-09-10T10:04:28.614 INFO:tasks.workunit.client.1.smithi107.stdout:5/914: mkdir de/d20/d2b/d4b/d8c/d12f 0 2024-09-10T10:04:28.616 INFO:tasks.workunit.client.0.smithi071.stdout:6/709: chown d4/da/df/d2e/d3a 5 1 2024-09-10T10:04:28.617 INFO:tasks.workunit.client.0.smithi071.stdout:6/710: chown d4/da/df/d2e/ld3 6 1 2024-09-10T10:04:28.617 INFO:tasks.workunit.client.1.smithi107.stdout:2/858: mknod d3/da/df/d20/d36/d39/da3/dd0/c133 0 2024-09-10T10:04:28.618 INFO:tasks.workunit.client.1.smithi107.stdout:5/915: creat de/d20/d2b/d4b/d5e/d116/d5c/f130 x:0 0 0 2024-09-10T10:04:28.619 INFO:tasks.workunit.client.0.smithi071.stdout:7/985: link d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/dd2/dae/le7 d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/de8/l15d 0 2024-09-10T10:04:28.619 INFO:tasks.workunit.client.0.smithi071.stdout:6/711: dread - d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/fe0 zero size 2024-09-10T10:04:28.620 INFO:tasks.workunit.client.0.smithi071.stdout:6/712: dread - d4/d61/d83/da8/fca zero size 2024-09-10T10:04:28.621 INFO:tasks.workunit.client.1.smithi107.stdout:2/859: symlink d3/da/df/d20/d36/d4f/d92/dec/l134 0 2024-09-10T10:04:28.623 INFO:tasks.workunit.client.0.smithi071.stdout:6/713: mknod d4/da/df/d2e/d3a/d40/d60/ce9 0 2024-09-10T10:04:28.623 INFO:tasks.workunit.client.0.smithi071.stdout:3/828: dread d3/d49/d34/f75 [4194304,4194304] 0 2024-09-10T10:04:28.624 INFO:tasks.workunit.client.0.smithi071.stdout:7/986: creat d9/ddb/d12e/d136/d108/d10c/d118/d105/d137/dd2/f15e x:0 0 0 2024-09-10T10:04:28.629 INFO:tasks.workunit.client.1.smithi107.stdout:8/760: write d5/d42/f65 [2927841,42717] 0 2024-09-10T10:04:28.631 INFO:tasks.workunit.client.1.smithi107.stdout:2/860: truncate d3/d21/f32 2911315 0 2024-09-10T10:04:28.632 INFO:tasks.workunit.client.1.smithi107.stdout:8/761: symlink d5/d8/d66/d8b/d1a/d64/db9/l102 0 2024-09-10T10:04:28.633 INFO:tasks.workunit.client.1.smithi107.stdout:2/861: symlink d3/da/d66/db7/l135 0 2024-09-10T10:04:28.637 INFO:tasks.workunit.client.1.smithi107.stdout:5/916: dread de/d20/d2b/faf [0,4194304] 0 2024-09-10T10:04:28.639 INFO:tasks.workunit.client.1.smithi107.stdout:8/762: truncate d5/d8/f32 3730550 0 2024-09-10T10:04:28.641 INFO:tasks.workunit.client.1.smithi107.stdout:5/917: symlink de/d20/d2b/dcc/d103/l131 0 2024-09-10T10:04:28.642 INFO:tasks.workunit.client.1.smithi107.stdout:8/763: rename d5/d8/d2a/d35/f59 to d5/d8/d66/d8b/d1a/d64/f103 0 2024-09-10T10:04:28.644 INFO:tasks.workunit.client.1.smithi107.stdout:8/764: fsync d5/d8/d66/d8b/d18/fb2 0 2024-09-10T10:04:28.651 INFO:tasks.workunit.client.1.smithi107.stdout:2/862: dread d3/da/d1e/f24 [0,4194304] 0 2024-09-10T10:04:28.651 INFO:tasks.workunit.client.1.smithi107.stdout:2/863: stat d3/da/d1e/f113 0 2024-09-10T10:04:28.655 INFO:tasks.workunit.client.1.smithi107.stdout:8/765: dread d5/d8/d5b/f74 [0,4194304] 0 2024-09-10T10:04:28.656 INFO:tasks.workunit.client.1.smithi107.stdout:2/864: dread d3/da/d66/d91/dea/ffd [0,4194304] 0 2024-09-10T10:04:28.657 INFO:tasks.workunit.client.1.smithi107.stdout:8/766: write d5/d8/d66/d8b/d1a/d64/db9/fbf [322083,76301] 0 2024-09-10T10:04:28.658 INFO:tasks.workunit.client.1.smithi107.stdout:2/865: fsync d3/da/df/d20/d36/d4f/d92/f12c 0 2024-09-10T10:04:28.659 INFO:tasks.workunit.client.1.smithi107.stdout:8/767: mkdir d5/d8/d66/d8e/d104 0 2024-09-10T10:04:28.659 INFO:tasks.workunit.client.1.smithi107.stdout:2/866: write d3/da/df/d20/f57 [1927531,18294] 0 2024-09-10T10:04:28.662 INFO:tasks.workunit.client.1.smithi107.stdout:2/867: rename d3/da/d66/d91 to d3/da/df/d20/dfb/d136 0 2024-09-10T10:04:28.663 INFO:tasks.workunit.client.1.smithi107.stdout:2/868: chown d3/da/d1e/d40/d8a/d7f/d55/l5a 1 1 2024-09-10T10:04:28.664 INFO:tasks.workunit.client.1.smithi107.stdout:2/869: read - d3/da/d1e/d40/d8a/d7f/f5d zero size 2024-09-10T10:04:28.665 INFO:tasks.workunit.client.1.smithi107.stdout:2/870: dread - d3/da/d1e/d40/d8a/d7f/d55/d85/de4/fe9 zero size 2024-09-10T10:04:28.667 INFO:tasks.workunit.client.1.smithi107.stdout:2/871: mkdir d3/da/df/d20/d36/d39/da3/d123/d137 0 2024-09-10T10:04:28.668 INFO:tasks.workunit.client.1.smithi107.stdout:2/872: chown d3/da/df/d20/d36/d39/da3/ddb/d12b/fab 25655 1 2024-09-10T10:04:28.674 INFO:tasks.workunit.client.1.smithi107.stdout:2/873: write d3/da/d1e/d5f/f34 [1873268,15101] 0 2024-09-10T10:04:28.675 INFO:tasks.workunit.client.1.smithi107.stdout:2/874: chown d3/da/d1e/d40/d8a/l107 17371 1 2024-09-10T10:04:28.676 INFO:tasks.workunit.client.1.smithi107.stdout:2/875: dread - d3/da/df/d20/d36/d4f/f12f zero size 2024-09-10T10:04:28.677 INFO:tasks.workunit.client.1.smithi107.stdout:2/876: read d3/da/df/d78/f80 [2049776,81995] 0 2024-09-10T10:04:28.679 INFO:tasks.workunit.client.1.smithi107.stdout:2/877: rmdir d3/d8f/de0 0 2024-09-10T10:04:28.681 INFO:tasks.workunit.client.1.smithi107.stdout:2/878: truncate d3/da/df/d20/d36/d39/da3/ddb/d12b/fd5 1091370 0 2024-09-10T10:04:28.685 INFO:tasks.workunit.client.1.smithi107.stdout:2/879: write d3/da/d66/fd1 [650636,55276] 0 2024-09-10T10:04:28.688 INFO:tasks.workunit.client.1.smithi107.stdout:2/880: rename d3/da/df/d20/d36/fd8 to d3/da/d1e/d5f/dad/deb/f138 0 2024-09-10T10:04:28.688 INFO:tasks.workunit.client.1.smithi107.stdout:2/881: readlink d3/da/df/d20/dfb/l130 0 2024-09-10T10:04:28.693 INFO:tasks.workunit.client.1.smithi107.stdout:2/882: dwrite d3/d8f/f11e [0,4194304] 0 2024-09-10T10:04:28.694 INFO:tasks.workunit.client.1.smithi107.stdout:2/883: stat d3/da/df/d20/d36/d39/da3/d123 0 2024-09-10T10:04:28.697 INFO:tasks.workunit.client.1.smithi107.stdout:2/884: creat d3/da/d1e/d5f/d54/d114/f139 x:0 0 0 2024-09-10T10:04:28.698 INFO:tasks.workunit.client.1.smithi107.stdout:2/885: write d3/da/d1e/d40/d8a/d7f/d55/d85/f8e [1585985,67933] 0 2024-09-10T10:04:28.699 INFO:tasks.workunit.client.1.smithi107.stdout:2/886: stat d3/da/d1e/d5f/d54/d114 0 2024-09-10T10:04:28.708 INFO:tasks.workunit.client.1.smithi107.stdout:2/887: write d3/da/df/d20/d36/d4f/faa [1853627,20862] 0 2024-09-10T10:04:28.712 INFO:tasks.workunit.client.1.smithi107.stdout:2/888: dread d3/da/d1e/d40/d8a/d7f/d55/d85/f131 [0,4194304] 0 2024-09-10T10:04:28.716 INFO:tasks.workunit.client.1.smithi107.stdout:2/889: link d3/f6c d3/da/df/d20/dfb/d136/dea/f13a 0 2024-09-10T10:04:28.731 INFO:tasks.workunit.client.1.smithi107.stdout:9/801: sync 2024-09-10T10:04:28.731 INFO:tasks.workunit.client.1.smithi107.stdout:6/875: sync 2024-09-10T10:04:28.732 INFO:tasks.workunit.client.1.smithi107.stdout:9/802: chown d5/d7/fb2 158892513 1 2024-09-10T10:04:28.736 INFO:tasks.workunit.client.1.smithi107.stdout:9/803: rename d5/d7/d3c to d5/d7/d1d/d41/dc8/dfc/d10d 0 2024-09-10T10:04:28.740 INFO:tasks.workunit.client.1.smithi107.stdout:6/876: creat d0/d3d/d14/d42/f136 x:0 0 0 2024-09-10T10:04:28.740 INFO:tasks.workunit.client.1.smithi107.stdout:9/804: creat d5/d7/d1d/d41/dc8/f10e x:0 0 0 2024-09-10T10:04:28.745 INFO:tasks.workunit.client.1.smithi107.stdout:9/805: write d5/d7/d1d/d9b/dab/d57/fd4 [1379882,130017] 0 2024-09-10T10:04:28.749 INFO:tasks.workunit.client.1.smithi107.stdout:9/806: write d5/d7/d1d/d9b/dab/d57/d87/f89 [1484445,110955] 0 2024-09-10T10:04:28.750 INFO:tasks.workunit.client.1.smithi107.stdout:6/877: dwrite d0/d3d/d14/d17/f36 [0,4194304] 0 2024-09-10T10:04:28.751 INFO:tasks.workunit.client.1.smithi107.stdout:6/878: chown d0/d3d/d14/d21/d8a/d8d/f117 181829087 1 2024-09-10T10:04:28.756 INFO:tasks.workunit.client.1.smithi107.stdout:9/807: write d5/d7/d1d/d9b/de5/ff4 [3196987,95292] 0 2024-09-10T10:04:28.759 INFO:tasks.workunit.client.1.smithi107.stdout:9/808: mknod d5/d1e/dc5/de0/c10f 0 2024-09-10T10:04:28.765 INFO:tasks.workunit.client.0.smithi071.stdout:3/829: dread - d3/d1c/f7c zero size 2024-09-10T10:04:28.765 INFO:tasks.workunit.client.1.smithi107.stdout:9/809: dwrite d5/d7/d1d/d41/dc8/dfc/d10d/fde [0,4194304] 0 2024-09-10T10:04:28.765 INFO:tasks.workunit.client.0.smithi071.stdout:5/764: truncate dc/df/d29/d94/fb3 1009458 0 2024-09-10T10:04:28.766 INFO:tasks.workunit.client.0.smithi071.stdout:7/987: mkdir d9/d15/d1f/d98/d15f 0 2024-09-10T10:04:28.766 INFO:tasks.workunit.client.0.smithi071.stdout:6/714: write d4/da/df/d5e/f75 [4640324,64237] 0 2024-09-10T10:04:28.766 INFO:tasks.workunit.client.1.smithi107.stdout:9/810: dread - d5/d7/d1d/d29/d101/f103 zero size 2024-09-10T10:04:28.769 INFO:tasks.workunit.client.1.smithi107.stdout:9/811: mknod d5/d1e/c110 0 2024-09-10T10:04:28.769 INFO:tasks.workunit.client.0.smithi071.stdout:3/830: rename d3/d1c/d3e/f97 to d3/d1c/f11b 0 2024-09-10T10:04:28.771 INFO:tasks.workunit.client.0.smithi071.stdout:7/988: mkdir d9/d15/d1f/d74/d160 0 2024-09-10T10:04:28.771 INFO:tasks.workunit.client.1.smithi107.stdout:9/812: chown d5/d7/d1d/d9b/dab/d57/d87/d37/c3d 2 1 2024-09-10T10:04:28.773 INFO:tasks.workunit.client.0.smithi071.stdout:0/951: dwrite d11/d22/f6f [0,4194304] 0 2024-09-10T10:04:28.773 INFO:tasks.workunit.client.0.smithi071.stdout:6/715: unlink d4/da/df/d2e/d3a/d43/f4c 0 2024-09-10T10:04:28.773 INFO:tasks.workunit.client.1.smithi107.stdout:9/813: fdatasync d5/d7/f8b 0 2024-09-10T10:04:28.777 INFO:tasks.workunit.client.0.smithi071.stdout:7/989: fsync d9/d15/d1f/d74/da1/dcf/de1/f12c 0 2024-09-10T10:04:28.777 INFO:tasks.workunit.client.1.smithi107.stdout:9/814: unlink d5/d7/d1d/d41/d83/d9a/l6e 0 2024-09-10T10:04:28.778 INFO:tasks.workunit.client.1.smithi107.stdout:6/879: dread d0/d3d/d14/d9f/dca/f86 [0,4194304] 0 2024-09-10T10:04:28.781 INFO:tasks.workunit.client.0.smithi071.stdout:6/716: mknod d4/da/df/d2e/d3a/da9/dbc/cea 0 2024-09-10T10:04:28.782 INFO:tasks.workunit.client.0.smithi071.stdout:5/765: dwrite dc/df/d17/d8d/de4/fe6 [0,4194304] 0 2024-09-10T10:04:28.782 INFO:tasks.workunit.client.0.smithi071.stdout:6/717: stat l2 0 2024-09-10T10:04:28.783 INFO:tasks.workunit.client.0.smithi071.stdout:3/831: dwrite d3/d1c/d3c/fa2 [0,4194304] 0 2024-09-10T10:04:28.783 INFO:tasks.workunit.client.0.smithi071.stdout:0/952: unlink d11/d1e/dfa/d79/df8/c150 0 2024-09-10T10:04:28.786 INFO:tasks.workunit.client.0.smithi071.stdout:6/718: write d4/fc5 [1002867,55526] 0 2024-09-10T10:04:28.786 INFO:tasks.workunit.client.1.smithi107.stdout:6/880: rename d0/d3d/d14/d21/d8a/db9 to d0/d3d/d14/d17/d137 0 2024-09-10T10:04:28.789 INFO:tasks.workunit.client.0.smithi071.stdout:5/766: rename dc/df/d29/d48/c66 to dc/d4a/c106 0 2024-09-10T10:04:28.790 INFO:tasks.workunit.client.0.smithi071.stdout:0/953: creat d11/d22/d31/d72/f156 x:0 0 0 2024-09-10T10:04:28.790 INFO:tasks.workunit.client.1.smithi107.stdout:9/815: truncate d5/d1e/f9f 904108 0 2024-09-10T10:04:28.790 INFO:tasks.workunit.client.0.smithi071.stdout:6/719: mknod d4/da/df/d2e/d3a/da9/dbc/dc3/ceb 0 2024-09-10T10:04:28.793 INFO:tasks.workunit.client.0.smithi071.stdout:0/954: fsync d11/d22/d9a/fab 0 2024-09-10T10:04:28.793 INFO:tasks.workunit.client.0.smithi071.stdout:5/767: dread dc/df/d29/d94/fcc [0,4194304] 0 2024-09-10T10:04:28.797 INFO:tasks.workunit.client.1.smithi107.stdout:9/816: dwrite d5/d7/d1d/db5/fcc [0,4194304] 0 2024-09-10T10:04:28.797 INFO:tasks.workunit.client.0.smithi071.stdout:5/768: symlink dc/d53/d79/l107 0 2024-09-10T10:04:28.799 INFO:tasks.workunit.client.1.smithi107.stdout:6/881: creat d0/d3d/d14/d21/d124/f138 x:0 0 0 2024-09-10T10:04:28.799 INFO:tasks.workunit.client.1.smithi107.stdout:9/817: fdatasync d5/f64 0 2024-09-10T10:04:28.800 INFO:tasks.workunit.client.0.smithi071.stdout:6/720: dread d4/da/df/d2e/d3a/d51/d64/f72 [0,4194304] 0 2024-09-10T10:04:28.801 INFO:tasks.workunit.client.1.smithi107.stdout:6/882: rmdir d0/df0 39 2024-09-10T10:04:28.803 INFO:tasks.workunit.client.0.smithi071.stdout:5/769: creat dc/df/d29/d94/f108 x:0 0 0 2024-09-10T10:04:28.804 INFO:tasks.workunit.client.0.smithi071.stdout:0/955: dwrite d11/d22/d31/d72/d129/f14f [0,4194304] 0 2024-09-10T10:04:28.805 INFO:tasks.workunit.client.0.smithi071.stdout:6/721: chown d4/da/df/d2e/d3a/d91/dc7/d97/fdb 888 1 2024-09-10T10:04:28.807 INFO:tasks.workunit.client.1.smithi107.stdout:9/818: dwrite d5/d1e/f88 [0,4194304] 0 2024-09-10T10:04:28.808 INFO:tasks.workunit.client.0.smithi071.stdout:0/956: creat d11/d22/d31/d72/d129/f157 x:0 0 0 2024-09-10T10:04:28.813 INFO:tasks.workunit.client.0.smithi071.stdout:5/770: getdents dc/df/d3e/d5a/d80 0 2024-09-10T10:04:28.814 INFO:tasks.workunit.client.0.smithi071.stdout:7/990: write d9/d15/d1f/fef [820054,22013] 0 2024-09-10T10:04:28.815 INFO:tasks.workunit.client.1.smithi107.stdout:9/819: mkdir d5/d7/d1d/d41/d83/d9a/d8c/d111 0 2024-09-10T10:04:28.815 INFO:tasks.workunit.client.0.smithi071.stdout:5/771: write dc/df/d3e/d5a/fca [1658366,90717] 0 2024-09-10T10:04:28.816 INFO:tasks.workunit.client.0.smithi071.stdout:5/772: dread - dc/df/d29/d94/fd8 zero size 2024-09-10T10:04:28.818 INFO:tasks.workunit.client.1.smithi107.stdout:9/820: fdatasync d5/d7/d1d/d9b/dab/d57/f8a 0 2024-09-10T10:04:28.818 INFO:tasks.workunit.client.0.smithi071.stdout:7/991: unlink d9/d15/d1f/d74/c154 0 2024-09-10T10:04:28.821 INFO:tasks.workunit.client.0.smithi071.stdout:5/773: creat dc/df/d3e/d5a/dd4/f109 x:0 0 0 2024-09-10T10:04:28.822 INFO:tasks.workunit.client.0.smithi071.stdout:5/774: rmdir dc/d4a 39 2024-09-10T10:04:28.823 INFO:tasks.workunit.client.1.smithi107.stdout:9/821: mkdir d5/d1e/dc5/d112 0 2024-09-10T10:04:28.824 INFO:tasks.workunit.client.0.smithi071.stdout:7/992: mkdir d9/d15/d161 0 2024-09-10T10:04:28.825 INFO:tasks.workunit.client.0.smithi071.stdout:5/775: dread - dc/df/d3e/fd1 zero size 2024-09-10T10:04:28.827 INFO:tasks.workunit.client.0.smithi071.stdout:7/993: creat d9/d1a/d1d/df9/f162 x:0 0 0 2024-09-10T10:04:28.828 INFO:tasks.workunit.client.0.smithi071.stdout:5/776: read dc/df/d17/d8d/fb0 [213724,20923] 0 2024-09-10T10:04:28.829 INFO:tasks.workunit.client.0.smithi071.stdout:0/957: write d11/d22/f91 [666693,8755] 0 2024-09-10T10:04:28.829 INFO:tasks.workunit.client.0.smithi071.stdout:0/958: stat d11/d1e/dfa/d79/lbb 0 2024-09-10T10:04:28.830 INFO:tasks.workunit.client.0.smithi071.stdout:0/959: readlink d11/d30/d70/ldb 0 2024-09-10T10:04:28.830 INFO:tasks.workunit.client.0.smithi071.stdout:0/960: stat d11/d22/d9a/d106 0 2024-09-10T10:04:28.831 INFO:tasks.workunit.client.1.smithi107.stdout:6/883: write d0/d3d/d14/dde/d10c/d12a/f6e [79054,62899] 0 2024-09-10T10:04:28.831 INFO:tasks.workunit.client.0.smithi071.stdout:7/994: unlink d9/ddb/d12e/d136/d108/d10c/d118/f140 0 2024-09-10T10:04:28.832 INFO:tasks.workunit.client.1.smithi107.stdout:6/884: readlink d0/d3d/d14/d21/d8a/da2/l81 0 2024-09-10T10:04:28.832 INFO:tasks.workunit.client.0.smithi071.stdout:5/777: creat dc/d4a/f10a x:0 0 0 2024-09-10T10:04:28.833 INFO:tasks.workunit.client.0.smithi071.stdout:0/961: rmdir d11/d22/d9a 39 2024-09-10T10:04:28.834 INFO:tasks.workunit.client.0.smithi071.stdout:7/995: truncate d9/d15/d40/d80/ddd/de2/d109/f131 730899 0 2024-09-10T10:04:28.835 INFO:tasks.workunit.client.0.smithi071.stdout:5/778: creat dc/df/d3e/d5a/d80/f10b x:0 0 0 2024-09-10T10:04:28.836 INFO:tasks.workunit.client.0.smithi071.stdout:0/962: stat d11/d1e/dfa/c69 0 2024-09-10T10:04:28.836 INFO:tasks.workunit.client.0.smithi071.stdout:7/996: fsync d9/ddb/d12e/d136/d108/d10c/d118/f6e 0 2024-09-10T10:04:28.837 INFO:tasks.workunit.client.0.smithi071.stdout:0/963: fsync d11/d22/d40/fe3 0 2024-09-10T10:04:28.838 INFO:tasks.workunit.client.1.smithi107.stdout:9/822: dwrite d5/d7/d1d/d9b/dab/d57/d87/d37/f80 [4194304,4194304] 0 2024-09-10T10:04:28.840 INFO:tasks.workunit.client.0.smithi071.stdout:7/997: fsync d9/d15/d40/fc4 0 2024-09-10T10:04:28.840 INFO:tasks.workunit.client.1.smithi107.stdout:6/885: dwrite d0/d3d/d14/d17/fb4 [4194304,4194304] 0 2024-09-10T10:04:28.844 INFO:tasks.workunit.client.0.smithi071.stdout:7/998: chown d9/d70/c7b 238195211 1 2024-09-10T10:04:28.844 INFO:tasks.workunit.client.0.smithi071.stdout:5/779: dwrite dc/df/dd7/d87/ffb [0,4194304] 0 2024-09-10T10:04:28.845 INFO:tasks.workunit.client.1.smithi107.stdout:6/886: mknod d0/df0/c139 0 2024-09-10T10:04:28.848 INFO:tasks.workunit.client.1.smithi107.stdout:9/823: creat d5/d7/d1d/d29/db4/f113 x:0 0 0 2024-09-10T10:04:28.848 INFO:tasks.workunit.client.0.smithi071.stdout:0/964: stat d11/d22/d9a/d106/f143 0 2024-09-10T10:04:28.849 INFO:tasks.workunit.client.0.smithi071.stdout:5/780: chown dc/f3c 30 1 2024-09-10T10:04:28.850 INFO:tasks.workunit.client.0.smithi071.stdout:7/999: symlink d9/d1a/da2/l163 0 2024-09-10T10:04:28.852 INFO:tasks.workunit.client.0.smithi071.stdout:5/781: write dc/d53/db2/f8e [1398077,107350] 0 2024-09-10T10:04:28.853 INFO:tasks.workunit.client.0.smithi071.stdout:0/965: mkdir d11/d1e/dfa/d5f/d155/d158 0 2024-09-10T10:04:28.855 INFO:tasks.workunit.client.0.smithi071.stdout:0/966: write d11/d1e/f12e [314094,113208] 0 2024-09-10T10:04:28.856 INFO:tasks.workunit.client.1.smithi107.stdout:9/824: rename d5/d1e/f88 to d5/d7/d1d/d29/db4/dbd/f114 0 2024-09-10T10:04:28.857 INFO:tasks.workunit.client.1.smithi107.stdout:6/887: creat d0/d3d/d14/d21/d8a/da2/da3/f13a x:0 0 0 2024-09-10T10:04:28.857 INFO:tasks.workunit.client.0.smithi071.stdout:0/967: write d11/d22/d31/d72/df3/f107 [3835242,19187] 0 2024-09-10T10:04:28.859 INFO:tasks.workunit.client.1.smithi107.stdout:9/825: chown d5/d7/d1d/d41/d83/d9a/l34 14 1 2024-09-10T10:04:28.860 INFO:tasks.workunit.client.0.smithi071.stdout:0/968: mknod d11/d1e/dfa/d79/df8/c159 0 2024-09-10T10:04:28.860 INFO:tasks.workunit.client.1.smithi107.stdout:6/888: mkdir d0/d3d/d14/d17/d24/df3/d55/d13b 0 2024-09-10T10:04:28.862 INFO:tasks.workunit.client.1.smithi107.stdout:6/889: write d0/d70/faf [380770,23007] 0 2024-09-10T10:04:28.864 INFO:tasks.workunit.client.1.smithi107.stdout:9/826: fdatasync d5/d7/d1d/d3b/fbb 0 2024-09-10T10:04:28.864 INFO:tasks.workunit.client.1.smithi107.stdout:6/890: truncate d0/d3d/d14/d42/f136 526280 0 2024-09-10T10:04:28.867 INFO:tasks.workunit.client.1.smithi107.stdout:9/827: creat d5/d7/d1d/d29/d101/f115 x:0 0 0 2024-09-10T10:04:28.867 INFO:tasks.workunit.client.1.smithi107.stdout:6/891: truncate d0/d3d/d14/d21/f28 4540348 0 2024-09-10T10:04:28.874 INFO:tasks.workunit.client.1.smithi107.stdout:6/892: rmdir d0/d3d/d14/d17/d24/df3/d55/d13b 0 2024-09-10T10:04:28.874 INFO:tasks.workunit.client.1.smithi107.stdout:6/893: chown d0/d3d/d14/d42/l71 1 1 2024-09-10T10:04:28.875 INFO:tasks.workunit.client.1.smithi107.stdout:6/894: readlink d0/d3d/d14/d17/d24/df3/d55/lb5 0 2024-09-10T10:04:28.877 INFO:tasks.workunit.client.0.smithi071.stdout:5/782: dread dc/df/dd7/d87/f92 [0,4194304] 0 2024-09-10T10:04:28.877 INFO:tasks.workunit.client.1.smithi107.stdout:6/895: creat d0/d3d/d14/d17/d24/df3/d55/da6/f13c x:0 0 0 2024-09-10T10:04:28.878 INFO:tasks.workunit.client.1.smithi107.stdout:0/857: sync 2024-09-10T10:04:28.878 INFO:tasks.workunit.client.1.smithi107.stdout:9/828: truncate d5/d7/d1d/d41/d83/d9a/fb7 3086760 0 2024-09-10T10:04:28.881 INFO:tasks.workunit.client.1.smithi107.stdout:9/829: creat d5/d7/d1d/d41/dc8/f116 x:0 0 0 2024-09-10T10:04:28.882 INFO:tasks.workunit.client.1.smithi107.stdout:0/858: symlink d6/d8/d2f/d35/d4f/l11c 0 2024-09-10T10:04:28.886 INFO:tasks.workunit.client.1.smithi107.stdout:0/859: mknod d6/d8/d2f/d2e/d32/d85/c11d 0 2024-09-10T10:04:28.887 INFO:tasks.workunit.client.1.smithi107.stdout:6/896: write d0/d3d/d14/dde/d10c/d12a/fe0 [203007,69860] 0 2024-09-10T10:04:28.889 INFO:tasks.workunit.client.0.smithi071.stdout:0/969: dwrite d11/d22/d31/f4c [0,4194304] 0 2024-09-10T10:04:28.889 INFO:tasks.workunit.client.0.smithi071.stdout:5/783: dwrite dc/df/d29/d94/fb3 [0,4194304] 0 2024-09-10T10:04:28.890 INFO:tasks.workunit.client.0.smithi071.stdout:5/784: chown dc/d53/db2/f8e 362 1 2024-09-10T10:04:28.893 INFO:tasks.workunit.client.1.smithi107.stdout:0/860: dwrite d6/d8/d2f/da3/dee/ff2 [0,4194304] 0 2024-09-10T10:04:28.893 INFO:tasks.workunit.client.0.smithi071.stdout:5/785: fsync dc/d4a/fb7 0 2024-09-10T10:04:28.897 INFO:tasks.workunit.client.1.smithi107.stdout:6/897: creat d0/d3d/d14/d17/d24/df3/d55/d73/f13d x:0 0 0 2024-09-10T10:04:28.897 INFO:tasks.workunit.client.0.smithi071.stdout:5/786: creat dc/d4a/dbb/f10c x:0 0 0 2024-09-10T10:04:28.902 INFO:tasks.workunit.client.0.smithi071.stdout:0/970: dread d11/d22/d40/f4a [0,4194304] 0 2024-09-10T10:04:28.902 INFO:tasks.workunit.client.1.smithi107.stdout:0/861: rename d6/d8/d2f/dfc/l103 to d6/d5a/l11e 0 2024-09-10T10:04:28.903 INFO:tasks.workunit.client.1.smithi107.stdout:9/830: dwrite d5/d7/d1d/d9b/dab/d57/d87/fea [4194304,4194304] 0 2024-09-10T10:04:28.905 INFO:tasks.workunit.client.1.smithi107.stdout:9/831: write d5/d7/d1d/d41/d83/fa6 [4045974,111538] 0 2024-09-10T10:04:28.905 INFO:tasks.workunit.client.0.smithi071.stdout:5/787: dwrite dc/f31 [0,4194304] 0 2024-09-10T10:04:28.906 INFO:tasks.workunit.client.1.smithi107.stdout:6/898: creat d0/d3d/d14/d17/d24/df3/d55/d56/df2/f13e x:0 0 0 2024-09-10T10:04:28.907 INFO:tasks.workunit.client.0.smithi071.stdout:0/971: mkdir d11/d22/d40/df6/d13e/d15a 0 2024-09-10T10:04:28.908 INFO:tasks.workunit.client.1.smithi107.stdout:0/862: symlink d6/d8/d2f/d2e/d32/d59/l11f 0 2024-09-10T10:04:28.910 INFO:tasks.workunit.client.1.smithi107.stdout:9/832: creat d5/d1e/f117 x:0 0 0 2024-09-10T10:04:28.910 INFO:tasks.workunit.client.1.smithi107.stdout:6/899: rmdir d0/d3d/d14/d21/d8a/da7/dc9 39 2024-09-10T10:04:28.911 INFO:tasks.workunit.client.1.smithi107.stdout:0/863: mknod d6/d8/d3e/d43/dc7/c120 0 2024-09-10T10:04:28.911 INFO:tasks.workunit.client.0.smithi071.stdout:0/972: mknod d11/d22/d31/d72/c15b 0 2024-09-10T10:04:28.912 INFO:tasks.workunit.client.0.smithi071.stdout:5/788: creat dc/df/d3e/f10d x:0 0 0 2024-09-10T10:04:28.912 INFO:tasks.workunit.client.1.smithi107.stdout:9/833: dread - d5/d7/d1d/d29/fe2 zero size 2024-09-10T10:04:28.912 INFO:tasks.workunit.client.0.smithi071.stdout:0/973: dread - d11/d22/d9a/f153 zero size 2024-09-10T10:04:28.913 INFO:tasks.workunit.client.1.smithi107.stdout:0/864: chown d6/d8/d2f/d6e/dc5/lf6 13214 1 2024-09-10T10:04:28.915 INFO:tasks.workunit.client.1.smithi107.stdout:9/834: chown d5/d7/d1d/d9b/de5/ff4 350450 1 2024-09-10T10:04:28.916 INFO:tasks.workunit.client.1.smithi107.stdout:6/900: creat d0/d3d/d14/d21/d8a/da7/f13f x:0 0 0 2024-09-10T10:04:28.917 INFO:tasks.workunit.client.1.smithi107.stdout:0/865: creat d6/d8/f121 x:0 0 0 2024-09-10T10:04:28.918 INFO:tasks.workunit.client.1.smithi107.stdout:9/835: mknod d5/d7/d1d/d9b/de5/c118 0 2024-09-10T10:04:28.920 INFO:tasks.workunit.client.1.smithi107.stdout:6/901: write d0/d3d/d14/d17/d24/df3/fc6 [1912717,120194] 0 2024-09-10T10:04:28.921 INFO:tasks.workunit.client.1.smithi107.stdout:0/866: mknod d6/d8/d2f/da3/dee/dae/c122 0 2024-09-10T10:04:28.923 INFO:tasks.workunit.client.1.smithi107.stdout:0/867: write d6/d8/d2f/d35/d3c/f74 [237647,64391] 0 2024-09-10T10:04:28.924 INFO:tasks.workunit.client.1.smithi107.stdout:6/902: unlink d0/d3d/d14/d17/d137/d110/l129 0 2024-09-10T10:04:28.928 INFO:tasks.workunit.client.1.smithi107.stdout:0/868: dread d6/d8/d2f/da3/dee/ff2 [0,4194304] 0 2024-09-10T10:04:28.929 INFO:tasks.workunit.client.1.smithi107.stdout:0/869: chown d6/l9b 1090032 1 2024-09-10T10:04:28.931 INFO:tasks.workunit.client.1.smithi107.stdout:0/870: write d6/d8/f72 [2416751,88102] 0 2024-09-10T10:04:28.932 INFO:tasks.workunit.client.1.smithi107.stdout:6/903: dwrite d0/d3d/d14/d9f/dca/fd4 [0,4194304] 0 2024-09-10T10:04:28.934 INFO:tasks.workunit.client.1.smithi107.stdout:6/904: stat d0/d3d/d14/dde/d10c/d12a/fe7 0 2024-09-10T10:04:28.936 INFO:tasks.workunit.client.1.smithi107.stdout:0/871: truncate d6/d8/d2f/d35/d3c/d58/d69/f88 1084820 0 2024-09-10T10:04:28.937 INFO:tasks.workunit.client.1.smithi107.stdout:0/872: stat d6/d8/d3e/d43/c115 0 2024-09-10T10:04:28.944 INFO:tasks.workunit.client.1.smithi107.stdout:0/873: symlink d6/d8/d2f/l123 0 2024-09-10T10:04:28.946 INFO:tasks.workunit.client.0.smithi071.stdout:0/974: dread d11/d22/d9a/fab [0,4194304] 0 2024-09-10T10:04:28.946 INFO:tasks.workunit.client.1.smithi107.stdout:0/874: creat d6/d8/d2f/da3/dee/f124 x:0 0 0 2024-09-10T10:04:28.947 INFO:tasks.workunit.client.0.smithi071.stdout:0/975: chown l4 75055260 1 2024-09-10T10:04:28.948 INFO:tasks.workunit.client.1.smithi107.stdout:0/875: read d6/d5a/f10b [246469,91220] 0 2024-09-10T10:04:28.948 INFO:tasks.workunit.client.1.smithi107.stdout:9/836: dread d5/d1e/f5b [0,4194304] 0 2024-09-10T10:04:28.948 INFO:tasks.workunit.client.1.smithi107.stdout:6/905: write d0/d3d/d14/d21/f50 [852400,43163] 0 2024-09-10T10:04:28.949 INFO:tasks.workunit.client.0.smithi071.stdout:0/976: symlink d11/d30/d134/l15c 0 2024-09-10T10:04:28.950 INFO:tasks.workunit.client.1.smithi107.stdout:6/906: stat d0/d3d/d14/d21/d8a/d8d/l9b 0 2024-09-10T10:04:28.951 INFO:tasks.workunit.client.0.smithi071.stdout:5/789: dread dc/f13 [0,4194304] 0 2024-09-10T10:04:28.951 INFO:tasks.workunit.client.1.smithi107.stdout:0/876: unlink d6/d8/d2f/d35/d3c/f7a 0 2024-09-10T10:04:28.952 INFO:tasks.workunit.client.0.smithi071.stdout:0/977: mknod d11/d22/d9a/ddf/c15d 0 2024-09-10T10:04:28.952 INFO:tasks.workunit.client.1.smithi107.stdout:9/837: mkdir d5/d1e/dc5/d119 0 2024-09-10T10:04:28.953 INFO:tasks.workunit.client.0.smithi071.stdout:0/978: readlink d11/d22/d31/d72/l87 0 2024-09-10T10:04:28.953 INFO:tasks.workunit.client.0.smithi071.stdout:5/790: mknod dc/d4a/dbb/c10e 0 2024-09-10T10:04:28.954 INFO:tasks.workunit.client.0.smithi071.stdout:5/791: fsync dc/df/dd7/f35 0 2024-09-10T10:04:28.954 INFO:tasks.workunit.client.0.smithi071.stdout:0/979: dread - d11/d1e/dfa/d5f/f138 zero size 2024-09-10T10:04:28.954 INFO:tasks.workunit.client.1.smithi107.stdout:6/907: fsync d0/d3d/d14/d21/f7f 0 2024-09-10T10:04:28.956 INFO:tasks.workunit.client.1.smithi107.stdout:6/908: chown d0/d3d/d14/d21/f53 580982745 1 2024-09-10T10:04:28.957 INFO:tasks.workunit.client.1.smithi107.stdout:9/838: mknod d5/d7/d1d/d41/c11a 0 2024-09-10T10:04:28.958 INFO:tasks.workunit.client.1.smithi107.stdout:0/877: dwrite d6/d8/d2f/d2e/d32/d85/d8a/feb [0,4194304] 0 2024-09-10T10:04:28.959 INFO:tasks.workunit.client.0.smithi071.stdout:5/792: truncate dc/df/f7b 1434660 0 2024-09-10T10:04:28.963 INFO:tasks.workunit.client.0.smithi071.stdout:5/793: rename dc/d53/f60 to dc/d4a/f10f 0 2024-09-10T10:04:28.964 INFO:tasks.workunit.client.1.smithi107.stdout:6/909: creat d0/d3d/d14/d17/d24/df3/d55/f140 x:0 0 0 2024-09-10T10:04:28.966 INFO:tasks.workunit.client.1.smithi107.stdout:6/910: read d0/d3d/d14/d21/f33 [3922341,42844] 0 2024-09-10T10:04:28.966 INFO:tasks.workunit.client.0.smithi071.stdout:5/794: rename dc/d53/db2/f7c to dc/df/d29/d94/f110 0 2024-09-10T10:04:28.967 INFO:tasks.workunit.client.1.smithi107.stdout:0/878: link d6/d8/l20 d6/d8/d2f/d2e/d32/l125 0 2024-09-10T10:04:28.969 INFO:tasks.workunit.client.1.smithi107.stdout:9/839: rename d5/d7/d1d/d9b/dab/d57/d87/ldb to d5/d7/d1d/d41/d83/d9a/l11b 0 2024-09-10T10:04:28.971 INFO:tasks.workunit.client.0.smithi071.stdout:0/980: dwrite d11/d22/dde/d100/f132 [0,4194304] 0 2024-09-10T10:04:28.973 INFO:tasks.workunit.client.0.smithi071.stdout:0/981: write d11/d1e/f89 [3716276,58973] 0 2024-09-10T10:04:28.973 INFO:tasks.workunit.client.1.smithi107.stdout:0/879: dwrite d6/d8/f9 [4194304,4194304] 0 2024-09-10T10:04:28.973 INFO:tasks.workunit.client.1.smithi107.stdout:9/840: symlink d5/d7/d1d/l11c 0 2024-09-10T10:04:28.976 INFO:tasks.workunit.client.1.smithi107.stdout:0/880: read - d6/d8/d2f/d2e/d32/d56/ff0 zero size 2024-09-10T10:04:28.978 INFO:tasks.workunit.client.1.smithi107.stdout:0/881: symlink d6/d5a/l126 0 2024-09-10T10:04:28.979 INFO:tasks.workunit.client.1.smithi107.stdout:0/882: stat d6/d8/d2f/d2e/d7b/lf7 0 2024-09-10T10:04:28.981 INFO:tasks.workunit.client.0.smithi071.stdout:0/982: dwrite d11/d30/d70/d128/f135 [0,4194304] 0 2024-09-10T10:04:28.983 INFO:tasks.workunit.client.1.smithi107.stdout:9/841: rename d5/d7/d1d/d41/d83/d9a/l33 to d5/d7/d1d/d29/db4/dbd/l11d 0 2024-09-10T10:04:28.985 INFO:tasks.workunit.client.1.smithi107.stdout:0/883: creat d6/d5a/f127 x:0 0 0 2024-09-10T10:04:28.985 INFO:tasks.workunit.client.0.smithi071.stdout:0/983: creat d11/d22/d40/df6/d13e/d15a/f15e x:0 0 0 2024-09-10T10:04:28.986 INFO:tasks.workunit.client.0.smithi071.stdout:1/796: sync 2024-09-10T10:04:28.987 INFO:tasks.workunit.client.0.smithi071.stdout:1/797: chown d1/d21/d2f 1694 1 2024-09-10T10:04:28.988 INFO:tasks.workunit.client.1.smithi107.stdout:6/911: write d0/d3d/d14/d9f/fe8 [183392,52325] 0 2024-09-10T10:04:28.988 INFO:tasks.workunit.client.0.smithi071.stdout:0/984: symlink d11/d22/d31/l15f 0 2024-09-10T10:04:28.990 INFO:tasks.workunit.client.1.smithi107.stdout:0/884: readlink d6/d8/d2f/d2e/d7b/l9f 0 2024-09-10T10:04:28.993 INFO:tasks.workunit.client.0.smithi071.stdout:1/798: rename d1/d21/d2f/d30/d6a/d113 to d1/d21/d3d/d9a/df9/d11c 0 2024-09-10T10:04:28.994 INFO:tasks.workunit.client.1.smithi107.stdout:9/842: dwrite d5/d7/d1d/d29/d101/f10c [0,4194304] 0 2024-09-10T10:04:28.995 INFO:tasks.workunit.client.0.smithi071.stdout:1/799: readlink d1/d21/d2f/d30/d75/d97/lab 0 2024-09-10T10:04:28.996 INFO:tasks.workunit.client.0.smithi071.stdout:5/795: dread dc/d53/db2/f8f [0,4194304] 0 2024-09-10T10:04:28.996 INFO:tasks.workunit.client.0.smithi071.stdout:1/800: readlink d1/d21/d3d/l47 0 2024-09-10T10:04:28.998 INFO:tasks.workunit.client.0.smithi071.stdout:0/985: rename d11/d1e/dfa/c66 to d11/d22/d9a/d106/c160 0 2024-09-10T10:04:28.998 INFO:tasks.workunit.client.1.smithi107.stdout:9/843: chown d5/d7/d1d/d41/d83/d9a/f65 1 1 2024-09-10T10:04:28.999 INFO:tasks.workunit.client.0.smithi071.stdout:1/801: mkdir d1/d70/d76/d11d 0 2024-09-10T10:04:29.000 INFO:tasks.workunit.client.0.smithi071.stdout:5/796: dread dc/df/d3e/d5a/d80/d8a/dda/fe2 [0,4194304] 0 2024-09-10T10:04:29.001 INFO:tasks.workunit.client.0.smithi071.stdout:5/797: write dc/f21 [3080555,59207] 0 2024-09-10T10:04:29.002 INFO:tasks.workunit.client.0.smithi071.stdout:0/986: creat d11/d22/d14a/f161 x:0 0 0 2024-09-10T10:04:29.004 INFO:tasks.workunit.client.1.smithi107.stdout:0/885: dwrite d6/d8/d2f/d2e/d32/f4c [0,4194304] 0 2024-09-10T10:04:29.004 INFO:tasks.workunit.client.0.smithi071.stdout:0/987: chown d11/l123 451 1 2024-09-10T10:04:29.008 INFO:tasks.workunit.client.0.smithi071.stdout:1/802: dwrite d1/d21/d3d/d4a/fed [0,4194304] 0 2024-09-10T10:04:29.008 INFO:tasks.workunit.client.0.smithi071.stdout:0/988: creat d11/d22/d40/df6/d13e/d15a/f162 x:0 0 0 2024-09-10T10:04:29.008 INFO:tasks.workunit.client.1.smithi107.stdout:0/886: creat d6/d8/d2f/d2e/d7b/d89/f128 x:0 0 0 2024-09-10T10:04:29.009 INFO:tasks.workunit.client.0.smithi071.stdout:1/803: write d1/f74 [4565962,50203] 0 2024-09-10T10:04:29.013 INFO:tasks.workunit.client.0.smithi071.stdout:1/804: creat d1/d3f/d58/d102/f11e x:0 0 0 2024-09-10T10:04:29.014 INFO:tasks.workunit.client.0.smithi071.stdout:0/989: read d11/d30/d70/de2/ffb [3191978,80664] 0 2024-09-10T10:04:29.020 INFO:tasks.workunit.client.0.smithi071.stdout:1/805: rename d1/d21/d3d/d9a/d72/c88 to d1/d57/dbf/c11f 0 2024-09-10T10:04:29.021 INFO:tasks.workunit.client.0.smithi071.stdout:1/806: dread - d1/d57/fc6 zero size 2024-09-10T10:04:29.022 INFO:tasks.workunit.client.1.smithi107.stdout:7/793: sync 2024-09-10T10:04:29.023 INFO:tasks.workunit.client.1.smithi107.stdout:0/887: dread d6/f4a [0,4194304] 0 2024-09-10T10:04:29.024 INFO:tasks.workunit.client.0.smithi071.stdout:1/807: rename d1/d3f/fdd to d1/d35/dea/f120 0 2024-09-10T10:04:29.024 INFO:tasks.workunit.client.1.smithi107.stdout:6/912: dwrite d0/d3d/d14/d17/d24/df3/f92 [0,4194304] 0 2024-09-10T10:04:29.025 INFO:tasks.workunit.client.1.smithi107.stdout:6/913: chown d0/d3d/d14/d21/d8a/d8d 484156865 1 2024-09-10T10:04:29.027 INFO:tasks.workunit.client.0.smithi071.stdout:1/808: rename d1/d21/d2f/d30/d75/d97/dee to d1/d21/d3d/d9a/d121 0 2024-09-10T10:04:29.027 INFO:tasks.workunit.client.1.smithi107.stdout:7/794: chown d0/d20/d35/leb 9589 1 2024-09-10T10:04:29.028 INFO:tasks.workunit.client.0.smithi071.stdout:1/809: write d1/fd [2168370,47662] 0 2024-09-10T10:04:29.028 INFO:tasks.workunit.client.1.smithi107.stdout:9/844: write d5/d7/d1d/fa0 [441016,43752] 0 2024-09-10T10:04:29.030 INFO:tasks.workunit.client.0.smithi071.stdout:0/990: rmdir d11/d1e/dfa 39 2024-09-10T10:04:29.032 INFO:tasks.workunit.client.1.smithi107.stdout:0/888: dwrite d6/d8/d2f/da3/dee/dae/fef [0,4194304] 0 2024-09-10T10:04:29.033 INFO:tasks.workunit.client.0.smithi071.stdout:0/991: creat d11/d22/d31/d72/f163 x:0 0 0 2024-09-10T10:04:29.034 INFO:tasks.workunit.client.1.smithi107.stdout:6/914: mknod d0/d3d/d14/c141 0 2024-09-10T10:04:29.035 INFO:tasks.workunit.client.0.smithi071.stdout:1/810: truncate d1/d21/d3d/d9a/df9/de4/db6/fc0 195584 0 2024-09-10T10:04:29.038 INFO:tasks.workunit.client.1.smithi107.stdout:0/889: chown d6/d8/d2f/d35/d3c/d58/lda 574 1 2024-09-10T10:04:29.038 INFO:tasks.workunit.client.0.smithi071.stdout:5/798: dwrite dc/df/dd7/f2f [0,4194304] 0 2024-09-10T10:04:29.038 INFO:tasks.workunit.client.0.smithi071.stdout:0/992: mkdir d11/d22/dde/d164 0 2024-09-10T10:04:29.040 INFO:tasks.workunit.client.0.smithi071.stdout:5/799: write dc/df/d29/f3f [3826191,43412] 0 2024-09-10T10:04:29.041 INFO:tasks.workunit.client.0.smithi071.stdout:0/993: chown d11/d1e/dfa/d79/ddc 28 1 2024-09-10T10:04:29.044 INFO:tasks.workunit.client.0.smithi071.stdout:5/800: mkdir dc/df/d3e/d5a/d80/d8a/da3/d111 0 2024-09-10T10:04:29.044 INFO:tasks.workunit.client.0.smithi071.stdout:1/811: read d1/d21/f98 [1404186,87092] 0 2024-09-10T10:04:29.045 INFO:tasks.workunit.client.0.smithi071.stdout:0/994: write d11/f12d [942478,125345] 0 2024-09-10T10:04:29.047 INFO:tasks.workunit.client.1.smithi107.stdout:7/795: getdents d0/d20/d35 0 2024-09-10T10:04:29.048 INFO:tasks.workunit.client.0.smithi071.stdout:0/995: fsync d11/d22/d31/f49 0 2024-09-10T10:04:29.048 INFO:tasks.workunit.client.0.smithi071.stdout:0/996: chown d11/d30 34477 1 2024-09-10T10:04:29.049 INFO:tasks.workunit.client.1.smithi107.stdout:0/890: truncate d6/d8/d2f/d2e/d32/f6a 2459666 0 2024-09-10T10:04:29.049 INFO:tasks.workunit.client.0.smithi071.stdout:5/801: rename dc/df/d29/lad to dc/d53/db2/l112 0 2024-09-10T10:04:29.050 INFO:tasks.workunit.client.0.smithi071.stdout:0/997: creat d11/d22/d14a/f165 x:0 0 0 2024-09-10T10:04:29.050 INFO:tasks.workunit.client.1.smithi107.stdout:0/891: read d6/d8/d2f/d2e/d32/f9c [834030,8596] 0 2024-09-10T10:04:29.051 INFO:tasks.workunit.client.0.smithi071.stdout:1/812: mknod d1/d21/d3d/d9a/df9/de4/db6/c122 0 2024-09-10T10:04:29.052 INFO:tasks.workunit.client.1.smithi107.stdout:6/915: fdatasync d0/d3d/d14/d21/d8a/da7/ffc 0 2024-09-10T10:04:29.053 INFO:tasks.workunit.client.0.smithi071.stdout:1/813: truncate d1/d21/d2f/d30/d6a/d91/f106 507425 0 2024-09-10T10:04:29.054 INFO:tasks.workunit.client.1.smithi107.stdout:7/796: symlink d0/d8/d5c/d6d/l105 0 2024-09-10T10:04:29.057 INFO:tasks.workunit.client.0.smithi071.stdout:1/814: mknod d1/d21/d2f/d30/d75/c123 0 2024-09-10T10:04:29.057 INFO:tasks.workunit.client.1.smithi107.stdout:6/916: read - d0/d3d/d14/d17/d24/df3/f90 zero size 2024-09-10T10:04:29.059 INFO:tasks.workunit.client.0.smithi071.stdout:1/815: creat d1/d35/f124 x:0 0 0 2024-09-10T10:04:29.060 INFO:tasks.workunit.client.1.smithi107.stdout:0/892: dwrite d6/d8/d2f/d2e/d32/d95/dce/fd8 [0,4194304] 0 2024-09-10T10:04:29.061 INFO:tasks.workunit.client.0.smithi071.stdout:1/816: mkdir d1/d21/d125 0 2024-09-10T10:04:29.065 INFO:tasks.workunit.client.1.smithi107.stdout:7/797: dwrite d0/d20/d35/f9f [4194304,4194304] 0 2024-09-10T10:04:29.065 INFO:tasks.workunit.client.0.smithi071.stdout:1/817: mknod d1/d21/d2f/d30/d75/c126 0 2024-09-10T10:04:29.068 INFO:tasks.workunit.client.1.smithi107.stdout:6/917: link d0/d3d/d14/d9f/fe8 d0/d3d/d14/d21/d8a/da7/dc9/f142 0 2024-09-10T10:04:29.070 INFO:tasks.workunit.client.0.smithi071.stdout:1/818: creat d1/d21/d2f/d30/f127 x:0 0 0 2024-09-10T10:04:29.071 INFO:tasks.workunit.client.1.smithi107.stdout:6/918: write d0/d3d/d14/d17/d24/df3/d55/f140 [867004,108518] 0 2024-09-10T10:04:29.073 INFO:tasks.workunit.client.0.smithi071.stdout:1/819: chown d1/d57/dbf/lf6 400644 1 2024-09-10T10:04:29.073 INFO:tasks.workunit.client.0.smithi071.stdout:0/998: dwrite d11/d22/d40/fb8 [0,4194304] 0 2024-09-10T10:04:29.074 INFO:tasks.workunit.client.0.smithi071.stdout:0/999: fsync d11/d1e/dfa/d79/fe4 0 2024-09-10T10:04:29.075 INFO:tasks.workunit.client.1.smithi107.stdout:7/798: dwrite d0/d1b/d4d/d69/fc3 [0,4194304] 0 2024-09-10T10:04:29.075 INFO:tasks.workunit.client.0.smithi071.stdout:1/820: write d1/d3f/f84 [2895582,7947] 0 2024-09-10T10:04:29.077 INFO:tasks.workunit.client.1.smithi107.stdout:7/799: write d0/d8/d56/dcc/de7/ff4 [519033,102363] 0 2024-09-10T10:04:29.078 INFO:tasks.workunit.client.0.smithi071.stdout:1/821: write d1/d21/d2f/d30/d6a/d91/f106 [602749,121551] 0 2024-09-10T10:04:29.078 INFO:tasks.workunit.client.0.smithi071.stdout:1/822: truncate d1/f19 5588068 0 2024-09-10T10:04:29.079 INFO:tasks.workunit.client.1.smithi107.stdout:6/919: rename d0/d3d/d14/dde/d10c/d12a/fe0 to d0/d3d/d14/d17/d24/dc5/f143 0 2024-09-10T10:04:29.080 INFO:tasks.workunit.client.1.smithi107.stdout:7/800: truncate d0/d1b/d4d/f61 2902016 0 2024-09-10T10:04:29.086 INFO:tasks.workunit.client.1.smithi107.stdout:7/801: symlink d0/d8/d56/dcc/l106 0 2024-09-10T10:04:29.089 INFO:tasks.workunit.client.1.smithi107.stdout:6/920: dwrite d0/d3d/d14/d21/d8a/dee/df1/f109 [0,4194304] 0 2024-09-10T10:04:29.091 INFO:tasks.workunit.client.1.smithi107.stdout:6/921: write d0/d3d/d14/d21/d124/f138 [817770,90367] 0 2024-09-10T10:04:29.091 INFO:tasks.workunit.client.1.smithi107.stdout:7/802: mknod d0/d8/d56/dcc/c107 0 2024-09-10T10:04:29.091 INFO:tasks.workunit.client.0.smithi071.stdout:5/802: dread dc/df/d3e/d5a/d80/f86 [0,4194304] 0 2024-09-10T10:04:29.094 INFO:tasks.workunit.client.1.smithi107.stdout:7/803: symlink d0/d20/d35/l108 0 2024-09-10T10:04:29.094 INFO:tasks.workunit.client.0.smithi071.stdout:5/803: write dc/df/ff4 [254505,130928] 0 2024-09-10T10:04:29.097 INFO:tasks.workunit.client.0.smithi071.stdout:5/804: creat dc/df/d29/d48/f113 x:0 0 0 2024-09-10T10:04:29.101 INFO:tasks.workunit.client.1.smithi107.stdout:7/804: dwrite d0/d8/d5c/f103 [0,4194304] 0 2024-09-10T10:04:29.101 INFO:tasks.workunit.client.0.smithi071.stdout:5/805: creat dc/d53/d79/f114 x:0 0 0 2024-09-10T10:04:29.103 INFO:tasks.workunit.client.0.smithi071.stdout:1/823: write d1/d57/f5f [1511818,40049] 0 2024-09-10T10:04:29.103 INFO:tasks.workunit.client.1.smithi107.stdout:7/805: chown d0/d8/d56/dcc/l106 0 1 2024-09-10T10:04:29.110 INFO:tasks.workunit.client.0.smithi071.stdout:1/824: dwrite d1/f19 [0,4194304] 0 2024-09-10T10:04:29.112 INFO:tasks.workunit.client.0.smithi071.stdout:1/825: dread - d1/d21/d2f/f9b zero size 2024-09-10T10:04:29.112 INFO:tasks.workunit.client.0.smithi071.stdout:1/826: stat d1/l20 0 2024-09-10T10:04:29.113 INFO:tasks.workunit.client.1.smithi107.stdout:7/806: rename d0/d8/dc/d2c/d47/ff1 to d0/d99/de0/f109 0 2024-09-10T10:04:29.115 INFO:tasks.workunit.client.1.smithi107.stdout:7/807: symlink d0/d99/de0/l10a 0 2024-09-10T10:04:29.116 INFO:tasks.workunit.client.0.smithi071.stdout:1/827: symlink d1/d57/dbf/l128 0 2024-09-10T10:04:29.117 INFO:tasks.workunit.client.0.smithi071.stdout:1/828: fsync d1/d3f/d58/f116 0 2024-09-10T10:04:29.120 INFO:tasks.workunit.client.1.smithi107.stdout:7/808: read d0/d8/d56/f8e [2209438,101547] 0 2024-09-10T10:04:29.126 INFO:tasks.workunit.client.0.smithi071.stdout:1/829: dwrite d1/d21/d2f/d30/f7d [4194304,4194304] 0 2024-09-10T10:04:29.129 INFO:tasks.workunit.client.0.smithi071.stdout:1/830: rmdir d1/d21/d3d/d9a/df9/de4 39 2024-09-10T10:04:29.129 INFO:tasks.workunit.client.0.smithi071.stdout:1/831: chown d1/f2e 0 1 2024-09-10T10:04:29.134 INFO:tasks.workunit.client.0.smithi071.stdout:1/832: write d1/d21/d3d/d9a/df9/de4/fdf [3130824,32200] 0 2024-09-10T10:04:29.135 INFO:tasks.workunit.client.0.smithi071.stdout:1/833: stat d1/d21/d2f/d30/d6a/ddb 0 2024-09-10T10:04:29.136 INFO:tasks.workunit.client.0.smithi071.stdout:1/834: dread - d1/d57/fc6 zero size 2024-09-10T10:04:29.136 INFO:tasks.workunit.client.1.smithi107.stdout:7/809: write d0/d8/dc/d2c/f7c [3464316,101948] 0 2024-09-10T10:04:29.138 INFO:tasks.workunit.client.0.smithi071.stdout:1/835: creat d1/d3f/d115/f129 x:0 0 0 2024-09-10T10:04:29.139 INFO:tasks.workunit.client.0.smithi071.stdout:1/836: write d1/d21/d65/f4e [144767,28500] 0 2024-09-10T10:04:29.143 INFO:tasks.workunit.client.1.smithi107.stdout:7/810: rename d0/d1b/d4d/d69/d97/l77 to d0/d1b/d4d/l10b 0 2024-09-10T10:04:29.148 INFO:tasks.workunit.client.0.smithi071.stdout:1/837: rename d1/d21/d3d/d9a/df9/de4/fdf to d1/d35/dea/d110/f12a 0 2024-09-10T10:04:29.148 INFO:tasks.workunit.client.0.smithi071.stdout:5/806: dread dc/df/f28 [0,4194304] 0 2024-09-10T10:04:29.148 INFO:tasks.workunit.client.0.smithi071.stdout:1/838: fsync d1/d21/f67 0 2024-09-10T10:04:29.149 INFO:tasks.workunit.client.1.smithi107.stdout:7/811: creat d0/d8/d56/f10c x:0 0 0 2024-09-10T10:04:29.149 INFO:tasks.workunit.client.1.smithi107.stdout:7/812: write d0/d8/d56/d5d/fd2 [4468252,126819] 0 2024-09-10T10:04:29.150 INFO:tasks.workunit.client.0.smithi071.stdout:1/839: symlink d1/d21/d3d/d9a/d72/l12b 0 2024-09-10T10:04:29.153 INFO:tasks.workunit.client.0.smithi071.stdout:5/807: getdents dc/d53/d79 0 2024-09-10T10:04:29.154 INFO:tasks.workunit.client.0.smithi071.stdout:1/840: dread d1/d21/d3d/d9a/f103 [0,4194304] 0 2024-09-10T10:04:29.155 INFO:tasks.workunit.client.1.smithi107.stdout:7/813: dwrite d0/d8/d56/dcc/d81/dbc/fc1 [0,4194304] 0 2024-09-10T10:04:29.156 INFO:tasks.workunit.client.0.smithi071.stdout:5/808: chown dc/df/da6/ce0 2 1 2024-09-10T10:04:29.157 INFO:tasks.workunit.client.1.smithi107.stdout:5/918: sync 2024-09-10T10:04:29.157 INFO:tasks.workunit.client.1.smithi107.stdout:2/890: sync 2024-09-10T10:04:29.157 INFO:tasks.workunit.client.1.smithi107.stdout:8/768: sync 2024-09-10T10:04:29.157 INFO:tasks.workunit.client.0.smithi071.stdout:5/809: fsync dc/df/d3e/d5a/dd4/f109 0 2024-09-10T10:04:29.158 INFO:tasks.workunit.client.1.smithi107.stdout:8/769: truncate d5/d8/d2a/d35/d85/dcb/fd1 556107 0 2024-09-10T10:04:29.159 INFO:tasks.workunit.client.1.smithi107.stdout:7/814: creat d0/d8/d5c/d6d/f10d x:0 0 0 2024-09-10T10:04:29.160 INFO:tasks.workunit.client.0.smithi071.stdout:5/810: fsync dc/df/d17/d8d/fcd 0 2024-09-10T10:04:29.160 INFO:tasks.workunit.client.1.smithi107.stdout:5/919: creat de/d9c/f132 x:0 0 0 2024-09-10T10:04:29.163 INFO:tasks.workunit.client.0.smithi071.stdout:5/811: creat dc/d4a/f115 x:0 0 0 2024-09-10T10:04:29.163 INFO:tasks.workunit.client.1.smithi107.stdout:8/770: mknod d5/d8/d66/d8b/d1a/c105 0 2024-09-10T10:04:29.168 INFO:tasks.workunit.client.1.smithi107.stdout:5/920: dwrite de/d20/d2b/d4b/d5e/d116/d7e/d79/f100 [0,4194304] 0 2024-09-10T10:04:29.168 INFO:tasks.workunit.client.1.smithi107.stdout:7/815: truncate d0/d8/d56/f9e 1124394 0 2024-09-10T10:04:29.172 INFO:tasks.workunit.client.0.smithi071.stdout:4/703: sync 2024-09-10T10:04:29.173 INFO:tasks.workunit.client.1.smithi107.stdout:7/816: dread - d0/d8/dc/f4f zero size 2024-09-10T10:04:29.173 INFO:tasks.workunit.client.0.smithi071.stdout:1/841: dread d1/d21/d2f/d30/d6a/fba [0,4194304] 0 2024-09-10T10:04:29.173 INFO:tasks.workunit.client.1.smithi107.stdout:5/921: mkdir de/d9c/d133 0 2024-09-10T10:04:29.174 INFO:tasks.workunit.client.0.smithi071.stdout:4/704: stat db/d15/d26/d43/d82/f83 0 2024-09-10T10:04:29.175 INFO:tasks.workunit.client.0.smithi071.stdout:1/842: chown d1/d57/fe9 4184623 1 2024-09-10T10:04:29.177 INFO:tasks.workunit.client.1.smithi107.stdout:7/817: mknod d0/d8/d56/dcc/de7/c10e 0 2024-09-10T10:04:29.177 INFO:tasks.workunit.client.0.smithi071.stdout:1/843: readlink d1/d21/d3d/d9a/df9/de4/lef 0 2024-09-10T10:04:29.178 INFO:tasks.workunit.client.0.smithi071.stdout:5/812: dwrite dc/df/d3e/d5a/d80/d8a/dda/fe2 [0,4194304] 0 2024-09-10T10:04:29.178 INFO:tasks.workunit.client.0.smithi071.stdout:4/705: rmdir db/d15/d17/d24 39 2024-09-10T10:04:29.179 INFO:tasks.workunit.client.1.smithi107.stdout:2/891: dwrite d3/da/df/d20/dfb/d136/dea/f98 [0,4194304] 0 2024-09-10T10:04:29.181 INFO:tasks.workunit.client.1.smithi107.stdout:2/892: readlink d3/da/d1e/d40/d8a/d7f/d55/d85/d7c/la7 0 2024-09-10T10:04:29.181 INFO:tasks.workunit.client.0.smithi071.stdout:5/813: symlink dc/df/d29/d48/dae/db6/l116 0 2024-09-10T10:04:29.183 INFO:tasks.workunit.client.0.smithi071.stdout:4/706: mkdir db/d15/d26/d43/d4d/d77/dd7/de7/dea 0 2024-09-10T10:04:29.184 INFO:tasks.workunit.client.1.smithi107.stdout:7/818: creat d0/d8/dc/d2c/d47/f10f x:0 0 0 2024-09-10T10:04:29.186 INFO:tasks.workunit.client.0.smithi071.stdout:5/814: mknod dc/df/dd7/d87/c117 0 2024-09-10T10:04:29.186 INFO:tasks.workunit.client.0.smithi071.stdout:1/844: dwrite d1/d35/f124 [0,4194304] 0 2024-09-10T10:04:29.190 INFO:tasks.workunit.client.0.smithi071.stdout:4/707: creat db/d15/d17/d4e/dc0/feb x:0 0 0 2024-09-10T10:04:29.193 INFO:tasks.workunit.client.0.smithi071.stdout:5/815: link dc/d4a/l69 dc/d4a/l118 0 2024-09-10T10:04:29.194 INFO:tasks.workunit.client.1.smithi107.stdout:7/819: rmdir d0/d8/d56/dcc/de7 39 2024-09-10T10:04:29.195 INFO:tasks.workunit.client.1.smithi107.stdout:8/771: link d5/d8/d66/d8b/d18/dab/fd4 d5/d8/d66/d8b/d1a/d64/db9/f106 0 2024-09-10T10:04:29.196 INFO:tasks.workunit.client.1.smithi107.stdout:2/893: mknod d3/c13b 0 2024-09-10T10:04:29.198 INFO:tasks.workunit.client.0.smithi071.stdout:5/816: fsync dc/d53/db2/f8f 0 2024-09-10T10:04:29.199 INFO:tasks.workunit.client.0.smithi071.stdout:4/708: dwrite db/d15/d17/d4e/d5a/d8d/faf [0,4194304] 0 2024-09-10T10:04:29.201 INFO:tasks.workunit.client.0.smithi071.stdout:1/845: dwrite d1/d35/dea/d110/f12a [0,4194304] 0 2024-09-10T10:04:29.203 INFO:tasks.workunit.client.1.smithi107.stdout:5/922: rename de/c36 to de/d20/d2b/d4b/d5e/d116/d7e/c134 0 2024-09-10T10:04:29.209 INFO:tasks.workunit.client.0.smithi071.stdout:5/817: truncate dc/df/f14 3672273 0 2024-09-10T10:04:29.209 INFO:tasks.workunit.client.0.smithi071.stdout:4/709: dwrite db/da0/fc4 [0,4194304] 0 2024-09-10T10:04:29.211 INFO:tasks.workunit.client.0.smithi071.stdout:4/710: write db/d15/f9e [930902,116146] 0 2024-09-10T10:04:29.213 INFO:tasks.workunit.client.0.smithi071.stdout:5/818: mkdir dc/df/d17/d8d/d119 0 2024-09-10T10:04:29.215 INFO:tasks.workunit.client.1.smithi107.stdout:8/772: dread d5/d8/d66/d8b/d1a/d75/fac [0,4194304] 0 2024-09-10T10:04:29.217 INFO:tasks.workunit.client.0.smithi071.stdout:4/711: truncate db/d15/d17/d4e/d5a/dd3/fd9 695514 0 2024-09-10T10:04:29.220 INFO:tasks.workunit.client.0.smithi071.stdout:4/712: symlink db/d15/d26/d43/d82/lec 0 2024-09-10T10:04:29.223 INFO:tasks.workunit.client.0.smithi071.stdout:4/713: rename db/d15/f9e to db/d15/fed 0 2024-09-10T10:04:29.224 INFO:tasks.workunit.client.1.smithi107.stdout:7/820: write d0/d1b/d9b/faf [4020146,52139] 0 2024-09-10T10:04:29.225 INFO:tasks.workunit.client.1.smithi107.stdout:7/821: chown d0/d8/fa8 1762781459 1 2024-09-10T10:04:29.226 INFO:tasks.workunit.client.1.smithi107.stdout:7/822: chown d0/d8/d56/dcc/ca1 866 1 2024-09-10T10:04:29.229 INFO:tasks.workunit.client.0.smithi071.stdout:4/714: dwrite db/d15/d17/f3f [0,4194304] 0 2024-09-10T10:04:29.232 INFO:tasks.workunit.client.0.smithi071.stdout:4/715: write db/d15/d26/d43/f66 [1967649,18242] 0 2024-09-10T10:04:29.236 INFO:tasks.workunit.client.0.smithi071.stdout:4/716: stat db/d15/d26/d43/d4d/d9f/da6/cae 0 2024-09-10T10:04:29.237 INFO:tasks.workunit.client.0.smithi071.stdout:1/846: dwrite d1/d21/f61 [0,4194304] 0 2024-09-10T10:04:29.239 INFO:tasks.workunit.client.1.smithi107.stdout:2/894: unlink d3/da/df/d20/d36/d4f/faa 0 2024-09-10T10:04:29.239 INFO:tasks.workunit.client.1.smithi107.stdout:8/773: symlink d5/d8/d2a/d35/d70/l107 0 2024-09-10T10:04:29.240 INFO:tasks.workunit.client.0.smithi071.stdout:4/717: symlink db/d15/d26/d43/d82/lee 0 2024-09-10T10:04:29.240 INFO:tasks.workunit.client.1.smithi107.stdout:8/774: write d5/fb [1066427,103900] 0 2024-09-10T10:04:29.241 INFO:tasks.workunit.client.0.smithi071.stdout:1/847: symlink d1/d35/dea/d110/l12c 0 2024-09-10T10:04:29.242 INFO:tasks.workunit.client.1.smithi107.stdout:5/923: mknod de/d9c/d133/c135 0 2024-09-10T10:04:29.243 INFO:tasks.workunit.client.0.smithi071.stdout:4/718: dread - db/d15/d26/d43/d4d/fad zero size 2024-09-10T10:04:29.244 INFO:tasks.workunit.client.1.smithi107.stdout:7/823: creat d0/d1b/d9d/dd0/f110 x:0 0 0 2024-09-10T10:04:29.247 INFO:tasks.workunit.client.1.smithi107.stdout:8/775: rename d5/d8/d66/d8b/d1a/d71/fae to d5/d8/d66/f108 0 2024-09-10T10:04:29.249 INFO:tasks.workunit.client.0.smithi071.stdout:5/819: dwrite dc/df/dd7/f7d [0,4194304] 0 2024-09-10T10:04:29.249 INFO:tasks.workunit.client.0.smithi071.stdout:5/820: fdatasync dc/df/d3e/f10d 0 2024-09-10T10:04:29.249 INFO:tasks.workunit.client.1.smithi107.stdout:2/895: symlink d3/da/df/d20/dfb/d136/dea/df7/l13c 0 2024-09-10T10:04:29.250 INFO:tasks.workunit.client.0.smithi071.stdout:4/719: chown db/d15/d17/d4e/d5a/d8d/c8e 647709806 1 2024-09-10T10:04:29.252 INFO:tasks.workunit.client.0.smithi071.stdout:5/821: mknod dc/d53/dee/c11a 0 2024-09-10T10:04:29.253 INFO:tasks.workunit.client.1.smithi107.stdout:8/776: symlink d5/d8/d66/d8b/d1a/d64/l109 0 2024-09-10T10:04:29.253 INFO:tasks.workunit.client.0.smithi071.stdout:5/822: chown dc/df/d3e/d5a/fa7 1674 1 2024-09-10T10:04:29.253 INFO:tasks.workunit.client.0.smithi071.stdout:5/823: dread - dc/d53/d6a/fd6 zero size 2024-09-10T10:04:29.254 INFO:tasks.workunit.client.1.smithi107.stdout:2/896: mkdir d3/da/d1e/d5f/d54/d114/d13d 0 2024-09-10T10:04:29.255 INFO:tasks.workunit.client.0.smithi071.stdout:4/720: rename db/d15/d17/f18 to db/d15/d17/d4e/d5a/dd3/fef 0 2024-09-10T10:04:29.255 INFO:tasks.workunit.client.0.smithi071.stdout:5/824: readlink dc/df/d3e/d5a/d80/d8a/da3/le3 0 2024-09-10T10:04:29.256 INFO:tasks.workunit.client.0.smithi071.stdout:1/848: rmdir d1/d21/d2f/d30/d6a 39 2024-09-10T10:04:29.257 INFO:tasks.workunit.client.1.smithi107.stdout:2/897: truncate d3/da/df/d20/d36/d39/da3/f10d 507492 0 2024-09-10T10:04:29.258 INFO:tasks.workunit.client.0.smithi071.stdout:1/849: read - d1/d21/d2f/d30/d75/feb zero size 2024-09-10T10:04:29.258 INFO:tasks.workunit.client.1.smithi107.stdout:2/898: chown d3/da/df/d20/d36/d39/da3/ddb/d12b 29883 1 2024-09-10T10:04:29.259 INFO:tasks.workunit.client.0.smithi071.stdout:5/825: rmdir dc/d4a/dbb 39 2024-09-10T10:04:29.259 INFO:tasks.workunit.client.0.smithi071.stdout:4/721: creat db/d15/d17/d4e/d5a/ff0 x:0 0 0 2024-09-10T10:04:29.264 INFO:tasks.workunit.client.0.smithi071.stdout:1/850: truncate d1/d21/d2f/d30/d6a/d91/f9c 1948274 0 2024-09-10T10:04:29.270 INFO:tasks.workunit.client.0.smithi071.stdout:1/851: dwrite d1/d70/d76/f111 [0,4194304] 0 2024-09-10T10:04:29.272 INFO:tasks.workunit.client.0.smithi071.stdout:1/852: write d1/d21/f67 [1639446,15682] 0 2024-09-10T10:04:29.273 INFO:tasks.workunit.client.0.smithi071.stdout:5/826: write dc/df/d17/fef [1455277,24682] 0 2024-09-10T10:04:29.273 INFO:tasks.workunit.client.0.smithi071.stdout:1/853: dread - d1/d3f/d58/ffc zero size 2024-09-10T10:04:29.273 INFO:tasks.workunit.client.0.smithi071.stdout:4/722: write db/d15/d17/d4e/f6d [1654866,115802] 0 2024-09-10T10:04:29.276 INFO:tasks.workunit.client.0.smithi071.stdout:5/827: chown dc/d53/d79/f114 30672 1 2024-09-10T10:04:29.276 INFO:tasks.workunit.client.0.smithi071.stdout:1/854: write d1/d3f/f11a [17017,42071] 0 2024-09-10T10:04:29.279 INFO:tasks.workunit.client.1.smithi107.stdout:8/777: rmdir d5/d8/d66/d8b/d1a/d64 39 2024-09-10T10:04:29.279 INFO:tasks.workunit.client.1.smithi107.stdout:5/924: write de/d20/d2b/f39 [4129445,109316] 0 2024-09-10T10:04:29.280 INFO:tasks.workunit.client.0.smithi071.stdout:1/855: chown d1/d21/d2f/d30/d6a/d91/fa1 293 1 2024-09-10T10:04:29.284 INFO:tasks.workunit.client.0.smithi071.stdout:5/828: dwrite dc/ff8 [0,4194304] 0 2024-09-10T10:04:29.286 INFO:tasks.workunit.client.1.smithi107.stdout:7/824: dwrite d0/d8/dc/f26 [0,4194304] 0 2024-09-10T10:04:29.287 INFO:tasks.workunit.client.0.smithi071.stdout:4/723: link db/d15/d17/d4e/d5a/cc1 db/d1d/d61/d6a/d88/cf1 0 2024-09-10T10:04:29.289 INFO:tasks.workunit.client.1.smithi107.stdout:2/899: dwrite d3/da/f105 [0,4194304] 0 2024-09-10T10:04:29.291 INFO:tasks.workunit.client.0.smithi071.stdout:5/829: creat dc/f11b x:0 0 0 2024-09-10T10:04:29.292 INFO:tasks.workunit.client.0.smithi071.stdout:4/724: symlink db/d15/d17/d4e/d5a/d8d/lf2 0 2024-09-10T10:04:29.293 INFO:tasks.workunit.client.1.smithi107.stdout:8/778: rename d5/d8/d2a/d35/d85/fc0 to d5/f10a 0 2024-09-10T10:04:29.294 INFO:tasks.workunit.client.1.smithi107.stdout:0/893: sync 2024-09-10T10:04:29.294 INFO:tasks.workunit.client.1.smithi107.stdout:9/845: sync 2024-09-10T10:04:29.294 INFO:tasks.workunit.client.1.smithi107.stdout:6/922: sync 2024-09-10T10:04:29.295 INFO:tasks.workunit.client.1.smithi107.stdout:2/900: symlink d3/da/d1e/d5f/dad/deb/l13e 0 2024-09-10T10:04:29.298 INFO:tasks.workunit.client.1.smithi107.stdout:8/779: symlink d5/d42/ddb/l10b 0 2024-09-10T10:04:29.301 INFO:tasks.workunit.client.1.smithi107.stdout:0/894: mkdir d6/d8/d2f/d2e/d7b/d129 0 2024-09-10T10:04:29.301 INFO:tasks.workunit.client.1.smithi107.stdout:8/780: fsync d5/d8/d66/d8b/d21/f3a 0 2024-09-10T10:04:29.303 INFO:tasks.workunit.client.0.smithi071.stdout:5/830: dwrite dc/df/dd7/f2f [4194304,4194304] 0 2024-09-10T10:04:29.304 INFO:tasks.workunit.client.1.smithi107.stdout:6/923: creat d0/d3d/f144 x:0 0 0 2024-09-10T10:04:29.304 INFO:tasks.workunit.client.0.smithi071.stdout:5/831: chown dc/df/d3e/d5a/ffc 381 1 2024-09-10T10:04:29.306 INFO:tasks.workunit.client.1.smithi107.stdout:7/825: write d0/d8/d5c/f93 [4714679,78556] 0 2024-09-10T10:04:29.306 INFO:tasks.workunit.client.1.smithi107.stdout:0/895: write d6/d8/d3e/d43/f4b [557711,3461] 0 2024-09-10T10:04:29.309 INFO:tasks.workunit.client.1.smithi107.stdout:9/846: dwrite d5/d7/d1d/d9b/dab/d57/d87/d27/fa1 [0,4194304] 0 2024-09-10T10:04:29.311 INFO:tasks.workunit.client.0.smithi071.stdout:5/832: link dc/df/dd7/l77 dc/df/d3e/d5a/dd4/l11c 0 2024-09-10T10:04:29.313 INFO:tasks.workunit.client.1.smithi107.stdout:6/924: mkdir d0/d3d/d14/dde/d10c/d12a/d145 0 2024-09-10T10:04:29.318 INFO:tasks.workunit.client.0.smithi071.stdout:5/833: dwrite dc/d53/d6a/fd6 [0,4194304] 0 2024-09-10T10:04:29.319 INFO:tasks.workunit.client.0.smithi071.stdout:5/834: chown dc/df/d29/d94/fd8 959 1 2024-09-10T10:04:29.320 INFO:tasks.workunit.client.1.smithi107.stdout:2/901: dwrite d3/da/df/d20/d36/d39/da3/ddb/d12b/d129/f12d [0,4194304] 0 2024-09-10T10:04:29.321 INFO:tasks.workunit.client.1.smithi107.stdout:5/925: dread de/d20/d3d/fd2 [0,4194304] 0 2024-09-10T10:04:29.326 INFO:tasks.workunit.client.1.smithi107.stdout:0/896: getdents d6/d8/d2f/d2e 0 2024-09-10T10:04:29.329 INFO:tasks.workunit.client.1.smithi107.stdout:7/826: dwrite d0/fcf [4194304,4194304] 0 2024-09-10T10:04:29.329 INFO:tasks.workunit.client.1.smithi107.stdout:5/926: mknod de/d20/d2b/d4b/d5e/d116/d4e/d89/d99/c136 0 2024-09-10T10:04:29.330 INFO:tasks.workunit.client.0.smithi071.stdout:1/856: dread d1/d21/d2f/ffb [4194304,4194304] 0 2024-09-10T10:04:29.331 INFO:tasks.workunit.client.1.smithi107.stdout:5/927: chown de/d20/d2b/d4b/d5e/d116/d7e/db2 54298564 1 2024-09-10T10:04:29.333 INFO:tasks.workunit.client.0.smithi071.stdout:5/835: dread dc/df/d17/fef [0,4194304] 0 2024-09-10T10:04:29.333 INFO:tasks.workunit.client.1.smithi107.stdout:5/928: readlink de/d20/d2b/d4b/d8c/l121 0 2024-09-10T10:04:29.334 INFO:tasks.workunit.client.0.smithi071.stdout:5/836: dread - dc/df/d3e/d5a/d80/d8a/da3/ffa zero size 2024-09-10T10:04:29.334 INFO:tasks.workunit.client.0.smithi071.stdout:1/857: rename d1/d21/d65/f53 to d1/d3f/d58/f12d 0 2024-09-10T10:04:29.335 INFO:tasks.workunit.client.0.smithi071.stdout:5/837: fdatasync dc/df/d29/f5f 0 2024-09-10T10:04:29.337 INFO:tasks.workunit.client.0.smithi071.stdout:1/858: write d1/d21/d2f/d30/f7d [1268302,126552] 0 2024-09-10T10:04:29.340 INFO:tasks.workunit.client.1.smithi107.stdout:0/897: getdents d6/d8/d2f/d2e/d32/d95 0 2024-09-10T10:04:29.340 INFO:tasks.workunit.client.0.smithi071.stdout:1/859: truncate d1/f9 2079574 0 2024-09-10T10:04:29.341 INFO:tasks.workunit.client.1.smithi107.stdout:2/902: link d3/f6c d3/da/df/d20/d36/f13f 0 2024-09-10T10:04:29.341 INFO:tasks.workunit.client.0.smithi071.stdout:5/838: dread dc/df/dd7/f2f [0,4194304] 0 2024-09-10T10:04:29.342 INFO:tasks.workunit.client.0.smithi071.stdout:1/860: chown d1/d21/d2f/d30/d6a/c44 129175 1 2024-09-10T10:04:29.343 INFO:tasks.workunit.client.1.smithi107.stdout:5/929: dread de/d20/d2b/d4b/d5e/fa5 [0,4194304] 0 2024-09-10T10:04:29.343 INFO:tasks.workunit.client.1.smithi107.stdout:2/903: chown d3/da/d1e/d40/d8a/d7f/d55/d85/d7c/la7 218483 1 2024-09-10T10:04:29.344 INFO:tasks.workunit.client.0.smithi071.stdout:5/839: creat dc/d53/db2/f11d x:0 0 0 2024-09-10T10:04:29.344 INFO:tasks.workunit.client.1.smithi107.stdout:0/898: getdents d6/d8/d2f/d6e/dc5/ddb/df1 0 2024-09-10T10:04:29.347 INFO:tasks.workunit.client.0.smithi071.stdout:5/840: rename dc/df/d17/d8d/fb0 to dc/df/d3e/d5a/d80/f11e 0 2024-09-10T10:04:29.347 INFO:tasks.workunit.client.1.smithi107.stdout:5/930: symlink de/d20/d2b/d4b/d8c/d12f/l137 0 2024-09-10T10:04:29.349 INFO:tasks.workunit.client.0.smithi071.stdout:5/841: creat dc/df/d17/d8d/d119/f11f x:0 0 0 2024-09-10T10:04:29.349 INFO:tasks.workunit.client.1.smithi107.stdout:5/931: fsync de/d20/d3d/dd4/f11d 0 2024-09-10T10:04:29.350 INFO:tasks.workunit.client.0.smithi071.stdout:5/842: fsync dc/df/dd7/d87/f92 0 2024-09-10T10:04:29.354 INFO:tasks.workunit.client.1.smithi107.stdout:5/932: symlink de/d20/d2b/d4b/l138 0 2024-09-10T10:04:29.356 INFO:tasks.workunit.client.1.smithi107.stdout:5/933: stat de/f28 0 2024-09-10T10:04:29.356 INFO:tasks.workunit.client.1.smithi107.stdout:0/899: dwrite d6/d8/d2f/da3/da5/fbc [0,4194304] 0 2024-09-10T10:04:29.357 INFO:tasks.workunit.client.1.smithi107.stdout:9/847: truncate d5/f6a 630689 0 2024-09-10T10:04:29.359 INFO:tasks.workunit.client.1.smithi107.stdout:6/925: truncate d0/d3d/d14/d42/f4e 397150 0 2024-09-10T10:04:29.359 INFO:tasks.workunit.client.1.smithi107.stdout:8/781: dwrite d5/d8/d5b/f74 [0,4194304] 0 2024-09-10T10:04:29.363 INFO:tasks.workunit.client.1.smithi107.stdout:7/827: fsync d0/fcf 0 2024-09-10T10:04:29.369 INFO:tasks.workunit.client.1.smithi107.stdout:8/782: mkdir d5/d42/ddb/d10c 0 2024-09-10T10:04:29.372 INFO:tasks.workunit.client.0.smithi071.stdout:4/725: dwrite db/d8f/fbf [0,4194304] 0 2024-09-10T10:04:29.372 INFO:tasks.workunit.client.1.smithi107.stdout:7/828: creat d0/d8/d56/dcc/da0/f111 x:0 0 0 2024-09-10T10:04:29.372 INFO:tasks.workunit.client.1.smithi107.stdout:8/783: chown d5/d8/d66/d8b/d18/fc3 212 1 2024-09-10T10:04:29.375 INFO:tasks.workunit.client.0.smithi071.stdout:4/726: mknod db/d15/d26/cf3 0 2024-09-10T10:04:29.376 INFO:tasks.workunit.client.1.smithi107.stdout:9/848: rename d5/d7/d1d/d3b/l8d to d5/d7/d1d/d9b/de5/l11e 0 2024-09-10T10:04:29.376 INFO:tasks.workunit.client.1.smithi107.stdout:8/784: read d5/d8/d66/d8b/d21/fb3 [3139379,64967] 0 2024-09-10T10:04:29.379 INFO:tasks.workunit.client.0.smithi071.stdout:4/727: creat db/d15/d17/d4e/d5a/ff4 x:0 0 0 2024-09-10T10:04:29.379 INFO:tasks.workunit.client.1.smithi107.stdout:6/926: creat d0/d3d/d14/f146 x:0 0 0 2024-09-10T10:04:29.381 INFO:tasks.workunit.client.1.smithi107.stdout:0/900: link d6/d8/d3e/d43/fc0 d6/d8/d2f/da3/dee/f12a 0 2024-09-10T10:04:29.383 INFO:tasks.workunit.client.1.smithi107.stdout:9/849: chown d5/d7/d1d/d41/d83/d9a/f28 6941114 1 2024-09-10T10:04:29.384 INFO:tasks.workunit.client.1.smithi107.stdout:8/785: creat d5/d8/d66/d8b/d1a/d71/f10d x:0 0 0 2024-09-10T10:04:29.385 INFO:tasks.workunit.client.1.smithi107.stdout:7/829: dread d0/d8/fa8 [0,4194304] 0 2024-09-10T10:04:29.385 INFO:tasks.workunit.client.1.smithi107.stdout:0/901: dread - d6/d8/d2f/d2e/d32/d56/ff0 zero size 2024-09-10T10:04:29.385 INFO:tasks.workunit.client.0.smithi071.stdout:2/885: sync 2024-09-10T10:04:29.386 INFO:tasks.workunit.client.1.smithi107.stdout:5/934: rename de/fb8 to de/d20/d2b/d4b/d5e/d116/d4e/d89/d99/f139 0 2024-09-10T10:04:29.386 INFO:tasks.workunit.client.1.smithi107.stdout:7/830: write d0/fd9 [373660,124028] 0 2024-09-10T10:04:29.387 INFO:tasks.workunit.client.0.smithi071.stdout:2/886: dread - d8/d38/d8d/f105 zero size 2024-09-10T10:04:29.387 INFO:tasks.workunit.client.1.smithi107.stdout:6/927: mknod d0/d3d/d14/d21/d124/c147 0 2024-09-10T10:04:29.388 INFO:tasks.workunit.client.0.smithi071.stdout:4/728: dwrite db/d15/d26/d43/d82/f83 [4194304,4194304] 0 2024-09-10T10:04:29.390 INFO:tasks.workunit.client.0.smithi071.stdout:2/887: dread - d8/d87/d49/d66/df0/f110 zero size 2024-09-10T10:04:29.392 INFO:tasks.workunit.client.1.smithi107.stdout:5/935: mknod de/d20/d3d/dd4/c13a 0 2024-09-10T10:04:29.393 INFO:tasks.workunit.client.0.smithi071.stdout:4/729: mknod db/d1d/d61/d6a/d88/d90/cf5 0 2024-09-10T10:04:29.396 INFO:tasks.workunit.client.1.smithi107.stdout:8/786: dwrite d5/d8/d66/d8b/d21/d83/ff5 [0,4194304] 0 2024-09-10T10:04:29.396 INFO:tasks.workunit.client.1.smithi107.stdout:2/904: dread d3/da/d1e/d40/f9f [0,4194304] 0 2024-09-10T10:04:29.399 INFO:tasks.workunit.client.0.smithi071.stdout:2/888: read d8/d38/d63/fc1 [2085768,84378] 0 2024-09-10T10:04:29.401 INFO:tasks.workunit.client.1.smithi107.stdout:5/936: rename de/d20/f80 to de/d20/d2b/d4b/d5e/d116/d5c/f13b 0 2024-09-10T10:04:29.404 INFO:tasks.workunit.client.1.smithi107.stdout:2/905: unlink d3/da/d1e/d40/lca 0 2024-09-10T10:04:29.407 INFO:tasks.workunit.client.0.smithi071.stdout:5/843: dwrite dc/df/d17/fa2 [0,4194304] 0 2024-09-10T10:04:29.408 INFO:tasks.workunit.client.1.smithi107.stdout:8/787: dwrite d5/d8/d66/d8b/d21/f3e [4194304,4194304] 0 2024-09-10T10:04:29.411 INFO:tasks.workunit.client.1.smithi107.stdout:5/937: write de/d20/d2b/d4b/d5e/db1/f118 [1304931,46432] 0 2024-09-10T10:04:29.411 INFO:tasks.workunit.client.1.smithi107.stdout:2/906: symlink d3/da/df/d20/d36/d39/da3/d123/l140 0 2024-09-10T10:04:29.414 INFO:tasks.workunit.client.1.smithi107.stdout:9/850: write d5/d7/d1d/d9b/dab/d57/d87/d27/f42 [2978558,47487] 0 2024-09-10T10:04:29.417 INFO:tasks.workunit.client.0.smithi071.stdout:5/844: dwrite dc/df/d17/f1f [4194304,4194304] 0 2024-09-10T10:04:29.420 INFO:tasks.workunit.client.1.smithi107.stdout:8/788: getdents d5/d42 0 2024-09-10T10:04:29.422 INFO:tasks.workunit.client.1.smithi107.stdout:9/851: chown d5/d7/d1d/d41/d83/d9a/l11b 255 1 2024-09-10T10:04:29.422 INFO:tasks.workunit.client.0.smithi071.stdout:5/845: mkdir dc/df/d3e/d5a/dd2/d120 0 2024-09-10T10:04:29.425 INFO:tasks.workunit.client.0.smithi071.stdout:5/846: write dc/d53/db2/f8f [3687845,71950] 0 2024-09-10T10:04:29.425 INFO:tasks.workunit.client.1.smithi107.stdout:8/789: read d5/f79 [3084307,55970] 0 2024-09-10T10:04:29.425 INFO:tasks.workunit.client.1.smithi107.stdout:7/831: dwrite d0/d8/d56/d5d/f8b [0,4194304] 0 2024-09-10T10:04:29.426 INFO:tasks.workunit.client.0.smithi071.stdout:4/730: dread db/f46 [0,4194304] 0 2024-09-10T10:04:29.427 INFO:tasks.workunit.client.0.smithi071.stdout:4/731: chown db/d15/d17/d4e/d5a 1 1 2024-09-10T10:04:29.428 INFO:tasks.workunit.client.0.smithi071.stdout:5/847: chown dc/df/d3e/d5a/d80/cbf 16210769 1 2024-09-10T10:04:29.429 INFO:tasks.workunit.client.0.smithi071.stdout:4/732: mknod db/d1d/d61/d6a/d88/d90/cf6 0 2024-09-10T10:04:29.431 INFO:tasks.workunit.client.1.smithi107.stdout:9/852: mkdir d5/d7/d1d/d29/db4/dbd/d11f 0 2024-09-10T10:04:29.431 INFO:tasks.workunit.client.0.smithi071.stdout:5/848: creat dc/df/d3e/d5a/f121 x:0 0 0 2024-09-10T10:04:29.433 INFO:tasks.workunit.client.0.smithi071.stdout:4/733: rename db/d15/d26/d43/c95 to db/d15/d26/d43/d4d/cf7 0 2024-09-10T10:04:29.435 INFO:tasks.workunit.client.1.smithi107.stdout:2/907: dread d3/da/d1e/d27/fa4 [0,4194304] 0 2024-09-10T10:04:29.437 INFO:tasks.workunit.client.1.smithi107.stdout:8/790: creat d5/d8/d66/d8b/d18/da4/f10e x:0 0 0 2024-09-10T10:04:29.438 INFO:tasks.workunit.client.1.smithi107.stdout:9/853: truncate f3 4327997 0 2024-09-10T10:04:29.439 INFO:tasks.workunit.client.1.smithi107.stdout:7/832: dwrite d0/d8/d56/f10c [0,4194304] 0 2024-09-10T10:04:29.442 INFO:tasks.workunit.client.1.smithi107.stdout:7/833: write d0/d8/d56/dcc/d81/dbc/fea [100637,72060] 0 2024-09-10T10:04:29.444 INFO:tasks.workunit.client.1.smithi107.stdout:8/791: unlink d5/d8/d5b/f76 0 2024-09-10T10:04:29.445 INFO:tasks.workunit.client.1.smithi107.stdout:7/834: write d0/d1b/d4d/d69/fc3 [930595,35070] 0 2024-09-10T10:04:29.446 INFO:tasks.workunit.client.1.smithi107.stdout:7/835: fdatasync d0/d99/fe2 0 2024-09-10T10:04:29.447 INFO:tasks.workunit.client.1.smithi107.stdout:2/908: truncate d3/da/df/d20/dfb/d136/dea/ffe 593072 0 2024-09-10T10:04:29.447 INFO:tasks.workunit.client.1.smithi107.stdout:9/854: read d5/d7/d1d/d41/d83/fa6 [176850,74213] 0 2024-09-10T10:04:29.455 INFO:tasks.workunit.client.1.smithi107.stdout:7/836: fdatasync d0/d8/dc/f71 0 2024-09-10T10:04:29.460 INFO:tasks.workunit.client.1.smithi107.stdout:8/792: dwrite d5/d8/d66/d8b/d1a/d64/db9/ff6 [0,4194304] 0 2024-09-10T10:04:29.465 INFO:tasks.workunit.client.1.smithi107.stdout:7/837: rename d0/d1b/d4d/f8d to d0/d20/ddf/f112 0 2024-09-10T10:04:29.465 INFO:tasks.workunit.client.1.smithi107.stdout:7/838: stat d0/d20/d35 0 2024-09-10T10:04:29.466 INFO:tasks.workunit.client.0.smithi071.stdout:5/849: dread dc/d53/f7f [0,4194304] 0 2024-09-10T10:04:29.467 INFO:tasks.workunit.client.1.smithi107.stdout:2/909: fdatasync d3/da/df/d20/d36/d39/da3/ddb/d12b/f93 0 2024-09-10T10:04:29.467 INFO:tasks.workunit.client.0.smithi071.stdout:5/850: fsync dc/f21 0 2024-09-10T10:04:29.467 INFO:tasks.workunit.client.1.smithi107.stdout:8/793: dread d5/d8/d66/d8b/d18/fb2 [0,4194304] 0 2024-09-10T10:04:29.469 INFO:tasks.workunit.client.0.smithi071.stdout:5/851: mknod dc/d53/db2/c122 0 2024-09-10T10:04:29.471 INFO:tasks.workunit.client.0.smithi071.stdout:5/852: fdatasync dc/df/dd7/d87/f9f 0 2024-09-10T10:04:29.473 INFO:tasks.workunit.client.1.smithi107.stdout:7/839: dread - d0/d8/d5c/fae zero size 2024-09-10T10:04:29.475 INFO:tasks.workunit.client.0.smithi071.stdout:5/853: unlink dc/d53/db2/f11d 0 2024-09-10T10:04:29.476 INFO:tasks.workunit.client.0.smithi071.stdout:5/854: truncate dc/df/d29/fa1 3285076 0 2024-09-10T10:04:29.477 INFO:tasks.workunit.client.0.smithi071.stdout:5/855: read - dc/d4a/f115 zero size 2024-09-10T10:04:29.478 INFO:tasks.workunit.client.0.smithi071.stdout:5/856: read dc/d53/d6a/f96 [671003,106657] 0 2024-09-10T10:04:29.479 INFO:tasks.workunit.client.1.smithi107.stdout:7/840: fdatasync d0/d1b/d4d/d69/dca/fd6 0 2024-09-10T10:04:29.479 INFO:tasks.workunit.client.1.smithi107.stdout:2/910: dwrite d3/da/df/d20/d36/d39/da3/ddb/d12b/fbd [0,4194304] 0 2024-09-10T10:04:29.481 INFO:tasks.workunit.client.1.smithi107.stdout:7/841: chown d0/d8/dc/ff6 120193991 1 2024-09-10T10:04:29.482 INFO:tasks.workunit.client.1.smithi107.stdout:9/855: dwrite d5/d7/fe [0,4194304] 0 2024-09-10T10:04:29.484 INFO:tasks.workunit.client.1.smithi107.stdout:2/911: fdatasync d3/da/df/d20/d36/f76 0 2024-09-10T10:04:29.487 INFO:tasks.workunit.client.1.smithi107.stdout:9/856: mknod d5/d7/d1d/d29/c120 0 2024-09-10T10:04:29.490 INFO:tasks.workunit.client.1.smithi107.stdout:9/857: stat c2 0 2024-09-10T10:04:29.493 INFO:tasks.workunit.client.1.smithi107.stdout:7/842: dread d0/d8/d56/dcc/f55 [0,4194304] 0 2024-09-10T10:04:29.494 INFO:tasks.workunit.client.1.smithi107.stdout:9/858: creat d5/d7/d1d/d29/d101/f121 x:0 0 0 2024-09-10T10:04:29.495 INFO:tasks.workunit.client.1.smithi107.stdout:2/912: dwrite d3/da/f105 [0,4194304] 0 2024-09-10T10:04:29.500 INFO:tasks.workunit.client.1.smithi107.stdout:8/794: dwrite d5/d8/d5b/f6f [0,4194304] 0 2024-09-10T10:04:29.501 INFO:tasks.workunit.client.0.smithi071.stdout:2/889: dwrite d8/d38/d8d/fa7 [0,4194304] 0 2024-09-10T10:04:29.503 INFO:tasks.workunit.client.1.smithi107.stdout:2/913: write d3/da/df/d20/d36/d4f/d92/fd9 [937383,104498] 0 2024-09-10T10:04:29.507 INFO:tasks.workunit.client.0.smithi071.stdout:2/890: link d8/d4a/f124 d8/db6/de7/f12d 0 2024-09-10T10:04:29.507 INFO:tasks.workunit.client.1.smithi107.stdout:9/859: dwrite d5/d7/d1d/d29/fe2 [0,4194304] 0 2024-09-10T10:04:29.510 INFO:tasks.workunit.client.0.smithi071.stdout:2/891: chown d8/d38/d99/cb1 3908 1 2024-09-10T10:04:29.517 INFO:tasks.workunit.client.1.smithi107.stdout:2/914: symlink d3/da/df/d20/d36/l141 0 2024-09-10T10:04:29.518 INFO:tasks.workunit.client.0.smithi071.stdout:2/892: rename d8/d87/d49/d66/df0/f101 to d8/d38/d63/f12e 0 2024-09-10T10:04:29.521 INFO:tasks.workunit.client.0.smithi071.stdout:2/893: write d8/d38/d63/f12e [1685700,19491] 0 2024-09-10T10:04:29.522 INFO:tasks.workunit.client.1.smithi107.stdout:7/843: dwrite d0/d8/d56/dcc/d81/dbc/fc2 [0,4194304] 0 2024-09-10T10:04:29.526 INFO:tasks.workunit.client.0.smithi071.stdout:2/894: rename d8/d24/l3f to d8/d38/d63/dc9/l12f 0 2024-09-10T10:04:29.526 INFO:tasks.workunit.client.0.smithi071.stdout:2/895: stat d8/d24/d7f/fe8 0 2024-09-10T10:04:29.527 INFO:tasks.workunit.client.0.smithi071.stdout:2/896: truncate d8/d87/f76 4224166 0 2024-09-10T10:04:29.528 INFO:tasks.workunit.client.1.smithi107.stdout:2/915: chown d3/f6c 688211539 1 2024-09-10T10:04:29.529 INFO:tasks.workunit.client.0.smithi071.stdout:2/897: symlink d8/d38/l130 0 2024-09-10T10:04:29.531 INFO:tasks.workunit.client.0.smithi071.stdout:2/898: mkdir d8/d87/dc4/d103/d131 0 2024-09-10T10:04:29.533 INFO:tasks.workunit.client.0.smithi071.stdout:2/899: read d8/d4a/ffa [439850,69738] 0 2024-09-10T10:04:29.536 INFO:tasks.workunit.client.0.smithi071.stdout:2/900: creat d8/d87/d33/d41/d4d/d5e/f132 x:0 0 0 2024-09-10T10:04:29.536 INFO:tasks.workunit.client.1.smithi107.stdout:2/916: mkdir d3/da/df/d20/d36/d10f/d142 0 2024-09-10T10:04:29.537 INFO:tasks.workunit.client.1.smithi107.stdout:7/844: dwrite d0/d8/d5c/f93 [4194304,4194304] 0 2024-09-10T10:04:29.537 INFO:tasks.workunit.client.1.smithi107.stdout:8/795: dwrite d5/d8/d66/d8b/d18/fb2 [0,4194304] 0 2024-09-10T10:04:29.538 INFO:tasks.workunit.client.0.smithi071.stdout:2/901: dread - d8/d38/fca zero size 2024-09-10T10:04:29.539 INFO:tasks.workunit.client.0.smithi071.stdout:2/902: truncate d8/d87/d33/f3c 5172840 0 2024-09-10T10:04:29.541 INFO:tasks.workunit.client.1.smithi107.stdout:9/860: dwrite d5/d7/d1d/d41/d83/d9a/f28 [0,4194304] 0 2024-09-10T10:04:29.546 INFO:tasks.workunit.client.1.smithi107.stdout:8/796: symlink d5/d8/d66/d8b/d18/l10f 0 2024-09-10T10:04:29.550 INFO:tasks.workunit.client.0.smithi071.stdout:5/857: dread dc/df/d29/f5f [0,4194304] 0 2024-09-10T10:04:29.550 INFO:tasks.workunit.client.1.smithi107.stdout:7/845: dwrite d0/d20/d35/f9f [4194304,4194304] 0 2024-09-10T10:04:29.550 INFO:tasks.workunit.client.1.smithi107.stdout:8/797: mknod d5/d8/d66/d8b/d1a/d64/c110 0 2024-09-10T10:04:29.553 INFO:tasks.workunit.client.0.smithi071.stdout:5/858: creat dc/d53/f123 x:0 0 0 2024-09-10T10:04:29.553 INFO:tasks.workunit.client.1.smithi107.stdout:9/861: getdents d5/d1e/dc5 0 2024-09-10T10:04:29.556 INFO:tasks.workunit.client.0.smithi071.stdout:5/859: write dc/d53/db2/f8f [1343963,48396] 0 2024-09-10T10:04:29.556 INFO:tasks.workunit.client.1.smithi107.stdout:9/862: readlink d5/d7/d1d/d9b/dab/d57/d87/d37/l84 0 2024-09-10T10:04:29.557 INFO:tasks.workunit.client.1.smithi107.stdout:9/863: chown d5/d7/d1d/d29/db4 15323733 1 2024-09-10T10:04:29.560 INFO:tasks.workunit.client.1.smithi107.stdout:2/917: write d3/d8f/df4/d102/fdc [292222,100232] 0 2024-09-10T10:04:29.561 INFO:tasks.workunit.client.1.smithi107.stdout:9/864: creat d5/d7/d1d/d29/db4/dbd/f122 x:0 0 0 2024-09-10T10:04:29.561 INFO:tasks.workunit.client.1.smithi107.stdout:2/918: chown d3/da/d1e/d27/c59 355 1 2024-09-10T10:04:29.563 INFO:tasks.workunit.client.1.smithi107.stdout:2/919: chown d3/da/df/d20/d36/f13f 4 1 2024-09-10T10:04:29.564 INFO:tasks.workunit.client.1.smithi107.stdout:9/865: write d5/d7/d1d/d29/db4/dbd/f114 [2077766,20694] 0 2024-09-10T10:04:29.565 INFO:tasks.workunit.client.1.smithi107.stdout:9/866: chown d5/ce9 723019 1 2024-09-10T10:04:29.566 INFO:tasks.workunit.client.1.smithi107.stdout:2/920: mknod d3/da/df/d20/d36/d4f/d92/c143 0 2024-09-10T10:04:29.572 INFO:tasks.workunit.client.0.smithi071.stdout:6/722: sync 2024-09-10T10:04:29.572 INFO:tasks.workunit.client.0.smithi071.stdout:8/845: sync 2024-09-10T10:04:29.572 INFO:tasks.workunit.client.0.smithi071.stdout:3/832: sync 2024-09-10T10:04:29.574 INFO:tasks.workunit.client.0.smithi071.stdout:3/833: readlink d3/d1c/d3e/lf4 0 2024-09-10T10:04:29.575 INFO:tasks.workunit.client.0.smithi071.stdout:8/846: unlink d5/df/d95/lb0 0 2024-09-10T10:04:29.575 INFO:tasks.workunit.client.1.smithi107.stdout:9/867: write d5/d7/fb2 [1504121,96171] 0 2024-09-10T10:04:29.576 INFO:tasks.workunit.client.0.smithi071.stdout:8/847: chown d5/df/d1d/d81/f10a 2566 1 2024-09-10T10:04:29.576 INFO:tasks.workunit.client.0.smithi071.stdout:6/723: rename d4/da/df/d2e/d3a/d43/cd9 to d4/d61/d83/cec 0 2024-09-10T10:04:29.578 INFO:tasks.workunit.client.0.smithi071.stdout:6/724: write d4/d20/f7d [628343,98697] 0 2024-09-10T10:04:29.579 INFO:tasks.workunit.client.0.smithi071.stdout:3/834: getdents d3/d49/d2f/d7f 0 2024-09-10T10:04:29.581 INFO:tasks.workunit.client.1.smithi107.stdout:2/921: dwrite d3/f18 [0,4194304] 0 2024-09-10T10:04:29.582 INFO:tasks.workunit.client.1.smithi107.stdout:9/868: truncate d5/d7/d1d/d9b/dab/d57/d87/d27/f51 2106867 0 2024-09-10T10:04:29.583 INFO:tasks.workunit.client.0.smithi071.stdout:3/835: mknod d3/d1c/d3e/d77/c11c 0 2024-09-10T10:04:29.583 INFO:tasks.workunit.client.0.smithi071.stdout:3/836: fsync d3/d1c/d3c/da1/d3a/f68 0 2024-09-10T10:04:29.584 INFO:tasks.workunit.client.0.smithi071.stdout:3/837: chown d3/d49/d4f/l55 14 1 2024-09-10T10:04:29.585 INFO:tasks.workunit.client.1.smithi107.stdout:7/846: dread d0/d1b/d4d/d69/d97/d68/f58 [0,4194304] 0 2024-09-10T10:04:29.590 INFO:tasks.workunit.client.0.smithi071.stdout:3/838: dwrite d3/f8c [0,4194304] 0 2024-09-10T10:04:29.595 INFO:tasks.workunit.client.0.smithi071.stdout:3/839: creat d3/d1c/d3c/da1/d42/d4a/d60/f11d x:0 0 0 2024-09-10T10:04:29.619 INFO:tasks.workunit.client.1.smithi107.stdout:7/847: symlink d0/d8/dc/d2c/d47/l113 0 2024-09-10T10:04:29.619 INFO:tasks.workunit.client.1.smithi107.stdout:9/869: getdents d5/d7/d1d/d41/d83/d9a/d8c/d111 0 2024-09-10T10:04:29.620 INFO:tasks.workunit.client.1.smithi107.stdout:7/848: truncate d0/fcf 8643682 0 2024-09-10T10:04:29.640 INFO:tasks.workunit.client.1.smithi107.stdout:2/922: dwrite d3/da/d1e/d5f/f34 [0,4194304] 0 2024-09-10T10:04:29.641 INFO:tasks.workunit.client.1.smithi107.stdout:7/849: chown d0/d1b/d4d/d69/d97/d68/fc7 30 1 2024-09-10T10:04:29.643 INFO:tasks.workunit.client.1.smithi107.stdout:9/870: dread d5/d7/d1d/d9b/dab/d57/d87/fea [4194304,4194304] 0 2024-09-10T10:04:29.643 INFO:tasks.workunit.client.0.smithi071.stdout:4/734: write db/d15/d17/d4e/d5a/f7c [866617,10872] 0 2024-09-10T10:04:29.646 INFO:tasks.workunit.client.1.smithi107.stdout:2/923: creat d3/f144 x:0 0 0 2024-09-10T10:04:29.646 INFO:tasks.workunit.client.0.smithi071.stdout:4/735: rmdir db/d1d/d61 39 2024-09-10T10:04:29.652 INFO:tasks.workunit.client.1.smithi107.stdout:9/871: dwrite d5/d7/d1d/d29/fe2 [4194304,4194304] 0 2024-09-10T10:04:29.653 INFO:tasks.workunit.client.1.smithi107.stdout:7/850: getdents d0/d20/ddf 0 2024-09-10T10:04:29.654 INFO:tasks.workunit.client.1.smithi107.stdout:2/924: write d3/da/d1e/d5f/d54/d114/f115 [373046,73417] 0 2024-09-10T10:04:29.659 INFO:tasks.workunit.client.1.smithi107.stdout:2/925: symlink d3/da/d1e/d5f/d54/d114/l145 0 2024-09-10T10:04:29.661 INFO:tasks.workunit.client.1.smithi107.stdout:2/926: dread - d3/da/df/d20/d36/d39/da3/ddb/f11f zero size 2024-09-10T10:04:29.662 INFO:tasks.workunit.client.0.smithi071.stdout:2/903: write d8/d87/d33/d41/d56/d107/f117 [1915341,34431] 0 2024-09-10T10:04:29.664 INFO:tasks.workunit.client.0.smithi071.stdout:8/848: truncate d5/d36/f6d 3833535 0 2024-09-10T10:04:29.664 INFO:tasks.workunit.client.0.smithi071.stdout:2/904: creat d8/d24/d7f/f133 x:0 0 0 2024-09-10T10:04:29.665 INFO:tasks.workunit.client.1.smithi107.stdout:9/872: dwrite d5/d7/d1d/d41/dc8/dfc/d10d/ff9 [0,4194304] 0 2024-09-10T10:04:29.666 INFO:tasks.workunit.client.0.smithi071.stdout:8/849: mkdir d5/df/d74/d11d/d125 0 2024-09-10T10:04:29.666 INFO:tasks.workunit.client.1.smithi107.stdout:9/873: stat d5/l40 0 2024-09-10T10:04:29.667 INFO:tasks.workunit.client.1.smithi107.stdout:8/798: dread d5/d8/d5b/fe2 [0,4194304] 0 2024-09-10T10:04:29.668 INFO:tasks.workunit.client.0.smithi071.stdout:2/905: read - d8/d87/d49/d66/ff1 zero size 2024-09-10T10:04:29.668 INFO:tasks.workunit.client.0.smithi071.stdout:8/850: write d5/df/d1e/d38/f42 [3449116,74581] 0 2024-09-10T10:04:29.669 INFO:tasks.workunit.client.1.smithi107.stdout:9/874: mkdir d5/d7/d1d/d9b/de5/d123 0 2024-09-10T10:04:29.670 INFO:tasks.workunit.client.0.smithi071.stdout:6/725: dwrite d4/d61/d83/da8/f99 [0,4194304] 0 2024-09-10T10:04:29.673 INFO:tasks.workunit.client.0.smithi071.stdout:6/726: stat d4/da/df/d2e/d3a/d51/d64 0 2024-09-10T10:04:29.673 INFO:tasks.workunit.client.0.smithi071.stdout:2/906: creat d8/db6/de7/f134 x:0 0 0 2024-09-10T10:04:29.673 INFO:tasks.workunit.client.0.smithi071.stdout:8/851: creat d5/df/d1e/d38/d9f/f126 x:0 0 0 2024-09-10T10:04:29.673 INFO:tasks.workunit.client.0.smithi071.stdout:1/861: sync 2024-09-10T10:04:29.674 INFO:tasks.workunit.client.1.smithi107.stdout:8/799: rename d5/d8/d2a to d5/d8/d66/d8b/d18/d4f/d111 0 2024-09-10T10:04:29.675 INFO:tasks.workunit.client.0.smithi071.stdout:6/727: mkdir d4/ded 0 2024-09-10T10:04:29.676 INFO:tasks.workunit.client.1.smithi107.stdout:8/800: write d5/d8/d66/d8b/d21/f3a [45852,10096] 0 2024-09-10T10:04:29.676 INFO:tasks.workunit.client.0.smithi071.stdout:2/907: creat d8/d87/d51/f135 x:0 0 0 2024-09-10T10:04:29.677 INFO:tasks.workunit.client.1.smithi107.stdout:9/875: dwrite d5/d7/d1d/d9b/dab/d57/d87/d27/f60 [0,4194304] 0 2024-09-10T10:04:29.678 INFO:tasks.workunit.client.1.smithi107.stdout:2/927: write d3/da/df/d20/d36/f76 [4038119,71976] 0 2024-09-10T10:04:29.680 INFO:tasks.workunit.client.1.smithi107.stdout:8/801: rmdir d5/d8/d66/d8b/d18/d4f/d111/d47 39 2024-09-10T10:04:29.681 INFO:tasks.workunit.client.0.smithi071.stdout:2/908: fdatasync d8/d87/d51/fec 0 2024-09-10T10:04:29.683 INFO:tasks.workunit.client.1.smithi107.stdout:2/928: creat d3/da/df/d20/dfb/f146 x:0 0 0 2024-09-10T10:04:29.684 INFO:tasks.workunit.client.0.smithi071.stdout:1/862: dwrite d1/fd [0,4194304] 0 2024-09-10T10:04:29.687 INFO:tasks.workunit.client.1.smithi107.stdout:8/802: mkdir d5/da2/d112 0 2024-09-10T10:04:29.687 INFO:tasks.workunit.client.0.smithi071.stdout:6/728: creat d4/da/df/d2e/d3a/d91/dc7/d81/fee x:0 0 0 2024-09-10T10:04:29.687 INFO:tasks.workunit.client.0.smithi071.stdout:1/863: dread d1/d3f/f11a [0,4194304] 0 2024-09-10T10:04:29.689 INFO:tasks.workunit.client.1.smithi107.stdout:9/876: dwrite d5/d7/d1d/d9b/dab/d57/f69 [0,4194304] 0 2024-09-10T10:04:29.690 INFO:tasks.workunit.client.0.smithi071.stdout:1/864: fdatasync d1/f8e 0 2024-09-10T10:04:29.690 INFO:tasks.workunit.client.0.smithi071.stdout:2/909: link d8/d87/f1c d8/d87/dc4/f136 0 2024-09-10T10:04:29.691 INFO:tasks.workunit.client.0.smithi071.stdout:2/910: chown d8/db6/d11b 4 1 2024-09-10T10:04:29.693 INFO:tasks.workunit.client.0.smithi071.stdout:2/911: dread - d8/d38/d8d/f105 zero size 2024-09-10T10:04:29.693 INFO:tasks.workunit.client.0.smithi071.stdout:2/912: stat d8/d38/d99/cb1 0 2024-09-10T10:04:29.694 INFO:tasks.workunit.client.0.smithi071.stdout:1/865: mkdir d1/d21/d3d/d9a/df9/d12e 0 2024-09-10T10:04:29.695 INFO:tasks.workunit.client.0.smithi071.stdout:5/860: sync 2024-09-10T10:04:29.695 INFO:tasks.workunit.client.1.smithi107.stdout:9/877: truncate d5/d7/d1d/d95/faf 1116514 0 2024-09-10T10:04:29.702 INFO:tasks.workunit.client.1.smithi107.stdout:9/878: dwrite d5/d7/d1d/d29/fe2 [4194304,4194304] 0 2024-09-10T10:04:29.704 INFO:tasks.workunit.client.1.smithi107.stdout:9/879: rmdir d5/d7/d1d/d29/db4/dbd 39 2024-09-10T10:04:29.707 INFO:tasks.workunit.client.1.smithi107.stdout:9/880: symlink d5/d7/d1d/d9b/l124 0 2024-09-10T10:04:29.709 INFO:tasks.workunit.client.1.smithi107.stdout:9/881: dread - d5/d7/d1d/d29/db4/f113 zero size 2024-09-10T10:04:29.711 INFO:tasks.workunit.client.1.smithi107.stdout:9/882: symlink d5/d7/d1d/d41/dc8/l125 0 2024-09-10T10:04:29.712 INFO:tasks.workunit.client.0.smithi071.stdout:8/852: dread d5/df/d1d/d86/f3e [0,4194304] 0 2024-09-10T10:04:29.712 INFO:tasks.workunit.client.1.smithi107.stdout:7/851: dread d0/d8/d56/dcc/f60 [0,4194304] 0 2024-09-10T10:04:29.713 INFO:tasks.workunit.client.1.smithi107.stdout:8/803: write d5/d8/d66/fa9 [638694,91232] 0 2024-09-10T10:04:29.714 INFO:tasks.workunit.client.1.smithi107.stdout:7/852: write d0/d8/d56/d5d/fe9 [1744105,27185] 0 2024-09-10T10:04:29.716 INFO:tasks.workunit.client.1.smithi107.stdout:8/804: chown d5/d8/d66/d8b/d18/d4f/d111/d47/ffe 529 1 2024-09-10T10:04:29.718 INFO:tasks.workunit.client.1.smithi107.stdout:7/853: mknod d0/d8/d56/c114 0 2024-09-10T10:04:29.719 INFO:tasks.workunit.client.1.smithi107.stdout:7/854: fdatasync d0/d8/d56/dcc/da0/fdb 0 2024-09-10T10:04:29.722 INFO:tasks.workunit.client.1.smithi107.stdout:7/855: fsync d0/d8/d56/dcc/de7/df8/ffc 0 2024-09-10T10:04:29.725 INFO:tasks.workunit.client.1.smithi107.stdout:7/856: mknod d0/d8/d56/c115 0 2024-09-10T10:04:29.727 INFO:tasks.workunit.client.1.smithi107.stdout:8/805: dread d5/d8/d66/fa9 [0,4194304] 0 2024-09-10T10:04:29.728 INFO:tasks.workunit.client.1.smithi107.stdout:8/806: stat d5/d8/d66/d8b/d21/f41 0 2024-09-10T10:04:29.729 INFO:tasks.workunit.client.1.smithi107.stdout:7/857: dread d0/d20/d35/f5e [0,4194304] 0 2024-09-10T10:04:29.731 INFO:tasks.workunit.client.0.smithi071.stdout:2/913: dread d8/d38/d63/fc1 [0,4194304] 0 2024-09-10T10:04:29.732 INFO:tasks.workunit.client.1.smithi107.stdout:8/807: mkdir d5/d8/d66/d8b/d21/d113 0 2024-09-10T10:04:29.732 INFO:tasks.workunit.client.1.smithi107.stdout:7/858: creat d0/dff/f116 x:0 0 0 2024-09-10T10:04:29.734 INFO:tasks.workunit.client.1.smithi107.stdout:8/808: mknod d5/d8/d66/d8b/d18/d4f/d111/c114 0 2024-09-10T10:04:29.735 INFO:tasks.workunit.client.1.smithi107.stdout:8/809: dread - d5/d8/d66/d8b/d18/fc3 zero size 2024-09-10T10:04:29.738 INFO:tasks.workunit.client.1.smithi107.stdout:8/810: symlink d5/d8/d66/d8b/dfd/l115 0 2024-09-10T10:04:29.739 INFO:tasks.workunit.client.1.smithi107.stdout:8/811: write d5/d8/d66/d8b/d18/d4f/fd8 [121471,74329] 0 2024-09-10T10:04:29.743 INFO:tasks.workunit.client.1.smithi107.stdout:7/859: dread d0/d8/f32 [0,4194304] 0 2024-09-10T10:04:29.748 INFO:tasks.workunit.client.1.smithi107.stdout:8/812: link d5/d8/d66/d8b/d1a/f4d d5/d8/d66/d8b/d21/d83/f116 0 2024-09-10T10:04:29.750 INFO:tasks.workunit.client.1.smithi107.stdout:7/860: read d0/d8/dc/f1f [3250589,65372] 0 2024-09-10T10:04:29.750 INFO:tasks.workunit.client.1.smithi107.stdout:8/813: chown d5/d8/d66/d8b/d1a/d75/def/ff7 1 1 2024-09-10T10:04:29.752 INFO:tasks.workunit.client.1.smithi107.stdout:9/883: dread d5/f5c [0,4194304] 0 2024-09-10T10:04:29.754 INFO:tasks.workunit.client.1.smithi107.stdout:8/814: fsync d5/d8/d66/d8b/fc7 0 2024-09-10T10:04:29.756 INFO:tasks.workunit.client.1.smithi107.stdout:8/815: dread - d5/f10a zero size 2024-09-10T10:04:29.757 INFO:tasks.workunit.client.1.smithi107.stdout:8/816: stat d5/l2d 0 2024-09-10T10:04:29.760 INFO:tasks.workunit.client.1.smithi107.stdout:9/884: read d5/d7/d1d/d9b/dab/d57/f7a [338299,23765] 0 2024-09-10T10:04:29.760 INFO:tasks.workunit.client.1.smithi107.stdout:7/861: dread d0/d1b/d9b/faf [0,4194304] 0 2024-09-10T10:04:29.760 INFO:tasks.workunit.client.1.smithi107.stdout:8/817: symlink d5/d8/d66/d8b/dfd/l117 0 2024-09-10T10:04:29.762 INFO:tasks.workunit.client.1.smithi107.stdout:9/885: fsync d5/d7/d1d/d9b/dab/d57/d87/d27/f51 0 2024-09-10T10:04:29.763 INFO:tasks.workunit.client.1.smithi107.stdout:9/886: fsync d5/d1e/f117 0 2024-09-10T10:04:29.764 INFO:tasks.workunit.client.1.smithi107.stdout:9/887: fdatasync d5/d7/d1d/d9b/dab/d57/d87/d37/fe7 0 2024-09-10T10:04:29.769 INFO:tasks.workunit.client.1.smithi107.stdout:8/818: dwrite d5/f10a [0,4194304] 0 2024-09-10T10:04:29.772 INFO:tasks.workunit.client.1.smithi107.stdout:8/819: fsync d5/d8/d66/d8b/d21/f73 0 2024-09-10T10:04:29.778 INFO:tasks.workunit.client.1.smithi107.stdout:8/820: dwrite d5/d8/d66/d8b/d21/f3e [0,4194304] 0 2024-09-10T10:04:29.779 INFO:tasks.workunit.client.1.smithi107.stdout:8/821: stat d5/d8/d66/d8b/d21/d83/lc5 0 2024-09-10T10:04:29.782 INFO:tasks.workunit.client.0.smithi071.stdout:3/840: truncate d3/d10/f84 1421762 0 2024-09-10T10:04:29.784 INFO:tasks.workunit.client.0.smithi071.stdout:6/729: mkdir d4/da/df/d2e/d3a/d40/d60/d7a/def 0 2024-09-10T10:04:29.784 INFO:tasks.workunit.client.0.smithi071.stdout:6/730: stat d4/d20 0 2024-09-10T10:04:29.785 INFO:tasks.workunit.client.0.smithi071.stdout:6/731: dread - d4/da/df/d5e/fd8 zero size 2024-09-10T10:04:29.794 INFO:tasks.workunit.client.1.smithi107.stdout:8/822: dwrite d5/d8/d66/d8b/fbc [0,4194304] 0 2024-09-10T10:04:29.796 INFO:tasks.workunit.client.1.smithi107.stdout:7/862: dread d0/d8/dc/f1f [0,4194304] 0 2024-09-10T10:04:29.803 INFO:tasks.workunit.client.1.smithi107.stdout:8/823: dwrite d5/d8/d66/d8b/d1a/d64/db9/fbf [0,4194304] 0 2024-09-10T10:04:29.816 INFO:tasks.workunit.client.1.smithi107.stdout:8/824: write d5/d8/d66/d8b/d1a/f4d [185485,126846] 0 2024-09-10T10:04:29.817 INFO:tasks.workunit.client.1.smithi107.stdout:8/825: stat d5/d42/lc2 0 2024-09-10T10:04:29.821 INFO:tasks.workunit.client.1.smithi107.stdout:8/826: mkdir d5/d8/d66/d8b/d18/d4f/d111/d35/d70/d118 0 2024-09-10T10:04:29.822 INFO:tasks.workunit.client.1.smithi107.stdout:7/863: dwrite d0/d8/dc/d2c/d47/fe4 [0,4194304] 0 2024-09-10T10:04:29.824 INFO:tasks.workunit.client.1.smithi107.stdout:8/827: mkdir d5/d8/d66/d8b/d18/d4f/d111/d35/d85/d119 0 2024-09-10T10:04:29.829 INFO:tasks.workunit.client.1.smithi107.stdout:7/864: truncate d0/d8/d56/f10c 199393 0 2024-09-10T10:04:29.830 INFO:tasks.workunit.client.1.smithi107.stdout:7/865: chown d0/d8/d56/c114 16471795 1 2024-09-10T10:04:29.833 INFO:tasks.workunit.client.1.smithi107.stdout:7/866: rename d0/d8/d56/dcc/ldc to d0/d20/d72/dc0/l117 0 2024-09-10T10:04:29.841 INFO:tasks.workunit.client.0.smithi071.stdout:4/736: write db/d1d/f38 [377652,31400] 0 2024-09-10T10:04:29.842 INFO:tasks.workunit.client.1.smithi107.stdout:7/867: write d0/d8/d56/dcc/d81/f8a [407467,46712] 0 2024-09-10T10:04:29.844 INFO:tasks.workunit.client.0.smithi071.stdout:1/866: unlink d1/l66 0 2024-09-10T10:04:29.845 INFO:tasks.workunit.client.1.smithi107.stdout:8/828: dread d5/f4a [0,4194304] 0 2024-09-10T10:04:29.846 INFO:tasks.workunit.client.0.smithi071.stdout:1/867: fdatasync d1/d57/f5f 0 2024-09-10T10:04:29.846 INFO:tasks.workunit.client.1.smithi107.stdout:7/868: dread d0/d1b/d4d/d69/d97/d68/f58 [0,4194304] 0 2024-09-10T10:04:29.849 INFO:tasks.workunit.client.1.smithi107.stdout:7/869: write d0/d8/dc/ff6 [287007,97355] 0 2024-09-10T10:04:29.850 INFO:tasks.workunit.client.1.smithi107.stdout:7/870: stat d0/d20/c7f 0 2024-09-10T10:04:29.854 INFO:tasks.workunit.client.1.smithi107.stdout:7/871: creat d0/d8/d56/dcc/f118 x:0 0 0 2024-09-10T10:04:29.854 INFO:tasks.workunit.client.1.smithi107.stdout:8/829: dwrite d5/d8/d5b/f90 [0,4194304] 0 2024-09-10T10:04:29.855 INFO:tasks.workunit.client.1.smithi107.stdout:7/872: chown d0/d8/d56/dcc/d81/dbc/fea 583 1 2024-09-10T10:04:29.855 INFO:tasks.workunit.client.1.smithi107.stdout:8/830: readlink d5/d8/d66/d8b/d21/d83/l33 0 2024-09-10T10:04:29.855 INFO:tasks.workunit.client.1.smithi107.stdout:7/873: chown d0/dff 284 1 2024-09-10T10:04:29.857 INFO:tasks.workunit.client.1.smithi107.stdout:7/874: symlink d0/d20/d72/l119 0 2024-09-10T10:04:29.862 INFO:tasks.workunit.client.1.smithi107.stdout:8/831: rmdir d5/d8/d66/d8b/d18/d4f/d111/df8 0 2024-09-10T10:04:29.864 INFO:tasks.workunit.client.1.smithi107.stdout:7/875: creat d0/d8/dc/f11a x:0 0 0 2024-09-10T10:04:29.866 INFO:tasks.workunit.client.1.smithi107.stdout:8/832: read d5/d8/d66/d8b/d21/f61 [504123,40717] 0 2024-09-10T10:04:29.867 INFO:tasks.workunit.client.0.smithi071.stdout:1/868: dwrite d1/d3f/d58/daf/ddc/fe0 [0,4194304] 0 2024-09-10T10:04:29.869 INFO:tasks.workunit.client.1.smithi107.stdout:8/833: write d5/d8/d5b/fb0 [3293081,41152] 0 2024-09-10T10:04:29.869 INFO:tasks.workunit.client.0.smithi071.stdout:1/869: fsync d1/d21/d2f/d30/d6a/fba 0 2024-09-10T10:04:29.873 INFO:tasks.workunit.client.1.smithi107.stdout:7/876: dwrite d0/d8/d5c/fbe [0,4194304] 0 2024-09-10T10:04:29.873 INFO:tasks.workunit.client.0.smithi071.stdout:1/870: symlink d1/l12f 0 2024-09-10T10:04:29.876 INFO:tasks.workunit.client.0.smithi071.stdout:1/871: symlink d1/d21/d3d/d9a/d101/l130 0 2024-09-10T10:04:29.876 INFO:tasks.workunit.client.0.smithi071.stdout:1/872: chown d1/d21/d2f/d30/d6a/d91/d9d 537056 1 2024-09-10T10:04:29.878 INFO:tasks.workunit.client.0.smithi071.stdout:1/873: fsync d1/d21/d3d/d9a/d72/dfd/f107 0 2024-09-10T10:04:29.879 INFO:tasks.workunit.client.0.smithi071.stdout:1/874: fdatasync d1/d21/d3d/d4a/f82 0 2024-09-10T10:04:29.880 INFO:tasks.workunit.client.0.smithi071.stdout:6/732: mkdir d4/da/df/d2e/d3a/d91/dc7/df0 0 2024-09-10T10:04:29.881 INFO:tasks.workunit.client.0.smithi071.stdout:1/875: symlink d1/d21/d3d/d9a/df9/d12e/l131 0 2024-09-10T10:04:29.883 INFO:tasks.workunit.client.0.smithi071.stdout:6/733: dread - d4/da/df/d2e/d3a/d51/fc0 zero size 2024-09-10T10:04:29.884 INFO:tasks.workunit.client.1.smithi107.stdout:8/834: dwrite d5/d8/d66/d8b/d1a/f4d [0,4194304] 0 2024-09-10T10:04:29.885 INFO:tasks.workunit.client.1.smithi107.stdout:7/877: dread d0/d8/dc/ff6 [0,4194304] 0 2024-09-10T10:04:29.886 INFO:tasks.workunit.client.0.smithi071.stdout:1/876: mkdir d1/d21/d3d/d9a/d72/dfd/d132 0 2024-09-10T10:04:29.894 INFO:tasks.workunit.client.0.smithi071.stdout:6/734: dwrite d4/da/df/d2e/d3a/d51/f9a [0,4194304] 0 2024-09-10T10:04:29.900 INFO:tasks.workunit.client.0.smithi071.stdout:6/735: write d4/da/df/d2e/d3a/d91/dc7/d81/db2/fb6 [577661,52003] 0 2024-09-10T10:04:29.900 INFO:tasks.workunit.client.0.smithi071.stdout:1/877: dread d1/d3f/f84 [4194304,4194304] 0 2024-09-10T10:04:29.902 INFO:tasks.workunit.client.1.smithi107.stdout:7/878: mkdir d0/d8/dd1/d11b 0 2024-09-10T10:04:29.904 INFO:tasks.workunit.client.1.smithi107.stdout:8/835: truncate d5/d8/d66/d8b/d18/d4f/d111/d35/d70/f95 3764714 0 2024-09-10T10:04:29.905 INFO:tasks.workunit.client.1.smithi107.stdout:7/879: symlink d0/dff/l11c 0 2024-09-10T10:04:29.906 INFO:tasks.workunit.client.0.smithi071.stdout:1/878: write d1/d35/f124 [2731770,91928] 0 2024-09-10T10:04:29.908 INFO:tasks.workunit.client.1.smithi107.stdout:8/836: truncate d5/d8/d66/d8b/d18/fc3 893141 0 2024-09-10T10:04:29.909 INFO:tasks.workunit.client.0.smithi071.stdout:1/879: chown d1/f2e 18825 1 2024-09-10T10:04:29.912 INFO:tasks.workunit.client.1.smithi107.stdout:7/880: dread d0/d20/d35/f9f [4194304,4194304] 0 2024-09-10T10:04:29.913 INFO:tasks.workunit.client.0.smithi071.stdout:6/736: getdents d4/da/df/d2e 0 2024-09-10T10:04:29.914 INFO:tasks.workunit.client.0.smithi071.stdout:3/841: mkdir d3/d1c/d3c/da1/d5d/da5/d11e 0 2024-09-10T10:04:29.915 INFO:tasks.workunit.client.1.smithi107.stdout:8/837: rename d5/d8/d66/d8b/d18/d4f/d111/d35/d70/ff0 to d5/d8/d66/d8b/d18/da4/f11a 0 2024-09-10T10:04:29.915 INFO:tasks.workunit.client.0.smithi071.stdout:5/861: dread dc/df/f38 [0,4194304] 0 2024-09-10T10:04:29.916 INFO:tasks.workunit.client.0.smithi071.stdout:1/880: link d1/d21/c60 d1/d21/d3d/d4a/c133 0 2024-09-10T10:04:29.917 INFO:tasks.workunit.client.0.smithi071.stdout:8/853: rename d5/df/d1d/d86/d90/lcc to d5/df/d67/l127 0 2024-09-10T10:04:29.917 INFO:tasks.workunit.client.1.smithi107.stdout:7/881: symlink d0/d8/dd1/d11b/l11d 0 2024-09-10T10:04:29.918 INFO:tasks.workunit.client.1.smithi107.stdout:8/838: symlink d5/d8/d66/d8b/d18/d4f/d111/d35/d85/d119/l11b 0 2024-09-10T10:04:29.920 INFO:tasks.workunit.client.0.smithi071.stdout:1/881: mknod d1/d21/d2f/d30/d6a/c134 0 2024-09-10T10:04:29.921 INFO:tasks.workunit.client.1.smithi107.stdout:8/839: dread d5/d8/d66/d8b/d21/f3a [0,4194304] 0 2024-09-10T10:04:29.922 INFO:tasks.workunit.client.0.smithi071.stdout:4/737: dread db/d15/d17/d24/f25 [0,4194304] 0 2024-09-10T10:04:29.923 INFO:tasks.workunit.client.0.smithi071.stdout:8/854: write d5/df/d1d/d86/d90/d109/fc6 [3892765,30997] 0 2024-09-10T10:04:29.924 INFO:tasks.workunit.client.0.smithi071.stdout:1/882: creat d1/d21/d3d/d9a/df9/d11c/f135 x:0 0 0 2024-09-10T10:04:29.925 INFO:tasks.workunit.client.0.smithi071.stdout:3/842: link d3/d20/d99/fff d3/d1c/d3c/da1/d42/d4a/f11f 0 2024-09-10T10:04:29.925 INFO:tasks.workunit.client.1.smithi107.stdout:8/840: unlink d5/d8/d66/d8b/d1a/d64/db9/ff6 0 2024-09-10T10:04:29.926 INFO:tasks.workunit.client.1.smithi107.stdout:0/902: sync 2024-09-10T10:04:29.927 INFO:tasks.workunit.client.1.smithi107.stdout:8/841: rmdir d5/d8/d66/d8b/dfd 39 2024-09-10T10:04:29.928 INFO:tasks.workunit.client.0.smithi071.stdout:3/843: fsync d3/d1c/d3c/da1/d5d/d8f/fdb 0 2024-09-10T10:04:29.929 INFO:tasks.workunit.client.1.smithi107.stdout:0/903: fdatasync d6/d8/d2f/d6e/f9d 0 2024-09-10T10:04:29.929 INFO:tasks.workunit.client.0.smithi071.stdout:8/855: chown d5/lae 1 1 2024-09-10T10:04:29.929 INFO:tasks.workunit.client.0.smithi071.stdout:6/737: getdents d4/da/df/d2e/d3a/d91 0 2024-09-10T10:04:29.931 INFO:tasks.workunit.client.0.smithi071.stdout:6/738: rename d4/da/df to d4/da/df/d2e/d3a/da9/dbc/df1 22 2024-09-10T10:04:29.932 INFO:tasks.workunit.client.0.smithi071.stdout:8/856: fsync d5/df/d1e/d38/d9f/faf 0 2024-09-10T10:04:29.934 INFO:tasks.workunit.client.1.smithi107.stdout:0/904: unlink d6/d8/d2f/d2e/d32/d56/c7f 0 2024-09-10T10:04:29.935 INFO:tasks.workunit.client.0.smithi071.stdout:3/844: symlink d3/d1c/d3c/l120 0 2024-09-10T10:04:29.939 INFO:tasks.workunit.client.0.smithi071.stdout:4/738: link db/d15/d26/d43/d4d/l3e db/d15/d17/d4e/d5a/d8d/lf8 0 2024-09-10T10:04:29.941 INFO:tasks.workunit.client.0.smithi071.stdout:3/845: write d3/fa [3694821,113458] 0 2024-09-10T10:04:29.943 INFO:tasks.workunit.client.0.smithi071.stdout:3/846: chown d3/d1c/d3c/d66/d102 33743 1 2024-09-10T10:04:29.944 INFO:tasks.workunit.client.1.smithi107.stdout:0/905: link d6/d8/f9 d6/d8/d2f/d35/d3c/d58/d69/d84/f12b 0 2024-09-10T10:04:29.946 INFO:tasks.workunit.client.1.smithi107.stdout:7/882: dread d0/d8/d56/d5d/fe9 [0,4194304] 0 2024-09-10T10:04:29.947 INFO:tasks.workunit.client.1.smithi107.stdout:8/842: dread d5/d8/f24 [0,4194304] 0 2024-09-10T10:04:29.948 INFO:tasks.workunit.client.1.smithi107.stdout:0/906: dread - d6/d8/d2f/da3/dee/f12a zero size 2024-09-10T10:04:29.949 INFO:tasks.workunit.client.0.smithi071.stdout:1/883: write d1/d3f/f11a [94141,50429] 0 2024-09-10T10:04:29.949 INFO:tasks.workunit.client.0.smithi071.stdout:4/739: link db/d15/d26/d43/d4d/d9f/f9a db/d1d/d61/d6a/d88/d90/ff9 0 2024-09-10T10:04:29.950 INFO:tasks.workunit.client.1.smithi107.stdout:0/907: dread - d6/d8/d2f/d35/d3c/d58/fdc zero size 2024-09-10T10:04:29.952 INFO:tasks.workunit.client.1.smithi107.stdout:0/908: creat d6/d8/d2f/da3/da5/f12c x:0 0 0 2024-09-10T10:04:29.952 INFO:tasks.workunit.client.1.smithi107.stdout:7/883: dread d0/d20/d35/f9f [4194304,4194304] 0 2024-09-10T10:04:29.953 INFO:tasks.workunit.client.0.smithi071.stdout:4/740: mknod db/d15/d17/d4e/d5a/d8d/cfa 0 2024-09-10T10:04:29.954 INFO:tasks.workunit.client.0.smithi071.stdout:2/914: mknod d8/db6/c137 0 2024-09-10T10:04:29.955 INFO:tasks.workunit.client.1.smithi107.stdout:0/909: dread - d6/d8/d2f/d35/d3c/d58/fdc zero size 2024-09-10T10:04:29.955 INFO:tasks.workunit.client.1.smithi107.stdout:7/884: chown d0/d1b/d4d/d69/d97/d68/fc7 11 1 2024-09-10T10:04:29.957 INFO:tasks.workunit.client.0.smithi071.stdout:4/741: mkdir db/dfb 0 2024-09-10T10:04:29.957 INFO:tasks.workunit.client.1.smithi107.stdout:7/885: mkdir d0/d8/dd1/d11e 0 2024-09-10T10:04:29.957 INFO:tasks.workunit.client.1.smithi107.stdout:0/910: rmdir d6/d8/d2f/d35/d4f 39 2024-09-10T10:04:29.959 INFO:tasks.workunit.client.1.smithi107.stdout:0/911: stat d6/d8/d2f/d35/d3c/d58/d86/la8 0 2024-09-10T10:04:29.960 INFO:tasks.workunit.client.1.smithi107.stdout:7/886: rmdir d0/d1b/d4d/d69/d97/d68 39 2024-09-10T10:04:29.961 INFO:tasks.workunit.client.0.smithi071.stdout:4/742: dread db/d15/d26/d43/f66 [0,4194304] 0 2024-09-10T10:04:29.962 INFO:tasks.workunit.client.1.smithi107.stdout:7/887: chown d0/d1b/d4d/d69/dca/fda 365 1 2024-09-10T10:04:29.963 INFO:tasks.workunit.client.0.smithi071.stdout:3/847: creat d3/d1c/f121 x:0 0 0 2024-09-10T10:04:29.964 INFO:tasks.workunit.client.0.smithi071.stdout:3/848: stat d3/d49/d4f/ff3 0 2024-09-10T10:04:29.965 INFO:tasks.workunit.client.0.smithi071.stdout:3/849: fsync d3/d49/d4f/f119 0 2024-09-10T10:04:29.966 INFO:tasks.workunit.client.0.smithi071.stdout:1/884: dwrite d1/d3f/f43 [0,4194304] 0 2024-09-10T10:04:29.969 INFO:tasks.workunit.client.1.smithi107.stdout:0/912: dwrite d6/faf [0,4194304] 0 2024-09-10T10:04:29.970 INFO:tasks.workunit.client.1.smithi107.stdout:0/913: readlink d6/d8/d2f/d2e/d32/l4e 0 2024-09-10T10:04:29.972 INFO:tasks.workunit.client.0.smithi071.stdout:3/850: truncate d3/d49/d2f/fb5 1029296 0 2024-09-10T10:04:29.976 INFO:tasks.workunit.client.1.smithi107.stdout:0/914: rmdir d6/d8/d2f/d35/d3c/d58 39 2024-09-10T10:04:29.976 INFO:tasks.workunit.client.1.smithi107.stdout:7/888: dwrite d0/d8/fb6 [0,4194304] 0 2024-09-10T10:04:29.977 INFO:tasks.workunit.client.0.smithi071.stdout:3/851: symlink d3/d1c/d3c/da1/d42/l122 0 2024-09-10T10:04:29.977 INFO:tasks.workunit.client.0.smithi071.stdout:3/852: write d3/f21 [1117784,30986] 0 2024-09-10T10:04:29.979 INFO:tasks.workunit.client.0.smithi071.stdout:3/853: truncate d3/d1c/d3c/da1/d3a/dc0/f101 1251850 0 2024-09-10T10:04:29.979 INFO:tasks.workunit.client.0.smithi071.stdout:5/862: creat dc/df/d3e/f124 x:0 0 0 2024-09-10T10:04:29.980 INFO:tasks.workunit.client.0.smithi071.stdout:5/863: chown dc/df/d29/c65 78349 1 2024-09-10T10:04:29.981 INFO:tasks.workunit.client.1.smithi107.stdout:0/915: mkdir d6/d5a/da9/df8/d12d 0 2024-09-10T10:04:29.983 INFO:tasks.workunit.client.0.smithi071.stdout:5/864: fdatasync dc/df/d3e/fd1 0 2024-09-10T10:04:29.985 INFO:tasks.workunit.client.1.smithi107.stdout:7/889: mkdir d0/d1b/d4d/d69/d97/d68/d11f 0 2024-09-10T10:04:29.985 INFO:tasks.workunit.client.0.smithi071.stdout:3/854: symlink d3/d49/d2f/dc2/l123 0 2024-09-10T10:04:29.986 INFO:tasks.workunit.client.0.smithi071.stdout:8/857: symlink d5/d36/l128 0 2024-09-10T10:04:29.987 INFO:tasks.workunit.client.1.smithi107.stdout:0/916: unlink d6/d8/d2f/d2e/d32/d59/f62 0 2024-09-10T10:04:29.988 INFO:tasks.workunit.client.1.smithi107.stdout:7/890: mknod d0/d20/c120 0 2024-09-10T10:04:29.989 INFO:tasks.workunit.client.0.smithi071.stdout:6/739: creat d4/da/df/d2e/d3a/d91/dc7/d81/ff2 x:0 0 0 2024-09-10T10:04:29.989 INFO:tasks.workunit.client.0.smithi071.stdout:5/865: mknod dc/df/d17/d8d/c125 0 2024-09-10T10:04:29.990 INFO:tasks.workunit.client.1.smithi107.stdout:0/917: unlink d6/d8/cc6 0 2024-09-10T10:04:29.991 INFO:tasks.workunit.client.0.smithi071.stdout:8/858: write d5/df/d67/fe1 [120138,95526] 0 2024-09-10T10:04:29.991 INFO:tasks.workunit.client.0.smithi071.stdout:3/855: chown d3/d1c/d3c/da1/d42/d4a/d60/d78/lb0 155 1 2024-09-10T10:04:29.993 INFO:tasks.workunit.client.1.smithi107.stdout:0/918: dread - d6/d8/d2f/d2e/d32/d85/fb4 zero size 2024-09-10T10:04:29.994 INFO:tasks.workunit.client.0.smithi071.stdout:1/885: dwrite d1/d70/fcd [0,4194304] 0 2024-09-10T10:04:29.994 INFO:tasks.workunit.client.1.smithi107.stdout:7/891: link d0/d8/d56/dcc/d81/lcb d0/d1b/l121 0 2024-09-10T10:04:29.995 INFO:tasks.workunit.client.1.smithi107.stdout:7/892: write d0/d8/d5c/d6d/fc8 [1754086,1764] 0 2024-09-10T10:04:29.996 INFO:tasks.workunit.client.0.smithi071.stdout:5/866: write dc/df/d29/d48/dae/db6/feb [89630,85796] 0 2024-09-10T10:04:29.997 INFO:tasks.workunit.client.1.smithi107.stdout:7/893: dread - d0/d20/d35/ffa zero size 2024-09-10T10:04:29.999 INFO:tasks.workunit.client.0.smithi071.stdout:4/743: dwrite db/d15/d17/d4e/f9c [0,4194304] 0 2024-09-10T10:04:29.999 INFO:tasks.workunit.client.1.smithi107.stdout:0/919: mknod d6/d8/d2f/d35/d3c/d58/d69/d84/c12e 0 2024-09-10T10:04:30.000 INFO:tasks.workunit.client.0.smithi071.stdout:6/740: mknod d4/da/df/d2e/d3a/d43/dc8/cf3 0 2024-09-10T10:04:30.003 INFO:tasks.workunit.client.0.smithi071.stdout:3/856: rename d3/f8c to d3/d1c/d3c/da1/d3a/dba/f124 0 2024-09-10T10:04:30.003 INFO:tasks.workunit.client.0.smithi071.stdout:5/867: dread dc/d4a/f10f [0,4194304] 0 2024-09-10T10:04:30.009 INFO:tasks.workunit.client.0.smithi071.stdout:8/859: creat d5/df/d1d/d86/d75/dcd/f129 x:0 0 0 2024-09-10T10:04:30.009 INFO:tasks.workunit.client.0.smithi071.stdout:1/886: link d1/d57/fe9 d1/d70/d76/d11d/f136 0 2024-09-10T10:04:30.011 INFO:tasks.workunit.client.0.smithi071.stdout:5/868: rename dc/f3c to dc/df/d3e/d5a/d80/d8a/f126 0 2024-09-10T10:04:30.011 INFO:tasks.workunit.client.0.smithi071.stdout:1/887: chown d1/d3f/d115 255 1 2024-09-10T10:04:30.017 INFO:tasks.workunit.client.0.smithi071.stdout:6/741: rename d4/da/df/d2e/d3a/d40/d60/d7a/fba to d4/da/df/d2e/d3a/d40/d60/d7a/dbd/ff4 0 2024-09-10T10:04:30.017 INFO:tasks.workunit.client.0.smithi071.stdout:3/857: dwrite d3/d49/d2f/dc2/fe6 [0,4194304] 0 2024-09-10T10:04:30.020 INFO:tasks.workunit.client.0.smithi071.stdout:1/888: dread d1/d21/d3d/d9a/df9/de4/db6/fc0 [0,4194304] 0 2024-09-10T10:04:30.022 INFO:tasks.workunit.client.1.smithi107.stdout:0/920: dwrite d6/d8/d2f/d2e/f75 [0,4194304] 0 2024-09-10T10:04:30.023 INFO:tasks.workunit.client.0.smithi071.stdout:8/860: link d5/df/d1e/d38/f48 d5/df/d74/f12a 0 2024-09-10T10:04:30.026 INFO:tasks.workunit.client.1.smithi107.stdout:0/921: mkdir d6/d8/d2f/d6e/dc5/ddb/d12f 0 2024-09-10T10:04:30.026 INFO:tasks.workunit.client.0.smithi071.stdout:5/869: dwrite dc/df/d29/d48/dae/db6/fc2 [0,4194304] 0 2024-09-10T10:04:30.028 INFO:tasks.workunit.client.0.smithi071.stdout:6/742: creat d4/da/df/d2e/d3a/d91/dc7/ff5 x:0 0 0 2024-09-10T10:04:30.030 INFO:tasks.workunit.client.0.smithi071.stdout:1/889: unlink d1/d35/dea/ff2 0 2024-09-10T10:04:30.030 INFO:tasks.workunit.client.0.smithi071.stdout:8/861: mknod d5/df/d1d/d86/d90/c12b 0 2024-09-10T10:04:30.034 INFO:tasks.workunit.client.1.smithi107.stdout:0/922: rmdir d6/d8/d2f/d6e/dc5 39 2024-09-10T10:04:30.035 INFO:tasks.workunit.client.0.smithi071.stdout:5/870: stat dc/df/d3e/d5a/d80/d8a/da3/cd0 0 2024-09-10T10:04:30.036 INFO:tasks.workunit.client.0.smithi071.stdout:4/744: dread db/d15/d26/d43/d4d/f4a [0,4194304] 0 2024-09-10T10:04:30.040 INFO:tasks.workunit.client.1.smithi107.stdout:0/923: dwrite d6/d8/d2f/d2e/d32/d85/d8a/feb [0,4194304] 0 2024-09-10T10:04:30.041 INFO:tasks.workunit.client.0.smithi071.stdout:3/858: dwrite d3/d1c/d3c/da1/d3a/dba/f124 [0,4194304] 0 2024-09-10T10:04:30.041 INFO:tasks.workunit.client.0.smithi071.stdout:4/745: chown db/d15/d26/cb5 2972 1 2024-09-10T10:04:30.042 INFO:tasks.workunit.client.0.smithi071.stdout:8/862: write d5/df/d1d/d86/d75/fe0 [751742,128875] 0 2024-09-10T10:04:30.043 INFO:tasks.workunit.client.0.smithi071.stdout:3/859: fdatasync d3/d49/d34/faf 0 2024-09-10T10:04:30.045 INFO:tasks.workunit.client.0.smithi071.stdout:1/890: dread d1/d3f/f43 [0,4194304] 0 2024-09-10T10:04:30.049 INFO:tasks.workunit.client.0.smithi071.stdout:1/891: mknod d1/d70/d76/c137 0 2024-09-10T10:04:30.050 INFO:tasks.workunit.client.0.smithi071.stdout:5/871: dread dc/df/d29/f5f [0,4194304] 0 2024-09-10T10:04:30.051 INFO:tasks.workunit.client.0.smithi071.stdout:3/860: mkdir d3/d49/d125 0 2024-09-10T10:04:30.051 INFO:tasks.workunit.client.0.smithi071.stdout:6/743: write d4/da/df/d2e/d3a/d51/d64/fa5 [117400,82647] 0 2024-09-10T10:04:30.054 INFO:tasks.workunit.client.0.smithi071.stdout:4/746: write db/d1d/f36 [766948,53574] 0 2024-09-10T10:04:30.055 INFO:tasks.workunit.client.0.smithi071.stdout:1/892: creat d1/d21/d2f/d30/f138 x:0 0 0 2024-09-10T10:04:30.056 INFO:tasks.workunit.client.1.smithi107.stdout:0/924: dread d6/f4a [0,4194304] 0 2024-09-10T10:04:30.057 INFO:tasks.workunit.client.1.smithi107.stdout:0/925: stat d6/d8/d2f/d2e/d32/d85/fb4 0 2024-09-10T10:04:30.058 INFO:tasks.workunit.client.0.smithi071.stdout:6/744: symlink d4/da/df/d2e/d3a/d40/d60/d7a/lf6 0 2024-09-10T10:04:30.058 INFO:tasks.workunit.client.0.smithi071.stdout:3/861: rmdir d3/d10/d87 0 2024-09-10T10:04:30.061 INFO:tasks.workunit.client.0.smithi071.stdout:6/745: symlink d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/lf7 0 2024-09-10T10:04:30.064 INFO:tasks.workunit.client.0.smithi071.stdout:3/862: getdents d3/d1c/d3c/da1/d3a/dba 0 2024-09-10T10:04:30.064 INFO:tasks.workunit.client.1.smithi107.stdout:0/926: dwrite d6/d8/d2f/d2e/d32/d95/dce/fd8 [0,4194304] 0 2024-09-10T10:04:30.066 INFO:tasks.workunit.client.0.smithi071.stdout:6/746: link d4/d61/d83/faf d4/da/df/d2e/d3a/d43/ff8 0 2024-09-10T10:04:30.070 INFO:tasks.workunit.client.0.smithi071.stdout:4/747: write db/d15/d26/d43/d4d/f78 [981809,66085] 0 2024-09-10T10:04:30.070 INFO:tasks.workunit.client.1.smithi107.stdout:0/927: link d6/d14/f99 d6/d8/d2f/da3/f130 0 2024-09-10T10:04:30.071 INFO:tasks.workunit.client.0.smithi071.stdout:6/747: mkdir d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/df9 0 2024-09-10T10:04:30.071 INFO:tasks.workunit.client.1.smithi107.stdout:0/928: chown d6/d8/d3e/d43 4 1 2024-09-10T10:04:30.072 INFO:tasks.workunit.client.0.smithi071.stdout:3/863: link d3/d1c/d3e/de0/l108 d3/d1c/l126 0 2024-09-10T10:04:30.075 INFO:tasks.workunit.client.1.smithi107.stdout:0/929: dread d6/d8/d2f/d35/d3c/d58/d86/fcb [0,4194304] 0 2024-09-10T10:04:30.075 INFO:tasks.workunit.client.0.smithi071.stdout:8/863: dread d5/df/f5b [4194304,4194304] 0 2024-09-10T10:04:30.075 INFO:tasks.workunit.client.0.smithi071.stdout:4/748: rmdir db/d15 39 2024-09-10T10:04:30.077 INFO:tasks.workunit.client.1.smithi107.stdout:0/930: fsync d6/d8/d3e/d43/f79 0 2024-09-10T10:04:30.077 INFO:tasks.workunit.client.0.smithi071.stdout:5/872: dwrite dc/df/d3e/d5a/d80/f11e [0,4194304] 0 2024-09-10T10:04:30.080 INFO:tasks.workunit.client.0.smithi071.stdout:3/864: write d3/d1c/d3c/da1/d3a/dc0/f101 [2225302,31470] 0 2024-09-10T10:04:30.083 INFO:tasks.workunit.client.0.smithi071.stdout:6/748: rename d4/da/df/d2e/ce1 to d4/da/df/d2e/d3a/cfa 0 2024-09-10T10:04:30.084 INFO:tasks.workunit.client.1.smithi107.stdout:0/931: rename d6/d8/d2f/d2e/d32/c110 to d6/d8/d2f/da3/c131 0 2024-09-10T10:04:30.086 INFO:tasks.workunit.client.0.smithi071.stdout:8/864: creat d5/df/d1d/d81/d10c/f12c x:0 0 0 2024-09-10T10:04:30.088 INFO:tasks.workunit.client.0.smithi071.stdout:5/873: mknod dc/df/d3e/d5a/d80/d8a/c127 0 2024-09-10T10:04:30.089 INFO:tasks.workunit.client.0.smithi071.stdout:3/865: creat d3/d20/d99/d9b/f127 x:0 0 0 2024-09-10T10:04:30.089 INFO:tasks.workunit.client.0.smithi071.stdout:3/866: readlink d3/d49/d2f/l37 0 2024-09-10T10:04:30.090 INFO:tasks.workunit.client.0.smithi071.stdout:4/749: symlink db/d15/d26/db2/lfc 0 2024-09-10T10:04:30.090 INFO:tasks.workunit.client.0.smithi071.stdout:3/867: readlink d3/d1c/d3c/da1/d3a/l8e 0 2024-09-10T10:04:30.091 INFO:tasks.workunit.client.0.smithi071.stdout:8/865: write d5/df/d1d/d81/d9b/f104 [726328,42590] 0 2024-09-10T10:04:30.093 INFO:tasks.workunit.client.0.smithi071.stdout:3/868: mkdir d3/d1c/d3c/da1/d5d/d7a/d128 0 2024-09-10T10:04:30.094 INFO:tasks.workunit.client.0.smithi071.stdout:3/869: chown d3/d1c/d3c/f82 108 1 2024-09-10T10:04:30.096 INFO:tasks.workunit.client.0.smithi071.stdout:8/866: link d5/df/d67/la2 d5/df/d1e/d38/d9f/l12d 0 2024-09-10T10:04:30.098 INFO:tasks.workunit.client.0.smithi071.stdout:8/867: chown d5/df/d1e/d70/dc7/c6c 48 1 2024-09-10T10:04:30.100 INFO:tasks.workunit.client.1.smithi107.stdout:0/932: dwrite d6/d8/d2f/d35/d3c/d58/d69/d84/fc8 [0,4194304] 0 2024-09-10T10:04:30.101 INFO:tasks.workunit.client.0.smithi071.stdout:8/868: mkdir d5/df/d57/d82/d12e 0 2024-09-10T10:04:30.103 INFO:tasks.workunit.client.1.smithi107.stdout:0/933: fsync d6/d8/d2f/d6e/f9d 0 2024-09-10T10:04:30.104 INFO:tasks.workunit.client.0.smithi071.stdout:6/749: dwrite d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/fe0 [0,4194304] 0 2024-09-10T10:04:30.104 INFO:tasks.workunit.client.0.smithi071.stdout:5/874: truncate f4 6631731 0 2024-09-10T10:04:30.104 INFO:tasks.workunit.client.1.smithi107.stdout:0/934: dread - d6/d8/f121 zero size 2024-09-10T10:04:30.107 INFO:tasks.workunit.client.0.smithi071.stdout:8/869: unlink d5/df/d1e/d70/lb6 0 2024-09-10T10:04:30.108 INFO:tasks.workunit.client.0.smithi071.stdout:5/875: creat dc/df/d17/d8d/d119/f128 x:0 0 0 2024-09-10T10:04:30.108 INFO:tasks.workunit.client.0.smithi071.stdout:8/870: chown d5/d36/l128 3862 1 2024-09-10T10:04:30.109 INFO:tasks.workunit.client.1.smithi107.stdout:0/935: creat d6/d8/d2f/d2e/d32/d56/ddf/f132 x:0 0 0 2024-09-10T10:04:30.109 INFO:tasks.workunit.client.0.smithi071.stdout:6/750: mknod d4/da/df/d2e/d3a/d51/cfb 0 2024-09-10T10:04:30.110 INFO:tasks.workunit.client.1.smithi107.stdout:6/928: sync 2024-09-10T10:04:30.110 INFO:tasks.workunit.client.1.smithi107.stdout:9/888: sync 2024-09-10T10:04:30.110 INFO:tasks.workunit.client.1.smithi107.stdout:2/929: sync 2024-09-10T10:04:30.110 INFO:tasks.workunit.client.1.smithi107.stdout:5/938: sync 2024-09-10T10:04:30.111 INFO:tasks.workunit.client.0.smithi071.stdout:3/870: truncate d3/d1c/d3c/da1/f51 1327358 0 2024-09-10T10:04:30.113 INFO:tasks.workunit.client.0.smithi071.stdout:8/871: read d5/df/d57/d82/f84 [276594,119450] 0 2024-09-10T10:04:30.113 INFO:tasks.workunit.client.0.smithi071.stdout:5/876: truncate dc/df/d29/d94/fcc 920747 0 2024-09-10T10:04:30.115 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:29 smithi071 ceph-mon[27559]: pgmap v6: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-10T10:04:30.116 INFO:tasks.workunit.client.1.smithi107.stdout:6/929: creat d0/d3d/d14/d9f/dca/f148 x:0 0 0 2024-09-10T10:04:30.116 INFO:tasks.workunit.client.0.smithi071.stdout:4/750: dread db/d15/d4b/fdc [0,4194304] 0 2024-09-10T10:04:30.117 INFO:tasks.workunit.client.1.smithi107.stdout:5/939: mknod de/c13c 0 2024-09-10T10:04:30.117 INFO:tasks.workunit.client.0.smithi071.stdout:3/871: write d3/d1c/d3c/da1/d5d/d7a/f10f [30699,125499] 0 2024-09-10T10:04:30.118 INFO:tasks.workunit.client.1.smithi107.stdout:5/940: chown de/d20/d3d/dd4/fde 451438799 1 2024-09-10T10:04:30.118 INFO:tasks.workunit.client.1.smithi107.stdout:2/930: truncate d3/da/d1e/d40/d8a/d7f/d55/fcb 623677 0 2024-09-10T10:04:30.119 INFO:tasks.workunit.client.0.smithi071.stdout:5/877: write dc/df/d3e/d5a/dd4/fd9 [757729,8818] 0 2024-09-10T10:04:30.120 INFO:tasks.workunit.client.1.smithi107.stdout:0/936: dread d6/d5a/d5c/f92 [0,4194304] 0 2024-09-10T10:04:30.120 INFO:tasks.workunit.client.1.smithi107.stdout:6/930: fdatasync d0/d3d/d14/d21/d8a/da7/ffc 0 2024-09-10T10:04:30.121 INFO:tasks.workunit.client.0.smithi071.stdout:4/751: write db/d15/d4b/f64 [4765225,83961] 0 2024-09-10T10:04:30.121 INFO:tasks.workunit.client.1.smithi107.stdout:2/931: dread - d3/d21/d95/fe2 zero size 2024-09-10T10:04:30.124 INFO:tasks.workunit.client.0.smithi071.stdout:6/751: dwrite d4/da/df/d2e/d3a/d40/f58 [0,4194304] 0 2024-09-10T10:04:30.126 INFO:tasks.workunit.client.0.smithi071.stdout:4/752: chown db/d15/d17/d4e/d5a/dd3 3432851 1 2024-09-10T10:04:30.126 INFO:tasks.workunit.client.0.smithi071.stdout:6/752: chown d4/f27 0 1 2024-09-10T10:04:30.127 INFO:tasks.workunit.client.1.smithi107.stdout:9/889: link d5/d7/d1d/d41/d83/d9a/fb7 d5/d7/d1d/d41/dc8/f126 0 2024-09-10T10:04:30.129 INFO:tasks.workunit.client.0.smithi071.stdout:4/753: read db/d15/d26/d43/d4d/f4a [4126174,110181] 0 2024-09-10T10:04:30.129 INFO:tasks.workunit.client.0.smithi071.stdout:5/878: link dc/d4a/cf7 dc/df/d3e/d5a/dd2/d120/c129 0 2024-09-10T10:04:30.130 INFO:tasks.workunit.client.0.smithi071.stdout:6/753: symlink d4/da/df/d2e/d3a/d40/d60/d7a/lfc 0 2024-09-10T10:04:30.132 INFO:tasks.workunit.client.0.smithi071.stdout:6/754: stat d4/da/df/d2e/d3a/da9/dbc/dc3/ceb 0 2024-09-10T10:04:30.132 INFO:tasks.workunit.client.1.smithi107.stdout:0/937: truncate d6/d8/d2f/d35/d3c/d58/f73 2493333 0 2024-09-10T10:04:30.133 INFO:tasks.workunit.client.1.smithi107.stdout:9/890: unlink d5/d1e/f5b 0 2024-09-10T10:04:30.135 INFO:tasks.workunit.client.0.smithi071.stdout:4/754: rename db/d15/d26/d43/d82/f98 to db/d1d/d61/ffd 0 2024-09-10T10:04:30.135 INFO:tasks.workunit.client.1.smithi107.stdout:6/931: mknod d0/d3d/d14/d17/d24/df3/d55/da6/d11b/c149 0 2024-09-10T10:04:30.138 INFO:tasks.workunit.client.0.smithi071.stdout:3/872: write d3/d10/d24/d2b/db2/ffc [46079,121877] 0 2024-09-10T10:04:30.138 INFO:tasks.workunit.client.0.smithi071.stdout:6/755: symlink d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/lfd 0 2024-09-10T10:04:30.139 INFO:tasks.workunit.client.1.smithi107.stdout:0/938: symlink d6/l133 0 2024-09-10T10:04:30.140 INFO:tasks.workunit.client.1.smithi107.stdout:6/932: mkdir d0/d3d/d14/d17/d14a 0 2024-09-10T10:04:30.141 INFO:tasks.workunit.client.0.smithi071.stdout:5/879: dwrite dc/df/f28 [4194304,4194304] 0 2024-09-10T10:04:30.143 INFO:tasks.workunit.client.0.smithi071.stdout:6/756: write d4/d61/d83/da8/fc1 [56556,80142] 0 2024-09-10T10:04:30.144 INFO:tasks.workunit.client.0.smithi071.stdout:3/873: write d3/d1c/d3c/da1/d42/d4a/d60/d78/fac [1841391,45253] 0 2024-09-10T10:04:30.145 INFO:tasks.workunit.client.0.smithi071.stdout:6/757: stat d4/da/df/d2e/d3a/fe8 0 2024-09-10T10:04:30.147 INFO:tasks.workunit.client.0.smithi071.stdout:4/755: dread db/d8f/fbf [0,4194304] 0 2024-09-10T10:04:30.148 INFO:tasks.workunit.client.1.smithi107.stdout:5/941: dwrite de/d20/d2b/f60 [0,4194304] 0 2024-09-10T10:04:30.149 INFO:tasks.workunit.client.0.smithi071.stdout:8/872: dread d5/df/d1d/d86/d90/d109/f3c [0,4194304] 0 2024-09-10T10:04:30.150 INFO:tasks.workunit.client.0.smithi071.stdout:8/873: dread - d5/d36/d49/d8f/fe5 zero size 2024-09-10T10:04:30.151 INFO:tasks.workunit.client.1.smithi107.stdout:6/933: getdents d0/df0 0 2024-09-10T10:04:30.151 INFO:tasks.workunit.client.0.smithi071.stdout:3/874: rmdir d3/d1c/d3c/da1/d42/d4a/d60 39 2024-09-10T10:04:30.151 INFO:tasks.workunit.client.1.smithi107.stdout:2/932: dwrite d3/da/d1e/d40/d8a/d7f/d55/f64 [0,4194304] 0 2024-09-10T10:04:30.155 INFO:tasks.workunit.client.0.smithi071.stdout:5/880: rename dc/df/d3e/d5a/fa7 to dc/df/d3e/d5a/d80/d8a/dda/f12a 0 2024-09-10T10:04:30.156 INFO:tasks.workunit.client.0.smithi071.stdout:4/756: dwrite db/d15/d17/d4e/f9c [0,4194304] 0 2024-09-10T10:04:30.157 INFO:tasks.workunit.client.1.smithi107.stdout:5/942: symlink de/d20/d2b/d4b/d5e/d9a/l13d 0 2024-09-10T10:04:30.158 INFO:tasks.workunit.client.1.smithi107.stdout:0/939: dread d6/d8/d2f/d2e/d32/d85/d8a/feb [0,4194304] 0 2024-09-10T10:04:30.159 INFO:tasks.workunit.client.1.smithi107.stdout:6/934: truncate d0/d3d/d14/d42/f136 1137958 0 2024-09-10T10:04:30.160 INFO:tasks.workunit.client.1.smithi107.stdout:0/940: chown d6/c1a 495988 1 2024-09-10T10:04:30.162 INFO:tasks.workunit.client.0.smithi071.stdout:6/758: unlink d4/da/df/d2e/d3a/d91/dc7/d81/ff2 0 2024-09-10T10:04:30.162 INFO:tasks.workunit.client.1.smithi107.stdout:5/943: link de/fff de/d20/d3d/f13e 0 2024-09-10T10:04:30.163 INFO:tasks.workunit.client.0.smithi071.stdout:6/759: write d4/d1c/fbb [3609843,69179] 0 2024-09-10T10:04:30.164 INFO:tasks.workunit.client.1.smithi107.stdout:9/891: dread d5/d7/fb2 [0,4194304] 0 2024-09-10T10:04:30.165 INFO:tasks.workunit.client.1.smithi107.stdout:6/935: mkdir d0/d3d/d14/d17/d24/df3/d55/d56/df2/d14b 0 2024-09-10T10:04:30.168 INFO:tasks.workunit.client.0.smithi071.stdout:4/757: creat db/d15/d26/d43/d82/ffe x:0 0 0 2024-09-10T10:04:30.169 INFO:tasks.workunit.client.0.smithi071.stdout:6/760: creat d4/ffe x:0 0 0 2024-09-10T10:04:30.170 INFO:tasks.workunit.client.1.smithi107.stdout:5/944: creat de/d20/d2b/d4b/d5e/d116/d4e/d89/d99/d123/f13f x:0 0 0 2024-09-10T10:04:30.171 INFO:tasks.workunit.client.0.smithi071.stdout:5/881: link dc/df/ff4 dc/d53/d101/f12b 0 2024-09-10T10:04:30.172 INFO:tasks.workunit.client.0.smithi071.stdout:6/761: read - d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/fcb zero size 2024-09-10T10:04:30.172 INFO:tasks.workunit.client.0.smithi071.stdout:5/882: chown dc/f31 56461 1 2024-09-10T10:04:30.173 INFO:tasks.workunit.client.0.smithi071.stdout:3/875: creat d3/d1c/d3e/f129 x:0 0 0 2024-09-10T10:04:30.174 INFO:tasks.workunit.client.1.smithi107.stdout:6/936: truncate d0/d3d/d14/d21/f23 4054180 0 2024-09-10T10:04:30.175 INFO:tasks.workunit.client.0.smithi071.stdout:8/874: rename d5/df/f5f to d5/df/d1e/f12f 0 2024-09-10T10:04:30.175 INFO:tasks.workunit.client.0.smithi071.stdout:4/758: dwrite db/d1d/d61/d6a/fe9 [4194304,4194304] 0 2024-09-10T10:04:30.177 INFO:tasks.workunit.client.1.smithi107.stdout:0/941: dwrite d6/d8/d2f/d2e/d32/d56/ddf/ffb [0,4194304] 0 2024-09-10T10:04:30.179 INFO:tasks.workunit.client.0.smithi071.stdout:6/762: read d4/d61/fa4 [1042560,105019] 0 2024-09-10T10:04:30.180 INFO:tasks.workunit.client.0.smithi071.stdout:4/759: mknod db/d1d/d61/cff 0 2024-09-10T10:04:30.183 INFO:tasks.workunit.client.1.smithi107.stdout:6/937: unlink d0/d3d/d14/d17/d24/ff6 0 2024-09-10T10:04:30.186 INFO:tasks.workunit.client.1.smithi107.stdout:9/892: dwrite d5/d7/d1d/d9b/dab/d57/d87/d27/fa1 [0,4194304] 0 2024-09-10T10:04:30.188 INFO:tasks.workunit.client.0.smithi071.stdout:4/760: mkdir db/dfb/d100 0 2024-09-10T10:04:30.189 INFO:tasks.workunit.client.0.smithi071.stdout:4/761: dread - db/d15/fcc zero size 2024-09-10T10:04:30.193 INFO:tasks.workunit.client.1.smithi107.stdout:6/938: stat d0/d3d/d14/d17/l66 0 2024-09-10T10:04:30.193 INFO:tasks.workunit.client.1.smithi107.stdout:5/945: dwrite de/d20/d2b/d4b/d5e/d116/d7e/d79/f7d [0,4194304] 0 2024-09-10T10:04:30.193 INFO:tasks.workunit.client.0.smithi071.stdout:4/762: rmdir db/d15/d17/d4e/dc0 39 2024-09-10T10:04:30.193 INFO:tasks.workunit.client.1.smithi107.stdout:0/942: fsync d6/d5a/d5c/f92 0 2024-09-10T10:04:30.194 INFO:tasks.workunit.client.0.smithi071.stdout:4/763: dread - db/d1d/d61/ffd zero size 2024-09-10T10:04:30.194 INFO:tasks.workunit.client.0.smithi071.stdout:4/764: chown db/d1d/f36 83848023 1 2024-09-10T10:04:30.198 INFO:tasks.workunit.client.1.smithi107.stdout:2/933: dread d3/da/df/d20/d36/fcd [0,4194304] 0 2024-09-10T10:04:30.199 INFO:tasks.workunit.client.0.smithi071.stdout:4/765: unlink db/d15/d17/l33 0 2024-09-10T10:04:30.199 INFO:tasks.workunit.client.1.smithi107.stdout:2/934: chown d3/da/d66/db7/c10a 93345631 1 2024-09-10T10:04:30.199 INFO:tasks.workunit.client.1.smithi107.stdout:0/943: mkdir d6/d8/d2f/d2e/d32/d56/d134 0 2024-09-10T10:04:30.202 INFO:tasks.workunit.client.1.smithi107.stdout:5/946: mkdir de/d20/d2b/d4b/d5e/d116/d7e/db2/dee/d140 0 2024-09-10T10:04:30.203 INFO:tasks.workunit.client.0.smithi071.stdout:4/766: mknod db/d15/d17/d4e/d5a/d8d/c101 0 2024-09-10T10:04:30.204 INFO:tasks.workunit.client.0.smithi071.stdout:4/767: fdatasync db/d15/d26/d43/d4d/fe2 0 2024-09-10T10:04:30.207 INFO:tasks.workunit.client.0.smithi071.stdout:4/768: mknod db/d15/d17/c102 0 2024-09-10T10:04:30.208 INFO:tasks.workunit.client.0.smithi071.stdout:4/769: truncate db/d15/d26/d43/d4d/fdd 525040 0 2024-09-10T10:04:30.209 INFO:tasks.workunit.client.1.smithi107.stdout:2/935: mkdir d3/da/d1e/d5f/dad/deb/d147 0 2024-09-10T10:04:30.209 INFO:tasks.workunit.client.0.smithi071.stdout:4/770: chown db/d15/d26/d43/d4d/fe2 66424877 1 2024-09-10T10:04:30.211 INFO:tasks.workunit.client.0.smithi071.stdout:4/771: symlink db/d15/d17/d4e/d5a/l103 0 2024-09-10T10:04:30.215 INFO:tasks.workunit.client.0.smithi071.stdout:3/876: dread d3/d49/d34/f6e [0,4194304] 0 2024-09-10T10:04:30.216 INFO:tasks.workunit.client.0.smithi071.stdout:3/877: write d3/d20/f63 [2473452,32774] 0 2024-09-10T10:04:30.221 INFO:tasks.workunit.client.1.smithi107.stdout:0/944: unlink d6/d8/d2f/d6e/dc5/ddb/df1/c102 0 2024-09-10T10:04:30.221 INFO:tasks.workunit.client.0.smithi071.stdout:3/878: dwrite d3/d49/d2f/f35 [0,4194304] 0 2024-09-10T10:04:30.224 INFO:tasks.workunit.client.1.smithi107.stdout:5/947: mkdir de/d20/d2b/d4b/d5e/d116/d7e/db2/d141 0 2024-09-10T10:04:30.224 INFO:tasks.workunit.client.1.smithi107.stdout:2/936: symlink d3/da/df/d20/dfb/d136/d10c/l148 0 2024-09-10T10:04:30.227 INFO:tasks.workunit.client.1.smithi107.stdout:2/937: creat d3/da/d66/db7/f149 x:0 0 0 2024-09-10T10:04:30.227 INFO:tasks.workunit.client.0.smithi071.stdout:8/875: truncate d5/df/d1e/d38/f42 28104 0 2024-09-10T10:04:30.228 INFO:tasks.workunit.client.0.smithi071.stdout:5/883: truncate dc/df/d3e/f43 2157710 0 2024-09-10T10:04:30.229 INFO:tasks.workunit.client.1.smithi107.stdout:2/938: chown d3/da/df/d20/dfb/d136/dea/ffd 0 1 2024-09-10T10:04:30.229 INFO:tasks.workunit.client.1.smithi107.stdout:5/948: mkdir de/d142 0 2024-09-10T10:04:30.230 INFO:tasks.workunit.client.0.smithi071.stdout:5/884: truncate dc/f11b 2694 0 2024-09-10T10:04:30.232 INFO:tasks.workunit.client.1.smithi107.stdout:5/949: read - de/d20/d2b/d4b/d5e/d116/d4e/d89/d99/d123/f13f zero size 2024-09-10T10:04:30.236 INFO:tasks.workunit.client.0.smithi071.stdout:5/885: symlink dc/d53/db2/l12c 0 2024-09-10T10:04:30.237 INFO:tasks.workunit.client.0.smithi071.stdout:6/763: dwrite d4/da/df/d2e/d3a/d51/d64/f72 [0,4194304] 0 2024-09-10T10:04:30.242 INFO:tasks.workunit.client.1.smithi107.stdout:2/939: link d3/da/df/d20/d36/d39/da3/ddb/d12b/fab d3/d21/f14a 0 2024-09-10T10:04:30.243 INFO:tasks.workunit.client.0.smithi071.stdout:4/772: dwrite db/d15/d26/d43/d82/f89 [0,4194304] 0 2024-09-10T10:04:30.243 INFO:tasks.workunit.client.1.smithi107.stdout:2/940: stat d3/d21/f103 0 2024-09-10T10:04:30.244 INFO:tasks.workunit.client.0.smithi071.stdout:6/764: fdatasync d4/da/f13 0 2024-09-10T10:04:30.244 INFO:tasks.workunit.client.0.smithi071.stdout:3/879: dread d3/d1c/d3c/da1/d5d/d7a/f89 [0,4194304] 0 2024-09-10T10:04:30.245 INFO:tasks.workunit.client.1.smithi107.stdout:5/950: getdents de/d20/d2b/d4b/d5e/db1 0 2024-09-10T10:04:30.251 INFO:tasks.workunit.client.1.smithi107.stdout:9/893: dwrite d5/d7/d1d/d95/faf [0,4194304] 0 2024-09-10T10:04:30.254 INFO:tasks.workunit.client.0.smithi071.stdout:8/876: dread d5/d36/d49/fbf [0,4194304] 0 2024-09-10T10:04:30.256 INFO:tasks.workunit.client.0.smithi071.stdout:6/765: dwrite d4/da/df/d2e/d3a/d51/fc0 [0,4194304] 0 2024-09-10T10:04:30.259 INFO:tasks.workunit.client.0.smithi071.stdout:3/880: dwrite d3/d10/d24/f27 [0,4194304] 0 2024-09-10T10:04:30.259 INFO:tasks.workunit.client.1.smithi107.stdout:9/894: dwrite d5/d7/d1d/d9b/dab/d57/d87/f89 [0,4194304] 0 2024-09-10T10:04:30.263 INFO:tasks.workunit.client.0.smithi071.stdout:8/877: creat d5/df/d74/d11d/f130 x:0 0 0 2024-09-10T10:04:30.263 INFO:tasks.workunit.client.0.smithi071.stdout:8/878: fdatasync d5/df/d1e/fda 0 2024-09-10T10:04:30.267 INFO:tasks.workunit.client.1.smithi107.stdout:9/895: creat d5/d7/d1d/d41/dc8/dfc/d10d/f127 x:0 0 0 2024-09-10T10:04:30.268 INFO:tasks.workunit.client.0.smithi071.stdout:6/766: mkdir d4/da/df/d2e/d3a/d40/d60/dff 0 2024-09-10T10:04:30.269 INFO:tasks.workunit.client.1.smithi107.stdout:2/941: getdents d3/da/df/d20/d36/d10f 0 2024-09-10T10:04:30.270 INFO:tasks.workunit.client.1.smithi107.stdout:9/896: creat d5/d7/d1d/d29/db4/df0/f128 x:0 0 0 2024-09-10T10:04:30.271 INFO:tasks.workunit.client.0.smithi071.stdout:8/879: rename d5/df/d1d/l25 to d5/df/d1d/d86/d90/d109/l131 0 2024-09-10T10:04:30.272 INFO:tasks.workunit.client.1.smithi107.stdout:2/942: fdatasync d3/da/df/d20/d36/fb0 0 2024-09-10T10:04:30.273 INFO:tasks.workunit.client.0.smithi071.stdout:6/767: creat d4/da/df/d2e/d3a/d40/d60/d7a/dbd/f100 x:0 0 0 2024-09-10T10:04:30.275 INFO:tasks.workunit.client.0.smithi071.stdout:6/768: truncate d4/d61/d83/da8/fca 705063 0 2024-09-10T10:04:30.278 INFO:tasks.workunit.client.0.smithi071.stdout:6/769: fsync d4/da/df/d2e/d3a/d3e/f77 0 2024-09-10T10:04:30.278 INFO:tasks.workunit.client.1.smithi107.stdout:2/943: dwrite d3/da/d1e/d40/d8a/d7f/fb9 [0,4194304] 0 2024-09-10T10:04:30.280 INFO:tasks.workunit.client.1.smithi107.stdout:2/944: write d3/da/d1e/d5f/d54/d114/f139 [531926,7234] 0 2024-09-10T10:04:30.281 INFO:tasks.workunit.client.1.smithi107.stdout:2/945: readlink d3/da/d1e/d40/d8a/d7f/d55/d85/l10e 0 2024-09-10T10:04:30.301 INFO:tasks.workunit.client.0.smithi071.stdout:3/881: dread d3/d1c/f22 [8388608,4194304] 0 2024-09-10T10:04:30.304 INFO:tasks.workunit.client.0.smithi071.stdout:8/880: dread d5/df/fcf [0,4194304] 0 2024-09-10T10:04:30.307 INFO:tasks.workunit.client.0.smithi071.stdout:8/881: rename d5/df/d1d/d81/d9b/fd3 to d5/df/d1e/d38/f132 0 2024-09-10T10:04:30.307 INFO:tasks.workunit.client.0.smithi071.stdout:8/882: chown d5/df/d1d/c2b 7549952 1 2024-09-10T10:04:30.307 INFO:tasks.workunit.client.0.smithi071.stdout:8/883: fdatasync d5/df/df7/f107 0 2024-09-10T10:04:30.308 INFO:tasks.workunit.client.0.smithi071.stdout:8/884: write d5/df/d57/f8a [713622,22270] 0 2024-09-10T10:04:30.310 INFO:tasks.workunit.client.0.smithi071.stdout:8/885: creat d5/d36/f133 x:0 0 0 2024-09-10T10:04:30.315 INFO:tasks.workunit.client.0.smithi071.stdout:3/882: write d3/d1c/d3c/da1/d5d/f90 [172641,88167] 0 2024-09-10T10:04:30.320 INFO:tasks.workunit.client.0.smithi071.stdout:3/883: rename d3/d49/l10d to d3/d1c/d3c/da1/l12a 0 2024-09-10T10:04:30.321 INFO:tasks.workunit.client.0.smithi071.stdout:6/770: dwrite d4/da/df/d2e/d3a/d91/f96 [0,4194304] 0 2024-09-10T10:04:30.322 INFO:tasks.workunit.client.0.smithi071.stdout:3/884: chown d3/d10/d24/l4b 80 1 2024-09-10T10:04:30.323 INFO:tasks.workunit.client.0.smithi071.stdout:8/886: dwrite d5/d36/d49/d8f/ff0 [0,4194304] 0 2024-09-10T10:04:30.323 INFO:tasks.workunit.client.0.smithi071.stdout:6/771: mkdir d4/d1c/d101 0 2024-09-10T10:04:30.324 INFO:tasks.workunit.client.0.smithi071.stdout:3/885: write d3/d1c/f22 [11213890,106481] 0 2024-09-10T10:04:30.324 INFO:tasks.workunit.client.0.smithi071.stdout:6/772: chown d4/da/df/c67 0 1 2024-09-10T10:04:30.328 INFO:tasks.workunit.client.0.smithi071.stdout:8/887: rename d5/df/d57/f5a to d5/df/d1d/d81/d10c/f134 0 2024-09-10T10:04:30.334 INFO:tasks.workunit.client.0.smithi071.stdout:6/773: dwrite d4/d61/d83/da8/fca [0,4194304] 0 2024-09-10T10:04:30.341 INFO:tasks.workunit.client.0.smithi071.stdout:3/886: dread d3/d20/f6d [0,4194304] 0 2024-09-10T10:04:30.349 INFO:tasks.workunit.client.0.smithi071.stdout:6/774: write d4/d61/f89 [6418,85952] 0 2024-09-10T10:04:30.349 INFO:tasks.workunit.client.0.smithi071.stdout:3/887: write d3/fc6 [46521,102167] 0 2024-09-10T10:04:30.352 INFO:tasks.workunit.client.0.smithi071.stdout:8/888: dwrite d5/df/d1d/d86/d75/d85/f110 [0,4194304] 0 2024-09-10T10:04:30.352 INFO:tasks.workunit.client.0.smithi071.stdout:6/775: creat d4/d1c/f102 x:0 0 0 2024-09-10T10:04:30.356 INFO:tasks.workunit.client.0.smithi071.stdout:3/888: dread d3/d1c/d3c/f6f [0,4194304] 0 2024-09-10T10:04:30.356 INFO:tasks.workunit.client.0.smithi071.stdout:6/776: symlink d4/da/df/d2e/d3a/da9/dbc/l103 0 2024-09-10T10:04:30.357 INFO:tasks.workunit.client.0.smithi071.stdout:8/889: fdatasync d5/df/d1e/d38/f42 0 2024-09-10T10:04:30.359 INFO:tasks.workunit.client.0.smithi071.stdout:6/777: write d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/fe0 [5068488,118461] 0 2024-09-10T10:04:30.361 INFO:tasks.workunit.client.0.smithi071.stdout:8/890: creat d5/df/d1e/d70/dc7/f135 x:0 0 0 2024-09-10T10:04:30.361 INFO:tasks.workunit.client.0.smithi071.stdout:3/889: truncate d3/d1c/d3c/f69 2816791 0 2024-09-10T10:04:30.362 INFO:tasks.workunit.client.0.smithi071.stdout:6/778: fsync d4/da/df/d5e/fd4 0 2024-09-10T10:04:30.362 INFO:tasks.workunit.client.0.smithi071.stdout:3/890: fdatasync d3/d49/d34/faf 0 2024-09-10T10:04:30.363 INFO:tasks.workunit.client.0.smithi071.stdout:8/891: chown d5/df/d1d/d86/d90/d109/fc6 23703 1 2024-09-10T10:04:30.365 INFO:tasks.workunit.client.0.smithi071.stdout:3/891: truncate d3/d1c/d3c/da1/fb7 4193234 0 2024-09-10T10:04:30.365 INFO:tasks.workunit.client.0.smithi071.stdout:8/892: mkdir d5/d136 0 2024-09-10T10:04:30.366 INFO:tasks.workunit.client.0.smithi071.stdout:8/893: fsync d5/df/d57/f8e 0 2024-09-10T10:04:30.371 INFO:tasks.workunit.client.0.smithi071.stdout:8/894: rename d5/df/d1e/d38/ffd to d5/df/d57/d82/d12e/f137 0 2024-09-10T10:04:30.373 INFO:tasks.workunit.client.0.smithi071.stdout:8/895: dread d5/df/d1d/d86/f9c [0,4194304] 0 2024-09-10T10:04:30.384 INFO:tasks.workunit.client.0.smithi071.stdout:8/896: dwrite d5/df/d1d/f93 [0,4194304] 0 2024-09-10T10:04:30.384 INFO:tasks.workunit.client.1.smithi107.stdout:2/946: fdatasync d3/da/d1e/d40/d8a/d7f/d55/d85/de4/f119 0 2024-09-10T10:04:30.385 INFO:tasks.workunit.client.0.smithi071.stdout:3/892: dread d3/d1c/d3c/da1/d42/d4a/d60/d78/fac [0,4194304] 0 2024-09-10T10:04:30.387 INFO:tasks.workunit.client.0.smithi071.stdout:3/893: truncate d3/d10/d24/fd8 1126172 0 2024-09-10T10:04:30.391 INFO:tasks.workunit.client.0.smithi071.stdout:8/897: dwrite d5/df/d1e/fda [0,4194304] 0 2024-09-10T10:04:30.392 INFO:tasks.workunit.client.0.smithi071.stdout:8/898: chown d5/df/d1d/f93 482572 1 2024-09-10T10:04:30.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:29 smithi107 ceph-mon[34215]: pgmap v6: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail 2024-09-10T10:04:30.412 INFO:tasks.workunit.client.0.smithi071.stdout:8/899: write d5/df/d74/f12a [3749966,10411] 0 2024-09-10T10:04:30.414 INFO:tasks.workunit.client.0.smithi071.stdout:8/900: write d5/df/f80 [2038226,82859] 0 2024-09-10T10:04:30.415 INFO:tasks.workunit.client.1.smithi107.stdout:0/945: dwrite d6/f10 [0,4194304] 0 2024-09-10T10:04:30.417 INFO:tasks.workunit.client.1.smithi107.stdout:6/939: dwrite d0/d3d/d14/d17/d24/df3/d55/d73/f93 [4194304,4194304] 0 2024-09-10T10:04:30.417 INFO:tasks.workunit.client.0.smithi071.stdout:3/894: dwrite d3/d1c/d3c/da1/fa9 [0,4194304] 0 2024-09-10T10:04:30.418 INFO:tasks.workunit.client.1.smithi107.stdout:5/951: dwrite de/d20/d2b/d4b/d5e/d116/fd6 [0,4194304] 0 2024-09-10T10:04:30.419 INFO:tasks.workunit.client.0.smithi071.stdout:3/895: write d3/d1c/d3c/da1/d3a/f68 [1673677,124350] 0 2024-09-10T10:04:30.420 INFO:tasks.workunit.client.0.smithi071.stdout:8/901: unlink d5/f73 0 2024-09-10T10:04:30.424 INFO:tasks.workunit.client.0.smithi071.stdout:8/902: creat d5/df/d1d/d86/f138 x:0 0 0 2024-09-10T10:04:30.426 INFO:tasks.workunit.client.1.smithi107.stdout:6/940: unlink d0/df0/c139 0 2024-09-10T10:04:30.426 INFO:tasks.workunit.client.0.smithi071.stdout:8/903: truncate d5/df/d74/fe6 5230607 0 2024-09-10T10:04:30.427 INFO:tasks.workunit.client.0.smithi071.stdout:3/896: mkdir d3/d49/d125/d12b 0 2024-09-10T10:04:30.429 INFO:tasks.workunit.client.1.smithi107.stdout:0/946: rename d6/d8/d2f/d2e/d32/d85 to d6/d8/d2f/d2e/d32/d135 0 2024-09-10T10:04:30.430 INFO:tasks.workunit.client.0.smithi071.stdout:8/904: unlink d5/l55 0 2024-09-10T10:04:30.432 INFO:tasks.workunit.client.1.smithi107.stdout:6/941: mkdir d0/d3d/d14/d17/d14c 0 2024-09-10T10:04:30.433 INFO:tasks.workunit.client.1.smithi107.stdout:0/947: creat d6/d8/d2f/da3/dee/dae/f136 x:0 0 0 2024-09-10T10:04:30.435 INFO:tasks.workunit.client.0.smithi071.stdout:8/905: rename d5/df/d74/d11d to d5/df/d1e/d38/d9f/d139 0 2024-09-10T10:04:30.436 INFO:tasks.workunit.client.0.smithi071.stdout:3/897: dwrite d3/d1c/d3c/da1/d5d/d7a/f10f [0,4194304] 0 2024-09-10T10:04:30.436 INFO:tasks.workunit.client.1.smithi107.stdout:2/947: dread d3/da/d1e/d40/fc4 [0,4194304] 0 2024-09-10T10:04:30.437 INFO:tasks.workunit.client.1.smithi107.stdout:6/942: rename d0/d3d/d14/d17/d24/l30 to d0/d3d/d14/d17/d24/dc5/l14d 0 2024-09-10T10:04:30.438 INFO:tasks.workunit.client.0.smithi071.stdout:8/906: creat d5/df/d57/d82/f13a x:0 0 0 2024-09-10T10:04:30.439 INFO:tasks.workunit.client.0.smithi071.stdout:8/907: write d5/df/d1d/d86/ff8 [385585,113777] 0 2024-09-10T10:04:30.440 INFO:tasks.workunit.client.0.smithi071.stdout:3/898: creat d3/d1c/d3c/da1/d5d/da5/db3/f12c x:0 0 0 2024-09-10T10:04:30.440 INFO:tasks.workunit.client.1.smithi107.stdout:0/948: creat d6/d8/d2f/d2e/d32/d56/d134/f137 x:0 0 0 2024-09-10T10:04:30.441 INFO:tasks.workunit.client.0.smithi071.stdout:8/908: symlink d5/d36/dfa/l13b 0 2024-09-10T10:04:30.447 INFO:tasks.workunit.client.0.smithi071.stdout:3/899: getdents d3/d1c/d3c/da1/d5d/d8f 0 2024-09-10T10:04:30.452 INFO:tasks.workunit.client.0.smithi071.stdout:8/909: creat d5/df/d1d/d86/d75/d85/f13c x:0 0 0 2024-09-10T10:04:30.455 INFO:tasks.workunit.client.1.smithi107.stdout:5/952: dread de/d41/f46 [0,4194304] 0 2024-09-10T10:04:30.457 INFO:tasks.workunit.client.1.smithi107.stdout:5/953: read de/f31 [3384339,84983] 0 2024-09-10T10:04:30.459 INFO:tasks.workunit.client.1.smithi107.stdout:5/954: dread - de/d20/d3d/dc0/fca zero size 2024-09-10T10:04:30.460 INFO:tasks.workunit.client.0.smithi071.stdout:8/910: dread d5/df/d57/f8a [0,4194304] 0 2024-09-10T10:04:30.461 INFO:tasks.workunit.client.1.smithi107.stdout:2/948: write d3/f1f [5172037,96384] 0 2024-09-10T10:04:30.462 INFO:tasks.workunit.client.1.smithi107.stdout:2/949: chown d3/da/d1e 5577 1 2024-09-10T10:04:30.463 INFO:tasks.workunit.client.1.smithi107.stdout:5/955: write de/d20/d2b/d4b/d5e/d116/d5c/faa [27016,79552] 0 2024-09-10T10:04:30.467 INFO:tasks.workunit.client.1.smithi107.stdout:5/956: creat de/d20/d3d/dd4/f143 x:0 0 0 2024-09-10T10:04:30.468 INFO:tasks.workunit.client.1.smithi107.stdout:6/943: dwrite d0/d3d/d14/d42/f4e [0,4194304] 0 2024-09-10T10:04:30.468 INFO:tasks.workunit.client.1.smithi107.stdout:2/950: mknod d3/da/d1e/d40/d8a/d7f/d55/c14b 0 2024-09-10T10:04:30.472 INFO:tasks.workunit.client.1.smithi107.stdout:6/944: creat d0/d3d/d14/d21/f14e x:0 0 0 2024-09-10T10:04:30.473 INFO:tasks.workunit.client.1.smithi107.stdout:5/957: mkdir de/d20/d2b/d4b/d5e/d9a/d144 0 2024-09-10T10:04:30.475 INFO:tasks.workunit.client.0.smithi071.stdout:8/911: mknod d5/df/d1e/d38/c13d 0 2024-09-10T10:04:30.477 INFO:tasks.workunit.client.0.smithi071.stdout:8/912: mknod d5/df/d1d/d86/d90/d109/c13e 0 2024-09-10T10:04:30.479 INFO:tasks.workunit.client.1.smithi107.stdout:6/945: creat d0/d3d/d14/d17/f14f x:0 0 0 2024-09-10T10:04:30.480 INFO:tasks.workunit.client.1.smithi107.stdout:2/951: dwrite d3/da/d1e/d40/d8a/d7f/f44 [0,4194304] 0 2024-09-10T10:04:30.481 INFO:tasks.workunit.client.1.smithi107.stdout:6/946: truncate d0/d3d/f144 971233 0 2024-09-10T10:04:30.482 INFO:tasks.workunit.client.1.smithi107.stdout:5/958: dread de/d20/fd8 [0,4194304] 0 2024-09-10T10:04:30.483 INFO:tasks.workunit.client.1.smithi107.stdout:2/952: mkdir d3/da/df/d20/d14c 0 2024-09-10T10:04:30.483 INFO:tasks.workunit.client.1.smithi107.stdout:6/947: chown d0/d3d/d14/c29 4 1 2024-09-10T10:04:30.488 INFO:tasks.workunit.client.1.smithi107.stdout:5/959: rename de/d20/d2b/d4b/d5e/d12a to de/d20/d2b/d4b/d5e/d116/d7e/db2/dbc/d145 0 2024-09-10T10:04:30.489 INFO:tasks.workunit.client.1.smithi107.stdout:6/948: symlink d0/d3d/d14/d21/d8a/da7/l150 0 2024-09-10T10:04:30.491 INFO:tasks.workunit.client.1.smithi107.stdout:5/960: write de/d20/d3d/fd2 [3620740,67380] 0 2024-09-10T10:04:30.492 INFO:tasks.workunit.client.1.smithi107.stdout:5/961: fdatasync de/f114 0 2024-09-10T10:04:30.494 INFO:tasks.workunit.client.0.smithi071.stdout:3/900: write d3/d1c/d3c/da1/d5d/d7a/f89 [4139413,8154] 0 2024-09-10T10:04:30.494 INFO:tasks.workunit.client.1.smithi107.stdout:2/953: truncate d3/da/d1e/d40/f9f 2311957 0 2024-09-10T10:04:30.495 INFO:tasks.workunit.client.0.smithi071.stdout:8/913: getdents d5/df/d1d/d86/d90/d109 0 2024-09-10T10:04:30.496 INFO:tasks.workunit.client.1.smithi107.stdout:5/962: truncate de/d20/d2b/d4b/d5e/db1/f105 652689 0 2024-09-10T10:04:30.496 INFO:tasks.workunit.client.0.smithi071.stdout:3/901: creat d3/d49/d2f/d7f/de2/f12d x:0 0 0 2024-09-10T10:04:30.497 INFO:tasks.workunit.client.1.smithi107.stdout:6/949: dwrite d0/d3d/d14/d17/d24/df3/f103 [4194304,4194304] 0 2024-09-10T10:04:30.498 INFO:tasks.workunit.client.0.smithi071.stdout:3/902: truncate d3/d49/ffd 615620 0 2024-09-10T10:04:30.503 INFO:tasks.workunit.client.0.smithi071.stdout:3/903: dwrite d3/d1c/d3c/da1/d5d/d9d/fe9 [0,4194304] 0 2024-09-10T10:04:30.511 INFO:tasks.workunit.client.0.smithi071.stdout:3/904: dwrite d3/d1c/d3c/da1/d3a/f68 [0,4194304] 0 2024-09-10T10:04:30.512 INFO:tasks.workunit.client.1.smithi107.stdout:8/843: sync 2024-09-10T10:04:30.512 INFO:tasks.workunit.client.0.smithi071.stdout:8/914: write d5/df/d1e/d38/fb1 [199880,23030] 0 2024-09-10T10:04:30.514 INFO:tasks.workunit.client.1.smithi107.stdout:6/950: truncate d0/d3d/d14/d17/f14f 320650 0 2024-09-10T10:04:30.518 INFO:tasks.workunit.client.0.smithi071.stdout:8/915: rename d5/df/d1d/f8c to d5/df/d1d/d86/d90/d109/f13f 0 2024-09-10T10:04:30.519 INFO:tasks.workunit.client.1.smithi107.stdout:2/954: dwrite d3/da/df/d20/dfb/d136/dea/ffe [0,4194304] 0 2024-09-10T10:04:30.521 INFO:tasks.workunit.client.0.smithi071.stdout:8/916: truncate d5/d36/d49/fd8 698131 0 2024-09-10T10:04:30.525 INFO:tasks.workunit.client.0.smithi071.stdout:8/917: mkdir d5/df/d1d/d86/d75/dcd/d115/d140 0 2024-09-10T10:04:30.526 INFO:tasks.workunit.client.1.smithi107.stdout:8/844: dwrite d5/d8/d5b/f90 [4194304,4194304] 0 2024-09-10T10:04:30.527 INFO:tasks.workunit.client.1.smithi107.stdout:6/951: link d0/d70/f115 d0/d3d/d14/dde/d10c/d12a/f151 0 2024-09-10T10:04:30.529 INFO:tasks.workunit.client.0.smithi071.stdout:3/905: dread d3/d1c/d3c/da1/f5f [0,4194304] 0 2024-09-10T10:04:30.530 INFO:tasks.workunit.client.1.smithi107.stdout:8/845: chown d5/d8/d66/d8b/d21/led 102677 1 2024-09-10T10:04:30.532 INFO:tasks.workunit.client.1.smithi107.stdout:2/955: rmdir d3/da/d1e 39 2024-09-10T10:04:30.534 INFO:tasks.workunit.client.0.smithi071.stdout:3/906: creat d3/f12e x:0 0 0 2024-09-10T10:04:30.534 INFO:tasks.workunit.client.1.smithi107.stdout:8/846: creat d5/da2/f11c x:0 0 0 2024-09-10T10:04:30.536 INFO:tasks.workunit.client.0.smithi071.stdout:3/907: readlink d3/d1c/d3c/da1/l12a 0 2024-09-10T10:04:30.536 INFO:tasks.workunit.client.1.smithi107.stdout:5/963: truncate de/d20/d3d/f88 93384 0 2024-09-10T10:04:30.541 INFO:tasks.workunit.client.1.smithi107.stdout:6/952: getdents d0/d3d/d14/d21 0 2024-09-10T10:04:30.541 INFO:tasks.workunit.client.1.smithi107.stdout:5/964: mkdir de/d20/d2b/d4b/d5e/d116/d7e/db2/dbc/d146 0 2024-09-10T10:04:30.542 INFO:tasks.workunit.client.1.smithi107.stdout:5/965: stat de/d20/d3d/dc0/l127 0 2024-09-10T10:04:30.543 INFO:tasks.workunit.client.1.smithi107.stdout:2/956: link d3/da/d66/db7/l135 d3/da/d1e/d5f/d54/l14d 0 2024-09-10T10:04:30.544 INFO:tasks.workunit.client.1.smithi107.stdout:6/953: creat d0/d3d/d14/d17/d24/df3/d55/da6/f152 x:0 0 0 2024-09-10T10:04:30.546 INFO:tasks.workunit.client.1.smithi107.stdout:2/957: creat d3/da/df/d20/dfb/d136/d10c/f14e x:0 0 0 2024-09-10T10:04:30.546 INFO:tasks.workunit.client.1.smithi107.stdout:5/966: mknod de/d20/d2b/d4b/d5e/c147 0 2024-09-10T10:04:30.547 INFO:tasks.workunit.client.1.smithi107.stdout:6/954: mkdir d0/d3d/d14/d21/d124/d153 0 2024-09-10T10:04:30.548 INFO:tasks.workunit.client.1.smithi107.stdout:5/967: write de/d20/d2b/d4b/d5e/d116/d5c/f130 [257791,22325] 0 2024-09-10T10:04:30.548 INFO:tasks.workunit.client.1.smithi107.stdout:8/847: write d5/d8/d66/d8b/d21/fb3 [1407793,39651] 0 2024-09-10T10:04:30.549 INFO:tasks.workunit.client.0.smithi071.stdout:3/908: truncate d3/d1c/d3c/da1/d42/d4a/d60/fb6 106119 0 2024-09-10T10:04:30.550 INFO:tasks.workunit.client.1.smithi107.stdout:6/955: dread - d0/d3d/d14/d21/d8a/da7/dc9/f11c zero size 2024-09-10T10:04:30.551 INFO:tasks.workunit.client.0.smithi071.stdout:3/909: truncate d3/d1c/f79 92270 0 2024-09-10T10:04:30.552 INFO:tasks.workunit.client.1.smithi107.stdout:8/848: creat d5/d8/d66/d8b/d1a/f11d x:0 0 0 2024-09-10T10:04:30.553 INFO:tasks.workunit.client.1.smithi107.stdout:5/968: rmdir de/d20/d2b/d4b/d5e/d116/d7e/db2/dee 39 2024-09-10T10:04:30.561 INFO:tasks.workunit.client.1.smithi107.stdout:6/956: dwrite d0/d3d/d14/dde/d10c/d12a/f5c [0,4194304] 0 2024-09-10T10:04:30.562 INFO:tasks.workunit.client.0.smithi071.stdout:3/910: dwrite d3/d49/d34/deb/ff1 [0,4194304] 0 2024-09-10T10:04:30.563 INFO:tasks.workunit.client.1.smithi107.stdout:8/849: write d5/d8/d66/d8b/d18/d4f/f8d [8775656,43864] 0 2024-09-10T10:04:30.564 INFO:tasks.workunit.client.1.smithi107.stdout:5/969: truncate de/d20/d2b/d4b/f71 1145854 0 2024-09-10T10:04:30.568 INFO:tasks.workunit.client.0.smithi071.stdout:3/911: rename d3/d49/d34/deb/ff1 to d3/d1c/d3e/f12f 0 2024-09-10T10:04:30.569 INFO:tasks.workunit.client.1.smithi107.stdout:6/957: creat d0/d3d/d14/d21/d8a/da2/da3/f154 x:0 0 0 2024-09-10T10:04:30.570 INFO:tasks.workunit.client.1.smithi107.stdout:8/850: truncate d5/d8/d66/d8b/d1a/d71/f7d 383923 0 2024-09-10T10:04:30.571 INFO:tasks.workunit.client.0.smithi071.stdout:3/912: chown d3/d10/d24/d2b/c32 100844835 1 2024-09-10T10:04:30.572 INFO:tasks.workunit.client.1.smithi107.stdout:6/958: fsync d0/d3d/f64 0 2024-09-10T10:04:30.575 INFO:tasks.workunit.client.0.smithi071.stdout:3/913: creat d3/d49/d2f/d7f/f130 x:0 0 0 2024-09-10T10:04:30.576 INFO:tasks.workunit.client.1.smithi107.stdout:8/851: link d5/d8/d66/fc1 d5/da2/f11e 0 2024-09-10T10:04:30.576 INFO:tasks.workunit.client.1.smithi107.stdout:5/970: dread de/db3/fbf [4194304,4194304] 0 2024-09-10T10:04:30.577 INFO:tasks.workunit.client.1.smithi107.stdout:5/971: readlink de/d9c/la6 0 2024-09-10T10:04:30.577 INFO:tasks.workunit.client.1.smithi107.stdout:6/959: symlink d0/d3d/d14/d21/d8a/dee/l155 0 2024-09-10T10:04:30.577 INFO:tasks.workunit.client.0.smithi071.stdout:3/914: creat d3/d20/d99/d9b/dde/d118/f131 x:0 0 0 2024-09-10T10:04:30.580 INFO:tasks.workunit.client.0.smithi071.stdout:3/915: creat d3/d1c/d3c/da1/dd2/f132 x:0 0 0 2024-09-10T10:04:30.580 INFO:tasks.workunit.client.1.smithi107.stdout:5/972: getdents de/d20/d2b/d4b/d5e/d116/d7e/db2/d141 0 2024-09-10T10:04:30.582 INFO:tasks.workunit.client.0.smithi071.stdout:3/916: mkdir d3/d49/d4f/d133 0 2024-09-10T10:04:30.584 INFO:tasks.workunit.client.1.smithi107.stdout:6/960: dwrite d0/d3d/d14/d21/fa0 [0,4194304] 0 2024-09-10T10:04:30.585 INFO:tasks.workunit.client.1.smithi107.stdout:6/961: fsync d0/f13 0 2024-09-10T10:04:30.586 INFO:tasks.workunit.client.1.smithi107.stdout:5/973: rmdir de/d20/d2b/d4b/d5e/d116/d7e/db2/dbc/d145 0 2024-09-10T10:04:30.589 INFO:tasks.workunit.client.1.smithi107.stdout:5/974: write de/d20/d2b/d4b/d5e/d116/d7e/d79/f7d [3607785,65640] 0 2024-09-10T10:04:30.589 INFO:tasks.workunit.client.1.smithi107.stdout:5/975: dread - de/fa7 zero size 2024-09-10T10:04:30.591 INFO:tasks.workunit.client.0.smithi071.stdout:3/917: write d3/d49/d2f/d7f/de2/f12d [94428,71580] 0 2024-09-10T10:04:30.591 INFO:tasks.workunit.client.1.smithi107.stdout:5/976: fsync de/d20/d3d/dd4/f143 0 2024-09-10T10:04:30.592 INFO:tasks.workunit.client.1.smithi107.stdout:6/962: creat d0/d3d/d14/dde/d10c/d12a/d102/f156 x:0 0 0 2024-09-10T10:04:30.592 INFO:tasks.workunit.client.1.smithi107.stdout:5/977: write de/d20/d3d/dd4/f11d [375162,73730] 0 2024-09-10T10:04:30.594 INFO:tasks.workunit.client.0.smithi071.stdout:3/918: read d3/f41 [3486179,21831] 0 2024-09-10T10:04:30.596 INFO:tasks.workunit.client.1.smithi107.stdout:5/978: unlink de/d20/d2b/d4b/d5e/d9a/la2 0 2024-09-10T10:04:30.596 INFO:tasks.workunit.client.1.smithi107.stdout:6/963: truncate d0/d3d/fbb 708366 0 2024-09-10T10:04:30.597 INFO:tasks.workunit.client.0.smithi071.stdout:3/919: mknod d3/d1c/d3e/d77/c134 0 2024-09-10T10:04:30.598 INFO:tasks.workunit.client.1.smithi107.stdout:6/964: readlink d0/d3d/d14/d21/d8a/da7/lab 0 2024-09-10T10:04:30.600 INFO:tasks.workunit.client.1.smithi107.stdout:8/852: dwrite d5/d8/d66/d8b/d21/f3c [0,4194304] 0 2024-09-10T10:04:30.601 INFO:tasks.workunit.client.0.smithi071.stdout:3/920: truncate d3/d49/d34/f81 1392338 0 2024-09-10T10:04:30.606 INFO:tasks.workunit.client.1.smithi107.stdout:8/853: creat d5/d8/d66/d8b/d18/d4f/d111/d35/f11f x:0 0 0 2024-09-10T10:04:30.612 INFO:tasks.workunit.client.1.smithi107.stdout:8/854: rename d5/l2d to d5/d8/d66/d8b/d21/d83/l120 0 2024-09-10T10:04:30.613 INFO:tasks.workunit.client.1.smithi107.stdout:6/965: write d0/d3d/d14/d17/d24/df3/d55/d73/f75 [872474,99894] 0 2024-09-10T10:04:30.613 INFO:tasks.workunit.client.1.smithi107.stdout:5/979: dwrite de/d41/f52 [0,4194304] 0 2024-09-10T10:04:30.613 INFO:tasks.workunit.client.0.smithi071.stdout:3/921: dread d3/d49/f6c [0,4194304] 0 2024-09-10T10:04:30.615 INFO:tasks.workunit.client.1.smithi107.stdout:8/855: symlink d5/l121 0 2024-09-10T10:04:30.615 INFO:tasks.workunit.client.1.smithi107.stdout:6/966: chown d0/d3d/d14/d17/d24/df3/d55/l62 18020928 1 2024-09-10T10:04:30.616 INFO:tasks.workunit.client.1.smithi107.stdout:5/980: write de/d20/d2b/d4b/d5e/d116/d7e/f10c [304355,25331] 0 2024-09-10T10:04:30.617 INFO:tasks.workunit.client.0.smithi071.stdout:3/922: mknod d3/d49/d125/d12b/c135 0 2024-09-10T10:04:30.620 INFO:tasks.workunit.client.1.smithi107.stdout:6/967: symlink d0/d3d/d14/d21/d8a/dee/df1/l157 0 2024-09-10T10:04:30.621 INFO:tasks.workunit.client.1.smithi107.stdout:6/968: readlink d0/d3d/d14/l120 0 2024-09-10T10:04:30.625 INFO:tasks.workunit.client.0.smithi071.stdout:3/923: write d3/d49/d2f/fb5 [881288,111276] 0 2024-09-10T10:04:30.625 INFO:tasks.workunit.client.1.smithi107.stdout:5/981: creat de/d20/d2b/d4b/d5e/d116/f148 x:0 0 0 2024-09-10T10:04:30.626 INFO:tasks.workunit.client.1.smithi107.stdout:6/969: symlink d0/d3d/d14/d9f/dca/l158 0 2024-09-10T10:04:30.627 INFO:tasks.workunit.client.0.smithi071.stdout:3/924: write d3/d1c/f11b [4930920,90647] 0 2024-09-10T10:04:30.628 INFO:tasks.workunit.client.1.smithi107.stdout:5/982: mknod de/d20/c149 0 2024-09-10T10:04:30.629 INFO:tasks.workunit.client.0.smithi071.stdout:3/925: mknod d3/d1c/d3c/da1/d3a/dbd/c136 0 2024-09-10T10:04:30.630 INFO:tasks.workunit.client.0.smithi071.stdout:3/926: stat d3/d49/d34/c56 0 2024-09-10T10:04:30.631 INFO:tasks.workunit.client.0.smithi071.stdout:3/927: chown d3/d20/d99/ldc 8690 1 2024-09-10T10:04:30.631 INFO:tasks.workunit.client.1.smithi107.stdout:8/856: dwrite d5/d8/d66/d8b/d21/d83/f84 [0,4194304] 0 2024-09-10T10:04:30.631 INFO:tasks.workunit.client.1.smithi107.stdout:5/983: write de/d20/d2b/d4b/d5e/d9a/f11c [187385,46601] 0 2024-09-10T10:04:30.631 INFO:tasks.workunit.client.1.smithi107.stdout:8/857: chown d5/d8 342985569 1 2024-09-10T10:04:30.632 INFO:tasks.workunit.client.1.smithi107.stdout:6/970: link d0/d3d/d14/d42/f8b d0/d70/f159 0 2024-09-10T10:04:30.633 INFO:tasks.workunit.client.1.smithi107.stdout:8/858: chown d5/d8/d66/d8b/d21/ca5 2037111593 1 2024-09-10T10:04:30.634 INFO:tasks.workunit.client.1.smithi107.stdout:6/971: chown d0/d3d/d14/d21/d8a/d8d/l9b 442431096 1 2024-09-10T10:04:30.634 INFO:tasks.workunit.client.1.smithi107.stdout:8/859: stat d5/d8/d66/d8b/d21/d83/fa1 0 2024-09-10T10:04:30.635 INFO:tasks.workunit.client.1.smithi107.stdout:8/860: fsync d5/d42/fdd 0 2024-09-10T10:04:30.636 INFO:tasks.workunit.client.1.smithi107.stdout:6/972: chown d0/d3d/d14/d17/d24/df3/f90 122 1 2024-09-10T10:04:30.636 INFO:tasks.workunit.client.0.smithi071.stdout:3/928: dread d3/d49/d2f/dc2/fe6 [0,4194304] 0 2024-09-10T10:04:30.636 INFO:tasks.workunit.client.1.smithi107.stdout:8/861: readlink d5/d8/d66/d8b/d18/d4f/l51 0 2024-09-10T10:04:30.637 INFO:tasks.workunit.client.1.smithi107.stdout:5/984: mknod de/d20/d3d/dd4/c14a 0 2024-09-10T10:04:30.638 INFO:tasks.workunit.client.0.smithi071.stdout:3/929: chown d3/d1c/d3c/da1/d42/d4a/d60/d78/c111 21683 1 2024-09-10T10:04:30.639 INFO:tasks.workunit.client.1.smithi107.stdout:6/973: creat d0/d3d/d14/d21/d8a/dee/d112/f15a x:0 0 0 2024-09-10T10:04:30.641 INFO:tasks.workunit.client.1.smithi107.stdout:6/974: dread - d0/d3d/d14/d21/d8a/da2/ffd zero size 2024-09-10T10:04:30.641 INFO:tasks.workunit.client.1.smithi107.stdout:5/985: dread de/d41/f52 [0,4194304] 0 2024-09-10T10:04:30.644 INFO:tasks.workunit.client.0.smithi071.stdout:3/930: dwrite d3/f12e [0,4194304] 0 2024-09-10T10:04:30.647 INFO:tasks.workunit.client.1.smithi107.stdout:5/986: rename de/d20/d2b/d4b/d5e/d116/c82 to de/d20/d2b/d4b/d8c/c14b 0 2024-09-10T10:04:30.649 INFO:tasks.workunit.client.0.smithi071.stdout:3/931: creat d3/d1c/d3c/da1/d3a/dba/f137 x:0 0 0 2024-09-10T10:04:30.649 INFO:tasks.workunit.client.1.smithi107.stdout:5/987: mknod de/d20/d2b/c14c 0 2024-09-10T10:04:30.650 INFO:tasks.workunit.client.0.smithi071.stdout:3/932: readlink d3/d1c/d3c/da1/d42/d4a/d60/d78/l7d 0 2024-09-10T10:04:30.652 INFO:tasks.workunit.client.1.smithi107.stdout:5/988: symlink de/d20/d2b/d4b/d5e/db1/l14d 0 2024-09-10T10:04:30.653 INFO:tasks.workunit.client.0.smithi071.stdout:3/933: symlink d3/d1c/d3e/df8/l138 0 2024-09-10T10:04:30.654 INFO:tasks.workunit.client.1.smithi107.stdout:5/989: readlink de/d20/d2b/d4b/d8c/lf8 0 2024-09-10T10:04:30.655 INFO:tasks.workunit.client.0.smithi071.stdout:3/934: fsync d3/f1b 0 2024-09-10T10:04:30.656 INFO:tasks.workunit.client.1.smithi107.stdout:8/862: dwrite d5/d8/d66/d8b/fba [0,4194304] 0 2024-09-10T10:04:30.658 INFO:tasks.workunit.client.0.smithi071.stdout:3/935: creat d3/d49/d125/f139 x:0 0 0 2024-09-10T10:04:30.659 INFO:tasks.workunit.client.1.smithi107.stdout:5/990: creat de/d20/d2b/d4b/d5e/f14e x:0 0 0 2024-09-10T10:04:30.661 INFO:tasks.workunit.client.0.smithi071.stdout:3/936: mknod d3/d1c/d3c/da1/d5d/d9d/c13a 0 2024-09-10T10:04:30.661 INFO:tasks.workunit.client.1.smithi107.stdout:8/863: link d5/d8/d66/fca d5/d8/d66/d8e/f122 0 2024-09-10T10:04:30.663 INFO:tasks.workunit.client.1.smithi107.stdout:8/864: write d5/d8/d5b/fe2 [3801328,77808] 0 2024-09-10T10:04:30.663 INFO:tasks.workunit.client.1.smithi107.stdout:5/991: fdatasync de/d20/d3d/dc0/fca 0 2024-09-10T10:04:30.665 INFO:tasks.workunit.client.0.smithi071.stdout:3/937: rename d3/d1c/d3e/lf4 to d3/d1c/l13b 0 2024-09-10T10:04:30.666 INFO:tasks.workunit.client.1.smithi107.stdout:8/865: read - d5/d8/d66/d8b/d1a/d71/f10d zero size 2024-09-10T10:04:30.667 INFO:tasks.workunit.client.1.smithi107.stdout:5/992: symlink de/d20/d2b/d4b/d5e/d116/d5c/l14f 0 2024-09-10T10:04:30.667 INFO:tasks.workunit.client.1.smithi107.stdout:6/975: truncate d0/d3d/d14/d42/f136 820160 0 2024-09-10T10:04:30.669 INFO:tasks.workunit.client.1.smithi107.stdout:8/866: unlink d5/d8/d66/d8b/d18/fb2 0 2024-09-10T10:04:30.670 INFO:tasks.workunit.client.1.smithi107.stdout:6/976: creat d0/d3d/d14/d17/d137/d110/f15b x:0 0 0 2024-09-10T10:04:30.671 INFO:tasks.workunit.client.1.smithi107.stdout:8/867: symlink d5/d8/d66/d8b/d18/dab/l123 0 2024-09-10T10:04:30.674 INFO:tasks.workunit.client.1.smithi107.stdout:6/977: mkdir d0/d3d/d14/d17/d24/df3/d55/d56/d15c 0 2024-09-10T10:04:30.675 INFO:tasks.workunit.client.1.smithi107.stdout:5/993: dwrite de/d20/d2b/faf [0,4194304] 0 2024-09-10T10:04:30.675 INFO:tasks.workunit.client.1.smithi107.stdout:8/868: mkdir d5/d8/d66/d8b/d1a/d64/d124 0 2024-09-10T10:04:30.676 INFO:tasks.workunit.client.1.smithi107.stdout:5/994: write de/d20/d2b/f60 [3104140,51512] 0 2024-09-10T10:04:30.677 INFO:tasks.workunit.client.1.smithi107.stdout:6/978: fdatasync d0/d3d/d14/d17/d24/df3/d55/d73/f13d 0 2024-09-10T10:04:30.680 INFO:tasks.workunit.client.1.smithi107.stdout:6/979: write d0/d3d/d14/d17/d24/df3/d55/f140 [63103,35947] 0 2024-09-10T10:04:30.685 INFO:tasks.workunit.client.0.smithi071.stdout:3/938: dread d3/d1c/d3c/da1/d42/d4a/f11f [0,4194304] 0 2024-09-10T10:04:30.687 INFO:tasks.workunit.client.1.smithi107.stdout:6/980: unlink d0/d3d/d14/d17/f36 0 2024-09-10T10:04:30.687 INFO:tasks.workunit.client.0.smithi071.stdout:3/939: fdatasync d3/d1c/d3c/da1/d5d/d9d/fa6 0 2024-09-10T10:04:30.694 INFO:tasks.workunit.client.0.smithi071.stdout:3/940: dwrite d3/d1c/d3c/da1/d5d/d9d/fb8 [0,4194304] 0 2024-09-10T10:04:30.694 INFO:tasks.workunit.client.1.smithi107.stdout:6/981: write d0/d3d/f41 [2553824,43050] 0 2024-09-10T10:04:30.695 INFO:tasks.workunit.client.0.smithi071.stdout:3/941: dread - d3/d20/d99/d9b/dde/d118/f131 zero size 2024-09-10T10:04:30.697 INFO:tasks.workunit.client.0.smithi071.stdout:3/942: write d3/d1c/d3c/da1/d3a/dc0/fcb [123307,48970] 0 2024-09-10T10:04:30.699 INFO:tasks.workunit.client.1.smithi107.stdout:6/982: stat d0/d3d/d14/d21/d124/d153 0 2024-09-10T10:04:30.699 INFO:tasks.workunit.client.1.smithi107.stdout:8/869: dwrite d5/d8/d66/d8b/d18/d4f/d111/f6e [0,4194304] 0 2024-09-10T10:04:30.701 INFO:tasks.workunit.client.1.smithi107.stdout:5/995: dwrite de/d20/d3d/f4c [0,4194304] 0 2024-09-10T10:04:30.704 INFO:tasks.workunit.client.0.smithi071.stdout:3/943: rename d3/d1c/d3c to d3/d49/d34/deb/d13c 0 2024-09-10T10:04:30.708 INFO:tasks.workunit.client.1.smithi107.stdout:6/983: unlink d0/d3d/d14/d9f/dca/fd4 0 2024-09-10T10:04:30.710 INFO:tasks.workunit.client.1.smithi107.stdout:5/996: mknod de/d20/d2b/d4b/d8c/d12f/c150 0 2024-09-10T10:04:30.714 INFO:tasks.workunit.client.1.smithi107.stdout:6/984: creat d0/d3d/d14/d42/f15d x:0 0 0 2024-09-10T10:04:30.714 INFO:tasks.workunit.client.1.smithi107.stdout:8/870: getdents d5/d8/d66/d8b/d1a/d75 0 2024-09-10T10:04:30.715 INFO:tasks.workunit.client.1.smithi107.stdout:5/997: link de/d20/d2b/d4b/d5e/d116/d4e/fe1 de/d9c/d133/f151 0 2024-09-10T10:04:30.716 INFO:tasks.workunit.client.1.smithi107.stdout:8/871: mkdir d5/d8/d66/d8b/d1a/d75/d125 0 2024-09-10T10:04:30.717 INFO:tasks.workunit.client.1.smithi107.stdout:6/985: symlink d0/d3d/d14/d17/d24/df3/d55/da6/l15e 0 2024-09-10T10:04:30.719 INFO:tasks.workunit.client.1.smithi107.stdout:6/986: mknod d0/d70/c15f 0 2024-09-10T10:04:30.721 INFO:tasks.workunit.client.1.smithi107.stdout:6/987: getdents d0/d3d/d14/d17/d24/df3/d55/d56/d15c 0 2024-09-10T10:04:30.723 INFO:tasks.workunit.client.1.smithi107.stdout:6/988: creat d0/d3d/d14/d17/f160 x:0 0 0 2024-09-10T10:04:30.730 INFO:tasks.workunit.client.1.smithi107.stdout:6/989: truncate d0/d3d/f144 777688 0 2024-09-10T10:04:30.733 INFO:tasks.workunit.client.1.smithi107.stdout:5/998: dwrite de/f11e [0,4194304] 0 2024-09-10T10:04:30.733 INFO:tasks.workunit.client.1.smithi107.stdout:5/999: fdatasync de/d20/d3d/dd4/f11d 0 2024-09-10T10:04:30.735 INFO:tasks.workunit.client.1.smithi107.stdout:8/872: dread d5/fb [0,4194304] 0 2024-09-10T10:04:30.743 INFO:tasks.workunit.client.1.smithi107.stdout:6/990: dwrite d0/d70/fb7 [0,4194304] 0 2024-09-10T10:04:30.743 INFO:tasks.workunit.client.1.smithi107.stdout:8/873: dwrite d5/d8/d66/d8b/d21/f3e [0,4194304] 0 2024-09-10T10:04:30.750 INFO:tasks.workunit.client.1.smithi107.stdout:6/991: rmdir d0/d3d/d14/d17/d24/df3/d55/d56 39 2024-09-10T10:04:30.752 INFO:tasks.workunit.client.1.smithi107.stdout:8/874: dwrite d5/d8/d66/d8b/d21/f3c [0,4194304] 0 2024-09-10T10:04:30.752 INFO:tasks.workunit.client.1.smithi107.stdout:7/894: sync 2024-09-10T10:04:30.756 INFO:tasks.workunit.client.1.smithi107.stdout:6/992: truncate d0/d70/fb6 5153613 0 2024-09-10T10:04:30.759 INFO:tasks.workunit.client.1.smithi107.stdout:8/875: mknod d5/d8/d66/d8b/d18/d4f/d111/d35/d85/d119/c126 0 2024-09-10T10:04:30.761 INFO:tasks.workunit.client.1.smithi107.stdout:6/993: mknod d0/d3d/d14/d21/d8a/dee/d112/c161 0 2024-09-10T10:04:30.761 INFO:tasks.workunit.client.1.smithi107.stdout:6/994: chown d0/d3d/d14/d9f/l104 5161088 1 2024-09-10T10:04:30.763 INFO:tasks.workunit.client.1.smithi107.stdout:8/876: getdents d5/d8/d66/d8b/d81/de3 0 2024-09-10T10:04:30.763 INFO:tasks.workunit.client.1.smithi107.stdout:6/995: truncate d0/d3d/d14/dde/d10c/d12a/f151 829725 0 2024-09-10T10:04:30.764 INFO:tasks.workunit.client.1.smithi107.stdout:8/877: write d5/d8/d66/d8b/d1a/d71/f10d [42598,16952] 0 2024-09-10T10:04:30.787 INFO:tasks.workunit.client.1.smithi107.stdout:7/895: dwrite d0/d8/d5c/fae [0,4194304] 0 2024-09-10T10:04:30.787 INFO:tasks.workunit.client.1.smithi107.stdout:6/996: dwrite d0/d3d/d14/d21/fb3 [0,4194304] 0 2024-09-10T10:04:30.788 INFO:tasks.workunit.client.1.smithi107.stdout:8/878: dwrite d5/d8/d66/fca [4194304,4194304] 0 2024-09-10T10:04:30.790 INFO:tasks.workunit.client.1.smithi107.stdout:7/896: creat d0/d8/d56/dcc/da0/f122 x:0 0 0 2024-09-10T10:04:30.793 INFO:tasks.workunit.client.1.smithi107.stdout:7/897: fdatasync d0/d8/dc/f11a 0 2024-09-10T10:04:30.794 INFO:tasks.workunit.client.1.smithi107.stdout:8/879: rename d5/d8/d66/d8b/d18/d4f/d111/d47/cd9 to d5/d8/d66/d8b/d21/d113/c127 0 2024-09-10T10:04:30.797 INFO:tasks.workunit.client.1.smithi107.stdout:7/898: fdatasync d0/d8/dc/d2c/f3b 0 2024-09-10T10:04:30.797 INFO:tasks.workunit.client.1.smithi107.stdout:7/899: chown d0/d20/d35/l5f 1634274 1 2024-09-10T10:04:30.798 INFO:tasks.workunit.client.1.smithi107.stdout:8/880: creat d5/d8/d66/d8b/d18/dab/f128 x:0 0 0 2024-09-10T10:04:30.801 INFO:tasks.workunit.client.1.smithi107.stdout:8/881: creat d5/d8/d66/d8b/d18/d4f/d111/d47/f129 x:0 0 0 2024-09-10T10:04:30.802 INFO:tasks.workunit.client.1.smithi107.stdout:8/882: chown d5/d8/d66/d8b/d18/caf 205 1 2024-09-10T10:04:30.807 INFO:tasks.workunit.client.1.smithi107.stdout:8/883: dwrite d5/d8/d66/d8b/d21/d83/fcf [0,4194304] 0 2024-09-10T10:04:30.808 INFO:tasks.workunit.client.1.smithi107.stdout:8/884: dread - d5/da2/fd3 zero size 2024-09-10T10:04:30.811 INFO:tasks.workunit.client.1.smithi107.stdout:8/885: creat d5/d8/d66/d8b/d18/f12a x:0 0 0 2024-09-10T10:04:30.813 INFO:tasks.workunit.client.1.smithi107.stdout:8/886: mknod d5/d8/d66/d8b/d1a/d64/db9/c12b 0 2024-09-10T10:04:30.816 INFO:tasks.workunit.client.1.smithi107.stdout:8/887: creat d5/d8/d66/d8b/dfd/f12c x:0 0 0 2024-09-10T10:04:30.817 INFO:tasks.workunit.client.1.smithi107.stdout:8/888: chown d5/d8/d66/d8b/d81/f8c 358924 1 2024-09-10T10:04:30.818 INFO:tasks.workunit.client.1.smithi107.stdout:8/889: chown d5/d8/d66/d8b/d21/f3e 13808 1 2024-09-10T10:04:30.824 INFO:tasks.workunit.client.1.smithi107.stdout:8/890: dwrite d5/d8/d66/d8b/d21/f56 [0,4194304] 0 2024-09-10T10:04:30.826 INFO:tasks.workunit.client.1.smithi107.stdout:8/891: mknod d5/d8/d66/d8b/d18/d4f/d111/d47/c12d 0 2024-09-10T10:04:30.834 INFO:tasks.workunit.client.1.smithi107.stdout:8/892: dwrite d5/d8/d66/d8b/f67 [0,4194304] 0 2024-09-10T10:04:30.834 INFO:tasks.workunit.client.1.smithi107.stdout:8/893: stat d5/d8/f24 0 2024-09-10T10:04:30.835 INFO:tasks.workunit.client.1.smithi107.stdout:8/894: write d5/d8/d66/d8b/d1a/f46 [3500183,94245] 0 2024-09-10T10:04:30.837 INFO:tasks.workunit.client.1.smithi107.stdout:8/895: fsync d5/d8/d66/f6a 0 2024-09-10T10:04:30.841 INFO:tasks.workunit.client.1.smithi107.stdout:8/896: dread d5/d8/d66/d8b/d21/d83/fcf [0,4194304] 0 2024-09-10T10:04:30.844 INFO:tasks.workunit.client.1.smithi107.stdout:8/897: fdatasync d5/d8/d66/d8b/d18/fc3 0 2024-09-10T10:04:30.846 INFO:tasks.workunit.client.1.smithi107.stdout:8/898: creat d5/d8/d66/d8b/d1a/d75/f12e x:0 0 0 2024-09-10T10:04:30.850 INFO:tasks.workunit.client.1.smithi107.stdout:8/899: link d5/d8/d66/fca d5/f12f 0 2024-09-10T10:04:30.851 INFO:tasks.workunit.client.1.smithi107.stdout:8/900: write d5/d8/d66/d8b/d1a/d75/f12e [721914,62893] 0 2024-09-10T10:04:30.855 INFO:tasks.workunit.client.1.smithi107.stdout:8/901: rename d5/d8/d66/d8b/d18/da4/f10e to d5/d8/d66/d8b/d1a/da3/f130 0 2024-09-10T10:04:30.857 INFO:tasks.workunit.client.1.smithi107.stdout:8/902: creat d5/d8/d66/d8b/f131 x:0 0 0 2024-09-10T10:04:30.859 INFO:tasks.workunit.client.1.smithi107.stdout:8/903: mkdir d5/d8/d66/d8b/d18/d4f/d111/d35/d85/dcb/ddf/d132 0 2024-09-10T10:04:30.861 INFO:tasks.workunit.client.1.smithi107.stdout:8/904: symlink d5/d8/d66/d8b/d18/d4f/d111/d35/d85/dcb/l133 0 2024-09-10T10:04:30.862 INFO:tasks.workunit.client.1.smithi107.stdout:8/905: mknod d5/d8/d66/d8b/d18/d4f/d111/d35/c134 0 2024-09-10T10:04:30.864 INFO:tasks.workunit.client.1.smithi107.stdout:8/906: unlink d5/d8/d66/d8b/d18/d4f/d111/d35/d85/d119/c126 0 2024-09-10T10:04:30.866 INFO:tasks.workunit.client.1.smithi107.stdout:8/907: mkdir d5/d8/d66/d8b/d18/d4f/d111/d35/d70/d135 0 2024-09-10T10:04:30.867 INFO:tasks.workunit.client.1.smithi107.stdout:8/908: chown d5/d8/d66/d8b/d18/d4f/d111/d35/c4c 264 1 2024-09-10T10:04:30.868 INFO:tasks.workunit.client.1.smithi107.stdout:8/909: creat d5/d42/f136 x:0 0 0 2024-09-10T10:04:30.869 INFO:tasks.workunit.client.1.smithi107.stdout:8/910: dread - d5/d42/f136 zero size 2024-09-10T10:04:30.871 INFO:tasks.workunit.client.1.smithi107.stdout:8/911: mknod d5/da2/c137 0 2024-09-10T10:04:30.871 INFO:tasks.workunit.client.1.smithi107.stdout:7/900: read d0/d8/d5c/f103 [310720,15622] 0 2024-09-10T10:04:30.872 INFO:tasks.workunit.client.1.smithi107.stdout:8/912: write d5/d8/f13 [1825191,32808] 0 2024-09-10T10:04:30.873 INFO:tasks.workunit.client.1.smithi107.stdout:7/901: chown d0/d1b/d4d/cf0 1 1 2024-09-10T10:04:30.875 INFO:tasks.workunit.client.0.smithi071.stdout:2/915: sync 2024-09-10T10:04:30.875 INFO:tasks.workunit.client.1.smithi107.stdout:7/902: mknod d0/d1b/d4d/d69/d97/d95/c123 0 2024-09-10T10:04:30.876 INFO:tasks.workunit.client.0.smithi071.stdout:2/916: rmdir d8/db6/de7 39 2024-09-10T10:04:30.877 INFO:tasks.workunit.client.1.smithi107.stdout:8/913: getdents d5/d42/ddb 0 2024-09-10T10:04:30.877 INFO:tasks.workunit.client.1.smithi107.stdout:7/903: write d0/d8/d56/dcc/d81/f8a [903020,113870] 0 2024-09-10T10:04:30.878 INFO:tasks.workunit.client.0.smithi071.stdout:2/917: creat d8/d4a/f138 x:0 0 0 2024-09-10T10:04:30.881 INFO:tasks.workunit.client.0.smithi071.stdout:2/918: unlink d8/d87/dc4/d103/l10f 0 2024-09-10T10:04:30.881 INFO:tasks.workunit.client.1.smithi107.stdout:8/914: getdents d5/d8/d66/d8e/dee 0 2024-09-10T10:04:30.881 INFO:tasks.workunit.client.1.smithi107.stdout:7/904: dread d0/d8/d56/dcc/d81/fad [0,4194304] 0 2024-09-10T10:04:30.883 INFO:tasks.workunit.client.1.smithi107.stdout:7/905: write d0/d1b/d4d/d69/dca/fd6 [54709,122095] 0 2024-09-10T10:04:30.885 INFO:tasks.workunit.client.1.smithi107.stdout:7/906: write d0/d20/d35/ffa [714427,53523] 0 2024-09-10T10:04:30.888 INFO:tasks.workunit.client.1.smithi107.stdout:7/907: mknod d0/d8/dc/d2c/d47/c124 0 2024-09-10T10:04:30.891 INFO:tasks.workunit.client.1.smithi107.stdout:8/915: dread d5/d8/d66/d8b/d1a/d75/def/ff7 [0,4194304] 0 2024-09-10T10:04:30.892 INFO:tasks.workunit.client.1.smithi107.stdout:8/916: chown d5/d8/d66/d8b/d1a/f4d 0 1 2024-09-10T10:04:30.893 INFO:tasks.workunit.client.1.smithi107.stdout:8/917: readlink d5/d8/d66/d8e/lc8 0 2024-09-10T10:04:30.893 INFO:tasks.workunit.client.1.smithi107.stdout:7/908: link d0/d1b/d4d/dba/ffb d0/d8/d56/dcc/d81/f125 0 2024-09-10T10:04:30.894 INFO:tasks.workunit.client.0.smithi071.stdout:2/919: write d8/d87/d33/d41/d4d/d52/fe4 [530546,70808] 0 2024-09-10T10:04:30.897 INFO:tasks.workunit.client.1.smithi107.stdout:7/909: mkdir d0/d1b/d4d/d126 0 2024-09-10T10:04:30.898 INFO:tasks.workunit.client.1.smithi107.stdout:7/910: write d0/d1b/d4d/fed [730034,20262] 0 2024-09-10T10:04:30.903 INFO:tasks.workunit.client.1.smithi107.stdout:7/911: dwrite d0/d1b/d4d/d69/d97/d68/ff2 [0,4194304] 0 2024-09-10T10:04:30.907 INFO:tasks.workunit.client.1.smithi107.stdout:9/897: sync 2024-09-10T10:04:30.907 INFO:tasks.workunit.client.1.smithi107.stdout:0/949: sync 2024-09-10T10:04:30.913 INFO:tasks.workunit.client.1.smithi107.stdout:0/950: rename d6/d8/f101 to d6/d8/d2f/d35/d3c/d58/d69/d84/f138 0 2024-09-10T10:04:30.917 INFO:tasks.workunit.client.1.smithi107.stdout:7/912: write d0/d8/f84 [1052625,26419] 0 2024-09-10T10:04:30.918 INFO:tasks.workunit.client.0.smithi071.stdout:2/920: dread d8/d87/d33/d41/d4d/f8c [0,4194304] 0 2024-09-10T10:04:30.919 INFO:tasks.workunit.client.1.smithi107.stdout:0/951: mkdir d6/d14/d139 0 2024-09-10T10:04:30.921 INFO:tasks.workunit.client.1.smithi107.stdout:7/913: rename d0/d1b/d4d/d69/d97/d95/fcd to d0/d1b/d4d/d69/f127 0 2024-09-10T10:04:30.922 INFO:tasks.workunit.client.0.smithi071.stdout:2/921: read d8/f20 [1555758,79537] 0 2024-09-10T10:04:30.922 INFO:tasks.workunit.client.1.smithi107.stdout:9/898: truncate d5/d7/d1d/db5/fcc 629494 0 2024-09-10T10:04:30.925 INFO:tasks.workunit.client.1.smithi107.stdout:0/952: rename d6/l60 to d6/d8/d2f/d2e/d32/d56/d134/l13a 0 2024-09-10T10:04:30.926 INFO:tasks.workunit.client.1.smithi107.stdout:9/899: symlink d5/d7/d1d/d29/d101/l129 0 2024-09-10T10:04:30.927 INFO:tasks.workunit.client.1.smithi107.stdout:7/914: unlink d0/d8/dc/cb3 0 2024-09-10T10:04:30.931 INFO:tasks.workunit.client.0.smithi071.stdout:2/922: dwrite d8/d4a/ffa [0,4194304] 0 2024-09-10T10:04:30.933 INFO:tasks.workunit.client.0.smithi071.stdout:2/923: creat d8/d38/d63/f139 x:0 0 0 2024-09-10T10:04:30.934 INFO:tasks.workunit.client.1.smithi107.stdout:0/953: dwrite d6/d8/d2f/d2e/d32/f4c [4194304,4194304] 0 2024-09-10T10:04:30.935 INFO:tasks.workunit.client.1.smithi107.stdout:7/915: rename d0/d1b/d4d/d69/d97/d68/fe3 to d0/d8/d56/d5d/f128 0 2024-09-10T10:04:30.935 INFO:tasks.workunit.client.1.smithi107.stdout:8/918: dread d5/d8/d5b/fb0 [0,4194304] 0 2024-09-10T10:04:30.935 INFO:tasks.workunit.client.0.smithi071.stdout:2/924: creat d8/d38/d47/f13a x:0 0 0 2024-09-10T10:04:30.936 INFO:tasks.workunit.client.1.smithi107.stdout:9/900: dwrite d5/d7/d1d/d9b/dab/d57/d87/d27/f42 [0,4194304] 0 2024-09-10T10:04:30.936 INFO:tasks.workunit.client.0.smithi071.stdout:2/925: dread - d8/d87/d49/d66/df0/f115 zero size 2024-09-10T10:04:30.940 INFO:tasks.workunit.client.0.smithi071.stdout:2/926: unlink d8/d87/d33/l92 0 2024-09-10T10:04:30.943 INFO:tasks.workunit.client.1.smithi107.stdout:0/954: mkdir d6/d8/d2f/d13b 0 2024-09-10T10:04:30.944 INFO:tasks.workunit.client.1.smithi107.stdout:9/901: mkdir d5/d7/d1d/d29/d101/d12a 0 2024-09-10T10:04:30.945 INFO:tasks.workunit.client.0.smithi071.stdout:2/927: creat d8/d87/d51/f13b x:0 0 0 2024-09-10T10:04:30.948 INFO:tasks.workunit.client.1.smithi107.stdout:8/919: dwrite d5/d8/d66/d8b/d18/d4f/d111/d47/f129 [0,4194304] 0 2024-09-10T10:04:30.948 INFO:tasks.workunit.client.1.smithi107.stdout:0/955: rmdir d6/d8/d2f/d35/d3c/d58 39 2024-09-10T10:04:30.949 INFO:tasks.workunit.client.0.smithi071.stdout:2/928: creat d8/d87/d33/d53/d120/f13c x:0 0 0 2024-09-10T10:04:30.953 INFO:tasks.workunit.client.1.smithi107.stdout:0/956: dread d6/f10 [0,4194304] 0 2024-09-10T10:04:30.955 INFO:tasks.workunit.client.1.smithi107.stdout:9/902: unlink d5/d7/d1d/d9b/dab/d57/d87/d27/c36 0 2024-09-10T10:04:30.959 INFO:tasks.workunit.client.1.smithi107.stdout:9/903: mkdir d5/d7/d1d/d41/dc8/dfc/d12b 0 2024-09-10T10:04:30.960 INFO:tasks.workunit.client.1.smithi107.stdout:8/920: getdents d5/d8/d66/d8b/d81 0 2024-09-10T10:04:30.962 INFO:tasks.workunit.client.1.smithi107.stdout:8/921: write d5/d8/d66/d8b/fba [2540965,94344] 0 2024-09-10T10:04:30.963 INFO:tasks.workunit.client.1.smithi107.stdout:7/916: dread d0/d1b/d4d/d69/d97/d68/f58 [0,4194304] 0 2024-09-10T10:04:30.964 INFO:tasks.workunit.client.1.smithi107.stdout:7/917: stat d0/d8/dc/d2c/fde 0 2024-09-10T10:04:30.964 INFO:tasks.workunit.client.1.smithi107.stdout:2/958: sync 2024-09-10T10:04:30.964 INFO:tasks.workunit.client.1.smithi107.stdout:6/997: sync 2024-09-10T10:04:30.968 INFO:tasks.workunit.client.1.smithi107.stdout:8/922: truncate d5/d8/d66/f108 5097447 0 2024-09-10T10:04:30.969 INFO:tasks.workunit.client.1.smithi107.stdout:6/998: creat d0/d3d/d14/d21/d124/d153/f162 x:0 0 0 2024-09-10T10:04:30.969 INFO:tasks.workunit.client.1.smithi107.stdout:2/959: read d3/da/d1e/d5f/f34 [945341,76849] 0 2024-09-10T10:04:30.970 INFO:tasks.workunit.client.1.smithi107.stdout:8/923: creat d5/d42/ddb/d10c/f138 x:0 0 0 2024-09-10T10:04:30.971 INFO:tasks.workunit.client.1.smithi107.stdout:8/924: fsync d5/d8/d66/d8b/d1a/fa8 0 2024-09-10T10:04:30.976 INFO:tasks.workunit.client.1.smithi107.stdout:9/904: write d5/d7/d1d/d9b/dab/f93 [1426143,78345] 0 2024-09-10T10:04:30.979 INFO:tasks.workunit.client.1.smithi107.stdout:7/918: write d0/d20/f3a [4970243,52127] 0 2024-09-10T10:04:30.981 INFO:tasks.workunit.client.1.smithi107.stdout:0/957: dwrite d6/d8/d2f/d2e/d7b/fa2 [0,4194304] 0 2024-09-10T10:04:30.982 INFO:tasks.workunit.client.1.smithi107.stdout:0/958: fdatasync d6/d8/d2f/da3/dee/f124 0 2024-09-10T10:04:30.983 INFO:tasks.workunit.client.0.smithi071.stdout:2/929: dread d8/d87/f1c [0,4194304] 0 2024-09-10T10:04:30.986 INFO:tasks.workunit.client.1.smithi107.stdout:0/959: mknod d6/d8/d2f/d2e/d32/d56/d134/c13c 0 2024-09-10T10:04:30.989 INFO:tasks.workunit.client.1.smithi107.stdout:9/905: mknod d5/d7/d1d/d41/c12c 0 2024-09-10T10:04:30.990 INFO:tasks.workunit.client.1.smithi107.stdout:8/925: truncate d5/d8/d66/d8b/d18/d4f/f8d 4674505 0 2024-09-10T10:04:30.993 INFO:tasks.workunit.client.1.smithi107.stdout:2/960: dwrite d3/da/df/d20/d36/fcd [4194304,4194304] 0 2024-09-10T10:04:30.993 INFO:tasks.workunit.client.1.smithi107.stdout:0/960: mkdir d6/d8/d13d 0 2024-09-10T10:04:30.993 INFO:tasks.workunit.client.0.smithi071.stdout:2/930: write d8/d87/d33/d53/f86 [1799637,119328] 0 2024-09-10T10:04:30.996 INFO:tasks.workunit.client.1.smithi107.stdout:0/961: dread - d6/d8/d2f/d2e/d32/d95/f97 zero size 2024-09-10T10:04:30.998 INFO:tasks.workunit.client.1.smithi107.stdout:6/999: dread d0/d3d/d14/d21/d8a/da2/da3/dac/fea [4194304,4194304] 0 2024-09-10T10:04:30.998 INFO:tasks.workunit.client.0.smithi071.stdout:1/893: sync 2024-09-10T10:04:31.000 INFO:tasks.workunit.client.1.smithi107.stdout:9/906: rename d5/d7/d1d/d29/db4/cd2 to d5/d7/d1d/d9b/dab/d57/d87/d37/c12d 0 2024-09-10T10:04:31.000 INFO:tasks.workunit.client.0.smithi071.stdout:2/931: link d8/d87/d49/d66/ca2 d8/db6/de7/d111/c13d 0 2024-09-10T10:04:31.003 INFO:tasks.workunit.client.0.smithi071.stdout:2/932: unlink d8/d87/d49/d66/ff1 0 2024-09-10T10:04:31.004 INFO:tasks.workunit.client.0.smithi071.stdout:1/894: mkdir d1/d3f/d58/daf/ddc/d139 0 2024-09-10T10:04:31.005 INFO:tasks.workunit.client.1.smithi107.stdout:2/961: mkdir d3/da/df/d20/d36/d4f/d14f 0 2024-09-10T10:04:31.006 INFO:tasks.workunit.client.0.smithi071.stdout:2/933: rename d8/d87/d33/d41/d4d/d52/lbe to d8/d87/l13e 0 2024-09-10T10:04:31.007 INFO:tasks.workunit.client.1.smithi107.stdout:0/962: dwrite d6/f10 [0,4194304] 0 2024-09-10T10:04:31.007 INFO:tasks.workunit.client.1.smithi107.stdout:7/919: truncate d0/fcf 1893995 0 2024-09-10T10:04:31.007 INFO:tasks.workunit.client.1.smithi107.stdout:9/907: chown d5/d7/d1d/d29/db4/dbd/d11f 46 1 2024-09-10T10:04:31.008 INFO:tasks.workunit.client.0.smithi071.stdout:1/895: dread - d1/d57/fca zero size 2024-09-10T10:04:31.008 INFO:tasks.workunit.client.1.smithi107.stdout:9/908: chown d5/d1e/f117 2780 1 2024-09-10T10:04:31.009 INFO:tasks.workunit.client.1.smithi107.stdout:9/909: stat d5/d7/d1d/d41/dc8/dfc/d10d/lc2 0 2024-09-10T10:04:31.010 INFO:tasks.workunit.client.0.smithi071.stdout:2/934: write d8/d87/f76 [5099223,103613] 0 2024-09-10T10:04:31.015 INFO:tasks.workunit.client.1.smithi107.stdout:0/963: rename d6/d8/d2f/da3/da5/fab to d6/d8/d2f/d2e/f13e 0 2024-09-10T10:04:31.018 INFO:tasks.workunit.client.0.smithi071.stdout:1/896: dwrite d1/fd [0,4194304] 0 2024-09-10T10:04:31.019 INFO:tasks.workunit.client.1.smithi107.stdout:7/920: mkdir d0/d8/dc/d2c/d129 0 2024-09-10T10:04:31.020 INFO:tasks.workunit.client.1.smithi107.stdout:8/926: write d5/d8/d66/d8b/d1a/d64/f103 [3050534,37819] 0 2024-09-10T10:04:31.021 INFO:tasks.workunit.client.1.smithi107.stdout:9/910: unlink d5/d7/d1d/d29/db4/df0/f10b 0 2024-09-10T10:04:31.022 INFO:tasks.workunit.client.1.smithi107.stdout:0/964: symlink d6/d8/d2f/d2e/d32/d56/dfd/l13f 0 2024-09-10T10:04:31.026 INFO:tasks.workunit.client.1.smithi107.stdout:2/962: creat d3/da/f150 x:0 0 0 2024-09-10T10:04:31.027 INFO:tasks.workunit.client.1.smithi107.stdout:2/963: chown d3/da/d1e/d5f/dad/l112 65777393 1 2024-09-10T10:04:31.027 INFO:tasks.workunit.client.1.smithi107.stdout:7/921: creat d0/d1b/d9d/f12a x:0 0 0 2024-09-10T10:04:31.028 INFO:tasks.workunit.client.1.smithi107.stdout:8/927: write d5/d8/d66/d8b/d21/d83/fcf [3469981,67987] 0 2024-09-10T10:04:31.030 INFO:tasks.workunit.client.1.smithi107.stdout:7/922: truncate d0/d20/ddf/ffe 576727 0 2024-09-10T10:04:31.031 INFO:tasks.workunit.client.1.smithi107.stdout:7/923: chown d0/d1b/d9d 90632183 1 2024-09-10T10:04:31.031 INFO:tasks.workunit.client.1.smithi107.stdout:8/928: write d5/d8/d66/d8b/d1a/f46 [3425222,127775] 0 2024-09-10T10:04:31.031 INFO:tasks.workunit.client.1.smithi107.stdout:7/924: dread - d0/dff/f116 zero size 2024-09-10T10:04:31.031 INFO:tasks.workunit.client.1.smithi107.stdout:2/964: mkdir d3/da/d66/d151 0 2024-09-10T10:04:31.033 INFO:tasks.workunit.client.1.smithi107.stdout:9/911: getdents d5 0 2024-09-10T10:04:31.036 INFO:tasks.workunit.client.1.smithi107.stdout:7/925: mkdir d0/d1b/d4d/d69/d97/d95/d12b 0 2024-09-10T10:04:31.036 INFO:tasks.workunit.client.1.smithi107.stdout:0/965: link d6/c1a d6/d8/d2f/d6e/c140 0 2024-09-10T10:04:31.039 INFO:tasks.workunit.client.1.smithi107.stdout:8/929: creat d5/d8/d66/d8b/d18/d4f/d111/d35/d85/f139 x:0 0 0 2024-09-10T10:04:31.040 INFO:tasks.workunit.client.1.smithi107.stdout:7/926: write d0/d8/dc/f1f [5355488,79045] 0 2024-09-10T10:04:31.041 INFO:tasks.workunit.client.0.smithi071.stdout:2/935: dread d8/d87/d33/d41/d4d/d5e/f9a [0,4194304] 0 2024-09-10T10:04:31.041 INFO:tasks.workunit.client.1.smithi107.stdout:8/930: chown d5/d8/d66/d8b/d1a/f4d 2 1 2024-09-10T10:04:31.041 INFO:tasks.workunit.client.1.smithi107.stdout:7/927: chown d0/f27 23728 1 2024-09-10T10:04:31.043 INFO:tasks.workunit.client.1.smithi107.stdout:2/965: creat d3/da/df/d20/d36/d39/da3/d123/d137/f152 x:0 0 0 2024-09-10T10:04:31.043 INFO:tasks.workunit.client.0.smithi071.stdout:2/936: creat d8/d87/d33/d41/d4d/d5e/f13f x:0 0 0 2024-09-10T10:04:31.045 INFO:tasks.workunit.client.0.smithi071.stdout:2/937: unlink d8/d38/d8d/f98 0 2024-09-10T10:04:31.045 INFO:tasks.workunit.client.1.smithi107.stdout:8/931: symlink d5/d8/d66/d8b/d18/da4/l13a 0 2024-09-10T10:04:31.046 INFO:tasks.workunit.client.1.smithi107.stdout:9/912: getdents d5/d7/d1d/db5 0 2024-09-10T10:04:31.047 INFO:tasks.workunit.client.0.smithi071.stdout:2/938: readlink d8/d38/d99/lee 0 2024-09-10T10:04:31.047 INFO:tasks.workunit.client.1.smithi107.stdout:2/966: mkdir d3/da/df/d20/d36/d39/da3/dd0/d153 0 2024-09-10T10:04:31.047 INFO:tasks.workunit.client.0.smithi071.stdout:2/939: stat d8/l12 0 2024-09-10T10:04:31.049 INFO:tasks.workunit.client.1.smithi107.stdout:7/928: mknod d0/d8/dc/d2c/c12c 0 2024-09-10T10:04:31.049 INFO:tasks.workunit.client.0.smithi071.stdout:2/940: fsync d8/d38/fa0 0 2024-09-10T10:04:31.050 INFO:tasks.workunit.client.0.smithi071.stdout:1/897: dread d1/d21/f61 [0,4194304] 0 2024-09-10T10:04:31.051 INFO:tasks.workunit.client.0.smithi071.stdout:1/898: stat d1/d21/d2f/d30/d75/l8a 0 2024-09-10T10:04:31.052 INFO:tasks.workunit.client.1.smithi107.stdout:7/929: fdatasync d0/d8/d5c/d6d/fbf 0 2024-09-10T10:04:31.052 INFO:tasks.workunit.client.1.smithi107.stdout:0/966: getdents d6/d8/d2f/d6e/dc5 0 2024-09-10T10:04:31.053 INFO:tasks.workunit.client.0.smithi071.stdout:1/899: chown d1/d21/d3d/lf3 0 1 2024-09-10T10:04:31.054 INFO:tasks.workunit.client.1.smithi107.stdout:7/930: readlink d0/d8/ld 0 2024-09-10T10:04:31.055 INFO:tasks.workunit.client.1.smithi107.stdout:8/932: dwrite d5/d8/d66/d8b/d21/d83/f84 [0,4194304] 0 2024-09-10T10:04:31.055 INFO:tasks.workunit.client.1.smithi107.stdout:2/967: mknod d3/da/df/d20/d118/c154 0 2024-09-10T10:04:31.056 INFO:tasks.workunit.client.0.smithi071.stdout:5/886: sync 2024-09-10T10:04:31.057 INFO:tasks.workunit.client.0.smithi071.stdout:6/779: sync 2024-09-10T10:04:31.057 INFO:tasks.workunit.client.0.smithi071.stdout:4/773: sync 2024-09-10T10:04:31.057 INFO:tasks.workunit.client.1.smithi107.stdout:7/931: read - d0/d8/d56/d5d/f128 zero size 2024-09-10T10:04:31.057 INFO:tasks.workunit.client.1.smithi107.stdout:9/913: dwrite d5/d7/d1d/d9b/dab/d57/d87/d27/fa1 [0,4194304] 0 2024-09-10T10:04:31.058 INFO:tasks.workunit.client.0.smithi071.stdout:2/941: dwrite d8/f20 [0,4194304] 0 2024-09-10T10:04:31.059 INFO:tasks.workunit.client.0.smithi071.stdout:4/774: stat db/d15/d17/d24/f8a 0 2024-09-10T10:04:31.059 INFO:tasks.workunit.client.0.smithi071.stdout:6/780: dread - d4/d20/fa1 zero size 2024-09-10T10:04:31.061 INFO:tasks.workunit.client.0.smithi071.stdout:4/775: chown db/d15/d17/d4e/d5a/dd3/fd9 10 1 2024-09-10T10:04:31.062 INFO:tasks.workunit.client.1.smithi107.stdout:9/914: write d5/d7/d1d/d41/dc8/dfc/d10d/f127 [73887,2328] 0 2024-09-10T10:04:31.062 INFO:tasks.workunit.client.1.smithi107.stdout:8/933: rmdir d5/d8/d66/d8b/d21/d83 39 2024-09-10T10:04:31.062 INFO:tasks.workunit.client.0.smithi071.stdout:1/900: fdatasync d1/d21/d2f/d30/d6a/d91/fa1 0 2024-09-10T10:04:31.063 INFO:tasks.workunit.client.1.smithi107.stdout:0/967: dwrite d6/f7 [0,4194304] 0 2024-09-10T10:04:31.068 INFO:tasks.workunit.client.1.smithi107.stdout:7/932: rmdir d0/d20/ddf 39 2024-09-10T10:04:31.068 INFO:tasks.workunit.client.1.smithi107.stdout:8/934: truncate d5/d8/d66/d8b/d1a/d75/fac 540124 0 2024-09-10T10:04:31.069 INFO:tasks.workunit.client.0.smithi071.stdout:1/901: truncate d1/d21/d2f/d30/fd8 226837 0 2024-09-10T10:04:31.069 INFO:tasks.workunit.client.0.smithi071.stdout:2/942: mknod d8/d38/d8d/c140 0 2024-09-10T10:04:31.070 INFO:tasks.workunit.client.0.smithi071.stdout:4/776: rmdir db/d15/d17/d4e/dc0/dc2 39 2024-09-10T10:04:31.072 INFO:tasks.workunit.client.1.smithi107.stdout:2/968: write d3/da/df/d20/d36/f13f [2736426,58686] 0 2024-09-10T10:04:31.075 INFO:tasks.workunit.client.0.smithi071.stdout:2/943: rename d8/d87/d49/dce to d8/d4a/d141 0 2024-09-10T10:04:31.077 INFO:tasks.workunit.client.0.smithi071.stdout:2/944: fdatasync d8/d87/d33/d41/d56/d107/f117 0 2024-09-10T10:04:31.077 INFO:tasks.workunit.client.0.smithi071.stdout:6/781: getdents d4/da/df/d2e/d3a/d40/d60/d7a 0 2024-09-10T10:04:31.077 INFO:tasks.workunit.client.0.smithi071.stdout:6/782: stat d4/d1c 0 2024-09-10T10:04:31.078 INFO:tasks.workunit.client.0.smithi071.stdout:2/945: readlink d8/d87/d51/l11f 0 2024-09-10T10:04:31.078 INFO:tasks.workunit.client.1.smithi107.stdout:7/933: symlink d0/d8/dc/d2c/d47/l12d 0 2024-09-10T10:04:31.078 INFO:tasks.workunit.client.1.smithi107.stdout:9/915: rename d5/d7/d1d/d9b/dab/d57/d87/d27/cc7 to d5/d7/d1d/d29/db4/dfd/c12e 0 2024-09-10T10:04:31.079 INFO:tasks.workunit.client.1.smithi107.stdout:2/969: mkdir d3/da/df/d20/dfb/d136/d117/d155 0 2024-09-10T10:04:31.079 INFO:tasks.workunit.client.1.smithi107.stdout:7/934: chown d0/d8/dc 0 1 2024-09-10T10:04:31.080 INFO:tasks.workunit.client.0.smithi071.stdout:6/783: write d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/fe4 [394953,49212] 0 2024-09-10T10:04:31.082 INFO:tasks.workunit.client.1.smithi107.stdout:2/970: unlink d3/d8f/df4/f120 0 2024-09-10T10:04:31.083 INFO:tasks.workunit.client.0.smithi071.stdout:6/784: chown d4/da/df/d2e/d3a/d40/d60/d7a/dbd 321522 1 2024-09-10T10:04:31.084 INFO:tasks.workunit.client.1.smithi107.stdout:8/935: truncate d5/d8/d66/d8b/d21/f61 1150343 0 2024-09-10T10:04:31.085 INFO:tasks.workunit.client.1.smithi107.stdout:0/968: dwrite d6/d8/d2f/d2e/d32/d135/d8a/feb [0,4194304] 0 2024-09-10T10:04:31.087 INFO:tasks.workunit.client.0.smithi071.stdout:6/785: creat d4/da/df/d2e/d3a/d40/d60/d7a/def/f104 x:0 0 0 2024-09-10T10:04:31.088 INFO:tasks.workunit.client.0.smithi071.stdout:5/887: dread dc/df/dd7/d87/f9f [0,4194304] 0 2024-09-10T10:04:31.088 INFO:tasks.workunit.client.0.smithi071.stdout:2/946: dwrite d8/db6/de7/f134 [0,4194304] 0 2024-09-10T10:04:31.089 INFO:tasks.workunit.client.1.smithi107.stdout:7/935: dwrite d0/d99/fe2 [0,4194304] 0 2024-09-10T10:04:31.091 INFO:tasks.workunit.client.1.smithi107.stdout:2/971: fsync d3/da/df/d20/d36/d4f/d92/ff2 0 2024-09-10T10:04:31.093 INFO:tasks.workunit.client.0.smithi071.stdout:2/947: unlink d8/d87/l2c 0 2024-09-10T10:04:31.093 INFO:tasks.workunit.client.1.smithi107.stdout:7/936: chown d0/d8/dc/d2c/fde 32013 1 2024-09-10T10:04:31.095 INFO:tasks.workunit.client.1.smithi107.stdout:2/972: stat d3/da/df/d20/fc0 0 2024-09-10T10:04:31.097 INFO:tasks.workunit.client.0.smithi071.stdout:5/888: link dc/df/d29/d48/dae/db6/feb dc/df/d29/d48/dae/db6/f12d 0 2024-09-10T10:04:31.101 INFO:tasks.workunit.client.1.smithi107.stdout:0/969: dwrite d6/d8/d2f/da3/dee/f124 [0,4194304] 0 2024-09-10T10:04:31.101 INFO:tasks.workunit.client.0.smithi071.stdout:4/777: dread db/d15/d4b/f5f [0,4194304] 0 2024-09-10T10:04:31.101 INFO:tasks.workunit.client.0.smithi071.stdout:5/889: truncate f4 973338 0 2024-09-10T10:04:31.102 INFO:tasks.workunit.client.0.smithi071.stdout:2/948: link d8/d87/d51/c12a d8/d87/d33/d53/c142 0 2024-09-10T10:04:31.102 INFO:tasks.workunit.client.1.smithi107.stdout:7/937: truncate d0/d1b/d9d/f12a 809561 0 2024-09-10T10:04:31.102 INFO:tasks.workunit.client.1.smithi107.stdout:8/936: dwrite d5/da2/fd3 [0,4194304] 0 2024-09-10T10:04:31.102 INFO:tasks.workunit.client.1.smithi107.stdout:2/973: stat d3/da/df/c9a 0 2024-09-10T10:04:31.104 INFO:tasks.workunit.client.0.smithi071.stdout:4/778: write db/d15/d17/d24/f8a [377081,38570] 0 2024-09-10T10:04:31.107 INFO:tasks.workunit.client.0.smithi071.stdout:1/902: write d1/d21/d65/fce [381279,3783] 0 2024-09-10T10:04:31.109 INFO:tasks.workunit.client.0.smithi071.stdout:5/890: creat dc/df/d29/d48/dae/f12e x:0 0 0 2024-09-10T10:04:31.110 INFO:tasks.workunit.client.0.smithi071.stdout:5/891: chown dc/df/d17/d8d 30930039 1 2024-09-10T10:04:31.110 INFO:tasks.workunit.client.0.smithi071.stdout:2/949: unlink d8/d4a/lff 0 2024-09-10T10:04:31.113 INFO:tasks.workunit.client.1.smithi107.stdout:8/937: dwrite d5/f12f [0,4194304] 0 2024-09-10T10:04:31.115 INFO:tasks.workunit.client.1.smithi107.stdout:8/938: chown d5/d8/d66/d8b/d1a/d71/f10d 44424311 1 2024-09-10T10:04:31.116 INFO:tasks.workunit.client.0.smithi071.stdout:4/779: mkdir db/d15/d26/d43/d4d/d9f/da6/d104 0 2024-09-10T10:04:31.116 INFO:tasks.workunit.client.1.smithi107.stdout:9/916: write d5/d7/d1d/d29/fe6 [938900,28853] 0 2024-09-10T10:04:31.117 INFO:tasks.workunit.client.1.smithi107.stdout:2/974: dread d3/da/d66/fd1 [0,4194304] 0 2024-09-10T10:04:31.122 INFO:tasks.workunit.client.0.smithi071.stdout:5/892: unlink dc/df/d17/d8d/de4/lf9 0 2024-09-10T10:04:31.124 INFO:tasks.workunit.client.0.smithi071.stdout:2/950: rename d8/d87/d33/leb to d8/d87/d49/l143 0 2024-09-10T10:04:31.125 INFO:tasks.workunit.client.0.smithi071.stdout:4/780: creat db/d15/d26/d43/d4d/d77/dd7/f105 x:0 0 0 2024-09-10T10:04:31.126 INFO:tasks.workunit.client.1.smithi107.stdout:2/975: dwrite d3/da/df/d20/d36/d39/da3/ddb/f11f [0,4194304] 0 2024-09-10T10:04:31.127 INFO:tasks.workunit.client.0.smithi071.stdout:1/903: link d1/d21/d3d/d9a/df9/fae d1/d3f/f13a 0 2024-09-10T10:04:31.128 INFO:tasks.workunit.client.0.smithi071.stdout:5/893: link dc/df/dd7/cbd dc/df/d3e/d5a/dd4/c12f 0 2024-09-10T10:04:31.131 INFO:tasks.workunit.client.0.smithi071.stdout:1/904: mkdir d1/d21/d3d/d9a/df9/d11c/d13b 0 2024-09-10T10:04:31.132 INFO:tasks.workunit.client.0.smithi071.stdout:4/781: creat db/d15/f106 x:0 0 0 2024-09-10T10:04:31.133 INFO:tasks.workunit.client.0.smithi071.stdout:1/905: stat d1/d21/d2f/d30/d75/c126 0 2024-09-10T10:04:31.134 INFO:tasks.workunit.client.1.smithi107.stdout:2/976: dread d3/da/d1e/d40/d8a/d7f/d55/f64 [0,4194304] 0 2024-09-10T10:04:31.136 INFO:tasks.workunit.client.1.smithi107.stdout:2/977: truncate d3/da/d66/fd1 763751 0 2024-09-10T10:04:31.137 INFO:tasks.workunit.client.0.smithi071.stdout:4/782: write db/d15/d26/d43/d4d/d77/fe6 [2180687,41044] 0 2024-09-10T10:04:31.138 INFO:tasks.workunit.client.0.smithi071.stdout:1/906: rmdir d1/d21/d2f/d30/d6a/d91/d9d 39 2024-09-10T10:04:31.139 INFO:tasks.workunit.client.1.smithi107.stdout:2/978: stat d3/da/d1e/d40/d8a/d7f/d55/fcb 0 2024-09-10T10:04:31.139 INFO:tasks.workunit.client.0.smithi071.stdout:5/894: dwrite dc/df/d3e/fd1 [0,4194304] 0 2024-09-10T10:04:31.140 INFO:tasks.workunit.client.0.smithi071.stdout:4/783: dread - db/d15/d26/d43/d4d/d77/dd7/fe5 zero size 2024-09-10T10:04:31.142 INFO:tasks.workunit.client.1.smithi107.stdout:2/979: mkdir d3/da/d1e/d5f/d54/d114/d13d/d156 0 2024-09-10T10:04:31.142 INFO:tasks.workunit.client.1.smithi107.stdout:2/980: chown d3/da/d1e/d40/d8a/d7f/d55/fcb 1400 1 2024-09-10T10:04:31.143 INFO:tasks.workunit.client.0.smithi071.stdout:5/895: write dc/d4a/dbb/f10c [278435,111572] 0 2024-09-10T10:04:31.145 INFO:tasks.workunit.client.0.smithi071.stdout:1/907: rename d1/d21/d2f/d30/d6a/fba to d1/d3f/d58/daf/ddc/d139/f13c 0 2024-09-10T10:04:31.147 INFO:tasks.workunit.client.0.smithi071.stdout:1/908: stat d1/d70 0 2024-09-10T10:04:31.148 INFO:tasks.workunit.client.0.smithi071.stdout:5/896: read - dc/df/d3e/d5a/dd4/f102 zero size 2024-09-10T10:04:31.149 INFO:tasks.workunit.client.0.smithi071.stdout:4/784: dwrite db/d15/d17/d4e/f5b [0,4194304] 0 2024-09-10T10:04:31.153 INFO:tasks.workunit.client.0.smithi071.stdout:5/897: creat dc/df/d3e/d5a/d80/d8a/f130 x:0 0 0 2024-09-10T10:04:31.153 INFO:tasks.workunit.client.1.smithi107.stdout:0/970: write d6/d8/d2f/da3/da5/fc1 [314109,49235] 0 2024-09-10T10:04:31.154 INFO:tasks.workunit.client.0.smithi071.stdout:4/785: fdatasync db/d15/d26/fb9 0 2024-09-10T10:04:31.155 INFO:tasks.workunit.client.0.smithi071.stdout:1/909: getdents d1/d21/d2f/d30/d6a/d91/d9d/d114 0 2024-09-10T10:04:31.156 INFO:tasks.workunit.client.0.smithi071.stdout:5/898: truncate dc/f31 4779335 0 2024-09-10T10:04:31.156 INFO:tasks.workunit.client.0.smithi071.stdout:4/786: write db/d15/d17/d4e/d5a/dd3/fd9 [439449,35813] 0 2024-09-10T10:04:31.158 INFO:tasks.workunit.client.0.smithi071.stdout:1/910: creat d1/d35/dea/d110/f13d x:0 0 0 2024-09-10T10:04:31.160 INFO:tasks.workunit.client.0.smithi071.stdout:4/787: creat db/d15/d26/d43/d4d/f107 x:0 0 0 2024-09-10T10:04:31.163 INFO:tasks.workunit.client.0.smithi071.stdout:5/899: rename dc/df/d29/d48/dae/db6/l116 to dc/df/d3e/d5a/l131 0 2024-09-10T10:04:31.163 INFO:tasks.workunit.client.1.smithi107.stdout:7/938: truncate d0/d8/d56/dcc/f55 1323713 0 2024-09-10T10:04:31.164 INFO:tasks.workunit.client.0.smithi071.stdout:1/911: creat d1/d70/d76/dd4/dfe/f13e x:0 0 0 2024-09-10T10:04:31.164 INFO:tasks.workunit.client.0.smithi071.stdout:5/900: dread - dc/d53/d101/f104 zero size 2024-09-10T10:04:31.165 INFO:tasks.workunit.client.0.smithi071.stdout:5/901: stat dc/d53/c5d 0 2024-09-10T10:04:31.166 INFO:tasks.workunit.client.1.smithi107.stdout:9/917: dwrite d5/d7/d1d/d9b/dab/d57/f7a [0,4194304] 0 2024-09-10T10:04:31.167 INFO:tasks.workunit.client.0.smithi071.stdout:4/788: creat db/d15/d17/d4e/dc0/f108 x:0 0 0 2024-09-10T10:04:31.167 INFO:tasks.workunit.client.0.smithi071.stdout:1/912: rmdir d1/d3f/d58/daf/ddc/d139 39 2024-09-10T10:04:31.169 INFO:tasks.workunit.client.1.smithi107.stdout:2/981: write d3/da/f17 [2246510,83175] 0 2024-09-10T10:04:31.171 INFO:tasks.workunit.client.0.smithi071.stdout:5/902: symlink dc/d53/dee/l132 0 2024-09-10T10:04:31.172 INFO:tasks.workunit.client.1.smithi107.stdout:8/939: dread d5/d8/d5b/f74 [0,4194304] 0 2024-09-10T10:04:31.172 INFO:tasks.workunit.client.1.smithi107.stdout:2/982: fsync d3/da/df/d20/dfb/d136/dea/ffe 0 2024-09-10T10:04:31.173 INFO:tasks.workunit.client.0.smithi071.stdout:1/913: mknod d1/d21/d2f/d30/d6a/d91/d9d/d114/c13f 0 2024-09-10T10:04:31.173 INFO:tasks.workunit.client.1.smithi107.stdout:8/940: readlink d5/ld7 0 2024-09-10T10:04:31.174 INFO:tasks.workunit.client.1.smithi107.stdout:7/939: creat d0/d8/dc/d2c/f12e x:0 0 0 2024-09-10T10:04:31.174 INFO:tasks.workunit.client.0.smithi071.stdout:4/789: truncate db/f55 868628 0 2024-09-10T10:04:31.175 INFO:tasks.workunit.client.0.smithi071.stdout:4/790: dread - db/d15/d17/d4e/d5a/f92 zero size 2024-09-10T10:04:31.176 INFO:tasks.workunit.client.0.smithi071.stdout:4/791: write db/d15/fcc [154696,100962] 0 2024-09-10T10:04:31.178 INFO:tasks.workunit.client.0.smithi071.stdout:4/792: readlink db/d15/d17/d4e/d5a/l59 0 2024-09-10T10:04:31.179 INFO:tasks.workunit.client.0.smithi071.stdout:1/914: creat d1/d21/d2f/d30/d75/d97/df1/f140 x:0 0 0 2024-09-10T10:04:31.179 INFO:tasks.workunit.client.1.smithi107.stdout:2/983: mkdir d3/da/df/d20/dfb/d136/d117/d155/d157 0 2024-09-10T10:04:31.180 INFO:tasks.workunit.client.1.smithi107.stdout:9/918: dwrite d5/d7/d1d/d29/fe6 [0,4194304] 0 2024-09-10T10:04:31.183 INFO:tasks.workunit.client.0.smithi071.stdout:4/793: mkdir db/d15/d17/d4e/dc0/dc2/d109 0 2024-09-10T10:04:31.188 INFO:tasks.workunit.client.0.smithi071.stdout:4/794: unlink db/d15/d17/d4e/d5a/d8d/c8e 0 2024-09-10T10:04:31.189 INFO:tasks.workunit.client.1.smithi107.stdout:2/984: symlink d3/da/d1e/d40/d8a/d7f/d55/d85/d7c/l158 0 2024-09-10T10:04:31.189 INFO:tasks.workunit.client.1.smithi107.stdout:8/941: link d5/d8/d66/d8b/d18/d4f/d111/d47/lbd d5/da2/d112/l13b 0 2024-09-10T10:04:31.189 INFO:tasks.workunit.client.1.smithi107.stdout:2/985: readlink d3/da/d1e/d40/d8a/d7f/d55/d85/d7c/lf0 0 2024-09-10T10:04:31.189 INFO:tasks.workunit.client.1.smithi107.stdout:8/942: chown d5/d8/d66/d8b/d1a/laa 69 1 2024-09-10T10:04:31.189 INFO:tasks.workunit.client.1.smithi107.stdout:8/943: dread - d5/d8/d66/d8b/d1a/f11d zero size 2024-09-10T10:04:31.191 INFO:tasks.workunit.client.0.smithi071.stdout:4/795: creat db/d1d/d61/dcd/f10a x:0 0 0 2024-09-10T10:04:31.191 INFO:tasks.workunit.client.1.smithi107.stdout:2/986: dread - d3/da/df/d20/d36/d39/da3/fc9 zero size 2024-09-10T10:04:31.192 INFO:tasks.workunit.client.1.smithi107.stdout:9/919: link d5/d7/d1d/d9b/dab/d57/d87/d37/c12d d5/d7/d1d/d29/d101/c12f 0 2024-09-10T10:04:31.192 INFO:tasks.workunit.client.1.smithi107.stdout:2/987: fdatasync d3/da/df/d20/d36/d39/da3/ddb/d12b/fbd 0 2024-09-10T10:04:31.194 INFO:tasks.workunit.client.1.smithi107.stdout:2/988: dread - d3/da/df/d20/d36/d39/da3/d123/d137/f152 zero size 2024-09-10T10:04:31.194 INFO:tasks.workunit.client.1.smithi107.stdout:8/944: symlink d5/d8/d66/d8b/d18/d4f/l13c 0 2024-09-10T10:04:31.195 INFO:tasks.workunit.client.0.smithi071.stdout:4/796: fsync db/d15/d26/d43/d4d/d77/fbd 0 2024-09-10T10:04:31.195 INFO:tasks.workunit.client.1.smithi107.stdout:2/989: stat d3/da/df/d20/d36/d39/d126 0 2024-09-10T10:04:31.197 INFO:tasks.workunit.client.0.smithi071.stdout:4/797: chown db/d15/d26/db2/lfc 17755309 1 2024-09-10T10:04:31.197 INFO:tasks.workunit.client.0.smithi071.stdout:1/915: dread d1/d21/d2f/ffb [8388608,4194304] 0 2024-09-10T10:04:31.198 INFO:tasks.workunit.client.0.smithi071.stdout:5/903: dread - dc/df/d17/faf zero size 2024-09-10T10:04:31.198 INFO:tasks.workunit.client.1.smithi107.stdout:8/945: unlink d5/d8/d66/d8b/d1a/ce0 0 2024-09-10T10:04:31.200 INFO:tasks.workunit.client.0.smithi071.stdout:5/904: chown dc/df/d3e/d5a/d80/d8a/dda/fe2 997 1 2024-09-10T10:04:31.200 INFO:tasks.workunit.client.0.smithi071.stdout:4/798: creat db/d15/d17/d4e/d5a/d8d/f10b x:0 0 0 2024-09-10T10:04:31.201 INFO:tasks.workunit.client.0.smithi071.stdout:1/916: mkdir d1/d21/d125/d141 0 2024-09-10T10:04:31.204 INFO:tasks.workunit.client.0.smithi071.stdout:4/799: truncate db/d15/d26/d43/d4d/d9f/f96 445903 0 2024-09-10T10:04:31.206 INFO:tasks.workunit.client.1.smithi107.stdout:8/946: dwrite d5/d8/d66/d8b/d21/d83/ff9 [0,4194304] 0 2024-09-10T10:04:31.206 INFO:tasks.workunit.client.0.smithi071.stdout:4/800: chown db/d15/d17/d4e/d5a/d8d 13803 1 2024-09-10T10:04:31.209 INFO:tasks.workunit.client.0.smithi071.stdout:1/917: dwrite d1/d21/d2f/d30/d75/d97/df1/f140 [0,4194304] 0 2024-09-10T10:04:31.211 INFO:tasks.workunit.client.0.smithi071.stdout:1/918: chown d1/d3f/f11a 3255 1 2024-09-10T10:04:31.213 INFO:tasks.workunit.client.0.smithi071.stdout:4/801: symlink db/d15/d26/d43/d4d/d77/dd7/de7/dea/l10c 0 2024-09-10T10:04:31.216 INFO:tasks.workunit.client.1.smithi107.stdout:2/990: write d3/da/d1e/d40/d8a/d7f/d55/fcb [325957,78835] 0 2024-09-10T10:04:31.218 INFO:tasks.workunit.client.0.smithi071.stdout:1/919: creat d1/d21/d3d/d9a/df9/d12e/f142 x:0 0 0 2024-09-10T10:04:31.220 INFO:tasks.workunit.client.0.smithi071.stdout:4/802: rename db/d15/d26/d43/d4d/d9f/da6/cae to db/d1d/d61/c10d 0 2024-09-10T10:04:31.222 INFO:tasks.workunit.client.0.smithi071.stdout:4/803: dread - db/d15/d26/d43/d4d/d77/dd7/fe5 zero size 2024-09-10T10:04:31.225 INFO:tasks.workunit.client.0.smithi071.stdout:4/804: mkdir db/d1d/d61/d6a/d10e 0 2024-09-10T10:04:31.225 INFO:tasks.workunit.client.0.smithi071.stdout:5/905: dread dc/df/d3e/d5a/f71 [0,4194304] 0 2024-09-10T10:04:31.226 INFO:tasks.workunit.client.0.smithi071.stdout:4/805: dread - db/d1d/d61/ffd zero size 2024-09-10T10:04:31.227 INFO:tasks.workunit.client.0.smithi071.stdout:5/906: mknod dc/df/d3e/c133 0 2024-09-10T10:04:31.229 INFO:tasks.workunit.client.0.smithi071.stdout:4/806: link db/d15/d17/d4e/d5a/fd2 db/d1d/f10f 0 2024-09-10T10:04:31.233 INFO:tasks.workunit.client.0.smithi071.stdout:4/807: unlink db/d15/d26/d43/d4d/d77/dd7/fe5 0 2024-09-10T10:04:31.236 INFO:tasks.workunit.client.0.smithi071.stdout:4/808: creat db/d15/d17/d4e/f110 x:0 0 0 2024-09-10T10:04:31.236 INFO:tasks.workunit.client.0.smithi071.stdout:4/809: chown db/lf 1487508049 1 2024-09-10T10:04:31.240 INFO:tasks.workunit.client.0.smithi071.stdout:4/810: rename db/d15/d17/d24/c32 to db/d1d/d61/d6a/c111 0 2024-09-10T10:04:31.241 INFO:tasks.workunit.client.0.smithi071.stdout:5/907: truncate dc/df/dd7/d87/f92 300726 0 2024-09-10T10:04:31.242 INFO:tasks.workunit.client.0.smithi071.stdout:4/811: mknod db/d15/d17/d4e/d5a/c112 0 2024-09-10T10:04:31.242 INFO:tasks.workunit.client.0.smithi071.stdout:1/920: dread d1/d35/fa8 [0,4194304] 0 2024-09-10T10:04:31.244 INFO:tasks.workunit.client.0.smithi071.stdout:1/921: truncate d1/d21/d2f/d30/f127 279608 0 2024-09-10T10:04:31.245 INFO:tasks.workunit.client.0.smithi071.stdout:1/922: chown d1/d21/d3d/f105 3559 1 2024-09-10T10:04:31.247 INFO:tasks.workunit.client.0.smithi071.stdout:1/923: dread d1/d3f/f11a [0,4194304] 0 2024-09-10T10:04:31.249 INFO:tasks.workunit.client.0.smithi071.stdout:4/812: write db/d1d/faa [981920,6178] 0 2024-09-10T10:04:31.252 INFO:tasks.workunit.client.0.smithi071.stdout:4/813: mkdir db/d15/d17/d113 0 2024-09-10T10:04:31.256 INFO:tasks.workunit.client.0.smithi071.stdout:4/814: rename db/d15/d17/d4e/d5a/ff4 to db/d1d/d61/d6a/d88/f114 0 2024-09-10T10:04:31.259 INFO:tasks.workunit.client.0.smithi071.stdout:1/924: dread d1/d21/f24 [0,4194304] 0 2024-09-10T10:04:31.259 INFO:tasks.workunit.client.0.smithi071.stdout:4/815: mknod db/d15/d17/d4e/dc0/dc2/c115 0 2024-09-10T10:04:31.259 INFO:tasks.workunit.client.1.smithi107.stdout:8/947: link d5/d8/d66/d8b/d1a/ca0 d5/d8/d66/d8b/d18/d4f/d111/d35/d85/d119/c13d 0 2024-09-10T10:04:31.260 INFO:tasks.workunit.client.1.smithi107.stdout:8/948: readlink d5/d8/d66/d8b/d18/dab/lad 0 2024-09-10T10:04:31.260 INFO:tasks.workunit.client.1.smithi107.stdout:8/949: stat d5/d8/d5b/fb0 0 2024-09-10T10:04:31.261 INFO:tasks.workunit.client.0.smithi071.stdout:4/816: mknod db/c116 0 2024-09-10T10:04:31.262 INFO:tasks.workunit.client.0.smithi071.stdout:5/908: dread dc/df/d3e/f63 [4194304,4194304] 0 2024-09-10T10:04:31.263 INFO:tasks.workunit.client.0.smithi071.stdout:1/925: rename d1/d21/f61 to d1/d70/d76/dd4/dfe/f143 0 2024-09-10T10:04:31.264 INFO:tasks.workunit.client.0.smithi071.stdout:1/926: chown d1/cd9 653 1 2024-09-10T10:04:31.266 INFO:tasks.workunit.client.0.smithi071.stdout:1/927: creat d1/d3f/d115/f144 x:0 0 0 2024-09-10T10:04:31.266 INFO:tasks.workunit.client.0.smithi071.stdout:5/909: rename dc/d53/c6e to dc/df/d17/c134 0 2024-09-10T10:04:31.266 INFO:tasks.workunit.client.0.smithi071.stdout:4/817: dread db/d15/d17/d4e/fce [0,4194304] 0 2024-09-10T10:04:31.267 INFO:tasks.workunit.client.0.smithi071.stdout:5/910: stat dc/df/d29/d48/c84 0 2024-09-10T10:04:31.267 INFO:tasks.workunit.client.1.smithi107.stdout:8/950: link d5/d8/l39 d5/d8/d66/d8b/d18/da4/l13e 0 2024-09-10T10:04:31.268 INFO:tasks.workunit.client.0.smithi071.stdout:4/818: creat db/d8f/f117 x:0 0 0 2024-09-10T10:04:31.268 INFO:tasks.workunit.client.0.smithi071.stdout:5/911: dread - dc/df/d3e/d5a/d80/ff1 zero size 2024-09-10T10:04:31.269 INFO:tasks.workunit.client.1.smithi107.stdout:8/951: truncate d5/d8/d66/d8b/d21/d83/ffc 274307 0 2024-09-10T10:04:31.270 INFO:tasks.workunit.client.0.smithi071.stdout:1/928: creat d1/d21/d3d/d9a/df9/f145 x:0 0 0 2024-09-10T10:04:31.271 INFO:tasks.workunit.client.0.smithi071.stdout:4/819: truncate db/d15/d17/f75 474698 0 2024-09-10T10:04:31.271 INFO:tasks.workunit.client.1.smithi107.stdout:8/952: unlink d5/d8/d66/d8e/f122 0 2024-09-10T10:04:31.272 INFO:tasks.workunit.client.0.smithi071.stdout:5/912: mkdir dc/df/d17/d8d/d135 0 2024-09-10T10:04:31.272 INFO:tasks.workunit.client.0.smithi071.stdout:3/944: sync 2024-09-10T10:04:31.272 INFO:tasks.workunit.client.0.smithi071.stdout:8/918: sync 2024-09-10T10:04:31.272 INFO:tasks.workunit.client.1.smithi107.stdout:8/953: fsync d5/d8/d66/d8b/d1a/d71/f10d 0 2024-09-10T10:04:31.275 INFO:tasks.workunit.client.0.smithi071.stdout:4/820: read db/d15/d17/d4e/d5a/dd3/fd9 [378302,54809] 0 2024-09-10T10:04:31.277 INFO:tasks.workunit.client.0.smithi071.stdout:1/929: dwrite d1/d21/d3d/d9a/df9/f145 [0,4194304] 0 2024-09-10T10:04:31.278 INFO:tasks.workunit.client.0.smithi071.stdout:5/913: rename dc/d4a/f10f to dc/df/d3e/f136 0 2024-09-10T10:04:31.279 INFO:tasks.workunit.client.1.smithi107.stdout:8/954: dwrite d5/f79 [0,4194304] 0 2024-09-10T10:04:31.281 INFO:tasks.workunit.client.0.smithi071.stdout:1/930: dread d1/d35/dea/d110/f12a [0,4194304] 0 2024-09-10T10:04:31.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:30 smithi071 ceph-mon[27559]: Standby manager daemon smithi071.gtqytr started 2024-09-10T10:04:31.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:30 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.71:0/4224278399' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi071.gtqytr/crt"}]: dispatch 2024-09-10T10:04:31.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:30 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.71:0/4224278399' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:04:31.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:30 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.71:0/4224278399' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi071.gtqytr/key"}]: dispatch 2024-09-10T10:04:31.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:30 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.71:0/4224278399' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:04:31.289 INFO:tasks.workunit.client.0.smithi071.stdout:8/919: write d5/df/d1e/d38/f42 [466542,22214] 0 2024-09-10T10:04:31.291 INFO:tasks.workunit.client.0.smithi071.stdout:5/914: write dc/df/f19 [531672,58143] 0 2024-09-10T10:04:31.291 INFO:tasks.workunit.client.0.smithi071.stdout:5/915: chown dc/df/f38 1457869 1 2024-09-10T10:04:31.295 INFO:tasks.workunit.client.0.smithi071.stdout:5/916: symlink dc/df/d3e/d5a/dd4/l137 0 2024-09-10T10:04:31.297 INFO:tasks.workunit.client.0.smithi071.stdout:5/917: creat dc/df/d3e/d5a/d80/d8a/dda/f138 x:0 0 0 2024-09-10T10:04:31.299 INFO:tasks.workunit.client.0.smithi071.stdout:5/918: chown dc/df/d3e/d5a/d80/ff1 30566160 1 2024-09-10T10:04:31.299 INFO:tasks.workunit.client.0.smithi071.stdout:5/919: stat dc/f31 0 2024-09-10T10:04:31.300 INFO:tasks.workunit.client.0.smithi071.stdout:5/920: dread - dc/df/da6/fe9 zero size 2024-09-10T10:04:31.302 INFO:tasks.workunit.client.0.smithi071.stdout:1/931: write d1/d21/f98 [1645479,6725] 0 2024-09-10T10:04:31.306 INFO:tasks.workunit.client.0.smithi071.stdout:1/932: symlink d1/d21/d3d/d9a/df9/d12e/l146 0 2024-09-10T10:04:31.306 INFO:tasks.workunit.client.0.smithi071.stdout:8/920: write d5/df/d1d/d86/f3e [287460,127244] 0 2024-09-10T10:04:31.308 INFO:tasks.workunit.client.0.smithi071.stdout:1/933: mkdir d1/d21/d3d/d147 0 2024-09-10T10:04:31.309 INFO:tasks.workunit.client.0.smithi071.stdout:8/921: rmdir d5/df/d1d/d81/d10c 39 2024-09-10T10:04:31.311 INFO:tasks.workunit.client.0.smithi071.stdout:8/922: readlink d5/df/d1d/d86/d90/db4/ldd 0 2024-09-10T10:04:31.311 INFO:tasks.workunit.client.1.smithi107.stdout:8/955: dread d5/d8/d66/d8b/d1a/d64/db9/fbf [0,4194304] 0 2024-09-10T10:04:31.312 INFO:tasks.workunit.client.0.smithi071.stdout:5/921: dwrite dc/df/d3e/f52 [0,4194304] 0 2024-09-10T10:04:31.313 INFO:tasks.workunit.client.0.smithi071.stdout:8/923: fdatasync d5/df/d1d/d86/d75/d85/f110 0 2024-09-10T10:04:31.315 INFO:tasks.workunit.client.0.smithi071.stdout:8/924: fdatasync d5/df/df7/f107 0 2024-09-10T10:04:31.315 INFO:tasks.workunit.client.0.smithi071.stdout:1/934: truncate d1/d3f/d58/f12d 1175052 0 2024-09-10T10:04:31.315 INFO:tasks.workunit.client.0.smithi071.stdout:8/925: chown d5/df/d57/d82/f84 942387841 1 2024-09-10T10:04:31.316 INFO:tasks.workunit.client.1.smithi107.stdout:8/956: fsync d5/d8/d66/d8b/d18/d4f/d111/d35/d70/f95 0 2024-09-10T10:04:31.318 INFO:tasks.workunit.client.0.smithi071.stdout:5/922: write dc/df/dd7/f7d [5210687,49592] 0 2024-09-10T10:04:31.319 INFO:tasks.workunit.client.0.smithi071.stdout:5/923: stat dc/d53/f123 0 2024-09-10T10:04:31.320 INFO:tasks.workunit.client.1.smithi107.stdout:8/957: unlink d5/d8/d66/d8b/d1a/d64/db9/l102 0 2024-09-10T10:04:31.322 INFO:tasks.workunit.client.0.smithi071.stdout:8/926: creat d5/df/d1d/d86/d75/dcd/d115/d140/f141 x:0 0 0 2024-09-10T10:04:31.323 INFO:tasks.workunit.client.0.smithi071.stdout:8/927: fdatasync d5/df/ff2 0 2024-09-10T10:04:31.323 INFO:tasks.workunit.client.0.smithi071.stdout:5/924: rename dc/df/d3e/d5a/d80/f10b to dc/df/d29/d94/f139 0 2024-09-10T10:04:31.324 INFO:tasks.workunit.client.0.smithi071.stdout:8/928: chown d5/df/d1d/d86/d75/d85/f13c 63 1 2024-09-10T10:04:31.325 INFO:tasks.workunit.client.0.smithi071.stdout:5/925: truncate dc/df/f38 4913801 0 2024-09-10T10:04:31.326 INFO:tasks.workunit.client.0.smithi071.stdout:5/926: write dc/df/d17/fa2 [1730076,33504] 0 2024-09-10T10:04:31.334 INFO:tasks.workunit.client.0.smithi071.stdout:1/935: write d1/d21/d65/fa5 [128993,29339] 0 2024-09-10T10:04:31.334 INFO:tasks.workunit.client.0.smithi071.stdout:5/927: rmdir dc/df/d3e 39 2024-09-10T10:04:31.334 INFO:tasks.workunit.client.1.smithi107.stdout:8/958: write d5/d8/d66/d8b/d18/d4f/d111/d47/f53 [5872721,107458] 0 2024-09-10T10:04:31.337 INFO:tasks.workunit.client.0.smithi071.stdout:8/929: dread d5/df/d1d/d86/d90/d109/fc6 [0,4194304] 0 2024-09-10T10:04:31.338 INFO:tasks.workunit.client.0.smithi071.stdout:5/928: creat dc/df/f13a x:0 0 0 2024-09-10T10:04:31.340 INFO:tasks.workunit.client.1.smithi107.stdout:8/959: dwrite d5/d8/d66/d8b/d21/d83/ff5 [0,4194304] 0 2024-09-10T10:04:31.340 INFO:tasks.workunit.client.0.smithi071.stdout:1/936: write d1/d3f/d58/fe5 [4695219,25723] 0 2024-09-10T10:04:31.344 INFO:tasks.workunit.client.1.smithi107.stdout:8/960: symlink d5/d8/d66/d8b/d1a/da3/l13f 0 2024-09-10T10:04:31.345 INFO:tasks.workunit.client.0.smithi071.stdout:5/929: creat dc/df/d3e/f13b x:0 0 0 2024-09-10T10:04:31.345 INFO:tasks.workunit.client.0.smithi071.stdout:1/937: mkdir d1/d3f/d115/d148 0 2024-09-10T10:04:31.346 INFO:tasks.workunit.client.0.smithi071.stdout:8/930: dwrite d5/f19 [0,4194304] 0 2024-09-10T10:04:31.349 INFO:tasks.workunit.client.0.smithi071.stdout:1/938: symlink d1/d70/d76/l149 0 2024-09-10T10:04:31.351 INFO:tasks.workunit.client.0.smithi071.stdout:8/931: stat d5/df/d1d/d86/d75/cfb 0 2024-09-10T10:04:31.352 INFO:tasks.workunit.client.1.smithi107.stdout:8/961: dwrite d5/d8/d66/d8b/d18/da4/f11a [0,4194304] 0 2024-09-10T10:04:31.352 INFO:tasks.workunit.client.0.smithi071.stdout:1/939: creat d1/d70/d76/dd4/dfe/f14a x:0 0 0 2024-09-10T10:04:31.354 INFO:tasks.workunit.client.1.smithi107.stdout:8/962: rmdir d5/d8/d66/d8b/d21/d83 39 2024-09-10T10:04:31.357 INFO:tasks.workunit.client.1.smithi107.stdout:8/963: dread - d5/da2/f11c zero size 2024-09-10T10:04:31.358 INFO:tasks.workunit.client.0.smithi071.stdout:8/932: rename d5/df/d1d/d86/d90/f10b to d5/df/d1d/d86/d90/d109/f142 0 2024-09-10T10:04:31.359 INFO:tasks.workunit.client.1.smithi107.stdout:8/964: readlink d5/d8/d66/d8b/d18/dab/lad 0 2024-09-10T10:04:31.362 INFO:tasks.workunit.client.0.smithi071.stdout:8/933: symlink d5/df/d1d/d86/d75/dcd/l143 0 2024-09-10T10:04:31.364 INFO:tasks.workunit.client.1.smithi107.stdout:8/965: link d5/d8/d66/d8b/d1a/d75/fac d5/d42/ddb/f140 0 2024-09-10T10:04:31.367 INFO:tasks.workunit.client.0.smithi071.stdout:8/934: creat d5/df/d1d/d86/d75/d85/f144 x:0 0 0 2024-09-10T10:04:31.368 INFO:tasks.workunit.client.1.smithi107.stdout:8/966: unlink d5/d8/d66/d8b/d21/fb3 0 2024-09-10T10:04:31.369 INFO:tasks.workunit.client.0.smithi071.stdout:8/935: creat d5/df/d1e/d38/d9f/f145 x:0 0 0 2024-09-10T10:04:31.370 INFO:tasks.workunit.client.1.smithi107.stdout:8/967: symlink d5/d8/d66/d8b/d18/d4f/d111/d35/d85/l141 0 2024-09-10T10:04:31.372 INFO:tasks.workunit.client.1.smithi107.stdout:8/968: dread - d5/d42/ddb/fe4 zero size 2024-09-10T10:04:31.372 INFO:tasks.workunit.client.1.smithi107.stdout:8/969: chown d5/d8/d5b 586104938 1 2024-09-10T10:04:31.373 INFO:tasks.workunit.client.0.smithi071.stdout:5/930: dread dc/df/d17/f2b [0,4194304] 0 2024-09-10T10:04:31.373 INFO:tasks.workunit.client.1.smithi107.stdout:8/970: truncate d5/d8/fe7 744818 0 2024-09-10T10:04:31.374 INFO:tasks.workunit.client.1.smithi107.stdout:8/971: write d5/d8/f13 [2406252,107873] 0 2024-09-10T10:04:31.375 INFO:tasks.workunit.client.0.smithi071.stdout:1/940: dread d1/d3f/d58/daf/ddc/d139/f13c [0,4194304] 0 2024-09-10T10:04:31.375 INFO:tasks.workunit.client.0.smithi071.stdout:5/931: unlink dc/d53/db2/f8f 0 2024-09-10T10:04:31.375 INFO:tasks.workunit.client.0.smithi071.stdout:1/941: readlink d1/d3f/lc7 0 2024-09-10T10:04:31.377 INFO:tasks.workunit.client.0.smithi071.stdout:5/932: mkdir dc/df/d3e/d5a/d80/d8a/d13c 0 2024-09-10T10:04:31.378 INFO:tasks.workunit.client.0.smithi071.stdout:8/936: truncate d5/df/d1d/d86/f29 20456 0 2024-09-10T10:04:31.378 INFO:tasks.workunit.client.0.smithi071.stdout:5/933: stat dc/df/dd7/c2e 0 2024-09-10T10:04:31.379 INFO:tasks.workunit.client.0.smithi071.stdout:1/942: creat d1/d21/d2f/d30/d6a/d91/f14b x:0 0 0 2024-09-10T10:04:31.380 INFO:tasks.workunit.client.0.smithi071.stdout:5/934: fdatasync dc/df/ff4 0 2024-09-10T10:04:31.381 INFO:tasks.workunit.client.0.smithi071.stdout:8/937: creat d5/df/f146 x:0 0 0 2024-09-10T10:04:31.385 INFO:tasks.workunit.client.0.smithi071.stdout:5/935: rename dc/df/f38 to dc/d4a/f13d 0 2024-09-10T10:04:31.386 INFO:tasks.workunit.client.0.smithi071.stdout:1/943: write d1/f2e [1161120,85245] 0 2024-09-10T10:04:31.387 INFO:tasks.workunit.client.1.smithi107.stdout:8/972: write d5/d8/d66/d8b/d18/d4f/f5c [1585838,16331] 0 2024-09-10T10:04:31.387 INFO:tasks.workunit.client.0.smithi071.stdout:1/944: chown d1/d57/dbf/lf6 0 1 2024-09-10T10:04:31.389 INFO:tasks.workunit.client.0.smithi071.stdout:5/936: mkdir dc/df/d3e/d5a/d80/d8a/d13c/d13e 0 2024-09-10T10:04:31.390 INFO:tasks.workunit.client.0.smithi071.stdout:1/945: unlink d1/d21/d2f/d30/d6a/c56 0 2024-09-10T10:04:31.390 INFO:tasks.workunit.client.0.smithi071.stdout:8/938: truncate d5/df/d1e/d38/f48 365793 0 2024-09-10T10:04:31.394 INFO:tasks.workunit.client.0.smithi071.stdout:5/937: dread dc/df/d3e/d5a/f71 [0,4194304] 0 2024-09-10T10:04:31.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:30 smithi107 ceph-mon[34215]: Standby manager daemon smithi071.gtqytr started 2024-09-10T10:04:31.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:30 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.71:0/4224278399' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi071.gtqytr/crt"}]: dispatch 2024-09-10T10:04:31.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:30 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.71:0/4224278399' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:04:31.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:30 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.71:0/4224278399' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi071.gtqytr/key"}]: dispatch 2024-09-10T10:04:31.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:30 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.71:0/4224278399' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:04:31.396 INFO:tasks.workunit.client.0.smithi071.stdout:1/946: dwrite d1/f2e [0,4194304] 0 2024-09-10T10:04:31.397 INFO:tasks.workunit.client.0.smithi071.stdout:5/938: read dc/d53/f7f [412073,125536] 0 2024-09-10T10:04:31.398 INFO:tasks.workunit.client.0.smithi071.stdout:8/939: dwrite d5/df/d1d/d86/d75/f121 [0,4194304] 0 2024-09-10T10:04:31.400 INFO:tasks.workunit.client.0.smithi071.stdout:8/940: chown d5/df/d57/d82 222691 1 2024-09-10T10:04:31.405 INFO:tasks.workunit.client.0.smithi071.stdout:1/947: rename d1/d3f/d58/daf/l9f to d1/d21/d2f/d30/l14c 0 2024-09-10T10:04:31.408 INFO:tasks.workunit.client.0.smithi071.stdout:5/939: dwrite dc/df/d3e/f124 [0,4194304] 0 2024-09-10T10:04:31.410 INFO:tasks.workunit.client.0.smithi071.stdout:5/940: readlink dc/df/d29/l4f 0 2024-09-10T10:04:31.417 INFO:tasks.workunit.client.0.smithi071.stdout:8/941: dwrite d5/df/d57/f8a [0,4194304] 0 2024-09-10T10:04:31.420 INFO:tasks.workunit.client.0.smithi071.stdout:8/942: mkdir d5/d136/d147 0 2024-09-10T10:04:31.422 INFO:tasks.workunit.client.0.smithi071.stdout:8/943: creat d5/df/d1d/d86/d75/dcd/f148 x:0 0 0 2024-09-10T10:04:31.429 INFO:tasks.workunit.client.0.smithi071.stdout:1/948: write d1/d21/d3d/d4a/fa6 [1673038,7910] 0 2024-09-10T10:04:31.433 INFO:tasks.workunit.client.0.smithi071.stdout:1/949: readlink d1/d21/d3d/d9a/df9/de4/db6/lfa 0 2024-09-10T10:04:31.434 INFO:tasks.workunit.client.0.smithi071.stdout:5/941: dwrite dc/fe [0,4194304] 0 2024-09-10T10:04:31.436 INFO:tasks.workunit.client.0.smithi071.stdout:1/950: creat d1/d57/f14d x:0 0 0 2024-09-10T10:04:31.437 INFO:tasks.workunit.client.0.smithi071.stdout:1/951: chown d1/d21/d3d/d9a/d101 17 1 2024-09-10T10:04:31.439 INFO:tasks.workunit.client.0.smithi071.stdout:1/952: symlink d1/d21/d3d/d9a/d72/dfd/l14e 0 2024-09-10T10:04:31.439 INFO:tasks.workunit.client.0.smithi071.stdout:5/942: link dc/df/d29/c65 dc/df/c13f 0 2024-09-10T10:04:31.441 INFO:tasks.workunit.client.0.smithi071.stdout:1/953: creat d1/d21/d3d/d9a/f14f x:0 0 0 2024-09-10T10:04:31.441 INFO:tasks.workunit.client.0.smithi071.stdout:5/943: symlink dc/df/d3e/d5a/d80/d8a/dda/l140 0 2024-09-10T10:04:31.442 INFO:tasks.workunit.client.0.smithi071.stdout:1/954: fdatasync d1/d21/d2f/d30/d6a/d91/f14b 0 2024-09-10T10:04:31.442 INFO:tasks.workunit.client.0.smithi071.stdout:5/944: chown dc/d53/d6a 41 1 2024-09-10T10:04:31.443 INFO:tasks.workunit.client.0.smithi071.stdout:5/945: fsync dc/df/d3e/f124 0 2024-09-10T10:04:31.445 INFO:tasks.workunit.client.0.smithi071.stdout:1/955: creat d1/d21/d3d/d9a/d72/f150 x:0 0 0 2024-09-10T10:04:31.447 INFO:tasks.workunit.client.0.smithi071.stdout:1/956: fdatasync d1/f9 0 2024-09-10T10:04:31.448 INFO:tasks.workunit.client.0.smithi071.stdout:1/957: truncate d1/d21/d65/fce 589315 0 2024-09-10T10:04:31.450 INFO:tasks.workunit.client.0.smithi071.stdout:1/958: mknod d1/d35/dea/d110/c151 0 2024-09-10T10:04:31.473 INFO:tasks.workunit.client.1.smithi107.stdout:0/971: sync 2024-09-10T10:04:31.477 INFO:tasks.workunit.client.1.smithi107.stdout:0/972: write d6/d5a/f108 [206400,123047] 0 2024-09-10T10:04:31.481 INFO:tasks.workunit.client.1.smithi107.stdout:0/973: write d6/d5a/f10b [591034,24804] 0 2024-09-10T10:04:31.482 INFO:tasks.workunit.client.1.smithi107.stdout:0/974: chown d6/d8e/lca 30252354 1 2024-09-10T10:04:31.483 INFO:tasks.workunit.client.1.smithi107.stdout:0/975: mkdir d6/d8/d2f/d2e/d32/d95/d113/d141 0 2024-09-10T10:04:31.485 INFO:tasks.workunit.client.1.smithi107.stdout:0/976: rmdir d6/d8/d2f/d6e/dc5/ddb 39 2024-09-10T10:04:31.489 INFO:tasks.workunit.client.1.smithi107.stdout:0/977: write d6/d8/d2f/d35/d3c/d58/d69/d84/f12b [11641903,130887] 0 2024-09-10T10:04:31.489 INFO:tasks.workunit.client.1.smithi107.stdout:0/978: write d6/d8/d2f/da3/f109 [126687,53672] 0 2024-09-10T10:04:31.492 INFO:tasks.workunit.client.1.smithi107.stdout:0/979: creat d6/d8/d2f/d2e/d32/d135/d8a/f142 x:0 0 0 2024-09-10T10:04:31.494 INFO:tasks.workunit.client.1.smithi107.stdout:0/980: getdents d6/d8/d2f/d2e/d32/d95/d113/d141 0 2024-09-10T10:04:31.495 INFO:tasks.workunit.client.1.smithi107.stdout:0/981: fsync d6/d8/d2f/d2e/d32/d56/ddf/f117 0 2024-09-10T10:04:31.497 INFO:tasks.workunit.client.1.smithi107.stdout:0/982: creat d6/d8/d2f/d2e/d32/d95/dce/de1/f143 x:0 0 0 2024-09-10T10:04:31.498 INFO:tasks.workunit.client.1.smithi107.stdout:0/983: getdents d6/d14/d139 0 2024-09-10T10:04:31.500 INFO:tasks.workunit.client.1.smithi107.stdout:0/984: truncate d6/d8/d2f/d2e/d32/d56/ddf/f117 612029 0 2024-09-10T10:04:31.501 INFO:tasks.workunit.client.1.smithi107.stdout:0/985: chown d6/d8/d2f/da3/dee/f124 761298390 1 2024-09-10T10:04:31.507 INFO:tasks.workunit.client.1.smithi107.stdout:0/986: dwrite d6/d8/d2f/d6e/f9d [0,4194304] 0 2024-09-10T10:04:31.512 INFO:tasks.workunit.client.1.smithi107.stdout:0/987: fdatasync d6/d5a/f127 0 2024-09-10T10:04:31.528 INFO:tasks.workunit.client.1.smithi107.stdout:0/988: dwrite d6/d8/d2f/d35/d3c/d58/d69/f88 [0,4194304] 0 2024-09-10T10:04:31.531 INFO:tasks.workunit.client.1.smithi107.stdout:0/989: creat d6/d8/d2f/d35/d3c/d58/d86/f144 x:0 0 0 2024-09-10T10:04:31.552 INFO:tasks.workunit.client.1.smithi107.stdout:0/990: dread d6/d8/ff9 [0,4194304] 0 2024-09-10T10:04:31.553 INFO:tasks.workunit.client.1.smithi107.stdout:0/991: fdatasync d6/d8/d2f/da3/f109 0 2024-09-10T10:04:31.553 INFO:tasks.workunit.client.1.smithi107.stdout:0/992: write d6/d8/d2f/d6e/f9d [7571165,22720] 0 2024-09-10T10:04:31.560 INFO:tasks.workunit.client.1.smithi107.stdout:0/993: dwrite d6/d14/f99 [0,4194304] 0 2024-09-10T10:04:31.563 INFO:tasks.workunit.client.1.smithi107.stdout:0/994: creat d6/d8/d2f/d2e/d7b/d129/f145 x:0 0 0 2024-09-10T10:04:31.564 INFO:tasks.workunit.client.1.smithi107.stdout:0/995: rmdir d6/d8e 39 2024-09-10T10:04:31.566 INFO:tasks.workunit.client.1.smithi107.stdout:0/996: mkdir d6/d14/d139/d146 0 2024-09-10T10:04:31.568 INFO:tasks.workunit.client.1.smithi107.stdout:7/940: sync 2024-09-10T10:04:31.575 INFO:tasks.workunit.client.1.smithi107.stdout:7/941: truncate d0/d8/dc/ff6 372576 0 2024-09-10T10:04:31.576 INFO:tasks.workunit.client.1.smithi107.stdout:7/942: dread - d0/d8/d56/dcc/da0/fdb zero size 2024-09-10T10:04:31.577 INFO:tasks.workunit.client.1.smithi107.stdout:7/943: chown d0/d8/d56/dcc/de7/ff4 67 1 2024-09-10T10:04:31.578 INFO:tasks.workunit.client.1.smithi107.stdout:7/944: readlink d0/d20/d35/l3e 0 2024-09-10T10:04:31.578 INFO:tasks.workunit.client.1.smithi107.stdout:7/945: chown d0/d20/d72/fe6 14581 1 2024-09-10T10:04:31.579 INFO:tasks.workunit.client.1.smithi107.stdout:7/946: chown d0/d8/d56/f10c 0 1 2024-09-10T10:04:31.581 INFO:tasks.workunit.client.1.smithi107.stdout:7/947: creat d0/dff/f12f x:0 0 0 2024-09-10T10:04:31.581 INFO:tasks.workunit.client.1.smithi107.stdout:7/948: chown d0 3 1 2024-09-10T10:04:31.586 INFO:tasks.workunit.client.1.smithi107.stdout:7/949: write d0/d8/dc/ff6 [83343,28290] 0 2024-09-10T10:04:31.588 INFO:tasks.workunit.client.1.smithi107.stdout:7/950: mknod d0/c130 0 2024-09-10T10:04:31.589 INFO:tasks.workunit.client.1.smithi107.stdout:7/951: rmdir d0/d20/ddd 39 2024-09-10T10:04:31.592 INFO:tasks.workunit.client.1.smithi107.stdout:7/952: rename d0/d8/d5c/fae to d0/d1b/d4d/d69/d97/d95/d12b/f131 0 2024-09-10T10:04:31.593 INFO:tasks.workunit.client.1.smithi107.stdout:7/953: write d0/d8/d5c/d6d/fbf [62692,1784] 0 2024-09-10T10:04:31.594 INFO:tasks.workunit.client.1.smithi107.stdout:7/954: mkdir d0/dff/d132 0 2024-09-10T10:04:31.596 INFO:tasks.workunit.client.1.smithi107.stdout:7/955: rename d0/dff/f116 to d0/d8/d5c/d6d/f133 0 2024-09-10T10:04:31.598 INFO:tasks.workunit.client.1.smithi107.stdout:7/956: mkdir d0/d8/d56/dcc/d81/d134 0 2024-09-10T10:04:31.599 INFO:tasks.workunit.client.1.smithi107.stdout:7/957: creat d0/d8/d56/d5d/f135 x:0 0 0 2024-09-10T10:04:31.602 INFO:tasks.workunit.client.1.smithi107.stdout:7/958: dread d0/d20/d35/ffa [0,4194304] 0 2024-09-10T10:04:31.602 INFO:tasks.workunit.client.1.smithi107.stdout:7/959: chown d0/d1b/d4d/d126 9 1 2024-09-10T10:04:31.604 INFO:tasks.workunit.client.1.smithi107.stdout:7/960: symlink d0/d8/d56/dcc/d81/dbc/l136 0 2024-09-10T10:04:31.605 INFO:tasks.workunit.client.1.smithi107.stdout:7/961: mkdir d0/d8/dc/d137 0 2024-09-10T10:04:31.619 INFO:tasks.workunit.client.1.smithi107.stdout:7/962: dread d0/d8/d56/f8e [0,4194304] 0 2024-09-10T10:04:31.652 INFO:tasks.workunit.client.0.smithi071.stdout:6/786: sync 2024-09-10T10:04:31.654 INFO:tasks.workunit.client.0.smithi071.stdout:6/787: stat d4/da/df/d2e/cc4 0 2024-09-10T10:04:31.656 INFO:tasks.workunit.client.0.smithi071.stdout:6/788: creat d4/da/df/d2e/d3a/d91/f105 x:0 0 0 2024-09-10T10:04:31.657 INFO:tasks.workunit.client.0.smithi071.stdout:6/789: chown d4/da/df/d2e/d3a/d91/dc7/d81/db1 224459070 1 2024-09-10T10:04:31.661 INFO:tasks.workunit.client.0.smithi071.stdout:6/790: dwrite d4/da/df/d2e/d3a/d51/fc0 [0,4194304] 0 2024-09-10T10:04:31.663 INFO:tasks.workunit.client.0.smithi071.stdout:6/791: symlink d4/da/df/l106 0 2024-09-10T10:04:31.669 INFO:tasks.workunit.client.0.smithi071.stdout:6/792: link d4/da/df/d2e/d3a/d40/d60/d7a/dbd/f100 d4/da/df/d2e/d3a/d91/dc7/d81/d95/f107 0 2024-09-10T10:04:31.670 INFO:tasks.workunit.client.0.smithi071.stdout:6/793: dread - d4/da/df/d5e/fd8 zero size 2024-09-10T10:04:31.674 INFO:tasks.workunit.client.0.smithi071.stdout:6/794: rename d4/da/df/d2e/d3a/da9/dbc/dc3 to d4/da/df/d2e/d3a/d51/d108 0 2024-09-10T10:04:31.692 INFO:tasks.workunit.client.0.smithi071.stdout:6/795: truncate d4/f6c 3175745 0 2024-09-10T10:04:31.695 INFO:tasks.workunit.client.0.smithi071.stdout:6/796: rename d4/da/df/d2e/d3a/f66 to d4/da/df/d2e/d3a/d91/dc7/f109 0 2024-09-10T10:04:31.697 INFO:tasks.workunit.client.0.smithi071.stdout:6/797: creat d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/df9/f10a x:0 0 0 2024-09-10T10:04:31.700 INFO:tasks.workunit.client.0.smithi071.stdout:6/798: rename d4/da/df/c6d to d4/da/df/d2e/d3a/d40/d60/d7a/dbd/c10b 0 2024-09-10T10:04:31.706 INFO:tasks.workunit.client.0.smithi071.stdout:6/799: truncate d4/d61/d83/da8/f71 489872 0 2024-09-10T10:04:31.711 INFO:tasks.workunit.client.0.smithi071.stdout:6/800: dwrite d4/da/df/d2e/d3a/f74 [4194304,4194304] 0 2024-09-10T10:04:31.716 INFO:tasks.workunit.client.0.smithi071.stdout:6/801: rename d4/d1c to d4/da/df/d2e/d10c 0 2024-09-10T10:04:31.718 INFO:tasks.workunit.client.0.smithi071.stdout:6/802: fsync d4/d61/f69 0 2024-09-10T10:04:31.720 INFO:tasks.workunit.client.0.smithi071.stdout:6/803: unlink d4/d61/d83/da8/f5c 0 2024-09-10T10:04:31.722 INFO:tasks.workunit.client.0.smithi071.stdout:6/804: rmdir d4/da/df/d2e/d10c/d101 0 2024-09-10T10:04:31.725 INFO:tasks.workunit.client.0.smithi071.stdout:6/805: truncate d4/da/df/d2e/d3a/d40/d60/fbf 718580 0 2024-09-10T10:04:31.727 INFO:tasks.workunit.client.0.smithi071.stdout:6/806: write d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/fe0 [4783115,9450] 0 2024-09-10T10:04:31.744 INFO:tasks.workunit.client.1.smithi107.stdout:8/973: sync 2024-09-10T10:04:31.744 INFO:tasks.workunit.client.1.smithi107.stdout:2/991: sync 2024-09-10T10:04:31.744 INFO:tasks.workunit.client.1.smithi107.stdout:9/920: sync 2024-09-10T10:04:31.748 INFO:tasks.workunit.client.1.smithi107.stdout:2/992: creat d3/da/f159 x:0 0 0 2024-09-10T10:04:31.750 INFO:tasks.workunit.client.1.smithi107.stdout:8/974: getdents d5/d8/d66/d8b/d1a/d64/db9 0 2024-09-10T10:04:31.752 INFO:tasks.workunit.client.1.smithi107.stdout:2/993: creat d3/da/d1e/d40/f15a x:0 0 0 2024-09-10T10:04:31.753 INFO:tasks.workunit.client.1.smithi107.stdout:9/921: truncate d5/d7/f9 2813912 0 2024-09-10T10:04:31.754 INFO:tasks.workunit.client.1.smithi107.stdout:9/922: truncate d5/d1e/f117 365568 0 2024-09-10T10:04:31.755 INFO:tasks.workunit.client.1.smithi107.stdout:2/994: truncate d3/da/d1e/d40/d8a/d7f/d55/fba 2099678 0 2024-09-10T10:04:31.756 INFO:tasks.workunit.client.1.smithi107.stdout:9/923: chown d5/d7/d1d/d41/d83/d9a/l34 19 1 2024-09-10T10:04:31.757 INFO:tasks.workunit.client.1.smithi107.stdout:2/995: mkdir d3/da/df/d20/dfb/d136/dea/d15b 0 2024-09-10T10:04:31.758 INFO:tasks.workunit.client.1.smithi107.stdout:9/924: symlink d5/d7/d1d/db5/l130 0 2024-09-10T10:04:31.760 INFO:tasks.workunit.client.1.smithi107.stdout:2/996: dread d3/da/d1e/d27/fa4 [0,4194304] 0 2024-09-10T10:04:31.761 INFO:tasks.workunit.client.1.smithi107.stdout:2/997: write d3/f144 [374650,12982] 0 2024-09-10T10:04:31.763 INFO:tasks.workunit.client.1.smithi107.stdout:2/998: truncate d3/da/df/d20/dfb/f146 67425 0 2024-09-10T10:04:31.763 INFO:tasks.workunit.client.1.smithi107.stdout:2/999: chown d3/da/d1e/d27 3 1 2024-09-10T10:04:31.769 INFO:tasks.workunit.client.1.smithi107.stdout:9/925: dwrite d5/d7/d1d/d41/d83/d9a/fb0 [0,4194304] 0 2024-09-10T10:04:31.781 INFO:tasks.workunit.client.1.smithi107.stdout:9/926: dwrite d5/d7/f9 [0,4194304] 0 2024-09-10T10:04:31.784 INFO:tasks.workunit.client.1.smithi107.stdout:9/927: creat d5/d7/d1d/d9b/de5/d123/f131 x:0 0 0 2024-09-10T10:04:31.795 INFO:tasks.workunit.client.1.smithi107.stdout:9/928: dwrite f3 [4194304,4194304] 0 2024-09-10T10:04:31.797 INFO:tasks.workunit.client.1.smithi107.stdout:9/929: mkdir d5/d7/d1d/d29/db4/dbd/d132 0 2024-09-10T10:04:31.799 INFO:tasks.workunit.client.0.smithi071.stdout:2/951: sync 2024-09-10T10:04:31.800 INFO:tasks.workunit.client.1.smithi107.stdout:9/930: read d5/d7/d1d/db5/fcc [452542,121610] 0 2024-09-10T10:04:31.804 INFO:tasks.workunit.client.1.smithi107.stdout:9/931: link d5/d7/d1d/d29/fdc d5/d7/d106/d107/f133 0 2024-09-10T10:04:31.804 INFO:tasks.workunit.client.0.smithi071.stdout:2/952: getdents d8/db6/d11b 0 2024-09-10T10:04:31.805 INFO:tasks.workunit.client.0.smithi071.stdout:2/953: mknod d8/d87/d33/d41/d56/d107/c144 0 2024-09-10T10:04:31.806 INFO:tasks.workunit.client.1.smithi107.stdout:9/932: creat d5/d7/d1d/d29/db4/dbd/d132/f134 x:0 0 0 2024-09-10T10:04:31.809 INFO:tasks.workunit.client.1.smithi107.stdout:9/933: mkdir d5/d7/d1d/d29/db4/dbd/d11f/d135 0 2024-09-10T10:04:31.811 INFO:tasks.workunit.client.1.smithi107.stdout:9/934: symlink d5/d7/d106/d107/l136 0 2024-09-10T10:04:31.811 INFO:tasks.workunit.client.1.smithi107.stdout:9/935: fdatasync d5/d7/d1d/d41/dc8/dfc/d10d/ff9 0 2024-09-10T10:04:31.812 INFO:tasks.workunit.client.1.smithi107.stdout:9/936: write d5/d7/d1d/d41/d83/d9a/fb0 [3465264,27421] 0 2024-09-10T10:04:31.815 INFO:tasks.workunit.client.0.smithi071.stdout:2/954: dwrite d8/d4a/f97 [0,4194304] 0 2024-09-10T10:04:31.815 INFO:tasks.workunit.client.1.smithi107.stdout:9/937: fsync d5/d7/d1d/d9b/dab/d57/f8a 0 2024-09-10T10:04:31.817 INFO:tasks.workunit.client.1.smithi107.stdout:9/938: write d5/d7/d1d/d9b/dab/f93 [1586763,73707] 0 2024-09-10T10:04:31.817 INFO:tasks.workunit.client.1.smithi107.stdout:9/939: fsync d5/d7/d1d/d29/fe2 0 2024-09-10T10:04:31.821 INFO:tasks.workunit.client.1.smithi107.stdout:9/940: mknod d5/d7/d106/c137 0 2024-09-10T10:04:31.822 INFO:tasks.workunit.client.1.smithi107.stdout:9/941: stat d5/d7/d1d/l98 0 2024-09-10T10:04:31.824 INFO:tasks.workunit.client.1.smithi107.stdout:9/942: fdatasync d5/d7/d1d/f3f 0 2024-09-10T10:04:31.827 INFO:tasks.workunit.client.1.smithi107.stdout:9/943: link d5/f6 d5/d7/d1d/d9b/dab/d57/d87/d27/d10a/f138 0 2024-09-10T10:04:31.828 INFO:tasks.workunit.client.1.smithi107.stdout:9/944: write d5/d7/d1d/d41/dc8/f10e [324264,5181] 0 2024-09-10T10:04:31.830 INFO:tasks.workunit.client.0.smithi071.stdout:2/955: dread d8/d87/d33/d53/f86 [0,4194304] 0 2024-09-10T10:04:31.834 INFO:tasks.workunit.client.1.smithi107.stdout:9/945: truncate d5/d7/d1d/d9b/dab/d57/d87/d27/d10a/f138 164191 0 2024-09-10T10:04:31.836 INFO:tasks.workunit.client.1.smithi107.stdout:9/946: creat d5/d7/d1d/d95/f139 x:0 0 0 2024-09-10T10:04:31.840 INFO:tasks.workunit.client.0.smithi071.stdout:2/956: dwrite d8/d87/d49/d66/fb4 [0,4194304] 0 2024-09-10T10:04:31.842 INFO:tasks.workunit.client.0.smithi071.stdout:2/957: dread - d8/d87/dc4/ff4 zero size 2024-09-10T10:04:31.845 INFO:tasks.workunit.client.0.smithi071.stdout:2/958: creat d8/d87/d33/d41/d56/f145 x:0 0 0 2024-09-10T10:04:31.845 INFO:tasks.workunit.client.1.smithi107.stdout:9/947: dwrite d5/d7/d1d/d3b/fbb [0,4194304] 0 2024-09-10T10:04:31.847 INFO:tasks.workunit.client.1.smithi107.stdout:9/948: creat d5/d1e/f13a x:0 0 0 2024-09-10T10:04:31.850 INFO:tasks.workunit.client.1.smithi107.stdout:9/949: symlink d5/d7/d1d/d41/d83/d9a/d8c/l13b 0 2024-09-10T10:04:31.851 INFO:tasks.workunit.client.1.smithi107.stdout:9/950: chown d5/d7/d1d/d41 26736 1 2024-09-10T10:04:31.853 INFO:tasks.workunit.client.0.smithi071.stdout:2/959: write d8/d87/dc4/dea/f10d [582652,3064] 0 2024-09-10T10:04:31.863 INFO:tasks.workunit.client.1.smithi107.stdout:9/951: truncate d5/d7/d1d/d9b/dab/d57/fd4 363732 0 2024-09-10T10:04:31.864 INFO:tasks.workunit.client.1.smithi107.stdout:9/952: chown d5/d7/d1d/d9b/de5/d123/f131 22 1 2024-09-10T10:04:31.865 INFO:tasks.workunit.client.1.smithi107.stdout:9/953: write d5/d7/d1d/d95/faf [3342280,98382] 0 2024-09-10T10:04:31.865 INFO:tasks.workunit.client.1.smithi107.stdout:9/954: readlink d5/d7/d1d/d41/led 0 2024-09-10T10:04:31.867 INFO:tasks.workunit.client.0.smithi071.stdout:2/960: dwrite d8/d87/d33/d41/d4d/f85 [0,4194304] 0 2024-09-10T10:04:31.872 INFO:tasks.workunit.client.1.smithi107.stdout:9/955: write d5/d7/d1d/d9b/dab/d57/d87/d27/f51 [2547872,117058] 0 2024-09-10T10:04:31.875 INFO:tasks.workunit.client.0.smithi071.stdout:4/821: sync 2024-09-10T10:04:31.875 INFO:tasks.workunit.client.0.smithi071.stdout:3/945: sync 2024-09-10T10:04:31.876 INFO:tasks.workunit.client.0.smithi071.stdout:2/961: dread d8/f1a [0,4194304] 0 2024-09-10T10:04:31.877 INFO:tasks.workunit.client.0.smithi071.stdout:4/822: write db/d15/d4b/f64 [4001400,5832] 0 2024-09-10T10:04:31.877 INFO:tasks.workunit.client.0.smithi071.stdout:2/962: chown d8/f1a 642 1 2024-09-10T10:04:31.877 INFO:tasks.workunit.client.1.smithi107.stdout:9/956: write d5/d7/d1d/d41/d97/f9d [686186,9627] 0 2024-09-10T10:04:31.878 INFO:tasks.workunit.client.1.smithi107.stdout:0/997: sync 2024-09-10T10:04:31.878 INFO:tasks.workunit.client.1.smithi107.stdout:7/963: sync 2024-09-10T10:04:31.878 INFO:tasks.workunit.client.1.smithi107.stdout:8/975: sync 2024-09-10T10:04:31.881 INFO:tasks.workunit.client.1.smithi107.stdout:0/998: creat d6/d8/d2f/d2e/d32/d95/f147 x:0 0 0 2024-09-10T10:04:31.883 INFO:tasks.workunit.client.1.smithi107.stdout:8/976: unlink d5/d8/d66/d8b/d18/d4f/f8d 0 2024-09-10T10:04:31.884 INFO:tasks.workunit.client.0.smithi071.stdout:4/823: rename db/d15/d17/d24/l48 to db/d1d/l118 0 2024-09-10T10:04:31.884 INFO:tasks.workunit.client.0.smithi071.stdout:3/946: link d3/d20/d99/cf7 d3/d49/d34/deb/d13c/da1/d5d/c13d 0 2024-09-10T10:04:31.885 INFO:tasks.workunit.client.1.smithi107.stdout:0/999: fsync d6/d8/f15 0 2024-09-10T10:04:31.886 INFO:tasks.workunit.client.0.smithi071.stdout:3/947: stat d3/d49/d34/deb/d13c/f6f 0 2024-09-10T10:04:31.886 INFO:tasks.workunit.client.1.smithi107.stdout:9/957: creat d5/d7/d1d/d9b/dab/d57/d87/d37/d108/f13c x:0 0 0 2024-09-10T10:04:31.887 INFO:tasks.workunit.client.0.smithi071.stdout:4/824: stat db/d15/d26/d43/d82/fd8 0 2024-09-10T10:04:31.887 INFO:tasks.workunit.client.1.smithi107.stdout:9/958: chown d5/d1e/dc5/de3 8399701 1 2024-09-10T10:04:31.888 INFO:tasks.workunit.client.1.smithi107.stdout:8/977: creat d5/d8/d66/d8b/d18/d4f/d111/d35/d85/dcb/f142 x:0 0 0 2024-09-10T10:04:31.888 INFO:tasks.workunit.client.0.smithi071.stdout:4/825: write db/d15/d26/d43/fa5 [951131,75202] 0 2024-09-10T10:04:31.889 INFO:tasks.workunit.client.1.smithi107.stdout:9/959: chown d5/d7/d1d/d41/d83/d9a/d8c/d111 121713588 1 2024-09-10T10:04:31.890 INFO:tasks.workunit.client.1.smithi107.stdout:7/964: dwrite d0/d8/d56/f82 [0,4194304] 0 2024-09-10T10:04:31.892 INFO:tasks.workunit.client.1.smithi107.stdout:8/978: rmdir d5/d8/d66/d8b/d21/d113 39 2024-09-10T10:04:31.892 INFO:tasks.workunit.client.0.smithi071.stdout:4/826: rename db/d15/d26/db2 to db/d8f/d119 0 2024-09-10T10:04:31.893 INFO:tasks.workunit.client.0.smithi071.stdout:3/948: dwrite d3/d1c/d3e/f12f [0,4194304] 0 2024-09-10T10:04:31.894 INFO:tasks.workunit.client.1.smithi107.stdout:9/960: dread d5/d7/d1d/d41/dc8/f10e [0,4194304] 0 2024-09-10T10:04:31.895 INFO:tasks.workunit.client.0.smithi071.stdout:4/827: stat db/d15/d17/d4e/d5a/ff0 0 2024-09-10T10:04:31.895 INFO:tasks.workunit.client.1.smithi107.stdout:8/979: creat d5/da2/f143 x:0 0 0 2024-09-10T10:04:31.896 INFO:tasks.workunit.client.1.smithi107.stdout:9/961: chown d5/d7/d1d/d41/d83/d9a/fb7 793506032 1 2024-09-10T10:04:31.898 INFO:tasks.workunit.client.0.smithi071.stdout:4/828: symlink db/d8f/d119/l11a 0 2024-09-10T10:04:31.898 INFO:tasks.workunit.client.0.smithi071.stdout:2/963: dread d8/d4a/d104/d65/f79 [0,4194304] 0 2024-09-10T10:04:31.902 INFO:tasks.workunit.client.1.smithi107.stdout:7/965: rename d0/d8/d5c/d6d/fa5 to d0/d1b/d4d/d69/d97/f138 0 2024-09-10T10:04:31.902 INFO:tasks.workunit.client.0.smithi071.stdout:2/964: creat d8/d87/d51/f146 x:0 0 0 2024-09-10T10:04:31.904 INFO:tasks.workunit.client.0.smithi071.stdout:2/965: dread d8/f1a [0,4194304] 0 2024-09-10T10:04:31.905 INFO:tasks.workunit.client.1.smithi107.stdout:7/966: symlink d0/d1b/d4d/d69/d97/d95/l139 0 2024-09-10T10:04:31.905 INFO:tasks.workunit.client.1.smithi107.stdout:9/962: link d5/d7/d1d/d41/f91 d5/d7/d1d/d41/dc8/dfc/d12b/f13d 0 2024-09-10T10:04:31.906 INFO:tasks.workunit.client.0.smithi071.stdout:4/829: dwrite db/d15/d17/d24/f8a [0,4194304] 0 2024-09-10T10:04:31.906 INFO:tasks.workunit.client.0.smithi071.stdout:2/966: chown d8/d38/d8d/c140 376 1 2024-09-10T10:04:31.914 INFO:tasks.workunit.client.0.smithi071.stdout:4/830: creat db/d15/d17/d4e/d5a/dd3/f11b x:0 0 0 2024-09-10T10:04:31.916 INFO:tasks.workunit.client.1.smithi107.stdout:7/967: dwrite d0/d8/dc/f26 [0,4194304] 0 2024-09-10T10:04:31.917 INFO:tasks.workunit.client.1.smithi107.stdout:8/980: dwrite d5/f19 [0,4194304] 0 2024-09-10T10:04:31.917 INFO:tasks.workunit.client.1.smithi107.stdout:8/981: readlink d5/l17 0 2024-09-10T10:04:31.917 INFO:tasks.workunit.client.0.smithi071.stdout:4/831: rmdir db/d15/d26/d43/d4d/d77/dd7/de7 39 2024-09-10T10:04:31.918 INFO:tasks.workunit.client.1.smithi107.stdout:9/963: dwrite d5/d7/d1d/d9b/dab/d57/d87/d27/fa1 [0,4194304] 0 2024-09-10T10:04:31.919 INFO:tasks.workunit.client.0.smithi071.stdout:3/949: dwrite d3/d49/d34/deb/d13c/da1/d3a/f105 [0,4194304] 0 2024-09-10T10:04:31.920 INFO:tasks.workunit.client.0.smithi071.stdout:4/832: fsync db/d15/d4b/fdc 0 2024-09-10T10:04:31.921 INFO:tasks.workunit.client.0.smithi071.stdout:4/833: chown db/d8f 863801 1 2024-09-10T10:04:31.922 INFO:tasks.workunit.client.1.smithi107.stdout:7/968: mknod d0/d8/d56/d5d/c13a 0 2024-09-10T10:04:31.923 INFO:tasks.workunit.client.1.smithi107.stdout:8/982: symlink d5/d8/d66/d8e/d104/l144 0 2024-09-10T10:04:31.925 INFO:tasks.workunit.client.1.smithi107.stdout:8/983: chown d5/da2/f143 6380984 1 2024-09-10T10:04:31.926 INFO:tasks.workunit.client.1.smithi107.stdout:9/964: getdents d5/d7/d1d/d9b/dab 0 2024-09-10T10:04:31.927 INFO:tasks.workunit.client.1.smithi107.stdout:7/969: rename d0/d20/d72/cf7 to d0/d8/dd1/c13b 0 2024-09-10T10:04:31.927 INFO:tasks.workunit.client.0.smithi071.stdout:4/834: unlink db/d1d/d61/c7b 0 2024-09-10T10:04:31.929 INFO:tasks.workunit.client.0.smithi071.stdout:3/950: getdents d3/d49/d2f/dc2 0 2024-09-10T10:04:31.931 INFO:tasks.workunit.client.0.smithi071.stdout:4/835: creat db/d1d/d61/dcd/f11c x:0 0 0 2024-09-10T10:04:31.932 INFO:tasks.workunit.client.0.smithi071.stdout:6/807: sync 2024-09-10T10:04:31.932 INFO:tasks.workunit.client.0.smithi071.stdout:5/946: sync 2024-09-10T10:04:31.932 INFO:tasks.workunit.client.0.smithi071.stdout:1/959: sync 2024-09-10T10:04:31.932 INFO:tasks.workunit.client.0.smithi071.stdout:8/944: sync 2024-09-10T10:04:31.933 INFO:tasks.workunit.client.1.smithi107.stdout:8/984: truncate d5/d8/d66/d8b/d18/d4f/d111/d35/d85/dcb/f142 24882 0 2024-09-10T10:04:31.933 INFO:tasks.workunit.client.1.smithi107.stdout:9/965: read d5/d7/d1d/d41/d83/d9a/f28 [2725125,71522] 0 2024-09-10T10:04:31.934 INFO:tasks.workunit.client.0.smithi071.stdout:3/951: rename d3/d49/d125/d12b/c135 to d3/d49/d125/c13e 0 2024-09-10T10:04:31.935 INFO:tasks.workunit.client.1.smithi107.stdout:9/966: write d5/f6a [1338060,64287] 0 2024-09-10T10:04:31.936 INFO:tasks.workunit.client.0.smithi071.stdout:5/947: readlink dc/df/d17/lc8 0 2024-09-10T10:04:31.938 INFO:tasks.workunit.client.0.smithi071.stdout:1/960: write d1/d3f/d58/daf/ddc/d139/f13c [1931457,53211] 0 2024-09-10T10:04:31.938 INFO:tasks.workunit.client.1.smithi107.stdout:9/967: stat d5/d7/d1d/d3b 0 2024-09-10T10:04:31.938 INFO:tasks.workunit.client.0.smithi071.stdout:4/836: rmdir db/d15/d26/d43/d4d/d77/dd7/de7/dd0 39 2024-09-10T10:04:31.940 INFO:tasks.workunit.client.1.smithi107.stdout:8/985: dread d5/f79 [0,4194304] 0 2024-09-10T10:04:31.940 INFO:tasks.workunit.client.0.smithi071.stdout:2/967: write d8/d24/d7f/f10a [140637,79702] 0 2024-09-10T10:04:31.940 INFO:tasks.workunit.client.0.smithi071.stdout:4/837: readlink db/d15/d17/d24/l68 0 2024-09-10T10:04:31.941 INFO:tasks.workunit.client.0.smithi071.stdout:6/808: rename d4/da/df/d2e/d3a/d40/d60/c8c to d4/da/df/d2e/d3a/d91/dc7/d81/db2/c10d 0 2024-09-10T10:04:31.941 INFO:tasks.workunit.client.0.smithi071.stdout:1/961: chown d1/d21/d2f/d30/c59 44 1 2024-09-10T10:04:31.942 INFO:tasks.workunit.client.0.smithi071.stdout:3/952: symlink d3/d49/d2f/d7f/l13f 0 2024-09-10T10:04:31.946 INFO:tasks.workunit.client.1.smithi107.stdout:9/968: dwrite d5/d7/d1d/d29/db4/dbd/f114 [0,4194304] 0 2024-09-10T10:04:31.946 INFO:tasks.workunit.client.0.smithi071.stdout:2/968: mknod d8/d87/dad/dd1/c147 0 2024-09-10T10:04:31.948 INFO:tasks.workunit.client.0.smithi071.stdout:6/809: write d4/da/df/d2e/d3a/d51/d108/fcd [773571,124042] 0 2024-09-10T10:04:31.949 INFO:tasks.workunit.client.0.smithi071.stdout:8/945: dwrite d5/d36/d49/fb8 [4194304,4194304] 0 2024-09-10T10:04:31.949 INFO:tasks.workunit.client.0.smithi071.stdout:4/838: getdents db/d8f 0 2024-09-10T10:04:31.953 INFO:tasks.workunit.client.0.smithi071.stdout:3/953: truncate d3/d49/d34/deb/d13c/d66/fad 736131 0 2024-09-10T10:04:31.955 INFO:tasks.workunit.client.0.smithi071.stdout:8/946: chown d5/df/d67/la2 3223 1 2024-09-10T10:04:31.956 INFO:tasks.workunit.client.0.smithi071.stdout:1/962: dread d1/d21/d3d/d9a/df9/f145 [0,4194304] 0 2024-09-10T10:04:31.956 INFO:tasks.workunit.client.0.smithi071.stdout:6/810: truncate d4/f38 728441 0 2024-09-10T10:04:31.960 INFO:tasks.workunit.client.0.smithi071.stdout:8/947: stat d5/df/d74/lb2 0 2024-09-10T10:04:31.962 INFO:tasks.workunit.client.1.smithi107.stdout:8/986: dread d5/d8/d5b/fe2 [0,4194304] 0 2024-09-10T10:04:31.963 INFO:tasks.workunit.client.0.smithi071.stdout:4/839: dwrite db/d15/f94 [0,4194304] 0 2024-09-10T10:04:31.967 INFO:tasks.workunit.client.1.smithi107.stdout:7/970: dread d0/f27 [0,4194304] 0 2024-09-10T10:04:31.967 INFO:tasks.workunit.client.0.smithi071.stdout:1/963: rename d1/d21/d2f/d30/d75/d97 to d1/d3f/d115/d148/d152 0 2024-09-10T10:04:31.970 INFO:tasks.workunit.client.1.smithi107.stdout:7/971: fsync d0/d8/d56/f10c 0 2024-09-10T10:04:31.972 INFO:tasks.workunit.client.0.smithi071.stdout:2/969: dwrite d8/d87/fc2 [0,4194304] 0 2024-09-10T10:04:31.973 INFO:tasks.workunit.client.0.smithi071.stdout:1/964: symlink d1/d21/d3d/d9a/d72/dfd/l153 0 2024-09-10T10:04:31.974 INFO:tasks.workunit.client.0.smithi071.stdout:8/948: rename d5/df/d1d/d81/d9b/f104 to d5/df/d57/d82/d12e/f149 0 2024-09-10T10:04:31.976 INFO:tasks.workunit.client.1.smithi107.stdout:7/972: creat d0/d8/d56/dcc/f13c x:0 0 0 2024-09-10T10:04:31.977 INFO:tasks.workunit.client.0.smithi071.stdout:3/954: dread d3/d49/d34/ff5 [0,4194304] 0 2024-09-10T10:04:31.979 INFO:tasks.workunit.client.1.smithi107.stdout:7/973: fdatasync d0/d20/d35/f54 0 2024-09-10T10:04:31.980 INFO:tasks.workunit.client.0.smithi071.stdout:1/965: symlink d1/d21/d2f/d30/d6a/d91/d9d/d114/l154 0 2024-09-10T10:04:31.982 INFO:tasks.workunit.client.1.smithi107.stdout:9/969: dread d5/d7/d1d/d41/d83/fa6 [0,4194304] 0 2024-09-10T10:04:31.982 INFO:tasks.workunit.client.0.smithi071.stdout:6/811: write d4/da/df/d2e/d3a/d91/dc7/f9c [872261,60318] 0 2024-09-10T10:04:31.983 INFO:tasks.workunit.client.0.smithi071.stdout:4/840: write db/d8f/fb1 [21247,125117] 0 2024-09-10T10:04:31.986 INFO:tasks.workunit.client.0.smithi071.stdout:6/812: read - d4/d61/d83/faf zero size 2024-09-10T10:04:31.989 INFO:tasks.workunit.client.1.smithi107.stdout:8/987: dwrite d5/d8/d66/d8b/d1a/d64/db9/f106 [0,4194304] 0 2024-09-10T10:04:31.990 INFO:tasks.workunit.client.0.smithi071.stdout:4/841: creat db/d15/d26/d43/d82/f11d x:0 0 0 2024-09-10T10:04:31.991 INFO:tasks.workunit.client.0.smithi071.stdout:1/966: dwrite d1/d21/d3d/d9a/f14f [0,4194304] 0 2024-09-10T10:04:31.992 INFO:tasks.workunit.client.1.smithi107.stdout:8/988: truncate d5/d8/d66/d8b/dfd/f12c 953858 0 2024-09-10T10:04:31.992 INFO:tasks.workunit.client.0.smithi071.stdout:4/842: stat db/d15/d26/d43/d4d/d9f/da6/lb0 0 2024-09-10T10:04:31.992 INFO:tasks.workunit.client.0.smithi071.stdout:6/813: mknod d4/da/df/d2e/d3a/c10e 0 2024-09-10T10:04:31.994 INFO:tasks.workunit.client.0.smithi071.stdout:8/949: write d5/df/d1e/d38/d9f/fb9 [694369,119557] 0 2024-09-10T10:04:31.994 INFO:tasks.workunit.client.0.smithi071.stdout:2/970: truncate d8/db6/de7/f134 1973425 0 2024-09-10T10:04:31.995 INFO:tasks.workunit.client.1.smithi107.stdout:8/989: write d5/d8/d66/d8b/d21/d83/fa1 [849256,55499] 0 2024-09-10T10:04:31.996 INFO:tasks.workunit.client.1.smithi107.stdout:7/974: write d0/d20/d72/f9a [536726,72724] 0 2024-09-10T10:04:31.997 INFO:tasks.workunit.client.1.smithi107.stdout:8/990: readlink d5/d8/l15 0 2024-09-10T10:04:32.001 INFO:tasks.workunit.client.0.smithi071.stdout:6/814: readlink d4/da/df/d2e/le3 0 2024-09-10T10:04:32.001 INFO:tasks.workunit.client.0.smithi071.stdout:1/967: dread d1/d21/d2f/f7c [0,4194304] 0 2024-09-10T10:04:32.002 INFO:tasks.workunit.client.1.smithi107.stdout:8/991: getdents d5/d8/d66/d8b/d18/d4f/d111/d35/d70/d135 0 2024-09-10T10:04:32.002 INFO:tasks.workunit.client.0.smithi071.stdout:4/843: symlink db/d15/d26/d43/d4d/d77/l11e 0 2024-09-10T10:04:32.003 INFO:tasks.workunit.client.0.smithi071.stdout:8/950: symlink d5/l14a 0 2024-09-10T10:04:32.003 INFO:tasks.workunit.client.1.smithi107.stdout:8/992: readlink d5/d8/d66/d8b/d18/l10f 0 2024-09-10T10:04:32.008 INFO:tasks.workunit.client.0.smithi071.stdout:2/971: rename d8/d87/c44 to d8/d87/d33/d53/d120/c148 0 2024-09-10T10:04:32.008 INFO:tasks.workunit.client.0.smithi071.stdout:1/968: creat d1/d21/d3d/d9a/d101/f155 x:0 0 0 2024-09-10T10:04:32.008 INFO:tasks.workunit.client.0.smithi071.stdout:8/951: mkdir d5/d36/d14b 0 2024-09-10T10:04:32.010 INFO:tasks.workunit.client.0.smithi071.stdout:3/955: dwrite d3/fd [8388608,4194304] 0 2024-09-10T10:04:32.012 INFO:tasks.workunit.client.0.smithi071.stdout:8/952: write d5/df/d1d/f93 [1524053,14563] 0 2024-09-10T10:04:32.015 INFO:tasks.workunit.client.0.smithi071.stdout:6/815: dwrite d4/da/df/d2e/d3a/f74 [8388608,4194304] 0 2024-09-10T10:04:32.015 INFO:tasks.workunit.client.0.smithi071.stdout:2/972: dread d8/d87/d33/d41/d56/fb3 [0,4194304] 0 2024-09-10T10:04:32.016 INFO:tasks.workunit.client.0.smithi071.stdout:8/953: fsync d5/df/fcf 0 2024-09-10T10:04:32.016 INFO:tasks.workunit.client.0.smithi071.stdout:1/969: link d1/d21/d3d/d9a/cbc d1/d21/d125/d141/c156 0 2024-09-10T10:04:32.017 INFO:tasks.workunit.client.0.smithi071.stdout:2/973: stat d8/d87/d51/c73 0 2024-09-10T10:04:32.017 INFO:tasks.workunit.client.0.smithi071.stdout:3/956: rmdir d3/d49/d34/deb/d13c/da1/dd2 39 2024-09-10T10:04:32.022 INFO:tasks.workunit.client.0.smithi071.stdout:2/974: read d8/d38/d8d/ddc/f114 [571842,7234] 0 2024-09-10T10:04:32.022 INFO:tasks.workunit.client.0.smithi071.stdout:6/816: readlink d4/da/df/d2e/d3a/d43/l65 0 2024-09-10T10:04:32.023 INFO:tasks.workunit.client.0.smithi071.stdout:2/975: chown d8/db6/de7/cfb 35430 1 2024-09-10T10:04:32.025 INFO:tasks.workunit.client.1.smithi107.stdout:9/970: dread d5/d7/d1d/d41/d83/d9a/f56 [0,4194304] 0 2024-09-10T10:04:32.026 INFO:tasks.workunit.client.0.smithi071.stdout:6/817: mknod d4/da/df/d2e/d10c/c10f 0 2024-09-10T10:04:32.027 INFO:tasks.workunit.client.1.smithi107.stdout:9/971: fsync d5/d7/d1d/d9b/dab/d57/d87/d37/fe7 0 2024-09-10T10:04:32.027 INFO:tasks.workunit.client.0.smithi071.stdout:2/976: creat d8/d87/d33/d41/d56/d107/f149 x:0 0 0 2024-09-10T10:04:32.029 INFO:tasks.workunit.client.0.smithi071.stdout:8/954: getdents d5/d36/d49 0 2024-09-10T10:04:32.030 INFO:tasks.workunit.client.0.smithi071.stdout:2/977: truncate d8/d38/d47/fa9 617291 0 2024-09-10T10:04:32.031 INFO:tasks.workunit.client.0.smithi071.stdout:6/818: getdents d4/da/df/d2e/d3a/d43/dc8 0 2024-09-10T10:04:32.031 INFO:tasks.workunit.client.1.smithi107.stdout:9/972: unlink d5/d7/d1d/d41/dc8/dfc/d10d/ffe 0 2024-09-10T10:04:32.032 INFO:tasks.workunit.client.0.smithi071.stdout:6/819: chown d4/da/df/c67 43375346 1 2024-09-10T10:04:32.032 INFO:tasks.workunit.client.0.smithi071.stdout:8/955: truncate d5/d36/d49/fd8 1141561 0 2024-09-10T10:04:32.033 INFO:tasks.workunit.client.0.smithi071.stdout:2/978: dread d8/d38/d8d/ddc/f114 [0,4194304] 0 2024-09-10T10:04:32.033 INFO:tasks.workunit.client.0.smithi071.stdout:6/820: fdatasync d4/f25 0 2024-09-10T10:04:32.034 INFO:tasks.workunit.client.1.smithi107.stdout:9/973: creat d5/d7/d1d/d29/db4/f13e x:0 0 0 2024-09-10T10:04:32.036 INFO:tasks.workunit.client.0.smithi071.stdout:2/979: mkdir d8/d87/dad/dd1/d14a 0 2024-09-10T10:04:32.037 INFO:tasks.workunit.client.0.smithi071.stdout:3/957: write d3/d49/d34/deb/d13c/da1/d3a/dbd/fb1 [625214,88847] 0 2024-09-10T10:04:32.038 INFO:tasks.workunit.client.1.smithi107.stdout:8/993: dread d5/d8/d5b/f6f [0,4194304] 0 2024-09-10T10:04:32.040 INFO:tasks.workunit.client.0.smithi071.stdout:2/980: creat d8/d87/d33/d41/d4d/dc8/f14b x:0 0 0 2024-09-10T10:04:32.040 INFO:tasks.workunit.client.0.smithi071.stdout:3/958: chown d3/d49/d34/deb/d13c/da1/d3a/dc0 0 1 2024-09-10T10:04:32.041 INFO:tasks.workunit.client.0.smithi071.stdout:8/956: dwrite d5/f10f [0,4194304] 0 2024-09-10T10:04:32.043 INFO:tasks.workunit.client.0.smithi071.stdout:3/959: chown d3/d49/d2f/d7f/f130 99 1 2024-09-10T10:04:32.046 INFO:tasks.workunit.client.1.smithi107.stdout:9/974: truncate d5/d7/d1d/d9b/dab/d57/d87/d27/f51 1865967 0 2024-09-10T10:04:32.046 INFO:tasks.workunit.client.0.smithi071.stdout:8/957: symlink d5/df/d57/d82/de9/l14c 0 2024-09-10T10:04:32.046 INFO:tasks.workunit.client.1.smithi107.stdout:9/975: chown d5/d7 31475 1 2024-09-10T10:04:32.047 INFO:tasks.workunit.client.1.smithi107.stdout:8/994: write d5/d8/d66/d8b/d21/f61 [208381,4208] 0 2024-09-10T10:04:32.047 INFO:tasks.workunit.client.0.smithi071.stdout:2/981: write d8/d87/d33/d41/d4d/d5e/fd4 [664999,45109] 0 2024-09-10T10:04:32.048 INFO:tasks.workunit.client.0.smithi071.stdout:2/982: stat d8/d24/d7f/f133 0 2024-09-10T10:04:32.048 INFO:tasks.workunit.client.1.smithi107.stdout:9/976: mknod d5/c13f 0 2024-09-10T10:04:32.049 INFO:tasks.workunit.client.0.smithi071.stdout:8/958: mkdir d5/df/d1e/d70/d14d 0 2024-09-10T10:04:32.051 INFO:tasks.workunit.client.0.smithi071.stdout:3/960: write d3/d49/d34/f75 [4445275,122091] 0 2024-09-10T10:04:32.051 INFO:tasks.workunit.client.1.smithi107.stdout:8/995: rename d5/d8/d66/d8b/dfd/l117 to d5/d8/d66/d8e/dee/l145 0 2024-09-10T10:04:32.052 INFO:tasks.workunit.client.0.smithi071.stdout:3/961: readlink d3/d1c/d3e/d77/l96 0 2024-09-10T10:04:32.056 INFO:tasks.workunit.client.0.smithi071.stdout:2/983: dwrite d8/d87/d33/d41/d4d/d5e/fd4 [0,4194304] 0 2024-09-10T10:04:32.060 INFO:tasks.workunit.client.0.smithi071.stdout:3/962: dwrite d3/d20/d99/d9b/f127 [0,4194304] 0 2024-09-10T10:04:32.064 INFO:tasks.workunit.client.0.smithi071.stdout:8/959: rename d5/df/d1d/d86/f106 to d5/df/d1d/d86/d75/d85/f14e 0 2024-09-10T10:04:32.064 INFO:tasks.workunit.client.0.smithi071.stdout:2/984: rmdir d8/d87/d49 39 2024-09-10T10:04:32.065 INFO:tasks.workunit.client.0.smithi071.stdout:3/963: mknod d3/d49/d34/deb/d13c/da1/d5d/d8f/c140 0 2024-09-10T10:04:32.065 INFO:tasks.workunit.client.0.smithi071.stdout:8/960: fsync d5/df/d1d/d86/d75/fe0 0 2024-09-10T10:04:32.068 INFO:tasks.workunit.client.0.smithi071.stdout:8/961: fdatasync d5/df/d1d/d86/d75/dcd/d115/d140/f141 0 2024-09-10T10:04:32.069 INFO:tasks.workunit.client.0.smithi071.stdout:3/964: rename d3/d49/d4f/d133 to d3/d1c/d141 0 2024-09-10T10:04:32.073 INFO:tasks.workunit.client.0.smithi071.stdout:3/965: creat d3/d49/d34/deb/d13c/da1/d42/d4a/d60/d78/f142 x:0 0 0 2024-09-10T10:04:32.077 INFO:tasks.workunit.client.0.smithi071.stdout:2/985: truncate d8/d87/d33/f40 2649044 0 2024-09-10T10:04:32.077 INFO:tasks.workunit.client.0.smithi071.stdout:8/962: write d5/df/d1d/fa5 [284169,2314] 0 2024-09-10T10:04:32.078 INFO:tasks.workunit.client.0.smithi071.stdout:2/986: read - d8/d38/d8d/f105 zero size 2024-09-10T10:04:32.081 INFO:tasks.workunit.client.1.smithi107.stdout:9/977: mknod d5/d7/d1d/d29/db4/dbd/d11f/d135/c140 0 2024-09-10T10:04:32.082 INFO:tasks.workunit.client.1.smithi107.stdout:8/996: dwrite d5/d8/d66/d8b/d18/fbe [0,4194304] 0 2024-09-10T10:04:32.086 INFO:tasks.workunit.client.1.smithi107.stdout:8/997: mkdir d5/d8/d66/d8b/d146 0 2024-09-10T10:04:32.091 INFO:tasks.workunit.client.1.smithi107.stdout:9/978: write d5/d7/d1d/d41/f91 [7122440,41381] 0 2024-09-10T10:04:32.093 INFO:tasks.workunit.client.1.smithi107.stdout:8/998: rmdir d5/d8/d66/d8b/d18/d4f/d111/d35/d70/d118 0 2024-09-10T10:04:32.093 INFO:tasks.workunit.client.1.smithi107.stdout:9/979: readlink d5/d7/d1d/d41/d83/d9a/l75 0 2024-09-10T10:04:32.095 INFO:tasks.workunit.client.1.smithi107.stdout:9/980: creat d5/d7/d1d/d29/db4/df0/f141 x:0 0 0 2024-09-10T10:04:32.097 INFO:tasks.workunit.client.1.smithi107.stdout:8/999: link d5/d8/d66/d8b/d1a/d64/c6c d5/d8/d66/d8b/d18/d4f/d111/d35/c147 0 2024-09-10T10:04:32.104 INFO:tasks.workunit.client.1.smithi107.stdout:9/981: write d5/f35 [1712077,9632] 0 2024-09-10T10:04:32.109 INFO:tasks.workunit.client.1.smithi107.stdout:9/982: dwrite d5/d7/d1d/d9b/dab/d57/d87/d27/feb [0,4194304] 0 2024-09-10T10:04:32.117 INFO:tasks.workunit.client.1.smithi107.stdout:9/983: dwrite d5/f6a [4194304,4194304] 0 2024-09-10T10:04:32.121 INFO:tasks.workunit.client.1.smithi107.stdout:9/984: truncate d5/d7/d1d/d9b/dab/fd0 3271150 0 2024-09-10T10:04:32.123 INFO:tasks.workunit.client.1.smithi107.stdout:9/985: fdatasync d5/d7/d1d/d41/d83/d9a/fb7 0 2024-09-10T10:04:32.129 INFO:tasks.workunit.client.1.smithi107.stdout:9/986: creat d5/d1e/dc5/de0/f142 x:0 0 0 2024-09-10T10:04:32.131 INFO:tasks.workunit.client.1.smithi107.stdout:9/987: write d5/d7/d1d/d3b/ffa [888915,25957] 0 2024-09-10T10:04:32.133 INFO:tasks.workunit.client.1.smithi107.stdout:9/988: truncate d5/d7/d1d/d41/f71 5116340 0 2024-09-10T10:04:32.138 INFO:tasks.workunit.client.1.smithi107.stdout:9/989: dread - d5/d1e/dc5/de0/f142 zero size 2024-09-10T10:04:32.148 INFO:tasks.workunit.client.1.smithi107.stdout:9/990: dread d5/d7/d1d/d41/dc8/f126 [0,4194304] 0 2024-09-10T10:04:32.153 INFO:tasks.workunit.client.1.smithi107.stdout:9/991: dwrite d5/d7/d1d/d9b/dab/d57/d87/d37/f63 [0,4194304] 0 2024-09-10T10:04:32.156 INFO:tasks.workunit.client.1.smithi107.stdout:9/992: mknod d5/d7/d1d/d41/c143 0 2024-09-10T10:04:32.158 INFO:tasks.workunit.client.1.smithi107.stdout:9/993: creat d5/d7/d1d/d29/db4/dfd/f144 x:0 0 0 2024-09-10T10:04:32.161 INFO:tasks.workunit.client.1.smithi107.stdout:9/994: dread d5/d7/d1d/fa0 [0,4194304] 0 2024-09-10T10:04:32.170 INFO:tasks.workunit.client.1.smithi107.stdout:9/995: dwrite d5/d7/d1d/f82 [0,4194304] 0 2024-09-10T10:04:32.171 INFO:tasks.workunit.client.1.smithi107.stdout:9/996: write d5/d7/d1d/d29/fe6 [1030403,31895] 0 2024-09-10T10:04:32.174 INFO:tasks.workunit.client.1.smithi107.stdout:9/997: mknod d5/d7/d106/c145 0 2024-09-10T10:04:32.178 INFO:tasks.workunit.client.1.smithi107.stdout:9/998: getdents d5/d7/d1d 0 2024-09-10T10:04:32.180 INFO:tasks.workunit.client.1.smithi107.stdout:9/999: rmdir d5/d1e/dc5/d119 0 2024-09-10T10:04:32.196 INFO:tasks.workunit.client.1.smithi107.stdout:7/975: sync 2024-09-10T10:04:32.197 INFO:tasks.workunit.client.1.smithi107.stdout:7/976: write d0/d20/d35/f94 [1016873,123005] 0 2024-09-10T10:04:32.198 INFO:tasks.workunit.client.1.smithi107.stdout:7/977: write d0/d8/d56/dcc/d81/dbc/fc2 [1340554,105482] 0 2024-09-10T10:04:32.204 INFO:tasks.workunit.client.1.smithi107.stdout:7/978: write d0/d8/d56/f8e [1251370,31234] 0 2024-09-10T10:04:32.207 INFO:tasks.workunit.client.1.smithi107.stdout:7/979: dread d0/d8/f18 [4194304,4194304] 0 2024-09-10T10:04:32.208 INFO:tasks.workunit.client.1.smithi107.stdout:7/980: creat d0/d8/dd1/d11b/f13d x:0 0 0 2024-09-10T10:04:32.209 INFO:tasks.workunit.client.1.smithi107.stdout:7/981: mknod d0/d20/d72/dc0/c13e 0 2024-09-10T10:04:32.214 INFO:tasks.workunit.client.1.smithi107.stdout:7/982: dwrite d0/d8/f84 [0,4194304] 0 2024-09-10T10:04:32.220 INFO:tasks.workunit.client.1.smithi107.stdout:7/983: creat d0/d8/d5c/f13f x:0 0 0 2024-09-10T10:04:32.259 INFO:tasks.workunit.client.1.smithi107.stdout:7/984: dwrite d0/d1b/f28 [0,4194304] 0 2024-09-10T10:04:32.263 INFO:tasks.workunit.client.1.smithi107.stdout:7/985: symlink d0/d8/dc/d137/l140 0 2024-09-10T10:04:32.264 INFO:tasks.workunit.client.1.smithi107.stdout:7/986: write d0/d8/d5c/d6d/fc8 [1247345,17904] 0 2024-09-10T10:04:32.268 INFO:tasks.workunit.client.1.smithi107.stdout:7/987: creat d0/f141 x:0 0 0 2024-09-10T10:04:32.269 INFO:tasks.workunit.client.1.smithi107.stdout:7/988: fdatasync d0/d1b/fbb 0 2024-09-10T10:04:32.270 INFO:tasks.workunit.client.1.smithi107.stdout:7/989: chown d0/d8/dc/fb0 25 1 2024-09-10T10:04:32.271 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:31 smithi107 ceph-mon[34215]: pgmap v7: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 80 MiB/s rd, 189 MiB/s wr, 448 op/s 2024-09-10T10:04:32.271 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:31 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mgr metadata", "who": "smithi071.gtqytr", "id": "smithi071.gtqytr"}]: dispatch 2024-09-10T10:04:32.272 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:31 smithi107 ceph-mon[34215]: mgrmap e25: smithi107.qurtcs(active, since 8s), standbys: smithi071.gtqytr 2024-09-10T10:04:32.273 INFO:tasks.workunit.client.1.smithi107.stdout:7/990: truncate d0/d20/ddf/f112 593471 0 2024-09-10T10:04:32.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:31 smithi071 ceph-mon[27559]: pgmap v7: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 80 MiB/s rd, 189 MiB/s wr, 448 op/s 2024-09-10T10:04:32.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:31 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mgr metadata", "who": "smithi071.gtqytr", "id": "smithi071.gtqytr"}]: dispatch 2024-09-10T10:04:32.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:31 smithi071 ceph-mon[27559]: mgrmap e25: smithi107.qurtcs(active, since 8s), standbys: smithi071.gtqytr 2024-09-10T10:04:32.343 INFO:tasks.workunit.client.0.smithi071.stdout:5/948: sync 2024-09-10T10:04:32.344 INFO:tasks.workunit.client.0.smithi071.stdout:4/844: sync 2024-09-10T10:04:32.346 INFO:tasks.workunit.client.0.smithi071.stdout:4/845: mknod db/d15/d26/d43/d4d/d77/dd7/de7/dd0/c11f 0 2024-09-10T10:04:32.347 INFO:tasks.workunit.client.0.smithi071.stdout:5/949: getdents dc/d53/d101 0 2024-09-10T10:04:32.348 INFO:tasks.workunit.client.0.smithi071.stdout:4/846: creat db/d1d/d61/f120 x:0 0 0 2024-09-10T10:04:32.355 INFO:tasks.workunit.client.0.smithi071.stdout:5/950: dwrite dc/df/d3e/d5a/d80/f86 [0,4194304] 0 2024-09-10T10:04:32.355 INFO:tasks.workunit.client.0.smithi071.stdout:4/847: dwrite db/d15/d26/d43/d4d/f78 [0,4194304] 0 2024-09-10T10:04:32.359 INFO:tasks.workunit.client.0.smithi071.stdout:4/848: creat db/d15/d17/d4e/d5a/f121 x:0 0 0 2024-09-10T10:04:32.365 INFO:tasks.workunit.client.0.smithi071.stdout:4/849: write db/d15/d26/d43/f50 [2633570,77437] 0 2024-09-10T10:04:32.369 INFO:tasks.workunit.client.0.smithi071.stdout:5/951: dread dc/df/d29/f3f [0,4194304] 0 2024-09-10T10:04:32.371 INFO:tasks.workunit.client.0.smithi071.stdout:5/952: mknod dc/d53/db2/c141 0 2024-09-10T10:04:32.374 INFO:tasks.workunit.client.0.smithi071.stdout:5/953: write dc/d53/f7f [3496545,21272] 0 2024-09-10T10:04:32.374 INFO:tasks.workunit.client.0.smithi071.stdout:4/850: dread db/d15/d26/d43/d4d/f4a [0,4194304] 0 2024-09-10T10:04:32.375 INFO:tasks.workunit.client.0.smithi071.stdout:5/954: write dc/df/d3e/d5a/dd4/f102 [539877,96177] 0 2024-09-10T10:04:32.376 INFO:tasks.workunit.client.0.smithi071.stdout:4/851: fdatasync db/d15/d17/d24/f8a 0 2024-09-10T10:04:32.380 INFO:tasks.workunit.client.0.smithi071.stdout:5/955: mkdir dc/df/d3e/d5a/d80/d8a/da3/d111/d142 0 2024-09-10T10:04:32.381 INFO:tasks.workunit.client.0.smithi071.stdout:4/852: link db/d15/d26/d43/d82/f11d db/d15/d26/d43/d4d/d77/f122 0 2024-09-10T10:04:32.386 INFO:tasks.workunit.client.0.smithi071.stdout:4/853: dread db/d1d/d61/d6a/f6c [0,4194304] 0 2024-09-10T10:04:32.387 INFO:tasks.workunit.client.0.smithi071.stdout:5/956: truncate dc/df/f28 6096651 0 2024-09-10T10:04:32.388 INFO:tasks.workunit.client.0.smithi071.stdout:4/854: creat db/d1d/d61/d6a/d88/d90/f123 x:0 0 0 2024-09-10T10:04:32.389 INFO:tasks.workunit.client.0.smithi071.stdout:5/957: creat dc/df/d3e/d5a/d80/d8a/d13c/f143 x:0 0 0 2024-09-10T10:04:32.389 INFO:tasks.workunit.client.0.smithi071.stdout:4/855: rmdir db/d1d/d61/d6a/d88 39 2024-09-10T10:04:32.391 INFO:tasks.workunit.client.0.smithi071.stdout:5/958: mkdir dc/df/d3e/d5a/d80/d8a/d13c/d144 0 2024-09-10T10:04:32.392 INFO:tasks.workunit.client.0.smithi071.stdout:4/856: mkdir db/d15/d26/d43/d4d/d9f/da6/d104/d124 0 2024-09-10T10:04:32.393 INFO:tasks.workunit.client.0.smithi071.stdout:5/959: creat dc/df/d3e/d5a/d80/d8a/da3/f145 x:0 0 0 2024-09-10T10:04:32.393 INFO:tasks.workunit.client.0.smithi071.stdout:4/857: mknod db/d15/d17/d4e/dc0/c125 0 2024-09-10T10:04:32.394 INFO:tasks.workunit.client.0.smithi071.stdout:5/960: creat dc/df/d29/d48/dae/f146 x:0 0 0 2024-09-10T10:04:32.394 INFO:tasks.workunit.client.0.smithi071.stdout:4/858: dread - db/d15/d17/d4e/d5a/ff0 zero size 2024-09-10T10:04:32.396 INFO:tasks.workunit.client.0.smithi071.stdout:5/961: symlink dc/l147 0 2024-09-10T10:04:32.397 INFO:tasks.workunit.client.0.smithi071.stdout:4/859: creat db/d1d/d61/d6a/d10e/f126 x:0 0 0 2024-09-10T10:04:32.397 INFO:tasks.workunit.client.0.smithi071.stdout:5/962: write dc/df/d3e/f63 [9347686,97894] 0 2024-09-10T10:04:32.399 INFO:tasks.workunit.client.0.smithi071.stdout:4/860: creat db/d15/d17/d113/f127 x:0 0 0 2024-09-10T10:04:32.400 INFO:tasks.workunit.client.0.smithi071.stdout:2/987: sync 2024-09-10T10:04:32.400 INFO:tasks.workunit.client.0.smithi071.stdout:3/966: sync 2024-09-10T10:04:32.400 INFO:tasks.workunit.client.0.smithi071.stdout:1/970: sync 2024-09-10T10:04:32.401 INFO:tasks.workunit.client.0.smithi071.stdout:6/821: sync 2024-09-10T10:04:32.401 INFO:tasks.workunit.client.0.smithi071.stdout:8/963: sync 2024-09-10T10:04:32.402 INFO:tasks.workunit.client.0.smithi071.stdout:8/964: truncate d5/f19 574992 0 2024-09-10T10:04:32.403 INFO:tasks.workunit.client.0.smithi071.stdout:1/971: dread - d1/d21/d3d/d9a/d72/f150 zero size 2024-09-10T10:04:32.406 INFO:tasks.workunit.client.0.smithi071.stdout:8/965: symlink d5/d136/l14f 0 2024-09-10T10:04:32.408 INFO:tasks.workunit.client.0.smithi071.stdout:1/972: write d1/d35/fa4 [22186,5226] 0 2024-09-10T10:04:32.409 INFO:tasks.workunit.client.0.smithi071.stdout:1/973: read d1/d3f/f43 [594308,84316] 0 2024-09-10T10:04:32.411 INFO:tasks.workunit.client.0.smithi071.stdout:5/963: truncate dc/df/dd7/f7d 1867659 0 2024-09-10T10:04:32.412 INFO:tasks.workunit.client.0.smithi071.stdout:1/974: mkdir d1/d57/dbf/d157 0 2024-09-10T10:04:32.412 INFO:tasks.workunit.client.0.smithi071.stdout:4/861: link db/d15/d26/d43/d4d/d9f/f96 db/d15/d26/d43/f128 0 2024-09-10T10:04:32.413 INFO:tasks.workunit.client.0.smithi071.stdout:3/967: link d3/d10/d24/l4b d3/d49/d34/deb/d13c/da1/d5d/d7a/d128/l143 0 2024-09-10T10:04:32.413 INFO:tasks.workunit.client.0.smithi071.stdout:1/975: write d1/d21/d65/f4e [365548,106449] 0 2024-09-10T10:04:32.413 INFO:tasks.workunit.client.0.smithi071.stdout:4/862: chown db/d1d/l20 59353 1 2024-09-10T10:04:32.414 INFO:tasks.workunit.client.0.smithi071.stdout:6/822: getdents d4/da/df/d2e/d3a 0 2024-09-10T10:04:32.414 INFO:tasks.workunit.client.0.smithi071.stdout:5/964: creat dc/df/d3e/d5a/f148 x:0 0 0 2024-09-10T10:04:32.418 INFO:tasks.workunit.client.0.smithi071.stdout:3/968: creat d3/d49/d34/d67/f144 x:0 0 0 2024-09-10T10:04:32.420 INFO:tasks.workunit.client.0.smithi071.stdout:1/976: creat d1/d3f/d58/daf/ddc/f158 x:0 0 0 2024-09-10T10:04:32.420 INFO:tasks.workunit.client.0.smithi071.stdout:2/988: dwrite d8/d87/d33/d41/d56/fb3 [0,4194304] 0 2024-09-10T10:04:32.420 INFO:tasks.workunit.client.0.smithi071.stdout:4/863: unlink db/d15/d26/d43/d4d/l80 0 2024-09-10T10:04:32.421 INFO:tasks.workunit.client.0.smithi071.stdout:6/823: truncate d4/da/df/d2e/d3a/d51/d64/fa5 1328267 0 2024-09-10T10:04:32.423 INFO:tasks.workunit.client.0.smithi071.stdout:5/965: symlink dc/df/d3e/d5a/d80/d8a/l149 0 2024-09-10T10:04:32.424 INFO:tasks.workunit.client.0.smithi071.stdout:3/969: symlink d3/d1c/d141/l145 0 2024-09-10T10:04:32.425 INFO:tasks.workunit.client.0.smithi071.stdout:8/966: truncate d5/df/d1d/d86/d90/db4/f11a 4706782 0 2024-09-10T10:04:32.427 INFO:tasks.workunit.client.0.smithi071.stdout:6/824: rmdir d4/da/df/d2e/d3a/d51/d108 39 2024-09-10T10:04:32.429 INFO:tasks.workunit.client.0.smithi071.stdout:8/967: creat d5/df/d57/d82/de9/f150 x:0 0 0 2024-09-10T10:04:32.431 INFO:tasks.workunit.client.0.smithi071.stdout:4/864: rename db/d15/d26/d43/d4d/d9f/da6/d104/d124 to db/d1d/d61/d6a/d88/d129 0 2024-09-10T10:04:32.432 INFO:tasks.workunit.client.0.smithi071.stdout:6/825: rmdir d4/da/df/d2e/d3a/d43 39 2024-09-10T10:04:32.434 INFO:tasks.workunit.client.0.smithi071.stdout:1/977: dread d1/d70/d76/fcf [0,4194304] 0 2024-09-10T10:04:32.435 INFO:tasks.workunit.client.0.smithi071.stdout:4/865: readlink db/d15/l57 0 2024-09-10T10:04:32.435 INFO:tasks.workunit.client.0.smithi071.stdout:2/989: write d8/fe9 [763465,12552] 0 2024-09-10T10:04:32.438 INFO:tasks.workunit.client.0.smithi071.stdout:5/966: dread dc/df/d3e/f136 [0,4194304] 0 2024-09-10T10:04:32.442 INFO:tasks.workunit.client.0.smithi071.stdout:1/978: rename d1/d21/f98 to d1/d35/dea/d10f/f159 0 2024-09-10T10:04:32.443 INFO:tasks.workunit.client.0.smithi071.stdout:6/826: creat d4/da/df/d2e/d3a/d91/dc7/df0/f110 x:0 0 0 2024-09-10T10:04:32.445 INFO:tasks.workunit.client.0.smithi071.stdout:3/970: dread d3/d49/d34/deb/d13c/da1/d5d/d8f/fdb [0,4194304] 0 2024-09-10T10:04:32.445 INFO:tasks.workunit.client.0.smithi071.stdout:8/968: dwrite d5/df/d74/fe6 [0,4194304] 0 2024-09-10T10:04:32.447 INFO:tasks.workunit.client.0.smithi071.stdout:2/990: truncate d8/d87/d33/d41/d4d/d5e/f132 185952 0 2024-09-10T10:04:32.447 INFO:tasks.workunit.client.0.smithi071.stdout:5/967: truncate dc/df/d3e/d5a/d80/f86 4455098 0 2024-09-10T10:04:32.451 INFO:tasks.workunit.client.0.smithi071.stdout:3/971: chown d3/d10/d24/d2b/db2/ffc 3 1 2024-09-10T10:04:32.454 INFO:tasks.workunit.client.0.smithi071.stdout:1/979: link d1/d70/d76/c93 d1/c15a 0 2024-09-10T10:04:32.455 INFO:tasks.workunit.client.0.smithi071.stdout:3/972: chown d3/d49/d34/deb/d13c/d66/l8a 398 1 2024-09-10T10:04:32.455 INFO:tasks.workunit.client.0.smithi071.stdout:6/827: creat d4/da/df/d2e/d3a/d91/dc7/d97/f111 x:0 0 0 2024-09-10T10:04:32.461 INFO:tasks.workunit.client.0.smithi071.stdout:4/866: dwrite db/d15/d26/d43/d4d/fad [0,4194304] 0 2024-09-10T10:04:32.463 INFO:tasks.workunit.client.0.smithi071.stdout:4/867: chown db/d1d/d61/cff 32015444 1 2024-09-10T10:04:32.465 INFO:tasks.workunit.client.0.smithi071.stdout:1/980: fsync d1/d21/d3d/d9a/df9/de4/db6/f10d 0 2024-09-10T10:04:32.470 INFO:tasks.workunit.client.0.smithi071.stdout:1/981: mkdir d1/d21/d3d/d9a/d72/d15b 0 2024-09-10T10:04:32.473 INFO:tasks.workunit.client.0.smithi071.stdout:1/982: rmdir d1/d70/d76/dd4 39 2024-09-10T10:04:32.477 INFO:tasks.workunit.client.0.smithi071.stdout:3/973: dread d3/d49/d34/deb/d13c/da1/d5d/da5/db3/fd5 [0,4194304] 0 2024-09-10T10:04:32.477 INFO:tasks.workunit.client.0.smithi071.stdout:2/991: getdents d8/d87/dc4/dea 0 2024-09-10T10:04:32.478 INFO:tasks.workunit.client.0.smithi071.stdout:5/968: getdents dc/df/d3e 0 2024-09-10T10:04:32.479 INFO:tasks.workunit.client.0.smithi071.stdout:8/969: dread d5/d36/f39 [0,4194304] 0 2024-09-10T10:04:32.481 INFO:tasks.workunit.client.0.smithi071.stdout:4/868: symlink db/d15/d17/l12a 0 2024-09-10T10:04:32.481 INFO:tasks.workunit.client.0.smithi071.stdout:6/828: creat d4/da/df/d2e/d3a/d43/f112 x:0 0 0 2024-09-10T10:04:32.482 INFO:tasks.workunit.client.0.smithi071.stdout:2/992: rmdir d8/d24/d7f 39 2024-09-10T10:04:32.482 INFO:tasks.workunit.client.0.smithi071.stdout:5/969: read - dc/df/da6/fe9 zero size 2024-09-10T10:04:32.482 INFO:tasks.workunit.client.0.smithi071.stdout:1/983: write d1/d21/d2f/f7c [1350000,59225] 0 2024-09-10T10:04:32.483 INFO:tasks.workunit.client.0.smithi071.stdout:3/974: mkdir d3/d49/d34/deb/d146 0 2024-09-10T10:04:32.484 INFO:tasks.workunit.client.0.smithi071.stdout:8/970: mkdir d5/df/d57/d82/d12e/d151 0 2024-09-10T10:04:32.486 INFO:tasks.workunit.client.0.smithi071.stdout:3/975: fsync d3/d1c/d3e/f129 0 2024-09-10T10:04:32.486 INFO:tasks.workunit.client.0.smithi071.stdout:2/993: stat d8/d87/d33/d41/d4d/d5e/cb0 0 2024-09-10T10:04:32.487 INFO:tasks.workunit.client.0.smithi071.stdout:5/970: creat dc/d4a/dbb/f14a x:0 0 0 2024-09-10T10:04:32.488 INFO:tasks.workunit.client.0.smithi071.stdout:1/984: truncate d1/d21/fd5 39419 0 2024-09-10T10:04:32.488 INFO:tasks.workunit.client.0.smithi071.stdout:6/829: read d4/da/df/d2e/d3a/d51/fc0 [2757510,49988] 0 2024-09-10T10:04:32.488 INFO:tasks.workunit.client.0.smithi071.stdout:5/971: dread - dc/df/f13a zero size 2024-09-10T10:04:32.490 INFO:tasks.workunit.client.0.smithi071.stdout:4/869: creat db/d1d/d61/d6a/f12b x:0 0 0 2024-09-10T10:04:32.491 INFO:tasks.workunit.client.0.smithi071.stdout:3/976: write d3/fc6 [138686,18431] 0 2024-09-10T10:04:32.496 INFO:tasks.workunit.client.0.smithi071.stdout:3/977: unlink d3/d49/d2f/f35 0 2024-09-10T10:04:32.502 INFO:tasks.workunit.client.0.smithi071.stdout:6/830: rename d4/da/df/d2e/d3a/d51/f9a to d4/da/df/d2e/dc2/f113 0 2024-09-10T10:04:32.502 INFO:tasks.workunit.client.0.smithi071.stdout:1/985: dwrite d1/d21/d3d/d9a/df9/ff7 [0,4194304] 0 2024-09-10T10:04:32.504 INFO:tasks.workunit.client.0.smithi071.stdout:4/870: dwrite db/d1d/d61/dcd/f10a [0,4194304] 0 2024-09-10T10:04:32.504 INFO:tasks.workunit.client.0.smithi071.stdout:1/986: chown d1/d21/f24 31 1 2024-09-10T10:04:32.506 INFO:tasks.workunit.client.0.smithi071.stdout:3/978: read d3/d49/d34/deb/d13c/da1/d42/d4a/d60/fb6 [51073,21955] 0 2024-09-10T10:04:32.507 INFO:tasks.workunit.client.0.smithi071.stdout:2/994: truncate d8/d87/d33/d41/d4d/d52/fe4 119337 0 2024-09-10T10:04:32.508 INFO:tasks.workunit.client.0.smithi071.stdout:6/831: symlink d4/da/df/d2e/d10c/l114 0 2024-09-10T10:04:32.509 INFO:tasks.workunit.client.0.smithi071.stdout:1/987: read - d1/d21/d2f/f46 zero size 2024-09-10T10:04:32.515 INFO:tasks.workunit.client.0.smithi071.stdout:8/971: dwrite d5/df/d57/fba [4194304,4194304] 0 2024-09-10T10:04:32.515 INFO:tasks.workunit.client.0.smithi071.stdout:2/995: unlink d8/d87/d33/d53/l68 0 2024-09-10T10:04:32.516 INFO:tasks.workunit.client.0.smithi071.stdout:1/988: rmdir d1/d3f/d115/d148/d152 39 2024-09-10T10:04:32.520 INFO:tasks.workunit.client.0.smithi071.stdout:5/972: dwrite dc/df/d29/d48/dae/db6/feb [4194304,4194304] 0 2024-09-10T10:04:32.520 INFO:tasks.workunit.client.0.smithi071.stdout:3/979: write d3/d49/d34/deb/d13c/da1/d5d/d8f/fdb [2836459,74554] 0 2024-09-10T10:04:32.523 INFO:tasks.workunit.client.0.smithi071.stdout:8/972: symlink d5/df/d74/l152 0 2024-09-10T10:04:32.525 INFO:tasks.workunit.client.0.smithi071.stdout:3/980: mknod d3/d20/d8d/c147 0 2024-09-10T10:04:32.527 INFO:tasks.workunit.client.0.smithi071.stdout:3/981: chown d3/d49/d34/lb4 23114662 1 2024-09-10T10:04:32.527 INFO:tasks.workunit.client.0.smithi071.stdout:5/973: creat dc/df/d17/d8d/d135/f14b x:0 0 0 2024-09-10T10:04:32.528 INFO:tasks.workunit.client.0.smithi071.stdout:6/832: creat d4/da/df/d2e/d3a/d91/dc7/d81/f115 x:0 0 0 2024-09-10T10:04:32.528 INFO:tasks.workunit.client.0.smithi071.stdout:4/871: getdents db/d15/d26/d43/d4d/d9f/da6/d104 0 2024-09-10T10:04:32.529 INFO:tasks.workunit.client.0.smithi071.stdout:5/974: chown dc/df/d3e/d5a/fca 1 1 2024-09-10T10:04:32.529 INFO:tasks.workunit.client.0.smithi071.stdout:2/996: read d8/d87/f76 [3648767,118040] 0 2024-09-10T10:04:32.530 INFO:tasks.workunit.client.0.smithi071.stdout:8/973: rmdir d5/dfe 0 2024-09-10T10:04:32.531 INFO:tasks.workunit.client.0.smithi071.stdout:4/872: unlink db/la7 0 2024-09-10T10:04:32.531 INFO:tasks.workunit.client.0.smithi071.stdout:3/982: write d3/d20/d99/fff [4398891,15122] 0 2024-09-10T10:04:32.532 INFO:tasks.workunit.client.0.smithi071.stdout:8/974: fsync d5/fd2 0 2024-09-10T10:04:32.532 INFO:tasks.workunit.client.1.smithi107.stdout:7/991: sync 2024-09-10T10:04:32.533 INFO:tasks.workunit.client.0.smithi071.stdout:5/975: dread - dc/df/d29/d48/dae/fc0 zero size 2024-09-10T10:04:32.533 INFO:tasks.workunit.client.0.smithi071.stdout:4/873: stat db/d15/d17/f60 0 2024-09-10T10:04:32.535 INFO:tasks.workunit.client.1.smithi107.stdout:7/992: unlink d0/d8/fa8 0 2024-09-10T10:04:32.536 INFO:tasks.workunit.client.1.smithi107.stdout:7/993: write d0/d8/f84 [1302666,69452] 0 2024-09-10T10:04:32.539 INFO:tasks.workunit.client.1.smithi107.stdout:7/994: getdents d0/d20/d35 0 2024-09-10T10:04:32.541 INFO:tasks.workunit.client.1.smithi107.stdout:7/995: write d0/d20/ddf/ffe [317239,35161] 0 2024-09-10T10:04:32.545 INFO:tasks.workunit.client.1.smithi107.stdout:7/996: write d0/d8/d5c/fa2 [600296,70465] 0 2024-09-10T10:04:32.547 INFO:tasks.workunit.client.0.smithi071.stdout:3/983: fdatasync d3/d20/d99/d9b/dde/d118/f131 0 2024-09-10T10:04:32.548 INFO:tasks.workunit.client.0.smithi071.stdout:1/989: write d1/d35/fa8 [3609122,110049] 0 2024-09-10T10:04:32.549 INFO:tasks.workunit.client.0.smithi071.stdout:8/975: mknod d5/df/d1e/d70/c153 0 2024-09-10T10:04:32.549 INFO:tasks.workunit.client.0.smithi071.stdout:2/997: link d8/d38/d63/fb7 d8/d38/f14c 0 2024-09-10T10:04:32.550 INFO:tasks.workunit.client.0.smithi071.stdout:3/984: fsync d3/d10/d24/d2b/db2/ffc 0 2024-09-10T10:04:32.550 INFO:tasks.workunit.client.0.smithi071.stdout:4/874: rmdir db/d15/d26/d43/d4d/d77 39 2024-09-10T10:04:32.551 INFO:tasks.workunit.client.0.smithi071.stdout:5/976: mknod dc/df/d3e/d5a/d80/d8a/d13c/c14c 0 2024-09-10T10:04:32.552 INFO:tasks.workunit.client.0.smithi071.stdout:1/990: chown d1/d21/d2f/d30/f138 11933 1 2024-09-10T10:04:32.552 INFO:tasks.workunit.client.0.smithi071.stdout:5/977: readlink dc/l37 0 2024-09-10T10:04:32.552 INFO:tasks.workunit.client.0.smithi071.stdout:2/998: mkdir d8/d87/dc4/dea/d14d 0 2024-09-10T10:04:32.553 INFO:tasks.workunit.client.0.smithi071.stdout:1/991: rmdir d1/d3f/d115/d148 39 2024-09-10T10:04:32.557 INFO:tasks.workunit.client.0.smithi071.stdout:8/976: symlink d5/df/d1d/d86/d75/l154 0 2024-09-10T10:04:32.561 INFO:tasks.workunit.client.0.smithi071.stdout:1/992: rename d1/d3f/d115/d148/d152/ld6 to d1/d21/d2f/d30/d6a/d91/d9d/l15c 0 2024-09-10T10:04:32.563 INFO:tasks.workunit.client.0.smithi071.stdout:8/977: mknod d5/df/d1d/d86/d75/d85/c155 0 2024-09-10T10:04:32.563 INFO:tasks.workunit.client.0.smithi071.stdout:1/993: mkdir d1/d21/d3d/d4a/d15d 0 2024-09-10T10:04:32.564 INFO:tasks.workunit.client.0.smithi071.stdout:8/978: write d5/df/fcf [291781,97066] 0 2024-09-10T10:04:32.566 INFO:tasks.workunit.client.0.smithi071.stdout:1/994: creat d1/d3f/d58/f15e x:0 0 0 2024-09-10T10:04:32.569 INFO:tasks.workunit.client.1.smithi107.stdout:7/997: dread d0/d1b/d4d/fed [0,4194304] 0 2024-09-10T10:04:32.570 INFO:tasks.workunit.client.0.smithi071.stdout:4/875: dread db/d1d/d61/d6a/fd4 [0,4194304] 0 2024-09-10T10:04:32.571 INFO:tasks.workunit.client.0.smithi071.stdout:2/999: dwrite d8/d87/f1c [0,4194304] 0 2024-09-10T10:04:32.571 INFO:tasks.workunit.client.0.smithi071.stdout:1/995: write d1/d21/d3d/d9a/d101/f155 [598319,119107] 0 2024-09-10T10:04:32.571 INFO:tasks.workunit.client.0.smithi071.stdout:5/978: dread dc/d53/f7f [0,4194304] 0 2024-09-10T10:04:32.573 INFO:tasks.workunit.client.0.smithi071.stdout:5/979: readlink dc/df/d29/l4f 0 2024-09-10T10:04:32.573 INFO:tasks.workunit.client.0.smithi071.stdout:8/979: dread d5/df/d1d/d86/d75/f121 [0,4194304] 0 2024-09-10T10:04:32.574 INFO:tasks.workunit.client.0.smithi071.stdout:5/980: write dc/d53/f123 [112944,26782] 0 2024-09-10T10:04:32.575 INFO:tasks.workunit.client.1.smithi107.stdout:7/998: link d0/d1b/d4d/cef d0/d8/d56/dcc/d81/d134/c142 0 2024-09-10T10:04:32.575 INFO:tasks.workunit.client.1.smithi107.stdout:7/999: chown d0/d20/ce1 0 1 2024-09-10T10:04:32.576 INFO:tasks.workunit.client.0.smithi071.stdout:5/981: write dc/df/d29/d94/fcc [1677941,56139] 0 2024-09-10T10:04:32.577 INFO:tasks.workunit.client.0.smithi071.stdout:4/876: creat db/d15/d17/d4e/dc0/f12c x:0 0 0 2024-09-10T10:04:32.578 INFO:tasks.workunit.client.0.smithi071.stdout:5/982: write dc/df/d3e/d5a/d80/ff1 [484319,19893] 0 2024-09-10T10:04:32.581 INFO:tasks.workunit.client.1.smithi107.stderr:+ rm -rf -- ./tmp.5K5xN91LOm 2024-09-10T10:04:32.582 INFO:tasks.workunit.client.0.smithi071.stdout:1/996: write d1/d21/d2f/d30/d6a/f6d [4353555,53400] 0 2024-09-10T10:04:32.587 INFO:tasks.workunit.client.0.smithi071.stdout:4/877: write db/d15/d26/d43/d4d/f39 [1485156,23305] 0 2024-09-10T10:04:32.591 INFO:tasks.workunit.client.0.smithi071.stdout:8/980: dwrite d5/d36/d49/fd8 [0,4194304] 0 2024-09-10T10:04:32.600 INFO:tasks.workunit.client.0.smithi071.stdout:8/981: dread d5/df/d1e/d38/fb1 [0,4194304] 0 2024-09-10T10:04:32.602 INFO:tasks.workunit.client.0.smithi071.stdout:1/997: dwrite d1/d21/d2f/d30/d6a/d91/fa1 [0,4194304] 0 2024-09-10T10:04:32.603 INFO:tasks.workunit.client.0.smithi071.stdout:4/878: dwrite db/d15/d26/d43/d4d/d9f/fa4 [0,4194304] 0 2024-09-10T10:04:32.606 INFO:tasks.workunit.client.0.smithi071.stdout:4/879: mkdir db/d15/d12d 0 2024-09-10T10:04:32.609 INFO:tasks.workunit.client.0.smithi071.stdout:1/998: unlink d1/d57/lbd 0 2024-09-10T10:04:32.611 INFO:tasks.workunit.client.0.smithi071.stdout:8/982: rename d5/df/d1d/d86/d75/d85/l11c to d5/df/d1e/d70/dc7/l156 0 2024-09-10T10:04:32.612 INFO:tasks.workunit.client.0.smithi071.stdout:1/999: chown d1/d3f/d115/f119 10930815 1 2024-09-10T10:04:32.612 INFO:tasks.workunit.client.0.smithi071.stdout:4/880: truncate db/d15/d26/d43/d4d/fe2 360511 0 2024-09-10T10:04:32.614 INFO:tasks.workunit.client.0.smithi071.stdout:5/983: dread dc/d53/db2/fc4 [0,4194304] 0 2024-09-10T10:04:32.614 INFO:tasks.workunit.client.0.smithi071.stdout:8/983: chown d5/df/d1d/d81/d10c/f134 769 1 2024-09-10T10:04:32.617 INFO:tasks.workunit.client.0.smithi071.stdout:8/984: write d5/df/d1d/d86/d75/f7b [283127,59190] 0 2024-09-10T10:04:32.621 INFO:tasks.workunit.client.0.smithi071.stdout:8/985: rename d5/d36/d49/f4f to d5/df/d57/d82/d12e/d151/f157 0 2024-09-10T10:04:32.625 INFO:tasks.workunit.client.0.smithi071.stdout:8/986: rename d5/df/d1d/f11f to d5/df/d1d/d81/f158 0 2024-09-10T10:04:32.627 INFO:tasks.workunit.client.0.smithi071.stdout:8/987: mknod d5/df/d57/d82/d12e/d151/c159 0 2024-09-10T10:04:32.627 INFO:tasks.workunit.client.0.smithi071.stdout:4/881: write db/d15/d4b/fb3 [226549,126915] 0 2024-09-10T10:04:32.628 INFO:tasks.workunit.client.0.smithi071.stdout:5/984: write dc/df/d3e/d5a/f5e [1938273,89235] 0 2024-09-10T10:04:32.630 INFO:tasks.workunit.client.0.smithi071.stdout:8/988: chown d5/df/d1d/d86/db7/cd4 124 1 2024-09-10T10:04:32.635 INFO:tasks.workunit.client.0.smithi071.stdout:8/989: creat d5/df/d1d/d86/d75/d85/f15a x:0 0 0 2024-09-10T10:04:32.636 INFO:tasks.workunit.client.0.smithi071.stdout:4/882: dwrite db/d15/d17/d4e/f5b [4194304,4194304] 0 2024-09-10T10:04:32.639 INFO:tasks.workunit.client.0.smithi071.stdout:4/883: readlink db/d15/d17/d4e/d5a/l103 0 2024-09-10T10:04:32.642 INFO:tasks.workunit.client.0.smithi071.stdout:8/990: creat d5/df/d1d/d81/f15b x:0 0 0 2024-09-10T10:04:32.644 INFO:tasks.workunit.client.0.smithi071.stdout:5/985: dwrite dc/df/d3e/d5a/d80/fe5 [0,4194304] 0 2024-09-10T10:04:32.645 INFO:tasks.workunit.client.0.smithi071.stdout:8/991: dread - d5/df/d1d/d86/d90/d109/f123 zero size 2024-09-10T10:04:32.651 INFO:tasks.workunit.client.0.smithi071.stdout:8/992: rename d5/df/df7/f107 to d5/df/d57/d82/d12e/f15c 0 2024-09-10T10:04:32.651 INFO:tasks.workunit.client.0.smithi071.stdout:8/993: readlink d5/df/d67/la2 0 2024-09-10T10:04:32.652 INFO:tasks.workunit.client.0.smithi071.stdout:5/986: dread dc/df/d3e/d5a/dd4/fd9 [0,4194304] 0 2024-09-10T10:04:32.655 INFO:tasks.workunit.client.0.smithi071.stdout:5/987: symlink dc/df/d17/d8d/l14d 0 2024-09-10T10:04:32.658 INFO:tasks.workunit.client.0.smithi071.stdout:5/988: creat dc/d53/d79/f14e x:0 0 0 2024-09-10T10:04:32.658 INFO:tasks.workunit.client.0.smithi071.stdout:8/994: dwrite d5/df/d1e/d38/d9f/f145 [0,4194304] 0 2024-09-10T10:04:32.660 INFO:tasks.workunit.client.0.smithi071.stdout:5/989: creat dc/df/d29/d94/f14f x:0 0 0 2024-09-10T10:04:32.662 INFO:tasks.workunit.client.0.smithi071.stdout:8/995: unlink d5/df/d1e/l2a 0 2024-09-10T10:04:32.665 INFO:tasks.workunit.client.0.smithi071.stdout:8/996: write d5/df/d74/fe6 [3574567,22050] 0 2024-09-10T10:04:32.666 INFO:tasks.workunit.client.0.smithi071.stdout:4/884: dread db/d15/d26/d43/d82/f83 [0,4194304] 0 2024-09-10T10:04:32.666 INFO:tasks.workunit.client.0.smithi071.stdout:5/990: creat dc/df/d3e/d5a/d80/d8a/da3/d111/d142/f150 x:0 0 0 2024-09-10T10:04:32.669 INFO:tasks.workunit.client.0.smithi071.stdout:8/997: creat d5/df/d57/d82/d12e/d151/f15d x:0 0 0 2024-09-10T10:04:32.675 INFO:tasks.workunit.client.0.smithi071.stdout:8/998: link d5/df/d95/le8 d5/df/d1e/d70/d14d/l15e 0 2024-09-10T10:04:32.676 INFO:tasks.workunit.client.0.smithi071.stdout:5/991: write dc/df/ff4 [578155,94521] 0 2024-09-10T10:04:32.677 INFO:tasks.workunit.client.0.smithi071.stdout:5/992: readlink dc/d4a/la9 0 2024-09-10T10:04:32.678 INFO:tasks.workunit.client.0.smithi071.stdout:8/999: fdatasync d5/d36/f133 0 2024-09-10T10:04:32.681 INFO:tasks.workunit.client.0.smithi071.stdout:4/885: dwrite db/d15/d26/fb9 [0,4194304] 0 2024-09-10T10:04:32.681 INFO:tasks.workunit.client.0.smithi071.stdout:5/993: rename dc/d53/db2/c141 to dc/d4a/dbb/c151 0 2024-09-10T10:04:32.682 INFO:tasks.workunit.client.0.smithi071.stdout:5/994: fdatasync dc/df/d29/d48/dae/db6/f12d 0 2024-09-10T10:04:32.685 INFO:tasks.workunit.client.0.smithi071.stdout:4/886: creat db/f12e x:0 0 0 2024-09-10T10:04:32.687 INFO:tasks.workunit.client.0.smithi071.stdout:4/887: write db/d15/d17/f93 [1129052,82130] 0 2024-09-10T10:04:32.691 INFO:tasks.workunit.client.0.smithi071.stdout:5/995: dwrite dc/df/d3e/d5a/d80/d8a/d13c/f143 [0,4194304] 0 2024-09-10T10:04:32.695 INFO:tasks.workunit.client.0.smithi071.stdout:4/888: rename db/d15/d17/d4e/d5a/c112 to db/d1d/d61/d6a/c12f 0 2024-09-10T10:04:32.696 INFO:tasks.workunit.client.0.smithi071.stdout:4/889: chown db/d1d/d61/d6a/d88/d90/f97 1894 1 2024-09-10T10:04:32.696 INFO:tasks.workunit.client.0.smithi071.stdout:5/996: read dc/df/d3e/f52 [2923642,126863] 0 2024-09-10T10:04:32.699 INFO:tasks.workunit.client.0.smithi071.stdout:4/890: symlink db/d1d/d61/dcd/l130 0 2024-09-10T10:04:32.700 INFO:tasks.workunit.client.0.smithi071.stdout:4/891: chown db/d15/d26/f91 1 1 2024-09-10T10:04:32.701 INFO:tasks.workunit.client.0.smithi071.stdout:5/997: rename dc/df/d29/d94/fd8 to dc/df/dd7/d87/f152 0 2024-09-10T10:04:32.703 INFO:tasks.workunit.client.0.smithi071.stdout:4/892: rename db/c116 to db/d15/d26/d43/d82/c131 0 2024-09-10T10:04:32.706 INFO:tasks.workunit.client.0.smithi071.stdout:5/998: getdents dc/df/d3e/d5a/d80 0 2024-09-10T10:04:32.707 INFO:tasks.workunit.client.0.smithi071.stdout:4/893: truncate db/d15/d17/d4e/d5a/dd3/fef 1220384 0 2024-09-10T10:04:32.711 INFO:tasks.workunit.client.0.smithi071.stdout:5/999: link dc/df/d3e/d5a/dd4/lde dc/df/d3e/d5a/d80/l153 0 2024-09-10T10:04:32.713 INFO:tasks.workunit.client.0.smithi071.stdout:4/894: dwrite db/d8f/fb1 [0,4194304] 0 2024-09-10T10:04:32.716 INFO:tasks.workunit.client.0.smithi071.stdout:4/895: rmdir db/d1d/d61/d6a/d88 39 2024-09-10T10:04:32.734 INFO:tasks.workunit.client.0.smithi071.stdout:4/896: dread db/d15/d26/f63 [0,4194304] 0 2024-09-10T10:04:32.736 INFO:tasks.workunit.client.0.smithi071.stdout:4/897: unlink db/d15/d17/d4e/d5a/d8d/l99 0 2024-09-10T10:04:32.737 INFO:tasks.workunit.client.0.smithi071.stdout:4/898: write db/d15/d17/d4e/f110 [222593,70443] 0 2024-09-10T10:04:32.738 INFO:tasks.workunit.client.0.smithi071.stdout:4/899: chown db/d15/d26/f91 35 1 2024-09-10T10:04:32.740 INFO:tasks.workunit.client.0.smithi071.stdout:4/900: mknod db/d15/d17/d4e/c132 0 2024-09-10T10:04:32.741 INFO:tasks.workunit.client.0.smithi071.stdout:4/901: readlink db/d15/d26/d43/d4d/d9f/da6/lb0 0 2024-09-10T10:04:32.741 INFO:tasks.workunit.client.0.smithi071.stdout:4/902: fdatasync db/d8f/f117 0 2024-09-10T10:04:32.750 INFO:tasks.workunit.client.0.smithi071.stdout:4/903: dread db/d1d/f36 [0,4194304] 0 2024-09-10T10:04:32.762 INFO:tasks.workunit.client.0.smithi071.stdout:4/904: dwrite db/d15/d17/d4e/d5a/dd3/fef [0,4194304] 0 2024-09-10T10:04:32.767 INFO:tasks.workunit.client.0.smithi071.stdout:4/905: dwrite db/d15/d17/d4e/f6d [0,4194304] 0 2024-09-10T10:04:32.788 INFO:tasks.workunit.client.0.smithi071.stdout:4/906: dwrite db/d15/d26/d43/d4d/fa2 [0,4194304] 0 2024-09-10T10:04:32.791 INFO:tasks.workunit.client.0.smithi071.stdout:4/907: mkdir db/d15/d17/d113/d133 0 2024-09-10T10:04:32.999 INFO:tasks.workunit.client.0.smithi071.stdout:3/985: sync 2024-09-10T10:04:32.999 INFO:tasks.workunit.client.0.smithi071.stdout:6/833: sync 2024-09-10T10:04:33.004 INFO:tasks.workunit.client.0.smithi071.stdout:6/834: creat d4/da/df/d2e/d3a/d40/d60/dff/f116 x:0 0 0 2024-09-10T10:04:33.006 INFO:tasks.workunit.client.0.smithi071.stdout:6/835: unlink d4/da/df/d2e/d3a/d91/f96 0 2024-09-10T10:04:33.012 INFO:tasks.workunit.client.0.smithi071.stdout:6/836: write d4/da/df/d2e/d3a/d51/d64/f9e [837003,50466] 0 2024-09-10T10:04:33.012 INFO:tasks.workunit.client.0.smithi071.stdout:3/986: dwrite d3/d49/d34/deb/d13c/da1/f51 [0,4194304] 0 2024-09-10T10:04:33.015 INFO:tasks.workunit.client.0.smithi071.stdout:6/837: getdents d4/da 0 2024-09-10T10:04:33.017 INFO:tasks.workunit.client.0.smithi071.stdout:3/987: truncate d3/d49/d34/deb/d13c/f69 2925702 0 2024-09-10T10:04:33.019 INFO:tasks.workunit.client.0.smithi071.stdout:3/988: symlink d3/d49/d2f/l148 0 2024-09-10T10:04:33.020 INFO:tasks.workunit.client.0.smithi071.stdout:6/838: getdents d4/da/df/d2e/d3a/d91/dc7 0 2024-09-10T10:04:33.022 INFO:tasks.workunit.client.0.smithi071.stdout:6/839: fdatasync d4/da/df/d2e/d3a/d91/dc7/d81/db2/fb6 0 2024-09-10T10:04:33.022 INFO:tasks.workunit.client.0.smithi071.stdout:6/840: chown d4/da/df/d2e/d10c 13 1 2024-09-10T10:04:33.023 INFO:tasks.workunit.client.0.smithi071.stdout:3/989: creat d3/d49/d34/deb/d13c/da1/d5d/da5/f149 x:0 0 0 2024-09-10T10:04:33.028 INFO:tasks.workunit.client.0.smithi071.stdout:6/841: creat d4/da/df/d2e/d3a/d91/f117 x:0 0 0 2024-09-10T10:04:33.028 INFO:tasks.workunit.client.0.smithi071.stdout:3/990: rmdir d3/d49/d34/deb/d13c/da1/d42/d4a 39 2024-09-10T10:04:33.029 INFO:tasks.workunit.client.0.smithi071.stdout:3/991: rename d3/d20/d8d to d3/d10/d24/d2b/d14a 0 2024-09-10T10:04:33.031 INFO:tasks.workunit.client.0.smithi071.stdout:3/992: read - d3/d49/d2f/d7f/fa0 zero size 2024-09-10T10:04:33.032 INFO:tasks.workunit.client.0.smithi071.stdout:6/842: write d4/da/df/d2e/d3a/d40/f55 [4749916,59645] 0 2024-09-10T10:04:33.035 INFO:tasks.workunit.client.0.smithi071.stdout:3/993: creat d3/d49/d34/deb/d13c/da1/d5d/da5/f14b x:0 0 0 2024-09-10T10:04:33.035 INFO:tasks.workunit.client.0.smithi071.stdout:6/843: mkdir d4/da/df/d2e/d3a/d40/d60/d7a/dbd/d118 0 2024-09-10T10:04:33.037 INFO:tasks.workunit.client.0.smithi071.stdout:3/994: dread - d3/d49/d34/deb/d13c/da1/d5d/d7a/fdf zero size 2024-09-10T10:04:33.042 INFO:tasks.workunit.client.0.smithi071.stdout:3/995: link d3/f41 d3/d49/d34/d67/df9/f14c 0 2024-09-10T10:04:33.043 INFO:tasks.workunit.client.0.smithi071.stdout:6/844: write d4/da/df/d2e/d3a/d51/f94 [112846,85809] 0 2024-09-10T10:04:33.046 INFO:tasks.workunit.client.0.smithi071.stdout:6/845: creat d4/ded/f119 x:0 0 0 2024-09-10T10:04:33.047 INFO:tasks.workunit.client.0.smithi071.stdout:3/996: truncate d3/d49/d34/deb/d13c/da1/d5d/da5/db3/fd5 4567155 0 2024-09-10T10:04:33.049 INFO:tasks.workunit.client.0.smithi071.stdout:3/997: read d3/d49/d34/deb/d13c/da1/d3a/f68 [1882767,77566] 0 2024-09-10T10:04:33.066 INFO:tasks.workunit.client.0.smithi071.stdout:6/846: dread d4/d61/d83/f9f [0,4194304] 0 2024-09-10T10:04:33.071 INFO:tasks.workunit.client.0.smithi071.stdout:6/847: write d4/da/df/d2e/d3a/d3e/f77 [910639,15391] 0 2024-09-10T10:04:33.074 INFO:tasks.workunit.client.0.smithi071.stdout:6/848: creat d4/da/df/d2e/d3a/d91/dc7/f11a x:0 0 0 2024-09-10T10:04:33.079 INFO:tasks.workunit.client.0.smithi071.stdout:6/849: write d4/da/df/d2e/d3a/d91/dc7/d81/d95/f107 [250652,42040] 0 2024-09-10T10:04:33.082 INFO:tasks.workunit.client.0.smithi071.stdout:6/850: write d4/da/df/d2e/d3a/d91/dc7/f109 [1857020,110015] 0 2024-09-10T10:04:33.085 INFO:tasks.workunit.client.0.smithi071.stdout:6/851: mknod d4/da/df/d2e/d3a/d40/d60/dff/c11b 0 2024-09-10T10:04:33.086 INFO:tasks.workunit.client.0.smithi071.stdout:6/852: read - d4/da/df/d2e/d10c/f102 zero size 2024-09-10T10:04:33.092 INFO:tasks.workunit.client.0.smithi071.stdout:6/853: dwrite d4/da/f82 [0,4194304] 0 2024-09-10T10:04:33.096 INFO:tasks.workunit.client.0.smithi071.stdout:6/854: creat d4/da/df/d2e/d3a/d40/d60/d7a/dbd/f11c x:0 0 0 2024-09-10T10:04:33.099 INFO:tasks.workunit.client.0.smithi071.stdout:6/855: symlink d4/da/df/d5e/l11d 0 2024-09-10T10:04:33.100 INFO:tasks.workunit.client.0.smithi071.stdout:6/856: fsync d4/da/df/d2e/d3a/d91/dc7/d81/d95/f107 0 2024-09-10T10:04:33.105 INFO:tasks.workunit.client.0.smithi071.stdout:6/857: read d4/da/df/f53 [3553015,83221] 0 2024-09-10T10:04:33.107 INFO:tasks.workunit.client.0.smithi071.stdout:6/858: symlink d4/da/df/d2e/dc2/l11e 0 2024-09-10T10:04:33.118 INFO:tasks.workunit.client.0.smithi071.stdout:6/859: dwrite d4/da/df/f50 [0,4194304] 0 2024-09-10T10:04:33.120 INFO:tasks.workunit.client.0.smithi071.stdout:6/860: mknod d4/da/c11f 0 2024-09-10T10:04:33.143 INFO:tasks.workunit.client.0.smithi071.stdout:6/861: dread d4/da/df/d5e/f75 [0,4194304] 0 2024-09-10T10:04:33.144 INFO:tasks.workunit.client.0.smithi071.stdout:6/862: read - d4/da/df/d2e/d3a/d43/ff8 zero size 2024-09-10T10:04:33.145 INFO:tasks.workunit.client.0.smithi071.stdout:6/863: dread - d4/da/df/d2e/d3a/d91/dc7/f11a zero size 2024-09-10T10:04:33.148 INFO:tasks.workunit.client.0.smithi071.stdout:6/864: mknod d4/da/df/d2e/d3a/d51/c120 0 2024-09-10T10:04:33.151 INFO:tasks.workunit.client.0.smithi071.stdout:6/865: mknod d4/da/df/d2e/d3a/d91/dc7/d81/c121 0 2024-09-10T10:04:33.153 INFO:tasks.workunit.client.0.smithi071.stdout:6/866: creat d4/da/f122 x:0 0 0 2024-09-10T10:04:33.155 INFO:tasks.workunit.client.0.smithi071.stdout:6/867: creat d4/da/df/d2e/d3a/d3e/f123 x:0 0 0 2024-09-10T10:04:33.159 INFO:tasks.workunit.client.0.smithi071.stdout:6/868: rename d4/ded to d4/da/df/d2e/d3a/d91/dc7/df0/d124 0 2024-09-10T10:04:33.162 INFO:tasks.workunit.client.0.smithi071.stdout:6/869: creat d4/da/df/d2e/d3a/da9/dbc/f125 x:0 0 0 2024-09-10T10:04:33.164 INFO:tasks.workunit.client.0.smithi071.stdout:6/870: truncate f1 5016793 0 2024-09-10T10:04:33.165 INFO:tasks.workunit.client.0.smithi071.stdout:6/871: fdatasync d4/da/df/d2e/d3a/da9/dbc/f125 0 2024-09-10T10:04:33.167 INFO:tasks.workunit.client.0.smithi071.stdout:6/872: creat d4/da/df/d2e/d3a/d91/dc7/df0/d124/f126 x:0 0 0 2024-09-10T10:04:33.168 INFO:tasks.workunit.client.0.smithi071.stdout:6/873: chown d4/da/df/d5e/ld6 8 1 2024-09-10T10:04:33.169 INFO:tasks.workunit.client.0.smithi071.stdout:6/874: mknod d4/da/df/d2e/d3a/d43/dc8/c127 0 2024-09-10T10:04:33.172 INFO:tasks.workunit.client.0.smithi071.stdout:6/875: mknod d4/da/df/d2e/d3a/d40/d60/d7a/def/c128 0 2024-09-10T10:04:33.173 INFO:tasks.workunit.client.0.smithi071.stdout:6/876: dread - d4/da/df/d2e/d3a/d91/dc7/df0/f110 zero size 2024-09-10T10:04:33.175 INFO:tasks.workunit.client.0.smithi071.stdout:6/877: mknod d4/d61/d83/c129 0 2024-09-10T10:04:33.183 INFO:tasks.workunit.client.0.smithi071.stdout:6/878: write d4/da/df/d2e/d3a/d40/d60/f7c [4340613,125909] 0 2024-09-10T10:04:33.185 INFO:tasks.workunit.client.0.smithi071.stdout:6/879: truncate d4/f27 4100944 0 2024-09-10T10:04:33.187 INFO:tasks.workunit.client.0.smithi071.stdout:6/880: mkdir d4/da/df/d2e/d3a/d40/d60/dff/d12a 0 2024-09-10T10:04:33.189 INFO:tasks.workunit.client.0.smithi071.stdout:6/881: mkdir d4/da/df/d2e/d12b 0 2024-09-10T10:04:33.191 INFO:tasks.workunit.client.0.smithi071.stdout:6/882: mkdir d4/d61/d83/da8/d12c 0 2024-09-10T10:04:33.193 INFO:tasks.workunit.client.0.smithi071.stdout:6/883: mknod d4/da/df/d2e/d3a/d91/dc7/d81/d95/c12d 0 2024-09-10T10:04:33.195 INFO:tasks.workunit.client.0.smithi071.stdout:6/884: symlink d4/da/df/d2e/d3a/d40/d60/d7a/def/l12e 0 2024-09-10T10:04:33.197 INFO:tasks.workunit.client.0.smithi071.stdout:6/885: symlink d4/da/df/d2e/d3a/da9/l12f 0 2024-09-10T10:04:33.199 INFO:tasks.workunit.client.0.smithi071.stdout:6/886: chown d4/da/df/d2e/d3a/d40/d60/d7a/dbd/c10b 214342 1 2024-09-10T10:04:33.199 INFO:tasks.workunit.client.0.smithi071.stdout:6/887: chown d4/da/df/d2e/d3a/d91/dc7/f8f 76 1 2024-09-10T10:04:33.202 INFO:tasks.workunit.client.0.smithi071.stdout:6/888: dread - d4/da/df/d2e/d3a/d51/d108/fe5 zero size 2024-09-10T10:04:33.205 INFO:tasks.workunit.client.0.smithi071.stdout:6/889: rename d4/d61/f69 to d4/da/df/d2e/d3a/d40/d60/d7a/dbd/d118/f130 0 2024-09-10T10:04:33.206 INFO:tasks.workunit.client.0.smithi071.stdout:6/890: mkdir d4/da/df/d2e/d12b/d131 0 2024-09-10T10:04:33.210 INFO:tasks.workunit.client.0.smithi071.stdout:6/891: link d4/da/df/d2e/d3a/d43/dc8/cf3 d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/c132 0 2024-09-10T10:04:33.210 INFO:tasks.workunit.client.0.smithi071.stdout:6/892: chown d4/da/df/d2e/d3a/d40/cc6 466149 1 2024-09-10T10:04:33.213 INFO:tasks.workunit.client.0.smithi071.stdout:6/893: creat d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/df9/f133 x:0 0 0 2024-09-10T10:04:33.215 INFO:tasks.workunit.client.0.smithi071.stdout:6/894: rmdir d4/da/df/d2e/d3a/d51/d64 39 2024-09-10T10:04:33.229 INFO:tasks.workunit.client.0.smithi071.stdout:6/895: dwrite d4/da/df/d5e/fd4 [0,4194304] 0 2024-09-10T10:04:33.232 INFO:tasks.workunit.client.0.smithi071.stdout:6/896: creat d4/f134 x:0 0 0 2024-09-10T10:04:33.233 INFO:tasks.workunit.client.0.smithi071.stdout:6/897: write d4/da/df/d2e/d3a/d43/dc8/fe2 [250132,93975] 0 2024-09-10T10:04:33.235 INFO:tasks.workunit.client.0.smithi071.stdout:6/898: write d4/da/df/d2e/d3a/d51/f94 [1015431,111633] 0 2024-09-10T10:04:33.238 INFO:tasks.workunit.client.0.smithi071.stdout:6/899: creat d4/da/df/d2e/d3a/d43/dc8/f135 x:0 0 0 2024-09-10T10:04:33.245 INFO:tasks.workunit.client.0.smithi071.stdout:6/900: dread d4/da/df/d2e/d3a/d51/d108/fcd [0,4194304] 0 2024-09-10T10:04:33.247 INFO:tasks.workunit.client.0.smithi071.stdout:6/901: write d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/fe0 [2866608,81255] 0 2024-09-10T10:04:33.250 INFO:tasks.workunit.client.0.smithi071.stdout:4/908: sync 2024-09-10T10:04:33.252 INFO:tasks.workunit.client.0.smithi071.stdout:4/909: chown db/d15/d17/d4e/d5a/d8d/faf 1955 1 2024-09-10T10:04:33.254 INFO:tasks.workunit.client.0.smithi071.stdout:4/910: write db/d15/d17/d4e/dc0/f108 [547283,51689] 0 2024-09-10T10:04:33.254 INFO:tasks.workunit.client.0.smithi071.stdout:6/902: dwrite d4/da/df/d2e/d3a/da9/dbc/f125 [0,4194304] 0 2024-09-10T10:04:33.257 INFO:tasks.workunit.client.0.smithi071.stdout:4/911: mknod db/d15/d17/d4e/d5a/dd3/c134 0 2024-09-10T10:04:33.258 INFO:tasks.workunit.client.0.smithi071.stdout:6/903: creat d4/da/df/d2e/d3a/d43/f136 x:0 0 0 2024-09-10T10:04:33.262 INFO:tasks.workunit.client.0.smithi071.stdout:4/912: rmdir db/d15/d17 39 2024-09-10T10:04:33.264 INFO:tasks.workunit.client.0.smithi071.stdout:6/904: mkdir d4/da/df/d2e/d3a/d51/d64/d137 0 2024-09-10T10:04:33.265 INFO:tasks.workunit.client.0.smithi071.stdout:4/913: fsync db/d15/d26/d43/d4d/d9f/f96 0 2024-09-10T10:04:33.268 INFO:tasks.workunit.client.0.smithi071.stdout:4/914: creat db/d15/de4/f135 x:0 0 0 2024-09-10T10:04:33.271 INFO:tasks.workunit.client.0.smithi071.stdout:6/905: dwrite d4/da/df/d2e/d3a/d91/dc7/f9c [0,4194304] 0 2024-09-10T10:04:33.272 INFO:tasks.workunit.client.0.smithi071.stdout:3/998: sync 2024-09-10T10:04:33.272 INFO:tasks.workunit.client.0.smithi071.stdout:4/915: creat db/d15/d17/d4e/d5a/d8d/f136 x:0 0 0 2024-09-10T10:04:33.274 INFO:tasks.workunit.client.0.smithi071.stdout:3/999: write d3/d49/d34/d67/f144 [975686,60487] 0 2024-09-10T10:04:33.274 INFO:tasks.workunit.client.0.smithi071.stdout:6/906: dread - d4/da/df/d2e/d3a/d43/dc8/f135 zero size 2024-09-10T10:04:33.277 INFO:tasks.workunit.client.0.smithi071.stdout:6/907: truncate d4/da/df/d2e/d3a/d91/dc7/f11a 502145 0 2024-09-10T10:04:33.278 INFO:tasks.workunit.client.0.smithi071.stdout:4/916: rename db/d1d/d61/c10d to db/d15/d17/d4e/dc0/dc2/c137 0 2024-09-10T10:04:33.281 INFO:tasks.workunit.client.0.smithi071.stdout:6/908: mkdir d4/da/df/d2e/d3a/d51/d138 0 2024-09-10T10:04:33.285 INFO:tasks.workunit.client.0.smithi071.stdout:4/917: rename db/d15/d17/d4e/d5a/d8d/f136 to db/d1d/d61/d6a/d88/d90/f138 0 2024-09-10T10:04:33.286 INFO:tasks.workunit.client.0.smithi071.stdout:4/918: dread - db/d1d/d61/f120 zero size 2024-09-10T10:04:33.286 INFO:tasks.workunit.client.0.smithi071.stdout:6/909: dread d4/da/df/d2e/d3a/d51/f94 [0,4194304] 0 2024-09-10T10:04:33.291 INFO:tasks.workunit.client.0.smithi071.stdout:6/910: getdents d4/da/df/d2e/d3a/d40/d60/d7a/dbd 0 2024-09-10T10:04:33.293 INFO:tasks.workunit.client.0.smithi071.stdout:6/911: symlink d4/da/df/d2e/d10c/l139 0 2024-09-10T10:04:33.295 INFO:tasks.workunit.client.0.smithi071.stdout:4/919: truncate db/d15/d17/d4e/dc0/f108 445742 0 2024-09-10T10:04:33.300 INFO:tasks.workunit.client.0.smithi071.stdout:6/912: truncate d4/da/df/d5e/f75 4036839 0 2024-09-10T10:04:33.301 INFO:tasks.workunit.client.0.smithi071.stdout:6/913: chown d4/d61/d83/da8 17 1 2024-09-10T10:04:33.302 INFO:tasks.workunit.client.0.smithi071.stdout:4/920: dwrite db/d15/d26/d43/d82/ffe [0,4194304] 0 2024-09-10T10:04:33.303 INFO:tasks.workunit.client.0.smithi071.stdout:6/914: write d4/da/f82 [4374512,109511] 0 2024-09-10T10:04:33.304 INFO:tasks.workunit.client.0.smithi071.stdout:4/921: truncate db/d15/f106 872632 0 2024-09-10T10:04:33.305 INFO:tasks.workunit.client.0.smithi071.stdout:6/915: chown d4/da/df/d2e/d3a/d91/dc7/l84 0 1 2024-09-10T10:04:33.305 INFO:tasks.workunit.client.0.smithi071.stdout:4/922: fdatasync db/d1d/faa 0 2024-09-10T10:04:33.307 INFO:tasks.workunit.client.0.smithi071.stdout:4/923: mknod db/da0/c139 0 2024-09-10T10:04:33.309 INFO:tasks.workunit.client.0.smithi071.stdout:4/924: fsync db/d15/d17/d4e/d5a/dd3/f11b 0 2024-09-10T10:04:33.312 INFO:tasks.workunit.client.0.smithi071.stdout:4/925: creat db/d1d/d61/d6a/d88/f13a x:0 0 0 2024-09-10T10:04:33.314 INFO:tasks.workunit.client.0.smithi071.stdout:4/926: mkdir db/d15/d17/d13b 0 2024-09-10T10:04:33.316 INFO:tasks.workunit.client.0.smithi071.stdout:4/927: mkdir db/d15/d17/d24/d13c 0 2024-09-10T10:04:33.318 INFO:tasks.workunit.client.0.smithi071.stdout:4/928: fdatasync db/d15/d17/f3d 0 2024-09-10T10:04:33.323 INFO:tasks.workunit.client.0.smithi071.stdout:4/929: getdents db/d15/d26/d43/d4d/d77/dd7/de7/dea 0 2024-09-10T10:04:33.325 INFO:tasks.workunit.client.0.smithi071.stdout:4/930: creat db/d15/d17/d24/f13d x:0 0 0 2024-09-10T10:04:33.327 INFO:tasks.workunit.client.0.smithi071.stdout:4/931: mknod db/d15/d17/d13b/c13e 0 2024-09-10T10:04:33.328 INFO:tasks.workunit.client.0.smithi071.stdout:4/932: symlink db/d15/d17/d4e/d5a/l13f 0 2024-09-10T10:04:33.330 INFO:tasks.workunit.client.0.smithi071.stdout:4/933: mkdir db/d15/d26/d43/d4d/d77/dd7/de7/dd0/d140 0 2024-09-10T10:04:33.332 INFO:tasks.workunit.client.0.smithi071.stdout:4/934: mkdir db/d15/d26/d43/d4d/d9f/da6/d141 0 2024-09-10T10:04:33.334 INFO:tasks.workunit.client.0.smithi071.stdout:4/935: mknod db/d1d/d61/d6a/c142 0 2024-09-10T10:04:33.336 INFO:tasks.workunit.client.0.smithi071.stdout:4/936: readlink db/d15/d17/d4e/d5a/d8d/lf8 0 2024-09-10T10:04:33.337 INFO:tasks.workunit.client.0.smithi071.stdout:4/937: symlink db/da0/l143 0 2024-09-10T10:04:33.338 INFO:tasks.workunit.client.0.smithi071.stdout:4/938: fsync db/d1d/faa 0 2024-09-10T10:04:33.338 INFO:tasks.workunit.client.0.smithi071.stdout:4/939: chown db/d15/d4b/f5f 4580664 1 2024-09-10T10:04:33.340 INFO:tasks.workunit.client.0.smithi071.stdout:4/940: mknod db/d1d/c144 0 2024-09-10T10:04:33.340 INFO:tasks.workunit.client.0.smithi071.stdout:4/941: stat db/d15/d26/d43/c45 0 2024-09-10T10:04:33.346 INFO:tasks.workunit.client.0.smithi071.stdout:4/942: dwrite db/d15/d4b/fe3 [0,4194304] 0 2024-09-10T10:04:33.373 INFO:tasks.workunit.client.0.smithi071.stdout:4/943: dread db/d15/d26/d43/d82/f89 [0,4194304] 0 2024-09-10T10:04:33.377 INFO:tasks.workunit.client.0.smithi071.stdout:4/944: rename db/d15/d17/d24 to db/d15/d26/d43/d4d/d145 0 2024-09-10T10:04:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.613+0000 7feca65a5640 1 -- 172.21.15.71:0/1263625430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca00fc700 msgr2=0x7feca00fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.613+0000 7feca65a5640 1 --2- 172.21.15.71:0/1263625430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca00fc700 0x7feca00fcb70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fec880048d0 tx=0x7fec88009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.613+0000 7feca65a5640 1 -- 172.21.15.71:0/1263625430 shutdown_connections 2024-09-10T10:04:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.613+0000 7feca65a5640 1 --2- 172.21.15.71:0/1263625430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca00fc700 0x7feca00fcb70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.613+0000 7feca65a5640 1 --2- 172.21.15.71:0/1263625430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feca00fb430 0x7feca00fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.613+0000 7feca65a5640 1 -- 172.21.15.71:0/1263625430 >> 172.21.15.71:0/1263625430 conn(0x7feca00f6c10 msgr2=0x7feca00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.613+0000 7feca65a5640 1 -- 172.21.15.71:0/1263625430 shutdown_connections 2024-09-10T10:04:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.613+0000 7feca65a5640 1 -- 172.21.15.71:0/1263625430 wait complete. 2024-09-10T10:04:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.614+0000 7feca65a5640 1 Processor -- start 2024-09-10T10:04:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.614+0000 7feca65a5640 1 -- start start 2024-09-10T10:04:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.614+0000 7feca65a5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca00fb430 0x7feca0113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.614+0000 7feca65a5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feca00fc700 0x7feca0113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.614+0000 7feca65a5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca0114200 con 0x7feca00fb430 2024-09-10T10:04:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.614+0000 7feca65a5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca0114a20 con 0x7feca00fc700 2024-09-10T10:04:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.614+0000 7fec9ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca00fb430 0x7feca0113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.614+0000 7fec9ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca00fb430 0x7feca0113670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58036/0 (socket says 172.21.15.71:58036) 2024-09-10T10:04:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.614+0000 7fec97fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feca00fc700 0x7feca0113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:33.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.614+0000 7fec9ffff640 1 -- 172.21.15.71:0/1316266137 learned_addr learned my addr 172.21.15.71:0/1316266137 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:33.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.615+0000 7fec9ffff640 1 -- 172.21.15.71:0/1316266137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feca00fc700 msgr2=0x7feca0113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:33.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.615+0000 7fec9ffff640 1 --2- 172.21.15.71:0/1316266137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feca00fc700 0x7feca0113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:33.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.615+0000 7fec9ffff640 1 -- 172.21.15.71:0/1316266137 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec88005040 con 0x7feca00fb430 2024-09-10T10:04:33.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.615+0000 7fec9ffff640 1 --2- 172.21.15.71:0/1316266137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca00fb430 0x7feca0113670 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fec9000eb70 tx=0x7fec9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:33.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.615+0000 7fec9d7fa640 1 -- 172.21.15.71:0/1316266137 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec90007c30 con 0x7feca00fb430 2024-09-10T10:04:33.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.615+0000 7fec9d7fa640 1 -- 172.21.15.71:0/1316266137 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fec9000f040 con 0x7feca00fb430 2024-09-10T10:04:33.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.615+0000 7feca65a5640 1 -- 172.21.15.71:0/1316266137 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca0114c50 con 0x7feca00fb430 2024-09-10T10:04:33.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.615+0000 7fec9d7fa640 1 -- 172.21.15.71:0/1316266137 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec9000ca60 con 0x7feca00fb430 2024-09-10T10:04:33.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.615+0000 7feca65a5640 1 -- 172.21.15.71:0/1316266137 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca01151f0 con 0x7feca00fb430 2024-09-10T10:04:33.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.616+0000 7feca65a5640 1 -- 172.21.15.71:0/1316266137 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca00fa890 con 0x7feca00fb430 2024-09-10T10:04:33.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.617+0000 7fec9d7fa640 1 -- 172.21.15.71:0/1316266137 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7fec9000cbc0 con 0x7feca00fb430 2024-09-10T10:04:33.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.617+0000 7fec9d7fa640 1 --2- 172.21.15.71:0/1316266137 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fec8c06e4a0 0x7fec8c070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:33.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.617+0000 7fec9d7fa640 1 -- 172.21.15.71:0/1316266137 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fec9008d820 con 0x7feca00fb430 2024-09-10T10:04:33.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.618+0000 7fec97fff640 1 --2- 172.21.15.71:0/1316266137 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fec8c06e4a0 0x7fec8c070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:33.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.618+0000 7fec97fff640 1 --2- 172.21.15.71:0/1316266137 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fec8c06e4a0 0x7fec8c070950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fec88007ac0 tx=0x7fec88035040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:33.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.622+0000 7fec9d7fa640 1 -- 172.21.15.71:0/1316266137 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fec90057390 con 0x7feca00fb430 2024-09-10T10:04:33.822 INFO:tasks.workunit.client.0.smithi071.stdout:6/916: sync 2024-09-10T10:04:33.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.895+0000 7feca65a5640 1 -- 172.21.15.71:0/1316266137 --> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feca0104000 con 0x7fec8c06e4a0 2024-09-10T10:04:33.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.896+0000 7fec9d7fa640 1 -- 172.21.15.71:0/1316266137 <== mgr.24391 v2:172.21.15.107:6828/591375611 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fec88039040 con 0x7fec8c06e4a0 2024-09-10T10:04:33.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.898+0000 7feca65a5640 1 -- 172.21.15.71:0/1316266137 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fec8c06e4a0 msgr2=0x7fec8c070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:33.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.898+0000 7feca65a5640 1 --2- 172.21.15.71:0/1316266137 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fec8c06e4a0 0x7fec8c070950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fec88007ac0 tx=0x7fec88035040 comp rx=0 tx=0).stop 2024-09-10T10:04:33.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.898+0000 7feca65a5640 1 -- 172.21.15.71:0/1316266137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca00fb430 msgr2=0x7feca0113670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:33.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.898+0000 7feca65a5640 1 --2- 172.21.15.71:0/1316266137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca00fb430 0x7feca0113670 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fec9000eb70 tx=0x7fec9000b040 comp rx=0 tx=0).stop 2024-09-10T10:04:33.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.898+0000 7feca65a5640 1 -- 172.21.15.71:0/1316266137 shutdown_connections 2024-09-10T10:04:33.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.898+0000 7feca65a5640 1 --2- 172.21.15.71:0/1316266137 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fec8c06e4a0 0x7fec8c070950 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:33.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.898+0000 7feca65a5640 1 --2- 172.21.15.71:0/1316266137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feca00fc700 0x7feca0113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:33.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.898+0000 7feca65a5640 1 --2- 172.21.15.71:0/1316266137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feca00fb430 0x7feca0113670 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:33.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.898+0000 7feca65a5640 1 -- 172.21.15.71:0/1316266137 >> 172.21.15.71:0/1316266137 conn(0x7feca00f6c10 msgr2=0x7feca0065610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:33.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.898+0000 7feca65a5640 1 -- 172.21.15.71:0/1316266137 shutdown_connections 2024-09-10T10:04:33.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.898+0000 7feca65a5640 1 -- 172.21.15.71:0/1316266137 wait complete. 2024-09-10T10:04:33.908 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:04:33.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.992+0000 7fc33cf24640 1 -- 172.21.15.71:0/2924183122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3380ff6e0 msgr2=0x7fc338101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:33.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.992+0000 7fc33cf24640 1 --2- 172.21.15.71:0/2924183122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3380ff6e0 0x7fc338101ac0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0048d0 tx=0x7fc32c009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:33.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.992+0000 7fc33cf24640 1 -- 172.21.15.71:0/2924183122 shutdown_connections 2024-09-10T10:04:33.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.992+0000 7fc33cf24640 1 --2- 172.21.15.71:0/2924183122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3380ff6e0 0x7fc338101ac0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:33.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.992+0000 7fc33cf24640 1 --2- 172.21.15.71:0/2924183122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc338065be0 0x7fc3380ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:33.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.992+0000 7fc33cf24640 1 -- 172.21.15.71:0/2924183122 >> 172.21.15.71:0/2924183122 conn(0x7fc3380f6c10 msgr2=0x7fc3380f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:33.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.992+0000 7fc33cf24640 1 -- 172.21.15.71:0/2924183122 shutdown_connections 2024-09-10T10:04:33.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.992+0000 7fc33cf24640 1 -- 172.21.15.71:0/2924183122 wait complete. 2024-09-10T10:04:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.993+0000 7fc33cf24640 1 Processor -- start 2024-09-10T10:04:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.993+0000 7fc33cf24640 1 -- start start 2024-09-10T10:04:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.993+0000 7fc33cf24640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc338065be0 0x7fc33810d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.993+0000 7fc33cf24640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3380ff6e0 0x7fc33810d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.993+0000 7fc33cf24640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33810dc50 con 0x7fc3380ff6e0 2024-09-10T10:04:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.993+0000 7fc33cf24640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33810e420 con 0x7fc338065be0 2024-09-10T10:04:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.993+0000 7fc335d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3380ff6e0 0x7fc33810d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.993+0000 7fc335d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3380ff6e0 0x7fc33810d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58058/0 (socket says 172.21.15.71:58058) 2024-09-10T10:04:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.993+0000 7fc335d9b640 1 -- 172.21.15.71:0/1694949123 learned_addr learned my addr 172.21.15.71:0/1694949123 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.993+0000 7fc33659c640 1 --2- 172.21.15.71:0/1694949123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc338065be0 0x7fc33810d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.994+0000 7fc33659c640 1 -- 172.21.15.71:0/1694949123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3380ff6e0 msgr2=0x7fc33810d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:33.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.994+0000 7fc33659c640 1 --2- 172.21.15.71:0/1694949123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3380ff6e0 0x7fc33810d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:33.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.994+0000 7fc33659c640 1 -- 172.21.15.71:0/1694949123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c005040 con 0x7fc338065be0 2024-09-10T10:04:33.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.994+0000 7fc33659c640 1 --2- 172.21.15.71:0/1694949123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc338065be0 0x7fc33810d0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc338065940 tx=0x7fc32800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:33.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.994+0000 7fc326ffd640 1 -- 172.21.15.71:0/1694949123 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc328007c30 con 0x7fc338065be0 2024-09-10T10:04:33.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.994+0000 7fc33cf24640 1 -- 172.21.15.71:0/1694949123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33810e6b0 con 0x7fc338065be0 2024-09-10T10:04:33.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.994+0000 7fc326ffd640 1 -- 172.21.15.71:0/1694949123 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc32800f040 con 0x7fc338065be0 2024-09-10T10:04:33.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.994+0000 7fc33cf24640 1 -- 172.21.15.71:0/1694949123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33810ec50 con 0x7fc338065be0 2024-09-10T10:04:33.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.994+0000 7fc326ffd640 1 -- 172.21.15.71:0/1694949123 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc32800ca80 con 0x7fc338065be0 2024-09-10T10:04:33.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.995+0000 7fc33cf24640 1 -- 172.21.15.71:0/1694949123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3380fa890 con 0x7fc338065be0 2024-09-10T10:04:33.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.996+0000 7fc326ffd640 1 -- 172.21.15.71:0/1694949123 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7fc32800cd00 con 0x7fc338065be0 2024-09-10T10:04:33.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.996+0000 7fc326ffd640 1 --2- 172.21.15.71:0/1694949123 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fc32006e4a0 0x7fc320070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:33.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.996+0000 7fc326ffd640 1 -- 172.21.15.71:0/1694949123 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc32808dc70 con 0x7fc338065be0 2024-09-10T10:04:33.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.996+0000 7fc335d9b640 1 --2- 172.21.15.71:0/1694949123 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fc32006e4a0 0x7fc320070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:33.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:33.997+0000 7fc335d9b640 1 --2- 172.21.15.71:0/1694949123 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fc32006e4a0 0x7fc320070950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc33810ce70 tx=0x7fc32c035040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:34.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.001+0000 7fc326ffd640 1 -- 172.21.15.71:0/1694949123 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fc328094080 con 0x7fc338065be0 2024-09-10T10:04:34.019 INFO:tasks.workunit.client.0.smithi071.stdout:4/945: sync 2024-09-10T10:04:34.020 INFO:tasks.workunit.client.0.smithi071.stdout:4/946: dread - db/d1d/d61/d6a/d10e/f126 zero size 2024-09-10T10:04:34.025 INFO:tasks.workunit.client.0.smithi071.stdout:4/947: link db/d15/d17/d4e/c5d db/d15/d26/d43/d4d/d77/dd7/de7/c146 0 2024-09-10T10:04:34.027 INFO:tasks.workunit.client.0.smithi071.stdout:4/948: creat db/d8f/f147 x:0 0 0 2024-09-10T10:04:34.197 INFO:tasks.workunit.client.0.smithi071.stdout:6/917: sync 2024-09-10T10:04:34.202 INFO:tasks.workunit.client.0.smithi071.stdout:6/918: dwrite d4/d61/d83/da8/f99 [0,4194304] 0 2024-09-10T10:04:34.214 INFO:tasks.workunit.client.0.smithi071.stdout:6/919: dread d4/f25 [0,4194304] 0 2024-09-10T10:04:34.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.225+0000 7fc33cf24640 1 -- 172.21.15.71:0/1694949123 --> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc33810f030 con 0x7fc32006e4a0 2024-09-10T10:04:34.226 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:33 smithi071 ceph-mon[27559]: pgmap v8: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 62 MiB/s rd, 146 MiB/s wr, 347 op/s 2024-09-10T10:04:34.226 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:33 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:34.226 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:33 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:34.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.226+0000 7fc326ffd640 1 -- 172.21.15.71:0/1694949123 <== mgr.24391 v2:172.21.15.107:6828/591375611 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc33810f030 con 0x7fc32006e4a0 2024-09-10T10:04:34.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.228+0000 7fc33cf24640 1 -- 172.21.15.71:0/1694949123 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fc32006e4a0 msgr2=0x7fc320070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.228+0000 7fc33cf24640 1 --2- 172.21.15.71:0/1694949123 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fc32006e4a0 0x7fc320070950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc33810ce70 tx=0x7fc32c035040 comp rx=0 tx=0).stop 2024-09-10T10:04:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.228+0000 7fc33cf24640 1 -- 172.21.15.71:0/1694949123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc338065be0 msgr2=0x7fc33810d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.228+0000 7fc33cf24640 1 --2- 172.21.15.71:0/1694949123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc338065be0 0x7fc33810d0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc338065940 tx=0x7fc32800b040 comp rx=0 tx=0).stop 2024-09-10T10:04:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.228+0000 7fc33cf24640 1 -- 172.21.15.71:0/1694949123 shutdown_connections 2024-09-10T10:04:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.228+0000 7fc33cf24640 1 --2- 172.21.15.71:0/1694949123 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fc32006e4a0 0x7fc320070950 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.228+0000 7fc33cf24640 1 --2- 172.21.15.71:0/1694949123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3380ff6e0 0x7fc33810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.228+0000 7fc33cf24640 1 --2- 172.21.15.71:0/1694949123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc338065be0 0x7fc33810d0c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.228+0000 7fc33cf24640 1 -- 172.21.15.71:0/1694949123 >> 172.21.15.71:0/1694949123 conn(0x7fc3380f6c10 msgr2=0x7fc3380f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.229+0000 7fc33cf24640 1 -- 172.21.15.71:0/1694949123 shutdown_connections 2024-09-10T10:04:34.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.229+0000 7fc33cf24640 1 -- 172.21.15.71:0/1694949123 wait complete. 2024-09-10T10:04:34.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.315+0000 7f634d344640 1 -- 172.21.15.71:0/6879423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63480ff720 msgr2=0x7f6348101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:34.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.315+0000 7f634d344640 1 --2- 172.21.15.71:0/6879423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63480ff720 0x7f6348101b00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f633c0048d0 tx=0x7f633c009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.315+0000 7f634d344640 1 -- 172.21.15.71:0/6879423 shutdown_connections 2024-09-10T10:04:34.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.315+0000 7f634d344640 1 --2- 172.21.15.71:0/6879423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63480ff720 0x7f6348101b00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.315+0000 7f634d344640 1 --2- 172.21.15.71:0/6879423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6348065ba0 0x7f63480ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.315+0000 7f634d344640 1 -- 172.21.15.71:0/6879423 >> 172.21.15.71:0/6879423 conn(0x7f63480f6c10 msgr2=0x7f63480f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:34.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.315+0000 7f634d344640 1 -- 172.21.15.71:0/6879423 shutdown_connections 2024-09-10T10:04:34.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.315+0000 7f634d344640 1 -- 172.21.15.71:0/6879423 wait complete. 2024-09-10T10:04:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.315+0000 7f634d344640 1 Processor -- start 2024-09-10T10:04:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.316+0000 7f634d344640 1 -- start start 2024-09-10T10:04:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.316+0000 7f634d344640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6348065ba0 0x7f634810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.316+0000 7f634d344640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63480ff720 0x7f634810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.316+0000 7f634d344640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634810dc10 con 0x7f6348065ba0 2024-09-10T10:04:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.316+0000 7f634d344640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634810e430 con 0x7f63480ff720 2024-09-10T10:04:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.316+0000 7f6346ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6348065ba0 0x7f634810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.316+0000 7f6346ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6348065ba0 0x7f634810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58078/0 (socket says 172.21.15.71:58078) 2024-09-10T10:04:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.316+0000 7f6346ffd640 1 -- 172.21.15.71:0/3886004239 learned_addr learned my addr 172.21.15.71:0/3886004239 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:34.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.316+0000 7f63467fc640 1 --2- 172.21.15.71:0/3886004239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63480ff720 0x7f634810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.316+0000 7f6346ffd640 1 -- 172.21.15.71:0/3886004239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63480ff720 msgr2=0x7f634810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.316+0000 7f6346ffd640 1 --2- 172.21.15.71:0/3886004239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63480ff720 0x7f634810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.316+0000 7f6346ffd640 1 -- 172.21.15.71:0/3886004239 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c005040 con 0x7f6348065ba0 2024-09-10T10:04:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.316+0000 7f6346ffd640 1 --2- 172.21.15.71:0/3886004239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6348065ba0 0x7f634810d080 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6338002a80 tx=0x7f6338004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.317+0000 7f632f7fe640 1 -- 172.21.15.71:0/3886004239 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6338007c30 con 0x7f6348065ba0 2024-09-10T10:04:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.317+0000 7f632f7fe640 1 -- 172.21.15.71:0/3886004239 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f633800f040 con 0x7f6348065ba0 2024-09-10T10:04:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.317+0000 7f634d344640 1 -- 172.21.15.71:0/3886004239 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634810e6c0 con 0x7f6348065ba0 2024-09-10T10:04:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.317+0000 7f632f7fe640 1 -- 172.21.15.71:0/3886004239 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f633800db10 con 0x7f6348065ba0 2024-09-10T10:04:34.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.317+0000 7f634d344640 1 -- 172.21.15.71:0/3886004239 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634810ebb0 con 0x7f6348065ba0 2024-09-10T10:04:34.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.318+0000 7f634d344640 1 -- 172.21.15.71:0/3886004239 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63480fa890 con 0x7f6348065ba0 2024-09-10T10:04:34.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.319+0000 7f632f7fe640 1 -- 172.21.15.71:0/3886004239 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f633800dc70 con 0x7f6348065ba0 2024-09-10T10:04:34.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.319+0000 7f632f7fe640 1 --2- 172.21.15.71:0/3886004239 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f633006e4a0 0x7f6330070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:34.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.319+0000 7f632f7fe640 1 -- 172.21.15.71:0/3886004239 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f633808de80 con 0x7f6348065ba0 2024-09-10T10:04:34.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.319+0000 7f63467fc640 1 --2- 172.21.15.71:0/3886004239 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f633006e4a0 0x7f6330070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:34.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.320+0000 7f63467fc640 1 --2- 172.21.15.71:0/3886004239 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f633006e4a0 0x7f6330070950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f633c000c00 tx=0x7f633c035040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:34.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.323+0000 7f632f7fe640 1 -- 172.21.15.71:0/3886004239 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f63380579c0 con 0x7f6348065ba0 2024-09-10T10:04:34.333 INFO:tasks.workunit.client.0.smithi071.stdout:4/949: sync 2024-09-10T10:04:34.334 INFO:tasks.workunit.client.0.smithi071.stdout:4/950: chown db/d1d/d61/d6a/d88/d90/f138 181862 1 2024-09-10T10:04:34.336 INFO:tasks.workunit.client.0.smithi071.stdout:4/951: mkdir db/d15/d17/d4e/d5a/dd3/d148 0 2024-09-10T10:04:34.341 INFO:tasks.workunit.client.0.smithi071.stdout:4/952: dread db/d15/d4b/f5c [0,4194304] 0 2024-09-10T10:04:34.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:33 smithi107 ceph-mon[34215]: pgmap v8: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 62 MiB/s rd, 146 MiB/s wr, 347 op/s 2024-09-10T10:04:34.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:33 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:34.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:33 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:34.472 INFO:tasks.workunit.client.0.smithi071.stdout:6/920: sync 2024-09-10T10:04:34.502 INFO:tasks.workunit.client.0.smithi071.stdout:6/921: creat d4/d61/f13a x:0 0 0 2024-09-10T10:04:34.505 INFO:tasks.workunit.client.0.smithi071.stdout:6/922: dread f1 [0,4194304] 0 2024-09-10T10:04:34.505 INFO:tasks.workunit.client.0.smithi071.stdout:6/923: readlink d4/l23 0 2024-09-10T10:04:34.507 INFO:tasks.workunit.client.0.smithi071.stdout:6/924: chown d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/fcb 29774 1 2024-09-10T10:04:34.508 INFO:tasks.workunit.client.0.smithi071.stdout:6/925: truncate d4/da/df/d2e/d3a/d43/f136 622747 0 2024-09-10T10:04:34.510 INFO:tasks.workunit.client.0.smithi071.stdout:6/926: fsync d4/da/df/d2e/d10c/f42 0 2024-09-10T10:04:34.515 INFO:tasks.workunit.client.0.smithi071.stdout:6/927: link d4/d20/f86 d4/da/df/d2e/d12b/d131/f13b 0 2024-09-10T10:04:34.518 INFO:tasks.workunit.client.0.smithi071.stdout:6/928: symlink d4/da/df/d2e/d3a/d91/l13c 0 2024-09-10T10:04:34.518 INFO:tasks.workunit.client.0.smithi071.stdout:6/929: dread - d4/da/df/d2e/d3a/d91/dc7/d97/f111 zero size 2024-09-10T10:04:34.523 INFO:tasks.workunit.client.0.smithi071.stdout:6/930: unlink d4/da/df/d2e/d3a/d40/d60/dff/f116 0 2024-09-10T10:04:34.525 INFO:tasks.workunit.client.0.smithi071.stdout:6/931: dread d4/da/df/d2e/d3a/d91/dc7/f11a [0,4194304] 0 2024-09-10T10:04:34.568 INFO:tasks.workunit.client.0.smithi071.stdout:6/932: truncate d4/d61/d83/da8/f46 264320 0 2024-09-10T10:04:34.571 INFO:tasks.workunit.client.0.smithi071.stdout:6/933: symlink d4/da/df/d2e/d3a/d40/d60/dff/d12a/l13d 0 2024-09-10T10:04:34.578 INFO:tasks.workunit.client.0.smithi071.stdout:6/934: write d4/d61/d83/faf [198834,51480] 0 2024-09-10T10:04:34.591 INFO:tasks.workunit.client.0.smithi071.stdout:6/935: dwrite d4/f38 [0,4194304] 0 2024-09-10T10:04:34.597 INFO:tasks.workunit.client.0.smithi071.stdout:6/936: creat d4/da/df/d2e/f13e x:0 0 0 2024-09-10T10:04:34.604 INFO:tasks.workunit.client.0.smithi071.stdout:6/937: dwrite d4/d61/f13a [0,4194304] 0 2024-09-10T10:04:34.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.605+0000 7f634d344640 1 -- 172.21.15.71:0/3886004239 --> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f634810f010 con 0x7f633006e4a0 2024-09-10T10:04:34.616 INFO:tasks.workunit.client.0.smithi071.stdout:4/953: sync 2024-09-10T10:04:34.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.620+0000 7f632f7fe640 1 -- 172.21.15.71:0/3886004239 <== mgr.24391 v2:172.21.15.107:6828/591375611 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f634810f010 con 0x7f633006e4a0 2024-09-10T10:04:34.621 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:04:34.621 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (7m) 2m ago 8m 25.4M - 0.25.0 c8568f914cd2 b3a4270190ef 2024-09-10T10:04:34.621 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (8m) 2m ago 8m 6891k - 17.2.7-1597-g96d63e75 f3fc7d52e233 f70481a4c3c7 2024-09-10T10:04:34.621 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (7m) 0s ago 7m 6895k - 17.2.7-1597-g96d63e75 f3fc7d52e233 cf27ebcc0f98 2024-09-10T10:04:34.621 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (7m) 2m ago 8m 81.4M - 9.4.7 954c08fa6188 1998c9de2d92 2024-09-10T10:04:34.621 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (2m) 2m ago 2m 16.6M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (3m) 2m ago 3m 11.8M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (3m) 0s ago 2m 129M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (2m) 0s ago 2m 79.0M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:9283,8765,8443 running (9m) 2m ago 9m 449M - 17.2.7-1597-g96d63e75 f3fc7d52e233 dc0e497fa11e 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283 running (62s) 0s ago 7m 480M - 19.1.1-305-g1cf819b7 41d671128357 7eef59ade56b 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (9m) 2m ago 9m 49.6M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 35e491e574a3 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (7m) 0s ago 7m 39.3M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 682e2b6e311f 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (8m) 2m ago 8m 16.1M - 1.5.0 0da6a335fe13 acc088fb47d4 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (7m) 0s ago 7m 15.4M - 1.5.0 0da6a335fe13 12be03d3d11f 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (6m) 2m ago 6m 46.5M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 a79e69c9b514 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (6m) 2m ago 6m 44.4M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 44a84bf577da 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (5m) 2m ago 5m 42.9M 4288M 17.2.7-1597-g96d63e75 f3fc7d52e233 4fae52756a24 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (5m) 0s ago 5m 282M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:04:34.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (4m) 0s ago 4m 239M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:04:34.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (4m) 0s ago 4m 282M 5311M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:04:34.623 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (6m) 2m ago 7m 56.1M - 2.43.0 a07b618ecd1d 1a619aeb5698 2024-09-10T10:04:34.623 INFO:tasks.workunit.client.0.smithi071.stdout:4/954: dwrite db/d15/d4b/fe3 [0,4194304] 0 2024-09-10T10:04:34.623 INFO:tasks.workunit.client.0.smithi071.stdout:4/955: chown db/d15/d26/cdb 65351475 1 2024-09-10T10:04:34.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.623+0000 7f634d344640 1 -- 172.21.15.71:0/3886004239 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f633006e4a0 msgr2=0x7f6330070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:34.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.623+0000 7f634d344640 1 --2- 172.21.15.71:0/3886004239 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f633006e4a0 0x7f6330070950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f633c000c00 tx=0x7f633c035040 comp rx=0 tx=0).stop 2024-09-10T10:04:34.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.623+0000 7f634d344640 1 -- 172.21.15.71:0/3886004239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6348065ba0 msgr2=0x7f634810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:34.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.623+0000 7f634d344640 1 --2- 172.21.15.71:0/3886004239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6348065ba0 0x7f634810d080 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6338002a80 tx=0x7f6338004600 comp rx=0 tx=0).stop 2024-09-10T10:04:34.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.623+0000 7f634d344640 1 -- 172.21.15.71:0/3886004239 shutdown_connections 2024-09-10T10:04:34.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.623+0000 7f634d344640 1 --2- 172.21.15.71:0/3886004239 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f633006e4a0 0x7f6330070950 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.623+0000 7f634d344640 1 --2- 172.21.15.71:0/3886004239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63480ff720 0x7f634810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.623+0000 7f634d344640 1 --2- 172.21.15.71:0/3886004239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6348065ba0 0x7f634810d080 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.623+0000 7f634d344640 1 -- 172.21.15.71:0/3886004239 >> 172.21.15.71:0/3886004239 conn(0x7f63480f6c10 msgr2=0x7f63480f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:34.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.623+0000 7f634d344640 1 -- 172.21.15.71:0/3886004239 shutdown_connections 2024-09-10T10:04:34.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.623+0000 7f634d344640 1 -- 172.21.15.71:0/3886004239 wait complete. 2024-09-10T10:04:34.626 INFO:tasks.workunit.client.0.smithi071.stdout:6/938: dread d4/da/df/d2e/d3a/d40/f58 [0,4194304] 0 2024-09-10T10:04:34.630 INFO:tasks.workunit.client.0.smithi071.stdout:6/939: rename d4/da/df/d5e/fd8 to d4/da/df/d5e/f13f 0 2024-09-10T10:04:34.632 INFO:tasks.workunit.client.0.smithi071.stdout:6/940: symlink d4/da/df/d2e/d10c/l140 0 2024-09-10T10:04:34.633 INFO:tasks.workunit.client.0.smithi071.stdout:6/941: dread f1 [4194304,4194304] 0 2024-09-10T10:04:34.636 INFO:tasks.workunit.client.0.smithi071.stdout:6/942: symlink d4/da/df/d2e/d3a/d43/dc8/l141 0 2024-09-10T10:04:34.639 INFO:tasks.workunit.client.0.smithi071.stdout:6/943: creat d4/da/df/d2e/d3a/d91/dc7/d81/db1/f142 x:0 0 0 2024-09-10T10:04:34.640 INFO:tasks.workunit.client.0.smithi071.stdout:6/944: write d4/da/df/d2e/d3a/d91/f105 [193397,69177] 0 2024-09-10T10:04:34.644 INFO:tasks.workunit.client.0.smithi071.stdout:6/945: mkdir d4/da/df/d2e/d3a/d51/d143 0 2024-09-10T10:04:34.648 INFO:tasks.workunit.client.0.smithi071.stdout:6/946: link d4/da/df/d2e/d3a/d91/dc7/d81/db2/fb6 d4/da/df/d2e/d3a/d43/f144 0 2024-09-10T10:04:34.651 INFO:tasks.workunit.client.0.smithi071.stdout:6/947: rename d4/da/df/d2e/d3a/d91/dc7/d81/fee to d4/da/df/d2e/d3a/d91/dc7/df0/f145 0 2024-09-10T10:04:34.652 INFO:tasks.workunit.client.0.smithi071.stdout:6/948: write d4/da/df/f50 [4830947,47618] 0 2024-09-10T10:04:34.656 INFO:tasks.workunit.client.0.smithi071.stdout:6/949: unlink d4/da/df/d2e/d3a/d91/dc7/d81/db2/db9/c132 0 2024-09-10T10:04:34.657 INFO:tasks.workunit.client.0.smithi071.stdout:6/950: dread - d4/da/df/d2e/d3a/d51/d108/fe5 zero size 2024-09-10T10:04:34.658 INFO:tasks.workunit.client.0.smithi071.stdout:6/951: fdatasync d4/da/df/d2e/f13e 0 2024-09-10T10:04:34.661 INFO:tasks.workunit.client.0.smithi071.stdout:6/952: dread d4/da/f33 [0,4194304] 0 2024-09-10T10:04:34.661 INFO:tasks.workunit.client.0.smithi071.stdout:6/953: chown d4/d61/d83/f9f 19985053 1 2024-09-10T10:04:34.664 INFO:tasks.workunit.client.0.smithi071.stdout:6/954: creat d4/d61/d83/f146 x:0 0 0 2024-09-10T10:04:34.667 INFO:tasks.workunit.client.0.smithi071.stdout:6/955: dread d4/da/df/d2e/d3a/d91/f105 [0,4194304] 0 2024-09-10T10:04:34.669 INFO:tasks.workunit.client.0.smithi071.stdout:6/956: creat d4/da/df/d2e/d3a/d91/dc7/d81/d95/f147 x:0 0 0 2024-09-10T10:04:34.670 INFO:tasks.workunit.client.0.smithi071.stdout:6/957: chown d4/da/df/d2e/dc2/l11e 0 1 2024-09-10T10:04:34.672 INFO:tasks.workunit.client.0.smithi071.stdout:6/958: dread d4/da/df/d2e/d3a/d51/f94 [0,4194304] 0 2024-09-10T10:04:34.673 INFO:tasks.workunit.client.0.smithi071.stdout:6/959: mkdir d4/d61/d83/d148 0 2024-09-10T10:04:34.676 INFO:tasks.workunit.client.0.smithi071.stdout:6/960: creat d4/da/df/d2e/f149 x:0 0 0 2024-09-10T10:04:34.677 INFO:tasks.workunit.client.0.smithi071.stdout:6/961: creat d4/d61/f14a x:0 0 0 2024-09-10T10:04:34.683 INFO:tasks.workunit.client.0.smithi071.stdout:6/962: dwrite d4/d20/f7d [0,4194304] 0 2024-09-10T10:04:34.688 INFO:tasks.workunit.client.0.smithi071.stdout:6/963: rename d4/da/df/d2e/d3a/d51/d64/f88 to d4/da/df/d2e/f14b 0 2024-09-10T10:04:34.691 INFO:tasks.workunit.client.0.smithi071.stdout:6/964: mknod d4/da/df/d2e/d3a/d40/c14c 0 2024-09-10T10:04:34.701 INFO:tasks.workunit.client.0.smithi071.stdout:6/965: truncate d4/da/df/d2e/dc2/f113 2361133 0 2024-09-10T10:04:34.703 INFO:tasks.workunit.client.0.smithi071.stdout:6/966: creat d4/da/df/d2e/d3a/d91/dc7/d81/db2/f14d x:0 0 0 2024-09-10T10:04:34.704 INFO:tasks.workunit.client.0.smithi071.stdout:6/967: symlink d4/da/df/d2e/d3a/d91/dc7/df0/l14e 0 2024-09-10T10:04:34.719 INFO:tasks.workunit.client.0.smithi071.stdout:6/968: dread d4/da/df/d2e/d10c/f42 [0,4194304] 0 2024-09-10T10:04:34.722 INFO:tasks.workunit.client.0.smithi071.stdout:6/969: getdents d4 0 2024-09-10T10:04:34.725 INFO:tasks.workunit.client.0.smithi071.stdout:6/970: creat d4/da/df/d2e/d3a/d51/d138/f14f x:0 0 0 2024-09-10T10:04:34.728 INFO:tasks.workunit.client.0.smithi071.stdout:6/971: creat d4/da/df/d2e/dc2/f150 x:0 0 0 2024-09-10T10:04:34.729 INFO:tasks.workunit.client.0.smithi071.stdout:6/972: stat d4/da/df/d2e/d3a/da9/dbc/cea 0 2024-09-10T10:04:34.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.728+0000 7f521179f640 1 -- 172.21.15.71:0/4009406215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f520c0fe310 msgr2=0x7f520c0fa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:34.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.728+0000 7f521179f640 1 --2- 172.21.15.71:0/4009406215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f520c0fe310 0x7f520c0fa470 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f52000048d0 tx=0x7f5200009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.728+0000 7f521179f640 1 -- 172.21.15.71:0/4009406215 shutdown_connections 2024-09-10T10:04:34.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.728+0000 7f521179f640 1 --2- 172.21.15.71:0/4009406215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f520c0fe310 0x7f520c0fa470 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.728+0000 7f521179f640 1 --2- 172.21.15.71:0/4009406215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f520c0fd9c0 0x7f520c0fddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.728+0000 7f521179f640 1 -- 172.21.15.71:0/4009406215 >> 172.21.15.71:0/4009406215 conn(0x7f520c0f61c0 msgr2=0x7f520c0f85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:34.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.728+0000 7f521179f640 1 -- 172.21.15.71:0/4009406215 shutdown_connections 2024-09-10T10:04:34.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.728+0000 7f521179f640 1 -- 172.21.15.71:0/4009406215 wait complete. 2024-09-10T10:04:34.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.729+0000 7f521179f640 1 Processor -- start 2024-09-10T10:04:34.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.729+0000 7f521179f640 1 -- start start 2024-09-10T10:04:34.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.729+0000 7f521179f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f520c0fd9c0 0x7f520c0fd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:34.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.729+0000 7f521179f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f520c0fe310 0x7f520c0fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:34.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.729+0000 7f521179f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0fbc30 con 0x7f520c0fe310 2024-09-10T10:04:34.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.729+0000 7f521179f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0fbd70 con 0x7f520c0fd9c0 2024-09-10T10:04:34.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.730+0000 7f520b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f520c0fe310 0x7f520c0fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:34.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.730+0000 7f520bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f520c0fd9c0 0x7f520c0fd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:34.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.730+0000 7f520b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f520c0fe310 0x7f520c0fb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58100/0 (socket says 172.21.15.71:58100) 2024-09-10T10:04:34.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.730+0000 7f520b7fe640 1 -- 172.21.15.71:0/4023143928 learned_addr learned my addr 172.21.15.71:0/4023143928 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:34.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.730+0000 7f520bfff640 1 -- 172.21.15.71:0/4023143928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f520c0fe310 msgr2=0x7f520c0fb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:34.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.730+0000 7f520bfff640 1 --2- 172.21.15.71:0/4023143928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f520c0fe310 0x7f520c0fb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:34.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.730+0000 7f520bfff640 1 -- 172.21.15.71:0/4023143928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5200005040 con 0x7f520c0fd9c0 2024-09-10T10:04:34.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.730+0000 7f520b7fe640 1 --2- 172.21.15.71:0/4023143928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f520c0fe310 0x7f520c0fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:04:34.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.730+0000 7f520bfff640 1 --2- 172.21.15.71:0/4023143928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f520c0fd9c0 0x7f520c0fd1b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0027d0 tx=0x7f51fc009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:34.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.731+0000 7f5208ff9640 1 -- 172.21.15.71:0/4023143928 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51fc007a20 con 0x7f520c0fd9c0 2024-09-10T10:04:34.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.731+0000 7f5208ff9640 1 -- 172.21.15.71:0/4023143928 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f51fc00f040 con 0x7f520c0fd9c0 2024-09-10T10:04:34.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.731+0000 7f5208ff9640 1 -- 172.21.15.71:0/4023143928 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51fc009470 con 0x7f520c0fd9c0 2024-09-10T10:04:34.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.731+0000 7f521179f640 1 -- 172.21.15.71:0/4023143928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c0fc050 con 0x7f520c0fd9c0 2024-09-10T10:04:34.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.731+0000 7f521179f640 1 -- 172.21.15.71:0/4023143928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c114f30 con 0x7f520c0fd9c0 2024-09-10T10:04:34.734 INFO:tasks.workunit.client.0.smithi071.stdout:6/973: rename d4/da/df/c37 to d4/da/df/d2e/d3a/d51/d64/d137/c151 0 2024-09-10T10:04:34.734 INFO:tasks.workunit.client.0.smithi071.stdout:6/974: chown d4/l23 693699 1 2024-09-10T10:04:34.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.732+0000 7f521179f640 1 -- 172.21.15.71:0/4023143928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c04b720 con 0x7f520c0fd9c0 2024-09-10T10:04:34.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.733+0000 7f5208ff9640 1 -- 172.21.15.71:0/4023143928 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f51fc0096e0 con 0x7f520c0fd9c0 2024-09-10T10:04:34.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.733+0000 7f5208ff9640 1 --2- 172.21.15.71:0/4023143928 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f51f406e4a0 0x7f51f4070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:34.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.734+0000 7f5208ff9640 1 -- 172.21.15.71:0/4023143928 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f51fc08d380 con 0x7f520c0fd9c0 2024-09-10T10:04:34.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.734+0000 7f520b7fe640 1 --2- 172.21.15.71:0/4023143928 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f51f406e4a0 0x7f51f4070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:34.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.734+0000 7f520b7fe640 1 --2- 172.21.15.71:0/4023143928 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f51f406e4a0 0x7f51f4070950 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5200000c00 tx=0x7f5200035040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:34.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:34.739+0000 7f5208ff9640 1 -- 172.21.15.71:0/4023143928 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f51fc04f670 con 0x7f520c0fd9c0 2024-09-10T10:04:34.746 INFO:tasks.workunit.client.0.smithi071.stdout:6/975: dread d4/da/df/d2e/d3a/d43/f73 [0,4194304] 0 2024-09-10T10:04:34.748 INFO:tasks.workunit.client.0.smithi071.stdout:6/976: mkdir d4/da/df/d2e/d10c/d152 0 2024-09-10T10:04:34.749 INFO:tasks.workunit.client.0.smithi071.stdout:6/977: chown d4/da/df/d2e/d3a/d40/d60/d7a/dbd/f11c 119268 1 2024-09-10T10:04:34.750 INFO:tasks.workunit.client.0.smithi071.stdout:6/978: dread - d4/ffe zero size 2024-09-10T10:04:34.751 INFO:tasks.workunit.client.0.smithi071.stdout:6/979: rename d4 to d4/da/df/d2e/d3a/d40/d60/d7a/d153 22 2024-09-10T10:04:34.753 INFO:tasks.workunit.client.0.smithi071.stdout:6/980: creat d4/da/df/d2e/d3a/d91/dc7/d81/db1/f154 x:0 0 0 2024-09-10T10:04:34.759 INFO:tasks.workunit.client.0.smithi071.stdout:6/981: write d4/da/fb [679810,84659] 0 2024-09-10T10:04:34.761 INFO:tasks.workunit.client.0.smithi071.stdout:6/982: fsync d4/da/df/d2e/d3a/d91/dc7/d97/fdb 0 2024-09-10T10:04:34.762 INFO:tasks.workunit.client.0.smithi071.stdout:6/983: truncate d4/ffe 360344 0 2024-09-10T10:04:34.764 INFO:tasks.workunit.client.0.smithi071.stdout:6/984: mknod d4/da/df/d2e/d3a/da9/dbc/c155 0 2024-09-10T10:04:34.765 INFO:tasks.workunit.client.0.smithi071.stdout:6/985: fsync d4/d61/f89 0 2024-09-10T10:04:34.771 INFO:tasks.workunit.client.0.smithi071.stdout:6/986: dwrite d4/da/df/d2e/f13e [0,4194304] 0 2024-09-10T10:04:34.776 INFO:tasks.workunit.client.0.smithi071.stdout:6/987: rename d4/da/df/d2e/d3a/d40/d60/d7a/lfc to d4/da/df/d2e/d3a/da9/l156 0 2024-09-10T10:04:34.777 INFO:tasks.workunit.client.0.smithi071.stdout:6/988: readlink d4/d61/d83/da8/l52 0 2024-09-10T10:04:34.778 INFO:tasks.workunit.client.0.smithi071.stdout:6/989: write d4/da/df/d2e/d10c/fbb [976708,60654] 0 2024-09-10T10:04:34.780 INFO:tasks.workunit.client.0.smithi071.stdout:6/990: dread - d4/da/df/d2e/d3a/d91/dc7/d81/d95/f147 zero size 2024-09-10T10:04:34.782 INFO:tasks.workunit.client.0.smithi071.stdout:6/991: unlink d4/da/df/d2e/d3a/d91/dc7/f9c 0 2024-09-10T10:04:34.836 INFO:tasks.workunit.client.0.smithi071.stdout:6/992: symlink d4/da/df/d2e/d3a/d91/dc7/df0/l157 0 2024-09-10T10:04:34.844 INFO:tasks.workunit.client.0.smithi071.stdout:6/993: dwrite d4/da/df/d2e/d3a/d43/f112 [0,4194304] 0 2024-09-10T10:04:34.851 INFO:tasks.workunit.client.0.smithi071.stdout:6/994: dread d4/da/df/d5e/f75 [0,4194304] 0 2024-09-10T10:04:34.857 INFO:tasks.workunit.client.0.smithi071.stdout:6/995: write d4/da/df/d2e/d3a/f74 [1409277,63267] 0 2024-09-10T10:04:34.861 INFO:tasks.workunit.client.0.smithi071.stdout:6/996: mknod d4/da/df/d2e/dc2/c158 0 2024-09-10T10:04:34.898 INFO:tasks.workunit.client.0.smithi071.stdout:6/997: rmdir d4/d20 39 2024-09-10T10:04:34.901 INFO:tasks.workunit.client.0.smithi071.stdout:6/998: dread d4/da/df/d2e/d3a/d43/f136 [0,4194304] 0 2024-09-10T10:04:34.910 INFO:tasks.workunit.client.0.smithi071.stdout:4/956: sync 2024-09-10T10:04:34.913 INFO:tasks.workunit.client.0.smithi071.stdout:4/957: truncate db/d15/d26/f63 1871931 0 2024-09-10T10:04:34.921 INFO:tasks.workunit.client.0.smithi071.stdout:4/958: dwrite db/d15/d26/d43/d4d/d77/dd7/f105 [0,4194304] 0 2024-09-10T10:04:34.922 INFO:tasks.workunit.client.0.smithi071.stdout:6/999: dwrite d4/da/df/d2e/d3a/d40/d60/fbf [0,4194304] 0 2024-09-10T10:04:34.929 INFO:tasks.workunit.client.0.smithi071.stdout:4/959: write db/d15/d17/f75 [1430164,97769] 0 2024-09-10T10:04:34.930 INFO:tasks.workunit.client.0.smithi071.stdout:4/960: chown db/d15/d26/d43/d4d/fdd 10211333 1 2024-09-10T10:04:34.936 INFO:tasks.workunit.client.0.smithi071.stdout:4/961: getdents db/d15/d4b 0 2024-09-10T10:04:34.937 INFO:tasks.workunit.client.0.smithi071.stdout:4/962: truncate db/d1d/d61/d6a/f12b 678780 0 2024-09-10T10:04:34.939 INFO:tasks.workunit.client.0.smithi071.stdout:4/963: symlink db/da0/l149 0 2024-09-10T10:04:34.947 INFO:tasks.workunit.client.0.smithi071.stdout:4/964: rename db/da0 to db/d15/d26/d43/d4d/d9f/da6/d14a 0 2024-09-10T10:04:34.951 INFO:tasks.workunit.client.0.smithi071.stdout:4/965: write db/d1d/f10f [207157,104698] 0 2024-09-10T10:04:34.953 INFO:tasks.workunit.client.0.smithi071.stdout:4/966: creat db/d15/de4/f14b x:0 0 0 2024-09-10T10:04:34.955 INFO:tasks.workunit.client.0.smithi071.stdout:4/967: mknod db/d15/d17/d113/d133/c14c 0 2024-09-10T10:04:34.957 INFO:tasks.workunit.client.0.smithi071.stdout:4/968: rename db/d15/d4b/l69 to db/d15/d26/l14d 0 2024-09-10T10:04:34.961 INFO:tasks.workunit.client.0.smithi071.stdout:4/969: write db/d15/d26/d43/d82/f11d [31479,110140] 0 2024-09-10T10:04:34.963 INFO:tasks.workunit.client.0.smithi071.stdout:4/970: fsync db/d1d/d61/d6a/d88/f114 0 2024-09-10T10:04:34.965 INFO:tasks.workunit.client.0.smithi071.stdout:4/971: truncate db/d1d/d61/d6a/fe9 9102144 0 2024-09-10T10:04:34.968 INFO:tasks.workunit.client.0.smithi071.stdout:4/972: dread db/d15/d17/d4e/dc0/f108 [0,4194304] 0 2024-09-10T10:04:34.970 INFO:tasks.workunit.client.0.smithi071.stdout:4/973: creat db/d15/d17/d113/f14e x:0 0 0 2024-09-10T10:04:34.971 INFO:tasks.workunit.client.0.smithi071.stdout:4/974: stat db/f46 0 2024-09-10T10:04:34.972 INFO:tasks.workunit.client.0.smithi071.stdout:4/975: truncate db/d15/d26/d43/fa5 1831839 0 2024-09-10T10:04:34.976 INFO:tasks.workunit.client.0.smithi071.stdout:4/976: link db/d15/d17/d4e/dc0/c125 db/d15/d26/d43/d4d/d77/dd7/de7/c14f 0 2024-09-10T10:04:34.977 INFO:tasks.workunit.client.0.smithi071.stdout:4/977: stat db/c6e 0 2024-09-10T10:04:34.978 INFO:tasks.workunit.client.0.smithi071.stdout:4/978: mkdir db/d15/d26/d43/d4d/d77/d150 0 2024-09-10T10:04:34.980 INFO:tasks.workunit.client.0.smithi071.stdout:4/979: creat db/d1d/d61/d6a/d88/d90/f151 x:0 0 0 2024-09-10T10:04:34.982 INFO:tasks.workunit.client.0.smithi071.stdout:4/980: mkdir db/d15/d17/d113/d152 0 2024-09-10T10:04:34.985 INFO:tasks.workunit.client.0.smithi071.stdout:4/981: dread db/d1d/d61/d6a/d88/d90/ff9 [0,4194304] 0 2024-09-10T10:04:34.996 INFO:tasks.workunit.client.0.smithi071.stdout:4/982: dwrite db/d15/d17/d4e/d5a/d8d/faf [0,4194304] 0 2024-09-10T10:04:35.000 INFO:tasks.workunit.client.0.smithi071.stdout:4/983: rename db/d15/d26/d43/d82/c131 to db/d8f/d119/c153 0 2024-09-10T10:04:35.001 INFO:tasks.workunit.client.0.smithi071.stdout:4/984: chown db/d15/d26/d43/d4d/d145/f25 7142 1 2024-09-10T10:04:35.003 INFO:tasks.workunit.client.0.smithi071.stdout:4/985: creat db/d1d/d61/d6a/d88/f154 x:0 0 0 2024-09-10T10:04:35.004 INFO:tasks.workunit.client.0.smithi071.stdout:4/986: chown db/d15/d4b/fb3 836 1 2024-09-10T10:04:35.010 INFO:tasks.workunit.client.0.smithi071.stdout:4/987: dwrite db/d15/d26/d43/d4d/d145/f8a [0,4194304] 0 2024-09-10T10:04:35.011 INFO:tasks.workunit.client.0.smithi071.stdout:4/988: chown db/d15/d17 2159250 1 2024-09-10T10:04:35.014 INFO:tasks.workunit.client.0.smithi071.stdout:4/989: symlink db/d15/d26/d43/d4d/d9f/l155 0 2024-09-10T10:04:35.019 INFO:tasks.workunit.client.0.smithi071.stdout:4/990: rmdir db/d15/d26/d43/d4d/d145/d13c 0 2024-09-10T10:04:35.022 INFO:tasks.workunit.client.0.smithi071.stdout:4/991: read db/d15/d26/d43/d4d/fd1 [798829,38958] 0 2024-09-10T10:04:35.029 INFO:tasks.workunit.client.0.smithi071.stdout:4/992: dwrite db/d1d/d61/d6a/d88/d90/f123 [0,4194304] 0 2024-09-10T10:04:35.033 INFO:tasks.workunit.client.0.smithi071.stdout:4/993: read db/d15/f85 [165690,16559] 0 2024-09-10T10:04:35.037 INFO:tasks.workunit.client.0.smithi071.stdout:4/994: getdents db/d15/d17/d4e/d5a/dd3 0 2024-09-10T10:04:35.037 INFO:tasks.workunit.client.0.smithi071.stdout:4/995: stat db/d1d/d61/cff 0 2024-09-10T10:04:35.040 INFO:tasks.workunit.client.0.smithi071.stdout:4/996: creat db/d15/d26/d43/d4d/d9f/da6/d104/f156 x:0 0 0 2024-09-10T10:04:35.042 INFO:tasks.workunit.client.0.smithi071.stdout:4/997: fsync db/d15/d26/d43/d4d/d145/f8a 0 2024-09-10T10:04:35.059 INFO:tasks.workunit.client.0.smithi071.stdout:4/998: dread db/d15/d4b/fdc [0,4194304] 0 2024-09-10T10:04:35.068 INFO:tasks.workunit.client.0.smithi071.stdout:4/999: dwrite db/d15/f106 [0,4194304] 0 2024-09-10T10:04:35.070 INFO:tasks.workunit.client.0.smithi071.stderr:+ rm -rf -- ./tmp.3YsYuMMj07 2024-09-10T10:04:35.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.101+0000 7f521179f640 1 -- 172.21.15.71:0/4023143928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f520c115180 con 0x7f520c0fd9c0 2024-09-10T10:04:35.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.101+0000 7f5208ff9640 1 -- 172.21.15.71:0/4023143928 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f51fc056e70 con 0x7f520c0fd9c0 2024-09-10T10:04:35.103 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:04:35.103 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:04:35.103 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2 2024-09-10T10:04:35.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:04:35.103 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:04:35.103 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 1, 2024-09-10T10:04:35.103 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 1 2024-09-10T10:04:35.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:04:35.103 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:04:35.103 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 6 2024-09-10T10:04:35.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:04:35.104 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:04:35.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:04:35.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:04:35.104 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:04:35.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 13, 2024-09-10T10:04:35.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 1 2024-09-10T10:04:35.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:04:35.104 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:04:35.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.104+0000 7f521179f640 1 -- 172.21.15.71:0/4023143928 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f51f406e4a0 msgr2=0x7f51f4070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:35.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.104+0000 7f521179f640 1 --2- 172.21.15.71:0/4023143928 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f51f406e4a0 0x7f51f4070950 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5200000c00 tx=0x7f5200035040 comp rx=0 tx=0).stop 2024-09-10T10:04:35.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.104+0000 7f521179f640 1 -- 172.21.15.71:0/4023143928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f520c0fd9c0 msgr2=0x7f520c0fd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:35.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.104+0000 7f521179f640 1 --2- 172.21.15.71:0/4023143928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f520c0fd9c0 0x7f520c0fd1b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0027d0 tx=0x7f51fc009f70 comp rx=0 tx=0).stop 2024-09-10T10:04:35.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.104+0000 7f521179f640 1 -- 172.21.15.71:0/4023143928 shutdown_connections 2024-09-10T10:04:35.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.104+0000 7f521179f640 1 --2- 172.21.15.71:0/4023143928 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f51f406e4a0 0x7f51f4070950 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.104+0000 7f521179f640 1 --2- 172.21.15.71:0/4023143928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f520c0fe310 0x7f520c0fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.104+0000 7f521179f640 1 --2- 172.21.15.71:0/4023143928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f520c0fd9c0 0x7f520c0fd1b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.104+0000 7f521179f640 1 -- 172.21.15.71:0/4023143928 >> 172.21.15.71:0/4023143928 conn(0x7f520c0f61c0 msgr2=0x7f520c0f79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:35.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.104+0000 7f521179f640 1 -- 172.21.15.71:0/4023143928 shutdown_connections 2024-09-10T10:04:35.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.105+0000 7f521179f640 1 -- 172.21.15.71:0/4023143928 wait complete. 2024-09-10T10:04:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.211+0000 7fe2da6d1640 1 -- 172.21.15.71:0/3642813271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d4066470 msgr2=0x7fe2d40ff190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.211+0000 7fe2da6d1640 1 --2- 172.21.15.71:0/3642813271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d4066470 0x7fe2d40ff190 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40048d0 tx=0x7fe2c4009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.212+0000 7fe2da6d1640 1 -- 172.21.15.71:0/3642813271 shutdown_connections 2024-09-10T10:04:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.212+0000 7fe2da6d1640 1 --2- 172.21.15.71:0/3642813271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2d40ff6d0 0x7fe2d4101ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.212+0000 7fe2da6d1640 1 --2- 172.21.15.71:0/3642813271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d4066470 0x7fe2d40ff190 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.212+0000 7fe2da6d1640 1 -- 172.21.15.71:0/3642813271 >> 172.21.15.71:0/3642813271 conn(0x7fe2d40f6c00 msgr2=0x7fe2d40f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.212+0000 7fe2da6d1640 1 -- 172.21.15.71:0/3642813271 shutdown_connections 2024-09-10T10:04:35.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.212+0000 7fe2da6d1640 1 -- 172.21.15.71:0/3642813271 wait complete. 2024-09-10T10:04:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2da6d1640 1 Processor -- start 2024-09-10T10:04:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2da6d1640 1 -- start start 2024-09-10T10:04:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2da6d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2d4066470 0x7fe2d410d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2da6d1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d40ff6d0 0x7fe2d410d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2da6d1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d410dcb0 con 0x7fe2d40ff6d0 2024-09-10T10:04:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2da6d1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d410e480 con 0x7fe2d4066470 2024-09-10T10:04:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2cbfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d40ff6d0 0x7fe2d410d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2cbfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d40ff6d0 0x7fe2d410d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58126/0 (socket says 172.21.15.71:58126) 2024-09-10T10:04:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2cbfff640 1 -- 172.21.15.71:0/613010618 learned_addr learned my addr 172.21.15.71:0/613010618 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2d3fff640 1 --2- 172.21.15.71:0/613010618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2d4066470 0x7fe2d410d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:35.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2cbfff640 1 -- 172.21.15.71:0/613010618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2d4066470 msgr2=0x7fe2d410d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2cbfff640 1 --2- 172.21.15.71:0/613010618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2d4066470 0x7fe2d410d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2cbfff640 1 -- 172.21.15.71:0/613010618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c4005040 con 0x7fe2d40ff6d0 2024-09-10T10:04:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.213+0000 7fe2cbfff640 1 --2- 172.21.15.71:0/613010618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d40ff6d0 0x7fe2d410d660 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00eb70 tx=0x7fe2bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.214+0000 7fe2d17fa640 1 -- 172.21.15.71:0/613010618 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2bc007c30 con 0x7fe2d40ff6d0 2024-09-10T10:04:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.214+0000 7fe2d17fa640 1 -- 172.21.15.71:0/613010618 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe2bc00f040 con 0x7fe2d40ff6d0 2024-09-10T10:04:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.214+0000 7fe2da6d1640 1 -- 172.21.15.71:0/613010618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d410e6b0 con 0x7fe2d40ff6d0 2024-09-10T10:04:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.214+0000 7fe2d17fa640 1 -- 172.21.15.71:0/613010618 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2bc00ca60 con 0x7fe2d40ff6d0 2024-09-10T10:04:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.214+0000 7fe2da6d1640 1 -- 172.21.15.71:0/613010618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d410ec50 con 0x7fe2d40ff6d0 2024-09-10T10:04:35.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.215+0000 7fe2da6d1640 1 -- 172.21.15.71:0/613010618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d40fa880 con 0x7fe2d40ff6d0 2024-09-10T10:04:35.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.216+0000 7fe2d17fa640 1 -- 172.21.15.71:0/613010618 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7fe2bc00cbc0 con 0x7fe2d40ff6d0 2024-09-10T10:04:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.217+0000 7fe2d17fa640 1 --2- 172.21.15.71:0/613010618 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fe2c006e4a0 0x7fe2c0070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.217+0000 7fe2d17fa640 1 -- 172.21.15.71:0/613010618 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe2bc08dc80 con 0x7fe2d40ff6d0 2024-09-10T10:04:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.217+0000 7fe2d3fff640 1 --2- 172.21.15.71:0/613010618 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fe2c006e4a0 0x7fe2c0070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:35.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.218+0000 7fe2d3fff640 1 --2- 172.21.15.71:0/613010618 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fe2c006e4a0 0x7fe2c0070950 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40048a0 tx=0x7fe2c4035040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:35.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.221+0000 7fe2d17fa640 1 -- 172.21.15.71:0/613010618 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe2bc057870 con 0x7fe2d40ff6d0 2024-09-10T10:04:35.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:34 smithi071 ceph-mon[27559]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:35.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:34 smithi071 ceph-mon[27559]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:35.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:34 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:35.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:34 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:35.350 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:34 smithi107 ceph-mon[34215]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:35.350 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:34 smithi107 ceph-mon[34215]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:35.350 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:34 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:35.351 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:34 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:35.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.503+0000 7fe2da6d1640 1 -- 172.21.15.71:0/613010618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe2d404b720 con 0x7fe2d40ff6d0 2024-09-10T10:04:35.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.503+0000 7fe2d17fa640 1 -- 172.21.15.71:0/613010618 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1866 (secure 0 0 0) 0x7fe2bc05af30 con 0x7fe2d40ff6d0 2024-09-10T10:04:35.504 INFO:teuthology.orchestra.run.smithi071.stdout:e22 2024-09-10T10:04:35.505 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:04:35.505 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:04:35.505 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:04:35.505 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:04:35.505 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:04:35.505 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:04:35.505 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 22 2024-09-10T10:04:35.505 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:04:35.505 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:04:35.505 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:04:19.815073+0000 2024-09-10T10:04:35.505 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:04:35.505 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:04:35.506 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:04:35.507 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:04:35.507 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:04:35.507 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:04:35.507 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:04:35.507 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:04:35.507 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:04:35.507 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:04:35.507 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:04:35.507 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:04:35.507 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:04:35.508 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 22 2024-09-10T10:04:35.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.506+0000 7fe2da6d1640 1 -- 172.21.15.71:0/613010618 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fe2c006e4a0 msgr2=0x7fe2c0070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:35.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.506+0000 7fe2da6d1640 1 --2- 172.21.15.71:0/613010618 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fe2c006e4a0 0x7fe2c0070950 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40048a0 tx=0x7fe2c4035040 comp rx=0 tx=0).stop 2024-09-10T10:04:35.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.506+0000 7fe2da6d1640 1 -- 172.21.15.71:0/613010618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d40ff6d0 msgr2=0x7fe2d410d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:35.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.506+0000 7fe2da6d1640 1 --2- 172.21.15.71:0/613010618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d40ff6d0 0x7fe2d410d660 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00eb70 tx=0x7fe2bc00b040 comp rx=0 tx=0).stop 2024-09-10T10:04:35.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.506+0000 7fe2da6d1640 1 -- 172.21.15.71:0/613010618 shutdown_connections 2024-09-10T10:04:35.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.506+0000 7fe2da6d1640 1 --2- 172.21.15.71:0/613010618 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fe2c006e4a0 0x7fe2c0070950 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.506+0000 7fe2da6d1640 1 --2- 172.21.15.71:0/613010618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d40ff6d0 0x7fe2d410d660 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.506+0000 7fe2da6d1640 1 --2- 172.21.15.71:0/613010618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2d4066470 0x7fe2d410d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.506+0000 7fe2da6d1640 1 -- 172.21.15.71:0/613010618 >> 172.21.15.71:0/613010618 conn(0x7fe2d40f6c00 msgr2=0x7fe2d40f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:35.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.506+0000 7fe2da6d1640 1 -- 172.21.15.71:0/613010618 shutdown_connections 2024-09-10T10:04:35.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.506+0000 7fe2da6d1640 1 -- 172.21.15.71:0/613010618 wait complete. 2024-09-10T10:04:35.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.633+0000 7fcaa159a640 1 -- 172.21.15.71:0/999454039 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca8c0337b0 con 0x7fcaa40fabb0 2024-09-10T10:04:35.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.634+0000 7fcaa8a82640 1 -- 172.21.15.71:0/999454039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa40fabb0 msgr2=0x7fcaa40fafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:35.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.634+0000 7fcaa8a82640 1 --2- 172.21.15.71:0/999454039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa40fabb0 0x7fcaa40fafc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0049c0 tx=0x7fca8c00aeb0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.634+0000 7fcaa8a82640 1 -- 172.21.15.71:0/999454039 shutdown_connections 2024-09-10T10:04:35.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.634+0000 7fcaa8a82640 1 --2- 172.21.15.71:0/999454039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaa40fbe80 0x7fcaa40fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.634+0000 7fcaa8a82640 1 --2- 172.21.15.71:0/999454039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa40fabb0 0x7fcaa40fafc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.634+0000 7fcaa8a82640 1 -- 172.21.15.71:0/999454039 >> 172.21.15.71:0/999454039 conn(0x7fcaa40f6390 msgr2=0x7fcaa40f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:35.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.634+0000 7fcaa8a82640 1 -- 172.21.15.71:0/999454039 shutdown_connections 2024-09-10T10:04:35.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.635+0000 7fcaa8a82640 1 -- 172.21.15.71:0/999454039 wait complete. 2024-09-10T10:04:35.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.635+0000 7fcaa8a82640 1 Processor -- start 2024-09-10T10:04:35.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.635+0000 7fcaa8a82640 1 -- start start 2024-09-10T10:04:35.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.636+0000 7fcaa8a82640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa40fabb0 0x7fcaa410af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:35.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.636+0000 7fcaa8a82640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaa40fbe80 0x7fcaa410b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:35.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.636+0000 7fcaa8a82640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa410ba60 con 0x7fcaa40fabb0 2024-09-10T10:04:35.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.636+0000 7fcaa8a82640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa410c2d0 con 0x7fcaa40fbe80 2024-09-10T10:04:35.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.636+0000 7fcaa259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa40fabb0 0x7fcaa410af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:35.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.636+0000 7fcaa259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa40fabb0 0x7fcaa410af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58142/0 (socket says 172.21.15.71:58142) 2024-09-10T10:04:35.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.636+0000 7fcaa259c640 1 -- 172.21.15.71:0/3916242401 learned_addr learned my addr 172.21.15.71:0/3916242401 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:35.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.636+0000 7fcaa1d9b640 1 --2- 172.21.15.71:0/3916242401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaa40fbe80 0x7fcaa410b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:35.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.636+0000 7fcaa259c640 1 -- 172.21.15.71:0/3916242401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaa40fbe80 msgr2=0x7fcaa410b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:35.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.636+0000 7fcaa259c640 1 --2- 172.21.15.71:0/3916242401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaa40fbe80 0x7fcaa410b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.636+0000 7fcaa259c640 1 -- 172.21.15.71:0/3916242401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c005040 con 0x7fcaa40fabb0 2024-09-10T10:04:35.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.637+0000 7fcaa259c640 1 --2- 172.21.15.71:0/3916242401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa40fabb0 0x7fcaa410af20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fca8c033430 tx=0x7fca8c00aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:35.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.637+0000 7fca9affd640 1 -- 172.21.15.71:0/3916242401 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca8c033920 con 0x7fcaa40fabb0 2024-09-10T10:04:35.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.637+0000 7fcaa8a82640 1 -- 172.21.15.71:0/3916242401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa410c470 con 0x7fcaa40fabb0 2024-09-10T10:04:35.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.637+0000 7fcaa8a82640 1 -- 172.21.15.71:0/3916242401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa410ca10 con 0x7fcaa40fabb0 2024-09-10T10:04:35.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.638+0000 7fca9affd640 1 -- 172.21.15.71:0/3916242401 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fca8c03c420 con 0x7fcaa40fabb0 2024-09-10T10:04:35.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.638+0000 7fca9affd640 1 -- 172.21.15.71:0/3916242401 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca8c034640 con 0x7fcaa40fabb0 2024-09-10T10:04:35.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.639+0000 7fcaa8a82640 1 -- 172.21.15.71:0/3916242401 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa40fa010 con 0x7fcaa40fabb0 2024-09-10T10:04:35.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.640+0000 7fca9affd640 1 -- 172.21.15.71:0/3916242401 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7fca8c031020 con 0x7fcaa40fabb0 2024-09-10T10:04:35.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.641+0000 7fca9affd640 1 --2- 172.21.15.71:0/3916242401 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fca9006e570 0x7fca90070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:35.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.641+0000 7fca9affd640 1 -- 172.21.15.71:0/3916242401 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fca8c0ae9d0 con 0x7fcaa40fabb0 2024-09-10T10:04:35.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.642+0000 7fcaa1d9b640 1 --2- 172.21.15.71:0/3916242401 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fca9006e570 0x7fca90070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:35.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.643+0000 7fcaa1d9b640 1 --2- 172.21.15.71:0/3916242401 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fca9006e570 0x7fca90070a20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fca94009fd0 tx=0x7fca94009e50 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:35.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.648+0000 7fca9affd640 1 -- 172.21.15.71:0/3916242401 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fca8c0793a0 con 0x7fcaa40fabb0 2024-09-10T10:04:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.967+0000 7fcaa8a82640 1 -- 172.21.15.71:0/3916242401 --> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcaa410cdd0 con 0x7fca9006e570 2024-09-10T10:04:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.969+0000 7fca9affd640 1 -- 172.21.15.71:0/3916242401 <== mgr.24391 v2:172.21.15.107:6828/591375611 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fcaa410cdd0 con 0x7fca9006e570 2024-09-10T10:04:35.970 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:04:35.970 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:04:35.970 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:04:35.970 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:04:35.970 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-10T10:04:35.970 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "1/21 daemons upgraded", 2024-09-10T10:04:35.970 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "", 2024-09-10T10:04:35.970 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:04:35.970 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:04:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.971+0000 7fcaa8a82640 1 -- 172.21.15.71:0/3916242401 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fca9006e570 msgr2=0x7fca90070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.971+0000 7fcaa8a82640 1 --2- 172.21.15.71:0/3916242401 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fca9006e570 0x7fca90070a20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fca94009fd0 tx=0x7fca94009e50 comp rx=0 tx=0).stop 2024-09-10T10:04:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.971+0000 7fcaa8a82640 1 -- 172.21.15.71:0/3916242401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa40fabb0 msgr2=0x7fcaa410af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.971+0000 7fcaa8a82640 1 --2- 172.21.15.71:0/3916242401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa40fabb0 0x7fcaa410af20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fca8c033430 tx=0x7fca8c00aeb0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.971+0000 7fcaa8a82640 1 -- 172.21.15.71:0/3916242401 shutdown_connections 2024-09-10T10:04:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.971+0000 7fcaa8a82640 1 --2- 172.21.15.71:0/3916242401 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fca9006e570 0x7fca90070a20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.971+0000 7fcaa8a82640 1 --2- 172.21.15.71:0/3916242401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaa40fbe80 0x7fcaa410b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.971+0000 7fcaa8a82640 1 --2- 172.21.15.71:0/3916242401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcaa40fabb0 0x7fcaa410af20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.971+0000 7fcaa8a82640 1 -- 172.21.15.71:0/3916242401 >> 172.21.15.71:0/3916242401 conn(0x7fcaa40f6390 msgr2=0x7fcaa40f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.971+0000 7fcaa8a82640 1 -- 172.21.15.71:0/3916242401 shutdown_connections 2024-09-10T10:04:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:35.971+0000 7fcaa8a82640 1 -- 172.21.15.71:0/3916242401 wait complete. 2024-09-10T10:04:36.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.062+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/2354913282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cd8065c40 msgr2=0x7f8cd80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:36.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.062+0000 7f8cdc8cf640 1 --2- 172.21.15.71:0/2354913282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cd8065c40 0x7f8cd80ff140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80048d0 tx=0x7f8cc8009da0 comp rx=0 tx=0).stop 2024-09-10T10:04:36.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.062+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/2354913282 shutdown_connections 2024-09-10T10:04:36.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.062+0000 7f8cdc8cf640 1 --2- 172.21.15.71:0/2354913282 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd80ff680 0x7f8cd8101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:36.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.062+0000 7f8cdc8cf640 1 --2- 172.21.15.71:0/2354913282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cd8065c40 0x7f8cd80ff140 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:36.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.062+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/2354913282 >> 172.21.15.71:0/2354913282 conn(0x7f8cd80f6c10 msgr2=0x7f8cd80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:36.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.062+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/2354913282 shutdown_connections 2024-09-10T10:04:36.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.062+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/2354913282 wait complete. 2024-09-10T10:04:36.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.063+0000 7f8cdc8cf640 1 Processor -- start 2024-09-10T10:04:36.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.063+0000 7f8cdc8cf640 1 -- start start 2024-09-10T10:04:36.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.063+0000 7f8cdc8cf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd8065c40 0x7f8cd810f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:36.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.063+0000 7f8cdc8cf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cd80ff680 0x7f8cd810f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:36.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.063+0000 7f8cdc8cf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd810fe60 con 0x7f8cd80ff680 2024-09-10T10:04:36.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.063+0000 7f8cdc8cf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8110680 con 0x7f8cd8065c40 2024-09-10T10:04:36.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.063+0000 7f8ccffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cd80ff680 0x7f8cd810f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:36.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.064+0000 7f8ccffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cd80ff680 0x7f8cd810f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58170/0 (socket says 172.21.15.71:58170) 2024-09-10T10:04:36.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.064+0000 7f8ccffff640 1 -- 172.21.15.71:0/3550523213 learned_addr learned my addr 172.21.15.71:0/3550523213 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:04:36.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.064+0000 7f8cd659c640 1 --2- 172.21.15.71:0/3550523213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd8065c40 0x7f8cd810f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:36.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.064+0000 7f8ccffff640 1 -- 172.21.15.71:0/3550523213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd8065c40 msgr2=0x7f8cd810f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:36.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.064+0000 7f8ccffff640 1 --2- 172.21.15.71:0/3550523213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd8065c40 0x7f8cd810f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:36.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.064+0000 7f8ccffff640 1 -- 172.21.15.71:0/3550523213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8005040 con 0x7f8cd80ff680 2024-09-10T10:04:36.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.064+0000 7f8ccffff640 1 --2- 172.21.15.71:0/3550523213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cd80ff680 0x7f8cd810f810 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000eb70 tx=0x7f8cc000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:36.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.064+0000 7f8cceffd640 1 -- 172.21.15.71:0/3550523213 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc0007c30 con 0x7f8cd80ff680 2024-09-10T10:04:36.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.064+0000 7f8cceffd640 1 -- 172.21.15.71:0/3550523213 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8cc000f040 con 0x7f8cd80ff680 2024-09-10T10:04:36.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.064+0000 7f8cceffd640 1 -- 172.21.15.71:0/3550523213 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc000ca60 con 0x7f8cd80ff680 2024-09-10T10:04:36.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.064+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/3550523213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd81108b0 con 0x7f8cd80ff680 2024-09-10T10:04:36.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.064+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/3550523213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd8110e00 con 0x7f8cd80ff680 2024-09-10T10:04:36.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.066+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/3550523213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd80fa890 con 0x7f8cd80ff680 2024-09-10T10:04:36.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.066+0000 7f8cceffd640 1 -- 172.21.15.71:0/3550523213 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f8cc000cbc0 con 0x7f8cd80ff680 2024-09-10T10:04:36.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.067+0000 7f8cceffd640 1 --2- 172.21.15.71:0/3550523213 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f8cc406e4a0 0x7f8cc4070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:36.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.067+0000 7f8cceffd640 1 -- 172.21.15.71:0/3550523213 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8cc008d8a0 con 0x7f8cd80ff680 2024-09-10T10:04:36.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.067+0000 7f8cd659c640 1 --2- 172.21.15.71:0/3550523213 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f8cc406e4a0 0x7f8cc4070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:36.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.068+0000 7f8cd659c640 1 --2- 172.21.15.71:0/3550523213 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f8cc406e4a0 0x7f8cc4070950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8007ac0 tx=0x7f8cc8035040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:36.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.071+0000 7f8cceffd640 1 -- 172.21.15.71:0/3550523213 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8cc0057390 con 0x7f8cd80ff680 2024-09-10T10:04:36.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:35 smithi107 ceph-mon[34215]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:36.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:35 smithi107 ceph-mon[34215]: pgmap v9: 65 pgs: 65 active+clean; 4.1 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 88 MiB/s rd, 218 MiB/s wr, 503 op/s 2024-09-10T10:04:36.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:35 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/4023143928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:04:36.242 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:35 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/613010618' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:04:36.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:35 smithi071 ceph-mon[27559]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:36.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:35 smithi071 ceph-mon[27559]: pgmap v9: 65 pgs: 65 active+clean; 4.1 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 88 MiB/s rd, 218 MiB/s wr, 503 op/s 2024-09-10T10:04:36.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:35 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/4023143928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:04:36.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:35 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/613010618' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:04:36.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.405+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/3550523213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8cd8104fb0 con 0x7f8cd80ff680 2024-09-10T10:04:36.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.406+0000 7f8cceffd640 1 -- 172.21.15.71:0/3550523213 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8cc005aa50 con 0x7f8cd80ff680 2024-09-10T10:04:36.407 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:04:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.408+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/3550523213 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f8cc406e4a0 msgr2=0x7f8cc4070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.408+0000 7f8cdc8cf640 1 --2- 172.21.15.71:0/3550523213 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f8cc406e4a0 0x7f8cc4070950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8007ac0 tx=0x7f8cc8035040 comp rx=0 tx=0).stop 2024-09-10T10:04:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.408+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/3550523213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cd80ff680 msgr2=0x7f8cd810f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.408+0000 7f8cdc8cf640 1 --2- 172.21.15.71:0/3550523213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cd80ff680 0x7f8cd810f810 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000eb70 tx=0x7f8cc000b040 comp rx=0 tx=0).stop 2024-09-10T10:04:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.408+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/3550523213 shutdown_connections 2024-09-10T10:04:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.408+0000 7f8cdc8cf640 1 --2- 172.21.15.71:0/3550523213 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f8cc406e4a0 0x7f8cc4070950 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.408+0000 7f8cdc8cf640 1 --2- 172.21.15.71:0/3550523213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cd80ff680 0x7f8cd810f810 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.408+0000 7f8cdc8cf640 1 --2- 172.21.15.71:0/3550523213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd8065c40 0x7f8cd810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.408+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/3550523213 >> 172.21.15.71:0/3550523213 conn(0x7f8cd80f6c10 msgr2=0x7f8cd80fb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.408+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/3550523213 shutdown_connections 2024-09-10T10:04:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:04:36.408+0000 7f8cdc8cf640 1 -- 172.21.15.71:0/3550523213 wait complete. 2024-09-10T10:04:37.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:37 smithi107 ceph-mon[34215]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:37.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:37 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3550523213' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:04:37.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:37 smithi071 ceph-mon[27559]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:37.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:37 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3550523213' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:04:38.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:38 smithi071 ceph-mon[27559]: pgmap v10: 65 pgs: 65 active+clean; 4.1 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 79 MiB/s rd, 197 MiB/s wr, 455 op/s 2024-09-10T10:04:38.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:38 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:38.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:38 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:38.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:38 smithi107 ceph-mon[34215]: pgmap v10: 65 pgs: 65 active+clean; 4.1 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 79 MiB/s rd, 197 MiB/s wr, 455 op/s 2024-09-10T10:04:38.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:38 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:38.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:38 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:39.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:04:39.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:39.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:39.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:39.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:39.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:39.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:39.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:39.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:39 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:39.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:04:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:39.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:39.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:39.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:39 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:40.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: Adjusting osd_memory_target on smithi107 to 2581M 2024-09-10T10:04:40.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: Adjusting osd_memory_target on smithi071 to 1557M 2024-09-10T10:04:40.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T10:04:40.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-10T10:04:40.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: pgmap v11: 65 pgs: 65 active+clean; 4.1 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 79 MiB/s rd, 197 MiB/s wr, 455 op/s 2024-09-10T10:04:40.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:04:40.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:04:40.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:04:40.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:04:40.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:04:40.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:04:40.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:40 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: Adjusting osd_memory_target on smithi107 to 2581M 2024-09-10T10:04:40.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: Adjusting osd_memory_target on smithi071 to 1557M 2024-09-10T10:04:40.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T10:04:40.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-10T10:04:40.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: pgmap v11: 65 pgs: 65 active+clean; 4.1 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 79 MiB/s rd, 197 MiB/s wr, 455 op/s 2024-09-10T10:04:40.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:04:40.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:04:40.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:04:40.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:04:40.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:04:40.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:04:40.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:40.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:40 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:41.265 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:41 smithi071 ceph-mon[27559]: Reconfiguring node-exporter.smithi071 (dependencies changed)... 2024-09-10T10:04:41.265 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:41 smithi071 ceph-mon[27559]: Reconfiguring daemon node-exporter.smithi071 on smithi071 2024-09-10T10:04:41.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:41 smithi107 ceph-mon[34215]: Reconfiguring node-exporter.smithi071 (dependencies changed)... 2024-09-10T10:04:41.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:41 smithi107 ceph-mon[34215]: Reconfiguring daemon node-exporter.smithi071 on smithi071 2024-09-10T10:04:42.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:42 smithi071 ceph-mon[27559]: pgmap v12: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 82 MiB/s rd, 202 MiB/s wr, 570 op/s 2024-09-10T10:04:42.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:42 smithi107 ceph-mon[34215]: pgmap v12: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 82 MiB/s rd, 202 MiB/s wr, 570 op/s 2024-09-10T10:04:43.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:43 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:43.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:43 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:43.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:43 smithi071 ceph-mon[27559]: Reconfiguring alertmanager.smithi071 (dependencies changed)... 2024-09-10T10:04:43.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:43 smithi071 ceph-mon[27559]: Reconfiguring daemon alertmanager.smithi071 on smithi071 2024-09-10T10:04:43.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:43 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:43.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:43 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:43.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:43 smithi107 ceph-mon[34215]: Reconfiguring alertmanager.smithi071 (dependencies changed)... 2024-09-10T10:04:43.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:43 smithi107 ceph-mon[34215]: Reconfiguring daemon alertmanager.smithi071 on smithi071 2024-09-10T10:04:44.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:44 smithi071 ceph-mon[27559]: pgmap v13: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 36 MiB/s rd, 94 MiB/s wr, 314 op/s 2024-09-10T10:04:44.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:44 smithi107 ceph-mon[34215]: pgmap v13: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 36 MiB/s rd, 94 MiB/s wr, 314 op/s 2024-09-10T10:04:45.003 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T10:04:45.003 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-10T10:04:46.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:46 smithi071 ceph-mon[27559]: pgmap v14: 65 pgs: 65 active+clean; 1.6 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 37 MiB/s rd, 95 MiB/s wr, 421 op/s 2024-09-10T10:04:46.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:46 smithi107 ceph-mon[34215]: pgmap v14: 65 pgs: 65 active+clean; 1.6 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 37 MiB/s rd, 95 MiB/s wr, 421 op/s 2024-09-10T10:04:47.159 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T10:04:47.160 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T10:04:48.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:48 smithi107 ceph-mon[34215]: pgmap v15: 65 pgs: 65 active+clean; 1.6 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 3.4 MiB/s rd, 6.0 MiB/s wr, 222 op/s 2024-09-10T10:04:48.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:48 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:48.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:48 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:48.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:48 smithi071 ceph-mon[27559]: pgmap v15: 65 pgs: 65 active+clean; 1.6 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 3.4 MiB/s rd, 6.0 MiB/s wr, 222 op/s 2024-09-10T10:04:48.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:48 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:48.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:48 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:49.285 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:49 smithi071 ceph-mon[27559]: Reconfiguring grafana.smithi071 (dependencies changed)... 2024-09-10T10:04:49.285 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:49 smithi071 ceph-mon[27559]: Reconfiguring daemon grafana.smithi071 on smithi071 2024-09-10T10:04:49.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:49 smithi107 ceph-mon[34215]: Reconfiguring grafana.smithi071 (dependencies changed)... 2024-09-10T10:04:49.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:49 smithi107 ceph-mon[34215]: Reconfiguring daemon grafana.smithi071 on smithi071 2024-09-10T10:04:50.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:50 smithi071 ceph-mon[27559]: pgmap v16: 65 pgs: 65 active+clean; 1.6 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 3.4 MiB/s rd, 6.0 MiB/s wr, 222 op/s 2024-09-10T10:04:50.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:50 smithi107 ceph-mon[34215]: pgmap v16: 65 pgs: 65 active+clean; 1.6 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 3.4 MiB/s rd, 6.0 MiB/s wr, 222 op/s 2024-09-10T10:04:52.523 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:52 smithi071 ceph-mon[27559]: pgmap v17: 65 pgs: 65 active+clean; 404 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 4.2 MiB/s rd, 6.9 MiB/s wr, 371 op/s 2024-09-10T10:04:52.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:52 smithi107 ceph-mon[34215]: pgmap v17: 65 pgs: 65 active+clean; 404 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 4.2 MiB/s rd, 6.9 MiB/s wr, 371 op/s 2024-09-10T10:04:54.204 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:54 smithi071 ceph-mon[27559]: pgmap v18: 65 pgs: 65 active+clean; 404 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 256 op/s 2024-09-10T10:04:54.471 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:54 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:54.471 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:54 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:54.471 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:54 smithi071 ceph-mon[27559]: Reconfiguring prometheus.smithi071 (dependencies changed)... 2024-09-10T10:04:54.471 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:54 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:04:54.471 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:54 smithi071 ceph-mon[27559]: Reconfiguring daemon prometheus.smithi071 on smithi071 2024-09-10T10:04:54.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:54 smithi107 ceph-mon[34215]: pgmap v18: 65 pgs: 65 active+clean; 404 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 256 op/s 2024-09-10T10:04:54.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:54 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:54 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:04:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:54 smithi107 ceph-mon[34215]: Reconfiguring prometheus.smithi071 (dependencies changed)... 2024-09-10T10:04:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:54 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:04:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:54 smithi107 ceph-mon[34215]: Reconfiguring daemon prometheus.smithi071 on smithi071 2024-09-10T10:04:56.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:56 smithi071 ceph-mon[27559]: pgmap v19: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 512 op/s 2024-09-10T10:04:56.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:56 smithi107 ceph-mon[34215]: pgmap v19: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 512 op/s 2024-09-10T10:04:58.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:04:58 smithi071 ceph-mon[27559]: pgmap v20: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 404 op/s 2024-09-10T10:04:58.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:04:58 smithi107 ceph-mon[34215]: pgmap v20: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 404 op/s 2024-09-10T10:05:00.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:00 smithi071 ceph-mon[27559]: pgmap v21: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 405 op/s 2024-09-10T10:05:00.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:00 smithi107 ceph-mon[34215]: pgmap v21: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 405 op/s 2024-09-10T10:05:02.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:02 smithi071 ceph-mon[27559]: pgmap v22: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 649 op/s 2024-09-10T10:05:02.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:02 smithi107 ceph-mon[34215]: pgmap v22: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 649 op/s 2024-09-10T10:05:04.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:04 smithi071 ceph-mon[27559]: pgmap v23: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 500 op/s 2024-09-10T10:05:04.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:04 smithi107 ceph-mon[34215]: pgmap v23: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 500 op/s 2024-09-10T10:05:06.502 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:06 smithi071 ceph-mon[27559]: pgmap v24: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 706 op/s 2024-09-10T10:05:06.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.499+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/375186412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f840fc570 msgr2=0x7f5f840fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:06.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.499+0000 7f5f8b1ae640 1 --2- 172.21.15.71:0/375186412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f840fc570 0x7f5f840fc980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5f780048d0 tx=0x7f5f78009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:06.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.499+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/375186412 shutdown_connections 2024-09-10T10:05:06.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.499+0000 7f5f8b1ae640 1 --2- 172.21.15.71:0/375186412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f840fd840 0x7f5f840fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:06.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.499+0000 7f5f8b1ae640 1 --2- 172.21.15.71:0/375186412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f840fc570 0x7f5f840fc980 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:06.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.499+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/375186412 >> 172.21.15.71:0/375186412 conn(0x7f5f840f7d10 msgr2=0x7f5f840fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:06.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.499+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/375186412 shutdown_connections 2024-09-10T10:05:06.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.500+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/375186412 wait complete. 2024-09-10T10:05:06.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.500+0000 7f5f8b1ae640 1 Processor -- start 2024-09-10T10:05:06.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.500+0000 7f5f8b1ae640 1 -- start start 2024-09-10T10:05:06.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.500+0000 7f5f8b1ae640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f840fc570 0x7f5f8410d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:06.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.500+0000 7f5f8b1ae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f840fd840 0x7f5f8410d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:06.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.500+0000 7f5f8b1ae640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8410dc60 con 0x7f5f840fc570 2024-09-10T10:05:06.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.500+0000 7f5f8b1ae640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8410e430 con 0x7f5f840fd840 2024-09-10T10:05:06.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.501+0000 7f5f88f4a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f840fc570 0x7f5f8410d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:06.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.501+0000 7f5f88f4a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f840fc570 0x7f5f8410d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57554/0 (socket says 172.21.15.71:57554) 2024-09-10T10:05:06.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.501+0000 7f5f88f4a640 1 -- 172.21.15.71:0/2028152003 learned_addr learned my addr 172.21.15.71:0/2028152003 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:06.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.501+0000 7f5f83fff640 1 --2- 172.21.15.71:0/2028152003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f840fd840 0x7f5f8410d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:06.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.501+0000 7f5f88f4a640 1 -- 172.21.15.71:0/2028152003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f840fd840 msgr2=0x7f5f8410d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:06.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.501+0000 7f5f88f4a640 1 --2- 172.21.15.71:0/2028152003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f840fd840 0x7f5f8410d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:06.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.501+0000 7f5f88f4a640 1 -- 172.21.15.71:0/2028152003 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f78005040 con 0x7f5f840fc570 2024-09-10T10:05:06.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.501+0000 7f5f88f4a640 1 --2- 172.21.15.71:0/2028152003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f840fc570 0x7f5f8410d0d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5f780048a0 tx=0x7f5f78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:06.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.501+0000 7f5f817fa640 1 -- 172.21.15.71:0/2028152003 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f78038070 con 0x7f5f840fc570 2024-09-10T10:05:06.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.501+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/2028152003 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8410e660 con 0x7f5f840fc570 2024-09-10T10:05:06.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.501+0000 7f5f817fa640 1 -- 172.21.15.71:0/2028152003 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5f78004290 con 0x7f5f840fc570 2024-09-10T10:05:06.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.501+0000 7f5f817fa640 1 -- 172.21.15.71:0/2028152003 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f78033660 con 0x7f5f840fc570 2024-09-10T10:05:06.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.501+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/2028152003 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8410ec00 con 0x7f5f840fc570 2024-09-10T10:05:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.503+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/2028152003 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f840fb9d0 con 0x7f5f840fc570 2024-09-10T10:05:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.503+0000 7f5f817fa640 1 -- 172.21.15.71:0/2028152003 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f5f78030020 con 0x7f5f840fc570 2024-09-10T10:05:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.504+0000 7f5f817fa640 1 --2- 172.21.15.71:0/2028152003 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f5f7406e4a0 0x7f5f74070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.504+0000 7f5f817fa640 1 -- 172.21.15.71:0/2028152003 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5f780adc30 con 0x7f5f840fc570 2024-09-10T10:05:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.504+0000 7f5f83fff640 1 --2- 172.21.15.71:0/2028152003 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f5f7406e4a0 0x7f5f74070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.504+0000 7f5f83fff640 1 --2- 172.21.15.71:0/2028152003 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f5f7406e4a0 0x7f5f74070950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5f8410ce80 tx=0x7f5f7000b040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:06.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.508+0000 7f5f817fa640 1 -- 172.21.15.71:0/2028152003 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f5f780778b0 con 0x7f5f840fc570 2024-09-10T10:05:06.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:06 smithi107 ceph-mon[34215]: pgmap v24: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 706 op/s 2024-09-10T10:05:06.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.749+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/2028152003 --> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f8410ef00 con 0x7f5f7406e4a0 2024-09-10T10:05:06.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.751+0000 7f5f817fa640 1 -- 172.21.15.71:0/2028152003 <== mgr.24391 v2:172.21.15.107:6828/591375611 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f5f8410ef00 con 0x7f5f7406e4a0 2024-09-10T10:05:06.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.753+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/2028152003 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f5f7406e4a0 msgr2=0x7f5f74070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:06.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.753+0000 7f5f8b1ae640 1 --2- 172.21.15.71:0/2028152003 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f5f7406e4a0 0x7f5f74070950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5f8410ce80 tx=0x7f5f7000b040 comp rx=0 tx=0).stop 2024-09-10T10:05:06.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.753+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/2028152003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f840fc570 msgr2=0x7f5f8410d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:06.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.753+0000 7f5f8b1ae640 1 --2- 172.21.15.71:0/2028152003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f840fc570 0x7f5f8410d0d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5f780048a0 tx=0x7f5f78009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:06.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.754+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/2028152003 shutdown_connections 2024-09-10T10:05:06.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.754+0000 7f5f8b1ae640 1 --2- 172.21.15.71:0/2028152003 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f5f7406e4a0 0x7f5f74070950 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:06.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.754+0000 7f5f8b1ae640 1 --2- 172.21.15.71:0/2028152003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f840fd840 0x7f5f8410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:06.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.754+0000 7f5f8b1ae640 1 --2- 172.21.15.71:0/2028152003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f840fc570 0x7f5f8410d0d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:06.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.754+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/2028152003 >> 172.21.15.71:0/2028152003 conn(0x7f5f840f7d10 msgr2=0x7f5f840f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:06.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.754+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/2028152003 shutdown_connections 2024-09-10T10:05:06.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.754+0000 7f5f8b1ae640 1 -- 172.21.15.71:0/2028152003 wait complete. 2024-09-10T10:05:06.764 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:05:06.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.850+0000 7f6479ffb640 1 -- 172.21.15.71:0/1602140073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64740fe580 msgr2=0x7f64740fa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:06.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.850+0000 7f6479ffb640 1 --2- 172.21.15.71:0/1602140073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64740fe580 0x7f64740fa6e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f64680048d0 tx=0x7f6468009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:06.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.850+0000 7f6479ffb640 1 -- 172.21.15.71:0/1602140073 shutdown_connections 2024-09-10T10:05:06.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.850+0000 7f6479ffb640 1 --2- 172.21.15.71:0/1602140073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64740fe580 0x7f64740fa6e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:06.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.850+0000 7f6479ffb640 1 --2- 172.21.15.71:0/1602140073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64740fdc30 0x7f64740fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:06.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.850+0000 7f6479ffb640 1 -- 172.21.15.71:0/1602140073 >> 172.21.15.71:0/1602140073 conn(0x7f64740f6390 msgr2=0x7f64740f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:06.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.850+0000 7f6479ffb640 1 -- 172.21.15.71:0/1602140073 shutdown_connections 2024-09-10T10:05:06.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.850+0000 7f6479ffb640 1 -- 172.21.15.71:0/1602140073 wait complete. 2024-09-10T10:05:06.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.851+0000 7f6479ffb640 1 Processor -- start 2024-09-10T10:05:06.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.851+0000 7f6479ffb640 1 -- start start 2024-09-10T10:05:06.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.852+0000 7f6479ffb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64740fdc30 0x7f647410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:06.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.852+0000 7f6479ffb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64740fe580 0x7f647410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:06.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.852+0000 7f6479ffb640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647410dc30 con 0x7f64740fe580 2024-09-10T10:05:06.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.852+0000 7f6479ffb640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647410e450 con 0x7f64740fdc30 2024-09-10T10:05:06.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.852+0000 7f6472ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64740fe580 0x7f647410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:06.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.852+0000 7f6472ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64740fe580 0x7f647410d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57574/0 (socket says 172.21.15.71:57574) 2024-09-10T10:05:06.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.852+0000 7f6472ffd640 1 -- 172.21.15.71:0/1035655224 learned_addr learned my addr 172.21.15.71:0/1035655224 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:06.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.852+0000 7f64737fe640 1 --2- 172.21.15.71:0/1035655224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64740fdc30 0x7f647410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:06.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.852+0000 7f64737fe640 1 -- 172.21.15.71:0/1035655224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64740fe580 msgr2=0x7f647410d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:06.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.852+0000 7f64737fe640 1 --2- 172.21.15.71:0/1035655224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64740fe580 0x7f647410d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:06.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.852+0000 7f64737fe640 1 -- 172.21.15.71:0/1035655224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6468005040 con 0x7f64740fdc30 2024-09-10T10:05:06.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.852+0000 7f64737fe640 1 --2- 172.21.15.71:0/1035655224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64740fdc30 0x7f647410d0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f646400e910 tx=0x7f646400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:06.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.853+0000 7f645bfff640 1 -- 172.21.15.71:0/1035655224 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6464007c30 con 0x7f64740fdc30 2024-09-10T10:05:06.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.853+0000 7f645bfff640 1 -- 172.21.15.71:0/1035655224 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f646400f040 con 0x7f64740fdc30 2024-09-10T10:05:06.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.853+0000 7f6479ffb640 1 -- 172.21.15.71:0/1035655224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647410e680 con 0x7f64740fdc30 2024-09-10T10:05:06.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.853+0000 7f645bfff640 1 -- 172.21.15.71:0/1035655224 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64640093e0 con 0x7f64740fdc30 2024-09-10T10:05:06.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.853+0000 7f6479ffb640 1 -- 172.21.15.71:0/1035655224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647410ec20 con 0x7f64740fdc30 2024-09-10T10:05:06.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.854+0000 7f6479ffb640 1 -- 172.21.15.71:0/1035655224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64740fa010 con 0x7f64740fdc30 2024-09-10T10:05:06.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.855+0000 7f645bfff640 1 -- 172.21.15.71:0/1035655224 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f6464009540 con 0x7f64740fdc30 2024-09-10T10:05:06.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.856+0000 7f645bfff640 1 --2- 172.21.15.71:0/1035655224 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f645c06e570 0x7f645c070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:06.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.856+0000 7f645bfff640 1 -- 172.21.15.71:0/1035655224 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f646408d730 con 0x7f64740fdc30 2024-09-10T10:05:06.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.856+0000 7f6472ffd640 1 --2- 172.21.15.71:0/1035655224 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f645c06e570 0x7f645c070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:06.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.857+0000 7f6472ffd640 1 --2- 172.21.15.71:0/1035655224 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f645c06e570 0x7f645c070a20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f647410ce50 tx=0x7f6468035040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:06.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:06.863+0000 7f645bfff640 1 -- 172.21.15.71:0/1035655224 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f6464050670 con 0x7f64740fdc30 2024-09-10T10:05:07.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.157+0000 7f6479ffb640 1 -- 172.21.15.71:0/1035655224 --> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f647410f080 con 0x7f645c06e570 2024-09-10T10:05:07.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.161+0000 7f645bfff640 1 -- 172.21.15.71:0/1035655224 <== mgr.24391 v2:172.21.15.107:6828/591375611 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f647410f080 con 0x7f645c06e570 2024-09-10T10:05:07.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.164+0000 7f6479ffb640 1 -- 172.21.15.71:0/1035655224 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f645c06e570 msgr2=0x7f645c070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:07.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.164+0000 7f6479ffb640 1 --2- 172.21.15.71:0/1035655224 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f645c06e570 0x7f645c070a20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f647410ce50 tx=0x7f6468035040 comp rx=0 tx=0).stop 2024-09-10T10:05:07.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.164+0000 7f6479ffb640 1 -- 172.21.15.71:0/1035655224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64740fdc30 msgr2=0x7f647410d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:07.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.164+0000 7f6479ffb640 1 --2- 172.21.15.71:0/1035655224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64740fdc30 0x7f647410d0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f646400e910 tx=0x7f646400b040 comp rx=0 tx=0).stop 2024-09-10T10:05:07.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.164+0000 7f6479ffb640 1 -- 172.21.15.71:0/1035655224 shutdown_connections 2024-09-10T10:05:07.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.164+0000 7f6479ffb640 1 --2- 172.21.15.71:0/1035655224 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f645c06e570 0x7f645c070a20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.164+0000 7f6479ffb640 1 --2- 172.21.15.71:0/1035655224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64740fe580 0x7f647410d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.164+0000 7f6479ffb640 1 --2- 172.21.15.71:0/1035655224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64740fdc30 0x7f647410d0a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.164+0000 7f6479ffb640 1 -- 172.21.15.71:0/1035655224 >> 172.21.15.71:0/1035655224 conn(0x7f64740f6390 msgr2=0x7f64740f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:07.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.164+0000 7f6479ffb640 1 -- 172.21.15.71:0/1035655224 shutdown_connections 2024-09-10T10:05:07.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.164+0000 7f6479ffb640 1 -- 172.21.15.71:0/1035655224 wait complete. 2024-09-10T10:05:07.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.289+0000 7f87f524f640 1 -- 172.21.15.71:0/2765024231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87f00fc520 msgr2=0x7f87f00fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:07.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.289+0000 7f87f524f640 1 --2- 172.21.15.71:0/2765024231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87f00fc520 0x7f87f00fc930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f87e00048d0 tx=0x7f87e0009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.289+0000 7f87f524f640 1 -- 172.21.15.71:0/2765024231 shutdown_connections 2024-09-10T10:05:07.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.289+0000 7f87f524f640 1 --2- 172.21.15.71:0/2765024231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87f00fd7f0 0x7f87f00fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.289+0000 7f87f524f640 1 --2- 172.21.15.71:0/2765024231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87f00fc520 0x7f87f00fc930 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.289+0000 7f87f524f640 1 -- 172.21.15.71:0/2765024231 >> 172.21.15.71:0/2765024231 conn(0x7f87f00f7ce0 msgr2=0x7f87f00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:07.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.289+0000 7f87f524f640 1 -- 172.21.15.71:0/2765024231 shutdown_connections 2024-09-10T10:05:07.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.290+0000 7f87f524f640 1 -- 172.21.15.71:0/2765024231 wait complete. 2024-09-10T10:05:07.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.290+0000 7f87f524f640 1 Processor -- start 2024-09-10T10:05:07.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.290+0000 7f87f524f640 1 -- start start 2024-09-10T10:05:07.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.291+0000 7f87f524f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87f00fc520 0x7f87f010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:07.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.291+0000 7f87f524f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87f00fd7f0 0x7f87f010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:07.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.291+0000 7f87f524f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f010dc10 con 0x7f87f00fd7f0 2024-09-10T10:05:07.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.291+0000 7f87f524f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f010e430 con 0x7f87f00fc520 2024-09-10T10:05:07.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.291+0000 7f87ee59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87f00fd7f0 0x7f87f010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:07.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.291+0000 7f87ee59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87f00fd7f0 0x7f87f010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57584/0 (socket says 172.21.15.71:57584) 2024-09-10T10:05:07.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.291+0000 7f87ee59c640 1 -- 172.21.15.71:0/1851223587 learned_addr learned my addr 172.21.15.71:0/1851223587 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:07.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.291+0000 7f87eed9d640 1 --2- 172.21.15.71:0/1851223587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87f00fc520 0x7f87f010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:07.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.291+0000 7f87ee59c640 1 -- 172.21.15.71:0/1851223587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87f00fc520 msgr2=0x7f87f010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:07.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.291+0000 7f87ee59c640 1 --2- 172.21.15.71:0/1851223587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87f00fc520 0x7f87f010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.291+0000 7f87ee59c640 1 -- 172.21.15.71:0/1851223587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e0005040 con 0x7f87f00fd7f0 2024-09-10T10:05:07.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.291+0000 7f87ee59c640 1 --2- 172.21.15.71:0/1851223587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87f00fd7f0 0x7f87f010d5c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f87e4002a80 tx=0x7f87e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:07.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.292+0000 7f87d77fe640 1 -- 172.21.15.71:0/1851223587 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87e4007c30 con 0x7f87f00fd7f0 2024-09-10T10:05:07.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.292+0000 7f87f524f640 1 -- 172.21.15.71:0/1851223587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f010e6c0 con 0x7f87f00fd7f0 2024-09-10T10:05:07.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.292+0000 7f87d77fe640 1 -- 172.21.15.71:0/1851223587 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f87e400f040 con 0x7f87f00fd7f0 2024-09-10T10:05:07.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.292+0000 7f87d77fe640 1 -- 172.21.15.71:0/1851223587 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87e400dab0 con 0x7f87f00fd7f0 2024-09-10T10:05:07.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.292+0000 7f87f524f640 1 -- 172.21.15.71:0/1851223587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f010ebe0 con 0x7f87f00fd7f0 2024-09-10T10:05:07.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.293+0000 7f87f524f640 1 -- 172.21.15.71:0/1851223587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f00fb980 con 0x7f87f00fd7f0 2024-09-10T10:05:07.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.294+0000 7f87d77fe640 1 -- 172.21.15.71:0/1851223587 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f87e400dc10 con 0x7f87f00fd7f0 2024-09-10T10:05:07.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.294+0000 7f87d77fe640 1 --2- 172.21.15.71:0/1851223587 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f87d806e4a0 0x7f87d8070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:07.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.294+0000 7f87d77fe640 1 -- 172.21.15.71:0/1851223587 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f87e408d410 con 0x7f87f00fd7f0 2024-09-10T10:05:07.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.294+0000 7f87eed9d640 1 --2- 172.21.15.71:0/1851223587 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f87d806e4a0 0x7f87d8070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:07.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.295+0000 7f87eed9d640 1 --2- 172.21.15.71:0/1851223587 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f87d806e4a0 0x7f87d8070950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f87e0000c00 tx=0x7f87e0035040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:07.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.299+0000 7f87d77fe640 1 -- 172.21.15.71:0/1851223587 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f87e4056fc0 con 0x7f87f00fd7f0 2024-09-10T10:05:07.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.535+0000 7f87f524f640 1 -- 172.21.15.71:0/1851223587 --> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f87f010efc0 con 0x7f87d806e4a0 2024-09-10T10:05:07.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.544+0000 7f87d77fe640 1 -- 172.21.15.71:0/1851223587 <== mgr.24391 v2:172.21.15.107:6828/591375611 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f87f010efc0 con 0x7f87d806e4a0 2024-09-10T10:05:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:05:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 starting - - - - 2024-09-10T10:05:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (9m) 29s ago 9m 6891k - 17.2.7-1597-g96d63e75 f3fc7d52e233 f70481a4c3c7 2024-09-10T10:05:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (8m) 33s ago 8m 6895k - 17.2.7-1597-g96d63e75 f3fc7d52e233 cf27ebcc0f98 2024-09-10T10:05:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 starting - - - - 2024-09-10T10:05:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (3m) 29s ago 3m 133M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:05:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (3m) 29s ago 3m 77.9M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:05:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (3m) 33s ago 3m 129M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:05:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (3m) 33s ago 3m 79.0M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:05:07.546 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:9283,8765,8443 running (10m) 29s ago 10m 166M - 17.2.7-1597-g96d63e75 f3fc7d52e233 dc0e497fa11e 2024-09-10T10:05:07.547 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283 running (95s) 33s ago 8m 480M - 19.1.1-305-g1cf819b7 41d671128357 7eef59ade56b 2024-09-10T10:05:07.547 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (10m) 29s ago 10m 52.7M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 35e491e574a3 2024-09-10T10:05:07.547 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (7m) 33s ago 7m 39.3M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 682e2b6e311f 2024-09-10T10:05:07.547 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 starting - - - - 2024-09-10T10:05:07.547 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (8m) 33s ago 8m 15.4M - 1.5.0 0da6a335fe13 12be03d3d11f 2024-09-10T10:05:07.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (7m) 29s ago 7m 229M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 a79e69c9b514 2024-09-10T10:05:07.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (6m) 29s ago 6m 254M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 44a84bf577da 2024-09-10T10:05:07.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (6m) 29s ago 6m 210M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 4fae52756a24 2024-09-10T10:05:07.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (5m) 33s ago 5m 282M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:05:07.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (5m) 33s ago 5m 239M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:05:07.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (5m) 33s ago 5m 282M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:05:07.547 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (7m) 29s ago 8m 64.2M - 2.43.0 a07b618ecd1d 1a619aeb5698 2024-09-10T10:05:07.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.547+0000 7f87f524f640 1 -- 172.21.15.71:0/1851223587 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f87d806e4a0 msgr2=0x7f87d8070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:07.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.547+0000 7f87f524f640 1 --2- 172.21.15.71:0/1851223587 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f87d806e4a0 0x7f87d8070950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f87e0000c00 tx=0x7f87e0035040 comp rx=0 tx=0).stop 2024-09-10T10:05:07.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.547+0000 7f87f524f640 1 -- 172.21.15.71:0/1851223587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87f00fd7f0 msgr2=0x7f87f010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:07.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.547+0000 7f87f524f640 1 --2- 172.21.15.71:0/1851223587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87f00fd7f0 0x7f87f010d5c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f87e4002a80 tx=0x7f87e4004600 comp rx=0 tx=0).stop 2024-09-10T10:05:07.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.547+0000 7f87f524f640 1 -- 172.21.15.71:0/1851223587 shutdown_connections 2024-09-10T10:05:07.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.547+0000 7f87f524f640 1 --2- 172.21.15.71:0/1851223587 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f87d806e4a0 0x7f87d8070950 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.547+0000 7f87f524f640 1 --2- 172.21.15.71:0/1851223587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87f00fd7f0 0x7f87f010d5c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.547+0000 7f87f524f640 1 --2- 172.21.15.71:0/1851223587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87f00fc520 0x7f87f010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.547+0000 7f87f524f640 1 -- 172.21.15.71:0/1851223587 >> 172.21.15.71:0/1851223587 conn(0x7f87f00f7ce0 msgr2=0x7f87f00f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:07.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.547+0000 7f87f524f640 1 -- 172.21.15.71:0/1851223587 shutdown_connections 2024-09-10T10:05:07.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.547+0000 7f87f524f640 1 -- 172.21.15.71:0/1851223587 wait complete. 2024-09-10T10:05:07.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.634+0000 7f2ac6130640 1 -- 172.21.15.71:0/2367781299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ac00fb420 msgr2=0x7f2ac00fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:07.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.634+0000 7f2ac6130640 1 --2- 172.21.15.71:0/2367781299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ac00fb420 0x7f2ac00fb830 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00048d0 tx=0x7f2ab0009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.634+0000 7f2ac6130640 1 -- 172.21.15.71:0/2367781299 shutdown_connections 2024-09-10T10:05:07.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.634+0000 7f2ac6130640 1 --2- 172.21.15.71:0/2367781299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ac00fc6f0 0x7f2ac00fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.634+0000 7f2ac6130640 1 --2- 172.21.15.71:0/2367781299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ac00fb420 0x7f2ac00fb830 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.634+0000 7f2ac6130640 1 -- 172.21.15.71:0/2367781299 >> 172.21.15.71:0/2367781299 conn(0x7f2ac00f6c00 msgr2=0x7f2ac00f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:07.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.634+0000 7f2ac6130640 1 -- 172.21.15.71:0/2367781299 shutdown_connections 2024-09-10T10:05:07.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.634+0000 7f2ac6130640 1 -- 172.21.15.71:0/2367781299 wait complete. 2024-09-10T10:05:07.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.634+0000 7f2ac6130640 1 Processor -- start 2024-09-10T10:05:07.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.635+0000 7f2ac6130640 1 -- start start 2024-09-10T10:05:07.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.635+0000 7f2ac6130640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ac00fb420 0x7f2ac010fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:07.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.635+0000 7f2ac6130640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ac00fc6f0 0x7f2ac0112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:07.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.635+0000 7f2ac6130640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac00664f0 con 0x7f2ac00fc6f0 2024-09-10T10:05:07.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.635+0000 7f2ac6130640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac0066660 con 0x7f2ac00fb420 2024-09-10T10:05:07.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.635+0000 7f2abeffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ac00fc6f0 0x7f2ac0112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:07.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.635+0000 7f2abeffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ac00fc6f0 0x7f2ac0112300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57604/0 (socket says 172.21.15.71:57604) 2024-09-10T10:05:07.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.635+0000 7f2abeffd640 1 -- 172.21.15.71:0/3784330227 learned_addr learned my addr 172.21.15.71:0/3784330227 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:07.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.635+0000 7f2abf7fe640 1 --2- 172.21.15.71:0/3784330227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ac00fb420 0x7f2ac010fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:07.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.635+0000 7f2abeffd640 1 -- 172.21.15.71:0/3784330227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ac00fb420 msgr2=0x7f2ac010fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:07.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.635+0000 7f2abeffd640 1 --2- 172.21.15.71:0/3784330227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ac00fb420 0x7f2ac010fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.635+0000 7f2abeffd640 1 -- 172.21.15.71:0/3784330227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0005040 con 0x7f2ac00fc6f0 2024-09-10T10:05:07.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.636+0000 7f2abeffd640 1 --2- 172.21.15.71:0/3784330227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ac00fc6f0 0x7f2ac0112300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400eb70 tx=0x7f2ab400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:07.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.636+0000 7f2aa7fff640 1 -- 172.21.15.71:0/3784330227 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ab4007c30 con 0x7f2ac00fc6f0 2024-09-10T10:05:07.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.636+0000 7f2ac6130640 1 -- 172.21.15.71:0/3784330227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac0112840 con 0x7f2ac00fc6f0 2024-09-10T10:05:07.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.636+0000 7f2ac6130640 1 -- 172.21.15.71:0/3784330227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac0112db0 con 0x7f2ac00fc6f0 2024-09-10T10:05:07.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.636+0000 7f2aa7fff640 1 -- 172.21.15.71:0/3784330227 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2ab400f040 con 0x7f2ac00fc6f0 2024-09-10T10:05:07.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.636+0000 7f2aa7fff640 1 -- 172.21.15.71:0/3784330227 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ab400c950 con 0x7f2ac00fc6f0 2024-09-10T10:05:07.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.637+0000 7f2ac6130640 1 -- 172.21.15.71:0/3784330227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac00fa880 con 0x7f2ac00fc6f0 2024-09-10T10:05:07.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.638+0000 7f2aa7fff640 1 -- 172.21.15.71:0/3784330227 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f2ab400cad0 con 0x7f2ac00fc6f0 2024-09-10T10:05:07.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.638+0000 7f2aa7fff640 1 --2- 172.21.15.71:0/3784330227 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f2aa806e4a0 0x7f2aa8070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:07.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.638+0000 7f2aa7fff640 1 -- 172.21.15.71:0/3784330227 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2ab408d860 con 0x7f2ac00fc6f0 2024-09-10T10:05:07.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.638+0000 7f2abf7fe640 1 --2- 172.21.15.71:0/3784330227 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f2aa806e4a0 0x7f2aa8070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:07.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.639+0000 7f2abf7fe640 1 --2- 172.21.15.71:0/3784330227 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f2aa806e4a0 0x7f2aa8070950 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0000c00 tx=0x7f2ab0035040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:07.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.644+0000 7f2aa7fff640 1 -- 172.21.15.71:0/3784330227 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f2ab4050670 con 0x7f2ac00fc6f0 2024-09-10T10:05:07.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.922+0000 7f2ac6130640 1 -- 172.21.15.71:0/3784330227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2ac0103e40 con 0x7f2ac00fc6f0 2024-09-10T10:05:07.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.922+0000 7f2aa7fff640 1 -- 172.21.15.71:0/3784330227 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f2ab40573d0 con 0x7f2ac00fc6f0 2024-09-10T10:05:07.924 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:05:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:05:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2 2024-09-10T10:05:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:05:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:05:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 1, 2024-09-10T10:05:07.924 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 1 2024-09-10T10:05:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:05:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:05:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 6 2024-09-10T10:05:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:05:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:05:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:05:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:05:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:05:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 13, 2024-09-10T10:05:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 1 2024-09-10T10:05:07.925 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:05:07.925 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:05:07.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.925+0000 7f2ac6130640 1 -- 172.21.15.71:0/3784330227 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f2aa806e4a0 msgr2=0x7f2aa8070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:07.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.925+0000 7f2ac6130640 1 --2- 172.21.15.71:0/3784330227 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f2aa806e4a0 0x7f2aa8070950 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0000c00 tx=0x7f2ab0035040 comp rx=0 tx=0).stop 2024-09-10T10:05:07.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.925+0000 7f2ac6130640 1 -- 172.21.15.71:0/3784330227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ac00fc6f0 msgr2=0x7f2ac0112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:07.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.925+0000 7f2ac6130640 1 --2- 172.21.15.71:0/3784330227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ac00fc6f0 0x7f2ac0112300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400eb70 tx=0x7f2ab400b040 comp rx=0 tx=0).stop 2024-09-10T10:05:07.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.925+0000 7f2ac6130640 1 -- 172.21.15.71:0/3784330227 shutdown_connections 2024-09-10T10:05:07.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.925+0000 7f2ac6130640 1 --2- 172.21.15.71:0/3784330227 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f2aa806e4a0 0x7f2aa8070950 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.925+0000 7f2ac6130640 1 --2- 172.21.15.71:0/3784330227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ac00fc6f0 0x7f2ac0112300 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.925+0000 7f2ac6130640 1 --2- 172.21.15.71:0/3784330227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ac00fb420 0x7f2ac010fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:07.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.925+0000 7f2ac6130640 1 -- 172.21.15.71:0/3784330227 >> 172.21.15.71:0/3784330227 conn(0x7f2ac00f6c00 msgr2=0x7f2ac00f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:07.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.926+0000 7f2ac6130640 1 -- 172.21.15.71:0/3784330227 shutdown_connections 2024-09-10T10:05:07.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:07.926+0000 7f2ac6130640 1 -- 172.21.15.71:0/3784330227 wait complete. 2024-09-10T10:05:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.029+0000 7f49b11ab640 1 -- 172.21.15.71:0/733172754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49ac065bc0 msgr2=0x7f49ac0ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.029+0000 7f49b11ab640 1 --2- 172.21.15.71:0/733172754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49ac065bc0 0x7f49ac0ff1c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f499c0048d0 tx=0x7f499c009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.029+0000 7f49b11ab640 1 -- 172.21.15.71:0/733172754 shutdown_connections 2024-09-10T10:05:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.029+0000 7f49b11ab640 1 --2- 172.21.15.71:0/733172754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49ac0ff700 0x7f49ac101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.029+0000 7f49b11ab640 1 --2- 172.21.15.71:0/733172754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49ac065bc0 0x7f49ac0ff1c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.029+0000 7f49b11ab640 1 -- 172.21.15.71:0/733172754 >> 172.21.15.71:0/733172754 conn(0x7f49ac0f6c10 msgr2=0x7f49ac0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.029+0000 7f49b11ab640 1 -- 172.21.15.71:0/733172754 shutdown_connections 2024-09-10T10:05:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.029+0000 7f49b11ab640 1 -- 172.21.15.71:0/733172754 wait complete. 2024-09-10T10:05:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49b11ab640 1 Processor -- start 2024-09-10T10:05:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49b11ab640 1 -- start start 2024-09-10T10:05:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49b11ab640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49ac065bc0 0x7f49ac0fcb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:08.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49b11ab640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49ac0ff700 0x7f49ac0fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49b11ab640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac0fb690 con 0x7f49ac065bc0 2024-09-10T10:05:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49b11ab640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac0fb7d0 con 0x7f49ac0ff700 2024-09-10T10:05:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49aad9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49ac065bc0 0x7f49ac0fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49aad9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49ac065bc0 0x7f49ac0fcb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57624/0 (socket says 172.21.15.71:57624) 2024-09-10T10:05:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49aad9d640 1 -- 172.21.15.71:0/1549522383 learned_addr learned my addr 172.21.15.71:0/1549522383 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49aa59c640 1 --2- 172.21.15.71:0/1549522383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49ac0ff700 0x7f49ac0fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49aad9d640 1 -- 172.21.15.71:0/1549522383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49ac0ff700 msgr2=0x7f49ac0fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49aad9d640 1 --2- 172.21.15.71:0/1549522383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49ac0ff700 0x7f49ac0fb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49aad9d640 1 -- 172.21.15.71:0/1549522383 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c005040 con 0x7f49ac065bc0 2024-09-10T10:05:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49aad9d640 1 --2- 172.21.15.71:0/1549522383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49ac065bc0 0x7f49ac0fcb80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f499c0048a0 tx=0x7f499c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49937fe640 1 -- 172.21.15.71:0/1549522383 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f499c038070 con 0x7f49ac065bc0 2024-09-10T10:05:08.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.030+0000 7f49937fe640 1 -- 172.21.15.71:0/1549522383 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f499c02abd0 con 0x7f49ac065bc0 2024-09-10T10:05:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.031+0000 7f49937fe640 1 -- 172.21.15.71:0/1549522383 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f499c033640 con 0x7f49ac065bc0 2024-09-10T10:05:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.031+0000 7f49b11ab640 1 -- 172.21.15.71:0/1549522383 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ac0fba50 con 0x7f49ac065bc0 2024-09-10T10:05:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.031+0000 7f49b11ab640 1 -- 172.21.15.71:0/1549522383 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ac0fbf20 con 0x7f49ac065bc0 2024-09-10T10:05:08.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.032+0000 7f49b11ab640 1 -- 172.21.15.71:0/1549522383 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ac0fa890 con 0x7f49ac065bc0 2024-09-10T10:05:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.032+0000 7f49937fe640 1 -- 172.21.15.71:0/1549522383 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f499c030020 con 0x7f49ac065bc0 2024-09-10T10:05:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.032+0000 7f49937fe640 1 --2- 172.21.15.71:0/1549522383 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f499406e4a0 0x7f4994070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.033+0000 7f49937fe640 1 -- 172.21.15.71:0/1549522383 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f499c0ade00 con 0x7f49ac065bc0 2024-09-10T10:05:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.033+0000 7f49aa59c640 1 --2- 172.21.15.71:0/1549522383 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f499406e4a0 0x7f4994070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:08.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.033+0000 7f49aa59c640 1 --2- 172.21.15.71:0/1549522383 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f499406e4a0 0x7f4994070950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f49a0006fd0 tx=0x7f49a0008040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:08.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.037+0000 7f49937fe640 1 -- 172.21.15.71:0/1549522383 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f499c077a50 con 0x7f49ac065bc0 2024-09-10T10:05:08.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.393+0000 7f49b11ab640 1 -- 172.21.15.71:0/1549522383 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f49ac115380 con 0x7f49ac065bc0 2024-09-10T10:05:08.395 INFO:teuthology.orchestra.run.smithi071.stdout:e22 2024-09-10T10:05:08.395 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:05:08.395 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:05:08.396 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:05:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:05:08.396 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:05:08.396 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:05:08.396 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 22 2024-09-10T10:05:08.396 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:05:08.397 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:05:08.397 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:04:19.815073+0000 2024-09-10T10:05:08.397 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:05:08.397 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:05:08.397 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:05:08.397 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:05:08.398 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:05:08.398 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:05:08.398 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:05:08.398 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:05:08.398 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:05:08.398 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:05:08.399 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:05:08.399 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:05:08.399 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:05:08.399 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:05:08.399 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:05:08.399 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:05:08.399 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:05:08.400 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:05:08.400 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:05:08.400 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:05:08.400 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:05:08.400 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:05:08.400 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:05:08.401 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:05:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:05:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:05:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.393+0000 7f49937fe640 1 -- 172.21.15.71:0/1549522383 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1866 (secure 0 0 0) 0x7f499c07b110 con 0x7f49ac065bc0 2024-09-10T10:05:08.402 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 22 2024-09-10T10:05:08.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.396+0000 7f49b11ab640 1 -- 172.21.15.71:0/1549522383 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f499406e4a0 msgr2=0x7f4994070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:08.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.396+0000 7f49b11ab640 1 --2- 172.21.15.71:0/1549522383 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f499406e4a0 0x7f4994070950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f49a0006fd0 tx=0x7f49a0008040 comp rx=0 tx=0).stop 2024-09-10T10:05:08.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.396+0000 7f49b11ab640 1 -- 172.21.15.71:0/1549522383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49ac065bc0 msgr2=0x7f49ac0fcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:08.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.396+0000 7f49b11ab640 1 --2- 172.21.15.71:0/1549522383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49ac065bc0 0x7f49ac0fcb80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f499c0048a0 tx=0x7f499c009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.396+0000 7f49b11ab640 1 -- 172.21.15.71:0/1549522383 shutdown_connections 2024-09-10T10:05:08.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.396+0000 7f49b11ab640 1 --2- 172.21.15.71:0/1549522383 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f499406e4a0 0x7f4994070950 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.396+0000 7f49b11ab640 1 --2- 172.21.15.71:0/1549522383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49ac0ff700 0x7f49ac0fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.396+0000 7f49b11ab640 1 --2- 172.21.15.71:0/1549522383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49ac065bc0 0x7f49ac0fcb80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.396+0000 7f49b11ab640 1 -- 172.21.15.71:0/1549522383 >> 172.21.15.71:0/1549522383 conn(0x7f49ac0f6c10 msgr2=0x7f49ac0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:08.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.396+0000 7f49b11ab640 1 -- 172.21.15.71:0/1549522383 shutdown_connections 2024-09-10T10:05:08.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.396+0000 7f49b11ab640 1 -- 172.21.15.71:0/1549522383 wait complete. 2024-09-10T10:05:08.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.498+0000 7f5e459a0640 1 -- 172.21.15.71:0/3230726598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e400fd810 msgr2=0x7f5e400fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:08.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.498+0000 7f5e459a0640 1 --2- 172.21.15.71:0/3230726598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e400fd810 0x7f5e400fdc80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5e280048d0 tx=0x7f5e28009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.500 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:08 smithi071 ceph-mon[27559]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:08.500 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:08 smithi071 ceph-mon[27559]: pgmap v25: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 450 op/s 2024-09-10T10:05:08.500 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:08 smithi071 ceph-mon[27559]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:08.500 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:08 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3784330227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:05:08.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.498+0000 7f5e459a0640 1 -- 172.21.15.71:0/3230726598 shutdown_connections 2024-09-10T10:05:08.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.498+0000 7f5e459a0640 1 --2- 172.21.15.71:0/3230726598 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e400fd810 0x7f5e400fdc80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.498+0000 7f5e459a0640 1 --2- 172.21.15.71:0/3230726598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e400fc540 0x7f5e400fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.498+0000 7f5e459a0640 1 -- 172.21.15.71:0/3230726598 >> 172.21.15.71:0/3230726598 conn(0x7f5e400f7ce0 msgr2=0x7f5e400fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:08.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.498+0000 7f5e459a0640 1 -- 172.21.15.71:0/3230726598 shutdown_connections 2024-09-10T10:05:08.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.498+0000 7f5e459a0640 1 -- 172.21.15.71:0/3230726598 wait complete. 2024-09-10T10:05:08.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.499+0000 7f5e459a0640 1 Processor -- start 2024-09-10T10:05:08.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.499+0000 7f5e459a0640 1 -- start start 2024-09-10T10:05:08.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.499+0000 7f5e459a0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e400fc540 0x7f5e4010d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:08.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.499+0000 7f5e459a0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e400fd810 0x7f5e4010d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.499+0000 7f5e459a0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4010dc00 con 0x7f5e400fd810 2024-09-10T10:05:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.499+0000 7f5e459a0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4010e420 con 0x7f5e400fc540 2024-09-10T10:05:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.499+0000 7f5e367fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e400fd810 0x7f5e4010d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.499+0000 7f5e3effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e400fc540 0x7f5e4010d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.499+0000 7f5e3effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e400fc540 0x7f5e4010d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.71:60936/0 (socket says 172.21.15.71:60936) 2024-09-10T10:05:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.499+0000 7f5e3effd640 1 -- 172.21.15.71:0/1490772512 learned_addr learned my addr 172.21.15.71:0/1490772512 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.500+0000 7f5e3effd640 1 -- 172.21.15.71:0/1490772512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e400fd810 msgr2=0x7f5e4010d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.500+0000 7f5e3effd640 1 --2- 172.21.15.71:0/1490772512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e400fd810 0x7f5e4010d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.500+0000 7f5e3effd640 1 -- 172.21.15.71:0/1490772512 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30005040 con 0x7f5e400fc540 2024-09-10T10:05:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.500+0000 7f5e3effd640 1 --2- 172.21.15.71:0/1490772512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e400fc540 0x7f5e4010d070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009700 tx=0x7f5e30009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.500+0000 7f5e37fff640 1 -- 172.21.15.71:0/1490772512 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e3000e8b0 con 0x7f5e400fc540 2024-09-10T10:05:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.500+0000 7f5e37fff640 1 -- 172.21.15.71:0/1490772512 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e3000f040 con 0x7f5e400fc540 2024-09-10T10:05:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.500+0000 7f5e459a0640 1 -- 172.21.15.71:0/1490772512 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e28005040 con 0x7f5e400fc540 2024-09-10T10:05:08.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.500+0000 7f5e37fff640 1 -- 172.21.15.71:0/1490772512 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e30013d70 con 0x7f5e400fc540 2024-09-10T10:05:08.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.500+0000 7f5e459a0640 1 -- 172.21.15.71:0/1490772512 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4010ea60 con 0x7f5e400fc540 2024-09-10T10:05:08.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.502+0000 7f5e459a0640 1 -- 172.21.15.71:0/1490772512 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e400fb9a0 con 0x7f5e400fc540 2024-09-10T10:05:08.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.502+0000 7f5e37fff640 1 -- 172.21.15.71:0/1490772512 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f5e3000ea10 con 0x7f5e400fc540 2024-09-10T10:05:08.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.503+0000 7f5e37fff640 1 --2- 172.21.15.71:0/1490772512 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f5e2c06e4a0 0x7f5e2c070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:08.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.503+0000 7f5e37fff640 1 -- 172.21.15.71:0/1490772512 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5e3008db10 con 0x7f5e400fc540 2024-09-10T10:05:08.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.503+0000 7f5e367fc640 1 --2- 172.21.15.71:0/1490772512 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f5e2c06e4a0 0x7f5e2c070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:08.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.503+0000 7f5e367fc640 1 --2- 172.21.15.71:0/1490772512 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f5e2c06e4a0 0x7f5e2c070950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e28007ac0 tx=0x7f5e28035040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:08.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.509+0000 7f5e37fff640 1 -- 172.21.15.71:0/1490772512 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f5e30057590 con 0x7f5e400fc540 2024-09-10T10:05:08.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:08 smithi107 ceph-mon[34215]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:08.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:08 smithi107 ceph-mon[34215]: pgmap v25: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 450 op/s 2024-09-10T10:05:08.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:08 smithi107 ceph-mon[34215]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:08 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3784330227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:05:08.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.765+0000 7f5e459a0640 1 -- 172.21.15.71:0/1490772512 --> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e4010edc0 con 0x7f5e2c06e4a0 2024-09-10T10:05:08.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.767+0000 7f5e37fff640 1 -- 172.21.15.71:0/1490772512 <== mgr.24391 v2:172.21.15.107:6828/591375611 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f5e4010edc0 con 0x7f5e2c06e4a0 2024-09-10T10:05:08.768 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:05:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:05:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:05:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:05:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-10T10:05:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "1/21 daemons upgraded", 2024-09-10T10:05:08.768 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "", 2024-09-10T10:05:08.769 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:05:08.769 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:05:08.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.769+0000 7f5e459a0640 1 -- 172.21.15.71:0/1490772512 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f5e2c06e4a0 msgr2=0x7f5e2c070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:08.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.769+0000 7f5e459a0640 1 --2- 172.21.15.71:0/1490772512 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f5e2c06e4a0 0x7f5e2c070950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e28007ac0 tx=0x7f5e28035040 comp rx=0 tx=0).stop 2024-09-10T10:05:08.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.769+0000 7f5e459a0640 1 -- 172.21.15.71:0/1490772512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e400fc540 msgr2=0x7f5e4010d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:08.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.769+0000 7f5e459a0640 1 --2- 172.21.15.71:0/1490772512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e400fc540 0x7f5e4010d070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009700 tx=0x7f5e30009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.769+0000 7f5e459a0640 1 -- 172.21.15.71:0/1490772512 shutdown_connections 2024-09-10T10:05:08.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.769+0000 7f5e459a0640 1 --2- 172.21.15.71:0/1490772512 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f5e2c06e4a0 0x7f5e2c070950 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.769+0000 7f5e459a0640 1 --2- 172.21.15.71:0/1490772512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e400fd810 0x7f5e4010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.769+0000 7f5e459a0640 1 --2- 172.21.15.71:0/1490772512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e400fc540 0x7f5e4010d070 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.769+0000 7f5e459a0640 1 -- 172.21.15.71:0/1490772512 >> 172.21.15.71:0/1490772512 conn(0x7f5e400f7ce0 msgr2=0x7f5e400f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:08.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.769+0000 7f5e459a0640 1 -- 172.21.15.71:0/1490772512 shutdown_connections 2024-09-10T10:05:08.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.769+0000 7f5e459a0640 1 -- 172.21.15.71:0/1490772512 wait complete. 2024-09-10T10:05:08.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.871+0000 7fd53962f640 1 -- 172.21.15.71:0/596440543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5340ff740 msgr2=0x7fd534101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:08.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.871+0000 7fd53962f640 1 --2- 172.21.15.71:0/596440543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5340ff740 0x7fd534101b20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0048d0 tx=0x7fd51c009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.871+0000 7fd53962f640 1 -- 172.21.15.71:0/596440543 shutdown_connections 2024-09-10T10:05:08.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.871+0000 7fd53962f640 1 --2- 172.21.15.71:0/596440543 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5340ff740 0x7fd534101b20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.871+0000 7fd53962f640 1 --2- 172.21.15.71:0/596440543 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd534065b80 0x7fd5340ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.871+0000 7fd53962f640 1 -- 172.21.15.71:0/596440543 >> 172.21.15.71:0/596440543 conn(0x7fd5340f6c10 msgr2=0x7fd5340f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:08.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.871+0000 7fd53962f640 1 -- 172.21.15.71:0/596440543 shutdown_connections 2024-09-10T10:05:08.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.871+0000 7fd53962f640 1 -- 172.21.15.71:0/596440543 wait complete. 2024-09-10T10:05:08.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.872+0000 7fd53962f640 1 Processor -- start 2024-09-10T10:05:08.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.872+0000 7fd53962f640 1 -- start start 2024-09-10T10:05:08.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.872+0000 7fd53962f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd534065b80 0x7fd53410d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:08.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.872+0000 7fd53962f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5340ff740 0x7fd53410d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:08.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.872+0000 7fd53962f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53410dc60 con 0x7fd534065b80 2024-09-10T10:05:08.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.872+0000 7fd53962f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53410e430 con 0x7fd5340ff740 2024-09-10T10:05:08.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.872+0000 7fd532ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd534065b80 0x7fd53410d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:08.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.872+0000 7fd52bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5340ff740 0x7fd53410d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:08.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.872+0000 7fd532ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd534065b80 0x7fd53410d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57678/0 (socket says 172.21.15.71:57678) 2024-09-10T10:05:08.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.872+0000 7fd52bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5340ff740 0x7fd53410d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.71:60940/0 (socket says 172.21.15.71:60940) 2024-09-10T10:05:08.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.872+0000 7fd532ffd640 1 -- 172.21.15.71:0/2378643835 learned_addr learned my addr 172.21.15.71:0/2378643835 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:08.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.873+0000 7fd52bfff640 1 -- 172.21.15.71:0/2378643835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd534065b80 msgr2=0x7fd53410d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:08.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.873+0000 7fd52bfff640 1 --2- 172.21.15.71:0/2378643835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd534065b80 0x7fd53410d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:08.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.873+0000 7fd52bfff640 1 -- 172.21.15.71:0/2378643835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c005040 con 0x7fd5340ff740 2024-09-10T10:05:08.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.873+0000 7fd532ffd640 1 --2- 172.21.15.71:0/2378643835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd534065b80 0x7fd53410d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:05:08.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.873+0000 7fd52bfff640 1 --2- 172.21.15.71:0/2378643835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5340ff740 0x7fd53410d610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0048a0 tx=0x7fd51c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:08.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.873+0000 7fd52b7fe640 1 -- 172.21.15.71:0/2378643835 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd51c038070 con 0x7fd5340ff740 2024-09-10T10:05:08.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.873+0000 7fd52b7fe640 1 -- 172.21.15.71:0/2378643835 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd51c004290 con 0x7fd5340ff740 2024-09-10T10:05:08.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.873+0000 7fd52b7fe640 1 -- 172.21.15.71:0/2378643835 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd51c02c8b0 con 0x7fd5340ff740 2024-09-10T10:05:08.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.873+0000 7fd53962f640 1 -- 172.21.15.71:0/2378643835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53410e660 con 0x7fd5340ff740 2024-09-10T10:05:08.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.873+0000 7fd53962f640 1 -- 172.21.15.71:0/2378643835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53410ec00 con 0x7fd5340ff740 2024-09-10T10:05:08.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.875+0000 7fd53962f640 1 -- 172.21.15.71:0/2378643835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5340fa890 con 0x7fd5340ff740 2024-09-10T10:05:08.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.875+0000 7fd52b7fe640 1 -- 172.21.15.71:0/2378643835 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7fd51c030020 con 0x7fd5340ff740 2024-09-10T10:05:08.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.876+0000 7fd52b7fe640 1 --2- 172.21.15.71:0/2378643835 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fd52006e4a0 0x7fd520070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:08.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.876+0000 7fd52b7fe640 1 -- 172.21.15.71:0/2378643835 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd51c0adbf0 con 0x7fd5340ff740 2024-09-10T10:05:08.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.876+0000 7fd532ffd640 1 --2- 172.21.15.71:0/2378643835 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fd52006e4a0 0x7fd520070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:08.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.876+0000 7fd532ffd640 1 --2- 172.21.15.71:0/2378643835 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fd52006e4a0 0x7fd520070950 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd52400f630 tx=0x7fd52400b040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:08.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:08.881+0000 7fd52b7fe640 1 -- 172.21.15.71:0/2378643835 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd51c077880 con 0x7fd5340ff740 2024-09-10T10:05:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:09.304+0000 7fd53962f640 1 -- 172.21.15.71:0/2378643835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd534104f50 con 0x7fd5340ff740 2024-09-10T10:05:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:09.305+0000 7fd52b7fe640 1 -- 172.21.15.71:0/2378643835 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd51c07af40 con 0x7fd5340ff740 2024-09-10T10:05:09.306 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:05:09.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:09.308+0000 7fd53962f640 1 -- 172.21.15.71:0/2378643835 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fd52006e4a0 msgr2=0x7fd520070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:09.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:09.308+0000 7fd53962f640 1 --2- 172.21.15.71:0/2378643835 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fd52006e4a0 0x7fd520070950 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd52400f630 tx=0x7fd52400b040 comp rx=0 tx=0).stop 2024-09-10T10:05:09.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:09.308+0000 7fd53962f640 1 -- 172.21.15.71:0/2378643835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5340ff740 msgr2=0x7fd53410d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:09.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:09.308+0000 7fd53962f640 1 --2- 172.21.15.71:0/2378643835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5340ff740 0x7fd53410d610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0048a0 tx=0x7fd51c009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:09.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:09.308+0000 7fd53962f640 1 -- 172.21.15.71:0/2378643835 shutdown_connections 2024-09-10T10:05:09.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:09.308+0000 7fd53962f640 1 --2- 172.21.15.71:0/2378643835 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fd52006e4a0 0x7fd520070950 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:09.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:09.308+0000 7fd53962f640 1 --2- 172.21.15.71:0/2378643835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5340ff740 0x7fd53410d610 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:09.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:09.308+0000 7fd53962f640 1 --2- 172.21.15.71:0/2378643835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd534065b80 0x7fd53410d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:09.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:09.308+0000 7fd53962f640 1 -- 172.21.15.71:0/2378643835 >> 172.21.15.71:0/2378643835 conn(0x7fd5340f6c10 msgr2=0x7fd5340f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:09.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:09.308+0000 7fd53962f640 1 -- 172.21.15.71:0/2378643835 shutdown_connections 2024-09-10T10:05:09.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:09.308+0000 7fd53962f640 1 -- 172.21.15.71:0/2378643835 wait complete. 2024-09-10T10:05:09.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:09 smithi071 ceph-mon[27559]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:09 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:05:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:09 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1549522383' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:05:09.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:09 smithi107 ceph-mon[34215]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:09.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:09 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:05:09.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:09 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1549522383' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:05:10.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:10 smithi071 ceph-mon[27559]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:10.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:10 smithi071 ceph-mon[27559]: pgmap v26: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 450 op/s 2024-09-10T10:05:10.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:10 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/2378643835' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:05:10.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:10 smithi107 ceph-mon[34215]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:10.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:10 smithi107 ceph-mon[34215]: pgmap v26: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 450 op/s 2024-09-10T10:05:10.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:10 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/2378643835' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:05:12.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:12 smithi071 ceph-mon[27559]: pgmap v27: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 699 op/s 2024-09-10T10:05:12.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:12 smithi107 ceph-mon[34215]: pgmap v27: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 699 op/s 2024-09-10T10:05:14.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:14 smithi071 ceph-mon[27559]: pgmap v28: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 454 op/s 2024-09-10T10:05:14.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:14 smithi107 ceph-mon[34215]: pgmap v28: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 454 op/s 2024-09-10T10:05:16.419 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:16 smithi071 ceph-mon[27559]: pgmap v29: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 736 op/s 2024-09-10T10:05:16.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:16 smithi107 ceph-mon[34215]: pgmap v29: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 736 op/s 2024-09-10T10:05:18.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:18 smithi107 ceph-mon[34215]: pgmap v30: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 530 op/s 2024-09-10T10:05:18.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:18 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:18.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:18 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:18.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:18 smithi107 ceph-mon[34215]: Reconfiguring node-exporter.smithi107 (dependencies changed)... 2024-09-10T10:05:18.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:18 smithi107 ceph-mon[34215]: Reconfiguring daemon node-exporter.smithi107 on smithi107 2024-09-10T10:05:18.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:18 smithi071 ceph-mon[27559]: pgmap v30: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 530 op/s 2024-09-10T10:05:18.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:18 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:18.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:18 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:18.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:18 smithi071 ceph-mon[27559]: Reconfiguring node-exporter.smithi107 (dependencies changed)... 2024-09-10T10:05:18.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:18 smithi071 ceph-mon[27559]: Reconfiguring daemon node-exporter.smithi107 on smithi107 2024-09-10T10:05:20.443 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:20 smithi071 ceph-mon[27559]: pgmap v31: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 530 op/s 2024-09-10T10:05:20.443 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:20 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:20.443 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:20 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:20.443 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:20 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T10:05:20.444 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:20 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T10:05:20.444 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:20 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T10:05:20.444 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:20 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:20.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:20 smithi107 ceph-mon[34215]: pgmap v31: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 530 op/s 2024-09-10T10:05:20.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:20 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:20.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:20 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:20.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:20 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T10:05:20.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:20 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T10:05:20.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:20 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T10:05:20.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:20 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:21 smithi107 ceph-mon[34215]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T10:05:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:21 smithi107 ceph-mon[34215]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T10:05:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:21 smithi107 ceph-mon[34215]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T10:05:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:21 smithi107 ceph-mon[34215]: Upgrade: Need to upgrade myself (mgr.smithi107.qurtcs) 2024-09-10T10:05:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:21 smithi107 ceph-mon[34215]: Upgrade: Need to upgrade myself (mgr.smithi107.qurtcs) 2024-09-10T10:05:21.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:21 smithi071 ceph-mon[27559]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T10:05:21.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:21 smithi071 ceph-mon[27559]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T10:05:21.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:21 smithi071 ceph-mon[27559]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T10:05:21.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:21 smithi071 ceph-mon[27559]: Upgrade: Need to upgrade myself (mgr.smithi107.qurtcs) 2024-09-10T10:05:21.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:21 smithi071 ceph-mon[27559]: Upgrade: Need to upgrade myself (mgr.smithi107.qurtcs) 2024-09-10T10:05:22.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:22 smithi107 ceph-mon[34215]: pgmap v32: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 746 op/s 2024-09-10T10:05:22.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:22 smithi071 ceph-mon[27559]: pgmap v32: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 746 op/s 2024-09-10T10:05:23.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:23 smithi071 ceph-mon[27559]: Upgrade: Updating mgr.smithi071.gtqytr 2024-09-10T10:05:23.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:23 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:23.508 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi071.gtqytr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:05:23.508 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:23 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi071.gtqytr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:05:23.508 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:05:23.508 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:23.508 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:23 smithi071 ceph-mon[27559]: Deploying daemon mgr.smithi071.gtqytr on smithi071 2024-09-10T10:05:23.508 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:23 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:05:23.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:23 smithi107 ceph-mon[34215]: Upgrade: Updating mgr.smithi071.gtqytr 2024-09-10T10:05:23.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:23 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:23.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi071.gtqytr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:05:23.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:23 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi071.gtqytr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:05:23.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:05:23.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:23.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:23 smithi107 ceph-mon[34215]: Deploying daemon mgr.smithi071.gtqytr on smithi071 2024-09-10T10:05:23.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:23 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:05:24.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:24 smithi071 ceph-mon[27559]: pgmap v33: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 497 op/s 2024-09-10T10:05:24.796 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:24 smithi107 ceph-mon[34215]: pgmap v33: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 497 op/s 2024-09-10T10:05:26.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:26 smithi071 ceph-mon[27559]: pgmap v34: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 764 op/s 2024-09-10T10:05:26.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:26 smithi107 ceph-mon[34215]: pgmap v34: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 764 op/s 2024-09-10T10:05:27.951 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:27 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:27.952 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:27 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:27.952 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:27 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:27.952 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:27 smithi071 ceph-mon[27559]: pgmap v35: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 483 op/s 2024-09-10T10:05:28.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:27 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:28.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:27 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:28.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:27 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:28.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:27 smithi107 ceph-mon[34215]: pgmap v35: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 483 op/s 2024-09-10T10:05:30.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:29 smithi107 ceph-mon[34215]: pgmap v36: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 483 op/s 2024-09-10T10:05:30.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:29 smithi071 ceph-mon[27559]: pgmap v36: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 483 op/s 2024-09-10T10:05:31.761 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-10T10:05:31.761 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-10T10:05:32.103 DEBUG:teuthology.parallel:result is None 2024-09-10T10:05:32.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:32 smithi071 ceph-mon[27559]: pgmap v37: 65 pgs: 65 active+clean; 265 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 726 op/s 2024-09-10T10:05:32.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:32 smithi107 ceph-mon[34215]: pgmap v37: 65 pgs: 65 active+clean; 265 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 726 op/s 2024-09-10T10:05:33.078 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-10T10:05:33.078 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T10:05:33.495 DEBUG:teuthology.parallel:result is None 2024-09-10T10:05:33.495 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T10:05:33.563 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T10:05:33.564 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-10T10:05:33.597 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-10T10:05:33.597 DEBUG:teuthology.parallel:result is None 2024-09-10T10:05:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:33 smithi071 ceph-mon[27559]: Standby manager daemon smithi071.gtqytr restarted 2024-09-10T10:05:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:33 smithi071 ceph-mon[27559]: Standby manager daemon smithi071.gtqytr started 2024-09-10T10:05:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:33 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi071.gtqytr/crt"}]: dispatch 2024-09-10T10:05:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:33 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:05:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:33 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi071.gtqytr/key"}]: dispatch 2024-09-10T10:05:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:33 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:05:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:33 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:33 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:33.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:33 smithi107 ceph-mon[34215]: Standby manager daemon smithi071.gtqytr restarted 2024-09-10T10:05:33.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:33 smithi107 ceph-mon[34215]: Standby manager daemon smithi071.gtqytr started 2024-09-10T10:05:33.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:33 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi071.gtqytr/crt"}]: dispatch 2024-09-10T10:05:33.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:33 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:05:33.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:33 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi071.gtqytr/key"}]: dispatch 2024-09-10T10:05:33.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:33 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:05:33.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:33 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:33.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:33 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:34.629 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:34 smithi071 ceph-mon[27559]: pgmap v38: 65 pgs: 65 active+clean; 265 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 510 op/s 2024-09-10T10:05:34.629 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:34 smithi071 ceph-mon[27559]: mgrmap e26: smithi107.qurtcs(active, since 70s), standbys: smithi071.gtqytr 2024-09-10T10:05:34.629 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:34 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:34.629 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:34 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:34.630 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:34 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:34.630 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:34 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:34.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:34 smithi107 ceph-mon[34215]: pgmap v38: 65 pgs: 65 active+clean; 265 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 510 op/s 2024-09-10T10:05:34.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:34 smithi107 ceph-mon[34215]: mgrmap e26: smithi107.qurtcs(active, since 70s), standbys: smithi071.gtqytr 2024-09-10T10:05:34.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:34 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:34.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:34 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:34.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:34 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:34.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:34 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:36.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:36 smithi071 ceph-mon[27559]: pgmap v39: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 699 op/s 2024-09-10T10:05:36.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:36 smithi107 ceph-mon[34215]: pgmap v39: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 699 op/s 2024-09-10T10:05:38.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:38 smithi071 ceph-mon[27559]: pgmap v40: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 432 op/s 2024-09-10T10:05:38.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:38 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:05:38.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:38 smithi107 ceph-mon[34215]: pgmap v40: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 432 op/s 2024-09-10T10:05:38.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:38 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:05:39.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.397+0000 7f869a420640 1 -- 172.21.15.71:0/4028878317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86940fc720 msgr2=0x7f86940fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:39.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.397+0000 7f869a420640 1 --2- 172.21.15.71:0/4028878317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86940fc720 0x7f86940fcb90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f867c0048d0 tx=0x7f867c009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.397+0000 7f869a420640 1 -- 172.21.15.71:0/4028878317 shutdown_connections 2024-09-10T10:05:39.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.397+0000 7f869a420640 1 --2- 172.21.15.71:0/4028878317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86940fc720 0x7f86940fcb90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.397+0000 7f869a420640 1 --2- 172.21.15.71:0/4028878317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86940fb450 0x7f86940fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.397+0000 7f869a420640 1 -- 172.21.15.71:0/4028878317 >> 172.21.15.71:0/4028878317 conn(0x7f86940f6c10 msgr2=0x7f86940f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:39.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.397+0000 7f869a420640 1 -- 172.21.15.71:0/4028878317 shutdown_connections 2024-09-10T10:05:39.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.397+0000 7f869a420640 1 -- 172.21.15.71:0/4028878317 wait complete. 2024-09-10T10:05:39.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.398+0000 7f869a420640 1 Processor -- start 2024-09-10T10:05:39.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.398+0000 7f869a420640 1 -- start start 2024-09-10T10:05:39.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.398+0000 7f869a420640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86940fb450 0x7f869410d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:39.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.398+0000 7f869a420640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86940fc720 0x7f869410d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:39.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.398+0000 7f869a420640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869410e4b0 con 0x7f86940fb450 2024-09-10T10:05:39.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.398+0000 7f869a420640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869410e620 con 0x7f86940fc720 2024-09-10T10:05:39.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.398+0000 7f8693fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86940fb450 0x7f869410d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:39.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.398+0000 7f8693fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86940fb450 0x7f869410d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43916/0 (socket says 172.21.15.71:43916) 2024-09-10T10:05:39.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.398+0000 7f8693fff640 1 -- 172.21.15.71:0/3247276512 learned_addr learned my addr 172.21.15.71:0/3247276512 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:39.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.398+0000 7f868bfff640 1 --2- 172.21.15.71:0/3247276512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86940fc720 0x7f869410d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:39.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.399+0000 7f8693fff640 1 -- 172.21.15.71:0/3247276512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86940fc720 msgr2=0x7f869410d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:39.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.399+0000 7f8693fff640 1 --2- 172.21.15.71:0/3247276512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86940fc720 0x7f869410d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.399+0000 7f8693fff640 1 -- 172.21.15.71:0/3247276512 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c005040 con 0x7f86940fb450 2024-09-10T10:05:39.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.399+0000 7f868bfff640 1 --2- 172.21.15.71:0/3247276512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86940fc720 0x7f869410d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:05:39.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.399+0000 7f8693fff640 1 --2- 172.21.15.71:0/3247276512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86940fb450 0x7f869410d100 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f868400b790 tx=0x7f86840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:39.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.399+0000 7f86917fa640 1 -- 172.21.15.71:0/3247276512 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f868400c700 con 0x7f86940fb450 2024-09-10T10:05:39.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.399+0000 7f869a420640 1 -- 172.21.15.71:0/3247276512 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869410e900 con 0x7f86940fb450 2024-09-10T10:05:39.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.399+0000 7f86917fa640 1 -- 172.21.15.71:0/3247276512 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f868400cd00 con 0x7f86940fb450 2024-09-10T10:05:39.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.399+0000 7f86917fa640 1 -- 172.21.15.71:0/3247276512 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8684015e70 con 0x7f86940fb450 2024-09-10T10:05:39.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.399+0000 7f869a420640 1 -- 172.21.15.71:0/3247276512 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869410ee20 con 0x7f86940fb450 2024-09-10T10:05:39.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.400+0000 7f869a420640 1 -- 172.21.15.71:0/3247276512 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86941046e0 con 0x7f86940fb450 2024-09-10T10:05:39.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.401+0000 7f86917fa640 1 -- 172.21.15.71:0/3247276512 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 92029+0+0 (secure 0 0 0) 0x7f8684012070 con 0x7f86940fb450 2024-09-10T10:05:39.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.401+0000 7f86917fa640 1 --2- 172.21.15.71:0/3247276512 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f868006dae0 0x7f868006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:39.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.401+0000 7f86917fa640 1 -- 172.21.15.71:0/3247276512 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f868408ce50 con 0x7f86940fb450 2024-09-10T10:05:39.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.401+0000 7f868bfff640 1 --2- 172.21.15.71:0/3247276512 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f868006dae0 0x7f868006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:39.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.402+0000 7f868bfff640 1 --2- 172.21.15.71:0/3247276512 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f868006dae0 0x7f868006ff90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f867c00b020 tx=0x7f867c009da0 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:39.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.406+0000 7f86917fa640 1 -- 172.21.15.71:0/3247276512 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8684056a20 con 0x7f86940fb450 2024-09-10T10:05:39.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.591+0000 7f869a420640 1 -- 172.21.15.71:0/3247276512 --> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8694103f40 con 0x7f868006dae0 2024-09-10T10:05:39.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.593+0000 7f86917fa640 1 -- 172.21.15.71:0/3247276512 <== mgr.24391 v2:172.21.15.107:6828/591375611 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f8694103f40 con 0x7f868006dae0 2024-09-10T10:05:39.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.595+0000 7f869a420640 1 -- 172.21.15.71:0/3247276512 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f868006dae0 msgr2=0x7f868006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:39.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.595+0000 7f869a420640 1 --2- 172.21.15.71:0/3247276512 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f868006dae0 0x7f868006ff90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f867c00b020 tx=0x7f867c009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.595+0000 7f869a420640 1 -- 172.21.15.71:0/3247276512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86940fb450 msgr2=0x7f869410d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:39.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.595+0000 7f869a420640 1 --2- 172.21.15.71:0/3247276512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86940fb450 0x7f869410d100 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f868400b790 tx=0x7f86840091d0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.595+0000 7f869a420640 1 -- 172.21.15.71:0/3247276512 shutdown_connections 2024-09-10T10:05:39.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.595+0000 7f869a420640 1 --2- 172.21.15.71:0/3247276512 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f868006dae0 0x7f868006ff90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.595+0000 7f869a420640 1 --2- 172.21.15.71:0/3247276512 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86940fc720 0x7f869410d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.595+0000 7f869a420640 1 --2- 172.21.15.71:0/3247276512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86940fb450 0x7f869410d100 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.595+0000 7f869a420640 1 -- 172.21.15.71:0/3247276512 >> 172.21.15.71:0/3247276512 conn(0x7f86940f6c10 msgr2=0x7f8694066130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:39.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.595+0000 7f869a420640 1 -- 172.21.15.71:0/3247276512 shutdown_connections 2024-09-10T10:05:39.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.595+0000 7f869a420640 1 -- 172.21.15.71:0/3247276512 wait complete. 2024-09-10T10:05:39.605 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:05:39.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 -- 172.21.15.71:0/2973797365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfe80fc720 msgr2=0x7fcfe80fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:39.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 --2- 172.21.15.71:0/2973797365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfe80fc720 0x7fcfe80fcb90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0048d0 tx=0x7fcfdc009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 -- 172.21.15.71:0/2973797365 shutdown_connections 2024-09-10T10:05:39.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 --2- 172.21.15.71:0/2973797365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfe80fc720 0x7fcfe80fcb90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 --2- 172.21.15.71:0/2973797365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfe80fb450 0x7fcfe80fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 -- 172.21.15.71:0/2973797365 >> 172.21.15.71:0/2973797365 conn(0x7fcfe80f6c10 msgr2=0x7fcfe80f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:39.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 -- 172.21.15.71:0/2973797365 shutdown_connections 2024-09-10T10:05:39.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 -- 172.21.15.71:0/2973797365 wait complete. 2024-09-10T10:05:39.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 Processor -- start 2024-09-10T10:05:39.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 -- start start 2024-09-10T10:05:39.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfe80fb450 0x7fcfe810d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:39.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfe80fc720 0x7fcfe810d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:39.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe810dc90 con 0x7fcfe80fb450 2024-09-10T10:05:39.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.676+0000 7fcff0193640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe810e460 con 0x7fcfe80fc720 2024-09-10T10:05:39.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.677+0000 7fcfedf2f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfe80fb450 0x7fcfe810d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:39.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.677+0000 7fcfedf2f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfe80fb450 0x7fcfe810d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43948/0 (socket says 172.21.15.71:43948) 2024-09-10T10:05:39.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.677+0000 7fcfedf2f640 1 -- 172.21.15.71:0/3939190614 learned_addr learned my addr 172.21.15.71:0/3939190614 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:39.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.677+0000 7fcfed72e640 1 --2- 172.21.15.71:0/3939190614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfe80fc720 0x7fcfe810d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:39.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.677+0000 7fcfedf2f640 1 -- 172.21.15.71:0/3939190614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfe80fc720 msgr2=0x7fcfe810d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:39.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.677+0000 7fcfedf2f640 1 --2- 172.21.15.71:0/3939190614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfe80fc720 0x7fcfe810d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.677+0000 7fcfedf2f640 1 -- 172.21.15.71:0/3939190614 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc005040 con 0x7fcfe80fb450 2024-09-10T10:05:39.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.677+0000 7fcfedf2f640 1 --2- 172.21.15.71:0/3939190614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfe80fb450 0x7fcfe810d100 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000c790 tx=0x7fcfe00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:39.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.677+0000 7fcfe67fc640 1 -- 172.21.15.71:0/3939190614 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfe000a820 con 0x7fcfe80fb450 2024-09-10T10:05:39.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.677+0000 7fcff0193640 1 -- 172.21.15.71:0/3939190614 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe810e6f0 con 0x7fcfe80fb450 2024-09-10T10:05:39.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.677+0000 7fcfe67fc640 1 -- 172.21.15.71:0/3939190614 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcfe000ae20 con 0x7fcfe80fb450 2024-09-10T10:05:39.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.677+0000 7fcfe67fc640 1 -- 172.21.15.71:0/3939190614 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfe00113a0 con 0x7fcfe80fb450 2024-09-10T10:05:39.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.677+0000 7fcff0193640 1 -- 172.21.15.71:0/3939190614 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe810ec90 con 0x7fcfe80fb450 2024-09-10T10:05:39.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.678+0000 7fcff0193640 1 -- 172.21.15.71:0/3939190614 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe80fa8b0 con 0x7fcfe80fb450 2024-09-10T10:05:39.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.679+0000 7fcfe67fc640 1 -- 172.21.15.71:0/3939190614 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 92029+0+0 (secure 0 0 0) 0x7fcfe0012400 con 0x7fcfe80fb450 2024-09-10T10:05:39.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.679+0000 7fcfe67fc640 1 --2- 172.21.15.71:0/3939190614 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fcfd006dae0 0x7fcfd006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:39.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.679+0000 7fcfe67fc640 1 -- 172.21.15.71:0/3939190614 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcfe008d400 con 0x7fcfe80fb450 2024-09-10T10:05:39.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.680+0000 7fcfed72e640 1 --2- 172.21.15.71:0/3939190614 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fcfd006dae0 0x7fcfd006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:39.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.680+0000 7fcfed72e640 1 --2- 172.21.15.71:0/3939190614 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fcfd006dae0 0x7fcfd006ff90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc007ac0 tx=0x7fcfdc035040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:39.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.683+0000 7fcfe67fc640 1 -- 172.21.15.71:0/3939190614 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fcfe0057050 con 0x7fcfe80fb450 2024-09-10T10:05:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.867+0000 7fcff0193640 1 -- 172.21.15.71:0/3939190614 --> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfe8103fe0 con 0x7fcfd006dae0 2024-09-10T10:05:39.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.869+0000 7fcfe67fc640 1 -- 172.21.15.71:0/3939190614 <== mgr.24391 v2:172.21.15.107:6828/591375611 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fcfe8103fe0 con 0x7fcfd006dae0 2024-09-10T10:05:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.870+0000 7fcff0193640 1 -- 172.21.15.71:0/3939190614 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fcfd006dae0 msgr2=0x7fcfd006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.870+0000 7fcff0193640 1 --2- 172.21.15.71:0/3939190614 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fcfd006dae0 0x7fcfd006ff90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc007ac0 tx=0x7fcfdc035040 comp rx=0 tx=0).stop 2024-09-10T10:05:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.870+0000 7fcff0193640 1 -- 172.21.15.71:0/3939190614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfe80fb450 msgr2=0x7fcfe810d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.870+0000 7fcff0193640 1 --2- 172.21.15.71:0/3939190614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfe80fb450 0x7fcfe810d100 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000c790 tx=0x7fcfe00043c0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.871+0000 7fcff0193640 1 -- 172.21.15.71:0/3939190614 shutdown_connections 2024-09-10T10:05:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.871+0000 7fcff0193640 1 --2- 172.21.15.71:0/3939190614 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fcfd006dae0 0x7fcfd006ff90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.871+0000 7fcff0193640 1 --2- 172.21.15.71:0/3939190614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfe80fc720 0x7fcfe810d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.871+0000 7fcff0193640 1 --2- 172.21.15.71:0/3939190614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfe80fb450 0x7fcfe810d100 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.871+0000 7fcff0193640 1 -- 172.21.15.71:0/3939190614 >> 172.21.15.71:0/3939190614 conn(0x7fcfe80f6c10 msgr2=0x7fcfe8066100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:39.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.871+0000 7fcff0193640 1 -- 172.21.15.71:0/3939190614 shutdown_connections 2024-09-10T10:05:39.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.871+0000 7fcff0193640 1 -- 172.21.15.71:0/3939190614 wait complete. 2024-09-10T10:05:39.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.950+0000 7fbf1527b640 1 -- 172.21.15.71:0/2752921712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf100fc720 msgr2=0x7fbf100fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:39.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.950+0000 7fbf1527b640 1 --2- 172.21.15.71:0/2752921712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf100fc720 0x7fbf100fcb90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbef80048d0 tx=0x7fbef8009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.950+0000 7fbf1527b640 1 -- 172.21.15.71:0/2752921712 shutdown_connections 2024-09-10T10:05:39.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.950+0000 7fbf1527b640 1 --2- 172.21.15.71:0/2752921712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf100fc720 0x7fbf100fcb90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.950+0000 7fbf1527b640 1 --2- 172.21.15.71:0/2752921712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf100fb450 0x7fbf100fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.950+0000 7fbf1527b640 1 -- 172.21.15.71:0/2752921712 >> 172.21.15.71:0/2752921712 conn(0x7fbf100f6c10 msgr2=0x7fbf100f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:39.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.950+0000 7fbf1527b640 1 -- 172.21.15.71:0/2752921712 shutdown_connections 2024-09-10T10:05:39.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.950+0000 7fbf1527b640 1 -- 172.21.15.71:0/2752921712 wait complete. 2024-09-10T10:05:39.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.950+0000 7fbf1527b640 1 Processor -- start 2024-09-10T10:05:39.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.950+0000 7fbf1527b640 1 -- start start 2024-09-10T10:05:39.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf1527b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf100fb450 0x7fbf1010bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf1527b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf100fc720 0x7fbf1010c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf1527b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1010cae0 con 0x7fbf100fc720 2024-09-10T10:05:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf1527b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1010d300 con 0x7fbf100fb450 2024-09-10T10:05:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf0e7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf100fc720 0x7fbf1010c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf0e7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf100fc720 0x7fbf1010c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43958/0 (socket says 172.21.15.71:43958) 2024-09-10T10:05:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf0e7fc640 1 -- 172.21.15.71:0/1802560488 learned_addr learned my addr 172.21.15.71:0/1802560488 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf0effd640 1 --2- 172.21.15.71:0/1802560488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf100fb450 0x7fbf1010bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf0e7fc640 1 -- 172.21.15.71:0/1802560488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf100fb450 msgr2=0x7fbf1010bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf0e7fc640 1 --2- 172.21.15.71:0/1802560488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf100fb450 0x7fbf1010bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf0e7fc640 1 -- 172.21.15.71:0/1802560488 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef8005040 con 0x7fbf100fc720 2024-09-10T10:05:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf0e7fc640 1 --2- 172.21.15.71:0/1802560488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf100fc720 0x7fbf1010c490 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbef8003080 tx=0x7fbef8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf077fe640 1 -- 172.21.15.71:0/1802560488 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbef8038070 con 0x7fbf100fc720 2024-09-10T10:05:39.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf077fe640 1 -- 172.21.15.71:0/1802560488 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbef802abd0 con 0x7fbf100fc720 2024-09-10T10:05:39.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf1527b640 1 -- 172.21.15.71:0/1802560488 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1010d530 con 0x7fbf100fc720 2024-09-10T10:05:39.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.951+0000 7fbf077fe640 1 -- 172.21.15.71:0/1802560488 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbef803e670 con 0x7fbf100fc720 2024-09-10T10:05:39.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.952+0000 7fbf1527b640 1 -- 172.21.15.71:0/1802560488 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1010dad0 con 0x7fbf100fc720 2024-09-10T10:05:39.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.953+0000 7fbf1527b640 1 -- 172.21.15.71:0/1802560488 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf100fa8b0 con 0x7fbf100fc720 2024-09-10T10:05:39.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.953+0000 7fbf077fe640 1 -- 172.21.15.71:0/1802560488 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 92029+0+0 (secure 0 0 0) 0x7fbef8030020 con 0x7fbf100fc720 2024-09-10T10:05:39.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.954+0000 7fbf077fe640 1 --2- 172.21.15.71:0/1802560488 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fbefc06dae0 0x7fbefc06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:39.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.954+0000 7fbf077fe640 1 -- 172.21.15.71:0/1802560488 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fbef80ad680 con 0x7fbf100fc720 2024-09-10T10:05:39.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.954+0000 7fbf0effd640 1 --2- 172.21.15.71:0/1802560488 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fbefc06dae0 0x7fbefc06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:39.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.954+0000 7fbf0effd640 1 --2- 172.21.15.71:0/1802560488 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fbefc06dae0 0x7fbefc06ff90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbf000041d0 tx=0x7fbf00009040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:39.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:39.959+0000 7fbf077fe640 1 -- 172.21.15.71:0/1802560488 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fbef8077250 con 0x7fbf100fc720 2024-09-10T10:05:40.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.136+0000 7fbf1527b640 1 -- 172.21.15.71:0/1802560488 --> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf1010de00 con 0x7fbefc06dae0 2024-09-10T10:05:40.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.146+0000 7fbf077fe640 1 -- 172.21.15.71:0/1802560488 <== mgr.24391 v2:172.21.15.107:6828/591375611 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fbf1010de00 con 0x7fbefc06dae0 2024-09-10T10:05:40.147 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:05:40.147 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (53s) 6s ago 9m 17.1M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:05:40.147 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (9m) 6s ago 9m 6891k - 17.2.7-1597-g96d63e75 f3fc7d52e233 f70481a4c3c7 2024-09-10T10:05:40.147 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (8m) 6s ago 8m 6895k - 17.2.7-1597-g96d63e75 f3fc7d52e233 cf27ebcc0f98 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (47s) 6s ago 9m 77.1M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (4m) 6s ago 4m 126M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (4m) 6s ago 4m 72.9M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (4m) 6s ago 4m 126M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (4m) 6s ago 3m 67.8M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (13s) 6s ago 10m 68.1M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283 running (2m) 6s ago 8m 498M - 19.1.1-305-g1cf819b7 41d671128357 7eef59ade56b 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (10m) 6s ago 10m 56.6M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 35e491e574a3 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (8m) 6s ago 8m 41.8M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 682e2b6e311f 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (58s) 6s ago 9m 8048k - 1.5.0 0da6a335fe13 c3d47d79cd22 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (21s) 6s ago 8m 7880k - 1.5.0 0da6a335fe13 9a25165a0fd1 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (7m) 6s ago 7m 220M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 a79e69c9b514 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (7m) 6s ago 7m 228M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 44a84bf577da 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (6m) 6s ago 6m 189M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 4fae52756a24 2024-09-10T10:05:40.148 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (6m) 6s ago 6m 264M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:05:40.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (5m) 6s ago 5m 226M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:05:40.149 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (5m) 6s ago 5m 222M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:05:40.149 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (23s) 6s ago 9m 38.5M - 2.43.0 a07b618ecd1d 36b0bb220b78 2024-09-10T10:05:40.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.148+0000 7fbf1527b640 1 -- 172.21.15.71:0/1802560488 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fbefc06dae0 msgr2=0x7fbefc06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:40.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.148+0000 7fbf1527b640 1 --2- 172.21.15.71:0/1802560488 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fbefc06dae0 0x7fbefc06ff90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbf000041d0 tx=0x7fbf00009040 comp rx=0 tx=0).stop 2024-09-10T10:05:40.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.148+0000 7fbf1527b640 1 -- 172.21.15.71:0/1802560488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf100fc720 msgr2=0x7fbf1010c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:40.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.148+0000 7fbf1527b640 1 --2- 172.21.15.71:0/1802560488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf100fc720 0x7fbf1010c490 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbef8003080 tx=0x7fbef8009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.148+0000 7fbf1527b640 1 -- 172.21.15.71:0/1802560488 shutdown_connections 2024-09-10T10:05:40.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.148+0000 7fbf1527b640 1 --2- 172.21.15.71:0/1802560488 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fbefc06dae0 0x7fbefc06ff90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.148+0000 7fbf1527b640 1 --2- 172.21.15.71:0/1802560488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf100fc720 0x7fbf1010c490 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.148+0000 7fbf1527b640 1 --2- 172.21.15.71:0/1802560488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf100fb450 0x7fbf1010bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.148+0000 7fbf1527b640 1 -- 172.21.15.71:0/1802560488 >> 172.21.15.71:0/1802560488 conn(0x7fbf100f6c10 msgr2=0x7fbf100f8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:40.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.148+0000 7fbf1527b640 1 -- 172.21.15.71:0/1802560488 shutdown_connections 2024-09-10T10:05:40.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.148+0000 7fbf1527b640 1 -- 172.21.15.71:0/1802560488 wait complete. 2024-09-10T10:05:40.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.226+0000 7fe19a24d640 1 -- 172.21.15.71:0/3649315845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1940fb470 msgr2=0x7fe1940fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:40.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.226+0000 7fe19a24d640 1 --2- 172.21.15.71:0/3649315845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1940fb470 0x7fe1940fb880 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe1840048d0 tx=0x7fe184009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.226+0000 7fe19a24d640 1 -- 172.21.15.71:0/3649315845 shutdown_connections 2024-09-10T10:05:40.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.226+0000 7fe19a24d640 1 --2- 172.21.15.71:0/3649315845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1940fc740 0x7fe1940fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.226+0000 7fe19a24d640 1 --2- 172.21.15.71:0/3649315845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1940fb470 0x7fe1940fb880 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.226+0000 7fe19a24d640 1 -- 172.21.15.71:0/3649315845 >> 172.21.15.71:0/3649315845 conn(0x7fe1940f6c30 msgr2=0x7fe1940f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.226+0000 7fe19a24d640 1 -- 172.21.15.71:0/3649315845 shutdown_connections 2024-09-10T10:05:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.226+0000 7fe19a24d640 1 -- 172.21.15.71:0/3649315845 wait complete. 2024-09-10T10:05:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe19a24d640 1 Processor -- start 2024-09-10T10:05:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe19a24d640 1 -- start start 2024-09-10T10:05:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe19a24d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1940fb470 0x7fe19410c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe19a24d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1940fc740 0x7fe19410c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe19a24d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19410d3d0 con 0x7fe1940fc740 2024-09-10T10:05:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe19a24d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19410d540 con 0x7fe1940fb470 2024-09-10T10:05:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe192ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1940fc740 0x7fe19410c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe192ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1940fc740 0x7fe19410c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43982/0 (socket says 172.21.15.71:43982) 2024-09-10T10:05:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe192ffd640 1 -- 172.21.15.71:0/3407636122 learned_addr learned my addr 172.21.15.71:0/3407636122 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:40.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe1937fe640 1 --2- 172.21.15.71:0/3407636122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1940fb470 0x7fe19410c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:40.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe192ffd640 1 -- 172.21.15.71:0/3407636122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1940fb470 msgr2=0x7fe19410c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:40.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe192ffd640 1 --2- 172.21.15.71:0/3407636122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1940fb470 0x7fe19410c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe192ffd640 1 -- 172.21.15.71:0/3407636122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe184005040 con 0x7fe1940fc740 2024-09-10T10:05:40.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.227+0000 7fe1937fe640 1 --2- 172.21.15.71:0/3407636122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1940fb470 0x7fe19410c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:05:40.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.228+0000 7fe192ffd640 1 --2- 172.21.15.71:0/3407636122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1940fc740 0x7fe19410c560 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe18800b790 tx=0x7fe1880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:40.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.228+0000 7fe17bfff640 1 -- 172.21.15.71:0/3407636122 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe18800c700 con 0x7fe1940fc740 2024-09-10T10:05:40.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.228+0000 7fe17bfff640 1 -- 172.21.15.71:0/3407636122 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe18800cd00 con 0x7fe1940fc740 2024-09-10T10:05:40.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.228+0000 7fe19a24d640 1 -- 172.21.15.71:0/3407636122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19410d820 con 0x7fe1940fc740 2024-09-10T10:05:40.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.228+0000 7fe17bfff640 1 -- 172.21.15.71:0/3407636122 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe188015e70 con 0x7fe1940fc740 2024-09-10T10:05:40.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.228+0000 7fe19a24d640 1 -- 172.21.15.71:0/3407636122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19410dd40 con 0x7fe1940fc740 2024-09-10T10:05:40.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.229+0000 7fe19a24d640 1 -- 172.21.15.71:0/3407636122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1940fa8d0 con 0x7fe1940fc740 2024-09-10T10:05:40.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.230+0000 7fe17bfff640 1 -- 172.21.15.71:0/3407636122 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 92029+0+0 (secure 0 0 0) 0x7fe188012070 con 0x7fe1940fc740 2024-09-10T10:05:40.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.230+0000 7fe17bfff640 1 --2- 172.21.15.71:0/3407636122 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fe17c06dae0 0x7fe17c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:40.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.230+0000 7fe17bfff640 1 -- 172.21.15.71:0/3407636122 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe18808ce50 con 0x7fe1940fc740 2024-09-10T10:05:40.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.230+0000 7fe1937fe640 1 --2- 172.21.15.71:0/3407636122 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fe17c06dae0 0x7fe17c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:40.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.231+0000 7fe1937fe640 1 --2- 172.21.15.71:0/3407636122 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fe17c06dae0 0x7fe17c06ff90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe184003080 tx=0x7fe184009da0 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:40.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.234+0000 7fe17bfff640 1 -- 172.21.15.71:0/3407636122 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe188056a20 con 0x7fe1940fc740 2024-09-10T10:05:40.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.464+0000 7fe19a24d640 1 -- 172.21.15.71:0/3407636122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe19404b720 con 0x7fe1940fc740 2024-09-10T10:05:40.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.465+0000 7fe17bfff640 1 -- 172.21.15.71:0/3407636122 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fe18805a0e0 con 0x7fe1940fc740 2024-09-10T10:05:40.466 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:05:40.466 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:05:40.466 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2 2024-09-10T10:05:40.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:05:40.467 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:05:40.467 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:05:40.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:05:40.467 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:05:40.467 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 6 2024-09-10T10:05:40.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:05:40.467 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:05:40.467 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:05:40.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:05:40.467 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:05:40.467 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 12, 2024-09-10T10:05:40.467 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:05:40.468 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:05:40.468 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:05:40.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.467+0000 7fe19a24d640 1 -- 172.21.15.71:0/3407636122 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fe17c06dae0 msgr2=0x7fe17c06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:40.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.467+0000 7fe19a24d640 1 --2- 172.21.15.71:0/3407636122 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fe17c06dae0 0x7fe17c06ff90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe184003080 tx=0x7fe184009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.467+0000 7fe19a24d640 1 -- 172.21.15.71:0/3407636122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1940fc740 msgr2=0x7fe19410c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:40.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.467+0000 7fe19a24d640 1 --2- 172.21.15.71:0/3407636122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1940fc740 0x7fe19410c560 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe18800b790 tx=0x7fe1880091d0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.467+0000 7fe19a24d640 1 -- 172.21.15.71:0/3407636122 shutdown_connections 2024-09-10T10:05:40.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.467+0000 7fe19a24d640 1 --2- 172.21.15.71:0/3407636122 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fe17c06dae0 0x7fe17c06ff90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.467+0000 7fe19a24d640 1 --2- 172.21.15.71:0/3407636122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1940fc740 0x7fe19410c560 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.467+0000 7fe19a24d640 1 --2- 172.21.15.71:0/3407636122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1940fb470 0x7fe19410c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.467+0000 7fe19a24d640 1 -- 172.21.15.71:0/3407636122 >> 172.21.15.71:0/3407636122 conn(0x7fe1940f6c30 msgr2=0x7fe1940f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:40.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.467+0000 7fe19a24d640 1 -- 172.21.15.71:0/3407636122 shutdown_connections 2024-09-10T10:05:40.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.467+0000 7fe19a24d640 1 -- 172.21.15.71:0/3407636122 wait complete. 2024-09-10T10:05:40.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 -- 172.21.15.71:0/3316974576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e00fd820 msgr2=0x7f54e00fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:40.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 --2- 172.21.15.71:0/3316974576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e00fd820 0x7f54e00fdc90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f54c80048d0 tx=0x7f54c8009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 -- 172.21.15.71:0/3316974576 shutdown_connections 2024-09-10T10:05:40.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 --2- 172.21.15.71:0/3316974576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e00fd820 0x7f54e00fdc90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 --2- 172.21.15.71:0/3316974576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e00fc550 0x7f54e00fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 -- 172.21.15.71:0/3316974576 >> 172.21.15.71:0/3316974576 conn(0x7f54e00f7d30 msgr2=0x7f54e00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:40.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 -- 172.21.15.71:0/3316974576 shutdown_connections 2024-09-10T10:05:40.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 -- 172.21.15.71:0/3316974576 wait complete. 2024-09-10T10:05:40.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 Processor -- start 2024-09-10T10:05:40.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 -- start start 2024-09-10T10:05:40.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e00fc550 0x7f54e010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:40.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e00fd820 0x7f54e010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e010dc20 con 0x7f54e00fc550 2024-09-10T10:05:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.546+0000 7f54e4bcc640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e010e440 con 0x7f54e00fd820 2024-09-10T10:05:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.547+0000 7f54de59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e00fc550 0x7f54e010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.547+0000 7f54de59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e00fc550 0x7f54e010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44000/0 (socket says 172.21.15.71:44000) 2024-09-10T10:05:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.547+0000 7f54de59c640 1 -- 172.21.15.71:0/4031114358 learned_addr learned my addr 172.21.15.71:0/4031114358 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.547+0000 7f54ddd9b640 1 --2- 172.21.15.71:0/4031114358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e00fd820 0x7f54e010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.547+0000 7f54de59c640 1 -- 172.21.15.71:0/4031114358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e00fd820 msgr2=0x7f54e010d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.547+0000 7f54de59c640 1 --2- 172.21.15.71:0/4031114358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e00fd820 0x7f54e010d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.547+0000 7f54de59c640 1 -- 172.21.15.71:0/4031114358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c8005040 con 0x7f54e00fc550 2024-09-10T10:05:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.547+0000 7f54de59c640 1 --2- 172.21.15.71:0/4031114358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e00fc550 0x7f54e010d090 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f54d0002a50 tx=0x7f54d0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.547+0000 7f54d6ffd640 1 -- 172.21.15.71:0/4031114358 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d0007c30 con 0x7f54e00fc550 2024-09-10T10:05:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.547+0000 7f54d6ffd640 1 -- 172.21.15.71:0/4031114358 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f54d000f040 con 0x7f54e00fc550 2024-09-10T10:05:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.547+0000 7f54e4bcc640 1 -- 172.21.15.71:0/4031114358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e010e6d0 con 0x7f54e00fc550 2024-09-10T10:05:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.547+0000 7f54d6ffd640 1 -- 172.21.15.71:0/4031114358 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d000db50 con 0x7f54e00fc550 2024-09-10T10:05:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.547+0000 7f54e4bcc640 1 -- 172.21.15.71:0/4031114358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e010ec70 con 0x7f54e00fc550 2024-09-10T10:05:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.548+0000 7f54e4bcc640 1 -- 172.21.15.71:0/4031114358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e00fb9b0 con 0x7f54e00fc550 2024-09-10T10:05:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.549+0000 7f54d6ffd640 1 -- 172.21.15.71:0/4031114358 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 92029+0+0 (secure 0 0 0) 0x7f54d000dcb0 con 0x7f54e00fc550 2024-09-10T10:05:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.549+0000 7f54d6ffd640 1 --2- 172.21.15.71:0/4031114358 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f54cc06dae0 0x7f54cc06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.549+0000 7f54d6ffd640 1 -- 172.21.15.71:0/4031114358 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f54d008d240 con 0x7f54e00fc550 2024-09-10T10:05:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.549+0000 7f54ddd9b640 1 --2- 172.21.15.71:0/4031114358 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f54cc06dae0 0x7f54cc06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.550+0000 7f54ddd9b640 1 --2- 172.21.15.71:0/4031114358 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f54cc06dae0 0x7f54cc06ff90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54c8007ac0 tx=0x7f54c8035040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:40.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.553+0000 7f54d6ffd640 1 -- 172.21.15.71:0/4031114358 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f54d0056d80 con 0x7f54e00fc550 2024-09-10T10:05:40.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.753+0000 7f54e4bcc640 1 -- 172.21.15.71:0/4031114358 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f54e010efb0 con 0x7f54e00fc550 2024-09-10T10:05:40.755 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:40 smithi071 ceph-mon[27559]: pgmap v41: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 432 op/s 2024-09-10T10:05:40.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.754+0000 7f54d6ffd640 1 -- 172.21.15.71:0/4031114358 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1866 (secure 0 0 0) 0x7f54d005a440 con 0x7f54e00fc550 2024-09-10T10:05:40.756 INFO:teuthology.orchestra.run.smithi071.stdout:e22 2024-09-10T10:05:40.756 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:05:40.756 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:05:40.756 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:05:40.756 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:05:40.756 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:05:40.756 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:05:40.756 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 22 2024-09-10T10:05:40.756 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:05:40.756 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:05:40.756 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:04:19.815073+0000 2024-09-10T10:05:40.757 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:05:40.757 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:05:40.757 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:05:40.757 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:05:40.757 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:05:40.757 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:05:40.757 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:05:40.757 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:05:40.757 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:05:40.757 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:05:40.757 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:05:40.757 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:05:40.758 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:05:40.758 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:05:40.758 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:05:40.758 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:05:40.758 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:05:40.758 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:05:40.759 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:05:40.759 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:05:40.760 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:05:40.760 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:05:40.760 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:05:40.760 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:05:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:05:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:05:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 22 2024-09-10T10:05:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.756+0000 7f54e4bcc640 1 -- 172.21.15.71:0/4031114358 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f54cc06dae0 msgr2=0x7f54cc06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.756+0000 7f54e4bcc640 1 --2- 172.21.15.71:0/4031114358 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f54cc06dae0 0x7f54cc06ff90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54c8007ac0 tx=0x7f54c8035040 comp rx=0 tx=0).stop 2024-09-10T10:05:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.756+0000 7f54e4bcc640 1 -- 172.21.15.71:0/4031114358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e00fc550 msgr2=0x7f54e010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.756+0000 7f54e4bcc640 1 --2- 172.21.15.71:0/4031114358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e00fc550 0x7f54e010d090 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f54d0002a50 tx=0x7f54d0004600 comp rx=0 tx=0).stop 2024-09-10T10:05:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.756+0000 7f54e4bcc640 1 -- 172.21.15.71:0/4031114358 shutdown_connections 2024-09-10T10:05:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.756+0000 7f54e4bcc640 1 --2- 172.21.15.71:0/4031114358 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7f54cc06dae0 0x7f54cc06ff90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.756+0000 7f54e4bcc640 1 --2- 172.21.15.71:0/4031114358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54e00fd820 0x7f54e010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.756+0000 7f54e4bcc640 1 --2- 172.21.15.71:0/4031114358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54e00fc550 0x7f54e010d090 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.756+0000 7f54e4bcc640 1 -- 172.21.15.71:0/4031114358 >> 172.21.15.71:0/4031114358 conn(0x7f54e00f7d30 msgr2=0x7f54e00f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:40.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.756+0000 7f54e4bcc640 1 -- 172.21.15.71:0/4031114358 shutdown_connections 2024-09-10T10:05:40.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.757+0000 7f54e4bcc640 1 -- 172.21.15.71:0/4031114358 wait complete. 2024-09-10T10:05:40.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.835+0000 7fae43125640 1 -- 172.21.15.71:0/943540126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c065c40 msgr2=0x7fae3c0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:40.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.835+0000 7fae43125640 1 --2- 172.21.15.71:0/943540126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c065c40 0x7fae3c0ff140 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fae380048d0 tx=0x7fae38009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.835+0000 7fae43125640 1 -- 172.21.15.71:0/943540126 shutdown_connections 2024-09-10T10:05:40.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.835+0000 7fae43125640 1 --2- 172.21.15.71:0/943540126 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae3c0ff680 0x7fae3c101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.835+0000 7fae43125640 1 --2- 172.21.15.71:0/943540126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c065c40 0x7fae3c0ff140 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.835+0000 7fae43125640 1 -- 172.21.15.71:0/943540126 >> 172.21.15.71:0/943540126 conn(0x7fae3c0f6c10 msgr2=0x7fae3c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:40.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.835+0000 7fae43125640 1 -- 172.21.15.71:0/943540126 shutdown_connections 2024-09-10T10:05:40.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.835+0000 7fae43125640 1 -- 172.21.15.71:0/943540126 wait complete. 2024-09-10T10:05:40.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.836+0000 7fae43125640 1 Processor -- start 2024-09-10T10:05:40.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.836+0000 7fae43125640 1 -- start start 2024-09-10T10:05:40.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.836+0000 7fae43125640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae3c065c40 0x7fae3c10d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:40.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.836+0000 7fae43125640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c0ff680 0x7fae3c10d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:40.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.836+0000 7fae43125640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c10dca0 con 0x7fae3c0ff680 2024-09-10T10:05:40.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.836+0000 7fae43125640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c10e400 con 0x7fae3c065c40 2024-09-10T10:05:40.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.836+0000 7fae33fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c0ff680 0x7fae3c10d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:40.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.836+0000 7fae33fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c0ff680 0x7fae3c10d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44020/0 (socket says 172.21.15.71:44020) 2024-09-10T10:05:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.836+0000 7fae33fff640 1 -- 172.21.15.71:0/1285298392 learned_addr learned my addr 172.21.15.71:0/1285298392 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.837+0000 7fae40ec1640 1 --2- 172.21.15.71:0/1285298392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae3c065c40 0x7fae3c10d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.837+0000 7fae33fff640 1 -- 172.21.15.71:0/1285298392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae3c065c40 msgr2=0x7fae3c10d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.837+0000 7fae33fff640 1 --2- 172.21.15.71:0/1285298392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae3c065c40 0x7fae3c10d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.837+0000 7fae33fff640 1 -- 172.21.15.71:0/1285298392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae38005040 con 0x7fae3c0ff680 2024-09-10T10:05:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.837+0000 7fae40ec1640 1 --2- 172.21.15.71:0/1285298392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae3c065c40 0x7fae3c10d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:05:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.837+0000 7fae33fff640 1 --2- 172.21.15.71:0/1285298392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c0ff680 0x7fae3c10d650 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fae2c002a50 tx=0x7fae2c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.837+0000 7fae317fa640 1 -- 172.21.15.71:0/1285298392 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae2c007c30 con 0x7fae3c0ff680 2024-09-10T10:05:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.837+0000 7fae317fa640 1 -- 172.21.15.71:0/1285298392 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fae2c00f040 con 0x7fae3c0ff680 2024-09-10T10:05:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.837+0000 7fae43125640 1 -- 172.21.15.71:0/1285298392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c10e690 con 0x7fae3c0ff680 2024-09-10T10:05:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.837+0000 7fae317fa640 1 -- 172.21.15.71:0/1285298392 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae2c00da90 con 0x7fae3c0ff680 2024-09-10T10:05:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.837+0000 7fae43125640 1 -- 172.21.15.71:0/1285298392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c10ec30 con 0x7fae3c0ff680 2024-09-10T10:05:40.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.838+0000 7fae43125640 1 -- 172.21.15.71:0/1285298392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c0fa890 con 0x7fae3c0ff680 2024-09-10T10:05:40.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.839+0000 7fae317fa640 1 -- 172.21.15.71:0/1285298392 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 92029+0+0 (secure 0 0 0) 0x7fae2c00dd00 con 0x7fae3c0ff680 2024-09-10T10:05:40.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.839+0000 7fae317fa640 1 --2- 172.21.15.71:0/1285298392 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fae2406dae0 0x7fae2406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:40.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.839+0000 7fae317fa640 1 -- 172.21.15.71:0/1285298392 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fae2c08cc70 con 0x7fae3c0ff680 2024-09-10T10:05:40.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.839+0000 7fae40ec1640 1 --2- 172.21.15.71:0/1285298392 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fae2406dae0 0x7fae2406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:40.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.840+0000 7fae40ec1640 1 --2- 172.21.15.71:0/1285298392 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fae2406dae0 0x7fae2406ff90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae38007ac0 tx=0x7fae38035040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:40.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:40.843+0000 7fae317fa640 1 -- 172.21.15.71:0/1285298392 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fae2c056730 con 0x7fae3c0ff680 2024-09-10T10:05:40.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:40 smithi107 ceph-mon[34215]: pgmap v41: 65 pgs: 65 active+clean; 257 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 432 op/s 2024-09-10T10:05:41.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.024+0000 7fae43125640 1 -- 172.21.15.71:0/1285298392 --> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae3c10ef10 con 0x7fae2406dae0 2024-09-10T10:05:41.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.025+0000 7fae317fa640 1 -- 172.21.15.71:0/1285298392 <== mgr.24391 v2:172.21.15.107:6828/591375611 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fae3c10ef10 con 0x7fae2406dae0 2024-09-10T10:05:41.027 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:05:41.027 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:05:41.027 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:05:41.027 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:05:41.027 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:05:41.027 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr" 2024-09-10T10:05:41.027 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:05:41.027 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "2/21 daemons upgraded", 2024-09-10T10:05:41.027 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mgr daemons", 2024-09-10T10:05:41.027 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:05:41.027 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:05:41.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.027+0000 7fae43125640 1 -- 172.21.15.71:0/1285298392 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fae2406dae0 msgr2=0x7fae2406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:41.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.027+0000 7fae43125640 1 --2- 172.21.15.71:0/1285298392 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fae2406dae0 0x7fae2406ff90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae38007ac0 tx=0x7fae38035040 comp rx=0 tx=0).stop 2024-09-10T10:05:41.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.027+0000 7fae43125640 1 -- 172.21.15.71:0/1285298392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c0ff680 msgr2=0x7fae3c10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:41.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.027+0000 7fae43125640 1 --2- 172.21.15.71:0/1285298392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c0ff680 0x7fae3c10d650 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fae2c002a50 tx=0x7fae2c004600 comp rx=0 tx=0).stop 2024-09-10T10:05:41.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.028+0000 7fae43125640 1 -- 172.21.15.71:0/1285298392 shutdown_connections 2024-09-10T10:05:41.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.028+0000 7fae43125640 1 --2- 172.21.15.71:0/1285298392 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fae2406dae0 0x7fae2406ff90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:41.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.028+0000 7fae43125640 1 --2- 172.21.15.71:0/1285298392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae3c0ff680 0x7fae3c10d650 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:41.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.028+0000 7fae43125640 1 --2- 172.21.15.71:0/1285298392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae3c065c40 0x7fae3c10d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:41.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.028+0000 7fae43125640 1 -- 172.21.15.71:0/1285298392 >> 172.21.15.71:0/1285298392 conn(0x7fae3c0f6c10 msgr2=0x7fae3c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:41.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.028+0000 7fae43125640 1 -- 172.21.15.71:0/1285298392 shutdown_connections 2024-09-10T10:05:41.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.028+0000 7fae43125640 1 -- 172.21.15.71:0/1285298392 wait complete. 2024-09-10T10:05:41.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.105+0000 7fbc74b35640 1 -- 172.21.15.71:0/1458842008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc700fdba0 msgr2=0x7fbc700fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:41.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.105+0000 7fbc74b35640 1 --2- 172.21.15.71:0/1458842008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc700fdba0 0x7fbc700fdfb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbc600048d0 tx=0x7fbc60009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:41.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.106+0000 7fbc74b35640 1 -- 172.21.15.71:0/1458842008 shutdown_connections 2024-09-10T10:05:41.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.106+0000 7fbc74b35640 1 --2- 172.21.15.71:0/1458842008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc700fe4f0 0x7fbc700fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:41.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.106+0000 7fbc74b35640 1 --2- 172.21.15.71:0/1458842008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc700fdba0 0x7fbc700fdfb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:41.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.106+0000 7fbc74b35640 1 -- 172.21.15.71:0/1458842008 >> 172.21.15.71:0/1458842008 conn(0x7fbc700f63a0 msgr2=0x7fbc700f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:41.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.106+0000 7fbc74b35640 1 -- 172.21.15.71:0/1458842008 shutdown_connections 2024-09-10T10:05:41.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.106+0000 7fbc74b35640 1 -- 172.21.15.71:0/1458842008 wait complete. 2024-09-10T10:05:41.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc74b35640 1 Processor -- start 2024-09-10T10:05:41.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc74b35640 1 -- start start 2024-09-10T10:05:41.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc74b35640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc700fdba0 0x7fbc7010d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:41.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc74b35640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc700fe4f0 0x7fbc7010d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:41.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc74b35640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7010e4e0 con 0x7fbc700fdba0 2024-09-10T10:05:41.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc74b35640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7010e650 con 0x7fbc700fe4f0 2024-09-10T10:05:41.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc6e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc700fdba0 0x7fbc7010d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:41.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc6e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc700fdba0 0x7fbc7010d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44040/0 (socket says 172.21.15.71:44040) 2024-09-10T10:05:41.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc6e59c640 1 -- 172.21.15.71:0/1425113215 learned_addr learned my addr 172.21.15.71:0/1425113215 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:05:41.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc6e59c640 1 -- 172.21.15.71:0/1425113215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc700fe4f0 msgr2=0x7fbc7010d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:41.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc6dd9b640 1 --2- 172.21.15.71:0/1425113215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc700fe4f0 0x7fbc7010d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:41.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc6e59c640 1 --2- 172.21.15.71:0/1425113215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc700fe4f0 0x7fbc7010d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:41.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc6e59c640 1 -- 172.21.15.71:0/1425113215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc60005040 con 0x7fbc700fdba0 2024-09-10T10:05:41.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.107+0000 7fbc6e59c640 1 --2- 172.21.15.71:0/1425113215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc700fdba0 0x7fbc7010d130 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbc60003080 tx=0x7fbc60009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:41.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.108+0000 7fbc66ffd640 1 -- 172.21.15.71:0/1425113215 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc60038070 con 0x7fbc700fdba0 2024-09-10T10:05:41.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.108+0000 7fbc74b35640 1 -- 172.21.15.71:0/1425113215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7010e8d0 con 0x7fbc700fdba0 2024-09-10T10:05:41.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.108+0000 7fbc66ffd640 1 -- 172.21.15.71:0/1425113215 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbc6002abd0 con 0x7fbc700fdba0 2024-09-10T10:05:41.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.108+0000 7fbc66ffd640 1 -- 172.21.15.71:0/1425113215 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc6003e670 con 0x7fbc700fdba0 2024-09-10T10:05:41.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.108+0000 7fbc74b35640 1 -- 172.21.15.71:0/1425113215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7010edf0 con 0x7fbc700fdba0 2024-09-10T10:05:41.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.109+0000 7fbc74b35640 1 -- 172.21.15.71:0/1425113215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc70105820 con 0x7fbc700fdba0 2024-09-10T10:05:41.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.109+0000 7fbc66ffd640 1 -- 172.21.15.71:0/1425113215 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) v1 ==== 92029+0+0 (secure 0 0 0) 0x7fbc60030020 con 0x7fbc700fdba0 2024-09-10T10:05:41.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.110+0000 7fbc66ffd640 1 --2- 172.21.15.71:0/1425113215 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fbc5c06dae0 0x7fbc5c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:41.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.110+0000 7fbc66ffd640 1 -- 172.21.15.71:0/1425113215 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fbc600ad680 con 0x7fbc700fdba0 2024-09-10T10:05:41.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.110+0000 7fbc6dd9b640 1 --2- 172.21.15.71:0/1425113215 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fbc5c06dae0 0x7fbc5c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:41.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.110+0000 7fbc6dd9b640 1 --2- 172.21.15.71:0/1425113215 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fbc5c06dae0 0x7fbc5c06ff90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbc7010cee0 tx=0x7fbc58008040 comp rx=0 tx=0).ready entity=mgr.24391 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:41.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.114+0000 7fbc66ffd640 1 -- 172.21.15.71:0/1425113215 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fbc60077250 con 0x7fbc700fdba0 2024-09-10T10:05:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.347+0000 7fbc74b35640 1 -- 172.21.15.71:0/1425113215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbc700fa040 con 0x7fbc700fdba0 2024-09-10T10:05:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.347+0000 7fbc66ffd640 1 -- 172.21.15.71:0/1425113215 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbc6007a910 con 0x7fbc700fdba0 2024-09-10T10:05:41.349 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:05:41.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.349+0000 7fbc74b35640 1 -- 172.21.15.71:0/1425113215 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fbc5c06dae0 msgr2=0x7fbc5c06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:41.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.349+0000 7fbc74b35640 1 --2- 172.21.15.71:0/1425113215 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fbc5c06dae0 0x7fbc5c06ff90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbc7010cee0 tx=0x7fbc58008040 comp rx=0 tx=0).stop 2024-09-10T10:05:41.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.349+0000 7fbc74b35640 1 -- 172.21.15.71:0/1425113215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc700fdba0 msgr2=0x7fbc7010d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:41.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.349+0000 7fbc74b35640 1 --2- 172.21.15.71:0/1425113215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc700fdba0 0x7fbc7010d130 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbc60003080 tx=0x7fbc60009da0 comp rx=0 tx=0).stop 2024-09-10T10:05:41.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.350+0000 7fbc74b35640 1 -- 172.21.15.71:0/1425113215 shutdown_connections 2024-09-10T10:05:41.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.350+0000 7fbc74b35640 1 --2- 172.21.15.71:0/1425113215 >> [v2:172.21.15.107:6828/591375611,v1:172.21.15.107:6829/591375611] conn(0x7fbc5c06dae0 0x7fbc5c06ff90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:41.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.350+0000 7fbc74b35640 1 --2- 172.21.15.71:0/1425113215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc700fe4f0 0x7fbc7010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:41.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.350+0000 7fbc74b35640 1 --2- 172.21.15.71:0/1425113215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc700fdba0 0x7fbc7010d130 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:41.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.350+0000 7fbc74b35640 1 -- 172.21.15.71:0/1425113215 >> 172.21.15.71:0/1425113215 conn(0x7fbc700f63a0 msgr2=0x7fbc700f7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:41.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.350+0000 7fbc74b35640 1 -- 172.21.15.71:0/1425113215 shutdown_connections 2024-09-10T10:05:41.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:05:41.350+0000 7fbc74b35640 1 -- 172.21.15.71:0/1425113215 wait complete. 2024-09-10T10:05:41.778 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:41 smithi107 ceph-mon[34215]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:41.779 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:41 smithi107 ceph-mon[34215]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:41.780 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:41 smithi107 ceph-mon[34215]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:41.780 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:41 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/3407636122' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:05:41.780 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:41 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/4031114358' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:05:41.780 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:41 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1425113215' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:05:41.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:41 smithi071 ceph-mon[27559]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:41.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:41 smithi071 ceph-mon[27559]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:41.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:41 smithi071 ceph-mon[27559]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:41.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:41 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/3407636122' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:05:41.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:41 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/4031114358' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:05:41.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:41 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1425113215' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:05:42.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:42 smithi071 ceph-mon[27559]: pgmap v42: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 470 op/s 2024-09-10T10:05:42.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:42 smithi071 ceph-mon[27559]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:42.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:42 smithi107 ceph-mon[34215]: pgmap v42: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 470 op/s 2024-09-10T10:05:42.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:42 smithi107 ceph-mon[34215]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:44.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: pgmap v43: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 610 KiB/s rd, 612 KiB/s wr, 227 op/s 2024-09-10T10:05:44.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:44.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:44.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:44.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:44.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:44.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:44.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mgr fail", "who": "smithi107.qurtcs"}]: dispatch 2024-09-10T10:05:44.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mgr fail", "who": "smithi107.qurtcs"}]: dispatch 2024-09-10T10:05:44.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: Activating manager daemon smithi071.gtqytr 2024-09-10T10:05:44.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: osdmap e47: 6 total, 6 up, 6 in 2024-09-10T10:05:44.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd='[{"prefix": "mgr fail", "who": "smithi107.qurtcs"}]': finished 2024-09-10T10:05:44.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: mgrmap e27: smithi071.gtqytr(active, starting, since 0.00689982s) 2024-09-10T10:05:44.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T10:05:44.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T10:05:44.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.omoqqq"}]: dispatch 2024-09-10T10:05:44.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:05:44.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:05:44.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:05:44.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr metadata", "who": "smithi071.gtqytr", "id": "smithi071.gtqytr"}]: dispatch 2024-09-10T10:05:44.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:05:44.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:05:44.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:05:44.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:05:44.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:05:44.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:05:44.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:05:44.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:05:44.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:05:44.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: Manager daemon smithi071.gtqytr is now available 2024-09-10T10:05:44.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:44.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:05:44.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:05:44.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:44 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/trash_purge_schedule"}]: dispatch 2024-09-10T10:05:44.813 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: pgmap v43: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 610 KiB/s rd, 612 KiB/s wr, 227 op/s 2024-09-10T10:05:44.813 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:44.813 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:44.813 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:44.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:44.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' 2024-09-10T10:05:44.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:44.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.24391 172.21.15.107:0/2102586281' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mgr fail", "who": "smithi107.qurtcs"}]: dispatch 2024-09-10T10:05:44.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "mgr fail", "who": "smithi107.qurtcs"}]: dispatch 2024-09-10T10:05:44.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: Activating manager daemon smithi071.gtqytr 2024-09-10T10:05:44.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: osdmap e47: 6 total, 6 up, 6 in 2024-09-10T10:05:44.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.24391 ' entity='mgr.smithi107.qurtcs' cmd='[{"prefix": "mgr fail", "who": "smithi107.qurtcs"}]': finished 2024-09-10T10:05:44.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: mgrmap e27: smithi071.gtqytr(active, starting, since 0.00689982s) 2024-09-10T10:05:44.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T10:05:44.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T10:05:44.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.omoqqq"}]: dispatch 2024-09-10T10:05:44.814 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr metadata", "who": "smithi071.gtqytr", "id": "smithi071.gtqytr"}]: dispatch 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: Manager daemon smithi071.gtqytr is now available 2024-09-10T10:05:44.815 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:44.816 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:05:44.816 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:05:44.816 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:44 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/trash_purge_schedule"}]: dispatch 2024-09-10T10:05:46.202 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:45 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:46.202 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:45 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:46.202 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:45 smithi071 ceph-mon[27559]: mgrmap e28: smithi071.gtqytr(active, since 1.01003s) 2024-09-10T10:05:46.203 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:45 smithi071 ceph-mon[27559]: [10/Sep/2024:10:05:45] ENGINE Bus STARTING 2024-09-10T10:05:46.203 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:45 smithi071 ceph-mon[27559]: [10/Sep/2024:10:05:45] ENGINE Serving on https://172.21.15.71:7150 2024-09-10T10:05:46.203 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:45 smithi071 ceph-mon[27559]: [10/Sep/2024:10:05:45] ENGINE Error in HTTPServer.serve 2024-09-10T10:05:46.203 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Traceback (most recent call last): 2024-09-10T10:05:46.203 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:05:46.203 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:05:46.203 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:05:46.203 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._run(expiration_interval) 2024-09-10T10:05:46.203 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:05:46.203 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:05:46.203 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:05:46.203 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:05:46.203 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:05:46.204 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: s = self.context.wrap_socket( 2024-09-10T10:05:46.204 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:05:46.204 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: return self.sslsocket_class._create( 2024-09-10T10:05:46.204 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:05:46.204 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self.do_handshake() 2024-09-10T10:05:46.204 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:05:46.204 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._sslobj.do_handshake() 2024-09-10T10:05:46.204 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:05:46.240 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:45 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:46.240 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:45 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:46.240 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:45 smithi107 ceph-mon[34215]: mgrmap e28: smithi071.gtqytr(active, since 1.01003s) 2024-09-10T10:05:46.240 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:45 smithi107 ceph-mon[34215]: [10/Sep/2024:10:05:45] ENGINE Bus STARTING 2024-09-10T10:05:46.240 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:45 smithi107 ceph-mon[34215]: [10/Sep/2024:10:05:45] ENGINE Serving on https://172.21.15.71:7150 2024-09-10T10:05:46.240 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:45 smithi107 ceph-mon[34215]: [10/Sep/2024:10:05:45] ENGINE Error in HTTPServer.serve 2024-09-10T10:05:46.240 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Traceback (most recent call last): 2024-09-10T10:05:46.240 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:05:46.240 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:05:46.240 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:05:46.240 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._run(expiration_interval) 2024-09-10T10:05:46.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:05:46.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:05:46.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:05:46.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:05:46.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:05:46.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s = self.context.wrap_socket( 2024-09-10T10:05:46.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:05:46.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: return self.sslsocket_class._create( 2024-09-10T10:05:46.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:05:46.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self.do_handshake() 2024-09-10T10:05:46.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:05:46.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._sslobj.do_handshake() 2024-09-10T10:05:46.241 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:05:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:47 smithi071 ceph-mon[27559]: [10/Sep/2024:10:05:45] ENGINE Serving on http://172.21.15.71:8765 2024-09-10T10:05:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:47 smithi071 ceph-mon[27559]: [10/Sep/2024:10:05:45] ENGINE Bus STARTED 2024-09-10T10:05:47.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:47 smithi071 ceph-mon[27559]: pgmap v4: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-10T10:05:47.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:47 smithi107 ceph-mon[34215]: [10/Sep/2024:10:05:45] ENGINE Serving on http://172.21.15.71:8765 2024-09-10T10:05:47.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:47 smithi107 ceph-mon[34215]: [10/Sep/2024:10:05:45] ENGINE Bus STARTED 2024-09-10T10:05:47.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:47 smithi107 ceph-mon[34215]: pgmap v4: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-10T10:05:48.305 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:48 smithi107 ceph-mon[34215]: mgrmap e29: smithi071.gtqytr(active, since 3s) 2024-09-10T10:05:48.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:48 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:48.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:48 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:48.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:48 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:48.306 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:48 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:48.419 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:48 smithi071 ceph-mon[27559]: mgrmap e29: smithi071.gtqytr(active, since 3s) 2024-09-10T10:05:48.419 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:48 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:48.420 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:48 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:48.420 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:48 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:48.420 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:48 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:49.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:49 smithi107 ceph-mon[34215]: pgmap v5: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-10T10:05:49.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:49 smithi107 ceph-mon[34215]: Standby manager daemon smithi107.qurtcs started 2024-09-10T10:05:49.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:49 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/3644845729' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/crt"}]: dispatch 2024-09-10T10:05:49.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:49 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/3644845729' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:05:49.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:49 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/3644845729' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/key"}]: dispatch 2024-09-10T10:05:49.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:49 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/3644845729' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:05:49.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:49 smithi071 ceph-mon[27559]: pgmap v5: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-10T10:05:49.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:49 smithi071 ceph-mon[27559]: Standby manager daemon smithi107.qurtcs started 2024-09-10T10:05:49.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:49 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/3644845729' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/crt"}]: dispatch 2024-09-10T10:05:49.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:49 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/3644845729' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:05:49.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:49 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/3644845729' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/key"}]: dispatch 2024-09-10T10:05:49.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:49 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/3644845729' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:05:51.037 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:50 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:51.037 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:50 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:51.037 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:50 smithi071 ceph-mon[27559]: mgrmap e30: smithi071.gtqytr(active, since 6s), standbys: smithi107.qurtcs 2024-09-10T10:05:51.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:50 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr metadata", "who": "smithi107.qurtcs", "id": "smithi107.qurtcs"}]: dispatch 2024-09-10T10:05:51.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:50 smithi071 ceph-mon[27559]: pgmap v6: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 205 B/s rd, 2 op/s 2024-09-10T10:05:51.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:50 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:51.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:50 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:51.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:50 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:51.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:50 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:51.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:50 smithi107 ceph-mon[34215]: mgrmap e30: smithi071.gtqytr(active, since 6s), standbys: smithi107.qurtcs 2024-09-10T10:05:51.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:50 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr metadata", "who": "smithi107.qurtcs", "id": "smithi107.qurtcs"}]: dispatch 2024-09-10T10:05:51.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:50 smithi107 ceph-mon[34215]: pgmap v6: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 205 B/s rd, 2 op/s 2024-09-10T10:05:51.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:50 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:51.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:50 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:53.511 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:53 smithi071 ceph-mon[27559]: pgmap v7: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-10T10:05:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:53 smithi107 ceph-mon[34215]: pgmap v7: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-10T10:05:54.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:54.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:54.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:54.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:54.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T10:05:54.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-10T10:05:54.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:05:54.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:05:54.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:05:54.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:05:54.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: pgmap v8: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-10T10:05:54.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:05:54.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:05:54.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:54.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:54.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:54.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:54.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:54 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T10:05:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-10T10:05:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:05:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:05:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:05:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:05:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: pgmap v8: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-10T10:05:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:05:55.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:05:55.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:55.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:55.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:55.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:55.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:54 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:05:55.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:55 smithi071 ceph-mon[27559]: Reconfiguring prometheus.smithi071 (dependencies changed)... 2024-09-10T10:05:55.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:55 smithi071 ceph-mon[27559]: Reconfiguring daemon prometheus.smithi071 on smithi071 2024-09-10T10:05:55.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:55 smithi107 ceph-mon[34215]: Reconfiguring prometheus.smithi071 (dependencies changed)... 2024-09-10T10:05:55.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:55 smithi107 ceph-mon[34215]: Reconfiguring daemon prometheus.smithi071 on smithi071 2024-09-10T10:05:56.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:56 smithi107 ceph-mon[34215]: pgmap v9: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-10T10:05:56.946 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:56 smithi071 ceph-mon[27559]: pgmap v9: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-10T10:05:59.278 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:05:59 smithi071 ceph-mon[27559]: pgmap v10: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-10T10:05:59.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:05:59 smithi107 ceph-mon[34215]: pgmap v10: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-10T10:06:00.351 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:00 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:06:00.351 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:00 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:00.352 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:00 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:00.352 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:00 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T10:06:00.352 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:00 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:00.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:00 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:06:00.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:00 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:00.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:00 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:00.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:00 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T10:06:00.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:00 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:01.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:01 smithi107 ceph-mon[34215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T10:06:01.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:01 smithi107 ceph-mon[34215]: pgmap v11: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-10T10:06:01.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:01 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.qurtcs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:06:01.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:01 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:06:01.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:01 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:01 smithi071 ceph-mon[27559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T10:06:01.574 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:01 smithi071 ceph-mon[27559]: pgmap v11: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-10T10:06:01.574 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:01 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.qurtcs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:06:01.575 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:01 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:06:01.575 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:01 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:02.455 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:02 smithi107 ceph-mon[34215]: Upgrade: Updating mgr.smithi107.qurtcs 2024-09-10T10:06:02.456 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:02 smithi107 ceph-mon[34215]: Deploying daemon mgr.smithi107.qurtcs on smithi107 2024-09-10T10:06:02.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:02 smithi071 ceph-mon[27559]: Upgrade: Updating mgr.smithi107.qurtcs 2024-09-10T10:06:02.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:02 smithi071 ceph-mon[27559]: Deploying daemon mgr.smithi107.qurtcs on smithi107 2024-09-10T10:06:03.265 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:03 smithi107 ceph-mon[34215]: pgmap v12: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-10T10:06:03.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:03 smithi071 ceph-mon[27559]: pgmap v12: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-10T10:06:05.451 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:05 smithi107 ceph-mon[34215]: pgmap v13: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:05.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:05 smithi071 ceph-mon[27559]: pgmap v13: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:06.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:06 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:06.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:06 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:06.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:06 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:06.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:06 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:06.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:06 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:06.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:06 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:07.558 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:07 smithi071 ceph-mon[27559]: pgmap v14: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:06:07.728 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:07 smithi107 ceph-mon[34215]: pgmap v14: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:06:09.369 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:09 smithi107 ceph-mon[34215]: pgmap v15: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:09.369 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:09 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:09.369 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:09 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:09.369 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:09 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:09.369 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:09 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:09.673 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:09 smithi071 ceph-mon[27559]: pgmap v15: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:09.673 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:09 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:09.673 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:09 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:09.673 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:09 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:09.673 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:09 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.443+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3991295021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e540fd820 msgr2=0x7f6e540fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.443+0000 7f6e5bbd3640 1 --2- 172.21.15.71:0/3991295021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e540fd820 0x7f6e540fdc90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6e440048d0 tx=0x7f6e44009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3991295021 shutdown_connections 2024-09-10T10:06:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5bbd3640 1 --2- 172.21.15.71:0/3991295021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e540fd820 0x7f6e540fdc90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5bbd3640 1 --2- 172.21.15.71:0/3991295021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e540fc550 0x7f6e540fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3991295021 >> 172.21.15.71:0/3991295021 conn(0x7f6e540f7d30 msgr2=0x7f6e540fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3991295021 shutdown_connections 2024-09-10T10:06:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3991295021 wait complete. 2024-09-10T10:06:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5bbd3640 1 Processor -- start 2024-09-10T10:06:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5bbd3640 1 -- start start 2024-09-10T10:06:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5bbd3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e540fc550 0x7f6e5410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5bbd3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e540fd820 0x7f6e5410d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5bbd3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5410dc40 con 0x7f6e540fc550 2024-09-10T10:06:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5bbd3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5410e460 con 0x7f6e540fd820 2024-09-10T10:06:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5996f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e540fc550 0x7f6e5410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5996f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e540fc550 0x7f6e5410d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39068/0 (socket says 172.21.15.71:39068) 2024-09-10T10:06:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.444+0000 7f6e5996f640 1 -- 172.21.15.71:0/3832195264 learned_addr learned my addr 172.21.15.71:0/3832195264 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.445+0000 7f6e5916e640 1 --2- 172.21.15.71:0/3832195264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e540fd820 0x7f6e5410d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.445+0000 7f6e5996f640 1 -- 172.21.15.71:0/3832195264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e540fd820 msgr2=0x7f6e5410d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.445+0000 7f6e5996f640 1 --2- 172.21.15.71:0/3832195264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e540fd820 0x7f6e5410d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.445+0000 7f6e5996f640 1 -- 172.21.15.71:0/3832195264 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44005040 con 0x7f6e540fc550 2024-09-10T10:06:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.445+0000 7f6e5996f640 1 --2- 172.21.15.71:0/3832195264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e540fc550 0x7f6e5410d0b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000eb70 tx=0x7f6e5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.445+0000 7f6e4a7fc640 1 -- 172.21.15.71:0/3832195264 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e50007c30 con 0x7f6e540fc550 2024-09-10T10:06:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.445+0000 7f6e4a7fc640 1 -- 172.21.15.71:0/3832195264 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6e5000f040 con 0x7f6e540fc550 2024-09-10T10:06:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.445+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3832195264 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5410e690 con 0x7f6e540fc550 2024-09-10T10:06:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.445+0000 7f6e4a7fc640 1 -- 172.21.15.71:0/3832195264 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e5000ca60 con 0x7f6e540fc550 2024-09-10T10:06:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.445+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3832195264 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5410ec30 con 0x7f6e540fc550 2024-09-10T10:06:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.446+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3832195264 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e540fb9b0 con 0x7f6e540fc550 2024-09-10T10:06:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.447+0000 7f6e4a7fc640 1 -- 172.21.15.71:0/3832195264 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 31) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f6e5000cbc0 con 0x7f6e540fc550 2024-09-10T10:06:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.447+0000 7f6e4a7fc640 1 --2- 172.21.15.71:0/3832195264 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f6e4006dae0 0x7f6e4006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.447+0000 7f6e4a7fc640 1 -- 172.21.15.71:0/3832195264 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f6e5008d0c0 con 0x7f6e540fc550 2024-09-10T10:06:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.447+0000 7f6e5916e640 1 --2- 172.21.15.71:0/3832195264 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f6e4006dae0 0x7f6e4006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.448+0000 7f6e5916e640 1 --2- 172.21.15.71:0/3832195264 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f6e4006dae0 0x7f6e4006ff90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6e44007ac0 tx=0x7f6e44035040 comp rx=0 tx=0).ready entity=mgr.14730 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.452+0000 7f6e4a7fc640 1 -- 172.21.15.71:0/3832195264 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f6e50056ad0 con 0x7f6e540fc550 2024-09-10T10:06:11.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.631+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3832195264 --> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e5410ef60 con 0x7f6e4006dae0 2024-09-10T10:06:11.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.632+0000 7f6e4a7fc640 1 -- 172.21.15.71:0/3832195264 <== mgr.14730 v2:172.21.15.71:6800/3747026928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f6e5410ef60 con 0x7f6e4006dae0 2024-09-10T10:06:11.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.635+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3832195264 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f6e4006dae0 msgr2=0x7f6e4006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:11.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.635+0000 7f6e5bbd3640 1 --2- 172.21.15.71:0/3832195264 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f6e4006dae0 0x7f6e4006ff90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6e44007ac0 tx=0x7f6e44035040 comp rx=0 tx=0).stop 2024-09-10T10:06:11.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.635+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3832195264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e540fc550 msgr2=0x7f6e5410d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:11.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.635+0000 7f6e5bbd3640 1 --2- 172.21.15.71:0/3832195264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e540fc550 0x7f6e5410d0b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000eb70 tx=0x7f6e5000b040 comp rx=0 tx=0).stop 2024-09-10T10:06:11.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.635+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3832195264 shutdown_connections 2024-09-10T10:06:11.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.635+0000 7f6e5bbd3640 1 --2- 172.21.15.71:0/3832195264 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f6e4006dae0 0x7f6e4006ff90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.635+0000 7f6e5bbd3640 1 --2- 172.21.15.71:0/3832195264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e540fd820 0x7f6e5410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.635+0000 7f6e5bbd3640 1 --2- 172.21.15.71:0/3832195264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e540fc550 0x7f6e5410d0b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.635+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3832195264 >> 172.21.15.71:0/3832195264 conn(0x7f6e540f7d30 msgr2=0x7f6e540f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:11.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.635+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3832195264 shutdown_connections 2024-09-10T10:06:11.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.635+0000 7f6e5bbd3640 1 -- 172.21.15.71:0/3832195264 wait complete. 2024-09-10T10:06:11.637 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:11 smithi071 ceph-mon[27559]: pgmap v16: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-10T10:06:11.637 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:11 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:11.637 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:11 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:11.637 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:11 smithi071 ceph-mon[27559]: Standby manager daemon smithi107.qurtcs restarted 2024-09-10T10:06:11.637 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:11 smithi071 ceph-mon[27559]: Standby manager daemon smithi107.qurtcs started 2024-09-10T10:06:11.637 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:11 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/2604214596' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/crt"}]: dispatch 2024-09-10T10:06:11.638 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:11 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/2604214596' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:06:11.638 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:11 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/2604214596' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/key"}]: dispatch 2024-09-10T10:06:11.638 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:11 smithi071 ceph-mon[27559]: from='mgr.? 172.21.15.107:0/2604214596' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:06:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:06:11.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:11 smithi107 ceph-mon[34215]: pgmap v16: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-10T10:06:11.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:11 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:11.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:11 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:11.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:11 smithi107 ceph-mon[34215]: Standby manager daemon smithi107.qurtcs restarted 2024-09-10T10:06:11.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:11 smithi107 ceph-mon[34215]: Standby manager daemon smithi107.qurtcs started 2024-09-10T10:06:11.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:11 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/2604214596' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/crt"}]: dispatch 2024-09-10T10:06:11.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:11 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/2604214596' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:06:11.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:11 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/2604214596' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/key"}]: dispatch 2024-09-10T10:06:11.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:11 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/2604214596' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:06:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.714+0000 7f359e1e8640 1 -- 172.21.15.71:0/4091542288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fb430 msgr2=0x7f35980fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.714+0000 7f359e1e8640 1 --2- 172.21.15.71:0/4091542288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fb430 0x7f35980fb840 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f35880048d0 tx=0x7f3588009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.714+0000 7f359e1e8640 1 -- 172.21.15.71:0/4091542288 shutdown_connections 2024-09-10T10:06:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.714+0000 7f359e1e8640 1 --2- 172.21.15.71:0/4091542288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fc700 0x7f35980fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.714+0000 7f359e1e8640 1 --2- 172.21.15.71:0/4091542288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fb430 0x7f35980fb840 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.714+0000 7f359e1e8640 1 -- 172.21.15.71:0/4091542288 >> 172.21.15.71:0/4091542288 conn(0x7f35980f6c10 msgr2=0x7f35980f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.714+0000 7f359e1e8640 1 -- 172.21.15.71:0/4091542288 shutdown_connections 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.714+0000 7f359e1e8640 1 -- 172.21.15.71:0/4091542288 wait complete. 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.715+0000 7f359e1e8640 1 Processor -- start 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.715+0000 7f359e1e8640 1 -- start start 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.715+0000 7f359e1e8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fb430 0x7f359810d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.715+0000 7f359e1e8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fc700 0x7f359810d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.715+0000 7f359e1e8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359810e490 con 0x7f35980fb430 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.715+0000 7f359e1e8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359810e600 con 0x7f35980fc700 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.715+0000 7f35977fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fb430 0x7f359810d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.715+0000 7f35977fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fb430 0x7f359810d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39084/0 (socket says 172.21.15.71:39084) 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.715+0000 7f35977fe640 1 -- 172.21.15.71:0/1667353866 learned_addr learned my addr 172.21.15.71:0/1667353866 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.715+0000 7f358effd640 1 --2- 172.21.15.71:0/1667353866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fc700 0x7f359810d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:11.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.716+0000 7f35977fe640 1 -- 172.21.15.71:0/1667353866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fc700 msgr2=0x7f359810d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:11.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.716+0000 7f35977fe640 1 --2- 172.21.15.71:0/1667353866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fc700 0x7f359810d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.716+0000 7f35977fe640 1 -- 172.21.15.71:0/1667353866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3588005040 con 0x7f35980fb430 2024-09-10T10:06:11.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.716+0000 7f35977fe640 1 --2- 172.21.15.71:0/1667353866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fb430 0x7f359810d0e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3588003080 tx=0x7f3588009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:11.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.716+0000 7f3594ff9640 1 -- 172.21.15.71:0/1667353866 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3588038070 con 0x7f35980fb430 2024-09-10T10:06:11.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.716+0000 7f3594ff9640 1 -- 172.21.15.71:0/1667353866 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f358802abd0 con 0x7f35980fb430 2024-09-10T10:06:11.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.716+0000 7f359e1e8640 1 -- 172.21.15.71:0/1667353866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359810e880 con 0x7f35980fb430 2024-09-10T10:06:11.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.716+0000 7f3594ff9640 1 -- 172.21.15.71:0/1667353866 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f358803e670 con 0x7f35980fb430 2024-09-10T10:06:11.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.716+0000 7f359e1e8640 1 -- 172.21.15.71:0/1667353866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359810eda0 con 0x7f35980fb430 2024-09-10T10:06:11.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.717+0000 7f359e1e8640 1 -- 172.21.15.71:0/1667353866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35981046c0 con 0x7f35980fb430 2024-09-10T10:06:11.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.717+0000 7f3594ff9640 1 -- 172.21.15.71:0/1667353866 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 31) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f3588030020 con 0x7f35980fb430 2024-09-10T10:06:11.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.718+0000 7f3594ff9640 1 --2- 172.21.15.71:0/1667353866 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f358406dae0 0x7f358406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:11.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.718+0000 7f3594ff9640 1 -- 172.21.15.71:0/1667353866 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f35880ad730 con 0x7f35980fb430 2024-09-10T10:06:11.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.718+0000 7f358effd640 1 --2- 172.21.15.71:0/1667353866 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f358406dae0 0x7f358406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:11.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.718+0000 7f358effd640 1 --2- 172.21.15.71:0/1667353866 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f358406dae0 0x7f358406ff90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f359810ce90 tx=0x7f3580009120 comp rx=0 tx=0).ready entity=mgr.14730 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:11.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.722+0000 7f3594ff9640 1 -- 172.21.15.71:0/1667353866 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f3588077250 con 0x7f35980fb430 2024-09-10T10:06:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.900+0000 7f359e1e8640 1 -- 172.21.15.71:0/1667353866 --> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3598103eb0 con 0x7f358406dae0 2024-09-10T10:06:11.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.902+0000 7f3594ff9640 1 -- 172.21.15.71:0/1667353866 <== mgr.14730 v2:172.21.15.71:6800/3747026928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f3598103eb0 con 0x7f358406dae0 2024-09-10T10:06:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.903+0000 7f359e1e8640 1 -- 172.21.15.71:0/1667353866 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f358406dae0 msgr2=0x7f358406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.903+0000 7f359e1e8640 1 --2- 172.21.15.71:0/1667353866 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f358406dae0 0x7f358406ff90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f359810ce90 tx=0x7f3580009120 comp rx=0 tx=0).stop 2024-09-10T10:06:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.904+0000 7f359e1e8640 1 -- 172.21.15.71:0/1667353866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fb430 msgr2=0x7f359810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.904+0000 7f359e1e8640 1 --2- 172.21.15.71:0/1667353866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fb430 0x7f359810d0e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3588003080 tx=0x7f3588009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.904+0000 7f359e1e8640 1 -- 172.21.15.71:0/1667353866 shutdown_connections 2024-09-10T10:06:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.904+0000 7f359e1e8640 1 --2- 172.21.15.71:0/1667353866 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f358406dae0 0x7f358406ff90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.904+0000 7f359e1e8640 1 --2- 172.21.15.71:0/1667353866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35980fc700 0x7f359810d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.904+0000 7f359e1e8640 1 --2- 172.21.15.71:0/1667353866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35980fb430 0x7f359810d0e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.904+0000 7f359e1e8640 1 -- 172.21.15.71:0/1667353866 >> 172.21.15.71:0/1667353866 conn(0x7f35980f6c10 msgr2=0x7f35980656e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.904+0000 7f359e1e8640 1 -- 172.21.15.71:0/1667353866 shutdown_connections 2024-09-10T10:06:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.904+0000 7f359e1e8640 1 -- 172.21.15.71:0/1667353866 wait complete. 2024-09-10T10:06:11.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.981+0000 7f6fd0d51640 1 -- 172.21.15.71:0/1152326099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fcc0fb450 msgr2=0x7f6fcc0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:11.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.981+0000 7f6fd0d51640 1 --2- 172.21.15.71:0/1152326099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fcc0fb450 0x7f6fcc0fb860 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0048d0 tx=0x7f6fbc009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.981+0000 7f6fd0d51640 1 -- 172.21.15.71:0/1152326099 shutdown_connections 2024-09-10T10:06:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.981+0000 7f6fd0d51640 1 --2- 172.21.15.71:0/1152326099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fcc0fc720 0x7f6fcc0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.981+0000 7f6fd0d51640 1 --2- 172.21.15.71:0/1152326099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fcc0fb450 0x7f6fcc0fb860 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.981+0000 7f6fd0d51640 1 -- 172.21.15.71:0/1152326099 >> 172.21.15.71:0/1152326099 conn(0x7f6fcc0f6c10 msgr2=0x7f6fcc0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.981+0000 7f6fd0d51640 1 -- 172.21.15.71:0/1152326099 shutdown_connections 2024-09-10T10:06:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.981+0000 7f6fd0d51640 1 -- 172.21.15.71:0/1152326099 wait complete. 2024-09-10T10:06:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.981+0000 7f6fd0d51640 1 Processor -- start 2024-09-10T10:06:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.981+0000 7f6fd0d51640 1 -- start start 2024-09-10T10:06:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fd0d51640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fcc0fb450 0x7f6fcc10d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fd0d51640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fcc0fc720 0x7f6fcc10d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fd0d51640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc10e4e0 con 0x7f6fcc0fb450 2024-09-10T10:06:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fd0d51640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc10e650 con 0x7f6fcc0fc720 2024-09-10T10:06:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fca59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fcc0fb450 0x7f6fcc10d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fca59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fcc0fb450 0x7f6fcc10d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39106/0 (socket says 172.21.15.71:39106) 2024-09-10T10:06:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fca59c640 1 -- 172.21.15.71:0/3190670148 learned_addr learned my addr 172.21.15.71:0/3190670148 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fc9d9b640 1 --2- 172.21.15.71:0/3190670148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fcc0fc720 0x7f6fcc10d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fca59c640 1 -- 172.21.15.71:0/3190670148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fcc0fc720 msgr2=0x7f6fcc10d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fca59c640 1 --2- 172.21.15.71:0/3190670148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fcc0fc720 0x7f6fcc10d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fca59c640 1 -- 172.21.15.71:0/3190670148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc005040 con 0x7f6fcc0fb450 2024-09-10T10:06:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fca59c640 1 --2- 172.21.15.71:0/3190670148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fcc0fb450 0x7f6fcc10d130 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc003080 tx=0x7f6fbc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fc2ffd640 1 -- 172.21.15.71:0/3190670148 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fbc038070 con 0x7f6fcc0fb450 2024-09-10T10:06:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fc2ffd640 1 -- 172.21.15.71:0/3190670148 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6fbc02abd0 con 0x7f6fcc0fb450 2024-09-10T10:06:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fd0d51640 1 -- 172.21.15.71:0/3190670148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc10e8d0 con 0x7f6fcc0fb450 2024-09-10T10:06:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fc2ffd640 1 -- 172.21.15.71:0/3190670148 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fbc03e670 con 0x7f6fcc0fb450 2024-09-10T10:06:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.982+0000 7f6fd0d51640 1 -- 172.21.15.71:0/3190670148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc10edf0 con 0x7f6fcc0fb450 2024-09-10T10:06:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.983+0000 7f6fd0d51640 1 -- 172.21.15.71:0/3190670148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fcc1046e0 con 0x7f6fcc0fb450 2024-09-10T10:06:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.984+0000 7f6fc2ffd640 1 -- 172.21.15.71:0/3190670148 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 31) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f6fbc030020 con 0x7f6fcc0fb450 2024-09-10T10:06:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.984+0000 7f6fc2ffd640 1 --2- 172.21.15.71:0/3190670148 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f6fb806dae0 0x7f6fb806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.985+0000 7f6fc9d9b640 1 --2- 172.21.15.71:0/3190670148 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f6fb806dae0 0x7f6fb806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.985+0000 7f6fc2ffd640 1 -- 172.21.15.71:0/3190670148 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f6fbc0ad730 con 0x7f6fcc0fb450 2024-09-10T10:06:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.985+0000 7f6fc9d9b640 1 --2- 172.21.15.71:0/3190670148 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f6fb806dae0 0x7f6fb806ff90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc10cee0 tx=0x7f6fb4009120 comp rx=0 tx=0).ready entity=mgr.14730 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:11.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:11.989+0000 7f6fc2ffd640 1 -- 172.21.15.71:0/3190670148 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f6fbc077250 con 0x7f6fcc0fb450 2024-09-10T10:06:12.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.160+0000 7f6fd0d51640 1 -- 172.21.15.71:0/3190670148 --> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fcc103ed0 con 0x7f6fb806dae0 2024-09-10T10:06:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.170+0000 7f6fc2ffd640 1 -- 172.21.15.71:0/3190670148 <== mgr.14730 v2:172.21.15.71:6800/3747026928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6fcc103ed0 con 0x7f6fb806dae0 2024-09-10T10:06:12.171 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:06:12.171 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (85s) 1s ago 9m 17.1M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:06:12.171 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (10m) 1s ago 10m 6891k - 17.2.7-1597-g96d63e75 f3fc7d52e233 f70481a4c3c7 2024-09-10T10:06:12.171 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (9m) 3s ago 9m 6895k - 17.2.7-1597-g96d63e75 f3fc7d52e233 cf27ebcc0f98 2024-09-10T10:06:12.171 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (79s) 1s ago 9m 76.2M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:06:12.171 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (4m) 1s ago 4m 113M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:06:12.171 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (4m) 1s ago 4m 64.7M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:06:12.171 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (4m) 3s ago 4m 109M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:06:12.171 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (4m) 3s ago 4m 62.4M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:06:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (46s) 1s ago 11m 490M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:06:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (7s) 3s ago 9m 68.7M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:06:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (11m) 1s ago 11m 58.8M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 35e491e574a3 2024-09-10T10:06:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (9m) 3s ago 9m 43.5M 2048M 17.2.7-1597-g96d63e75 f3fc7d52e233 682e2b6e311f 2024-09-10T10:06:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (90s) 1s ago 10m 8228k - 1.5.0 0da6a335fe13 c3d47d79cd22 2024-09-10T10:06:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (53s) 3s ago 9m 8238k - 1.5.0 0da6a335fe13 9a25165a0fd1 2024-09-10T10:06:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (8m) 1s ago 8m 223M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 a79e69c9b514 2024-09-10T10:06:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (7m) 1s ago 7m 233M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 44a84bf577da 2024-09-10T10:06:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (7m) 1s ago 7m 195M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 4fae52756a24 2024-09-10T10:06:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (6m) 3s ago 6m 268M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:06:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (6m) 3s ago 6m 229M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:06:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (6m) 3s ago 6m 226M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:06:12.172 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (12s) 1s ago 9m 45.0M - 2.43.0 a07b618ecd1d 47d3ae62ce5e 2024-09-10T10:06:12.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.172+0000 7f6fd0d51640 1 -- 172.21.15.71:0/3190670148 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f6fb806dae0 msgr2=0x7f6fb806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:12.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.172+0000 7f6fd0d51640 1 --2- 172.21.15.71:0/3190670148 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f6fb806dae0 0x7f6fb806ff90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc10cee0 tx=0x7f6fb4009120 comp rx=0 tx=0).stop 2024-09-10T10:06:12.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.172+0000 7f6fd0d51640 1 -- 172.21.15.71:0/3190670148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fcc0fb450 msgr2=0x7f6fcc10d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:12.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.172+0000 7f6fd0d51640 1 --2- 172.21.15.71:0/3190670148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fcc0fb450 0x7f6fcc10d130 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc003080 tx=0x7f6fbc009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.172+0000 7f6fd0d51640 1 -- 172.21.15.71:0/3190670148 shutdown_connections 2024-09-10T10:06:12.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.172+0000 7f6fd0d51640 1 --2- 172.21.15.71:0/3190670148 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f6fb806dae0 0x7f6fb806ff90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.172+0000 7f6fd0d51640 1 --2- 172.21.15.71:0/3190670148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fcc0fc720 0x7f6fcc10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.172+0000 7f6fd0d51640 1 --2- 172.21.15.71:0/3190670148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fcc0fb450 0x7f6fcc10d130 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.172+0000 7f6fd0d51640 1 -- 172.21.15.71:0/3190670148 >> 172.21.15.71:0/3190670148 conn(0x7f6fcc0f6c10 msgr2=0x7f6fcc066140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:12.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.172+0000 7f6fd0d51640 1 -- 172.21.15.71:0/3190670148 shutdown_connections 2024-09-10T10:06:12.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.172+0000 7f6fd0d51640 1 -- 172.21.15.71:0/3190670148 wait complete. 2024-09-10T10:06:12.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.259+0000 7fe04cfba640 1 -- 172.21.15.71:0/2477885435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0480fb450 msgr2=0x7fe0480fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:12.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.259+0000 7fe04cfba640 1 --2- 172.21.15.71:0/2477885435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0480fb450 0x7fe0480fb860 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe040009c50 tx=0x7fe040004d10 comp rx=0 tx=0).stop 2024-09-10T10:06:12.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.259+0000 7fe04cfba640 1 -- 172.21.15.71:0/2477885435 shutdown_connections 2024-09-10T10:06:12.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.259+0000 7fe04cfba640 1 --2- 172.21.15.71:0/2477885435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0480fc720 0x7fe0480fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.259+0000 7fe04cfba640 1 --2- 172.21.15.71:0/2477885435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0480fb450 0x7fe0480fb860 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.259+0000 7fe04cfba640 1 -- 172.21.15.71:0/2477885435 >> 172.21.15.71:0/2477885435 conn(0x7fe0480f6c10 msgr2=0x7fe0480f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:12.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.259+0000 7fe04cfba640 1 -- 172.21.15.71:0/2477885435 shutdown_connections 2024-09-10T10:06:12.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.259+0000 7fe04cfba640 1 -- 172.21.15.71:0/2477885435 wait complete. 2024-09-10T10:06:12.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.259+0000 7fe04cfba640 1 Processor -- start 2024-09-10T10:06:12.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.259+0000 7fe04cfba640 1 -- start start 2024-09-10T10:06:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe04cfba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0480fb450 0x7fe04810fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe04cfba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0480fc720 0x7fe048112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe04cfba640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe048066790 con 0x7fe0480fb450 2024-09-10T10:06:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe04cfba640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe048066900 con 0x7fe0480fc720 2024-09-10T10:06:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe04659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0480fb450 0x7fe04810fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe04659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0480fb450 0x7fe04810fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39118/0 (socket says 172.21.15.71:39118) 2024-09-10T10:06:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe04659c640 1 -- 172.21.15.71:0/1926465827 learned_addr learned my addr 172.21.15.71:0/1926465827 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe045d9b640 1 --2- 172.21.15.71:0/1926465827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0480fc720 0x7fe048112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe04659c640 1 -- 172.21.15.71:0/1926465827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0480fc720 msgr2=0x7fe048112330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe04659c640 1 --2- 172.21.15.71:0/1926465827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0480fc720 0x7fe048112330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe04659c640 1 -- 172.21.15.71:0/1926465827 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0400098b0 con 0x7fe0480fb450 2024-09-10T10:06:12.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe04659c640 1 --2- 172.21.15.71:0/1926465827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0480fb450 0x7fe04810fde0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe040004750 tx=0x7fe040004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:12.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe03effd640 1 -- 172.21.15.71:0/1926465827 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe040009710 con 0x7fe0480fb450 2024-09-10T10:06:12.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe03effd640 1 -- 172.21.15.71:0/1926465827 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe040032b10 con 0x7fe0480fb450 2024-09-10T10:06:12.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.260+0000 7fe04cfba640 1 -- 172.21.15.71:0/1926465827 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0481128d0 con 0x7fe0480fb450 2024-09-10T10:06:12.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.261+0000 7fe03effd640 1 -- 172.21.15.71:0/1926465827 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe04003daa0 con 0x7fe0480fb450 2024-09-10T10:06:12.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.261+0000 7fe04cfba640 1 -- 172.21.15.71:0/1926465827 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe048112e40 con 0x7fe0480fb450 2024-09-10T10:06:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.262+0000 7fe04cfba640 1 -- 172.21.15.71:0/1926465827 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0480fa8b0 con 0x7fe0480fb450 2024-09-10T10:06:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.262+0000 7fe03effd640 1 -- 172.21.15.71:0/1926465827 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 31) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fe04002f030 con 0x7fe0480fb450 2024-09-10T10:06:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.263+0000 7fe03effd640 1 --2- 172.21.15.71:0/1926465827 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7fe03406dae0 0x7fe03406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.263+0000 7fe03effd640 1 -- 172.21.15.71:0/1926465827 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fe0400aeaf0 con 0x7fe0480fb450 2024-09-10T10:06:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.263+0000 7fe045d9b640 1 --2- 172.21.15.71:0/1926465827 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7fe03406dae0 0x7fe03406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.263+0000 7fe045d9b640 1 --2- 172.21.15.71:0/1926465827 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7fe03406dae0 0x7fe03406ff90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe030004ed0 tx=0x7fe03000b040 comp rx=0 tx=0).ready entity=mgr.14730 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.267+0000 7fe03effd640 1 -- 172.21.15.71:0/1926465827 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe040078510 con 0x7fe0480fb450 2024-09-10T10:06:12.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.525+0000 7fe04cfba640 1 -- 172.21.15.71:0/1926465827 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe0481130d0 con 0x7fe0480fb450 2024-09-10T10:06:12.526 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: mgrmap e31: smithi071.gtqytr(active, since 27s), standbys: smithi107.qurtcs 2024-09-10T10:06:12.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:12.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:12.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:12.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:12.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:12.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:12.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:06:12.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:12.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi071.gtqytr"}]: dispatch 2024-09-10T10:06:12.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi071.gtqytr"}]': finished 2024-09-10T10:06:12.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi107.qurtcs"}]: dispatch 2024-09-10T10:06:12.527 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi107.qurtcs"}]': finished 2024-09-10T10:06:12.528 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:12 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T10:06:12.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.525+0000 7fe03effd640 1 -- 172.21.15.71:0/1926465827 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fe04007bbd0 con 0x7fe0480fb450 2024-09-10T10:06:12.528 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:06:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:06:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2 2024-09-10T10:06:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:06:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:06:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:06:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:06:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:06:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 6 2024-09-10T10:06:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:06:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:06:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:06:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:06:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:06:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 12, 2024-09-10T10:06:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:06:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:06:12.529 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:06:12.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.528+0000 7fe04cfba640 1 -- 172.21.15.71:0/1926465827 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7fe03406dae0 msgr2=0x7fe03406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:12.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.528+0000 7fe04cfba640 1 --2- 172.21.15.71:0/1926465827 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7fe03406dae0 0x7fe03406ff90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe030004ed0 tx=0x7fe03000b040 comp rx=0 tx=0).stop 2024-09-10T10:06:12.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.528+0000 7fe04cfba640 1 -- 172.21.15.71:0/1926465827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0480fb450 msgr2=0x7fe04810fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:12.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.528+0000 7fe04cfba640 1 --2- 172.21.15.71:0/1926465827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0480fb450 0x7fe04810fde0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe040004750 tx=0x7fe040004d10 comp rx=0 tx=0).stop 2024-09-10T10:06:12.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.528+0000 7fe04cfba640 1 -- 172.21.15.71:0/1926465827 shutdown_connections 2024-09-10T10:06:12.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.528+0000 7fe04cfba640 1 --2- 172.21.15.71:0/1926465827 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7fe03406dae0 0x7fe03406ff90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.528+0000 7fe04cfba640 1 --2- 172.21.15.71:0/1926465827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0480fc720 0x7fe048112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.528+0000 7fe04cfba640 1 --2- 172.21.15.71:0/1926465827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0480fb450 0x7fe04810fde0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.528+0000 7fe04cfba640 1 -- 172.21.15.71:0/1926465827 >> 172.21.15.71:0/1926465827 conn(0x7fe0480f6c10 msgr2=0x7fe0480f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:12.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.528+0000 7fe04cfba640 1 -- 172.21.15.71:0/1926465827 shutdown_connections 2024-09-10T10:06:12.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.528+0000 7fe04cfba640 1 -- 172.21.15.71:0/1926465827 wait complete. 2024-09-10T10:06:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.612+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/1318245267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2eb40fc520 msgr2=0x7f2eb40fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.612+0000 7f2eb8fbf640 1 --2- 172.21.15.71:0/1318245267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2eb40fc520 0x7f2eb40fc930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40048d0 tx=0x7f2ea4009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.612+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/1318245267 shutdown_connections 2024-09-10T10:06:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.612+0000 7f2eb8fbf640 1 --2- 172.21.15.71:0/1318245267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40fd7f0 0x7f2eb40fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.612+0000 7f2eb8fbf640 1 --2- 172.21.15.71:0/1318245267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2eb40fc520 0x7f2eb40fc930 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.612+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/1318245267 >> 172.21.15.71:0/1318245267 conn(0x7f2eb40f7ce0 msgr2=0x7f2eb40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.612+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/1318245267 shutdown_connections 2024-09-10T10:06:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.612+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/1318245267 wait complete. 2024-09-10T10:06:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.613+0000 7f2eb8fbf640 1 Processor -- start 2024-09-10T10:06:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.613+0000 7f2eb8fbf640 1 -- start start 2024-09-10T10:06:12.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.613+0000 7f2eb8fbf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2eb40fc520 0x7f2eb410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:12.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.613+0000 7f2eb8fbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40fd7f0 0x7f2eb410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:12.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.613+0000 7f2eb8fbf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb410dc10 con 0x7f2eb40fc520 2024-09-10T10:06:12.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.613+0000 7f2eb8fbf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb410e430 con 0x7f2eb40fd7f0 2024-09-10T10:06:12.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.613+0000 7f2eb259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2eb40fc520 0x7f2eb410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:12.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.613+0000 7f2eb259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2eb40fc520 0x7f2eb410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39130/0 (socket says 172.21.15.71:39130) 2024-09-10T10:06:12.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.613+0000 7f2eb259c640 1 -- 172.21.15.71:0/793565581 learned_addr learned my addr 172.21.15.71:0/793565581 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:12.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.614+0000 7f2eb1d9b640 1 --2- 172.21.15.71:0/793565581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40fd7f0 0x7f2eb410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:12.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.614+0000 7f2eb259c640 1 -- 172.21.15.71:0/793565581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40fd7f0 msgr2=0x7f2eb410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:12.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.614+0000 7f2eb259c640 1 --2- 172.21.15.71:0/793565581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40fd7f0 0x7f2eb410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.614+0000 7f2eb259c640 1 -- 172.21.15.71:0/793565581 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea4005040 con 0x7f2eb40fc520 2024-09-10T10:06:12.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.614+0000 7f2eb1d9b640 1 --2- 172.21.15.71:0/793565581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40fd7f0 0x7f2eb410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:06:12.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.614+0000 7f2eb259c640 1 --2- 172.21.15.71:0/793565581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2eb40fc520 0x7f2eb410d080 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4003080 tx=0x7f2ea4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:12.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.614+0000 7f2ea2ffd640 1 -- 172.21.15.71:0/793565581 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ea4038070 con 0x7f2eb40fc520 2024-09-10T10:06:12.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.614+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/793565581 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb410e660 con 0x7f2eb40fc520 2024-09-10T10:06:12.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.614+0000 7f2ea2ffd640 1 -- 172.21.15.71:0/793565581 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2ea402abd0 con 0x7f2eb40fc520 2024-09-10T10:06:12.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.614+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/793565581 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb410ec00 con 0x7f2eb40fc520 2024-09-10T10:06:12.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.615+0000 7f2ea2ffd640 1 -- 172.21.15.71:0/793565581 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ea403e670 con 0x7f2eb40fc520 2024-09-10T10:06:12.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.615+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/793565581 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb40fb980 con 0x7f2eb40fc520 2024-09-10T10:06:12.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.617+0000 7f2ea2ffd640 1 -- 172.21.15.71:0/793565581 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 31) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f2ea4030020 con 0x7f2eb40fc520 2024-09-10T10:06:12.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.617+0000 7f2ea2ffd640 1 --2- 172.21.15.71:0/793565581 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f2e9c06dae0 0x7f2e9c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:12.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.618+0000 7f2ea2ffd640 1 -- 172.21.15.71:0/793565581 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f2ea40ad870 con 0x7f2eb40fc520 2024-09-10T10:06:12.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.618+0000 7f2eb1d9b640 1 --2- 172.21.15.71:0/793565581 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f2e9c06dae0 0x7f2e9c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:12.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.618+0000 7f2eb1d9b640 1 --2- 172.21.15.71:0/793565581 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f2e9c06dae0 0x7f2e9c06ff90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2eb410ce30 tx=0x7f2ea8009040 comp rx=0 tx=0).ready entity=mgr.14730 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:12.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.622+0000 7f2ea2ffd640 1 -- 172.21.15.71:0/793565581 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f2ea4077410 con 0x7f2eb40fc520 2024-09-10T10:06:12.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: mgrmap e31: smithi071.gtqytr(active, since 27s), standbys: smithi107.qurtcs 2024-09-10T10:06:12.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:12.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:12.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:12.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:12.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:12.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:12.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:06:12.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:12.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi071.gtqytr"}]: dispatch 2024-09-10T10:06:12.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi071.gtqytr"}]': finished 2024-09-10T10:06:12.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi107.qurtcs"}]: dispatch 2024-09-10T10:06:12.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi107.qurtcs"}]': finished 2024-09-10T10:06:12.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:12 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T10:06:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.837+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/793565581 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2eb4104f20 con 0x7f2eb40fc520 2024-09-10T10:06:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.838+0000 7f2ea2ffd640 1 -- 172.21.15.71:0/793565581 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1866 (secure 0 0 0) 0x7f2ea407aad0 con 0x7f2eb40fc520 2024-09-10T10:06:12.839 INFO:teuthology.orchestra.run.smithi071.stdout:e22 2024-09-10T10:06:12.840 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:06:12.840 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:06:12.840 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:06:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:06:12.840 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:06:12.840 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:06:12.840 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 22 2024-09-10T10:06:12.840 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:06:12.840 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:06:12.840 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:04:19.815073+0000 2024-09-10T10:06:12.840 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:06:12.840 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:06:12.841 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:06:12.841 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:06:12.841 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:06:12.841 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:06:12.841 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:06:12.841 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:06:12.841 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:06:12.841 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:06:12.841 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:06:12.841 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:06:12.841 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:06:12.841 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:06:12.842 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:06:12.842 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:06:12.842 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:06:12.842 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:06:12.842 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:06:12.842 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:06:12.842 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:12.842 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:12.842 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:12.842 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:06:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:06:12.843 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 22 2024-09-10T10:06:12.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.840+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/793565581 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f2e9c06dae0 msgr2=0x7f2e9c06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:12.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.840+0000 7f2eb8fbf640 1 --2- 172.21.15.71:0/793565581 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f2e9c06dae0 0x7f2e9c06ff90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2eb410ce30 tx=0x7f2ea8009040 comp rx=0 tx=0).stop 2024-09-10T10:06:12.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.840+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/793565581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2eb40fc520 msgr2=0x7f2eb410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:12.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.840+0000 7f2eb8fbf640 1 --2- 172.21.15.71:0/793565581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2eb40fc520 0x7f2eb410d080 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4003080 tx=0x7f2ea4009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.840+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/793565581 shutdown_connections 2024-09-10T10:06:12.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.840+0000 7f2eb8fbf640 1 --2- 172.21.15.71:0/793565581 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7f2e9c06dae0 0x7f2e9c06ff90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.840+0000 7f2eb8fbf640 1 --2- 172.21.15.71:0/793565581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2eb40fd7f0 0x7f2eb410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.840+0000 7f2eb8fbf640 1 --2- 172.21.15.71:0/793565581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2eb40fc520 0x7f2eb410d080 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.840+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/793565581 >> 172.21.15.71:0/793565581 conn(0x7f2eb40f7ce0 msgr2=0x7f2eb40f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:12.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.840+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/793565581 shutdown_connections 2024-09-10T10:06:12.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.840+0000 7f2eb8fbf640 1 -- 172.21.15.71:0/793565581 wait complete. 2024-09-10T10:06:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.921+0000 7efcdff64640 1 -- 172.21.15.71:0/3173187198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd80fdbb0 msgr2=0x7efcd80fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.921+0000 7efcdff64640 1 --2- 172.21.15.71:0/3173187198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd80fdbb0 0x7efcd80fdfc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efcd00048d0 tx=0x7efcd0009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.921+0000 7efcdff64640 1 -- 172.21.15.71:0/3173187198 shutdown_connections 2024-09-10T10:06:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.921+0000 7efcdff64640 1 --2- 172.21.15.71:0/3173187198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcd80fe500 0x7efcd80fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.921+0000 7efcdff64640 1 --2- 172.21.15.71:0/3173187198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd80fdbb0 0x7efcd80fdfc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.921+0000 7efcdff64640 1 -- 172.21.15.71:0/3173187198 >> 172.21.15.71:0/3173187198 conn(0x7efcd80f63b0 msgr2=0x7efcd80f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.921+0000 7efcdff64640 1 -- 172.21.15.71:0/3173187198 shutdown_connections 2024-09-10T10:06:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.921+0000 7efcdff64640 1 -- 172.21.15.71:0/3173187198 wait complete. 2024-09-10T10:06:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.921+0000 7efcdff64640 1 Processor -- start 2024-09-10T10:06:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcdff64640 1 -- start start 2024-09-10T10:06:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcdff64640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd80fdbb0 0x7efcd80fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcdff64640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcd80fe500 0x7efcd80fb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcdff64640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80fbe20 con 0x7efcd80fdbb0 2024-09-10T10:06:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcdff64640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80fbf60 con 0x7efcd80fe500 2024-09-10T10:06:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcddd00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd80fdbb0 0x7efcd80fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcddd00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd80fdbb0 0x7efcd80fd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39138/0 (socket says 172.21.15.71:39138) 2024-09-10T10:06:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcddd00640 1 -- 172.21.15.71:0/1280571911 learned_addr learned my addr 172.21.15.71:0/1280571911 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcdd4ff640 1 --2- 172.21.15.71:0/1280571911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcd80fe500 0x7efcd80fb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcddd00640 1 -- 172.21.15.71:0/1280571911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcd80fe500 msgr2=0x7efcd80fb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcddd00640 1 --2- 172.21.15.71:0/1280571911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcd80fe500 0x7efcd80fb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcddd00640 1 -- 172.21.15.71:0/1280571911 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd0005040 con 0x7efcd80fdbb0 2024-09-10T10:06:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcddd00640 1 --2- 172.21.15.71:0/1280571911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd80fdbb0 0x7efcd80fd3a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efcd00043d0 tx=0x7efcd0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcd67fc640 1 -- 172.21.15.71:0/1280571911 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcd0038070 con 0x7efcd80fdbb0 2024-09-10T10:06:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcd67fc640 1 -- 172.21.15.71:0/1280571911 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efcd002ae90 con 0x7efcd80fdbb0 2024-09-10T10:06:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.922+0000 7efcdff64640 1 -- 172.21.15.71:0/1280571911 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd80fc1e0 con 0x7efcd80fdbb0 2024-09-10T10:06:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.923+0000 7efcd67fc640 1 -- 172.21.15.71:0/1280571911 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcd003e670 con 0x7efcd80fdbb0 2024-09-10T10:06:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.923+0000 7efcdff64640 1 -- 172.21.15.71:0/1280571911 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd81150f0 con 0x7efcd80fdbb0 2024-09-10T10:06:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.923+0000 7efcdff64640 1 -- 172.21.15.71:0/1280571911 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd804b720 con 0x7efcd80fdbb0 2024-09-10T10:06:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.924+0000 7efcd67fc640 1 -- 172.21.15.71:0/1280571911 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 31) v1 ==== 92027+0+0 (secure 0 0 0) 0x7efcd0030020 con 0x7efcd80fdbb0 2024-09-10T10:06:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.924+0000 7efcd67fc640 1 --2- 172.21.15.71:0/1280571911 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7efcc006dae0 0x7efcc006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.925+0000 7efcd67fc640 1 -- 172.21.15.71:0/1280571911 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7efcd00ad4b0 con 0x7efcd80fdbb0 2024-09-10T10:06:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.925+0000 7efcdd4ff640 1 --2- 172.21.15.71:0/1280571911 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7efcc006dae0 0x7efcc006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.925+0000 7efcdd4ff640 1 --2- 172.21.15.71:0/1280571911 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7efcc006dae0 0x7efcc006ff90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efccc004fd0 tx=0x7efccc009040 comp rx=0 tx=0).ready entity=mgr.14730 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:12.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:12.929+0000 7efcd67fc640 1 -- 172.21.15.71:0/1280571911 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7efcd0077050 con 0x7efcd80fdbb0 2024-09-10T10:06:13.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.117+0000 7efcdff64640 1 -- 172.21.15.71:0/1280571911 --> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efcd80fc370 con 0x7efcc006dae0 2024-09-10T10:06:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.118+0000 7efcd67fc640 1 -- 172.21.15.71:0/1280571911 <== mgr.14730 v2:172.21.15.71:6800/3747026928 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7efcd80fc370 con 0x7efcc006dae0 2024-09-10T10:06:13.119 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:06:13.120 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:06:13.120 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:06:13.120 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:06:13.120 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:06:13.120 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr" 2024-09-10T10:06:13.120 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:06:13.120 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "2/21 daemons upgraded", 2024-09-10T10:06:13.120 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mon daemons", 2024-09-10T10:06:13.120 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:06:13.120 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:06:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.120+0000 7efcdff64640 1 -- 172.21.15.71:0/1280571911 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7efcc006dae0 msgr2=0x7efcc006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.120+0000 7efcdff64640 1 --2- 172.21.15.71:0/1280571911 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7efcc006dae0 0x7efcc006ff90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efccc004fd0 tx=0x7efccc009040 comp rx=0 tx=0).stop 2024-09-10T10:06:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.120+0000 7efcdff64640 1 -- 172.21.15.71:0/1280571911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd80fdbb0 msgr2=0x7efcd80fd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.120+0000 7efcdff64640 1 --2- 172.21.15.71:0/1280571911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd80fdbb0 0x7efcd80fd3a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efcd00043d0 tx=0x7efcd0009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.120+0000 7efcdff64640 1 -- 172.21.15.71:0/1280571911 shutdown_connections 2024-09-10T10:06:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.120+0000 7efcdff64640 1 --2- 172.21.15.71:0/1280571911 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7efcc006dae0 0x7efcc006ff90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.120+0000 7efcdff64640 1 --2- 172.21.15.71:0/1280571911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcd80fe500 0x7efcd80fb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.120+0000 7efcdff64640 1 --2- 172.21.15.71:0/1280571911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcd80fdbb0 0x7efcd80fd3a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.120+0000 7efcdff64640 1 -- 172.21.15.71:0/1280571911 >> 172.21.15.71:0/1280571911 conn(0x7efcd80f63b0 msgr2=0x7efcd80f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.121+0000 7efcdff64640 1 -- 172.21.15.71:0/1280571911 shutdown_connections 2024-09-10T10:06:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.121+0000 7efcdff64640 1 -- 172.21.15.71:0/1280571911 wait complete. 2024-09-10T10:06:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.198+0000 7fc2f4543640 1 -- 172.21.15.71:0/1649450339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0fc700 msgr2=0x7fc2ec0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.198+0000 7fc2f4543640 1 --2- 172.21.15.71:0/1649450339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0fc700 0x7fc2ec0fcb70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0048d0 tx=0x7fc2dc009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.198+0000 7fc2f4543640 1 -- 172.21.15.71:0/1649450339 shutdown_connections 2024-09-10T10:06:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.198+0000 7fc2f4543640 1 --2- 172.21.15.71:0/1649450339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0fc700 0x7fc2ec0fcb70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.198+0000 7fc2f4543640 1 --2- 172.21.15.71:0/1649450339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2ec0fb430 0x7fc2ec0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.198+0000 7fc2f4543640 1 -- 172.21.15.71:0/1649450339 >> 172.21.15.71:0/1649450339 conn(0x7fc2ec0f6c10 msgr2=0x7fc2ec0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:13.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.198+0000 7fc2f4543640 1 -- 172.21.15.71:0/1649450339 shutdown_connections 2024-09-10T10:06:13.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.198+0000 7fc2f4543640 1 -- 172.21.15.71:0/1649450339 wait complete. 2024-09-10T10:06:13.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.199+0000 7fc2f4543640 1 Processor -- start 2024-09-10T10:06:13.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.199+0000 7fc2f4543640 1 -- start start 2024-09-10T10:06:13.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.199+0000 7fc2f4543640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2ec0fb430 0x7fc2ec10bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:13.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.199+0000 7fc2f4543640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0fc700 0x7fc2ec10c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:13.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.199+0000 7fc2f4543640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec10cb10 con 0x7fc2ec0fc700 2024-09-10T10:06:13.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.199+0000 7fc2f4543640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec10d330 con 0x7fc2ec0fb430 2024-09-10T10:06:13.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.199+0000 7fc2f1ade640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0fc700 0x7fc2ec10c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:13.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.199+0000 7fc2f1ade640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0fc700 0x7fc2ec10c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39166/0 (socket says 172.21.15.71:39166) 2024-09-10T10:06:13.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.199+0000 7fc2f1ade640 1 -- 172.21.15.71:0/571933462 learned_addr learned my addr 172.21.15.71:0/571933462 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:13.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.199+0000 7fc2f22df640 1 --2- 172.21.15.71:0/571933462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2ec0fb430 0x7fc2ec10bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.200+0000 7fc2f1ade640 1 -- 172.21.15.71:0/571933462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2ec0fb430 msgr2=0x7fc2ec10bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.200+0000 7fc2f1ade640 1 --2- 172.21.15.71:0/571933462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2ec0fb430 0x7fc2ec10bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.200+0000 7fc2f1ade640 1 -- 172.21.15.71:0/571933462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc005040 con 0x7fc2ec0fc700 2024-09-10T10:06:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.200+0000 7fc2f1ade640 1 --2- 172.21.15.71:0/571933462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0fc700 0x7fc2ec10c4c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0048a0 tx=0x7fc2dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.200+0000 7fc2e2ffd640 1 -- 172.21.15.71:0/571933462 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2dc03a070 con 0x7fc2ec0fc700 2024-09-10T10:06:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.200+0000 7fc2e2ffd640 1 -- 172.21.15.71:0/571933462 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc2dc0338c0 con 0x7fc2ec0fc700 2024-09-10T10:06:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.200+0000 7fc2e2ffd640 1 -- 172.21.15.71:0/571933462 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2dc03e930 con 0x7fc2ec0fc700 2024-09-10T10:06:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.200+0000 7fc2f4543640 1 -- 172.21.15.71:0/571933462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec10d560 con 0x7fc2ec0fc700 2024-09-10T10:06:13.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.200+0000 7fc2f4543640 1 -- 172.21.15.71:0/571933462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec10daa0 con 0x7fc2ec0fc700 2024-09-10T10:06:13.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.201+0000 7fc2f4543640 1 -- 172.21.15.71:0/571933462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec0fa890 con 0x7fc2ec0fc700 2024-09-10T10:06:13.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.201+0000 7fc2e2ffd640 1 -- 172.21.15.71:0/571933462 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 31) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fc2dc030020 con 0x7fc2ec0fc700 2024-09-10T10:06:13.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.202+0000 7fc2e2ffd640 1 --2- 172.21.15.71:0/571933462 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7fc2d806dae0 0x7fc2d806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:13.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.202+0000 7fc2e2ffd640 1 -- 172.21.15.71:0/571933462 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fc2dc0af390 con 0x7fc2ec0fc700 2024-09-10T10:06:13.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.202+0000 7fc2f22df640 1 --2- 172.21.15.71:0/571933462 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7fc2d806dae0 0x7fc2d806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:13.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.202+0000 7fc2f22df640 1 --2- 172.21.15.71:0/571933462 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7fc2d806dae0 0x7fc2d806ff90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8004ed0 tx=0x7fc2e800b040 comp rx=0 tx=0).ready entity=mgr.14730 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:13.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.206+0000 7fc2e2ffd640 1 -- 172.21.15.71:0/571933462 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fc2dc078ed0 con 0x7fc2ec0fc700 2024-09-10T10:06:13.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.440+0000 7fc2f4543640 1 -- 172.21.15.71:0/571933462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc2ec103e50 con 0x7fc2ec0fc700 2024-09-10T10:06:13.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.440+0000 7fc2e2ffd640 1 -- 172.21.15.71:0/571933462 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc2dc07c590 con 0x7fc2ec0fc700 2024-09-10T10:06:13.442 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:06:13.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.443+0000 7fc2f4543640 1 -- 172.21.15.71:0/571933462 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7fc2d806dae0 msgr2=0x7fc2d806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:13.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.443+0000 7fc2f4543640 1 --2- 172.21.15.71:0/571933462 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7fc2d806dae0 0x7fc2d806ff90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8004ed0 tx=0x7fc2e800b040 comp rx=0 tx=0).stop 2024-09-10T10:06:13.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.443+0000 7fc2f4543640 1 -- 172.21.15.71:0/571933462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0fc700 msgr2=0x7fc2ec10c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:13.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.443+0000 7fc2f4543640 1 --2- 172.21.15.71:0/571933462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0fc700 0x7fc2ec10c4c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0048a0 tx=0x7fc2dc009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:13.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.443+0000 7fc2f4543640 1 -- 172.21.15.71:0/571933462 shutdown_connections 2024-09-10T10:06:13.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.443+0000 7fc2f4543640 1 --2- 172.21.15.71:0/571933462 >> [v2:172.21.15.71:6800/3747026928,v1:172.21.15.71:6801/3747026928] conn(0x7fc2d806dae0 0x7fc2d806ff90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:13.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.443+0000 7fc2f4543640 1 --2- 172.21.15.71:0/571933462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0fc700 0x7fc2ec10c4c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:13.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.443+0000 7fc2f4543640 1 --2- 172.21.15.71:0/571933462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc2ec0fb430 0x7fc2ec10bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:13.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.443+0000 7fc2f4543640 1 -- 172.21.15.71:0/571933462 >> 172.21.15.71:0/571933462 conn(0x7fc2ec0f6c10 msgr2=0x7fc2ec0f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:13.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.443+0000 7fc2f4543640 1 -- 172.21.15.71:0/571933462 shutdown_connections 2024-09-10T10:06:13.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:13.443+0000 7fc2f4543640 1 -- 172.21.15.71:0/571933462 wait complete. 2024-09-10T10:06:13.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:13 smithi071 ceph-mon[27559]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:13.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:13 smithi071 ceph-mon[27559]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:13.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:13 smithi071 ceph-mon[27559]: pgmap v17: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:06:13.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:13 smithi071 ceph-mon[27559]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:13.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:13 smithi071 ceph-mon[27559]: Upgrade: Setting container_image for all mgr 2024-09-10T10:06:13.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:13 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/1926465827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:06:13.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:13 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/793565581' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:06:13.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:13 smithi107 ceph-mon[34215]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:13.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:13 smithi107 ceph-mon[34215]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:13.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:13 smithi107 ceph-mon[34215]: pgmap v17: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:06:13.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:13 smithi107 ceph-mon[34215]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:13.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:13 smithi107 ceph-mon[34215]: Upgrade: Setting container_image for all mgr 2024-09-10T10:06:13.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:13 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/1926465827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:06:13.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:13 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/793565581' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:06:14.578 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:14 smithi071 ceph-mon[27559]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:14.578 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:14 smithi071 ceph-mon[27559]: from='client.? 172.21.15.71:0/571933462' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:06:14.578 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:14 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:14.578 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:14 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:06:14.578 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:14 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:06:14.578 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:14 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:14.578 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:14 smithi071 ceph-mon[27559]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:06:14.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:14 smithi107 ceph-mon[34215]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:14.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:14 smithi107 ceph-mon[34215]: from='client.? 172.21.15.71:0/571933462' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:06:14.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:14 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:14.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:14 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:06:14.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:14 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:06:14.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:14 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:14.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:14 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:06:15.682 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:15 smithi071 ceph-mon[27559]: Upgrade: Updating mon.smithi071 2024-09-10T10:06:15.682 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:15 smithi071 ceph-mon[27559]: Deploying daemon mon.smithi071 on smithi071 2024-09-10T10:06:15.682 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:15 smithi071 ceph-mon[27559]: pgmap v18: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:15.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:15 smithi107 ceph-mon[34215]: Upgrade: Updating mon.smithi071 2024-09-10T10:06:15.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:15 smithi107 ceph-mon[34215]: Deploying daemon mon.smithi071 on smithi071 2024-09-10T10:06:15.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:15 smithi107 ceph-mon[34215]: pgmap v18: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:16.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:15 smithi071 systemd[1]: Stopping Ceph mon.smithi071 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:06:16.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:16 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071[27555]: 2024-09-10T10:06:16.127+0000 7f616ec9a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi071 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:06:16.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:16 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071[27555]: 2024-09-10T10:06:16.127+0000 7f616ec9a640 -1 mon.smithi071@0(leader) e2 *** Got Signal Terminated *** 2024-09-10T10:06:16.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:16 smithi071 podman[90599]: 2024-09-10 10:06:16.332155006 +0000 UTC m=+0.310792578 container died 35e491e574a399a496726a9d61a0ae04f41c6851e874590c8f4dfef27d1e38e6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=quincy-96d63e7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T10:06:17.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:16 smithi071 podman[90599]: 2024-09-10 10:06:16.786729889 +0000 UTC m=+0.765367502 container cleanup 35e491e574a399a496726a9d61a0ae04f41c6851e874590c8f4dfef27d1e38e6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=quincy-96d63e7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T10:06:17.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:16 smithi071 bash[90599]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071 2024-09-10T10:06:17.423 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 podman[90623]: 2024-09-10 10:06:17.054732469 +0000 UTC m=+0.722844774 container remove 35e491e574a399a496726a9d61a0ae04f41c6851e874590c8f4dfef27d1e38e6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=quincy-96d63e7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:06:17.423 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi071.service: Deactivated successfully. 2024-09-10T10:06:17.423 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 systemd[1]: Stopped Ceph mon.smithi071 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:06:17.423 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi071.service: Consumed 10.403s CPU time. 2024-09-10T10:06:17.731 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 systemd[1]: Starting Ceph mon.smithi071 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:06:17.731 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 podman[90754]: 2024-09-10 10:06:17.534204065 +0000 UTC m=+0.015776874 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:06:17.731 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 podman[90754]: 2024-09-10 10:06:17.639004995 +0000 UTC m=+0.120577798 container create 97acff91c24f4b98c57570c1fead91cc7d7de9255b4c7cae256efcd21d150f37 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:06:18.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 podman[90754]: 2024-09-10 10:06:17.875065107 +0000 UTC m=+0.356637923 container init 97acff91c24f4b98c57570c1fead91cc7d7de9255b4c7cae256efcd21d150f37 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:06:18.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 podman[90754]: 2024-09-10 10:06:17.878582898 +0000 UTC m=+0.360155705 container start 97acff91c24f4b98c57570c1fead91cc7d7de9255b4c7cae256efcd21d150f37 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-09-10T10:06:18.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T10:06:18.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable), process ceph-mon, pid 2 2024-09-10T10:06:18.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: pidfile_write: ignore empty --pid-file 2024-09-10T10:06:18.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: load: jerasure load: lrc 2024-09-10T10:06:18.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: RocksDB version: 7.9.2 2024-09-10T10:06:18.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Git sha 0 2024-09-10T10:06:18.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Compile date 2024-09-09 20:43:47 2024-09-10T10:06:18.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: DB SUMMARY 2024-09-10T10:06:18.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: DB Session ID: RTARNVKRMXP5YHBRRQWH 2024-09-10T10:06:18.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: CURRENT file: CURRENT 2024-09-10T10:06:18.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T10:06:18.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: MANIFEST file: MANIFEST-000015 size: 979 Bytes 2024-09-10T10:06:18.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi071/store.db dir, Total Num: 1, files: 000030.sst 2024-09-10T10:06:18.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi071/store.db: 000028.log size: 2419520 ; 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.error_if_exists: 0 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.create_if_missing: 0 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.paranoid_checks: 1 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.env: 0x564439f92940 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.info_log: 0x56443c5c38c0 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.statistics: (nil) 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.use_fsync: 0 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_log_file_size: 0 2024-09-10T10:06:18.291 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T10:06:18.292 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T10:06:18.292 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T10:06:18.292 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T10:06:18.292 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.allow_fallocate: 1 2024-09-10T10:06:18.292 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T10:06:18.292 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T10:06:18.292 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.use_direct_reads: 0 2024-09-10T10:06:18.292 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T10:06:18.292 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T10:06:18.292 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.db_log_dir: 2024-09-10T10:06:18.292 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.wal_dir: 2024-09-10T10:06:18.292 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T10:06:18.292 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T10:06:18.293 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T10:06:18.293 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T10:06:18.293 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T10:06:18.293 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T10:06:18.293 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T10:06:18.293 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T10:06:18.293 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.write_buffer_manager: 0x56443c5d2dc0 2024-09-10T10:06:18.293 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T10:06:18.293 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T10:06:18.293 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T10:06:18.293 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T10:06:18.293 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T10:06:18.293 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T10:06:18.294 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T10:06:18.294 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T10:06:18.294 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.unordered_write: 0 2024-09-10T10:06:18.294 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T10:06:18.294 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T10:06:18.294 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T10:06:18.294 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T10:06:18.294 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.row_cache: None 2024-09-10T10:06:18.294 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.wal_filter: None 2024-09-10T10:06:18.295 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T10:06:18.296 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T10:06:18.296 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.two_write_queues: 0 2024-09-10T10:06:18.296 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T10:06:18.296 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.wal_compression: 0 2024-09-10T10:06:18.296 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.atomic_flush: 0 2024-09-10T10:06:18.296 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T10:06:18.296 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T10:06:18.296 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T10:06:18.296 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.log_readahead_size: 0 2024-09-10T10:06:18.296 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T10:06:18.296 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T10:06:18.296 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T10:06:18.297 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T10:06:18.297 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T10:06:18.297 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T10:06:18.297 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T10:06:18.297 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_background_jobs: 2 2024-09-10T10:06:18.297 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_background_compactions: -1 2024-09-10T10:06:18.297 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_subcompactions: 1 2024-09-10T10:06:18.297 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T10:06:18.297 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T10:06:18.297 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T10:06:18.297 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T10:06:18.297 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T10:06:18.297 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T10:06:18.298 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T10:06:18.298 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T10:06:18.298 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_open_files: -1 2024-09-10T10:06:18.298 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T10:06:18.298 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T10:06:18.298 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T10:06:18.298 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T10:06:18.298 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_background_flushes: -1 2024-09-10T10:06:18.298 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Compression algorithms supported: 2024-09-10T10:06:18.298 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: kZSTD supported: 0 2024-09-10T10:06:18.298 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: kXpressCompression supported: 0 2024-09-10T10:06:18.298 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: kBZip2Compression supported: 0 2024-09-10T10:06:18.298 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T10:06:18.299 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: kLZ4Compression supported: 1 2024-09-10T10:06:18.299 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: kZlibCompression supported: 1 2024-09-10T10:06:18.299 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T10:06:18.299 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: kSnappyCompression supported: 1 2024-09-10T10:06:18.299 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T10:06:18.299 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T10:06:18.299 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi071/store.db/MANIFEST-000015 2024-09-10T10:06:18.299 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T10:06:18.299 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T10:06:18.299 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.merge_operator: 2024-09-10T10:06:18.299 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compaction_filter: None 2024-09-10T10:06:18.299 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T10:06:18.299 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T10:06:18.300 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T10:06:18.300 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T10:06:18.300 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56443c5c3520) 2024-09-10T10:06:18.300 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: cache_index_and_filter_blocks: 1 2024-09-10T10:06:18.300 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T10:06:18.300 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T10:06:18.300 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: pin_top_level_index_and_filter: 1 2024-09-10T10:06:18.300 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: index_type: 0 2024-09-10T10:06:18.300 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: data_block_index_type: 0 2024-09-10T10:06:18.300 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: index_shortening: 1 2024-09-10T10:06:18.300 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T10:06:18.300 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: checksum: 4 2024-09-10T10:06:18.300 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: no_block_cache: 0 2024-09-10T10:06:18.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_cache: 0x56443c5b71f0 2024-09-10T10:06:18.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_cache_name: BinnedLRUCache 2024-09-10T10:06:18.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_cache_options: 2024-09-10T10:06:18.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: capacity : 536870912 2024-09-10T10:06:18.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: num_shard_bits : 4 2024-09-10T10:06:18.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: strict_capacity_limit : 0 2024-09-10T10:06:18.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: high_pri_pool_ratio: 0.000 2024-09-10T10:06:18.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_cache_compressed: (nil) 2024-09-10T10:06:18.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: persistent_cache: (nil) 2024-09-10T10:06:18.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_size: 4096 2024-09-10T10:06:18.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_size_deviation: 10 2024-09-10T10:06:18.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_restart_interval: 16 2024-09-10T10:06:18.301 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: index_block_restart_interval: 1 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: metadata_block_size: 4096 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: partition_filters: 0 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: use_delta_encoding: 1 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: filter_policy: bloomfilter 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: whole_key_filtering: 1 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: verify_compression: 0 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: read_amp_bytes_per_bit: 0 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: format_version: 5 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: enable_index_compression: 1 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: block_align: 0 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: max_auto_readahead_size: 262144 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: prepopulate_block_cache: 0 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: initial_auto_readahead_size: 8192 2024-09-10T10:06:18.302 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T10:06:18.303 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T10:06:18.303 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T10:06:18.303 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compression: NoCompression 2024-09-10T10:06:18.303 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T10:06:18.303 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T10:06:18.303 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T10:06:18.303 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.num_levels: 7 2024-09-10T10:06:18.303 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T10:06:18.303 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T10:06:18.303 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T10:06:18.303 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T10:06:18.303 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T10:06:18.304 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T10:06:18.304 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T10:06:18.304 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T10:06:18.304 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T10:06:18.304 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T10:06:18.304 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T10:06:18.304 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T10:06:18.304 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T10:06:18.304 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T10:06:18.304 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T10:06:18.304 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T10:06:18.305 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T10:06:18.305 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T10:06:18.305 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T10:06:18.305 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T10:06:18.305 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T10:06:18.305 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T10:06:18.305 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T10:06:18.305 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T10:06:18.305 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T10:06:18.305 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T10:06:18.305 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T10:06:18.305 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T10:06:18.306 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T10:06:18.306 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T10:06:18.306 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T10:06:18.306 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T10:06:18.306 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T10:06:18.306 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T10:06:18.306 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T10:06:18.306 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T10:06:18.306 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T10:06:18.306 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T10:06:18.306 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T10:06:18.307 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T10:06:18.307 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T10:06:18.307 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T10:06:18.307 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T10:06:18.307 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T10:06:18.307 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T10:06:18.307 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T10:06:18.307 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T10:06:18.307 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T10:06:18.307 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T10:06:18.307 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T10:06:18.307 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T10:06:18.307 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T10:06:18.308 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T10:06:18.308 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T10:06:18.308 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.inplace_update_support: 0 2024-09-10T10:06:18.308 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T10:06:18.308 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T10:06:18.308 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T10:06:18.308 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T10:06:18.308 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.bloom_locality: 0 2024-09-10T10:06:18.308 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.max_successive_merges: 0 2024-09-10T10:06:18.308 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T10:06:18.308 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T10:06:18.308 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T10:06:18.309 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T10:06:18.309 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.ttl: 2592000 2024-09-10T10:06:18.309 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T10:06:18.309 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T10:06:18.309 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T10:06:18.309 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.enable_blob_files: false 2024-09-10T10:06:18.309 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.min_blob_size: 0 2024-09-10T10:06:18.309 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T10:06:18.309 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T10:06:18.309 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T10:06:18.309 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T10:06:18.309 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T10:06:18.310 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T10:06:18.310 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T10:06:18.310 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T10:06:18.310 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2024-09-10T10:06:18.310 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T10:06:18.310 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi071/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 10439, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T10:06:18.310 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2024-09-10T10:06:18.310 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 75704ef2-353d-4775-853e-437e199df493 2024-09-10T10:06:18.310 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962777904983, "job": 1, "event": "recovery_started", "wal_files": [28]} 2024-09-10T10:06:18.310 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2024-09-10T10:06:18.310 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962777912004, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 2198154, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10440, "largest_seqno": 11337, "table_properties": {"data_size": 2193140, "index_size": 2881, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1093, "raw_key_size": 9850, "raw_average_key_size": 23, "raw_value_size": 2183965, "raw_average_value_size": 5199, "num_data_blocks": 132, "num_entries": 420, "num_filter_entries": 420, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725962777, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "75704ef2-353d-4775-853e-437e199df493", "db_session_id": "RTARNVKRMXP5YHBRRQWH", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2024-09-10T10:06:18.310 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962777912121, "job": 1, "event": "recovery_finished"} 2024-09-10T10:06:18.311 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2024-09-10T10:06:18.311 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T10:06:18.311 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi071/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T10:06:18.311 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56443c5e4e00 2024-09-10T10:06:18.311 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: DB pointer 0x56443c6e0000 2024-09-10T10:06:18.311 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T10:06:18.311 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T10:06:18.311 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ** DB Stats ** 2024-09-10T10:06:18.311 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T10:06:18.311 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T10:06:18.311 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T10:06:18.312 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T10:06:18.312 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T10:06:18.312 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T10:06:18.312 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T10:06:18.312 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T10:06:18.312 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-10T10:06:18.312 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T10:06:18.313 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T10:06:18.313 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: L0 1/0 2.10 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 569.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-10T10:06:18.313 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: L6 1/0 5.29 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-10T10:06:18.313 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Sum 2/0 7.38 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 569.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-10T10:06:18.313 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 569.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-10T10:06:18.313 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T10:06:18.313 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-10T10:06:18.313 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T10:06:18.313 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T10:06:18.313 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 569.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-10T10:06:18.313 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T10:06:18.313 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T10:06:18.313 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T10:06:18.314 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T10:06:18.314 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-10T10:06:18.314 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T10:06:18.314 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T10:06:18.314 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T10:06:18.314 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T10:06:18.314 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Cumulative compaction: 0.00 GB write, 188.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T10:06:18.314 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Interval compaction: 0.00 GB write, 188.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T10:06:18.314 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T10:06:18.314 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Block cache BinnedLRUCache@0x56443c5b71f0#2 capacity: 512.00 MB usage: 4.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-10T10:06:18.314 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.16 KB,0.000220537%) IndexBlock(1,3.08 KB,0.000587106%) Misc(1,0.00 KB,0%) 2024-09-10T10:06:18.314 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T10:06:18.314 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T10:06:18.315 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: starting mon.smithi071 rank 0 at public addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] at bind addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi071 fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T10:06:18.315 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: mon.smithi071@-1(???) e2 preinit fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T10:06:18.315 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: mon.smithi071@-1(???).mds e22 new map 2024-09-10T10:06:18.315 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: mon.smithi071@-1(???).mds e22 print_map 2024-09-10T10:06:18.315 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: e22 2024-09-10T10:06:18.315 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-10T10:06:18.315 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:06:18.315 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:06:18.315 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: legacy client fscid: 1 2024-09-10T10:06:18.315 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T10:06:18.315 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Filesystem 'cephfs' (1) 2024-09-10T10:06:18.315 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: fs_name cephfs 2024-09-10T10:06:18.315 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: epoch 22 2024-09-10T10:06:18.316 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:06:18.316 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:06:18.316 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: modified 2024-09-10T10:04:19.815073+0000 2024-09-10T10:06:18.316 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: tableserver 0 2024-09-10T10:06:18.316 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: root 0 2024-09-10T10:06:18.316 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: session_timeout 60 2024-09-10T10:06:18.316 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: session_autoclose 300 2024-09-10T10:06:18.316 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: max_file_size 1099511627776 2024-09-10T10:06:18.316 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: max_xattr_size 65536 2024-09-10T10:06:18.316 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: required_client_features {} 2024-09-10T10:06:18.316 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: last_failure 0 2024-09-10T10:06:18.316 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: last_failure_osd_epoch 45 2024-09-10T10:06:18.317 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:06:18.317 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: max_mds 2 2024-09-10T10:06:18.317 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: in 0,1 2024-09-10T10:06:18.317 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: up {0=14464,1=24267} 2024-09-10T10:06:18.317 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: failed 2024-09-10T10:06:18.317 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: damaged 2024-09-10T10:06:18.317 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: stopped 2024-09-10T10:06:18.317 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: data_pools [3] 2024-09-10T10:06:18.317 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: metadata_pool 2 2024-09-10T10:06:18.317 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: inline_data disabled 2024-09-10T10:06:18.317 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: balancer 2024-09-10T10:06:18.317 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: bal_rank_mask -1 2024-09-10T10:06:18.317 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: standby_count_wanted 1 2024-09-10T10:06:18.318 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: qdb_cluster leader: 0 members: 2024-09-10T10:06:18.318 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: [mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:18.318 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: [mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:18.318 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: [mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:18.318 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: [mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:18.318 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T10:06:18.318 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: 2024-09-10T10:06:18.318 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: mon.smithi071@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-10T10:06:18.318 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: mon.smithi071@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-10T10:06:18.318 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: mon.smithi071@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-10T10:06:18.318 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: mon.smithi071@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-10T10:06:18.318 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 ceph-mon[90773]: mon.smithi071@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-09-10T10:06:18.319 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 bash[90754]: 97acff91c24f4b98c57570c1fead91cc7d7de9255b4c7cae256efcd21d150f37 2024-09-10T10:06:18.319 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:17 smithi071 systemd[1]: Started Ceph mon.smithi071 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:06:19.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T10:06:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T10:06:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: pgmap v20: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: mon.smithi071 calling monitor election 2024-09-10T10:06:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: mon.smithi071 is new leader, mons smithi071,smithi107 in quorum (ranks 0,1) 2024-09-10T10:06:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: monmap epoch 2 2024-09-10T10:06:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T10:06:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: last_changed 2024-09-10T09:57:09.648349+0000 2024-09-10T10:06:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: created 2024-09-10T09:54:42.708407+0000 2024-09-10T10:06:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: min_mon_release 17 (quincy) 2024-09-10T10:06:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: election_strategy: 1 2024-09-10T10:06:19.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.smithi071 2024-09-10T10:06:19.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.smithi107 2024-09-10T10:06:19.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:06:19.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: osdmap e47: 6 total, 6 up, 6 in 2024-09-10T10:06:19.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: mgrmap e31: smithi071.gtqytr(active, since 35s), standbys: smithi107.qurtcs 2024-09-10T10:06:19.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: overall HEALTH_OK 2024-09-10T10:06:19.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: from='mgr.14730 ' entity='' 2024-09-10T10:06:19.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:19 smithi107 ceph-mon[34215]: mgrmap e32: smithi071.gtqytr(active, since 35s), standbys: smithi107.qurtcs 2024-09-10T10:06:19.693 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T10:06:19.693 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: from='mgr.14730 172.21.15.71:0/2329959770' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T10:06:19.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: pgmap v20: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:19.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: mon.smithi071 calling monitor election 2024-09-10T10:06:19.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: mon.smithi071 is new leader, mons smithi071,smithi107 in quorum (ranks 0,1) 2024-09-10T10:06:19.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: monmap epoch 2 2024-09-10T10:06:19.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T10:06:19.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: last_changed 2024-09-10T09:57:09.648349+0000 2024-09-10T10:06:19.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: created 2024-09-10T09:54:42.708407+0000 2024-09-10T10:06:19.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: min_mon_release 17 (quincy) 2024-09-10T10:06:19.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: election_strategy: 1 2024-09-10T10:06:19.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.smithi071 2024-09-10T10:06:19.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.smithi107 2024-09-10T10:06:19.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:06:19.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: osdmap e47: 6 total, 6 up, 6 in 2024-09-10T10:06:19.695 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: mgrmap e31: smithi071.gtqytr(active, since 35s), standbys: smithi107.qurtcs 2024-09-10T10:06:19.695 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: overall HEALTH_OK 2024-09-10T10:06:19.695 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: from='mgr.14730 ' entity='' 2024-09-10T10:06:19.695 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:19 smithi071 ceph-mon[90773]: mgrmap e32: smithi071.gtqytr(active, since 35s), standbys: smithi107.qurtcs 2024-09-10T10:06:24.362 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: Active manager daemon smithi071.gtqytr restarted 2024-09-10T10:06:24.362 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: Activating manager daemon smithi071.gtqytr 2024-09-10T10:06:24.362 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: osdmap e48: 6 total, 6 up, 6 in 2024-09-10T10:06:24.362 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: mgrmap e33: smithi071.gtqytr(active, starting, since 0.00926807s), standbys: smithi107.qurtcs 2024-09-10T10:06:24.362 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T10:06:24.362 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T10:06:24.362 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.omoqqq"}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr metadata", "who": "smithi071.gtqytr", "id": "smithi071.gtqytr"}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr metadata", "who": "smithi107.qurtcs", "id": "smithi107.qurtcs"}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:06:24.363 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:06:24.364 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: Manager daemon smithi071.gtqytr is now available 2024-09-10T10:06:24.364 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: Standby manager daemon smithi107.qurtcs restarted 2024-09-10T10:06:24.364 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: Standby manager daemon smithi107.qurtcs started 2024-09-10T10:06:24.364 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.? 172.21.15.107:0/544172561' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/crt"}]: dispatch 2024-09-10T10:06:24.364 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.? 172.21.15.107:0/544172561' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:06:24.364 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.? 172.21.15.107:0/544172561' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/key"}]: dispatch 2024-09-10T10:06:24.364 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.? 172.21.15.107:0/544172561' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:06:24.364 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:24.388 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: Active manager daemon smithi071.gtqytr restarted 2024-09-10T10:06:24.388 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: Activating manager daemon smithi071.gtqytr 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: osdmap e48: 6 total, 6 up, 6 in 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: mgrmap e33: smithi071.gtqytr(active, starting, since 0.00926807s), standbys: smithi107.qurtcs 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.omoqqq"}]: dispatch 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr metadata", "who": "smithi071.gtqytr", "id": "smithi071.gtqytr"}]: dispatch 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr metadata", "who": "smithi107.qurtcs", "id": "smithi107.qurtcs"}]: dispatch 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:06:24.389 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:06:24.390 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:06:24.390 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:06:24.390 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:06:24.390 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:06:24.390 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:06:24.390 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: Manager daemon smithi071.gtqytr is now available 2024-09-10T10:06:24.390 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: Standby manager daemon smithi107.qurtcs restarted 2024-09-10T10:06:24.390 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: Standby manager daemon smithi107.qurtcs started 2024-09-10T10:06:24.390 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/544172561' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/crt"}]: dispatch 2024-09-10T10:06:24.390 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/544172561' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:06:24.390 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/544172561' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi107.qurtcs/key"}]: dispatch 2024-09-10T10:06:24.390 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.? 172.21.15.107:0/544172561' entity='mgr.smithi107.qurtcs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:06:24.390 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:24 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:25.422 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:25 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:06:25.422 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:25 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:06:25.422 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:25 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:06:25.422 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:25 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/trash_purge_schedule"}]: dispatch 2024-09-10T10:06:25.422 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:25 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/trash_purge_schedule"}]: dispatch 2024-09-10T10:06:25.422 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:25 smithi107 ceph-mon[34215]: mgrmap e34: smithi071.gtqytr(active, since 1.0085s), standbys: smithi107.qurtcs 2024-09-10T10:06:25.438 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:06:25.439 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:06:25.439 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:25 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:06:25.439 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/trash_purge_schedule"}]: dispatch 2024-09-10T10:06:25.439 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:25 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi071.gtqytr/trash_purge_schedule"}]: dispatch 2024-09-10T10:06:25.439 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:25 smithi071 ceph-mon[90773]: mgrmap e34: smithi071.gtqytr(active, since 1.0085s), standbys: smithi107.qurtcs 2024-09-10T10:06:26.210 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:26 smithi107 ceph-mon[34215]: [10/Sep/2024:10:06:25] ENGINE Bus STARTING 2024-09-10T10:06:26.210 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:26 smithi107 ceph-mon[34215]: [10/Sep/2024:10:06:25] ENGINE Serving on https://172.21.15.71:7150 2024-09-10T10:06:26.210 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:26 smithi107 ceph-mon[34215]: [10/Sep/2024:10:06:25] ENGINE Error in HTTPServer.serve 2024-09-10T10:06:26.210 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Traceback (most recent call last): 2024-09-10T10:06:26.210 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:06:26.210 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._run(expiration_interval) 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: s = self.context.wrap_socket( 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: return self.sslsocket_class._create( 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self.do_handshake() 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: self._sslobj.do_handshake() 2024-09-10T10:06:26.211 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:06:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:26 smithi071 ceph-mon[90773]: [10/Sep/2024:10:06:25] ENGINE Bus STARTING 2024-09-10T10:06:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:26 smithi071 ceph-mon[90773]: [10/Sep/2024:10:06:25] ENGINE Serving on https://172.21.15.71:7150 2024-09-10T10:06:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:26 smithi071 ceph-mon[90773]: [10/Sep/2024:10:06:25] ENGINE Error in HTTPServer.serve 2024-09-10T10:06:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: Traceback (most recent call last): 2024-09-10T10:06:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:06:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:06:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:06:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._run(expiration_interval) 2024-09-10T10:06:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:06:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:06:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:06:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:06:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:06:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: s = self.context.wrap_socket( 2024-09-10T10:06:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:06:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: return self.sslsocket_class._create( 2024-09-10T10:06:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:06:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self.do_handshake() 2024-09-10T10:06:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:06:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: self._sslobj.do_handshake() 2024-09-10T10:06:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:06:27.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:27 smithi071 ceph-mon[90773]: [10/Sep/2024:10:06:25] ENGINE Serving on http://172.21.15.71:8765 2024-09-10T10:06:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:27 smithi071 ceph-mon[90773]: [10/Sep/2024:10:06:25] ENGINE Bus STARTED 2024-09-10T10:06:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:27 smithi071 ceph-mon[90773]: pgmap v4: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-10T10:06:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:27 smithi071 ceph-mon[90773]: mgrmap e35: smithi071.gtqytr(active, since 2s), standbys: smithi107.qurtcs 2024-09-10T10:06:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:27 smithi107 ceph-mon[34215]: [10/Sep/2024:10:06:25] ENGINE Serving on http://172.21.15.71:8765 2024-09-10T10:06:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:27 smithi107 ceph-mon[34215]: [10/Sep/2024:10:06:25] ENGINE Bus STARTED 2024-09-10T10:06:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:27 smithi107 ceph-mon[34215]: pgmap v4: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-10T10:06:27.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:27 smithi107 ceph-mon[34215]: mgrmap e35: smithi071.gtqytr(active, since 2s), standbys: smithi107.qurtcs 2024-09-10T10:06:28.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:28 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:28.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:28 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:28.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:28 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:28.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:28 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:28.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:28 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:28.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:28 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:28.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:28 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:28.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:28 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:29 smithi107 ceph-mon[34215]: pgmap v5: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-10T10:06:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:29 smithi107 ceph-mon[34215]: mgrmap e36: smithi071.gtqytr(active, since 4s), standbys: smithi107.qurtcs 2024-09-10T10:06:29.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:29 smithi071 ceph-mon[90773]: pgmap v5: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-10T10:06:29.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:29 smithi071 ceph-mon[90773]: mgrmap e36: smithi071.gtqytr(active, since 4s), standbys: smithi107.qurtcs 2024-09-10T10:06:30.774 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:30 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:30.774 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:30 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:30.774 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:30 smithi107 ceph-mon[34215]: pgmap v6: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-10T10:06:30.774 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:30 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:30.775 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:30 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:31.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:30 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:31.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:30 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:31.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:30 smithi071 ceph-mon[90773]: pgmap v6: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-10T10:06:31.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:30 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:31.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:30 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:32 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:32 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:32 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:32 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:32 smithi107 ceph-mon[34215]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T10:06:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:32 smithi107 ceph-mon[34215]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-10T10:06:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:32 smithi107 ceph-mon[34215]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:06:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:32 smithi107 ceph-mon[34215]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:06:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:32 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:32 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:32 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:32 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:32 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:32 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:32 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:32 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:32.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:32 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:32.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:32 smithi071 ceph-mon[90773]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-10T10:06:32.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:32 smithi071 ceph-mon[90773]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-10T10:06:32.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:32 smithi071 ceph-mon[90773]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:06:32.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:32 smithi071 ceph-mon[90773]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:06:32.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:32 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:32 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:32 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:32 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:32.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:32 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:33.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:33 smithi107 ceph-mon[34215]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:06:33.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:33 smithi107 ceph-mon[34215]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:06:33.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:33 smithi107 ceph-mon[34215]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:06:33.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:33 smithi107 ceph-mon[34215]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:06:33.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:33 smithi107 ceph-mon[34215]: pgmap v7: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-10T10:06:33.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:33 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:33.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:33 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:06:33.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:33 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T10:06:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:33 smithi071 ceph-mon[90773]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:06:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:33 smithi071 ceph-mon[90773]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:06:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:33 smithi071 ceph-mon[90773]: Updating smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:06:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:33 smithi071 ceph-mon[90773]: Updating smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:06:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:33 smithi071 ceph-mon[90773]: pgmap v7: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-10T10:06:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:33 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:33 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:06:33.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:33 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T10:06:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:34 smithi071 ceph-mon[90773]: Upgrade: Updating mon.smithi107 2024-09-10T10:06:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:34 smithi071 ceph-mon[90773]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:06:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:06:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:34 smithi071 ceph-mon[90773]: Deploying daemon mon.smithi107 on smithi107 2024-09-10T10:06:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:34 smithi071 ceph-mon[90773]: pgmap v8: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-10T10:06:34.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:34 smithi107 ceph-mon[34215]: Upgrade: Updating mon.smithi107 2024-09-10T10:06:34.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:34 smithi107 ceph-mon[34215]: from='mgr.34104 ' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:34.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:34 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:06:34.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:34 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:06:34.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:34 smithi107 ceph-mon[34215]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:34.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:34 smithi107 ceph-mon[34215]: Deploying daemon mon.smithi107 on smithi107 2024-09-10T10:06:34.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:34 smithi107 ceph-mon[34215]: pgmap v8: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-10T10:06:35.525 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:35 smithi107 systemd[1]: Stopping Ceph mon.smithi107 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:06:35.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:35 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107[34198]: 2024-09-10T10:06:35.523+0000 7f0f358f5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi107 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:06:35.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:35 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107[34198]: 2024-09-10T10:06:35.523+0000 7f0f358f5640 -1 mon.smithi107@1(peon) e2 *** Got Signal Terminated *** 2024-09-10T10:06:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:35 smithi107 podman[79236]: 2024-09-10 10:06:35.738124505 +0000 UTC m=+0.325033616 container died 682e2b6e311fa84fb8247283c37bacdec2a9b122ae677960183f0d558ee3f4c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-96d63e7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T10:06:36.258 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:36 smithi107 podman[79236]: 2024-09-10 10:06:36.073588865 +0000 UTC m=+0.660497975 container cleanup 682e2b6e311fa84fb8247283c37bacdec2a9b122ae677960183f0d558ee3f4c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=quincy-96d63e7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T10:06:36.259 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:36 smithi107 bash[79236]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107 2024-09-10T10:06:36.515 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:36 smithi107 podman[79250]: 2024-09-10 10:06:36.258126068 +0000 UTC m=+0.519603473 container remove 682e2b6e311fa84fb8247283c37bacdec2a9b122ae677960183f0d558ee3f4c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=quincy-96d63e7, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T10:06:36.515 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:36 smithi107 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi107.service: Deactivated successfully. 2024-09-10T10:06:36.515 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:36 smithi107 systemd[1]: Stopped Ceph mon.smithi107 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:06:36.515 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:36 smithi107 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi107.service: Consumed 5.807s CPU time. 2024-09-10T10:06:36.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:36 smithi107 systemd[1]: Starting Ceph mon.smithi107 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:06:37.149 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:36 smithi107 podman[79377]: 2024-09-10 10:06:36.799187269 +0000 UTC m=+0.015595399 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:06:37.149 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:36 smithi107 podman[79377]: 2024-09-10 10:06:36.901493356 +0000 UTC m=+0.117901485 container create c2f3cc873b797044a5cf58e6b5d87eea6e269cbf329185f06b1da54d13fb99c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T10:06:37.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 podman[79377]: 2024-09-10 10:06:37.104165928 +0000 UTC m=+0.320574044 container init c2f3cc873b797044a5cf58e6b5d87eea6e269cbf329185f06b1da54d13fb99c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T10:06:37.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 podman[79377]: 2024-09-10 10:06:37.107347997 +0000 UTC m=+0.323756115 container start c2f3cc873b797044a5cf58e6b5d87eea6e269cbf329185f06b1da54d13fb99c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:06:37.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T10:06:37.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable), process ceph-mon, pid 2 2024-09-10T10:06:37.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: pidfile_write: ignore empty --pid-file 2024-09-10T10:06:37.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: load: jerasure load: lrc 2024-09-10T10:06:37.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: RocksDB version: 7.9.2 2024-09-10T10:06:37.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Git sha 0 2024-09-10T10:06:37.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Compile date 2024-09-09 20:43:47 2024-09-10T10:06:37.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: DB SUMMARY 2024-09-10T10:06:37.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: DB Session ID: U90I43GE9TJY72SGHT1W 2024-09-10T10:06:37.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: CURRENT file: CURRENT 2024-09-10T10:06:37.150 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T10:06:37.151 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: MANIFEST file: MANIFEST-000009 size: 903 Bytes 2024-09-10T10:06:37.151 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi107/store.db dir, Total Num: 1, files: 000024.sst 2024-09-10T10:06:37.151 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi107/store.db: 000022.log size: 6158927 ; 2024-09-10T10:06:37.152 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.error_if_exists: 0 2024-09-10T10:06:37.152 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.create_if_missing: 0 2024-09-10T10:06:37.152 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.paranoid_checks: 1 2024-09-10T10:06:37.152 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T10:06:37.152 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T10:06:37.152 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T10:06:37.152 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.env: 0x55a042517940 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.info_log: 0x55a044cb98c0 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.statistics: (nil) 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.use_fsync: 0 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_log_file_size: 0 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.allow_fallocate: 1 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T10:06:37.153 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.use_direct_reads: 0 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.db_log_dir: 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.wal_dir: 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.write_buffer_manager: 0x55a044cc8dc0 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T10:06:37.154 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.unordered_write: 0 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.row_cache: None 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.wal_filter: None 2024-09-10T10:06:37.155 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.two_write_queues: 0 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.wal_compression: 0 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.atomic_flush: 0 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.log_readahead_size: 0 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T10:06:37.156 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_background_jobs: 2 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_background_compactions: -1 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_subcompactions: 1 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T10:06:37.157 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_open_files: -1 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_background_flushes: -1 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Compression algorithms supported: 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: kZSTD supported: 0 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: kXpressCompression supported: 0 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: kBZip2Compression supported: 0 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: kLZ4Compression supported: 1 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: kZlibCompression supported: 1 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T10:06:37.158 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: kSnappyCompression supported: 1 2024-09-10T10:06:37.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T10:06:37.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T10:06:37.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi107/store.db/MANIFEST-000009 2024-09-10T10:06:37.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T10:06:37.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T10:06:37.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.merge_operator: 2024-09-10T10:06:37.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compaction_filter: None 2024-09-10T10:06:37.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T10:06:37.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T10:06:37.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T10:06:37.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T10:06:37.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a044cb9520) 2024-09-10T10:06:37.159 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: cache_index_and_filter_blocks: 1 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: pin_top_level_index_and_filter: 1 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: index_type: 0 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: data_block_index_type: 0 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: index_shortening: 1 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: checksum: 4 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: no_block_cache: 0 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_cache: 0x55a044cad1f0 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_cache_name: BinnedLRUCache 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_cache_options: 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: capacity : 536870912 2024-09-10T10:06:37.160 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: num_shard_bits : 4 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: strict_capacity_limit : 0 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: high_pri_pool_ratio: 0.000 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_cache_compressed: (nil) 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: persistent_cache: (nil) 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_size: 4096 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_size_deviation: 10 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_restart_interval: 16 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: index_block_restart_interval: 1 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: metadata_block_size: 4096 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: partition_filters: 0 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: use_delta_encoding: 1 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: filter_policy: bloomfilter 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: whole_key_filtering: 1 2024-09-10T10:06:37.161 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: verify_compression: 0 2024-09-10T10:06:37.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: read_amp_bytes_per_bit: 0 2024-09-10T10:06:37.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: format_version: 5 2024-09-10T10:06:37.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: enable_index_compression: 1 2024-09-10T10:06:37.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: block_align: 0 2024-09-10T10:06:37.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: max_auto_readahead_size: 262144 2024-09-10T10:06:37.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: prepopulate_block_cache: 0 2024-09-10T10:06:37.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: initial_auto_readahead_size: 8192 2024-09-10T10:06:37.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T10:06:37.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T10:06:37.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T10:06:37.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compression: NoCompression 2024-09-10T10:06:37.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T10:06:37.162 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.num_levels: 7 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T10:06:37.163 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T10:06:37.164 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T10:06:37.165 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T10:06:37.165 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T10:06:37.165 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T10:06:37.165 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T10:06:37.165 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T10:06:37.165 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T10:06:37.165 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T10:06:37.165 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T10:06:37.165 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T10:06:37.165 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T10:06:37.165 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T10:06:37.165 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T10:06:37.165 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T10:06:37.166 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.inplace_update_support: 0 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.bloom_locality: 0 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.max_successive_merges: 0 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.ttl: 2592000 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T10:06:37.167 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.enable_blob_files: false 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.min_blob_size: 0 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 24.sst 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi107/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 26, last_sequence is 10538, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 935abb97-8c2a-44db-9484-10ef52053935 2024-09-10T10:06:37.168 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962797133699, "job": 1, "event": "recovery_started", "wal_files": [22]} 2024-09-10T10:06:37.169 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2024-09-10T10:06:37.169 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962797148498, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 3686378, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10543, "largest_seqno": 11975, "table_properties": {"data_size": 3679611, "index_size": 4186, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1541, "raw_key_size": 14367, "raw_average_key_size": 23, "raw_value_size": 3666419, "raw_average_value_size": 5990, "num_data_blocks": 190, "num_entries": 612, "num_filter_entries": 612, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725962797, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "935abb97-8c2a-44db-9484-10ef52053935", "db_session_id": "U90I43GE9TJY72SGHT1W", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2024-09-10T10:06:37.169 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962797148611, "job": 1, "event": "recovery_finished"} 2024-09-10T10:06:37.169 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2024-09-10T10:06:37.169 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T10:06:37.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi107/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T10:06:37.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a044cdae00 2024-09-10T10:06:37.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: DB pointer 0x55a044dd6000 2024-09-10T10:06:37.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T10:06:37.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T10:06:37.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** DB Stats ** 2024-09-10T10:06:37.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T10:06:37.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T10:06:37.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T10:06:37.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T10:06:37.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T10:06:37.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T10:06:37.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T10:06:37.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-10T10:06:37.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** Compaction Stats [default] ** 2024-09-10T10:06:37.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T10:06:37.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T10:06:37.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: L0 1/0 3.52 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 489.2 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-10T10:06:37.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: L6 1/0 5.29 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-10T10:06:37.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Sum 2/0 8.80 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 489.2 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-10T10:06:37.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 489.2 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-10T10:06:37.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-10T10:06:37.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** Compaction Stats [default] ** 2024-09-10T10:06:37.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T10:06:37.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T10:06:37.651 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 489.2 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-10T10:06:37.651 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-10T10:06:37.651 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T10:06:37.651 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-10T10:06:37.651 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T10:06:37.651 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-10T10:06:37.652 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T10:06:37.652 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T10:06:37.652 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T10:06:37.652 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T10:06:37.652 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Cumulative compaction: 0.00 GB write, 181.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T10:06:37.652 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Interval compaction: 0.00 GB write, 181.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T10:06:37.653 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T10:06:37.653 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Block cache BinnedLRUCache@0x55a044cad1f0#2 capacity: 512.00 MB usage: 6.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-10T10:06:37.653 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-09-10T10:06:37.653 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-10T10:06:37.654 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T10:06:37.654 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: starting mon.smithi107 rank 1 at public addrs [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] at bind addrs [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi107 fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T10:06:37.654 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: mon.smithi107@-1(???) e2 preinit fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T10:06:37.654 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: mon.smithi107@-1(???).mds e22 new map 2024-09-10T10:06:37.654 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: mon.smithi107@-1(???).mds e22 print_map 2024-09-10T10:06:37.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: e22 2024-09-10T10:06:37.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-10T10:06:37.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:06:37.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:06:37.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: legacy client fscid: 1 2024-09-10T10:06:37.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-10T10:06:37.656 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: Filesystem 'cephfs' (1) 2024-09-10T10:06:37.656 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: fs_name cephfs 2024-09-10T10:06:37.656 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: epoch 22 2024-09-10T10:06:37.656 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:06:37.656 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:06:37.656 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: modified 2024-09-10T10:04:19.815073+0000 2024-09-10T10:06:37.657 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: tableserver 0 2024-09-10T10:06:37.657 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: root 0 2024-09-10T10:06:37.657 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: session_timeout 60 2024-09-10T10:06:37.657 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: session_autoclose 300 2024-09-10T10:06:37.657 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: max_file_size 1099511627776 2024-09-10T10:06:37.657 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: max_xattr_size 65536 2024-09-10T10:06:37.658 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: required_client_features {} 2024-09-10T10:06:37.658 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: last_failure 0 2024-09-10T10:06:37.658 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: last_failure_osd_epoch 45 2024-09-10T10:06:37.658 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:06:37.658 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: max_mds 2 2024-09-10T10:06:37.659 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: in 0,1 2024-09-10T10:06:37.659 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: up {0=14464,1=24267} 2024-09-10T10:06:37.659 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: failed 2024-09-10T10:06:37.659 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: damaged 2024-09-10T10:06:37.659 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: stopped 2024-09-10T10:06:37.659 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: data_pools [3] 2024-09-10T10:06:37.660 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: metadata_pool 2 2024-09-10T10:06:37.660 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: inline_data disabled 2024-09-10T10:06:37.660 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: balancer 2024-09-10T10:06:37.660 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: bal_rank_mask -1 2024-09-10T10:06:37.660 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: standby_count_wanted 1 2024-09-10T10:06:37.660 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: qdb_cluster leader: 0 members: 2024-09-10T10:06:37.661 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: [mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:37.661 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: [mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:37.661 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: [mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:37.661 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: [mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:37.661 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-10T10:06:37.661 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout: 2024-09-10T10:06:37.662 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: mon.smithi107@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-10T10:06:37.662 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: mon.smithi107@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-10T10:06:37.662 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: mon.smithi107@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-10T10:06:37.662 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: mon.smithi107@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-10T10:06:37.662 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 ceph-mon[79396]: mon.smithi107@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-10T10:06:37.662 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 bash[79377]: c2f3cc873b797044a5cf58e6b5d87eea6e269cbf329185f06b1da54d13fb99c2 2024-09-10T10:06:37.663 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:37 smithi107 systemd[1]: Started Ceph mon.smithi107 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:06:38.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:38 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T10:06:38.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:38 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T10:06:39.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:38 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T10:06:39.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:38 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T10:06:39.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: overall HEALTH_OK 2024-09-10T10:06:39.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: mon.smithi107 calling monitor election 2024-09-10T10:06:39.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: mon.smithi071 calling monitor election 2024-09-10T10:06:39.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T10:06:39.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: mon.smithi071 is new leader, mons smithi071,smithi107 in quorum (ranks 0,1) 2024-09-10T10:06:39.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: monmap epoch 3 2024-09-10T10:06:39.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T10:06:39.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: last_changed 2024-09-10T10:06:38.622531+0000 2024-09-10T10:06:39.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: created 2024-09-10T09:54:42.708407+0000 2024-09-10T10:06:39.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: min_mon_release 19 (squid) 2024-09-10T10:06:39.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: election_strategy: 1 2024-09-10T10:06:39.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.smithi071 2024-09-10T10:06:39.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.smithi107 2024-09-10T10:06:39.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:06:39.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: osdmap e48: 6 total, 6 up, 6 in 2024-09-10T10:06:39.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: mgrmap e36: smithi071.gtqytr(active, since 14s), standbys: smithi107.qurtcs 2024-09-10T10:06:39.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: overall HEALTH_OK 2024-09-10T10:06:39.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T10:06:39.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:39.898 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:39.898 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:39.898 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:06:40.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: overall HEALTH_OK 2024-09-10T10:06:40.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: mon.smithi107 calling monitor election 2024-09-10T10:06:40.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: mon.smithi071 calling monitor election 2024-09-10T10:06:40.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi071"}]: dispatch 2024-09-10T10:06:40.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: mon.smithi071 is new leader, mons smithi071,smithi107 in quorum (ranks 0,1) 2024-09-10T10:06:40.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: monmap epoch 3 2024-09-10T10:06:40.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 2024-09-10T10:06:40.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: last_changed 2024-09-10T10:06:38.622531+0000 2024-09-10T10:06:40.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: created 2024-09-10T09:54:42.708407+0000 2024-09-10T10:06:40.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: min_mon_release 19 (squid) 2024-09-10T10:06:40.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: election_strategy: 1 2024-09-10T10:06:40.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.smithi071 2024-09-10T10:06:40.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.smithi107 2024-09-10T10:06:40.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:06:40.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: osdmap e48: 6 total, 6 up, 6 in 2024-09-10T10:06:40.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: mgrmap e36: smithi071.gtqytr(active, since 14s), standbys: smithi107.qurtcs 2024-09-10T10:06:40.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: overall HEALTH_OK 2024-09-10T10:06:40.040 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mon metadata", "id": "smithi107"}]: dispatch 2024-09-10T10:06:40.041 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:40.041 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:40.041 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:40.041 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:06:40.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:40 smithi107 ceph-mon[79396]: pgmap v11: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-10T10:06:41.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:40 smithi071 ceph-mon[90773]: pgmap v11: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-10T10:06:42.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:42 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:42 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:42 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:42 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:42.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:42 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:42.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:42 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:42.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:42 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:42.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:42 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:43.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.535+0000 7f61142be640 1 -- 172.21.15.71:0/3652393276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f610c0fd820 msgr2=0x7f610c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:43.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.535+0000 7f61142be640 1 --2- 172.21.15.71:0/3652393276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f610c0fd820 0x7f610c0fdc90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0048d0 tx=0x7f60fc009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:43.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.535+0000 7f61142be640 1 -- 172.21.15.71:0/3652393276 shutdown_connections 2024-09-10T10:06:43.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.535+0000 7f61142be640 1 --2- 172.21.15.71:0/3652393276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f610c0fd820 0x7f610c0fdc90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:43.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.535+0000 7f61142be640 1 --2- 172.21.15.71:0/3652393276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f610c0fc550 0x7f610c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:43.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.535+0000 7f61142be640 1 -- 172.21.15.71:0/3652393276 >> 172.21.15.71:0/3652393276 conn(0x7f610c0f7d30 msgr2=0x7f610c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:43.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.536+0000 7f61142be640 1 -- 172.21.15.71:0/3652393276 shutdown_connections 2024-09-10T10:06:43.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.536+0000 7f61142be640 1 -- 172.21.15.71:0/3652393276 wait complete. 2024-09-10T10:06:43.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.536+0000 7f61142be640 1 Processor -- start 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.536+0000 7f61142be640 1 -- start start 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.536+0000 7f61142be640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f610c0fc550 0x7f610c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.536+0000 7f61142be640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f610c0fd820 0x7f610c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.536+0000 7f61142be640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c10dc40 con 0x7f610c0fd820 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.536+0000 7f61142be640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c10e460 con 0x7f610c0fc550 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.537+0000 7f6111859640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f610c0fd820 0x7f610c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.537+0000 7f611205a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f610c0fc550 0x7f610c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.537+0000 7f6111859640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f610c0fd820 0x7f610c10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50080/0 (socket says 172.21.15.71:50080) 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.537+0000 7f6111859640 1 -- 172.21.15.71:0/1682111864 learned_addr learned my addr 172.21.15.71:0/1682111864 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.537+0000 7f6111859640 1 -- 172.21.15.71:0/1682111864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f610c0fc550 msgr2=0x7f610c10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.537+0000 7f6111859640 1 --2- 172.21.15.71:0/1682111864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f610c0fc550 0x7f610c10d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.537+0000 7f6111859640 1 -- 172.21.15.71:0/1682111864 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc005040 con 0x7f610c0fd820 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.537+0000 7f6111859640 1 --2- 172.21.15.71:0/1682111864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f610c0fd820 0x7f610c10d5f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0048a0 tx=0x7f60fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:43.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.537+0000 7f6102ffd640 1 -- 172.21.15.71:0/1682111864 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60fc038070 con 0x7f610c0fd820 2024-09-10T10:06:43.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.537+0000 7f6102ffd640 1 -- 172.21.15.71:0/1682111864 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f60fc004290 con 0x7f610c0fd820 2024-09-10T10:06:43.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.537+0000 7f61142be640 1 -- 172.21.15.71:0/1682111864 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c10e690 con 0x7f610c0fd820 2024-09-10T10:06:43.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.537+0000 7f6102ffd640 1 -- 172.21.15.71:0/1682111864 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60fc033660 con 0x7f610c0fd820 2024-09-10T10:06:43.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.538+0000 7f61142be640 1 -- 172.21.15.71:0/1682111864 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c10ec30 con 0x7f610c0fd820 2024-09-10T10:06:43.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.539+0000 7f61142be640 1 -- 172.21.15.71:0/1682111864 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c0fb9b0 con 0x7f610c0fd820 2024-09-10T10:06:43.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.539+0000 7f6102ffd640 1 -- 172.21.15.71:0/1682111864 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f60fc030020 con 0x7f610c0fd820 2024-09-10T10:06:43.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.540+0000 7f6102ffd640 1 --2- 172.21.15.71:0/1682111864 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f60f806e1e0 0x7f60f8070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:43.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.540+0000 7f6102ffd640 1 -- 172.21.15.71:0/1682111864 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f60fc0ade50 con 0x7f610c0fd820 2024-09-10T10:06:43.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.540+0000 7f611205a640 1 --2- 172.21.15.71:0/1682111864 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f60f806e1e0 0x7f60f8070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:43.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.540+0000 7f611205a640 1 --2- 172.21.15.71:0/1682111864 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f60f806e1e0 0x7f60f8070690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6108009af0 tx=0x7f610800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:43.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.545+0000 7f6102ffd640 1 -- 172.21.15.71:0/1682111864 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f60fc077120 con 0x7f610c0fd820 2024-09-10T10:06:43.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:43 smithi107 ceph-mon[79396]: pgmap v12: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:43.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.729+0000 7f61142be640 1 -- 172.21.15.71:0/1682111864 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f610c10eef0 con 0x7f60f806e1e0 2024-09-10T10:06:43.730 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:43 smithi071 ceph-mon[90773]: pgmap v12: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:43.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.731+0000 7f6102ffd640 1 -- 172.21.15.71:0/1682111864 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f610c10eef0 con 0x7f60f806e1e0 2024-09-10T10:06:43.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.733+0000 7f61142be640 1 -- 172.21.15.71:0/1682111864 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f60f806e1e0 msgr2=0x7f60f8070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:43.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.733+0000 7f61142be640 1 --2- 172.21.15.71:0/1682111864 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f60f806e1e0 0x7f60f8070690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6108009af0 tx=0x7f610800b040 comp rx=0 tx=0).stop 2024-09-10T10:06:43.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.733+0000 7f61142be640 1 -- 172.21.15.71:0/1682111864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f610c0fd820 msgr2=0x7f610c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:43.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.733+0000 7f61142be640 1 --2- 172.21.15.71:0/1682111864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f610c0fd820 0x7f610c10d5f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0048a0 tx=0x7f60fc009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:43.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.733+0000 7f61142be640 1 -- 172.21.15.71:0/1682111864 shutdown_connections 2024-09-10T10:06:43.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.733+0000 7f61142be640 1 --2- 172.21.15.71:0/1682111864 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f60f806e1e0 0x7f60f8070690 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:43.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.733+0000 7f61142be640 1 --2- 172.21.15.71:0/1682111864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f610c0fd820 0x7f610c10d5f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:43.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.733+0000 7f61142be640 1 --2- 172.21.15.71:0/1682111864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f610c0fc550 0x7f610c10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:43.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.733+0000 7f61142be640 1 -- 172.21.15.71:0/1682111864 >> 172.21.15.71:0/1682111864 conn(0x7f610c0f7d30 msgr2=0x7f610c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:43.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.733+0000 7f61142be640 1 -- 172.21.15.71:0/1682111864 shutdown_connections 2024-09-10T10:06:43.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.733+0000 7f61142be640 1 -- 172.21.15.71:0/1682111864 wait complete. 2024-09-10T10:06:43.742 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:06:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.812+0000 7f650cd5f640 1 -- 172.21.15.71:0/2956916172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65080fb450 msgr2=0x7f65080fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.812+0000 7f650cd5f640 1 --2- 172.21.15.71:0/2956916172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65080fb450 0x7f65080fb860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f65000048d0 tx=0x7f6500009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.812+0000 7f650cd5f640 1 -- 172.21.15.71:0/2956916172 shutdown_connections 2024-09-10T10:06:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.812+0000 7f650cd5f640 1 --2- 172.21.15.71:0/2956916172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65080fc720 0x7f65080fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.812+0000 7f650cd5f640 1 --2- 172.21.15.71:0/2956916172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65080fb450 0x7f65080fb860 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.812+0000 7f650cd5f640 1 -- 172.21.15.71:0/2956916172 >> 172.21.15.71:0/2956916172 conn(0x7f65080f6c10 msgr2=0x7f65080f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.812+0000 7f650cd5f640 1 -- 172.21.15.71:0/2956916172 shutdown_connections 2024-09-10T10:06:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.812+0000 7f650cd5f640 1 -- 172.21.15.71:0/2956916172 wait complete. 2024-09-10T10:06:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.812+0000 7f650cd5f640 1 Processor -- start 2024-09-10T10:06:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.812+0000 7f650cd5f640 1 -- start start 2024-09-10T10:06:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f650cd5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65080fb450 0x7f650810fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f650cd5f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65080fc720 0x7f6508112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f650cd5f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65080667b0 con 0x7f65080fc720 2024-09-10T10:06:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f650cd5f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6508066920 con 0x7f65080fb450 2024-09-10T10:06:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f6505d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65080fc720 0x7f6508112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f6505d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65080fc720 0x7f6508112330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50094/0 (socket says 172.21.15.71:50094) 2024-09-10T10:06:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f6505d9b640 1 -- 172.21.15.71:0/481676376 learned_addr learned my addr 172.21.15.71:0/481676376 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f650659c640 1 --2- 172.21.15.71:0/481676376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65080fb450 0x7f650810fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f6505d9b640 1 -- 172.21.15.71:0/481676376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65080fb450 msgr2=0x7f650810fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f6505d9b640 1 --2- 172.21.15.71:0/481676376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65080fb450 0x7f650810fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f6505d9b640 1 -- 172.21.15.71:0/481676376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500005040 con 0x7f65080fc720 2024-09-10T10:06:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f6505d9b640 1 --2- 172.21.15.71:0/481676376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65080fc720 0x7f6508112330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00db00 tx=0x7f64fc004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f64f6ffd640 1 -- 172.21.15.71:0/481676376 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64fc017070 con 0x7f65080fc720 2024-09-10T10:06:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f64f6ffd640 1 -- 172.21.15.71:0/481676376 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f64fc00f040 con 0x7f65080fc720 2024-09-10T10:06:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f650cd5f640 1 -- 172.21.15.71:0/481676376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65081128d0 con 0x7f65080fc720 2024-09-10T10:06:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f64f6ffd640 1 -- 172.21.15.71:0/481676376 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64fc003940 con 0x7f65080fc720 2024-09-10T10:06:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.813+0000 7f650cd5f640 1 -- 172.21.15.71:0/481676376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6508112e40 con 0x7f65080fc720 2024-09-10T10:06:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.814+0000 7f650cd5f640 1 -- 172.21.15.71:0/481676376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65080fa8b0 con 0x7f65080fc720 2024-09-10T10:06:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.815+0000 7f64f6ffd640 1 -- 172.21.15.71:0/481676376 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f64fc003b70 con 0x7f65080fc720 2024-09-10T10:06:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.815+0000 7f64f6ffd640 1 --2- 172.21.15.71:0/481676376 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f64f006e1e0 0x7f64f0070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.816+0000 7f650659c640 1 --2- 172.21.15.71:0/481676376 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f64f006e1e0 0x7f64f0070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.816+0000 7f64f6ffd640 1 -- 172.21.15.71:0/481676376 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f64fc08df50 con 0x7f65080fc720 2024-09-10T10:06:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.816+0000 7f650659c640 1 --2- 172.21.15.71:0/481676376 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f64f006e1e0 0x7f64f0070690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6500007ac0 tx=0x7f6500035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:43.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:43.820+0000 7f64f6ffd640 1 -- 172.21.15.71:0/481676376 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f64fc057060 con 0x7f65080fc720 2024-09-10T10:06:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.001+0000 7f650cd5f640 1 -- 172.21.15.71:0/481676376 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6508100b80 con 0x7f64f006e1e0 2024-09-10T10:06:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.003+0000 7f64f6ffd640 1 -- 172.21.15.71:0/481676376 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f6508100b80 con 0x7f64f006e1e0 2024-09-10T10:06:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.005+0000 7f650cd5f640 1 -- 172.21.15.71:0/481676376 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f64f006e1e0 msgr2=0x7f64f0070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.005+0000 7f650cd5f640 1 --2- 172.21.15.71:0/481676376 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f64f006e1e0 0x7f64f0070690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6500007ac0 tx=0x7f6500035040 comp rx=0 tx=0).stop 2024-09-10T10:06:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.005+0000 7f650cd5f640 1 -- 172.21.15.71:0/481676376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65080fc720 msgr2=0x7f6508112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.005+0000 7f650cd5f640 1 --2- 172.21.15.71:0/481676376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65080fc720 0x7f6508112330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00db00 tx=0x7f64fc004e60 comp rx=0 tx=0).stop 2024-09-10T10:06:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.005+0000 7f650cd5f640 1 -- 172.21.15.71:0/481676376 shutdown_connections 2024-09-10T10:06:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.005+0000 7f650cd5f640 1 --2- 172.21.15.71:0/481676376 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f64f006e1e0 0x7f64f0070690 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.005+0000 7f650cd5f640 1 --2- 172.21.15.71:0/481676376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65080fc720 0x7f6508112330 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.005+0000 7f650cd5f640 1 --2- 172.21.15.71:0/481676376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65080fb450 0x7f650810fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.005+0000 7f650cd5f640 1 -- 172.21.15.71:0/481676376 >> 172.21.15.71:0/481676376 conn(0x7f65080f6c10 msgr2=0x7f65080f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.005+0000 7f650cd5f640 1 -- 172.21.15.71:0/481676376 shutdown_connections 2024-09-10T10:06:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.005+0000 7f650cd5f640 1 -- 172.21.15.71:0/481676376 wait complete. 2024-09-10T10:06:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.083+0000 7f5ff7834640 1 -- 172.21.15.71:0/476321926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ff00fc550 msgr2=0x7f5ff00fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.083+0000 7f5ff7834640 1 --2- 172.21.15.71:0/476321926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ff00fc550 0x7f5ff00fc960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0048d0 tx=0x7f5fec009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.083+0000 7f5ff7834640 1 -- 172.21.15.71:0/476321926 shutdown_connections 2024-09-10T10:06:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.083+0000 7f5ff7834640 1 --2- 172.21.15.71:0/476321926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ff00fd820 0x7f5ff00fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.083+0000 7f5ff7834640 1 --2- 172.21.15.71:0/476321926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ff00fc550 0x7f5ff00fc960 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.083+0000 7f5ff7834640 1 -- 172.21.15.71:0/476321926 >> 172.21.15.71:0/476321926 conn(0x7f5ff00f7d30 msgr2=0x7f5ff00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.083+0000 7f5ff7834640 1 -- 172.21.15.71:0/476321926 shutdown_connections 2024-09-10T10:06:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.083+0000 7f5ff7834640 1 -- 172.21.15.71:0/476321926 wait complete. 2024-09-10T10:06:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.083+0000 7f5ff7834640 1 Processor -- start 2024-09-10T10:06:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.084+0000 7f5ff7834640 1 -- start start 2024-09-10T10:06:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.084+0000 7f5ff7834640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ff00fc550 0x7f5ff010d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.084+0000 7f5ff7834640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ff00fd820 0x7f5ff010d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.084+0000 7f5ff7834640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff010e4e0 con 0x7f5ff00fd820 2024-09-10T10:06:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.084+0000 7f5ff7834640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff010e650 con 0x7f5ff00fc550 2024-09-10T10:06:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.084+0000 7f5ff4dcf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ff00fd820 0x7f5ff010d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.084+0000 7f5ff4dcf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ff00fd820 0x7f5ff010d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50118/0 (socket says 172.21.15.71:50118) 2024-09-10T10:06:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.084+0000 7f5ff4dcf640 1 -- 172.21.15.71:0/3526930804 learned_addr learned my addr 172.21.15.71:0/3526930804 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.084+0000 7f5ff55d0640 1 --2- 172.21.15.71:0/3526930804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ff00fc550 0x7f5ff010d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.084+0000 7f5ff4dcf640 1 -- 172.21.15.71:0/3526930804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ff00fc550 msgr2=0x7f5ff010d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.084+0000 7f5ff4dcf640 1 --2- 172.21.15.71:0/3526930804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ff00fc550 0x7f5ff010d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.084+0000 7f5ff4dcf640 1 -- 172.21.15.71:0/3526930804 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec005040 con 0x7f5ff00fd820 2024-09-10T10:06:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.084+0000 7f5ff4dcf640 1 --2- 172.21.15.71:0/3526930804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ff00fd820 0x7f5ff010d670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000b790 tx=0x7f5fe00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.085+0000 7f5fe5ffb640 1 -- 172.21.15.71:0/3526930804 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fe000c700 con 0x7f5ff00fd820 2024-09-10T10:06:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.085+0000 7f5ff7834640 1 -- 172.21.15.71:0/3526930804 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff010e930 con 0x7f5ff00fd820 2024-09-10T10:06:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.085+0000 7f5fe5ffb640 1 -- 172.21.15.71:0/3526930804 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5fe000cd00 con 0x7f5ff00fd820 2024-09-10T10:06:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.085+0000 7f5fe5ffb640 1 -- 172.21.15.71:0/3526930804 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fe0015e70 con 0x7f5ff00fd820 2024-09-10T10:06:44.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.085+0000 7f5ff7834640 1 -- 172.21.15.71:0/3526930804 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff010ee50 con 0x7f5ff00fd820 2024-09-10T10:06:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.086+0000 7f5ff7834640 1 -- 172.21.15.71:0/3526930804 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff00fb9b0 con 0x7f5ff00fd820 2024-09-10T10:06:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.086+0000 7f5fe5ffb640 1 -- 172.21.15.71:0/3526930804 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f5fe0012070 con 0x7f5ff00fd820 2024-09-10T10:06:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.087+0000 7f5fe5ffb640 1 --2- 172.21.15.71:0/3526930804 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f5fdc06e1e0 0x7f5fdc070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.087+0000 7f5fe5ffb640 1 -- 172.21.15.71:0/3526930804 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5fe008d920 con 0x7f5ff00fd820 2024-09-10T10:06:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.087+0000 7f5ff55d0640 1 --2- 172.21.15.71:0/3526930804 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f5fdc06e1e0 0x7f5fdc070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.087+0000 7f5ff55d0640 1 --2- 172.21.15.71:0/3526930804 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f5fdc06e1e0 0x7f5fdc070690 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5fec007ac0 tx=0x7f5fec035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:44.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.091+0000 7f5fe5ffb640 1 -- 172.21.15.71:0/3526930804 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5fe0056b40 con 0x7f5ff00fd820 2024-09-10T10:06:44.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.268+0000 7f5ff7834640 1 -- 172.21.15.71:0/3526930804 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ff010f0d0 con 0x7f5fdc06e1e0 2024-09-10T10:06:44.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.279+0000 7f5fe5ffb640 1 -- 172.21.15.71:0/3526930804 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f5ff010f0d0 con 0x7f5fdc06e1e0 2024-09-10T10:06:44.280 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:06:44.280 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (117s) 14s ago 10m 17.1M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:06:44.280 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (10m) 14s ago 10m 6891k - 17.2.7-1597-g96d63e75 f3fc7d52e233 f70481a4c3c7 2024-09-10T10:06:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (9m) 2s ago 9m 6895k - 17.2.7-1597-g96d63e75 f3fc7d52e233 cf27ebcc0f98 2024-09-10T10:06:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (111s) 14s ago 10m 76.7M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:06:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (5m) 14s ago 5m 114M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:06:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (5m) 14s ago 5m 65.0M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:06:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (5m) 2s ago 5m 108M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:06:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (5m) 2s ago 5m 62.7M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:06:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (78s) 14s ago 11m 472M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:06:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (39s) 2s ago 9m 438M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:06:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (26s) 14s ago 11m 27.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:06:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (7s) 2s ago 9m 22.9M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:06:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (2m) 14s ago 10m 8414k - 1.5.0 0da6a335fe13 c3d47d79cd22 2024-09-10T10:06:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (85s) 2s ago 9m 14.6M - 1.5.0 0da6a335fe13 9a25165a0fd1 2024-09-10T10:06:44.281 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (8m) 14s ago 8m 224M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 a79e69c9b514 2024-09-10T10:06:44.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (8m) 14s ago 8m 234M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 44a84bf577da 2024-09-10T10:06:44.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (7m) 14s ago 7m 195M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 4fae52756a24 2024-09-10T10:06:44.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (7m) 2s ago 7m 269M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:06:44.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (7m) 2s ago 7m 229M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:06:44.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (6m) 2s ago 6m 227M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:06:44.282 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (45s) 14s ago 10m 50.2M - 2.43.0 a07b618ecd1d 47d3ae62ce5e 2024-09-10T10:06:44.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.281+0000 7f5ff7834640 1 -- 172.21.15.71:0/3526930804 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f5fdc06e1e0 msgr2=0x7f5fdc070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.281+0000 7f5ff7834640 1 --2- 172.21.15.71:0/3526930804 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f5fdc06e1e0 0x7f5fdc070690 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5fec007ac0 tx=0x7f5fec035040 comp rx=0 tx=0).stop 2024-09-10T10:06:44.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.281+0000 7f5ff7834640 1 -- 172.21.15.71:0/3526930804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ff00fd820 msgr2=0x7f5ff010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.281+0000 7f5ff7834640 1 --2- 172.21.15.71:0/3526930804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ff00fd820 0x7f5ff010d670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000b790 tx=0x7f5fe00091d0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.281+0000 7f5ff7834640 1 -- 172.21.15.71:0/3526930804 shutdown_connections 2024-09-10T10:06:44.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.281+0000 7f5ff7834640 1 --2- 172.21.15.71:0/3526930804 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f5fdc06e1e0 0x7f5fdc070690 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.281+0000 7f5ff7834640 1 --2- 172.21.15.71:0/3526930804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ff00fd820 0x7f5ff010d670 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.281+0000 7f5ff7834640 1 --2- 172.21.15.71:0/3526930804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ff00fc550 0x7f5ff010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.281+0000 7f5ff7834640 1 -- 172.21.15.71:0/3526930804 >> 172.21.15.71:0/3526930804 conn(0x7f5ff00f7d30 msgr2=0x7f5ff00f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:44.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.281+0000 7f5ff7834640 1 -- 172.21.15.71:0/3526930804 shutdown_connections 2024-09-10T10:06:44.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.282+0000 7f5ff7834640 1 -- 172.21.15.71:0/3526930804 wait complete. 2024-09-10T10:06:44.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.358+0000 7f86ce697640 1 -- 172.21.15.71:0/852784095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86c80fb430 msgr2=0x7f86c80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.358+0000 7f86ce697640 1 --2- 172.21.15.71:0/852784095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86c80fb430 0x7f86c80fb840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f86b80048d0 tx=0x7f86b8009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.358+0000 7f86ce697640 1 -- 172.21.15.71:0/852784095 shutdown_connections 2024-09-10T10:06:44.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.358+0000 7f86ce697640 1 --2- 172.21.15.71:0/852784095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86c80fc700 0x7f86c80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.358+0000 7f86ce697640 1 --2- 172.21.15.71:0/852784095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86c80fb430 0x7f86c80fb840 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.358+0000 7f86ce697640 1 -- 172.21.15.71:0/852784095 >> 172.21.15.71:0/852784095 conn(0x7f86c80f6c10 msgr2=0x7f86c80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:44.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.358+0000 7f86ce697640 1 -- 172.21.15.71:0/852784095 shutdown_connections 2024-09-10T10:06:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.359+0000 7f86ce697640 1 -- 172.21.15.71:0/852784095 wait complete. 2024-09-10T10:06:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.359+0000 7f86ce697640 1 Processor -- start 2024-09-10T10:06:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.359+0000 7f86ce697640 1 -- start start 2024-09-10T10:06:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.359+0000 7f86ce697640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86c80fb430 0x7f86c80ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.359+0000 7f86ce697640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86c80fc700 0x7f86c80fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.359+0000 7f86ce697640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80fdfd0 con 0x7f86c80fb430 2024-09-10T10:06:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.359+0000 7f86ce697640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80fe110 con 0x7f86c80fc700 2024-09-10T10:06:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.359+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86c80fb430 0x7f86c80ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.359+0000 7f86c7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86c80fb430 0x7f86c80ff550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50126/0 (socket says 172.21.15.71:50126) 2024-09-10T10:06:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.359+0000 7f86c7fff640 1 -- 172.21.15.71:0/489346665 learned_addr learned my addr 172.21.15.71:0/489346665 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.360+0000 7f86c77fe640 1 --2- 172.21.15.71:0/489346665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86c80fc700 0x7f86c80fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.360+0000 7f86c7fff640 1 -- 172.21.15.71:0/489346665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86c80fc700 msgr2=0x7f86c80fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.360+0000 7f86c7fff640 1 --2- 172.21.15.71:0/489346665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86c80fc700 0x7f86c80fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.360+0000 7f86c7fff640 1 -- 172.21.15.71:0/489346665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b8005040 con 0x7f86c80fb430 2024-09-10T10:06:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.360+0000 7f86c7fff640 1 --2- 172.21.15.71:0/489346665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86c80fb430 0x7f86c80ff550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f86b80043d0 tx=0x7f86b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.360+0000 7f86c4ff9640 1 -- 172.21.15.71:0/489346665 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86b8038070 con 0x7f86c80fb430 2024-09-10T10:06:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.360+0000 7f86c4ff9640 1 -- 172.21.15.71:0/489346665 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f86b802ae90 con 0x7f86c80fb430 2024-09-10T10:06:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.360+0000 7f86ce697640 1 -- 172.21.15.71:0/489346665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c80fe390 con 0x7f86c80fb430 2024-09-10T10:06:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.360+0000 7f86c4ff9640 1 -- 172.21.15.71:0/489346665 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86b803e670 con 0x7f86c80fb430 2024-09-10T10:06:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.360+0000 7f86ce697640 1 -- 172.21.15.71:0/489346665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c80fe8b0 con 0x7f86c80fb430 2024-09-10T10:06:44.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.361+0000 7f86ce697640 1 -- 172.21.15.71:0/489346665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c80fa890 con 0x7f86c80fb430 2024-09-10T10:06:44.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.362+0000 7f86c4ff9640 1 -- 172.21.15.71:0/489346665 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f86b8030020 con 0x7f86c80fb430 2024-09-10T10:06:44.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.362+0000 7f86c4ff9640 1 --2- 172.21.15.71:0/489346665 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f86b406e1e0 0x7f86b4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.362+0000 7f86c4ff9640 1 -- 172.21.15.71:0/489346665 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f86b80add50 con 0x7f86c80fb430 2024-09-10T10:06:44.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.362+0000 7f86c77fe640 1 --2- 172.21.15.71:0/489346665 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f86b406e1e0 0x7f86b4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.363+0000 7f86c77fe640 1 --2- 172.21.15.71:0/489346665 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f86b406e1e0 0x7f86b4070690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009fd0 tx=0x7f86b000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:44.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.366+0000 7f86c4ff9640 1 -- 172.21.15.71:0/489346665 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f86b8077020 con 0x7f86c80fb430 2024-09-10T10:06:44.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.600+0000 7f86ce697640 1 -- 172.21.15.71:0/489346665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f86c80fe8b0 con 0x7f86c80fb430 2024-09-10T10:06:44.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.600+0000 7f86c4ff9640 1 -- 172.21.15.71:0/489346665 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f86c80fe8b0 con 0x7f86c80fb430 2024-09-10T10:06:44.602 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:06:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:06:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:06:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:06:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:06:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:06:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:06:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:06:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 6 2024-09-10T10:06:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:06:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:06:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:06:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:06:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:06:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 10, 2024-09-10T10:06:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T10:06:44.603 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:06:44.603 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:06:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.602+0000 7f86ce697640 1 -- 172.21.15.71:0/489346665 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f86b406e1e0 msgr2=0x7f86b4070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.602+0000 7f86ce697640 1 --2- 172.21.15.71:0/489346665 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f86b406e1e0 0x7f86b4070690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009fd0 tx=0x7f86b000b040 comp rx=0 tx=0).stop 2024-09-10T10:06:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.602+0000 7f86ce697640 1 -- 172.21.15.71:0/489346665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86c80fb430 msgr2=0x7f86c80ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.602+0000 7f86ce697640 1 --2- 172.21.15.71:0/489346665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86c80fb430 0x7f86c80ff550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f86b80043d0 tx=0x7f86b8009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.602+0000 7f86ce697640 1 -- 172.21.15.71:0/489346665 shutdown_connections 2024-09-10T10:06:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.602+0000 7f86ce697640 1 --2- 172.21.15.71:0/489346665 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f86b406e1e0 0x7f86b4070690 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.602+0000 7f86ce697640 1 --2- 172.21.15.71:0/489346665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86c80fc700 0x7f86c80fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.602+0000 7f86ce697640 1 --2- 172.21.15.71:0/489346665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86c80fb430 0x7f86c80ff550 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.602+0000 7f86ce697640 1 -- 172.21.15.71:0/489346665 >> 172.21.15.71:0/489346665 conn(0x7f86c80f6c10 msgr2=0x7f86c8065670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:44.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.603+0000 7f86ce697640 1 -- 172.21.15.71:0/489346665 shutdown_connections 2024-09-10T10:06:44.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.603+0000 7f86ce697640 1 -- 172.21.15.71:0/489346665 wait complete. 2024-09-10T10:06:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.680+0000 7fed5ce9e640 1 -- 172.21.15.71:0/601299839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed580666b0 msgr2=0x7fed580ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.680+0000 7fed5ce9e640 1 --2- 172.21.15.71:0/601299839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed580666b0 0x7fed580ff1e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fed480048d0 tx=0x7fed48009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.680+0000 7fed5ce9e640 1 -- 172.21.15.71:0/601299839 shutdown_connections 2024-09-10T10:06:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.680+0000 7fed5ce9e640 1 --2- 172.21.15.71:0/601299839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed580ff720 0x7fed58101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.680+0000 7fed5ce9e640 1 --2- 172.21.15.71:0/601299839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed580666b0 0x7fed580ff1e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.680+0000 7fed5ce9e640 1 -- 172.21.15.71:0/601299839 >> 172.21.15.71:0/601299839 conn(0x7fed580f6c10 msgr2=0x7fed580f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.680+0000 7fed5ce9e640 1 -- 172.21.15.71:0/601299839 shutdown_connections 2024-09-10T10:06:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.680+0000 7fed5ce9e640 1 -- 172.21.15.71:0/601299839 wait complete. 2024-09-10T10:06:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.680+0000 7fed5ce9e640 1 Processor -- start 2024-09-10T10:06:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.680+0000 7fed5ce9e640 1 -- start start 2024-09-10T10:06:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed5ce9e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed580666b0 0x7fed5810d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed5ce9e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed580ff720 0x7fed5810d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed5ce9e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5810dce0 con 0x7fed580666b0 2024-09-10T10:06:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed5ce9e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5810e4b0 con 0x7fed580ff720 2024-09-10T10:06:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed5659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed580666b0 0x7fed5810d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed5659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed580666b0 0x7fed5810d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50140/0 (socket says 172.21.15.71:50140) 2024-09-10T10:06:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed5659c640 1 -- 172.21.15.71:0/1681412496 learned_addr learned my addr 172.21.15.71:0/1681412496 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed55d9b640 1 --2- 172.21.15.71:0/1681412496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed580ff720 0x7fed5810d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed5659c640 1 -- 172.21.15.71:0/1681412496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed580ff720 msgr2=0x7fed5810d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed5659c640 1 --2- 172.21.15.71:0/1681412496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed580ff720 0x7fed5810d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed5659c640 1 -- 172.21.15.71:0/1681412496 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed48005040 con 0x7fed580666b0 2024-09-10T10:06:44.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed5659c640 1 --2- 172.21.15.71:0/1681412496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed580666b0 0x7fed5810d150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fed480043d0 tx=0x7fed48009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed46ffd640 1 -- 172.21.15.71:0/1681412496 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed48038070 con 0x7fed580666b0 2024-09-10T10:06:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed46ffd640 1 -- 172.21.15.71:0/1681412496 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fed4802ae90 con 0x7fed580666b0 2024-09-10T10:06:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed5ce9e640 1 -- 172.21.15.71:0/1681412496 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5810e6e0 con 0x7fed580666b0 2024-09-10T10:06:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed46ffd640 1 -- 172.21.15.71:0/1681412496 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed4803e670 con 0x7fed580666b0 2024-09-10T10:06:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.681+0000 7fed5ce9e640 1 -- 172.21.15.71:0/1681412496 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5810ec80 con 0x7fed580666b0 2024-09-10T10:06:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.682+0000 7fed5ce9e640 1 -- 172.21.15.71:0/1681412496 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed580fa8b0 con 0x7fed580666b0 2024-09-10T10:06:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.683+0000 7fed46ffd640 1 -- 172.21.15.71:0/1681412496 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fed48030020 con 0x7fed580666b0 2024-09-10T10:06:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.683+0000 7fed46ffd640 1 --2- 172.21.15.71:0/1681412496 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fed4006e1e0 0x7fed40070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.683+0000 7fed46ffd640 1 -- 172.21.15.71:0/1681412496 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fed480adde0 con 0x7fed580666b0 2024-09-10T10:06:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.683+0000 7fed55d9b640 1 --2- 172.21.15.71:0/1681412496 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fed4006e1e0 0x7fed40070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.684+0000 7fed55d9b640 1 --2- 172.21.15.71:0/1681412496 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fed4006e1e0 0x7fed40070690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed5810cf00 tx=0x7fed4c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:44.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.688+0000 7fed46ffd640 1 -- 172.21.15.71:0/1681412496 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fed48077130 con 0x7fed580666b0 2024-09-10T10:06:44.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.885+0000 7fed5ce9e640 1 -- 172.21.15.71:0/1681412496 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fed58104fa0 con 0x7fed580666b0 2024-09-10T10:06:44.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.885+0000 7fed46ffd640 1 -- 172.21.15.71:0/1681412496 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1974 (secure 0 0 0) 0x7fed4807a7f0 con 0x7fed580666b0 2024-09-10T10:06:44.887 INFO:teuthology.orchestra.run.smithi071.stdout:e22 2024-09-10T10:06:44.887 INFO:teuthology.orchestra.run.smithi071.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-10T10:06:44.887 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:06:44.887 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:06:44.887 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:06:44.887 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:06:44.887 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:06:44.887 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 22 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:04:19.815073+0000 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:06:44.888 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:06:44.889 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:06:44.889 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:06:44.889 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:06:44.889 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:06:44.889 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:06:44.889 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:06:44.889 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:06:44.889 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:06:44.889 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:06:44.889 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:06:44.889 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:06:44.889 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:06:44.890 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 0 members: 2024-09-10T10:06:44.890 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:44.890 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:44.890 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:44.890 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:06:44.890 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:06:44.890 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:06:44.891 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 22 2024-09-10T10:06:44.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.888+0000 7fed5ce9e640 1 -- 172.21.15.71:0/1681412496 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fed4006e1e0 msgr2=0x7fed40070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.888+0000 7fed5ce9e640 1 --2- 172.21.15.71:0/1681412496 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fed4006e1e0 0x7fed40070690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed5810cf00 tx=0x7fed4c00b040 comp rx=0 tx=0).stop 2024-09-10T10:06:44.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.888+0000 7fed5ce9e640 1 -- 172.21.15.71:0/1681412496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed580666b0 msgr2=0x7fed5810d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.888+0000 7fed5ce9e640 1 --2- 172.21.15.71:0/1681412496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed580666b0 0x7fed5810d150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fed480043d0 tx=0x7fed48009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.888+0000 7fed5ce9e640 1 -- 172.21.15.71:0/1681412496 shutdown_connections 2024-09-10T10:06:44.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.888+0000 7fed5ce9e640 1 --2- 172.21.15.71:0/1681412496 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fed4006e1e0 0x7fed40070690 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.888+0000 7fed5ce9e640 1 --2- 172.21.15.71:0/1681412496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed580ff720 0x7fed5810d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.888+0000 7fed5ce9e640 1 --2- 172.21.15.71:0/1681412496 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed580666b0 0x7fed5810d150 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.888+0000 7fed5ce9e640 1 -- 172.21.15.71:0/1681412496 >> 172.21.15.71:0/1681412496 conn(0x7fed580f6c10 msgr2=0x7fed580f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:44.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.888+0000 7fed5ce9e640 1 -- 172.21.15.71:0/1681412496 shutdown_connections 2024-09-10T10:06:44.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.889+0000 7fed5ce9e640 1 -- 172.21.15.71:0/1681412496 wait complete. 2024-09-10T10:06:44.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.966+0000 7f3ec8c14640 1 -- 172.21.15.71:0/3588157768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec40fc550 msgr2=0x7f3ec40fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.966+0000 7f3ec8c14640 1 --2- 172.21.15.71:0/3588157768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec40fc550 0x7f3ec40fc960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40048d0 tx=0x7f3eb4009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec8c14640 1 -- 172.21.15.71:0/3588157768 shutdown_connections 2024-09-10T10:06:44.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec8c14640 1 --2- 172.21.15.71:0/3588157768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ec40fd820 0x7f3ec40fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec8c14640 1 --2- 172.21.15.71:0/3588157768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec40fc550 0x7f3ec40fc960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec8c14640 1 -- 172.21.15.71:0/3588157768 >> 172.21.15.71:0/3588157768 conn(0x7f3ec40f7d30 msgr2=0x7f3ec40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:44.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec8c14640 1 -- 172.21.15.71:0/3588157768 shutdown_connections 2024-09-10T10:06:44.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec8c14640 1 -- 172.21.15.71:0/3588157768 wait complete. 2024-09-10T10:06:44.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec8c14640 1 Processor -- start 2024-09-10T10:06:44.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec8c14640 1 -- start start 2024-09-10T10:06:44.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec8c14640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ec40fc550 0x7f3ec410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec8c14640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec40fd820 0x7f3ec410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec8c14640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec410dc10 con 0x7f3ec40fd820 2024-09-10T10:06:44.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec8c14640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec410e430 con 0x7f3ec40fc550 2024-09-10T10:06:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec1d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec40fd820 0x7f3ec410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec1d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec40fd820 0x7f3ec410d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50156/0 (socket says 172.21.15.71:50156) 2024-09-10T10:06:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.967+0000 7f3ec1d9b640 1 -- 172.21.15.71:0/615396084 learned_addr learned my addr 172.21.15.71:0/615396084 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.968+0000 7f3ec259c640 1 --2- 172.21.15.71:0/615396084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ec40fc550 0x7f3ec410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.968+0000 7f3ec1d9b640 1 -- 172.21.15.71:0/615396084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ec40fc550 msgr2=0x7f3ec410d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.968+0000 7f3ec1d9b640 1 --2- 172.21.15.71:0/615396084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ec40fc550 0x7f3ec410d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.968+0000 7f3ec1d9b640 1 -- 172.21.15.71:0/615396084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb4005040 con 0x7f3ec40fd820 2024-09-10T10:06:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.968+0000 7f3ec259c640 1 --2- 172.21.15.71:0/615396084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ec40fc550 0x7f3ec410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:06:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.968+0000 7f3ec1d9b640 1 --2- 172.21.15.71:0/615396084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec40fd820 0x7f3ec410d5c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00c830 tx=0x7f3eac004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.968+0000 7f3ebaffd640 1 -- 172.21.15.71:0/615396084 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eac00a850 con 0x7f3ec40fd820 2024-09-10T10:06:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.968+0000 7f3ebaffd640 1 -- 172.21.15.71:0/615396084 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3eac00ae50 con 0x7f3ec40fd820 2024-09-10T10:06:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.968+0000 7f3ec8c14640 1 -- 172.21.15.71:0/615396084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec410e6c0 con 0x7f3ec40fd820 2024-09-10T10:06:44.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.968+0000 7f3ebaffd640 1 -- 172.21.15.71:0/615396084 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eac0113a0 con 0x7f3ec40fd820 2024-09-10T10:06:44.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.968+0000 7f3ec8c14640 1 -- 172.21.15.71:0/615396084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec410ec60 con 0x7f3ec40fd820 2024-09-10T10:06:44.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.969+0000 7f3ec8c14640 1 -- 172.21.15.71:0/615396084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec40fb9b0 con 0x7f3ec40fd820 2024-09-10T10:06:44.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.970+0000 7f3ebaffd640 1 -- 172.21.15.71:0/615396084 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f3eac012400 con 0x7f3ec40fd820 2024-09-10T10:06:44.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.970+0000 7f3ebaffd640 1 --2- 172.21.15.71:0/615396084 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3eb006e1e0 0x7f3eb0070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.970+0000 7f3ebaffd640 1 -- 172.21.15.71:0/615396084 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3eac08df50 con 0x7f3ec40fd820 2024-09-10T10:06:44.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.970+0000 7f3ec259c640 1 --2- 172.21.15.71:0/615396084 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3eb006e1e0 0x7f3eb0070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.971+0000 7f3ec259c640 1 --2- 172.21.15.71:0/615396084 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3eb006e1e0 0x7f3eb0070690 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4004540 tx=0x7f3eb4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:44.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:44.974+0000 7f3ebaffd640 1 -- 172.21.15.71:0/615396084 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3eac0571f0 con 0x7f3ec40fd820 2024-09-10T10:06:45.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.157+0000 7f3ec8c14640 1 -- 172.21.15.71:0/615396084 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ec410ef80 con 0x7f3eb006e1e0 2024-09-10T10:06:45.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.158+0000 7f3ebaffd640 1 -- 172.21.15.71:0/615396084 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f3ec410ef80 con 0x7f3eb006e1e0 2024-09-10T10:06:45.159 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:06:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:06:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:06:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "4/21 daemons upgraded", 2024-09-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mon daemons", 2024-09-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:06:45.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.160+0000 7f3ec8c14640 1 -- 172.21.15.71:0/615396084 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3eb006e1e0 msgr2=0x7f3eb0070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:45.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.160+0000 7f3ec8c14640 1 --2- 172.21.15.71:0/615396084 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3eb006e1e0 0x7f3eb0070690 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4004540 tx=0x7f3eb4035040 comp rx=0 tx=0).stop 2024-09-10T10:06:45.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.160+0000 7f3ec8c14640 1 -- 172.21.15.71:0/615396084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec40fd820 msgr2=0x7f3ec410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.160+0000 7f3ec8c14640 1 --2- 172.21.15.71:0/615396084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec40fd820 0x7f3ec410d5c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00c830 tx=0x7f3eac004430 comp rx=0 tx=0).stop 2024-09-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.160+0000 7f3ec8c14640 1 -- 172.21.15.71:0/615396084 shutdown_connections 2024-09-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.160+0000 7f3ec8c14640 1 --2- 172.21.15.71:0/615396084 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3eb006e1e0 0x7f3eb0070690 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.160+0000 7f3ec8c14640 1 --2- 172.21.15.71:0/615396084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec40fd820 0x7f3ec410d5c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.160+0000 7f3ec8c14640 1 --2- 172.21.15.71:0/615396084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ec40fc550 0x7f3ec410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.160+0000 7f3ec8c14640 1 -- 172.21.15.71:0/615396084 >> 172.21.15.71:0/615396084 conn(0x7f3ec40f7d30 msgr2=0x7f3ec40f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.160+0000 7f3ec8c14640 1 -- 172.21.15.71:0/615396084 shutdown_connections 2024-09-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.160+0000 7f3ec8c14640 1 -- 172.21.15.71:0/615396084 wait complete. 2024-09-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.241+0000 7f8fae2e8640 1 -- 172.21.15.71:0/1180720537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fa80fc700 msgr2=0x7f8fa80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.241+0000 7f8fae2e8640 1 --2- 172.21.15.71:0/1180720537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fa80fc700 0x7f8fa80fcb70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8f900048d0 tx=0x7f8f90009da0 comp rx=0 tx=0).stop 2024-09-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.241+0000 7f8fae2e8640 1 -- 172.21.15.71:0/1180720537 shutdown_connections 2024-09-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.241+0000 7f8fae2e8640 1 --2- 172.21.15.71:0/1180720537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fa80fc700 0x7f8fa80fcb70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.241+0000 7f8fae2e8640 1 --2- 172.21.15.71:0/1180720537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa80fb430 0x7f8fa80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.241+0000 7f8fae2e8640 1 -- 172.21.15.71:0/1180720537 >> 172.21.15.71:0/1180720537 conn(0x7f8fa80f6c10 msgr2=0x7f8fa80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.241+0000 7f8fae2e8640 1 -- 172.21.15.71:0/1180720537 shutdown_connections 2024-09-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.241+0000 7f8fae2e8640 1 -- 172.21.15.71:0/1180720537 wait complete. 2024-09-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.241+0000 7f8fae2e8640 1 Processor -- start 2024-09-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.241+0000 7f8fae2e8640 1 -- start start 2024-09-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fae2e8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fa80fb430 0x7f8fa810d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fae2e8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa80fc700 0x7f8fa810d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fae2e8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa810dbf0 con 0x7f8fa80fb430 2024-09-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fae2e8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa810e410 con 0x7f8fa80fc700 2024-09-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fa7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fa80fb430 0x7f8fa810d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fa7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fa80fb430 0x7f8fa810d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50182/0 (socket says 172.21.15.71:50182) 2024-09-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fa7fff640 1 -- 172.21.15.71:0/2156397944 learned_addr learned my addr 172.21.15.71:0/2156397944 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8f9ffff640 1 --2- 172.21.15.71:0/2156397944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa80fc700 0x7f8fa810d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fa7fff640 1 -- 172.21.15.71:0/2156397944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa80fc700 msgr2=0x7f8fa810d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fa7fff640 1 --2- 172.21.15.71:0/2156397944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa80fc700 0x7f8fa810d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fa7fff640 1 -- 172.21.15.71:0/2156397944 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90005040 con 0x7f8fa80fb430 2024-09-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fa7fff640 1 --2- 172.21.15.71:0/2156397944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fa80fb430 0x7f8fa810d060 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8f98002a50 tx=0x7f8f98004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fa57fa640 1 -- 172.21.15.71:0/2156397944 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f98007c30 con 0x7f8fa80fb430 2024-09-10T10:06:45.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fae2e8640 1 -- 172.21.15.71:0/2156397944 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa810e6a0 con 0x7f8fa80fb430 2024-09-10T10:06:45.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fa57fa640 1 -- 172.21.15.71:0/2156397944 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8f9800f040 con 0x7f8fa80fb430 2024-09-10T10:06:45.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fa57fa640 1 -- 172.21.15.71:0/2156397944 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f9800da10 con 0x7f8fa80fb430 2024-09-10T10:06:45.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.242+0000 7f8fae2e8640 1 -- 172.21.15.71:0/2156397944 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa810ec40 con 0x7f8fa80fb430 2024-09-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.244+0000 7f8fae2e8640 1 -- 172.21.15.71:0/2156397944 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa80fa890 con 0x7f8fa80fb430 2024-09-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.244+0000 7f8fa57fa640 1 -- 172.21.15.71:0/2156397944 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f8f9800dc80 con 0x7f8fa80fb430 2024-09-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.245+0000 7f8fa57fa640 1 --2- 172.21.15.71:0/2156397944 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8f9406e1e0 0x7f8f94070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.245+0000 7f8fa57fa640 1 -- 172.21.15.71:0/2156397944 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8f9808d620 con 0x7f8fa80fb430 2024-09-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.245+0000 7f8f9ffff640 1 --2- 172.21.15.71:0/2156397944 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8f9406e1e0 0x7f8f94070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.245+0000 7f8f9ffff640 1 --2- 172.21.15.71:0/2156397944 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8f9406e1e0 0x7f8f94070690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8fa810ce10 tx=0x7f8f90035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.249+0000 7f8fa57fa640 1 -- 172.21.15.71:0/2156397944 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8f980567e0 con 0x7f8fa80fb430 2024-09-10T10:06:45.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.495+0000 7f8fae2e8640 1 -- 172.21.15.71:0/2156397944 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8fa804b720 con 0x7f8fa80fb430 2024-09-10T10:06:45.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.495+0000 7f8fa57fa640 1 -- 172.21.15.71:0/2156397944 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8f98059ea0 con 0x7f8fa80fb430 2024-09-10T10:06:45.497 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:45.497 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:45.497 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: pgmap v13: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:45.497 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:45.497 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/489346665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:06:45.497 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/1681412496' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:06:45.497 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:45.497 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:45.497 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:45.498 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:45.498 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:45.498 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:06:45.498 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:06:45.498 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:45.498 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:06:45.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.499+0000 7f8fae2e8640 1 -- 172.21.15.71:0/2156397944 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8f9406e1e0 msgr2=0x7f8f94070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:45.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.499+0000 7f8fae2e8640 1 --2- 172.21.15.71:0/2156397944 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8f9406e1e0 0x7f8f94070690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8fa810ce10 tx=0x7f8f90035040 comp rx=0 tx=0).stop 2024-09-10T10:06:45.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.499+0000 7f8fae2e8640 1 -- 172.21.15.71:0/2156397944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fa80fb430 msgr2=0x7f8fa810d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:45.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.499+0000 7f8fae2e8640 1 --2- 172.21.15.71:0/2156397944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fa80fb430 0x7f8fa810d060 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8f98002a50 tx=0x7f8f98004600 comp rx=0 tx=0).stop 2024-09-10T10:06:45.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.499+0000 7f8fae2e8640 1 -- 172.21.15.71:0/2156397944 shutdown_connections 2024-09-10T10:06:45.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.499+0000 7f8fae2e8640 1 --2- 172.21.15.71:0/2156397944 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8f9406e1e0 0x7f8f94070690 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:45.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.499+0000 7f8fae2e8640 1 --2- 172.21.15.71:0/2156397944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa80fc700 0x7f8fa810d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:45.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.499+0000 7f8fae2e8640 1 --2- 172.21.15.71:0/2156397944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fa80fb430 0x7f8fa810d060 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:45.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.499+0000 7f8fae2e8640 1 -- 172.21.15.71:0/2156397944 >> 172.21.15.71:0/2156397944 conn(0x7f8fa80f6c10 msgr2=0x7f8fa8065610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:45.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.499+0000 7f8fae2e8640 1 -- 172.21.15.71:0/2156397944 shutdown_connections 2024-09-10T10:06:45.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:06:45.499+0000 7f8fae2e8640 1 -- 172.21.15.71:0/2156397944 wait complete. 2024-09-10T10:06:45.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:45.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:45.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: pgmap v13: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:45.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:45.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/489346665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:06:45.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/1681412496' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:06:45.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:45.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:45.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:45.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:45.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:45.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:06:45.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:06:45.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:46.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:46 smithi071 ceph-mon[90773]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:46.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:46 smithi071 ceph-mon[90773]: Reconfiguring mon.smithi071 (monmap changed)... 2024-09-10T10:06:46.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:46 smithi071 ceph-mon[90773]: Reconfiguring daemon mon.smithi071 on smithi071 2024-09-10T10:06:46.694 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:46 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2156397944' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:06:46.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:46 smithi107 ceph-mon[79396]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:46.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:46 smithi107 ceph-mon[79396]: Reconfiguring mon.smithi071 (monmap changed)... 2024-09-10T10:06:46.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:46 smithi107 ceph-mon[79396]: Reconfiguring daemon mon.smithi071 on smithi071 2024-09-10T10:06:46.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:46 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2156397944' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:06:47.667 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:47 smithi071 ceph-mon[90773]: pgmap v14: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:06:47.667 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:47.667 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:47.667 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi071.gtqytr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:06:47.668 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:06:47.668 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:47.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:47 smithi107 ceph-mon[79396]: pgmap v14: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:06:47.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:47.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:47.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi071.gtqytr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:06:47.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:06:47.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:48.659 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:48 smithi071 ceph-mon[90773]: Reconfiguring mgr.smithi071.gtqytr (monmap changed)... 2024-09-10T10:06:48.660 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:48 smithi071 ceph-mon[90773]: Reconfiguring daemon mgr.smithi071.gtqytr on smithi071 2024-09-10T10:06:48.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:48 smithi107 ceph-mon[79396]: Reconfiguring mgr.smithi071.gtqytr (monmap changed)... 2024-09-10T10:06:48.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:48 smithi107 ceph-mon[79396]: Reconfiguring daemon mgr.smithi071.gtqytr on smithi071 2024-09-10T10:06:49.761 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:49 smithi071 ceph-mon[90773]: pgmap v15: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:49.761 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:49 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:49.761 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:49 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:49.761 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:49 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi071", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T10:06:49.762 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:49 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:49.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:49 smithi107 ceph-mon[79396]: pgmap v15: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:49.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:49 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:49.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:49 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:49.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:49 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi071", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T10:06:49.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:49 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:50.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:50 smithi071 ceph-mon[90773]: Reconfiguring crash.smithi071 (monmap changed)... 2024-09-10T10:06:50.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:50 smithi071 ceph-mon[90773]: Reconfiguring daemon crash.smithi071 on smithi071 2024-09-10T10:06:50.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:50.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:50.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T10:06:50.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:50.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:50 smithi107 ceph-mon[79396]: Reconfiguring crash.smithi071 (monmap changed)... 2024-09-10T10:06:50.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:50 smithi107 ceph-mon[79396]: Reconfiguring daemon crash.smithi071 on smithi071 2024-09-10T10:06:50.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:50.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:50.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T10:06:50.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:51.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:51 smithi071 ceph-mon[90773]: Reconfiguring osd.0 (monmap changed)... 2024-09-10T10:06:51.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:51 smithi071 ceph-mon[90773]: Reconfiguring daemon osd.0 on smithi071 2024-09-10T10:06:51.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:51 smithi071 ceph-mon[90773]: pgmap v16: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:06:51.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:51 smithi107 ceph-mon[79396]: Reconfiguring osd.0 (monmap changed)... 2024-09-10T10:06:51.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:51 smithi107 ceph-mon[79396]: Reconfiguring daemon osd.0 on smithi071 2024-09-10T10:06:51.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:51 smithi107 ceph-mon[79396]: pgmap v16: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:06:52.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:52 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:52.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:52 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:52.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:52 smithi071 ceph-mon[90773]: Reconfiguring osd.1 (monmap changed)... 2024-09-10T10:06:52.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:52 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T10:06:52.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:52 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:52.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:52 smithi071 ceph-mon[90773]: Reconfiguring daemon osd.1 on smithi071 2024-09-10T10:06:52.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:52 smithi071 ceph-mon[90773]: pgmap v17: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:52.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:52 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:52.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:52 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:52.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:52 smithi107 ceph-mon[79396]: Reconfiguring osd.1 (monmap changed)... 2024-09-10T10:06:52.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:52 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T10:06:52.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:52 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:52.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:52 smithi107 ceph-mon[79396]: Reconfiguring daemon osd.1 on smithi071 2024-09-10T10:06:52.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:52 smithi107 ceph-mon[79396]: pgmap v17: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:54.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:54.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:54.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:54 smithi071 ceph-mon[90773]: Reconfiguring osd.2 (monmap changed)... 2024-09-10T10:06:54.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T10:06:54.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:54.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:54 smithi071 ceph-mon[90773]: Reconfiguring daemon osd.2 on smithi071 2024-09-10T10:06:54.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:54.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:54.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:54 smithi107 ceph-mon[79396]: Reconfiguring osd.2 (monmap changed)... 2024-09-10T10:06:54.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T10:06:54.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:54.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:54 smithi107 ceph-mon[79396]: Reconfiguring daemon osd.2 on smithi071 2024-09-10T10:06:55.252 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:55 smithi071 ceph-mon[90773]: pgmap v18: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:55.252 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:06:55.252 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:55.252 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:55.253 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.toijsg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:06:55.253 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:55.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:55 smithi107 ceph-mon[79396]: pgmap v18: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:55.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:06:55.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:55.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:55.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.toijsg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:06:55.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:56.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:56 smithi071 ceph-mon[90773]: Reconfiguring mds.cephfs.smithi071.toijsg (monmap changed)... 2024-09-10T10:06:56.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:56 smithi071 ceph-mon[90773]: Reconfiguring daemon mds.cephfs.smithi071.toijsg on smithi071 2024-09-10T10:06:56.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:56 smithi107 ceph-mon[79396]: Reconfiguring mds.cephfs.smithi071.toijsg (monmap changed)... 2024-09-10T10:06:56.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:56 smithi107 ceph-mon[79396]: Reconfiguring daemon mds.cephfs.smithi071.toijsg on smithi071 2024-09-10T10:06:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:57 smithi071 ceph-mon[90773]: Reconfiguring mds.cephfs.smithi071.omoqqq (monmap changed)... 2024-09-10T10:06:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.omoqqq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:06:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:57 smithi071 ceph-mon[90773]: Reconfiguring daemon mds.cephfs.smithi071.omoqqq on smithi071 2024-09-10T10:06:57.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:57 smithi071 ceph-mon[90773]: pgmap v19: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:06:57.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:57.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:57.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:57 smithi107 ceph-mon[79396]: Reconfiguring mds.cephfs.smithi071.omoqqq (monmap changed)... 2024-09-10T10:06:57.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.omoqqq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:06:57.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:57.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:57 smithi107 ceph-mon[79396]: Reconfiguring daemon mds.cephfs.smithi071.omoqqq on smithi071 2024-09-10T10:06:57.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:57 smithi107 ceph-mon[79396]: pgmap v19: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:06:58.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:58 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:58.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:58 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:58.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:58 smithi071 ceph-mon[90773]: Reconfiguring crash.smithi107 (monmap changed)... 2024-09-10T10:06:58.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:58 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T10:06:58.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:58 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:58.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:58 smithi071 ceph-mon[90773]: Reconfiguring daemon crash.smithi107 on smithi107 2024-09-10T10:06:58.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:58 smithi071 ceph-mon[90773]: pgmap v20: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:06:58.856 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:58 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:58.857 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:58 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:06:58.857 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:58 smithi107 ceph-mon[79396]: Reconfiguring crash.smithi107 (monmap changed)... 2024-09-10T10:06:58.857 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:58 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T10:06:58.857 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:58 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:58.857 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:58 smithi107 ceph-mon[79396]: Reconfiguring daemon crash.smithi107 on smithi107 2024-09-10T10:06:58.857 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:58 smithi107 ceph-mon[79396]: pgmap v20: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:00.226 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:59 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:00.226 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:59 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:00.226 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:59 smithi107 ceph-mon[79396]: Reconfiguring mgr.smithi107.qurtcs (monmap changed)... 2024-09-10T10:07:00.226 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:59 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.qurtcs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:07:00.226 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:59 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:07:00.226 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:59 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:00.226 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:06:59 smithi107 ceph-mon[79396]: Reconfiguring daemon mgr.smithi107.qurtcs on smithi107 2024-09-10T10:07:00.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:59 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:00.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:59 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:00.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:59 smithi071 ceph-mon[90773]: Reconfiguring mgr.smithi107.qurtcs (monmap changed)... 2024-09-10T10:07:00.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:59 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi107.qurtcs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:07:00.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:59 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:07:00.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:59 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:00.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:06:59 smithi071 ceph-mon[90773]: Reconfiguring daemon mgr.smithi107.qurtcs on smithi107 2024-09-10T10:07:01.586 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:01 smithi107 ceph-mon[79396]: pgmap v21: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:01.586 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:01.586 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:01.586 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:01 smithi107 ceph-mon[79396]: Reconfiguring mon.smithi107 (monmap changed)... 2024-09-10T10:07:01.587 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:07:01.587 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:07:01.587 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:01.587 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:01 smithi107 ceph-mon[79396]: Reconfiguring daemon mon.smithi107 on smithi107 2024-09-10T10:07:01.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:01 smithi071 ceph-mon[90773]: pgmap v21: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:01.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:01.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:01.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:01 smithi071 ceph-mon[90773]: Reconfiguring mon.smithi107 (monmap changed)... 2024-09-10T10:07:01.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:07:01.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:07:01.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:01.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:01 smithi071 ceph-mon[90773]: Reconfiguring daemon mon.smithi107 on smithi107 2024-09-10T10:07:02.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:02.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:02.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:02 smithi107 ceph-mon[79396]: Reconfiguring osd.3 (monmap changed)... 2024-09-10T10:07:02.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T10:07:02.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:02.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:02 smithi107 ceph-mon[79396]: Reconfiguring daemon osd.3 on smithi107 2024-09-10T10:07:02.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:02 smithi107 ceph-mon[79396]: pgmap v22: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:03.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:03.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:03.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:02 smithi071 ceph-mon[90773]: Reconfiguring osd.3 (monmap changed)... 2024-09-10T10:07:03.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T10:07:03.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:03.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:02 smithi071 ceph-mon[90773]: Reconfiguring daemon osd.3 on smithi107 2024-09-10T10:07:03.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:02 smithi071 ceph-mon[90773]: pgmap v22: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:04.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:04 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:04.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:04 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:04.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:04 smithi107 ceph-mon[79396]: Reconfiguring osd.4 (monmap changed)... 2024-09-10T10:07:04.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:04 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T10:07:04.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:04 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:04.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:04 smithi107 ceph-mon[79396]: Reconfiguring daemon osd.4 on smithi107 2024-09-10T10:07:04.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:04 smithi107 ceph-mon[79396]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:07:04.454 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:04 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:04.454 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:04 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:04.454 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:04 smithi071 ceph-mon[90773]: Reconfiguring osd.4 (monmap changed)... 2024-09-10T10:07:04.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:04 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T10:07:04.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:04 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:04.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:04 smithi071 ceph-mon[90773]: Reconfiguring daemon osd.4 on smithi107 2024-09-10T10:07:04.455 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:04 smithi071 ceph-mon[90773]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:07:05.269 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:05 smithi107 ceph-mon[79396]: pgmap v23: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:05.269 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:05.270 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:05.270 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:07:05.270 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:05.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:05 smithi071 ceph-mon[90773]: pgmap v23: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:05.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:05.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:05.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:07:05.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:06.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:06 smithi107 ceph-mon[79396]: Reconfiguring osd.5 (monmap changed)... 2024-09-10T10:07:06.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:06 smithi107 ceph-mon[79396]: Reconfiguring daemon osd.5 on smithi107 2024-09-10T10:07:06.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:06 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:06.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:06 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:06.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:06 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.nycoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:06.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:06 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:06.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:06 smithi071 ceph-mon[90773]: Reconfiguring osd.5 (monmap changed)... 2024-09-10T10:07:06.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:06 smithi071 ceph-mon[90773]: Reconfiguring daemon osd.5 on smithi107 2024-09-10T10:07:06.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:06 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:06.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:06 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:06.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:06 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.nycoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:06.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:06 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:07.254 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:07 smithi107 ceph-mon[79396]: Reconfiguring mds.cephfs.smithi107.nycoxn (monmap changed)... 2024-09-10T10:07:07.254 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:07 smithi107 ceph-mon[79396]: Reconfiguring daemon mds.cephfs.smithi107.nycoxn on smithi107 2024-09-10T10:07:07.254 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:07 smithi107 ceph-mon[79396]: pgmap v24: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:07.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:07 smithi071 ceph-mon[90773]: Reconfiguring mds.cephfs.smithi107.nycoxn (monmap changed)... 2024-09-10T10:07:07.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:07 smithi071 ceph-mon[90773]: Reconfiguring daemon mds.cephfs.smithi107.nycoxn on smithi107 2024-09-10T10:07:07.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:07 smithi071 ceph-mon[90773]: pgmap v24: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:08.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:08.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:08 smithi107 ceph-mon[79396]: Reconfiguring mds.cephfs.smithi107.rvgklu (monmap changed)... 2024-09-10T10:07:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.rvgklu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:08 smithi107 ceph-mon[79396]: Reconfiguring daemon mds.cephfs.smithi107.rvgklu on smithi107 2024-09-10T10:07:08.660 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:08.660 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:08.660 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:08 smithi071 ceph-mon[90773]: Reconfiguring mds.cephfs.smithi107.rvgklu (monmap changed)... 2024-09-10T10:07:08.660 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.rvgklu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:08.660 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:08.660 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:08 smithi071 ceph-mon[90773]: Reconfiguring daemon mds.cephfs.smithi107.rvgklu on smithi107 2024-09-10T10:07:09.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:09 smithi107 ceph-mon[79396]: pgmap v25: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi071"}]: dispatch 2024-09-10T10:07:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi071"}]': finished 2024-09-10T10:07:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi107"}]: dispatch 2024-09-10T10:07:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi107"}]': finished 2024-09-10T10:07:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:07:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:09 smithi071 ceph-mon[90773]: pgmap v25: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi071"}]: dispatch 2024-09-10T10:07:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi071"}]': finished 2024-09-10T10:07:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi107"}]: dispatch 2024-09-10T10:07:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi107"}]': finished 2024-09-10T10:07:09.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:07:10.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:10 smithi071 ceph-mon[90773]: Upgrade: Setting container_image for all mon 2024-09-10T10:07:10.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:10 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:10.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:10 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi071", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T10:07:10.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:10 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:10.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:10 smithi107 ceph-mon[79396]: Upgrade: Setting container_image for all mon 2024-09-10T10:07:10.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:10 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:10.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:10 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi071", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T10:07:10.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:10 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:11.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:11 smithi071 ceph-mon[90773]: pgmap v26: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:11.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:11 smithi071 ceph-mon[90773]: Upgrade: Updating crash.smithi071 (1/2) 2024-09-10T10:07:11.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:11 smithi071 ceph-mon[90773]: Deploying daemon crash.smithi071 on smithi071 2024-09-10T10:07:11.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:11 smithi107 ceph-mon[79396]: pgmap v26: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:11.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:11 smithi107 ceph-mon[79396]: Upgrade: Updating crash.smithi071 (1/2) 2024-09-10T10:07:11.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:11 smithi107 ceph-mon[79396]: Deploying daemon crash.smithi071 on smithi071 2024-09-10T10:07:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:13 smithi107 ceph-mon[79396]: pgmap v27: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:13.716 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:13 smithi071 ceph-mon[90773]: pgmap v27: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:15.384 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:15.384 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:15.384 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:15 smithi107 ceph-mon[79396]: pgmap v28: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:15.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:15.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:15.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:15 smithi071 ceph-mon[90773]: pgmap v28: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.591+0000 7f361e756640 1 -- 172.21.15.71:0/1704237644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36180fd830 msgr2=0x7f36180fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.591+0000 7f361e756640 1 --2- 172.21.15.71:0/1704237644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36180fd830 0x7f36180fdca0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f360c0048d0 tx=0x7f360c009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.591+0000 7f361e756640 1 -- 172.21.15.71:0/1704237644 shutdown_connections 2024-09-10T10:07:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.591+0000 7f361e756640 1 --2- 172.21.15.71:0/1704237644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36180fd830 0x7f36180fdca0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.591+0000 7f361e756640 1 --2- 172.21.15.71:0/1704237644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36180fc560 0x7f36180fc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.591+0000 7f361e756640 1 -- 172.21.15.71:0/1704237644 >> 172.21.15.71:0/1704237644 conn(0x7f36180f7d40 msgr2=0x7f36180fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:15.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.591+0000 7f361e756640 1 -- 172.21.15.71:0/1704237644 shutdown_connections 2024-09-10T10:07:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.591+0000 7f361e756640 1 -- 172.21.15.71:0/1704237644 wait complete. 2024-09-10T10:07:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.592+0000 7f361e756640 1 Processor -- start 2024-09-10T10:07:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.592+0000 7f361e756640 1 -- start start 2024-09-10T10:07:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.592+0000 7f361e756640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36180fc560 0x7f361810d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.592+0000 7f361e756640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36180fd830 0x7f361810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.592+0000 7f361e756640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361810dbc0 con 0x7f36180fd830 2024-09-10T10:07:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.592+0000 7f361e756640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361810e3e0 con 0x7f36180fc560 2024-09-10T10:07:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.593+0000 7f36177fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36180fd830 0x7f361810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.593+0000 7f36177fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36180fd830 0x7f361810d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46846/0 (socket says 172.21.15.71:46846) 2024-09-10T10:07:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.593+0000 7f36177fe640 1 -- 172.21.15.71:0/3870382047 learned_addr learned my addr 172.21.15.71:0/3870382047 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.593+0000 7f3617fff640 1 --2- 172.21.15.71:0/3870382047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36180fc560 0x7f361810d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.593+0000 7f36177fe640 1 -- 172.21.15.71:0/3870382047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36180fc560 msgr2=0x7f361810d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:15.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.593+0000 7f36177fe640 1 --2- 172.21.15.71:0/3870382047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36180fc560 0x7f361810d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.593+0000 7f36177fe640 1 -- 172.21.15.71:0/3870382047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c005040 con 0x7f36180fd830 2024-09-10T10:07:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.593+0000 7f3617fff640 1 --2- 172.21.15.71:0/3870382047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36180fc560 0x7f361810d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:07:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.593+0000 7f36177fe640 1 --2- 172.21.15.71:0/3870382047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36180fd830 0x7f361810d570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f360c0043d0 tx=0x7f360c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.593+0000 7f3614ff9640 1 -- 172.21.15.71:0/3870382047 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f360c038070 con 0x7f36180fd830 2024-09-10T10:07:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.593+0000 7f3614ff9640 1 -- 172.21.15.71:0/3870382047 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f360c02ae90 con 0x7f36180fd830 2024-09-10T10:07:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.593+0000 7f361e756640 1 -- 172.21.15.71:0/3870382047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361810e610 con 0x7f36180fd830 2024-09-10T10:07:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.594+0000 7f3614ff9640 1 -- 172.21.15.71:0/3870382047 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f360c03e670 con 0x7f36180fd830 2024-09-10T10:07:15.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.594+0000 7f361e756640 1 -- 172.21.15.71:0/3870382047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361810eb30 con 0x7f36180fd830 2024-09-10T10:07:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.595+0000 7f361e756640 1 -- 172.21.15.71:0/3870382047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36180fb9c0 con 0x7f36180fd830 2024-09-10T10:07:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.595+0000 7f3614ff9640 1 -- 172.21.15.71:0/3870382047 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f360c030020 con 0x7f36180fd830 2024-09-10T10:07:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.595+0000 7f3614ff9640 1 --2- 172.21.15.71:0/3870382047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f360006e1e0 0x7f3600070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.596+0000 7f3614ff9640 1 -- 172.21.15.71:0/3870382047 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f360c0adf80 con 0x7f36180fd830 2024-09-10T10:07:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.596+0000 7f3617fff640 1 --2- 172.21.15.71:0/3870382047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f360006e1e0 0x7f3600070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:15.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.596+0000 7f3617fff640 1 --2- 172.21.15.71:0/3870382047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f360006e1e0 0x7f3600070690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3608009fd0 tx=0x7f360800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:15.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.600+0000 7f3614ff9640 1 -- 172.21.15.71:0/3870382047 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f360c0e31b0 con 0x7f36180fd830 2024-09-10T10:07:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.790+0000 7f361e756640 1 -- 172.21.15.71:0/3870382047 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f361810ee10 con 0x7f360006e1e0 2024-09-10T10:07:15.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.791+0000 7f3614ff9640 1 -- 172.21.15.71:0/3870382047 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f361810ee10 con 0x7f360006e1e0 2024-09-10T10:07:15.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.793+0000 7f361e756640 1 -- 172.21.15.71:0/3870382047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f360006e1e0 msgr2=0x7f3600070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:15.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.793+0000 7f361e756640 1 --2- 172.21.15.71:0/3870382047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f360006e1e0 0x7f3600070690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3608009fd0 tx=0x7f360800b040 comp rx=0 tx=0).stop 2024-09-10T10:07:15.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.793+0000 7f361e756640 1 -- 172.21.15.71:0/3870382047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36180fd830 msgr2=0x7f361810d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:15.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.793+0000 7f361e756640 1 --2- 172.21.15.71:0/3870382047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36180fd830 0x7f361810d570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f360c0043d0 tx=0x7f360c009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:15.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.793+0000 7f361e756640 1 -- 172.21.15.71:0/3870382047 shutdown_connections 2024-09-10T10:07:15.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.793+0000 7f361e756640 1 --2- 172.21.15.71:0/3870382047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f360006e1e0 0x7f3600070690 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:15.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.793+0000 7f361e756640 1 --2- 172.21.15.71:0/3870382047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36180fd830 0x7f361810d570 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:15.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.793+0000 7f361e756640 1 --2- 172.21.15.71:0/3870382047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36180fc560 0x7f361810d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:15.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.793+0000 7f361e756640 1 -- 172.21.15.71:0/3870382047 >> 172.21.15.71:0/3870382047 conn(0x7f36180f7d40 msgr2=0x7f36180f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:15.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.793+0000 7f361e756640 1 -- 172.21.15.71:0/3870382047 shutdown_connections 2024-09-10T10:07:15.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.793+0000 7f361e756640 1 -- 172.21.15.71:0/3870382047 wait complete. 2024-09-10T10:07:15.803 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:07:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 -- 172.21.15.71:0/3883948186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200fc520 msgr2=0x7f2c200fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 --2- 172.21.15.71:0/3883948186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200fc520 0x7f2c200fc930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2c100048d0 tx=0x7f2c10009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 -- 172.21.15.71:0/3883948186 shutdown_connections 2024-09-10T10:07:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 --2- 172.21.15.71:0/3883948186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c200fd7f0 0x7f2c200fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 --2- 172.21.15.71:0/3883948186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200fc520 0x7f2c200fc930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 -- 172.21.15.71:0/3883948186 >> 172.21.15.71:0/3883948186 conn(0x7f2c200f7ce0 msgr2=0x7f2c200fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 -- 172.21.15.71:0/3883948186 shutdown_connections 2024-09-10T10:07:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 -- 172.21.15.71:0/3883948186 wait complete. 2024-09-10T10:07:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 Processor -- start 2024-09-10T10:07:15.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 -- start start 2024-09-10T10:07:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200fc520 0x7f2c2010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c200fd7f0 0x7f2c2010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2010dc10 con 0x7f2c200fc520 2024-09-10T10:07:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c2638b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2010e430 con 0x7f2c200fd7f0 2024-09-10T10:07:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.873+0000 7f2c1ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200fc520 0x7f2c2010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.874+0000 7f2c1ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200fc520 0x7f2c2010d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46862/0 (socket says 172.21.15.71:46862) 2024-09-10T10:07:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.874+0000 7f2c1ffff640 1 -- 172.21.15.71:0/2442258018 learned_addr learned my addr 172.21.15.71:0/2442258018 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.874+0000 7f2c17fff640 1 --2- 172.21.15.71:0/2442258018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c200fd7f0 0x7f2c2010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.874+0000 7f2c1ffff640 1 -- 172.21.15.71:0/2442258018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c200fd7f0 msgr2=0x7f2c2010d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.874+0000 7f2c1ffff640 1 --2- 172.21.15.71:0/2442258018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c200fd7f0 0x7f2c2010d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:15.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.874+0000 7f2c1ffff640 1 -- 172.21.15.71:0/2442258018 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c10005040 con 0x7f2c200fc520 2024-09-10T10:07:15.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.874+0000 7f2c1ffff640 1 --2- 172.21.15.71:0/2442258018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200fc520 0x7f2c2010d080 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c100043d0 tx=0x7f2c10009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:15.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.874+0000 7f2c1d7fa640 1 -- 172.21.15.71:0/2442258018 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c10038070 con 0x7f2c200fc520 2024-09-10T10:07:15.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.874+0000 7f2c1d7fa640 1 -- 172.21.15.71:0/2442258018 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2c1002ae90 con 0x7f2c200fc520 2024-09-10T10:07:15.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.874+0000 7f2c2638b640 1 -- 172.21.15.71:0/2442258018 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2010e660 con 0x7f2c200fc520 2024-09-10T10:07:15.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.874+0000 7f2c1d7fa640 1 -- 172.21.15.71:0/2442258018 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c1003e670 con 0x7f2c200fc520 2024-09-10T10:07:15.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.874+0000 7f2c2638b640 1 -- 172.21.15.71:0/2442258018 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2010ec00 con 0x7f2c200fc520 2024-09-10T10:07:15.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.875+0000 7f2c2638b640 1 -- 172.21.15.71:0/2442258018 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c200fb980 con 0x7f2c200fc520 2024-09-10T10:07:15.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.876+0000 7f2c1d7fa640 1 -- 172.21.15.71:0/2442258018 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f2c10030020 con 0x7f2c200fc520 2024-09-10T10:07:15.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.877+0000 7f2c1d7fa640 1 --2- 172.21.15.71:0/2442258018 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2c0c06e1e0 0x7f2c0c070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:15.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.877+0000 7f2c1d7fa640 1 -- 172.21.15.71:0/2442258018 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2c100ade20 con 0x7f2c200fc520 2024-09-10T10:07:15.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.877+0000 7f2c17fff640 1 --2- 172.21.15.71:0/2442258018 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2c0c06e1e0 0x7f2c0c070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:15.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.877+0000 7f2c17fff640 1 --2- 172.21.15.71:0/2442258018 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2c0c06e1e0 0x7f2c0c070690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2c2010ce30 tx=0x7f2c0800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:15.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:15.881+0000 7f2c1d7fa640 1 -- 172.21.15.71:0/2442258018 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2c10077170 con 0x7f2c200fc520 2024-09-10T10:07:16.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.063+0000 7f2c2638b640 1 -- 172.21.15.71:0/2442258018 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c2010ef80 con 0x7f2c0c06e1e0 2024-09-10T10:07:16.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.065+0000 7f2c1d7fa640 1 -- 172.21.15.71:0/2442258018 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f2c2010ef80 con 0x7f2c0c06e1e0 2024-09-10T10:07:16.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.067+0000 7f2c2638b640 1 -- 172.21.15.71:0/2442258018 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2c0c06e1e0 msgr2=0x7f2c0c070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.067+0000 7f2c2638b640 1 --2- 172.21.15.71:0/2442258018 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2c0c06e1e0 0x7f2c0c070690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2c2010ce30 tx=0x7f2c0800b040 comp rx=0 tx=0).stop 2024-09-10T10:07:16.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.067+0000 7f2c2638b640 1 -- 172.21.15.71:0/2442258018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200fc520 msgr2=0x7f2c2010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.067+0000 7f2c2638b640 1 --2- 172.21.15.71:0/2442258018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200fc520 0x7f2c2010d080 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c100043d0 tx=0x7f2c10009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.067+0000 7f2c2638b640 1 -- 172.21.15.71:0/2442258018 shutdown_connections 2024-09-10T10:07:16.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.067+0000 7f2c2638b640 1 --2- 172.21.15.71:0/2442258018 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2c0c06e1e0 0x7f2c0c070690 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.067+0000 7f2c2638b640 1 --2- 172.21.15.71:0/2442258018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c200fd7f0 0x7f2c2010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.067+0000 7f2c2638b640 1 --2- 172.21.15.71:0/2442258018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200fc520 0x7f2c2010d080 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.067+0000 7f2c2638b640 1 -- 172.21.15.71:0/2442258018 >> 172.21.15.71:0/2442258018 conn(0x7f2c200f7ce0 msgr2=0x7f2c200f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:16.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.067+0000 7f2c2638b640 1 -- 172.21.15.71:0/2442258018 shutdown_connections 2024-09-10T10:07:16.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.067+0000 7f2c2638b640 1 -- 172.21.15.71:0/2442258018 wait complete. 2024-09-10T10:07:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.146+0000 7f68d3417640 1 -- 172.21.15.71:0/2622968691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68cc0fd490 msgr2=0x7f68cc0ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.146+0000 7f68d3417640 1 --2- 172.21.15.71:0/2622968691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68cc0fd490 0x7f68cc0ff910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0048d0 tx=0x7f68bc009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.146+0000 7f68d3417640 1 -- 172.21.15.71:0/2622968691 shutdown_connections 2024-09-10T10:07:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.146+0000 7f68d3417640 1 --2- 172.21.15.71:0/2622968691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68cc0fd490 0x7f68cc0ff910 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.146+0000 7f68d3417640 1 --2- 172.21.15.71:0/2622968691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68cc066730 0x7f68cc0fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.146+0000 7f68d3417640 1 -- 172.21.15.71:0/2622968691 >> 172.21.15.71:0/2622968691 conn(0x7f68cc0f6c10 msgr2=0x7f68cc0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.146+0000 7f68d3417640 1 -- 172.21.15.71:0/2622968691 shutdown_connections 2024-09-10T10:07:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.146+0000 7f68d3417640 1 -- 172.21.15.71:0/2622968691 wait complete. 2024-09-10T10:07:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.147+0000 7f68d3417640 1 Processor -- start 2024-09-10T10:07:16.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.147+0000 7f68d3417640 1 -- start start 2024-09-10T10:07:16.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.147+0000 7f68d3417640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68cc066730 0x7f68cc1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:16.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.147+0000 7f68d3417640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68cc0fd490 0x7f68cc113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:16.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.147+0000 7f68d3417640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc114260 con 0x7f68cc0fd490 2024-09-10T10:07:16.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.147+0000 7f68d3417640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc114a30 con 0x7f68cc066730 2024-09-10T10:07:16.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.147+0000 7f68d09b2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68cc0fd490 0x7f68cc113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:16.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.147+0000 7f68d09b2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68cc0fd490 0x7f68cc113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46888/0 (socket says 172.21.15.71:46888) 2024-09-10T10:07:16.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.147+0000 7f68d09b2640 1 -- 172.21.15.71:0/2418239047 learned_addr learned my addr 172.21.15.71:0/2418239047 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:16.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.147+0000 7f68d11b3640 1 --2- 172.21.15.71:0/2418239047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68cc066730 0x7f68cc1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:16.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.147+0000 7f68d09b2640 1 -- 172.21.15.71:0/2418239047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68cc066730 msgr2=0x7f68cc1136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.147+0000 7f68d09b2640 1 --2- 172.21.15.71:0/2418239047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68cc066730 0x7f68cc1136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.147+0000 7f68d09b2640 1 -- 172.21.15.71:0/2418239047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc005040 con 0x7f68cc0fd490 2024-09-10T10:07:16.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.148+0000 7f68d09b2640 1 --2- 172.21.15.71:0/2418239047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68cc0fd490 0x7f68cc113c10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0043d0 tx=0x7f68bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:16.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.148+0000 7f68c1ffb640 1 -- 172.21.15.71:0/2418239047 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68bc038070 con 0x7f68cc0fd490 2024-09-10T10:07:16.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.148+0000 7f68c1ffb640 1 -- 172.21.15.71:0/2418239047 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f68bc02ae90 con 0x7f68cc0fd490 2024-09-10T10:07:16.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.148+0000 7f68d3417640 1 -- 172.21.15.71:0/2418239047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc114c60 con 0x7f68cc0fd490 2024-09-10T10:07:16.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.148+0000 7f68c1ffb640 1 -- 172.21.15.71:0/2418239047 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68bc03e670 con 0x7f68cc0fd490 2024-09-10T10:07:16.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.148+0000 7f68d3417640 1 -- 172.21.15.71:0/2418239047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc115180 con 0x7f68cc0fd490 2024-09-10T10:07:16.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.149+0000 7f68d3417640 1 -- 172.21.15.71:0/2418239047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc0fa8b0 con 0x7f68cc0fd490 2024-09-10T10:07:16.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.149+0000 7f68c1ffb640 1 -- 172.21.15.71:0/2418239047 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f68bc030020 con 0x7f68cc0fd490 2024-09-10T10:07:16.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.150+0000 7f68c1ffb640 1 --2- 172.21.15.71:0/2418239047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f68b806e1e0 0x7f68b8070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:16.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.150+0000 7f68c1ffb640 1 -- 172.21.15.71:0/2418239047 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f68bc0adf40 con 0x7f68cc0fd490 2024-09-10T10:07:16.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.150+0000 7f68d11b3640 1 --2- 172.21.15.71:0/2418239047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f68b806e1e0 0x7f68b8070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:16.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.151+0000 7f68d11b3640 1 --2- 172.21.15.71:0/2418239047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f68b806e1e0 0x7f68b8070690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f68cc066490 tx=0x7f68c8009ef0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:16.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.154+0000 7f68c1ffb640 1 -- 172.21.15.71:0/2418239047 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f68bc0771e0 con 0x7f68cc0fd490 2024-09-10T10:07:16.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.331+0000 7f68d3417640 1 -- 172.21.15.71:0/2418239047 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f68cc115500 con 0x7f68b806e1e0 2024-09-10T10:07:16.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.340+0000 7f68c1ffb640 1 -- 172.21.15.71:0/2418239047 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f68cc115500 con 0x7f68b806e1e0 2024-09-10T10:07:16.341 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:07:16.341 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (2m) 46s ago 11m 17.1M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:07:16.341 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 starting - - - - 2024-09-10T10:07:16.341 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (10m) 34s ago 10m 6895k - 17.2.7-1597-g96d63e75 f3fc7d52e233 cf27ebcc0f98 2024-09-10T10:07:16.342 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (2m) 46s ago 10m 76.7M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:07:16.342 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (5m) 46s ago 5m 114M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:07:16.342 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (5m) 46s ago 5m 65.0M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:07:16.342 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (5m) 34s ago 5m 108M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:07:16.342 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (5m) 34s ago 5m 62.7M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:07:16.342 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (110s) 46s ago 12m 472M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:07:16.342 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (71s) 34s ago 10m 438M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:07:16.342 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (58s) 46s ago 12m 27.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:07:16.342 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (39s) 34s ago 10m 22.9M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:07:16.342 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (2m) 46s ago 11m 8414k - 1.5.0 0da6a335fe13 c3d47d79cd22 2024-09-10T10:07:16.342 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (117s) 34s ago 10m 14.6M - 1.5.0 0da6a335fe13 9a25165a0fd1 2024-09-10T10:07:16.342 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (9m) 46s ago 9m 224M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 a79e69c9b514 2024-09-10T10:07:16.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (8m) 46s ago 8m 234M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 44a84bf577da 2024-09-10T10:07:16.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (8m) 46s ago 8m 195M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 4fae52756a24 2024-09-10T10:07:16.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (8m) 34s ago 7m 269M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:07:16.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (7m) 34s ago 7m 229M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:07:16.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (7m) 34s ago 7m 227M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:07:16.343 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (77s) 46s ago 10m 50.2M - 2.43.0 a07b618ecd1d 47d3ae62ce5e 2024-09-10T10:07:16.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.342+0000 7f68d3417640 1 -- 172.21.15.71:0/2418239047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f68b806e1e0 msgr2=0x7f68b8070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.342+0000 7f68d3417640 1 --2- 172.21.15.71:0/2418239047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f68b806e1e0 0x7f68b8070690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f68cc066490 tx=0x7f68c8009ef0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.342+0000 7f68d3417640 1 -- 172.21.15.71:0/2418239047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68cc0fd490 msgr2=0x7f68cc113c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.342+0000 7f68d3417640 1 --2- 172.21.15.71:0/2418239047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68cc0fd490 0x7f68cc113c10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0043d0 tx=0x7f68bc009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.342+0000 7f68d3417640 1 -- 172.21.15.71:0/2418239047 shutdown_connections 2024-09-10T10:07:16.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.342+0000 7f68d3417640 1 --2- 172.21.15.71:0/2418239047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f68b806e1e0 0x7f68b8070690 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.342+0000 7f68d3417640 1 --2- 172.21.15.71:0/2418239047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68cc0fd490 0x7f68cc113c10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.342+0000 7f68d3417640 1 --2- 172.21.15.71:0/2418239047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68cc066730 0x7f68cc1136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.342+0000 7f68d3417640 1 -- 172.21.15.71:0/2418239047 >> 172.21.15.71:0/2418239047 conn(0x7f68cc0f6c10 msgr2=0x7f68cc0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:16.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.342+0000 7f68d3417640 1 -- 172.21.15.71:0/2418239047 shutdown_connections 2024-09-10T10:07:16.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.343+0000 7f68d3417640 1 -- 172.21.15.71:0/2418239047 wait complete. 2024-09-10T10:07:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.420+0000 7f369595b640 1 -- 172.21.15.71:0/470326959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36900fc720 msgr2=0x7f36900fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.420+0000 7f369595b640 1 --2- 172.21.15.71:0/470326959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36900fc720 0x7f36900fcb90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36840048d0 tx=0x7f3684009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.420+0000 7f369595b640 1 -- 172.21.15.71:0/470326959 shutdown_connections 2024-09-10T10:07:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.420+0000 7f369595b640 1 --2- 172.21.15.71:0/470326959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36900fc720 0x7f36900fcb90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.420+0000 7f369595b640 1 --2- 172.21.15.71:0/470326959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36900fb450 0x7f36900fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.420+0000 7f369595b640 1 -- 172.21.15.71:0/470326959 >> 172.21.15.71:0/470326959 conn(0x7f36900f6c30 msgr2=0x7f36900f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.420+0000 7f369595b640 1 -- 172.21.15.71:0/470326959 shutdown_connections 2024-09-10T10:07:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.420+0000 7f369595b640 1 -- 172.21.15.71:0/470326959 wait complete. 2024-09-10T10:07:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.421+0000 7f369595b640 1 Processor -- start 2024-09-10T10:07:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.421+0000 7f369595b640 1 -- start start 2024-09-10T10:07:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.421+0000 7f369595b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36900fb450 0x7f369010f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.421+0000 7f369595b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36900fc720 0x7f369010f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.421+0000 7f369595b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369010fe40 con 0x7f36900fb450 2024-09-10T10:07:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.421+0000 7f369595b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690110660 con 0x7f36900fc720 2024-09-10T10:07:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.421+0000 7f368effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36900fb450 0x7f369010f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.421+0000 7f368effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36900fb450 0x7f369010f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46908/0 (socket says 172.21.15.71:46908) 2024-09-10T10:07:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.421+0000 7f368effd640 1 -- 172.21.15.71:0/2349624879 learned_addr learned my addr 172.21.15.71:0/2349624879 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.422+0000 7f368e7fc640 1 --2- 172.21.15.71:0/2349624879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36900fc720 0x7f369010f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.422+0000 7f368effd640 1 -- 172.21.15.71:0/2349624879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36900fc720 msgr2=0x7f369010f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.422+0000 7f368effd640 1 --2- 172.21.15.71:0/2349624879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36900fc720 0x7f369010f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.422+0000 7f368effd640 1 -- 172.21.15.71:0/2349624879 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3684005040 con 0x7f36900fb450 2024-09-10T10:07:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.422+0000 7f368effd640 1 --2- 172.21.15.71:0/2349624879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36900fb450 0x7f369010f2b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f368000eb70 tx=0x7f368000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.422+0000 7f36777fe640 1 -- 172.21.15.71:0/2349624879 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3680007c30 con 0x7f36900fb450 2024-09-10T10:07:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.422+0000 7f36777fe640 1 -- 172.21.15.71:0/2349624879 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f368000f040 con 0x7f36900fb450 2024-09-10T10:07:16.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.422+0000 7f36777fe640 1 -- 172.21.15.71:0/2349624879 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f368000ca60 con 0x7f36900fb450 2024-09-10T10:07:16.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.422+0000 7f369595b640 1 -- 172.21.15.71:0/2349624879 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3690110890 con 0x7f36900fb450 2024-09-10T10:07:16.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.423+0000 7f369595b640 1 -- 172.21.15.71:0/2349624879 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3690110e30 con 0x7f36900fb450 2024-09-10T10:07:16.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.424+0000 7f369595b640 1 -- 172.21.15.71:0/2349624879 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36900fa8b0 con 0x7f36900fb450 2024-09-10T10:07:16.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.424+0000 7f36777fe640 1 -- 172.21.15.71:0/2349624879 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f368000cbc0 con 0x7f36900fb450 2024-09-10T10:07:16.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.424+0000 7f36777fe640 1 --2- 172.21.15.71:0/2349624879 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f367806e1e0 0x7f3678070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:16.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.424+0000 7f36777fe640 1 -- 172.21.15.71:0/2349624879 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f368008d980 con 0x7f36900fb450 2024-09-10T10:07:16.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.425+0000 7f368e7fc640 1 --2- 172.21.15.71:0/2349624879 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f367806e1e0 0x7f3678070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:16.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.425+0000 7f368e7fc640 1 --2- 172.21.15.71:0/2349624879 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f367806e1e0 0x7f3678070690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f369010f060 tx=0x7f3684035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:16.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.429+0000 7f36777fe640 1 -- 172.21.15.71:0/2349624879 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3680056bc0 con 0x7f36900fb450 2024-09-10T10:07:16.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.661+0000 7f369595b640 1 -- 172.21.15.71:0/2349624879 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f369004b720 con 0x7f36900fb450 2024-09-10T10:07:16.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.662+0000 7f36777fe640 1 -- 172.21.15.71:0/2349624879 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f368005a280 con 0x7f36900fb450 2024-09-10T10:07:16.663 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:07:16.663 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:07:16.663 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:07:16.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:07:16.664 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:07:16.664 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:07:16.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:07:16.664 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:07:16.664 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 6 2024-09-10T10:07:16.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:07:16.664 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:07:16.664 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:07:16.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:07:16.664 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:07:16.664 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 10, 2024-09-10T10:07:16.665 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T10:07:16.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:07:16.665 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:07:16.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.664+0000 7f369595b640 1 -- 172.21.15.71:0/2349624879 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f367806e1e0 msgr2=0x7f3678070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.664+0000 7f369595b640 1 --2- 172.21.15.71:0/2349624879 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f367806e1e0 0x7f3678070690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f369010f060 tx=0x7f3684035040 comp rx=0 tx=0).stop 2024-09-10T10:07:16.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.664+0000 7f369595b640 1 -- 172.21.15.71:0/2349624879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36900fb450 msgr2=0x7f369010f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.664+0000 7f369595b640 1 --2- 172.21.15.71:0/2349624879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36900fb450 0x7f369010f2b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f368000eb70 tx=0x7f368000b040 comp rx=0 tx=0).stop 2024-09-10T10:07:16.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.664+0000 7f369595b640 1 -- 172.21.15.71:0/2349624879 shutdown_connections 2024-09-10T10:07:16.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.664+0000 7f369595b640 1 --2- 172.21.15.71:0/2349624879 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f367806e1e0 0x7f3678070690 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.664+0000 7f369595b640 1 --2- 172.21.15.71:0/2349624879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36900fc720 0x7f369010f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.664+0000 7f369595b640 1 --2- 172.21.15.71:0/2349624879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36900fb450 0x7f369010f2b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.664+0000 7f369595b640 1 -- 172.21.15.71:0/2349624879 >> 172.21.15.71:0/2349624879 conn(0x7f36900f6c30 msgr2=0x7f3690066140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:16.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.664+0000 7f369595b640 1 -- 172.21.15.71:0/2349624879 shutdown_connections 2024-09-10T10:07:16.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.664+0000 7f369595b640 1 -- 172.21.15.71:0/2349624879 wait complete. 2024-09-10T10:07:16.731 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:16 smithi107 ceph-mon[79396]: Upgrade: Updating crash.smithi107 (2/2) 2024-09-10T10:07:16.732 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:16 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:16.732 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:16 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T10:07:16.732 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:16 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:16.732 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:16 smithi107 ceph-mon[79396]: Deploying daemon crash.smithi107 on smithi107 2024-09-10T10:07:16.732 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:16 smithi107 ceph-mon[79396]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:16.732 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:16 smithi107 ceph-mon[79396]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:16.732 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:16 smithi107 ceph-mon[79396]: pgmap v29: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:16.732 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:16 smithi107 ceph-mon[79396]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:16.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.742+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/3148676291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b980fb250 msgr2=0x7f4b980fdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.742+0000 7f4b9ef5c640 1 --2- 172.21.15.71:0/3148676291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b980fb250 0x7f4b980fdad0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4b840048d0 tx=0x7f4b84009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.742+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/3148676291 shutdown_connections 2024-09-10T10:07:16.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.742+0000 7f4b9ef5c640 1 --2- 172.21.15.71:0/3148676291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b980fb250 0x7f4b980fdad0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.742+0000 7f4b9ef5c640 1 --2- 172.21.15.71:0/3148676291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b980fa900 0x7f4b980fad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.742+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/3148676291 >> 172.21.15.71:0/3148676291 conn(0x7f4b980f6360 msgr2=0x7f4b980f8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:16.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.742+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/3148676291 shutdown_connections 2024-09-10T10:07:16.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.742+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/3148676291 wait complete. 2024-09-10T10:07:16.744 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:16 smithi071 ceph-mon[90773]: Upgrade: Updating crash.smithi107 (2/2) 2024-09-10T10:07:16.745 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:16 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:16.745 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:16 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi107", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T10:07:16.745 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:16 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:16.745 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:16 smithi071 ceph-mon[90773]: Deploying daemon crash.smithi107 on smithi107 2024-09-10T10:07:16.745 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:16 smithi071 ceph-mon[90773]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:16.745 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:16 smithi071 ceph-mon[90773]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:16.745 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:16 smithi071 ceph-mon[90773]: pgmap v29: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:16.745 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:16 smithi071 ceph-mon[90773]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:16.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.743+0000 7f4b9ef5c640 1 Processor -- start 2024-09-10T10:07:16.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.743+0000 7f4b9ef5c640 1 -- start start 2024-09-10T10:07:16.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.743+0000 7f4b9ef5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b980fa900 0x7f4b9810d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:16.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.743+0000 7f4b9ef5c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b980fb250 0x7f4b9810d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:16.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.743+0000 7f4b9ef5c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9810ddc0 con 0x7f4b980fb250 2024-09-10T10:07:16.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.743+0000 7f4b9ef5c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9810e5e0 con 0x7f4b980fa900 2024-09-10T10:07:16.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.743+0000 7f4b97fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b980fb250 0x7f4b9810d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:16.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.743+0000 7f4b97fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b980fb250 0x7f4b9810d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46932/0 (socket says 172.21.15.71:46932) 2024-09-10T10:07:16.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.743+0000 7f4b97fff640 1 -- 172.21.15.71:0/2323794715 learned_addr learned my addr 172.21.15.71:0/2323794715 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:16.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.744+0000 7f4b9ccf8640 1 --2- 172.21.15.71:0/2323794715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b980fa900 0x7f4b9810d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:16.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.744+0000 7f4b97fff640 1 -- 172.21.15.71:0/2323794715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b980fa900 msgr2=0x7f4b9810d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.744+0000 7f4b97fff640 1 --2- 172.21.15.71:0/2323794715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b980fa900 0x7f4b9810d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.744+0000 7f4b97fff640 1 -- 172.21.15.71:0/2323794715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84005040 con 0x7f4b980fb250 2024-09-10T10:07:16.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.744+0000 7f4b97fff640 1 --2- 172.21.15.71:0/2323794715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b980fb250 0x7f4b9810d770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b8402d040 tx=0x7f4b84009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:16.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.744+0000 7f4b957fa640 1 -- 172.21.15.71:0/2323794715 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b84038070 con 0x7f4b980fb250 2024-09-10T10:07:16.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.744+0000 7f4b957fa640 1 -- 172.21.15.71:0/2323794715 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b8402ae90 con 0x7f4b980fb250 2024-09-10T10:07:16.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.744+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/2323794715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9810e810 con 0x7f4b980fb250 2024-09-10T10:07:16.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.744+0000 7f4b957fa640 1 -- 172.21.15.71:0/2323794715 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b8403e670 con 0x7f4b980fb250 2024-09-10T10:07:16.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.744+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/2323794715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9810edb0 con 0x7f4b980fb250 2024-09-10T10:07:16.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.745+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/2323794715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9805ed70 con 0x7f4b980fb250 2024-09-10T10:07:16.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.746+0000 7f4b957fa640 1 -- 172.21.15.71:0/2323794715 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f4b84030020 con 0x7f4b980fb250 2024-09-10T10:07:16.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.747+0000 7f4b957fa640 1 --2- 172.21.15.71:0/2323794715 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4b8806e1e0 0x7f4b88070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:16.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.747+0000 7f4b957fa640 1 -- 172.21.15.71:0/2323794715 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4b840ade70 con 0x7f4b980fb250 2024-09-10T10:07:16.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.747+0000 7f4b9ccf8640 1 --2- 172.21.15.71:0/2323794715 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4b8806e1e0 0x7f4b88070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:16.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.747+0000 7f4b9ccf8640 1 --2- 172.21.15.71:0/2323794715 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4b8806e1e0 0x7f4b88070690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c004a70 tx=0x7f4b8c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:16.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.751+0000 7f4b957fa640 1 -- 172.21.15.71:0/2323794715 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4b84077090 con 0x7f4b980fb250 2024-09-10T10:07:16.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.950+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/2323794715 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4b98105230 con 0x7f4b980fb250 2024-09-10T10:07:16.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.950+0000 7f4b957fa640 1 -- 172.21.15.71:0/2323794715 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1972 (secure 0 0 0) 0x7f4b8407a750 con 0x7f4b980fb250 2024-09-10T10:07:16.952 INFO:teuthology.orchestra.run.smithi071.stdout:e23 2024-09-10T10:07:16.952 INFO:teuthology.orchestra.run.smithi071.stdout:btime 2024-09-10T10:07:03:646253+0000 2024-09-10T10:07:16.952 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:07:16.952 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:07:16.952 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:07:16.953 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:07:16.953 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:07:16.953 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:07:16.953 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 23 2024-09-10T10:07:16.953 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:07:16.953 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:07:16.953 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:07:03.646249+0000 2024-09-10T10:07:16.953 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:07:16.954 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:07:16.954 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:07:16.954 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:07:16.954 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:07:16.954 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:07:16.954 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:07:16.954 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:07:16.954 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:07:16.954 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:07:16.954 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:07:16.954 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:07:16.954 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:07:16.955 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:07:16.955 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:07:16.955 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:07:16.955 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:07:16.955 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:07:16.955 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:07:16.955 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:07:16.955 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:07:16.955 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:07:16.955 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 14464 members: 14464,24267 2024-09-10T10:07:16.955 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:07:16.956 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:07:16.956 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:07:16.956 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:07:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:07:16.956 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:07:16.957 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 23 2024-09-10T10:07:16.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.952+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/2323794715 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4b8806e1e0 msgr2=0x7f4b88070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.952+0000 7f4b9ef5c640 1 --2- 172.21.15.71:0/2323794715 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4b8806e1e0 0x7f4b88070690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c004a70 tx=0x7f4b8c00b040 comp rx=0 tx=0).stop 2024-09-10T10:07:16.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.952+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/2323794715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b980fb250 msgr2=0x7f4b9810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:16.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.952+0000 7f4b9ef5c640 1 --2- 172.21.15.71:0/2323794715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b980fb250 0x7f4b9810d770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b8402d040 tx=0x7f4b84009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.952+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/2323794715 shutdown_connections 2024-09-10T10:07:16.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.952+0000 7f4b9ef5c640 1 --2- 172.21.15.71:0/2323794715 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4b8806e1e0 0x7f4b88070690 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.952+0000 7f4b9ef5c640 1 --2- 172.21.15.71:0/2323794715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b980fb250 0x7f4b9810d770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.952+0000 7f4b9ef5c640 1 --2- 172.21.15.71:0/2323794715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b980fa900 0x7f4b9810d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:16.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.952+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/2323794715 >> 172.21.15.71:0/2323794715 conn(0x7f4b980f6360 msgr2=0x7f4b980f7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:16.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.952+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/2323794715 shutdown_connections 2024-09-10T10:07:16.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:16.953+0000 7f4b9ef5c640 1 -- 172.21.15.71:0/2323794715 wait complete. 2024-09-10T10:07:17.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.031+0000 7f346f654640 1 -- 172.21.15.71:0/435473230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34680fc720 msgr2=0x7f34680fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:17.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.031+0000 7f346f654640 1 --2- 172.21.15.71:0/435473230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34680fc720 0x7f34680fcb90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f34580048d0 tx=0x7f3458009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.031+0000 7f346f654640 1 -- 172.21.15.71:0/435473230 shutdown_connections 2024-09-10T10:07:17.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.031+0000 7f346f654640 1 --2- 172.21.15.71:0/435473230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34680fc720 0x7f34680fcb90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.031+0000 7f346f654640 1 --2- 172.21.15.71:0/435473230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34680fb450 0x7f34680fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.031+0000 7f346f654640 1 -- 172.21.15.71:0/435473230 >> 172.21.15.71:0/435473230 conn(0x7f34680f6c10 msgr2=0x7f34680f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:17.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.031+0000 7f346f654640 1 -- 172.21.15.71:0/435473230 shutdown_connections 2024-09-10T10:07:17.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.031+0000 7f346f654640 1 -- 172.21.15.71:0/435473230 wait complete. 2024-09-10T10:07:17.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.032+0000 7f346f654640 1 Processor -- start 2024-09-10T10:07:17.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.032+0000 7f346f654640 1 -- start start 2024-09-10T10:07:17.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.032+0000 7f346f654640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34680fb450 0x7f346810bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:17.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.032+0000 7f346f654640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34680fc720 0x7f346810c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:17.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.032+0000 7f346f654640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346810cb70 con 0x7f34680fc720 2024-09-10T10:07:17.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.032+0000 7f346f654640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346810d390 con 0x7f34680fb450 2024-09-10T10:07:17.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.033+0000 7f346cbef640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34680fc720 0x7f346810c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:17.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.033+0000 7f346d3f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34680fb450 0x7f346810bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:17.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.033+0000 7f346cbef640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34680fc720 0x7f346810c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46942/0 (socket says 172.21.15.71:46942) 2024-09-10T10:07:17.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.033+0000 7f346d3f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34680fb450 0x7f346810bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.71:45822/0 (socket says 172.21.15.71:45822) 2024-09-10T10:07:17.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.033+0000 7f346cbef640 1 -- 172.21.15.71:0/1514853408 learned_addr learned my addr 172.21.15.71:0/1514853408 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:17.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.033+0000 7f346cbef640 1 -- 172.21.15.71:0/1514853408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34680fb450 msgr2=0x7f346810bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:17.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.033+0000 7f346cbef640 1 --2- 172.21.15.71:0/1514853408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34680fb450 0x7f346810bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.033+0000 7f346cbef640 1 -- 172.21.15.71:0/1514853408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3458005040 con 0x7f34680fc720 2024-09-10T10:07:17.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.033+0000 7f346cbef640 1 --2- 172.21.15.71:0/1514853408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34680fc720 0x7f346810c520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3458004930 tx=0x7f3458009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:17.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.033+0000 7f345dffb640 1 -- 172.21.15.71:0/1514853408 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3458004290 con 0x7f34680fc720 2024-09-10T10:07:17.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.033+0000 7f345dffb640 1 -- 172.21.15.71:0/1514853408 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3458009880 con 0x7f34680fc720 2024-09-10T10:07:17.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.033+0000 7f346f654640 1 -- 172.21.15.71:0/1514853408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346810d5c0 con 0x7f34680fc720 2024-09-10T10:07:17.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.033+0000 7f345dffb640 1 -- 172.21.15.71:0/1514853408 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3458033890 con 0x7f34680fc720 2024-09-10T10:07:17.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.034+0000 7f346f654640 1 -- 172.21.15.71:0/1514853408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346810db60 con 0x7f34680fc720 2024-09-10T10:07:17.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.035+0000 7f346f654640 1 -- 172.21.15.71:0/1514853408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34680fa8b0 con 0x7f34680fc720 2024-09-10T10:07:17.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.035+0000 7f345dffb640 1 -- 172.21.15.71:0/1514853408 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f3458030020 con 0x7f34680fc720 2024-09-10T10:07:17.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.035+0000 7f345dffb640 1 --2- 172.21.15.71:0/1514853408 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f345406e1e0 0x7f3454070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:17.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.036+0000 7f345dffb640 1 -- 172.21.15.71:0/1514853408 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f34580adbf0 con 0x7f34680fc720 2024-09-10T10:07:17.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.036+0000 7f346d3f0640 1 --2- 172.21.15.71:0/1514853408 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f345406e1e0 0x7f3454070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:17.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.036+0000 7f346d3f0640 1 --2- 172.21.15.71:0/1514853408 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f345406e1e0 0x7f3454070690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3464009af0 tx=0x7f346400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:17.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.040+0000 7f345dffb640 1 -- 172.21.15.71:0/1514853408 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f34580b4080 con 0x7f34680fc720 2024-09-10T10:07:17.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.223+0000 7f346f654640 1 -- 172.21.15.71:0/1514853408 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f346810dee0 con 0x7f345406e1e0 2024-09-10T10:07:17.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.225+0000 7f345dffb640 1 -- 172.21.15.71:0/1514853408 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f346810dee0 con 0x7f345406e1e0 2024-09-10T10:07:17.226 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:07:17.226 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:07:17.226 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:07:17.226 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:07:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:07:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-10T10:07:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-10T10:07:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:07:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "4/21 daemons upgraded", 2024-09-10T10:07:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading crash daemons", 2024-09-10T10:07:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:07:17.227 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:07:17.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.227+0000 7f346f654640 1 -- 172.21.15.71:0/1514853408 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f345406e1e0 msgr2=0x7f3454070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:17.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.227+0000 7f346f654640 1 --2- 172.21.15.71:0/1514853408 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f345406e1e0 0x7f3454070690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3464009af0 tx=0x7f346400b040 comp rx=0 tx=0).stop 2024-09-10T10:07:17.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.227+0000 7f346f654640 1 -- 172.21.15.71:0/1514853408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34680fc720 msgr2=0x7f346810c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:17.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.227+0000 7f346f654640 1 --2- 172.21.15.71:0/1514853408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34680fc720 0x7f346810c520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3458004930 tx=0x7f3458009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.227+0000 7f346f654640 1 -- 172.21.15.71:0/1514853408 shutdown_connections 2024-09-10T10:07:17.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.227+0000 7f346f654640 1 --2- 172.21.15.71:0/1514853408 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f345406e1e0 0x7f3454070690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.227+0000 7f346f654640 1 --2- 172.21.15.71:0/1514853408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34680fc720 0x7f346810c520 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.227+0000 7f346f654640 1 --2- 172.21.15.71:0/1514853408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34680fb450 0x7f346810bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.227+0000 7f346f654640 1 -- 172.21.15.71:0/1514853408 >> 172.21.15.71:0/1514853408 conn(0x7f34680f6c10 msgr2=0x7f34680f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:17.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.227+0000 7f346f654640 1 -- 172.21.15.71:0/1514853408 shutdown_connections 2024-09-10T10:07:17.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.227+0000 7f346f654640 1 -- 172.21.15.71:0/1514853408 wait complete. 2024-09-10T10:07:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.306+0000 7fb71489c640 1 -- 172.21.15.71:0/4232756167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7100fd800 msgr2=0x7fb7100fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.306+0000 7fb71489c640 1 --2- 172.21.15.71:0/4232756167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7100fd800 0x7fb7100fdc70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80048d0 tx=0x7fb6f8009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.306+0000 7fb71489c640 1 -- 172.21.15.71:0/4232756167 shutdown_connections 2024-09-10T10:07:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.306+0000 7fb71489c640 1 --2- 172.21.15.71:0/4232756167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7100fd800 0x7fb7100fdc70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.306+0000 7fb71489c640 1 --2- 172.21.15.71:0/4232756167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7100fc530 0x7fb7100fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.306+0000 7fb71489c640 1 -- 172.21.15.71:0/4232756167 >> 172.21.15.71:0/4232756167 conn(0x7fb7100f7d10 msgr2=0x7fb7100fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.306+0000 7fb71489c640 1 -- 172.21.15.71:0/4232756167 shutdown_connections 2024-09-10T10:07:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.306+0000 7fb71489c640 1 -- 172.21.15.71:0/4232756167 wait complete. 2024-09-10T10:07:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.307+0000 7fb71489c640 1 Processor -- start 2024-09-10T10:07:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.307+0000 7fb71489c640 1 -- start start 2024-09-10T10:07:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.307+0000 7fb71489c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7100fc530 0x7fb71010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.307+0000 7fb71489c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7100fd800 0x7fb71010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.307+0000 7fb71489c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71010dc30 con 0x7fb7100fd800 2024-09-10T10:07:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.307+0000 7fb71489c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71010e450 con 0x7fb7100fc530 2024-09-10T10:07:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.307+0000 7fb70dd9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7100fd800 0x7fb71010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:17.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.307+0000 7fb70dd9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7100fd800 0x7fb71010d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46960/0 (socket says 172.21.15.71:46960) 2024-09-10T10:07:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.307+0000 7fb70dd9b640 1 -- 172.21.15.71:0/106969627 learned_addr learned my addr 172.21.15.71:0/106969627 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.307+0000 7fb70e59c640 1 --2- 172.21.15.71:0/106969627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7100fc530 0x7fb71010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.307+0000 7fb70dd9b640 1 -- 172.21.15.71:0/106969627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7100fc530 msgr2=0x7fb71010d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.307+0000 7fb70dd9b640 1 --2- 172.21.15.71:0/106969627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7100fc530 0x7fb71010d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.307+0000 7fb70dd9b640 1 -- 172.21.15.71:0/106969627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f8005040 con 0x7fb7100fd800 2024-09-10T10:07:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.308+0000 7fb70dd9b640 1 --2- 172.21.15.71:0/106969627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7100fd800 0x7fb71010d5e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80043d0 tx=0x7fb6f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.308+0000 7fb706ffd640 1 -- 172.21.15.71:0/106969627 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6f8038070 con 0x7fb7100fd800 2024-09-10T10:07:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.308+0000 7fb71489c640 1 -- 172.21.15.71:0/106969627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71010e680 con 0x7fb7100fd800 2024-09-10T10:07:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.308+0000 7fb706ffd640 1 -- 172.21.15.71:0/106969627 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb6f8009800 con 0x7fb7100fd800 2024-09-10T10:07:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.308+0000 7fb706ffd640 1 -- 172.21.15.71:0/106969627 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6f803e670 con 0x7fb7100fd800 2024-09-10T10:07:17.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.308+0000 7fb71489c640 1 -- 172.21.15.71:0/106969627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71010ec20 con 0x7fb7100fd800 2024-09-10T10:07:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.309+0000 7fb71489c640 1 -- 172.21.15.71:0/106969627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7100fb990 con 0x7fb7100fd800 2024-09-10T10:07:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.309+0000 7fb706ffd640 1 -- 172.21.15.71:0/106969627 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fb6f8030020 con 0x7fb7100fd800 2024-09-10T10:07:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.310+0000 7fb706ffd640 1 --2- 172.21.15.71:0/106969627 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb6fc06e1e0 0x7fb6fc070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.310+0000 7fb706ffd640 1 -- 172.21.15.71:0/106969627 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb6f80adf40 con 0x7fb7100fd800 2024-09-10T10:07:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.310+0000 7fb70e59c640 1 --2- 172.21.15.71:0/106969627 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb6fc06e1e0 0x7fb6fc070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.310+0000 7fb70e59c640 1 --2- 172.21.15.71:0/106969627 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb6fc06e1e0 0x7fb6fc070690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb708004fd0 tx=0x7fb708009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:17.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.314+0000 7fb706ffd640 1 -- 172.21.15.71:0/106969627 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb6f8077210 con 0x7fb7100fd800 2024-09-10T10:07:17.520 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:17 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2349624879' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:17.520 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:17 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2323794715' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:07:17.520 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:17 smithi107 ceph-mon[79396]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:17.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.545+0000 7fb71489c640 1 -- 172.21.15.71:0/106969627 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb710104f60 con 0x7fb7100fd800 2024-09-10T10:07:17.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.545+0000 7fb706ffd640 1 -- 172.21.15.71:0/106969627 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb6f807a8d0 con 0x7fb7100fd800 2024-09-10T10:07:17.546 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:07:17.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.547+0000 7fb71489c640 1 -- 172.21.15.71:0/106969627 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb6fc06e1e0 msgr2=0x7fb6fc070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:17.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.547+0000 7fb71489c640 1 --2- 172.21.15.71:0/106969627 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb6fc06e1e0 0x7fb6fc070690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb708004fd0 tx=0x7fb708009040 comp rx=0 tx=0).stop 2024-09-10T10:07:17.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.547+0000 7fb71489c640 1 -- 172.21.15.71:0/106969627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7100fd800 msgr2=0x7fb71010d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:17.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.547+0000 7fb71489c640 1 --2- 172.21.15.71:0/106969627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7100fd800 0x7fb71010d5e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80043d0 tx=0x7fb6f8009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.547+0000 7fb71489c640 1 -- 172.21.15.71:0/106969627 shutdown_connections 2024-09-10T10:07:17.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.547+0000 7fb71489c640 1 --2- 172.21.15.71:0/106969627 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb6fc06e1e0 0x7fb6fc070690 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.547+0000 7fb71489c640 1 --2- 172.21.15.71:0/106969627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7100fd800 0x7fb71010d5e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.547+0000 7fb71489c640 1 --2- 172.21.15.71:0/106969627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7100fc530 0x7fb71010d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:17.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.547+0000 7fb71489c640 1 -- 172.21.15.71:0/106969627 >> 172.21.15.71:0/106969627 conn(0x7fb7100f7d10 msgr2=0x7fb7100f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:17.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.547+0000 7fb71489c640 1 -- 172.21.15.71:0/106969627 shutdown_connections 2024-09-10T10:07:17.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:17.547+0000 7fb71489c640 1 -- 172.21.15.71:0/106969627 wait complete. 2024-09-10T10:07:17.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:17 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2349624879' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:17.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:17 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2323794715' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:07:17.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:17 smithi071 ceph-mon[90773]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:18.715 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:18 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/106969627' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:07:18.715 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:18 smithi107 ceph-mon[79396]: pgmap v30: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:18.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:18 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/106969627' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:07:18.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:18 smithi071 ceph-mon[90773]: pgmap v30: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:20.145 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:19 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:20.145 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:19 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:20.145 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:19 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:20.145 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:19 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:20.146 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:19 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:20.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:19 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:20.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:19 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:20.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:19 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:20.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:19 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:20.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:19 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:21.136 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:20 smithi071 ceph-mon[90773]: pgmap v31: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:21.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:20 smithi107 ceph-mon[79396]: pgmap v31: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:23.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:23.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:23.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:22 smithi107 ceph-mon[79396]: pgmap v32: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:23.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:23.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:23.180 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:23.180 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:23.180 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:22 smithi071 ceph-mon[90773]: pgmap v32: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:23.180 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:23.181 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:24.741 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:24.741 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:24.741 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:24 smithi071 ceph-mon[90773]: pgmap v33: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:24.741 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:07:24.741 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:24.741 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:25.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:25.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:25.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:24 smithi107 ceph-mon[79396]: pgmap v33: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:25.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:07:25.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:25.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:26.799 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:26.799 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:26.799 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:26 smithi071 ceph-mon[90773]: pgmap v34: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:26.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:26.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:26.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:26 smithi107 ceph-mon[79396]: pgmap v34: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:28.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:28.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:28.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:28.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:28.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:28.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:28.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:28.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:28.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:28.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: Upgrade: Setting container_image for all crash 2024-09-10T10:07:28.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:28.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi071"}]: dispatch 2024-09-10T10:07:28.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi071"}]': finished 2024-09-10T10:07:28.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi107"}]: dispatch 2024-09-10T10:07:28.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi107"}]': finished 2024-09-10T10:07:28.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-10T10:07:28.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-10T10:07:28.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: Upgrade: osd.0 is safe to restart 2024-09-10T10:07:28.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:28 smithi071 ceph-mon[90773]: pgmap v35: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:28.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: Upgrade: Setting container_image for all crash 2024-09-10T10:07:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi071"}]: dispatch 2024-09-10T10:07:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi071"}]': finished 2024-09-10T10:07:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi107"}]: dispatch 2024-09-10T10:07:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi107"}]': finished 2024-09-10T10:07:28.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-10T10:07:28.898 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-10T10:07:28.898 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: Upgrade: osd.0 is safe to restart 2024-09-10T10:07:28.898 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:28 smithi107 ceph-mon[79396]: pgmap v35: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:30.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:29 smithi107 ceph-mon[79396]: Upgrade: Updating osd.0 2024-09-10T10:07:30.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:29 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:30.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:29 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T10:07:30.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:29 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:30.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:29 smithi107 ceph-mon[79396]: Deploying daemon osd.0 on smithi071 2024-09-10T10:07:30.146 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:29 smithi071 ceph-mon[90773]: Upgrade: Updating osd.0 2024-09-10T10:07:30.146 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:29 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:30.147 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:29 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T10:07:30.147 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:29 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:30.147 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:29 smithi071 ceph-mon[90773]: Deploying daemon osd.0 on smithi071 2024-09-10T10:07:30.986 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:30 smithi071 ceph-mon[90773]: pgmap v36: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:31.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:30 smithi107 ceph-mon[79396]: pgmap v36: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:07:32.172 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:31 smithi071 systemd[1]: Stopping Ceph osd.0 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:07:32.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:32 smithi071 ceph-mon[90773]: osd.0 marked itself down and dead 2024-09-10T10:07:32.539 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:32 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0[46558]: 2024-09-10T10:07:32.170+0000 7f7232cba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:07:32.539 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:32 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0[46558]: 2024-09-10T10:07:32.170+0000 7f7232cba640 -1 osd.0 48 *** Got signal Terminated *** 2024-09-10T10:07:32.539 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:32 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0[46558]: 2024-09-10T10:07:32.170+0000 7f7232cba640 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:07:32.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:32 smithi107 ceph-mon[79396]: osd.0 marked itself down and dead 2024-09-10T10:07:32.981 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:32 smithi071 podman[98827]: 2024-09-10 10:07:32.682522187 +0000 UTC m=+0.625086045 container died a79e69c9b51473e6987d7e648d0efe35eea0e1340134fad3e563ddcfe7d5a5b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-96d63e7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T10:07:33.233 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:33 smithi071 podman[98827]: 2024-09-10 10:07:33.070745921 +0000 UTC m=+1.013309777 container cleanup a79e69c9b51473e6987d7e648d0efe35eea0e1340134fad3e563ddcfe7d5a5b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=quincy-96d63e7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T10:07:33.233 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:33 smithi071 bash[98827]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0 2024-09-10T10:07:33.505 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:33 smithi071 podman[98842]: 2024-09-10 10:07:33.305571229 +0000 UTC m=+0.625992611 container remove a79e69c9b51473e6987d7e648d0efe35eea0e1340134fad3e563ddcfe7d5a5b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-96d63e7) 2024-09-10T10:07:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:33 smithi071 ceph-mon[90773]: pgmap v37: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:33 smithi071 ceph-mon[90773]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T10:07:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:33 smithi071 ceph-mon[90773]: osdmap e49: 6 total, 5 up, 6 in 2024-09-10T10:07:33.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:33 smithi071 ceph-mon[90773]: osdmap e50: 6 total, 5 up, 6 in 2024-09-10T10:07:33.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:33 smithi107 ceph-mon[79396]: pgmap v37: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:07:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:33 smithi107 ceph-mon[79396]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T10:07:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:33 smithi107 ceph-mon[79396]: osdmap e49: 6 total, 5 up, 6 in 2024-09-10T10:07:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:33 smithi107 ceph-mon[79396]: osdmap e50: 6 total, 5 up, 6 in 2024-09-10T10:07:33.756 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:33 smithi071 podman[98930]: 2024-09-10 10:07:33.531395493 +0000 UTC m=+0.015631219 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:07:33.756 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:33 smithi071 podman[98930]: 2024-09-10 10:07:33.639682901 +0000 UTC m=+0.123918630 container create a0491c6b88f87e880503b6a5389ab291b0f23b237ba32fcad31c85f956eb87a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T10:07:34.039 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:33 smithi071 podman[98930]: 2024-09-10 10:07:33.917093145 +0000 UTC m=+0.401328874 container init a0491c6b88f87e880503b6a5389ab291b0f23b237ba32fcad31c85f956eb87a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-10T10:07:34.039 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:33 smithi071 podman[98930]: 2024-09-10 10:07:33.920407088 +0000 UTC m=+0.404642816 container start a0491c6b88f87e880503b6a5389ab291b0f23b237ba32fcad31c85f956eb87a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T10:07:34.039 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:33 smithi071 podman[98930]: 2024-09-10 10:07:33.994196075 +0000 UTC m=+0.478431812 container attach a0491c6b88f87e880503b6a5389ab291b0f23b237ba32fcad31c85f956eb87a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T10:07:34.390 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:34 smithi071 podman[98930]: 2024-09-10 10:07:34.105349349 +0000 UTC m=+0.589585077 container died a0491c6b88f87e880503b6a5389ab291b0f23b237ba32fcad31c85f956eb87a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:07:34.642 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:34 smithi071 podman[98953]: 2024-09-10 10:07:34.639507303 +0000 UTC m=+0.527840696 container remove a0491c6b88f87e880503b6a5389ab291b0f23b237ba32fcad31c85f956eb87a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T10:07:35.039 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:34 smithi071 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-10T10:07:35.039 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:34 smithi071 systemd[1]: Stopped Ceph osd.0 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:07:35.039 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:34 smithi071 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.0.service: Consumed 58.512s CPU time. 2024-09-10T10:07:35.039 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:34 smithi071 systemd[1]: Starting Ceph osd.0 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:07:35.352 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:35 smithi071 ceph-mon[90773]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T10:07:35.353 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:35 smithi071 podman[99050]: 2024-09-10 10:07:34.976610399 +0000 UTC m=+0.015859864 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:07:35.353 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:35 smithi071 podman[99050]: 2024-09-10 10:07:35.107323702 +0000 UTC m=+0.146573152 container create 99e5f530413d246bb465c26081199a0d106103f74d0a792a87c89a21712fd84a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T10:07:35.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:35 smithi107 ceph-mon[79396]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T10:07:35.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:35 smithi071 podman[99050]: 2024-09-10 10:07:35.352085753 +0000 UTC m=+0.391335219 container init 99e5f530413d246bb465c26081199a0d106103f74d0a792a87c89a21712fd84a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:07:35.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:35 smithi071 podman[99050]: 2024-09-10 10:07:35.35579939 +0000 UTC m=+0.395048843 container start 99e5f530413d246bb465c26081199a0d106103f74d0a792a87c89a21712fd84a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T10:07:35.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:35 smithi071 podman[99050]: 2024-09-10 10:07:35.426538612 +0000 UTC m=+0.465788065 container attach 99e5f530413d246bb465c26081199a0d106103f74d0a792a87c89a21712fd84a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T10:07:35.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:35 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate[99065]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:07:35.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:35 smithi071 bash[99050]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:07:35.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:35 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate[99065]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:07:35.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:35 smithi071 bash[99050]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:07:36.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:36 smithi071 ceph-mon[90773]: Health check failed: Degraded data redundancy: 63/321 objects degraded (19.626%), 19 pgs degraded (PG_DEGRADED) 2024-09-10T10:07:36.507 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate[99065]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T10:07:36.507 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 bash[99050]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T10:07:36.507 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate[99065]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-10T10:07:36.507 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 bash[99050]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-10T10:07:36.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:36 smithi107 ceph-mon[79396]: Health check failed: Degraded data redundancy: 63/321 objects degraded (19.626%), 19 pgs degraded (PG_DEGRADED) 2024-09-10T10:07:36.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate[99065]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-10T10:07:36.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 bash[99050]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-10T10:07:36.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate[99065]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-10T10:07:36.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 bash[99050]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-10T10:07:36.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate[99065]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-10T10:07:36.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 bash[99050]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-10T10:07:36.790 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate[99065]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T10:07:36.790 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 bash[99050]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T10:07:36.790 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate[99065]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-10T10:07:36.790 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 bash[99050]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-10T10:07:36.790 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:36 smithi071 podman[99050]: 2024-09-10 10:07:36.534037802 +0000 UTC m=+1.573287263 container died 99e5f530413d246bb465c26081199a0d106103f74d0a792a87c89a21712fd84a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T10:07:37.443 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:37 smithi071 ceph-mon[90773]: pgmap v41: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 63/321 objects degraded (19.626%) 2024-09-10T10:07:37.443 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:37 smithi071 podman[99214]: 2024-09-10 10:07:37.10549084 +0000 UTC m=+0.560380714 container remove 99e5f530413d246bb465c26081199a0d106103f74d0a792a87c89a21712fd84a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T10:07:37.443 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:37 smithi071 podman[99273]: 2024-09-10 10:07:37.215051532 +0000 UTC m=+0.015666929 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:07:37.443 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:37 smithi071 podman[99273]: 2024-09-10 10:07:37.348194565 +0000 UTC m=+0.148809937 container create f1e9da1144c1afa06905ce2a8191338e457c22dcadd7f799d40213675bbc94cd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:07:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:37 smithi107 ceph-mon[79396]: pgmap v41: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 63/321 objects degraded (19.626%) 2024-09-10T10:07:37.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:37 smithi071 podman[99273]: 2024-09-10 10:07:37.558656407 +0000 UTC m=+0.359271788 container init f1e9da1144c1afa06905ce2a8191338e457c22dcadd7f799d40213675bbc94cd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T10:07:37.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:37 smithi071 podman[99273]: 2024-09-10 10:07:37.561885857 +0000 UTC m=+0.362501232 container start f1e9da1144c1afa06905ce2a8191338e457c22dcadd7f799d40213675bbc94cd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:07:37.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:37 smithi071 ceph-osd[99292]: -- 172.21.15.71:0/1798579791 <== mon.0 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564531c641e0 con 0x564531bfa000 2024-09-10T10:07:37.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:37 smithi071 bash[99273]: f1e9da1144c1afa06905ce2a8191338e457c22dcadd7f799d40213675bbc94cd 2024-09-10T10:07:37.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:37 smithi071 systemd[1]: Started Ceph osd.0 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:07:39.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:38 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:39.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:38 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:39.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:38 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:39.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:38 smithi071 ceph-mon[90773]: pgmap v42: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-09-10T10:07:39.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:38 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:39.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:38 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:39.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:38 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:39.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:38 smithi107 ceph-mon[79396]: pgmap v42: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-09-10T10:07:39.788 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:39 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0[99288]: 2024-09-10T10:07:39.443+0000 7fd11e5da640 -1 Falling back to public interface 2024-09-10T10:07:40.310 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:40 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:40.311 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:40 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:07:40.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:40 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:40.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:40 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:07:41.469 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:41 smithi071 ceph-mon[90773]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 63/321 objects degraded (19.626%) 2024-09-10T10:07:41.469 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:41 smithi071 ceph-mon[90773]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:07:41.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:41 smithi107 ceph-mon[79396]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 63/321 objects degraded (19.626%) 2024-09-10T10:07:41.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:41 smithi107 ceph-mon[79396]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby-replay 2024-09-10T10:07:43.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:43 smithi071 ceph-mon[90773]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 63/321 objects degraded (19.626%) 2024-09-10T10:07:43.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:43 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:43.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:43 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:43.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:43 smithi107 ceph-mon[79396]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 63/321 objects degraded (19.626%) 2024-09-10T10:07:43.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:43 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:43.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:43 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:44.730 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:44 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:44.730 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:44 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:44.730 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:44 smithi071 ceph-mon[90773]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 63/321 objects degraded (19.626%) 2024-09-10T10:07:44.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:44 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:44.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:44 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:44.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:44 smithi107 ceph-mon[79396]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 63/321 objects degraded (19.626%) 2024-09-10T10:07:45.288 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:45 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0[99288]: 2024-09-10T10:07:45.124+0000 7fd11e5da640 -1 osd.0 48 log_to_monitors true 2024-09-10T10:07:45.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:45 smithi071 ceph-mon[90773]: from='osd.0 [v2:172.21.15.71:6802/392545558,v1:172.21.15.71:6803/392545558]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:07:45.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:45 smithi107 ceph-mon[79396]: from='osd.0 [v2:172.21.15.71:6802/392545558,v1:172.21.15.71:6803/392545558]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:07:46.789 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:07:46 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0[99288]: 2024-09-10T10:07:46.294+0000 7fd11236c640 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:07:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:46 smithi071 ceph-mon[90773]: from='osd.0 [v2:172.21.15.71:6802/392545558,v1:172.21.15.71:6803/392545558]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T10:07:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:46 smithi071 ceph-mon[90773]: osdmap e51: 6 total, 5 up, 6 in 2024-09-10T10:07:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:46 smithi071 ceph-mon[90773]: from='osd.0 [v2:172.21.15.71:6802/392545558,v1:172.21.15.71:6803/392545558]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-10T10:07:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:46 smithi071 ceph-mon[90773]: pgmap v47: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 63/321 objects degraded (19.626%) 2024-09-10T10:07:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:46 smithi071 ceph-mon[90773]: from='osd.0 [v2:172.21.15.71:6802/392545558,v1:172.21.15.71:6803/392545558]' entity='osd.0' 2024-09-10T10:07:46.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:46 smithi107 ceph-mon[79396]: from='osd.0 [v2:172.21.15.71:6802/392545558,v1:172.21.15.71:6803/392545558]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T10:07:46.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:46 smithi107 ceph-mon[79396]: osdmap e51: 6 total, 5 up, 6 in 2024-09-10T10:07:46.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:46 smithi107 ceph-mon[79396]: from='osd.0 [v2:172.21.15.71:6802/392545558,v1:172.21.15.71:6803/392545558]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-10T10:07:46.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:46 smithi107 ceph-mon[79396]: pgmap v47: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 63/321 objects degraded (19.626%) 2024-09-10T10:07:46.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:46 smithi107 ceph-mon[79396]: from='osd.0 [v2:172.21.15.71:6802/392545558,v1:172.21.15.71:6803/392545558]' entity='osd.0' 2024-09-10T10:07:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.628+0000 7ff11d6f6640 1 -- 172.21.15.71:0/944965961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1180fdba0 msgr2=0x7ff1180fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.628+0000 7ff11d6f6640 1 --2- 172.21.15.71:0/944965961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1180fdba0 0x7ff1180fdfb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff1080048d0 tx=0x7ff108009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.628+0000 7ff11d6f6640 1 -- 172.21.15.71:0/944965961 shutdown_connections 2024-09-10T10:07:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.628+0000 7ff11d6f6640 1 --2- 172.21.15.71:0/944965961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1180fe4f0 0x7ff1180fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.628+0000 7ff11d6f6640 1 --2- 172.21.15.71:0/944965961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1180fdba0 0x7ff1180fdfb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.628+0000 7ff11d6f6640 1 -- 172.21.15.71:0/944965961 >> 172.21.15.71:0/944965961 conn(0x7ff1180f63a0 msgr2=0x7ff1180f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:47.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.628+0000 7ff11d6f6640 1 -- 172.21.15.71:0/944965961 shutdown_connections 2024-09-10T10:07:47.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.628+0000 7ff11d6f6640 1 -- 172.21.15.71:0/944965961 wait complete. 2024-09-10T10:07:47.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.628+0000 7ff11d6f6640 1 Processor -- start 2024-09-10T10:07:47.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.628+0000 7ff11d6f6640 1 -- start start 2024-09-10T10:07:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff11d6f6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1180fdba0 0x7ff1180fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff11d6f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1180fe4f0 0x7ff1180fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff11d6f6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180fbe10 con 0x7ff1180fdba0 2024-09-10T10:07:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff11d6f6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180fbf50 con 0x7ff1180fe4f0 2024-09-10T10:07:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff116ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1180fdba0 0x7ff1180fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff116ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1180fdba0 0x7ff1180fd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46740/0 (socket says 172.21.15.71:46740) 2024-09-10T10:07:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff116ffd640 1 -- 172.21.15.71:0/3488149756 learned_addr learned my addr 172.21.15.71:0/3488149756 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff1167fc640 1 --2- 172.21.15.71:0/3488149756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1180fe4f0 0x7ff1180fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff116ffd640 1 -- 172.21.15.71:0/3488149756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1180fe4f0 msgr2=0x7ff1180fb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff116ffd640 1 --2- 172.21.15.71:0/3488149756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1180fe4f0 0x7ff1180fb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff116ffd640 1 -- 172.21.15.71:0/3488149756 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff108005040 con 0x7ff1180fdba0 2024-09-10T10:07:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff116ffd640 1 --2- 172.21.15.71:0/3488149756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1180fdba0 0x7ff1180fd390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff108003080 tx=0x7ff108009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:47.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff0ff7fe640 1 -- 172.21.15.71:0/3488149756 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff108038070 con 0x7ff1180fdba0 2024-09-10T10:07:47.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff0ff7fe640 1 -- 172.21.15.71:0/3488149756 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff10802abd0 con 0x7ff1180fdba0 2024-09-10T10:07:47.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff11d6f6640 1 -- 172.21.15.71:0/3488149756 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1180fc1d0 con 0x7ff1180fdba0 2024-09-10T10:07:47.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff0ff7fe640 1 -- 172.21.15.71:0/3488149756 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff10803e670 con 0x7ff1180fdba0 2024-09-10T10:07:47.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.629+0000 7ff11d6f6640 1 -- 172.21.15.71:0/3488149756 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1181150c0 con 0x7ff1180fdba0 2024-09-10T10:07:47.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.630+0000 7ff11d6f6640 1 -- 172.21.15.71:0/3488149756 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11804b720 con 0x7ff1180fdba0 2024-09-10T10:07:47.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.631+0000 7ff0ff7fe640 1 -- 172.21.15.71:0/3488149756 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7ff108030020 con 0x7ff1180fdba0 2024-09-10T10:07:47.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.631+0000 7ff0ff7fe640 1 --2- 172.21.15.71:0/3488149756 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff10006e1e0 0x7ff100070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:47.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.631+0000 7ff0ff7fe640 1 -- 172.21.15.71:0/3488149756 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff1080ae120 con 0x7ff1180fdba0 2024-09-10T10:07:47.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.631+0000 7ff1167fc640 1 --2- 172.21.15.71:0/3488149756 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff10006e1e0 0x7ff100070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:47.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.632+0000 7ff1167fc640 1 --2- 172.21.15.71:0/3488149756 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff10006e1e0 0x7ff100070690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff10c0041d0 tx=0x7ff10c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.636+0000 7ff0ff7fe640 1 -- 172.21.15.71:0/3488149756 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff108077340 con 0x7ff1180fdba0 2024-09-10T10:07:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.823+0000 7ff11d6f6640 1 -- 172.21.15.71:0/3488149756 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1180fc360 con 0x7ff10006e1e0 2024-09-10T10:07:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.824+0000 7ff0ff7fe640 1 -- 172.21.15.71:0/3488149756 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff1180fc360 con 0x7ff10006e1e0 2024-09-10T10:07:47.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.826+0000 7ff11d6f6640 1 -- 172.21.15.71:0/3488149756 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff10006e1e0 msgr2=0x7ff100070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.826+0000 7ff11d6f6640 1 --2- 172.21.15.71:0/3488149756 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff10006e1e0 0x7ff100070690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff10c0041d0 tx=0x7ff10c009040 comp rx=0 tx=0).stop 2024-09-10T10:07:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.826+0000 7ff11d6f6640 1 -- 172.21.15.71:0/3488149756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1180fdba0 msgr2=0x7ff1180fd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.826+0000 7ff11d6f6640 1 --2- 172.21.15.71:0/3488149756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1180fdba0 0x7ff1180fd390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff108003080 tx=0x7ff108009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.826+0000 7ff11d6f6640 1 -- 172.21.15.71:0/3488149756 shutdown_connections 2024-09-10T10:07:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.826+0000 7ff11d6f6640 1 --2- 172.21.15.71:0/3488149756 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff10006e1e0 0x7ff100070690 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.826+0000 7ff11d6f6640 1 --2- 172.21.15.71:0/3488149756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1180fe4f0 0x7ff1180fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.826+0000 7ff11d6f6640 1 --2- 172.21.15.71:0/3488149756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1180fdba0 0x7ff1180fd390 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.826+0000 7ff11d6f6640 1 -- 172.21.15.71:0/3488149756 >> 172.21.15.71:0/3488149756 conn(0x7ff1180f63a0 msgr2=0x7ff1180f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.826+0000 7ff11d6f6640 1 -- 172.21.15.71:0/3488149756 shutdown_connections 2024-09-10T10:07:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.826+0000 7ff11d6f6640 1 -- 172.21.15.71:0/3488149756 wait complete. 2024-09-10T10:07:47.836 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:07:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.907+0000 7f6d8f318640 1 -- 172.21.15.71:0/3009629865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d880fdbb0 msgr2=0x7f6d880fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.907+0000 7f6d8f318640 1 --2- 172.21.15.71:0/3009629865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d880fdbb0 0x7f6d880fdfc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d840048d0 tx=0x7f6d84009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8f318640 1 -- 172.21.15.71:0/3009629865 shutdown_connections 2024-09-10T10:07:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8f318640 1 --2- 172.21.15.71:0/3009629865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d880fe500 0x7f6d880fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8f318640 1 --2- 172.21.15.71:0/3009629865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d880fdbb0 0x7f6d880fdfc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8f318640 1 -- 172.21.15.71:0/3009629865 >> 172.21.15.71:0/3009629865 conn(0x7f6d880f63b0 msgr2=0x7f6d880f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:47.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8f318640 1 -- 172.21.15.71:0/3009629865 shutdown_connections 2024-09-10T10:07:47.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8f318640 1 -- 172.21.15.71:0/3009629865 wait complete. 2024-09-10T10:07:47.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8f318640 1 Processor -- start 2024-09-10T10:07:47.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8f318640 1 -- start start 2024-09-10T10:07:47.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8f318640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d880fdbb0 0x7f6d8810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:47.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8f318640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d880fe500 0x7f6d8810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:47.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8f318640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8810dc30 con 0x7f6d880fe500 2024-09-10T10:07:47.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8f318640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8810e450 con 0x7f6d880fdbb0 2024-09-10T10:07:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8c8b3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d880fe500 0x7f6d8810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8c8b3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d880fe500 0x7f6d8810d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46756/0 (socket says 172.21.15.71:46756) 2024-09-10T10:07:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.908+0000 7f6d8c8b3640 1 -- 172.21.15.71:0/752625329 learned_addr learned my addr 172.21.15.71:0/752625329 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.909+0000 7f6d8d0b4640 1 --2- 172.21.15.71:0/752625329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d880fdbb0 0x7f6d8810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.909+0000 7f6d8c8b3640 1 -- 172.21.15.71:0/752625329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d880fdbb0 msgr2=0x7f6d8810d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.909+0000 7f6d8c8b3640 1 --2- 172.21.15.71:0/752625329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d880fdbb0 0x7f6d8810d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.909+0000 7f6d8c8b3640 1 -- 172.21.15.71:0/752625329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d84005040 con 0x7f6d880fe500 2024-09-10T10:07:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.909+0000 7f6d8c8b3640 1 --2- 172.21.15.71:0/752625329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d880fe500 0x7f6d8810d5e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800c760 tx=0x7f6d780043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.909+0000 7f6d7dffb640 1 -- 172.21.15.71:0/752625329 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d7800a710 con 0x7f6d880fe500 2024-09-10T10:07:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.909+0000 7f6d7dffb640 1 -- 172.21.15.71:0/752625329 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6d7800ad10 con 0x7f6d880fe500 2024-09-10T10:07:47.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.909+0000 7f6d8f318640 1 -- 172.21.15.71:0/752625329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8810e6e0 con 0x7f6d880fe500 2024-09-10T10:07:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.909+0000 7f6d7dffb640 1 -- 172.21.15.71:0/752625329 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d780113a0 con 0x7f6d880fe500 2024-09-10T10:07:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.909+0000 7f6d8f318640 1 -- 172.21.15.71:0/752625329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8810ec80 con 0x7f6d880fe500 2024-09-10T10:07:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.910+0000 7f6d8f318640 1 -- 172.21.15.71:0/752625329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d880fa050 con 0x7f6d880fe500 2024-09-10T10:07:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.911+0000 7f6d7dffb640 1 -- 172.21.15.71:0/752625329 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f6d7800a870 con 0x7f6d880fe500 2024-09-10T10:07:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.911+0000 7f6d7dffb640 1 --2- 172.21.15.71:0/752625329 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6d7406e1e0 0x7f6d74070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.911+0000 7f6d7dffb640 1 -- 172.21.15.71:0/752625329 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f6d7808dc80 con 0x7f6d880fe500 2024-09-10T10:07:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.911+0000 7f6d8d0b4640 1 --2- 172.21.15.71:0/752625329 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6d7406e1e0 0x7f6d74070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:47.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.912+0000 7f6d8d0b4640 1 --2- 172.21.15.71:0/752625329 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6d7406e1e0 0x7f6d74070690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6d84000c00 tx=0x7f6d84035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:47.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:47.915+0000 7f6d7dffb640 1 -- 172.21.15.71:0/752625329 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6d78056fe0 con 0x7f6d880fe500 2024-09-10T10:07:48.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.098+0000 7f6d8f318640 1 -- 172.21.15.71:0/752625329 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d8810f060 con 0x7f6d7406e1e0 2024-09-10T10:07:48.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.099+0000 7f6d7dffb640 1 -- 172.21.15.71:0/752625329 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6d8810f060 con 0x7f6d7406e1e0 2024-09-10T10:07:48.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.101+0000 7f6d8f318640 1 -- 172.21.15.71:0/752625329 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6d7406e1e0 msgr2=0x7f6d74070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.101+0000 7f6d8f318640 1 --2- 172.21.15.71:0/752625329 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6d7406e1e0 0x7f6d74070690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6d84000c00 tx=0x7f6d84035040 comp rx=0 tx=0).stop 2024-09-10T10:07:48.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.101+0000 7f6d8f318640 1 -- 172.21.15.71:0/752625329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d880fe500 msgr2=0x7f6d8810d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.101+0000 7f6d8f318640 1 --2- 172.21.15.71:0/752625329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d880fe500 0x7f6d8810d5e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800c760 tx=0x7f6d780043c0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.101+0000 7f6d8f318640 1 -- 172.21.15.71:0/752625329 shutdown_connections 2024-09-10T10:07:48.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.101+0000 7f6d8f318640 1 --2- 172.21.15.71:0/752625329 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6d7406e1e0 0x7f6d74070690 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.101+0000 7f6d8f318640 1 --2- 172.21.15.71:0/752625329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d880fe500 0x7f6d8810d5e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.101+0000 7f6d8f318640 1 --2- 172.21.15.71:0/752625329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d880fdbb0 0x7f6d8810d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.101+0000 7f6d8f318640 1 -- 172.21.15.71:0/752625329 >> 172.21.15.71:0/752625329 conn(0x7f6d880f63b0 msgr2=0x7f6d880f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:48.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.101+0000 7f6d8f318640 1 -- 172.21.15.71:0/752625329 shutdown_connections 2024-09-10T10:07:48.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.101+0000 7f6d8f318640 1 -- 172.21.15.71:0/752625329 wait complete. 2024-09-10T10:07:48.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:48.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:48.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:48.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:48.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:48.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:48.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:48.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:48.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:48.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T10:07:48.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T10:07:48.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-10T10:07:48.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T10:07:48.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: osd.0 [v2:172.21.15.71:6802/392545558,v1:172.21.15.71:6803/392545558] boot 2024-09-10T10:07:48.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: osdmap e52: 6 total, 6 up, 6 in 2024-09-10T10:07:48.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:07:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.179+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/2060124122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9c00fd800 msgr2=0x7fd9c00fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.179+0000 7fd9c6ad4640 1 --2- 172.21.15.71:0/2060124122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9c00fd800 0x7fd9c00fdc70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40048d0 tx=0x7fd9b4009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.179+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/2060124122 shutdown_connections 2024-09-10T10:07:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.179+0000 7fd9c6ad4640 1 --2- 172.21.15.71:0/2060124122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9c00fd800 0x7fd9c00fdc70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.179+0000 7fd9c6ad4640 1 --2- 172.21.15.71:0/2060124122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9c00fc530 0x7fd9c00fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.179+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/2060124122 >> 172.21.15.71:0/2060124122 conn(0x7fd9c00f7d10 msgr2=0x7fd9c00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.179+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/2060124122 shutdown_connections 2024-09-10T10:07:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.179+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/2060124122 wait complete. 2024-09-10T10:07:48.182 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:48.182 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:48.182 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:48.182 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:48.182 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:48.182 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:48.182 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:48.182 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:48.182 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:48.182 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T10:07:48.182 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T10:07:48.183 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-10T10:07:48.183 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T10:07:48.183 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: osd.0 [v2:172.21.15.71:6802/392545558,v1:172.21.15.71:6803/392545558] boot 2024-09-10T10:07:48.183 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: osdmap e52: 6 total, 6 up, 6 in 2024-09-10T10:07:48.183 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:07:48.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.180+0000 7fd9c6ad4640 1 Processor -- start 2024-09-10T10:07:48.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.180+0000 7fd9c6ad4640 1 -- start start 2024-09-10T10:07:48.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.180+0000 7fd9c6ad4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9c00fc530 0x7fd9c0071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:48.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.180+0000 7fd9c6ad4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9c00fd800 0x7fd9c006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:48.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.180+0000 7fd9c6ad4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c006fff0 con 0x7fd9c00fd800 2024-09-10T10:07:48.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.180+0000 7fd9c6ad4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c0070130 con 0x7fd9c00fc530 2024-09-10T10:07:48.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.180+0000 7fd9bffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9c00fd800 0x7fd9c006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:48.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.180+0000 7fd9bffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9c00fd800 0x7fd9c006fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46774/0 (socket says 172.21.15.71:46774) 2024-09-10T10:07:48.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.180+0000 7fd9bffff640 1 -- 172.21.15.71:0/3599897038 learned_addr learned my addr 172.21.15.71:0/3599897038 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.181+0000 7fd9c4870640 1 --2- 172.21.15.71:0/3599897038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9c00fc530 0x7fd9c0071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.181+0000 7fd9bffff640 1 -- 172.21.15.71:0/3599897038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9c00fc530 msgr2=0x7fd9c0071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.181+0000 7fd9bffff640 1 --2- 172.21.15.71:0/3599897038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9c00fc530 0x7fd9c0071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.181+0000 7fd9bffff640 1 -- 172.21.15.71:0/3599897038 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b4005040 con 0x7fd9c00fd800 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.181+0000 7fd9bffff640 1 --2- 172.21.15.71:0/3599897038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9c00fd800 0x7fd9c006fa60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40043d0 tx=0x7fd9b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.181+0000 7fd9bd7fa640 1 -- 172.21.15.71:0/3599897038 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b4038070 con 0x7fd9c00fd800 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.181+0000 7fd9bd7fa640 1 -- 172.21.15.71:0/3599897038 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd9b402ae90 con 0x7fd9c00fd800 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.181+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/3599897038 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c00703b0 con 0x7fd9c00fd800 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.181+0000 7fd9bd7fa640 1 -- 172.21.15.71:0/3599897038 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b403e670 con 0x7fd9c00fd800 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.181+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/3599897038 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c01150c0 con 0x7fd9c00fd800 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.182+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/3599897038 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c00fb990 con 0x7fd9c00fd800 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.183+0000 7fd9bd7fa640 1 -- 172.21.15.71:0/3599897038 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fd9b4030020 con 0x7fd9c00fd800 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.183+0000 7fd9bd7fa640 1 --2- 172.21.15.71:0/3599897038 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd9a806e1e0 0x7fd9a8070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.183+0000 7fd9bd7fa640 1 -- 172.21.15.71:0/3599897038 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd9b40adfc0 con 0x7fd9c00fd800 2024-09-10T10:07:48.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.183+0000 7fd9c4870640 1 --2- 172.21.15.71:0/3599897038 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd9a806e1e0 0x7fd9a8070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:48.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.184+0000 7fd9c4870640 1 --2- 172.21.15.71:0/3599897038 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd9a806e1e0 0x7fd9a8070690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0071320 tx=0x7fd9b8004d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:48.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.188+0000 7fd9bd7fa640 1 -- 172.21.15.71:0/3599897038 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd9b40771e0 con 0x7fd9c00fd800 2024-09-10T10:07:48.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.383+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/3599897038 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9c0101c20 con 0x7fd9a806e1e0 2024-09-10T10:07:48.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.392+0000 7fd9bd7fa640 1 -- 172.21.15.71:0/3599897038 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fd9c0101c20 con 0x7fd9a806e1e0 2024-09-10T10:07:48.393 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:07:48.393 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (3m) 5s ago 11m 26.4M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:07:48.393 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (34s) 5s ago 11m 6903k - 19.1.1-305-g1cf819b7 41d671128357 5dc74ad01560 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (30s) 26s ago 10m 6891k - 19.1.1-305-g1cf819b7 41d671128357 6f4355e875db 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (2m) 5s ago 11m 76.2M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (6m) 5s ago 6m 113M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (6m) 5s ago 6m 65.3M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (6m) 26s ago 6m 108M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (6m) 26s ago 6m 62.7M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (2m) 5s ago 12m 495M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (103s) 26s ago 10m 439M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (90s) 5s ago 13m 42.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (71s) 26s ago 10m 33.9M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (3m) 5s ago 11m 16.7M - 1.5.0 0da6a335fe13 c3d47d79cd22 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (2m) 26s ago 10m 16.9M - 1.5.0 0da6a335fe13 9a25165a0fd1 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (11s) 5s ago 9m 12.0M 1557M 19.1.1-305-g1cf819b7 41d671128357 f1e9da1144c1 2024-09-10T10:07:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (9m) 5s ago 9m 234M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 44a84bf577da 2024-09-10T10:07:48.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (8m) 5s ago 8m 196M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 4fae52756a24 2024-09-10T10:07:48.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (8m) 26s ago 8m 270M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:07:48.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (8m) 26s ago 8m 229M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:07:48.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (7m) 26s ago 7m 228M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:07:48.395 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (109s) 5s ago 11m 54.0M - 2.43.0 a07b618ecd1d 47d3ae62ce5e 2024-09-10T10:07:48.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.395+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/3599897038 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd9a806e1e0 msgr2=0x7fd9a8070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.395+0000 7fd9c6ad4640 1 --2- 172.21.15.71:0/3599897038 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd9a806e1e0 0x7fd9a8070690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0071320 tx=0x7fd9b8004d00 comp rx=0 tx=0).stop 2024-09-10T10:07:48.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.395+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/3599897038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9c00fd800 msgr2=0x7fd9c006fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.395+0000 7fd9c6ad4640 1 --2- 172.21.15.71:0/3599897038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9c00fd800 0x7fd9c006fa60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40043d0 tx=0x7fd9b4009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.395+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/3599897038 shutdown_connections 2024-09-10T10:07:48.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.395+0000 7fd9c6ad4640 1 --2- 172.21.15.71:0/3599897038 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd9a806e1e0 0x7fd9a8070690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.395+0000 7fd9c6ad4640 1 --2- 172.21.15.71:0/3599897038 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9c00fd800 0x7fd9c006fa60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.395+0000 7fd9c6ad4640 1 --2- 172.21.15.71:0/3599897038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9c00fc530 0x7fd9c0071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.395+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/3599897038 >> 172.21.15.71:0/3599897038 conn(0x7fd9c00f7d10 msgr2=0x7fd9c00f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:48.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.395+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/3599897038 shutdown_connections 2024-09-10T10:07:48.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.395+0000 7fd9c6ad4640 1 -- 172.21.15.71:0/3599897038 wait complete. 2024-09-10T10:07:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.471+0000 7ff0c504f640 1 -- 172.21.15.71:0/1298253638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0c00666b0 msgr2=0x7ff0c00ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.471+0000 7ff0c504f640 1 --2- 172.21.15.71:0/1298253638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0c00666b0 0x7ff0c00ff200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0009c50 tx=0x7ff0b0004d10 comp rx=0 tx=0).stop 2024-09-10T10:07:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.471+0000 7ff0c504f640 1 -- 172.21.15.71:0/1298253638 shutdown_connections 2024-09-10T10:07:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.471+0000 7ff0c504f640 1 --2- 172.21.15.71:0/1298253638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0c00ff740 0x7ff0c0101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.471+0000 7ff0c504f640 1 --2- 172.21.15.71:0/1298253638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0c00666b0 0x7ff0c00ff200 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.471+0000 7ff0c504f640 1 -- 172.21.15.71:0/1298253638 >> 172.21.15.71:0/1298253638 conn(0x7ff0c00f6c30 msgr2=0x7ff0c00f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.471+0000 7ff0c504f640 1 -- 172.21.15.71:0/1298253638 shutdown_connections 2024-09-10T10:07:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.472+0000 7ff0c504f640 1 -- 172.21.15.71:0/1298253638 wait complete. 2024-09-10T10:07:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.472+0000 7ff0c504f640 1 Processor -- start 2024-09-10T10:07:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.472+0000 7ff0c504f640 1 -- start start 2024-09-10T10:07:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.472+0000 7ff0c504f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0c00666b0 0x7ff0c010d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.472+0000 7ff0c504f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0c00ff740 0x7ff0c010d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.472+0000 7ff0c504f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c010e580 con 0x7ff0c00ff740 2024-09-10T10:07:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.472+0000 7ff0c504f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c010e6f0 con 0x7ff0c00666b0 2024-09-10T10:07:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.473+0000 7ff0be59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0c00ff740 0x7ff0c010d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.473+0000 7ff0be59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0c00ff740 0x7ff0c010d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46782/0 (socket says 172.21.15.71:46782) 2024-09-10T10:07:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.473+0000 7ff0be59c640 1 -- 172.21.15.71:0/3980123698 learned_addr learned my addr 172.21.15.71:0/3980123698 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.473+0000 7ff0bed9d640 1 --2- 172.21.15.71:0/3980123698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0c00666b0 0x7ff0c010d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.473+0000 7ff0be59c640 1 -- 172.21.15.71:0/3980123698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0c00666b0 msgr2=0x7ff0c010d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.473+0000 7ff0be59c640 1 --2- 172.21.15.71:0/3980123698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0c00666b0 0x7ff0c010d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.473+0000 7ff0be59c640 1 -- 172.21.15.71:0/3980123698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b00098b0 con 0x7ff0c00ff740 2024-09-10T10:07:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.473+0000 7ff0bed9d640 1 --2- 172.21.15.71:0/3980123698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0c00666b0 0x7ff0c010d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:07:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.473+0000 7ff0be59c640 1 --2- 172.21.15.71:0/3980123698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0c00ff740 0x7ff0c010d760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400b580 tx=0x7ff0b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.473+0000 7ff0a77fe640 1 -- 172.21.15.71:0/3980123698 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0b400f570 con 0x7ff0c00ff740 2024-09-10T10:07:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.473+0000 7ff0a77fe640 1 -- 172.21.15.71:0/3980123698 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff0b400fb70 con 0x7ff0c00ff740 2024-09-10T10:07:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.473+0000 7ff0c504f640 1 -- 172.21.15.71:0/3980123698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c010e9d0 con 0x7ff0c00ff740 2024-09-10T10:07:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.474+0000 7ff0a77fe640 1 -- 172.21.15.71:0/3980123698 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0b4010d40 con 0x7ff0c00ff740 2024-09-10T10:07:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.474+0000 7ff0c504f640 1 -- 172.21.15.71:0/3980123698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c010eef0 con 0x7ff0c00ff740 2024-09-10T10:07:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.475+0000 7ff0a77fe640 1 -- 172.21.15.71:0/3980123698 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7ff0b400fce0 con 0x7ff0c00ff740 2024-09-10T10:07:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.475+0000 7ff0c504f640 1 -- 172.21.15.71:0/3980123698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c00fa8d0 con 0x7ff0c00ff740 2024-09-10T10:07:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.475+0000 7ff0a77fe640 1 --2- 172.21.15.71:0/3980123698 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff0a806e1e0 0x7ff0a8070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.475+0000 7ff0a77fe640 1 -- 172.21.15.71:0/3980123698 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff0b408dbe0 con 0x7ff0c00ff740 2024-09-10T10:07:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.476+0000 7ff0bed9d640 1 --2- 172.21.15.71:0/3980123698 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff0a806e1e0 0x7ff0a8070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.476+0000 7ff0bed9d640 1 --2- 172.21.15.71:0/3980123698 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff0a806e1e0 0x7ff0a8070690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0032470 tx=0x7ff0b0004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.480+0000 7ff0a77fe640 1 -- 172.21.15.71:0/3980123698 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff0b4056e80 con 0x7ff0c00ff740 2024-09-10T10:07:48.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.710+0000 7ff0c504f640 1 -- 172.21.15.71:0/3980123698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff0c0105100 con 0x7ff0c00ff740 2024-09-10T10:07:48.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.711+0000 7ff0a77fe640 1 -- 172.21.15.71:0/3980123698 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7ff0b405a540 con 0x7ff0c00ff740 2024-09-10T10:07:48.712 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:07:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:07:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:07:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:07:48.712 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:07:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:07:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:07:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:07:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 5, 2024-09-10T10:07:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 1 2024-09-10T10:07:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:07:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:07:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:07:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:07:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:07:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 9, 2024-09-10T10:07:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 5 2024-09-10T10:07:48.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:07:48.714 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:07:48.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.713+0000 7ff0c504f640 1 -- 172.21.15.71:0/3980123698 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff0a806e1e0 msgr2=0x7ff0a8070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.713+0000 7ff0c504f640 1 --2- 172.21.15.71:0/3980123698 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff0a806e1e0 0x7ff0a8070690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0032470 tx=0x7ff0b0004d10 comp rx=0 tx=0).stop 2024-09-10T10:07:48.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.713+0000 7ff0c504f640 1 -- 172.21.15.71:0/3980123698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0c00ff740 msgr2=0x7ff0c010d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.713+0000 7ff0c504f640 1 --2- 172.21.15.71:0/3980123698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0c00ff740 0x7ff0c010d760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400b580 tx=0x7ff0b40091a0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.713+0000 7ff0c504f640 1 -- 172.21.15.71:0/3980123698 shutdown_connections 2024-09-10T10:07:48.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.713+0000 7ff0c504f640 1 --2- 172.21.15.71:0/3980123698 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff0a806e1e0 0x7ff0a8070690 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.713+0000 7ff0c504f640 1 --2- 172.21.15.71:0/3980123698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0c00ff740 0x7ff0c010d760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.713+0000 7ff0c504f640 1 --2- 172.21.15.71:0/3980123698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0c00666b0 0x7ff0c010d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.713+0000 7ff0c504f640 1 -- 172.21.15.71:0/3980123698 >> 172.21.15.71:0/3980123698 conn(0x7ff0c00f6c30 msgr2=0x7ff0c00f7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:48.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.713+0000 7ff0c504f640 1 -- 172.21.15.71:0/3980123698 shutdown_connections 2024-09-10T10:07:48.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.713+0000 7ff0c504f640 1 -- 172.21.15.71:0/3980123698 wait complete. 2024-09-10T10:07:48.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.791+0000 7f3a4958f640 1 -- 172.21.15.71:0/2084981030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a440fb430 msgr2=0x7f3a440fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.791+0000 7f3a4958f640 1 --2- 172.21.15.71:0/2084981030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a440fb430 0x7f3a440fb840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a340048d0 tx=0x7f3a34009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.791+0000 7f3a4958f640 1 -- 172.21.15.71:0/2084981030 shutdown_connections 2024-09-10T10:07:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.791+0000 7f3a4958f640 1 --2- 172.21.15.71:0/2084981030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a440fc700 0x7f3a440fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.791+0000 7f3a4958f640 1 --2- 172.21.15.71:0/2084981030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a440fb430 0x7f3a440fb840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.791+0000 7f3a4958f640 1 -- 172.21.15.71:0/2084981030 >> 172.21.15.71:0/2084981030 conn(0x7f3a440f6c10 msgr2=0x7f3a440f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.791+0000 7f3a4958f640 1 -- 172.21.15.71:0/2084981030 shutdown_connections 2024-09-10T10:07:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.791+0000 7f3a4958f640 1 -- 172.21.15.71:0/2084981030 wait complete. 2024-09-10T10:07:48.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.792+0000 7f3a4958f640 1 Processor -- start 2024-09-10T10:07:48.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.792+0000 7f3a4958f640 1 -- start start 2024-09-10T10:07:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.792+0000 7f3a4958f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a440fb430 0x7f3a4410bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.792+0000 7f3a4958f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a440fc700 0x7f3a4410c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.792+0000 7f3a4958f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4410cb10 con 0x7f3a440fb430 2024-09-10T10:07:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.792+0000 7f3a4958f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4410d330 con 0x7f3a440fc700 2024-09-10T10:07:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.792+0000 7f3a42ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a440fb430 0x7f3a4410bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.792+0000 7f3a42ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a440fb430 0x7f3a4410bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46802/0 (socket says 172.21.15.71:46802) 2024-09-10T10:07:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.792+0000 7f3a42ffd640 1 -- 172.21.15.71:0/2931761281 learned_addr learned my addr 172.21.15.71:0/2931761281 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.792+0000 7f3a42ffd640 1 -- 172.21.15.71:0/2931761281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a440fc700 msgr2=0x7f3a4410c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.792+0000 7f3a42ffd640 1 --2- 172.21.15.71:0/2931761281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a440fc700 0x7f3a4410c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.792+0000 7f3a42ffd640 1 -- 172.21.15.71:0/2931761281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a34005040 con 0x7f3a440fb430 2024-09-10T10:07:48.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.793+0000 7f3a42ffd640 1 --2- 172.21.15.71:0/2931761281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a440fb430 0x7f3a4410bf80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a340048a0 tx=0x7f3a34009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:48.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.793+0000 7f3a3bfff640 1 -- 172.21.15.71:0/2931761281 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a34038070 con 0x7f3a440fb430 2024-09-10T10:07:48.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.793+0000 7f3a4958f640 1 -- 172.21.15.71:0/2931761281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4410d560 con 0x7f3a440fb430 2024-09-10T10:07:48.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.793+0000 7f3a3bfff640 1 -- 172.21.15.71:0/2931761281 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3a34004290 con 0x7f3a440fb430 2024-09-10T10:07:48.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.793+0000 7f3a3bfff640 1 -- 172.21.15.71:0/2931761281 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a34033660 con 0x7f3a440fb430 2024-09-10T10:07:48.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.793+0000 7f3a4958f640 1 -- 172.21.15.71:0/2931761281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4410db00 con 0x7f3a440fb430 2024-09-10T10:07:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.794+0000 7f3a4958f640 1 -- 172.21.15.71:0/2931761281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a440fa890 con 0x7f3a440fb430 2024-09-10T10:07:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.794+0000 7f3a3bfff640 1 -- 172.21.15.71:0/2931761281 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f3a34030020 con 0x7f3a440fb430 2024-09-10T10:07:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.795+0000 7f3a3bfff640 1 --2- 172.21.15.71:0/2931761281 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3a3006e1e0 0x7f3a30070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.795+0000 7f3a3bfff640 1 -- 172.21.15.71:0/2931761281 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3a340adf00 con 0x7f3a440fb430 2024-09-10T10:07:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.795+0000 7f3a3a7fc640 1 --2- 172.21.15.71:0/2931761281 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3a3006e1e0 0x7f3a30070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.795+0000 7f3a3a7fc640 1 --2- 172.21.15.71:0/2931761281 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3a3006e1e0 0x7f3a30070690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3a4410bd30 tx=0x7f3a2c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.799+0000 7f3a3bfff640 1 -- 172.21.15.71:0/2931761281 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3a34077120 con 0x7f3a440fb430 2024-09-10T10:07:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.997+0000 7f3a4958f640 1 -- 172.21.15.71:0/2931761281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3a44103e50 con 0x7f3a440fb430 2024-09-10T10:07:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:48.998+0000 7f3a3bfff640 1 -- 172.21.15.71:0/2931761281 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1955 (secure 0 0 0) 0x7f3a3402c870 con 0x7f3a440fb430 2024-09-10T10:07:48.999 INFO:teuthology.orchestra.run.smithi071.stdout:e24 2024-09-10T10:07:48.999 INFO:teuthology.orchestra.run.smithi071.stdout:btime 2024-09-10T10:07:40:170505+0000 2024-09-10T10:07:48.999 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:07:48.999 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:07:48.999 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:07:49.000 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:07:49.000 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:07:49.000 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:07:49.000 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 24 2024-09-10T10:07:49.000 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:07:49.000 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:07:49.000 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:07:39.792181+0000 2024-09-10T10:07:49.000 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:07:49.000 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:07:49.000 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:07:49.000 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:07:49.000 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:07:49.001 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:07:49.001 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:07:49.001 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:07:49.001 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:07:49.001 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:07:49.001 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:07:49.001 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:07:49.001 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:07:49.001 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:07:49.001 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:07:49.001 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:07:49.001 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:07:49.001 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:07:49.002 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:07:49.002 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:07:49.002 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:07:49.002 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:07:49.002 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 14464 members: 24267,14464 2024-09-10T10:07:49.002 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:07:49.002 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:07:49.002 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:07:49.002 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:07:49.002 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:07:49.002 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:07:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 24 2024-09-10T10:07:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.000+0000 7f3a4958f640 1 -- 172.21.15.71:0/2931761281 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3a3006e1e0 msgr2=0x7f3a30070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.000+0000 7f3a4958f640 1 --2- 172.21.15.71:0/2931761281 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3a3006e1e0 0x7f3a30070690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3a4410bd30 tx=0x7f3a2c00b040 comp rx=0 tx=0).stop 2024-09-10T10:07:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.000+0000 7f3a4958f640 1 -- 172.21.15.71:0/2931761281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a440fb430 msgr2=0x7f3a4410bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.000+0000 7f3a4958f640 1 --2- 172.21.15.71:0/2931761281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a440fb430 0x7f3a4410bf80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a340048a0 tx=0x7f3a34009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.000+0000 7f3a4958f640 1 -- 172.21.15.71:0/2931761281 shutdown_connections 2024-09-10T10:07:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.000+0000 7f3a4958f640 1 --2- 172.21.15.71:0/2931761281 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3a3006e1e0 0x7f3a30070690 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.000+0000 7f3a4958f640 1 --2- 172.21.15.71:0/2931761281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a440fc700 0x7f3a4410c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.000+0000 7f3a4958f640 1 --2- 172.21.15.71:0/2931761281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a440fb430 0x7f3a4410bf80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.001+0000 7f3a4958f640 1 -- 172.21.15.71:0/2931761281 >> 172.21.15.71:0/2931761281 conn(0x7f3a440f6c10 msgr2=0x7f3a440f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.001+0000 7f3a4958f640 1 -- 172.21.15.71:0/2931761281 shutdown_connections 2024-09-10T10:07:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.001+0000 7f3a4958f640 1 -- 172.21.15.71:0/2931761281 wait complete. 2024-09-10T10:07:49.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.079+0000 7f6c31928640 1 -- 172.21.15.71:0/1354232395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c2c0ff720 msgr2=0x7f6c2c101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:49.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.079+0000 7f6c31928640 1 --2- 172.21.15.71:0/1354232395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c2c0ff720 0x7f6c2c101b00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c140048d0 tx=0x7f6c14009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.080+0000 7f6c31928640 1 -- 172.21.15.71:0/1354232395 shutdown_connections 2024-09-10T10:07:49.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.080+0000 7f6c31928640 1 --2- 172.21.15.71:0/1354232395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c2c0ff720 0x7f6c2c101b00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.080+0000 7f6c31928640 1 --2- 172.21.15.71:0/1354232395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2c0666b0 0x7f6c2c0ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.080+0000 7f6c31928640 1 -- 172.21.15.71:0/1354232395 >> 172.21.15.71:0/1354232395 conn(0x7f6c2c0f6c10 msgr2=0x7f6c2c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:49.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.080+0000 7f6c31928640 1 -- 172.21.15.71:0/1354232395 shutdown_connections 2024-09-10T10:07:49.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.080+0000 7f6c31928640 1 -- 172.21.15.71:0/1354232395 wait complete. 2024-09-10T10:07:49.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.080+0000 7f6c31928640 1 Processor -- start 2024-09-10T10:07:49.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.080+0000 7f6c31928640 1 -- start start 2024-09-10T10:07:49.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.081+0000 7f6c31928640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c2c0666b0 0x7f6c2c0fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:49.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.081+0000 7f6c31928640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2c0ff720 0x7f6c2c0fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:49.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.081+0000 7f6c31928640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c110d40 con 0x7f6c2c0666b0 2024-09-10T10:07:49.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.081+0000 7f6c31928640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c110e80 con 0x7f6c2c0ff720 2024-09-10T10:07:49.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.081+0000 7f6c2affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c2c0666b0 0x7f6c2c0fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:49.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.081+0000 7f6c2affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c2c0666b0 0x7f6c2c0fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46816/0 (socket says 172.21.15.71:46816) 2024-09-10T10:07:49.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.081+0000 7f6c2affd640 1 -- 172.21.15.71:0/3654184176 learned_addr learned my addr 172.21.15.71:0/3654184176 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:49.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.081+0000 7f6c2a7fc640 1 --2- 172.21.15.71:0/3654184176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2c0ff720 0x7f6c2c0fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:49.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.081+0000 7f6c2affd640 1 -- 172.21.15.71:0/3654184176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2c0ff720 msgr2=0x7f6c2c0fb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:49.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.081+0000 7f6c2affd640 1 --2- 172.21.15.71:0/3654184176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2c0ff720 0x7f6c2c0fb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.081+0000 7f6c2affd640 1 -- 172.21.15.71:0/3654184176 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c14005040 con 0x7f6c2c0666b0 2024-09-10T10:07:49.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.081+0000 7f6c2affd640 1 --2- 172.21.15.71:0/3654184176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c2c0666b0 0x7f6c2c0fcbf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00eb70 tx=0x7f6c1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:49.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.081+0000 7f6c237fe640 1 -- 172.21.15.71:0/3654184176 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c1c007c30 con 0x7f6c2c0666b0 2024-09-10T10:07:49.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.082+0000 7f6c237fe640 1 -- 172.21.15.71:0/3654184176 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c1c00f040 con 0x7f6c2c0666b0 2024-09-10T10:07:49.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.082+0000 7f6c31928640 1 -- 172.21.15.71:0/3654184176 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2c0fb6e0 con 0x7f6c2c0666b0 2024-09-10T10:07:49.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.082+0000 7f6c237fe640 1 -- 172.21.15.71:0/3654184176 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c1c00caa0 con 0x7f6c2c0666b0 2024-09-10T10:07:49.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.082+0000 7f6c31928640 1 -- 172.21.15.71:0/3654184176 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2c0fbc80 con 0x7f6c2c0666b0 2024-09-10T10:07:49.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.083+0000 7f6c31928640 1 -- 172.21.15.71:0/3654184176 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2c0fa8b0 con 0x7f6c2c0666b0 2024-09-10T10:07:49.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.083+0000 7f6c237fe640 1 -- 172.21.15.71:0/3654184176 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f6c1c00cd10 con 0x7f6c2c0666b0 2024-09-10T10:07:49.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.084+0000 7f6c237fe640 1 --2- 172.21.15.71:0/3654184176 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6c1806e1e0 0x7f6c18070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:49.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.084+0000 7f6c237fe640 1 -- 172.21.15.71:0/3654184176 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f6c1c08e080 con 0x7f6c2c0666b0 2024-09-10T10:07:49.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.084+0000 7f6c2a7fc640 1 --2- 172.21.15.71:0/3654184176 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6c1806e1e0 0x7f6c18070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:49.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.084+0000 7f6c2a7fc640 1 --2- 172.21.15.71:0/3654184176 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6c1806e1e0 0x7f6c18070690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6c14007ac0 tx=0x7f6c14035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:49.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.088+0000 7f6c237fe640 1 -- 172.21.15.71:0/3654184176 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6c1c0571d0 con 0x7f6c2c0666b0 2024-09-10T10:07:49.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.271+0000 7f6c31928640 1 -- 172.21.15.71:0/3654184176 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c2c0f8750 con 0x7f6c1806e1e0 2024-09-10T10:07:49.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.272+0000 7f6c237fe640 1 -- 172.21.15.71:0/3654184176 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6c2c0f8750 con 0x7f6c1806e1e0 2024-09-10T10:07:49.274 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:07:49.274 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:07:49.274 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:07:49.274 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:07:49.274 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:07:49.274 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-09-10T10:07:49.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-10T10:07:49.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-10T10:07:49.274 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:07:49.274 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "7/21 daemons upgraded", 2024-09-10T10:07:49.275 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T10:07:49.275 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:07:49.275 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:07:49.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.275+0000 7f6c31928640 1 -- 172.21.15.71:0/3654184176 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6c1806e1e0 msgr2=0x7f6c18070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:49.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.275+0000 7f6c31928640 1 --2- 172.21.15.71:0/3654184176 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6c1806e1e0 0x7f6c18070690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6c14007ac0 tx=0x7f6c14035040 comp rx=0 tx=0).stop 2024-09-10T10:07:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.275+0000 7f6c31928640 1 -- 172.21.15.71:0/3654184176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c2c0666b0 msgr2=0x7f6c2c0fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.275+0000 7f6c31928640 1 --2- 172.21.15.71:0/3654184176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c2c0666b0 0x7f6c2c0fcbf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00eb70 tx=0x7f6c1c00b040 comp rx=0 tx=0).stop 2024-09-10T10:07:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.275+0000 7f6c31928640 1 -- 172.21.15.71:0/3654184176 shutdown_connections 2024-09-10T10:07:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.275+0000 7f6c31928640 1 --2- 172.21.15.71:0/3654184176 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6c1806e1e0 0x7f6c18070690 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.275+0000 7f6c31928640 1 --2- 172.21.15.71:0/3654184176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c2c0ff720 0x7f6c2c0fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.275+0000 7f6c31928640 1 --2- 172.21.15.71:0/3654184176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c2c0666b0 0x7f6c2c0fcbf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.275+0000 7f6c31928640 1 -- 172.21.15.71:0/3654184176 >> 172.21.15.71:0/3654184176 conn(0x7f6c2c0f6c10 msgr2=0x7f6c2c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.275+0000 7f6c31928640 1 -- 172.21.15.71:0/3654184176 shutdown_connections 2024-09-10T10:07:49.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.275+0000 7f6c31928640 1 -- 172.21.15.71:0/3654184176 wait complete. 2024-09-10T10:07:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.354+0000 7f45b0afa640 1 -- 172.21.15.71:0/3119923918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0fe4f0 msgr2=0x7f45ac0fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.354+0000 7f45b0afa640 1 --2- 172.21.15.71:0/3119923918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0fe4f0 0x7f45ac0fa650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f45a00048d0 tx=0x7f45a0009da0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.354+0000 7f45b0afa640 1 -- 172.21.15.71:0/3119923918 shutdown_connections 2024-09-10T10:07:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.354+0000 7f45b0afa640 1 --2- 172.21.15.71:0/3119923918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0fe4f0 0x7f45ac0fa650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.354+0000 7f45b0afa640 1 --2- 172.21.15.71:0/3119923918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45ac0fdba0 0x7f45ac0fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.354+0000 7f45b0afa640 1 -- 172.21.15.71:0/3119923918 >> 172.21.15.71:0/3119923918 conn(0x7f45ac0f63a0 msgr2=0x7f45ac0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:49.357 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:49 smithi071 ceph-mon[90773]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:49.357 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:49 smithi071 ceph-mon[90773]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:49.357 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:49 smithi071 ceph-mon[90773]: pgmap v49: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 63/321 objects degraded (19.626%) 2024-09-10T10:07:49.357 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:49 smithi071 ceph-mon[90773]: osdmap e53: 6 total, 6 up, 6 in 2024-09-10T10:07:49.357 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:49 smithi071 ceph-mon[90773]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:49.357 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:49 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/3980123698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:49.357 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:49 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2931761281' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:07:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.354+0000 7f45b0afa640 1 -- 172.21.15.71:0/3119923918 shutdown_connections 2024-09-10T10:07:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.354+0000 7f45b0afa640 1 -- 172.21.15.71:0/3119923918 wait complete. 2024-09-10T10:07:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.355+0000 7f45b0afa640 1 Processor -- start 2024-09-10T10:07:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.355+0000 7f45b0afa640 1 -- start start 2024-09-10T10:07:49.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.355+0000 7f45b0afa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0fdba0 0x7f45ac10d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:49.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.355+0000 7f45b0afa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45ac0fe4f0 0x7f45ac10d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:49.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.355+0000 7f45b0afa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac10dc50 con 0x7f45ac0fdba0 2024-09-10T10:07:49.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.355+0000 7f45b0afa640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac10e420 con 0x7f45ac0fe4f0 2024-09-10T10:07:49.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.355+0000 7f45aa59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0fdba0 0x7f45ac10d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:49.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.355+0000 7f45aa59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0fdba0 0x7f45ac10d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46836/0 (socket says 172.21.15.71:46836) 2024-09-10T10:07:49.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.355+0000 7f45aa59c640 1 -- 172.21.15.71:0/280696449 learned_addr learned my addr 172.21.15.71:0/280696449 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:07:49.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.355+0000 7f45a9d9b640 1 --2- 172.21.15.71:0/280696449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45ac0fe4f0 0x7f45ac10d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:49.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.356+0000 7f45aa59c640 1 -- 172.21.15.71:0/280696449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45ac0fe4f0 msgr2=0x7f45ac10d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:49.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.356+0000 7f45aa59c640 1 --2- 172.21.15.71:0/280696449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45ac0fe4f0 0x7f45ac10d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.356+0000 7f45aa59c640 1 -- 172.21.15.71:0/280696449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0005040 con 0x7f45ac0fdba0 2024-09-10T10:07:49.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.356+0000 7f45aa59c640 1 --2- 172.21.15.71:0/280696449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0fdba0 0x7f45ac10d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f459c002a50 tx=0x7f459c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:49.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.356+0000 7f459affd640 1 -- 172.21.15.71:0/280696449 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f459c007c30 con 0x7f45ac0fdba0 2024-09-10T10:07:49.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.356+0000 7f459affd640 1 -- 172.21.15.71:0/280696449 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f459c00f040 con 0x7f45ac0fdba0 2024-09-10T10:07:49.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.356+0000 7f45b0afa640 1 -- 172.21.15.71:0/280696449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac10e6b0 con 0x7f45ac0fdba0 2024-09-10T10:07:49.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.356+0000 7f459affd640 1 -- 172.21.15.71:0/280696449 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f459c00dad0 con 0x7f45ac0fdba0 2024-09-10T10:07:49.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.356+0000 7f45b0afa640 1 -- 172.21.15.71:0/280696449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac10ec20 con 0x7f45ac0fdba0 2024-09-10T10:07:49.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.357+0000 7f45b0afa640 1 -- 172.21.15.71:0/280696449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac105790 con 0x7f45ac0fdba0 2024-09-10T10:07:49.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.358+0000 7f459affd640 1 -- 172.21.15.71:0/280696449 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f459c00dc30 con 0x7f45ac0fdba0 2024-09-10T10:07:49.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.358+0000 7f459affd640 1 --2- 172.21.15.71:0/280696449 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f459406e1e0 0x7f4594070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:49.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.358+0000 7f459affd640 1 -- 172.21.15.71:0/280696449 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f459c08dcc0 con 0x7f45ac0fdba0 2024-09-10T10:07:49.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.358+0000 7f45a9d9b640 1 --2- 172.21.15.71:0/280696449 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f459406e1e0 0x7f4594070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:49.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.359+0000 7f45a9d9b640 1 --2- 172.21.15.71:0/280696449 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f459406e1e0 0x7f4594070690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f45a0000c00 tx=0x7f45a0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:49.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.363+0000 7f459affd640 1 -- 172.21.15.71:0/280696449 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f459c056dd0 con 0x7f45ac0fdba0 2024-09-10T10:07:49.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.593+0000 7f45b0afa640 1 -- 172.21.15.71:0/280696449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f45ac0fa040 con 0x7f45ac0fdba0 2024-09-10T10:07:49.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.594+0000 7f459affd640 1 -- 172.21.15.71:0/280696449 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1239 (secure 0 0 0) 0x7f459c05a490 con 0x7f45ac0fdba0 2024-09-10T10:07:49.600 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN Degraded data redundancy: 63/321 objects degraded (19.626%), 19 pgs degraded 2024-09-10T10:07:49.601 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 63/321 objects degraded (19.626%), 19 pgs degraded 2024-09-10T10:07:49.601 INFO:teuthology.orchestra.run.smithi071.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-10T10:07:49.601 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-10T10:07:49.601 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-10T10:07:49.601 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-10T10:07:49.601 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-10T10:07:49.602 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-10T10:07:49.602 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-10T10:07:49.602 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-10T10:07:49.602 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-10T10:07:49.602 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-10T10:07:49.602 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-10T10:07:49.602 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-10T10:07:49.603 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-10T10:07:49.603 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-10T10:07:49.603 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-10T10:07:49.603 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-10T10:07:49.603 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-10T10:07:49.603 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-10T10:07:49.603 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-10T10:07:49.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.596+0000 7f45b0afa640 1 -- 172.21.15.71:0/280696449 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f459406e1e0 msgr2=0x7f4594070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:49.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.596+0000 7f45b0afa640 1 --2- 172.21.15.71:0/280696449 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f459406e1e0 0x7f4594070690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f45a0000c00 tx=0x7f45a0035040 comp rx=0 tx=0).stop 2024-09-10T10:07:49.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.596+0000 7f45b0afa640 1 -- 172.21.15.71:0/280696449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0fdba0 msgr2=0x7f45ac10d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:49.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.596+0000 7f45b0afa640 1 --2- 172.21.15.71:0/280696449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0fdba0 0x7f45ac10d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f459c002a50 tx=0x7f459c004600 comp rx=0 tx=0).stop 2024-09-10T10:07:49.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.596+0000 7f45b0afa640 1 -- 172.21.15.71:0/280696449 shutdown_connections 2024-09-10T10:07:49.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.596+0000 7f45b0afa640 1 --2- 172.21.15.71:0/280696449 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f459406e1e0 0x7f4594070690 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.596+0000 7f45b0afa640 1 --2- 172.21.15.71:0/280696449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45ac0fe4f0 0x7f45ac10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.596+0000 7f45b0afa640 1 --2- 172.21.15.71:0/280696449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f45ac0fdba0 0x7f45ac10d0c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:49.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.596+0000 7f45b0afa640 1 -- 172.21.15.71:0/280696449 >> 172.21.15.71:0/280696449 conn(0x7f45ac0f63a0 msgr2=0x7f45ac0f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:49.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.596+0000 7f45b0afa640 1 -- 172.21.15.71:0/280696449 shutdown_connections 2024-09-10T10:07:49.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:07:49.596+0000 7f45b0afa640 1 -- 172.21.15.71:0/280696449 wait complete. 2024-09-10T10:07:49.654 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:49 smithi107 ceph-mon[79396]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:49.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:49 smithi107 ceph-mon[79396]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:49.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:49 smithi107 ceph-mon[79396]: pgmap v49: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 63/321 objects degraded (19.626%) 2024-09-10T10:07:49.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:49 smithi107 ceph-mon[79396]: osdmap e53: 6 total, 6 up, 6 in 2024-09-10T10:07:49.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:49 smithi107 ceph-mon[79396]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:49.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:49 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/3980123698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:07:49.655 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:49 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2931761281' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:07:50.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:50 smithi071 ceph-mon[90773]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:50.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:50 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/280696449' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:07:50.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:50 smithi107 ceph-mon[79396]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:50.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:50 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/280696449' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:07:51.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:51 smithi107 ceph-mon[79396]: pgmap v51: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.3 KiB/s rd, 5 op/s; 11/321 objects degraded (3.427%) 2024-09-10T10:07:51.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:51 smithi107 ceph-mon[79396]: Health check update: Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded (PG_DEGRADED) 2024-09-10T10:07:51.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:51 smithi071 ceph-mon[90773]: pgmap v51: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.3 KiB/s rd, 5 op/s; 11/321 objects degraded (3.427%) 2024-09-10T10:07:51.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:51 smithi071 ceph-mon[90773]: Health check update: Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded (PG_DEGRADED) 2024-09-10T10:07:52.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:52 smithi107 ceph-mon[79396]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded) 2024-09-10T10:07:52.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:52 smithi107 ceph-mon[79396]: Cluster is now healthy 2024-09-10T10:07:52.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:52 smithi071 ceph-mon[90773]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded) 2024-09-10T10:07:52.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:52 smithi071 ceph-mon[90773]: Cluster is now healthy 2024-09-10T10:07:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:53 smithi107 ceph-mon[79396]: pgmap v52: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-10T10:07:53.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:53 smithi071 ceph-mon[90773]: pgmap v52: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-10T10:07:55.448 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:55 smithi107 ceph-mon[79396]: pgmap v53: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-10T10:07:55.448 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:55.448 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:07:55.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:55 smithi071 ceph-mon[90773]: pgmap v53: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-10T10:07:55.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:07:55.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:07:57.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:57 smithi071 ceph-mon[90773]: pgmap v54: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 694 B/s wr, 4 op/s 2024-09-10T10:07:57.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:57 smithi071 ceph-mon[90773]: mgrmap e37: smithi071.gtqytr(active, since 92s), standbys: smithi107.qurtcs 2024-09-10T10:07:57.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:57 smithi107 ceph-mon[79396]: pgmap v54: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 694 B/s wr, 4 op/s 2024-09-10T10:07:57.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:57 smithi107 ceph-mon[79396]: mgrmap e37: smithi071.gtqytr(active, since 92s), standbys: smithi107.qurtcs 2024-09-10T10:07:59.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:07:59 smithi071 ceph-mon[90773]: pgmap v55: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 614 B/s wr, 4 op/s 2024-09-10T10:07:59.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:07:59 smithi107 ceph-mon[79396]: pgmap v55: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 614 B/s wr, 4 op/s 2024-09-10T10:08:00.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:00 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:00.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:00 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:01.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:01 smithi071 ceph-mon[90773]: pgmap v56: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 518 B/s wr, 5 op/s 2024-09-10T10:08:01.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:01 smithi107 ceph-mon[79396]: pgmap v56: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 518 B/s wr, 5 op/s 2024-09-10T10:08:02.446 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T10:08:02.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T10:08:03.449 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:03 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T10:08:03.449 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:03 smithi071 ceph-mon[90773]: Upgrade: osd.1 is safe to restart 2024-09-10T10:08:03.449 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:03 smithi071 ceph-mon[90773]: pgmap v57: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-10T10:08:03.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:03 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T10:08:03.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:03 smithi107 ceph-mon[79396]: Upgrade: osd.1 is safe to restart 2024-09-10T10:08:03.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:03 smithi107 ceph-mon[79396]: pgmap v57: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-10T10:08:04.842 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:04 smithi071 ceph-mon[90773]: Upgrade: Updating osd.1 2024-09-10T10:08:04.843 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:04 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:04.843 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:04 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T10:08:04.843 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:04 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:04.843 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:04 smithi071 ceph-mon[90773]: Deploying daemon osd.1 on smithi071 2024-09-10T10:08:04.843 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:04 smithi071 ceph-mon[90773]: pgmap v58: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-10T10:08:04.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:04 smithi107 ceph-mon[79396]: Upgrade: Updating osd.1 2024-09-10T10:08:04.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:04 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:04.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:04 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T10:08:04.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:04 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:04.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:04 smithi107 ceph-mon[79396]: Deploying daemon osd.1 on smithi071 2024-09-10T10:08:04.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:04 smithi107 ceph-mon[79396]: pgmap v58: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-10T10:08:06.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:06 smithi071 systemd[1]: Stopping Ceph osd.1 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:08:07.039 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:06 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1[53919]: 2024-09-10T10:08:06.645+0000 7ffbefd08640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:08:07.039 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:06 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1[53919]: 2024-09-10T10:08:06.645+0000 7ffbefd08640 -1 osd.1 53 *** Got signal Terminated *** 2024-09-10T10:08:07.039 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:06 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1[53919]: 2024-09-10T10:08:06.645+0000 7ffbefd08640 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:08:07.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:07 smithi071 ceph-mon[90773]: pgmap v59: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-10T10:08:07.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:07 smithi071 ceph-mon[90773]: osd.1 marked itself down and dead 2024-09-10T10:08:07.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:07 smithi107 ceph-mon[79396]: pgmap v59: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-10T10:08:07.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:07 smithi107 ceph-mon[79396]: osd.1 marked itself down and dead 2024-09-10T10:08:07.840 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:07 smithi071 podman[104165]: 2024-09-10 10:08:07.564525195 +0000 UTC m=+1.037312700 container died 44a84bf577daa70f6402327d05d8af9d4a45bc30b153dd417ec0478606f4eb41 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=quincy-96d63e7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T10:08:08.097 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:07 smithi071 podman[104165]: 2024-09-10 10:08:07.911477442 +0000 UTC m=+1.384264947 container cleanup 44a84bf577daa70f6402327d05d8af9d4a45bc30b153dd417ec0478606f4eb41 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=quincy-96d63e7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T10:08:08.097 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:07 smithi071 bash[104165]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1 2024-09-10T10:08:08.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:08 smithi071 ceph-mon[90773]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T10:08:08.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:08 smithi071 ceph-mon[90773]: osdmap e54: 6 total, 5 up, 6 in 2024-09-10T10:08:08.539 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:08 smithi071 podman[104180]: 2024-09-10 10:08:08.096061701 +0000 UTC m=+0.522862884 container remove 44a84bf577daa70f6402327d05d8af9d4a45bc30b153dd417ec0478606f4eb41 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=quincy-96d63e7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T10:08:08.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:08 smithi107 ceph-mon[79396]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T10:08:08.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:08 smithi107 ceph-mon[79396]: osdmap e54: 6 total, 5 up, 6 in 2024-09-10T10:08:08.825 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:08 smithi071 podman[104269]: 2024-09-10 10:08:08.443002337 +0000 UTC m=+0.015753953 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:08:08.826 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:08 smithi071 podman[104269]: 2024-09-10 10:08:08.685154047 +0000 UTC m=+0.257905656 container create bd00ffa5aa59876eb083658d5a3472c406a38f1064dff4df197aa4463ca9001a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T10:08:09.151 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:08 smithi071 podman[104269]: 2024-09-10 10:08:08.958084883 +0000 UTC m=+0.530836493 container init bd00ffa5aa59876eb083658d5a3472c406a38f1064dff4df197aa4463ca9001a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T10:08:09.151 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:08 smithi071 podman[104269]: 2024-09-10 10:08:08.961497655 +0000 UTC m=+0.534249274 container start bd00ffa5aa59876eb083658d5a3472c406a38f1064dff4df197aa4463ca9001a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T10:08:09.151 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:09 smithi071 podman[104269]: 2024-09-10 10:08:09.059757216 +0000 UTC m=+0.632508837 container attach bd00ffa5aa59876eb083658d5a3472c406a38f1064dff4df197aa4463ca9001a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T10:08:09.414 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:09 smithi071 podman[104269]: 2024-09-10 10:08:09.150831576 +0000 UTC m=+0.723583186 container died bd00ffa5aa59876eb083658d5a3472c406a38f1064dff4df197aa4463ca9001a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T10:08:09.415 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:09 smithi071 ceph-mon[90773]: pgmap v61: 65 pgs: 12 stale+active+clean, 53 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:08:09.415 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:09 smithi071 ceph-mon[90773]: osdmap e55: 6 total, 5 up, 6 in 2024-09-10T10:08:09.415 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:09.415 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:08:09.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:09 smithi107 ceph-mon[79396]: pgmap v61: 65 pgs: 12 stale+active+clean, 53 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:08:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:09 smithi107 ceph-mon[79396]: osdmap e55: 6 total, 5 up, 6 in 2024-09-10T10:08:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:08:10.146 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:09 smithi071 podman[104292]: 2024-09-10 10:08:09.812155713 +0000 UTC m=+0.655250341 container remove bd00ffa5aa59876eb083658d5a3472c406a38f1064dff4df197aa4463ca9001a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T10:08:10.146 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:09 smithi071 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-10T10:08:10.146 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:09 smithi071 systemd[1]: Stopped Ceph osd.1 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:08:10.146 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:09 smithi071 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.1.service: Consumed 1min 4.345s CPU time. 2024-09-10T10:08:10.147 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:10 smithi071 systemd[1]: Starting Ceph osd.1 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:08:10.400 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:10 smithi071 ceph-mon[90773]: Health check failed: Degraded data redundancy: 44/321 objects degraded (13.707%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T10:08:10.400 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:10 smithi071 podman[104404]: 2024-09-10 10:08:10.254900056 +0000 UTC m=+0.110233515 container create e9ecef71f44e7d8271d993d599cd95bc68e5ddf2f7b850fc181e50a3a6fcce73 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T10:08:10.401 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:10 smithi071 podman[104404]: 2024-09-10 10:08:10.16256299 +0000 UTC m=+0.017896449 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:08:10.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:10 smithi107 ceph-mon[79396]: Health check failed: Degraded data redundancy: 44/321 objects degraded (13.707%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T10:08:10.789 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:10 smithi071 podman[104404]: 2024-09-10 10:08:10.508134996 +0000 UTC m=+0.363468456 container init e9ecef71f44e7d8271d993d599cd95bc68e5ddf2f7b850fc181e50a3a6fcce73 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T10:08:10.789 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:10 smithi071 podman[104404]: 2024-09-10 10:08:10.512248002 +0000 UTC m=+0.367581461 container start e9ecef71f44e7d8271d993d599cd95bc68e5ddf2f7b850fc181e50a3a6fcce73 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:08:10.789 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:10 smithi071 podman[104404]: 2024-09-10 10:08:10.616301898 +0000 UTC m=+0.471635395 container attach e9ecef71f44e7d8271d993d599cd95bc68e5ddf2f7b850fc181e50a3a6fcce73 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T10:08:10.789 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:10 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate[104419]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:08:10.789 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:10 smithi071 bash[104404]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:08:10.789 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:10 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate[104419]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:08:10.789 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:10 smithi071 bash[104404]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:08:11.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:11 smithi071 ceph-mon[90773]: pgmap v63: 65 pgs: 15 active+undersized, 3 stale+active+clean, 14 active+undersized+degraded, 33 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 44/321 objects degraded (13.707%) 2024-09-10T10:08:11.539 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate[104419]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T10:08:11.539 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 bash[104404]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T10:08:11.539 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate[104419]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-10T10:08:11.539 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 bash[104404]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-10T10:08:11.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:11 smithi107 ceph-mon[79396]: pgmap v63: 65 pgs: 15 active+undersized, 3 stale+active+clean, 14 active+undersized+degraded, 33 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 44/321 objects degraded (13.707%) 2024-09-10T10:08:11.987 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate[104419]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-10T10:08:11.987 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 bash[104404]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-10T10:08:11.987 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate[104419]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-10T10:08:11.987 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 bash[104404]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-10T10:08:11.987 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate[104419]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-10T10:08:11.987 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 bash[104404]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-10T10:08:11.988 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate[104419]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T10:08:11.988 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 bash[104404]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T10:08:11.988 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate[104419]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-10T10:08:11.988 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 bash[104404]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-10T10:08:11.988 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:11 smithi071 podman[104404]: 2024-09-10 10:08:11.691138691 +0000 UTC m=+1.546472153 container died e9ecef71f44e7d8271d993d599cd95bc68e5ddf2f7b850fc181e50a3a6fcce73 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, ceph=True) 2024-09-10T10:08:12.539 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:12 smithi071 podman[104563]: 2024-09-10 10:08:12.2699755 +0000 UTC m=+0.572902643 container remove e9ecef71f44e7d8271d993d599cd95bc68e5ddf2f7b850fc181e50a3a6fcce73 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-activate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:08:12.539 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:12 smithi071 podman[104621]: 2024-09-10 10:08:12.378715572 +0000 UTC m=+0.016064004 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:08:12.539 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:12 smithi071 podman[104621]: 2024-09-10 10:08:12.504159942 +0000 UTC m=+0.141508420 container create 5afc8bef534339d4527db13901d2784cd9c36db1c1100c49fe975e7080709662 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:08:13.039 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:12 smithi071 podman[104621]: 2024-09-10 10:08:12.748644166 +0000 UTC m=+0.385992598 container init 5afc8bef534339d4527db13901d2784cd9c36db1c1100c49fe975e7080709662 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T10:08:13.039 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:12 smithi071 podman[104621]: 2024-09-10 10:08:12.75201079 +0000 UTC m=+0.389359223 container start 5afc8bef534339d4527db13901d2784cd9c36db1c1100c49fe975e7080709662 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T10:08:13.039 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:12 smithi071 ceph-osd[104640]: -- 172.21.15.71:0/1304153445 <== mon.0 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55991b4e01e0 con 0x55991a68dc00 2024-09-10T10:08:13.039 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:12 smithi071 bash[104621]: 5afc8bef534339d4527db13901d2784cd9c36db1c1100c49fe975e7080709662 2024-09-10T10:08:13.039 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:12 smithi071 systemd[1]: Started Ceph osd.1 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:08:13.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:13 smithi071 ceph-mon[90773]: pgmap v64: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-10T10:08:13.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:13 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:13.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:13 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:13.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:13 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:13.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:13 smithi107 ceph-mon[79396]: pgmap v64: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-10T10:08:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:13 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:13 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:13.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:13 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:14.789 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:14 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1[104636]: 2024-09-10T10:08:14.626+0000 7fd153fe6640 -1 Falling back to public interface 2024-09-10T10:08:15.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:15 smithi071 ceph-mon[90773]: pgmap v65: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-10T10:08:15.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:15 smithi107 ceph-mon[79396]: pgmap v65: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-10T10:08:17.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:17 smithi071 ceph-mon[90773]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-10T10:08:17.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:17 smithi107 ceph-mon[79396]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-10T10:08:19.010 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:18 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:19.011 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:18 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:19.011 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:18 smithi071 ceph-mon[90773]: Health check update: Degraded data redundancy: 50/321 objects degraded (15.576%), 16 pgs degraded (PG_DEGRADED) 2024-09-10T10:08:19.011 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:18 smithi071 ceph-mon[90773]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-10T10:08:19.011 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:18 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:19.011 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:18 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:19.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:18 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:19.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:18 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:19.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:18 smithi107 ceph-mon[79396]: Health check update: Degraded data redundancy: 50/321 objects degraded (15.576%), 16 pgs degraded (PG_DEGRADED) 2024-09-10T10:08:19.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:18 smithi107 ceph-mon[79396]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-10T10:08:19.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:18 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:19.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:18 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:19.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.682+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1504614777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ea40fc520 msgr2=0x7f5ea40fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:19.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.682+0000 7f5eab4b3640 1 --2- 172.21.15.71:0/1504614777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ea40fc520 0x7f5ea40fc930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00048d0 tx=0x7f5ea0009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:19.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.682+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1504614777 shutdown_connections 2024-09-10T10:08:19.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.682+0000 7f5eab4b3640 1 --2- 172.21.15.71:0/1504614777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea40fd7f0 0x7f5ea40fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:19.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.682+0000 7f5eab4b3640 1 --2- 172.21.15.71:0/1504614777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ea40fc520 0x7f5ea40fc930 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:19.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.682+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1504614777 >> 172.21.15.71:0/1504614777 conn(0x7f5ea40f7ce0 msgr2=0x7f5ea40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:19.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.683+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1504614777 shutdown_connections 2024-09-10T10:08:19.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.683+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1504614777 wait complete. 2024-09-10T10:08:19.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.683+0000 7f5eab4b3640 1 Processor -- start 2024-09-10T10:08:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.683+0000 7f5eab4b3640 1 -- start start 2024-09-10T10:08:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.683+0000 7f5eab4b3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea40fc520 0x7f5ea410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5eab4b3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ea40fd7f0 0x7f5ea410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5eab4b3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea410dc10 con 0x7f5ea40fd7f0 2024-09-10T10:08:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5eab4b3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea410e430 con 0x7f5ea40fc520 2024-09-10T10:08:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5ea8a4e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ea40fd7f0 0x7f5ea410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5ea8a4e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ea40fd7f0 0x7f5ea410d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58280/0 (socket says 172.21.15.71:58280) 2024-09-10T10:08:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5ea8a4e640 1 -- 172.21.15.71:0/1714636526 learned_addr learned my addr 172.21.15.71:0/1714636526 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5ea924f640 1 --2- 172.21.15.71:0/1714636526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea40fc520 0x7f5ea410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5ea8a4e640 1 -- 172.21.15.71:0/1714636526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea40fc520 msgr2=0x7f5ea410d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5ea8a4e640 1 --2- 172.21.15.71:0/1714636526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea40fc520 0x7f5ea410d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5ea8a4e640 1 -- 172.21.15.71:0/1714636526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea0005040 con 0x7f5ea40fd7f0 2024-09-10T10:08:19.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5ea8a4e640 1 --2- 172.21.15.71:0/1714636526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ea40fd7f0 0x7f5ea410d5c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400c830 tx=0x7f5e94004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:19.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5e99ffb640 1 -- 172.21.15.71:0/1714636526 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e9400a850 con 0x7f5ea40fd7f0 2024-09-10T10:08:19.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1714636526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea410e6c0 con 0x7f5ea40fd7f0 2024-09-10T10:08:19.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5e99ffb640 1 -- 172.21.15.71:0/1714636526 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e9400ae50 con 0x7f5ea40fd7f0 2024-09-10T10:08:19.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.684+0000 7f5e99ffb640 1 -- 172.21.15.71:0/1714636526 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e940113a0 con 0x7f5ea40fd7f0 2024-09-10T10:08:19.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.685+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1714636526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea410ec60 con 0x7f5ea40fd7f0 2024-09-10T10:08:19.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.686+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1714636526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea40fb980 con 0x7f5ea40fd7f0 2024-09-10T10:08:19.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.686+0000 7f5e99ffb640 1 -- 172.21.15.71:0/1714636526 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5e94012400 con 0x7f5ea40fd7f0 2024-09-10T10:08:19.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.686+0000 7f5e99ffb640 1 --2- 172.21.15.71:0/1714636526 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f5e9006e0b0 0x7f5e90070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:19.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.687+0000 7f5e99ffb640 1 -- 172.21.15.71:0/1714636526 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5e9408ddd0 con 0x7f5ea40fd7f0 2024-09-10T10:08:19.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.687+0000 7f5ea924f640 1 --2- 172.21.15.71:0/1714636526 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f5e9006e0b0 0x7f5e90070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:19.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.687+0000 7f5ea924f640 1 --2- 172.21.15.71:0/1714636526 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f5e9006e0b0 0x7f5e90070560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0007ac0 tx=0x7f5ea0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:19.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.691+0000 7f5e99ffb640 1 -- 172.21.15.71:0/1714636526 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5e94057180 con 0x7f5ea40fd7f0 2024-09-10T10:08:19.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.875+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1714636526 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ea410ef80 con 0x7f5e9006e0b0 2024-09-10T10:08:19.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.877+0000 7f5e99ffb640 1 -- 172.21.15.71:0/1714636526 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5ea410ef80 con 0x7f5e9006e0b0 2024-09-10T10:08:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.879+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1714636526 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f5e9006e0b0 msgr2=0x7f5e90070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.879+0000 7f5eab4b3640 1 --2- 172.21.15.71:0/1714636526 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f5e9006e0b0 0x7f5e90070560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0007ac0 tx=0x7f5ea0035040 comp rx=0 tx=0).stop 2024-09-10T10:08:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.879+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1714636526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ea40fd7f0 msgr2=0x7f5ea410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.879+0000 7f5eab4b3640 1 --2- 172.21.15.71:0/1714636526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ea40fd7f0 0x7f5ea410d5c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400c830 tx=0x7f5e94004430 comp rx=0 tx=0).stop 2024-09-10T10:08:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.879+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1714636526 shutdown_connections 2024-09-10T10:08:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.879+0000 7f5eab4b3640 1 --2- 172.21.15.71:0/1714636526 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f5e9006e0b0 0x7f5e90070560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.879+0000 7f5eab4b3640 1 --2- 172.21.15.71:0/1714636526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ea40fd7f0 0x7f5ea410d5c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.879+0000 7f5eab4b3640 1 --2- 172.21.15.71:0/1714636526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ea40fc520 0x7f5ea410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:19.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.879+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1714636526 >> 172.21.15.71:0/1714636526 conn(0x7f5ea40f7ce0 msgr2=0x7f5ea40f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:19.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.879+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1714636526 shutdown_connections 2024-09-10T10:08:19.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.880+0000 7f5eab4b3640 1 -- 172.21.15.71:0/1714636526 wait complete. 2024-09-10T10:08:19.890 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:08:19.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.962+0000 7f584c6c7640 1 -- 172.21.15.71:0/3893910162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58440fb430 msgr2=0x7f58440fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:19.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.962+0000 7f584c6c7640 1 --2- 172.21.15.71:0/3893910162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58440fb430 0x7f58440fb840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f58400048d0 tx=0x7f5840009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:19.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.962+0000 7f584c6c7640 1 -- 172.21.15.71:0/3893910162 shutdown_connections 2024-09-10T10:08:19.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.962+0000 7f584c6c7640 1 --2- 172.21.15.71:0/3893910162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58440fc700 0x7f58440fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:19.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.962+0000 7f584c6c7640 1 --2- 172.21.15.71:0/3893910162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58440fb430 0x7f58440fb840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:19.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.962+0000 7f584c6c7640 1 -- 172.21.15.71:0/3893910162 >> 172.21.15.71:0/3893910162 conn(0x7f58440f6c10 msgr2=0x7f58440f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:19.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.962+0000 7f584c6c7640 1 -- 172.21.15.71:0/3893910162 shutdown_connections 2024-09-10T10:08:19.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.963+0000 7f584c6c7640 1 -- 172.21.15.71:0/3893910162 wait complete. 2024-09-10T10:08:19.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.963+0000 7f584c6c7640 1 Processor -- start 2024-09-10T10:08:19.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.963+0000 7f584c6c7640 1 -- start start 2024-09-10T10:08:19.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.963+0000 7f584c6c7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58440fb430 0x7f584410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:19.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.963+0000 7f584c6c7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58440fc700 0x7f584410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:19.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.963+0000 7f584c6c7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584410dc30 con 0x7f58440fc700 2024-09-10T10:08:19.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.963+0000 7f584c6c7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584410e450 con 0x7f58440fb430 2024-09-10T10:08:19.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.963+0000 7f5849c62640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58440fc700 0x7f584410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:19.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.963+0000 7f5849c62640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58440fc700 0x7f584410d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58294/0 (socket says 172.21.15.71:58294) 2024-09-10T10:08:19.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.963+0000 7f5849c62640 1 -- 172.21.15.71:0/2721477625 learned_addr learned my addr 172.21.15.71:0/2721477625 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:19.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.964+0000 7f584a463640 1 --2- 172.21.15.71:0/2721477625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58440fb430 0x7f584410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:19.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.964+0000 7f5849c62640 1 -- 172.21.15.71:0/2721477625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58440fb430 msgr2=0x7f584410d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:19.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.964+0000 7f5849c62640 1 --2- 172.21.15.71:0/2721477625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58440fb430 0x7f584410d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:19.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.964+0000 7f5849c62640 1 -- 172.21.15.71:0/2721477625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5840005040 con 0x7f58440fc700 2024-09-10T10:08:19.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.964+0000 7f5849c62640 1 --2- 172.21.15.71:0/2721477625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58440fc700 0x7f584410d5e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f583400c830 tx=0x7f5834004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:19.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.964+0000 7f583affd640 1 -- 172.21.15.71:0/2721477625 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f583400a7d0 con 0x7f58440fc700 2024-09-10T10:08:19.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.964+0000 7f584c6c7640 1 -- 172.21.15.71:0/2721477625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584410e6e0 con 0x7f58440fc700 2024-09-10T10:08:19.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.964+0000 7f583affd640 1 -- 172.21.15.71:0/2721477625 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f583400add0 con 0x7f58440fc700 2024-09-10T10:08:19.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.964+0000 7f583affd640 1 -- 172.21.15.71:0/2721477625 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58340113a0 con 0x7f58440fc700 2024-09-10T10:08:19.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.964+0000 7f584c6c7640 1 -- 172.21.15.71:0/2721477625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584410ec80 con 0x7f58440fc700 2024-09-10T10:08:19.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.965+0000 7f584c6c7640 1 -- 172.21.15.71:0/2721477625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58440fa890 con 0x7f58440fc700 2024-09-10T10:08:19.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.966+0000 7f583affd640 1 -- 172.21.15.71:0/2721477625 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f583400a930 con 0x7f58440fc700 2024-09-10T10:08:19.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.966+0000 7f583affd640 1 --2- 172.21.15.71:0/2721477625 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f583006e0b0 0x7f5830070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:19.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.967+0000 7f583affd640 1 -- 172.21.15.71:0/2721477625 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f583408dcb0 con 0x7f58440fc700 2024-09-10T10:08:19.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.967+0000 7f584a463640 1 --2- 172.21.15.71:0/2721477625 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f583006e0b0 0x7f5830070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:19.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.967+0000 7f584a463640 1 --2- 172.21.15.71:0/2721477625 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f583006e0b0 0x7f5830070560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5840000c00 tx=0x7f5840035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:19.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:19.972+0000 7f583affd640 1 -- 172.21.15.71:0/2721477625 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5834057060 con 0x7f58440fc700 2024-09-10T10:08:20.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.171+0000 7f584c6c7640 1 -- 172.21.15.71:0/2721477625 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5844103fa0 con 0x7f583006e0b0 2024-09-10T10:08:20.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.172+0000 7f583affd640 1 -- 172.21.15.71:0/2721477625 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5844103fa0 con 0x7f583006e0b0 2024-09-10T10:08:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.175+0000 7f584c6c7640 1 -- 172.21.15.71:0/2721477625 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f583006e0b0 msgr2=0x7f5830070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.175+0000 7f584c6c7640 1 --2- 172.21.15.71:0/2721477625 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f583006e0b0 0x7f5830070560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5840000c00 tx=0x7f5840035040 comp rx=0 tx=0).stop 2024-09-10T10:08:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.175+0000 7f584c6c7640 1 -- 172.21.15.71:0/2721477625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58440fc700 msgr2=0x7f584410d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.175+0000 7f584c6c7640 1 --2- 172.21.15.71:0/2721477625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58440fc700 0x7f584410d5e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f583400c830 tx=0x7f5834004430 comp rx=0 tx=0).stop 2024-09-10T10:08:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.175+0000 7f584c6c7640 1 -- 172.21.15.71:0/2721477625 shutdown_connections 2024-09-10T10:08:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.175+0000 7f584c6c7640 1 --2- 172.21.15.71:0/2721477625 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f583006e0b0 0x7f5830070560 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.175+0000 7f584c6c7640 1 --2- 172.21.15.71:0/2721477625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58440fc700 0x7f584410d5e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.175+0000 7f584c6c7640 1 --2- 172.21.15.71:0/2721477625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58440fb430 0x7f584410d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.175+0000 7f584c6c7640 1 -- 172.21.15.71:0/2721477625 >> 172.21.15.71:0/2721477625 conn(0x7f58440f6c10 msgr2=0x7f5844065670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:20.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.175+0000 7f584c6c7640 1 -- 172.21.15.71:0/2721477625 shutdown_connections 2024-09-10T10:08:20.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.176+0000 7f584c6c7640 1 -- 172.21.15.71:0/2721477625 wait complete. 2024-09-10T10:08:20.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.263+0000 7fb5315f5640 1 -- 172.21.15.71:0/3819710376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb52c0ffa40 msgr2=0x7fb52c0ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:20.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.263+0000 7fb5315f5640 1 --2- 172.21.15.71:0/3819710376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb52c0ffa40 0x7fb52c0ffeb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb5140048d0 tx=0x7fb514009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.263+0000 7fb5315f5640 1 -- 172.21.15.71:0/3819710376 shutdown_connections 2024-09-10T10:08:20.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.263+0000 7fb5315f5640 1 --2- 172.21.15.71:0/3819710376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb52c0ffa40 0x7fb52c0ffeb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.263+0000 7fb5315f5640 1 --2- 172.21.15.71:0/3819710376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb52c0fe770 0x7fb52c0feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.263+0000 7fb5315f5640 1 -- 172.21.15.71:0/3819710376 >> 172.21.15.71:0/3819710376 conn(0x7fb52c0fa060 msgr2=0x7fb52c0fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:20.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.263+0000 7fb5315f5640 1 -- 172.21.15.71:0/3819710376 shutdown_connections 2024-09-10T10:08:20.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.263+0000 7fb5315f5640 1 -- 172.21.15.71:0/3819710376 wait complete. 2024-09-10T10:08:20.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.264+0000 7fb5315f5640 1 Processor -- start 2024-09-10T10:08:20.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.264+0000 7fb5315f5640 1 -- start start 2024-09-10T10:08:20.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.264+0000 7fb5315f5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb52c0fe770 0x7fb52c10f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:20.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.264+0000 7fb5315f5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb52c0ffa40 0x7fb52c10f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:20.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.264+0000 7fb5315f5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c10fe70 con 0x7fb52c0ffa40 2024-09-10T10:08:20.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.264+0000 7fb5315f5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c110640 con 0x7fb52c0fe770 2024-09-10T10:08:20.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.264+0000 7fb523fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb52c0ffa40 0x7fb52c10f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:20.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.264+0000 7fb523fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb52c0ffa40 0x7fb52c10f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58310/0 (socket says 172.21.15.71:58310) 2024-09-10T10:08:20.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.264+0000 7fb523fff640 1 -- 172.21.15.71:0/2324383798 learned_addr learned my addr 172.21.15.71:0/2324383798 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:20.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.265+0000 7fb52affd640 1 --2- 172.21.15.71:0/2324383798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb52c0fe770 0x7fb52c10f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:20.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.265+0000 7fb523fff640 1 -- 172.21.15.71:0/2324383798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb52c0fe770 msgr2=0x7fb52c10f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:20.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.265+0000 7fb523fff640 1 --2- 172.21.15.71:0/2324383798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb52c0fe770 0x7fb52c10f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.265+0000 7fb523fff640 1 -- 172.21.15.71:0/2324383798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb514005040 con 0x7fb52c0ffa40 2024-09-10T10:08:20.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.265+0000 7fb523fff640 1 --2- 172.21.15.71:0/2324383798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb52c0ffa40 0x7fb52c10f820 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb5140043d0 tx=0x7fb514009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:20.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.265+0000 7fb5237fe640 1 -- 172.21.15.71:0/2324383798 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb514038070 con 0x7fb52c0ffa40 2024-09-10T10:08:20.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.265+0000 7fb5315f5640 1 -- 172.21.15.71:0/2324383798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb52c110870 con 0x7fb52c0ffa40 2024-09-10T10:08:20.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.265+0000 7fb5237fe640 1 -- 172.21.15.71:0/2324383798 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb51402ae90 con 0x7fb52c0ffa40 2024-09-10T10:08:20.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.265+0000 7fb5237fe640 1 -- 172.21.15.71:0/2324383798 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb51403e670 con 0x7fb52c0ffa40 2024-09-10T10:08:20.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.265+0000 7fb5315f5640 1 -- 172.21.15.71:0/2324383798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52c110e10 con 0x7fb52c0ffa40 2024-09-10T10:08:20.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.267+0000 7fb5315f5640 1 -- 172.21.15.71:0/2324383798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52c0fdbd0 con 0x7fb52c0ffa40 2024-09-10T10:08:20.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.267+0000 7fb5237fe640 1 -- 172.21.15.71:0/2324383798 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb514030020 con 0x7fb52c0ffa40 2024-09-10T10:08:20.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.268+0000 7fb5237fe640 1 --2- 172.21.15.71:0/2324383798 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb51806e0b0 0x7fb518070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:20.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.268+0000 7fb5237fe640 1 -- 172.21.15.71:0/2324383798 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb5140add50 con 0x7fb52c0ffa40 2024-09-10T10:08:20.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.268+0000 7fb52affd640 1 --2- 172.21.15.71:0/2324383798 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb51806e0b0 0x7fb518070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:20.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.268+0000 7fb52affd640 1 --2- 172.21.15.71:0/2324383798 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb51806e0b0 0x7fb518070560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009fd0 tx=0x7fb51c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:20.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.272+0000 7fb5237fe640 1 -- 172.21.15.71:0/2324383798 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb514077130 con 0x7fb52c0ffa40 2024-09-10T10:08:20.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.489+0000 7fb5315f5640 1 -- 172.21.15.71:0/2324383798 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb52c1110f0 con 0x7fb51806e0b0 2024-09-10T10:08:20.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.499+0000 7fb5237fe640 1 -- 172.21.15.71:0/2324383798 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fb52c1110f0 con 0x7fb51806e0b0 2024-09-10T10:08:20.500 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:08:20.500 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (3m) 2s ago 12m 26.4M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:08:20.501 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (66s) 2s ago 12m 6903k - 19.1.1-305-g1cf819b7 41d671128357 5dc74ad01560 2024-09-10T10:08:20.501 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (62s) 58s ago 11m 6891k - 19.1.1-305-g1cf819b7 41d671128357 6f4355e875db 2024-09-10T10:08:20.501 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (3m) 2s ago 11m 76.3M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:08:20.501 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (6m) 2s ago 6m 113M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:08:20.501 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (6m) 2s ago 6m 65.2M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:08:20.501 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (6m) 58s ago 6m 108M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:08:20.501 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (6m) 58s ago 6m 62.7M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:08:20.501 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (2m) 2s ago 13m 496M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:08:20.501 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (2m) 58s ago 11m 439M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:08:20.501 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (2m) 2s ago 13m 45.8M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:08:20.501 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (103s) 58s ago 11m 33.9M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:08:20.501 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (3m) 2s ago 12m 16.4M - 1.5.0 0da6a335fe13 c3d47d79cd22 2024-09-10T10:08:20.501 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (3m) 58s ago 11m 16.9M - 1.5.0 0da6a335fe13 9a25165a0fd1 2024-09-10T10:08:20.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (43s) 2s ago 10m 94.2M 1557M 19.1.1-305-g1cf819b7 41d671128357 f1e9da1144c1 2024-09-10T10:08:20.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (8s) 2s ago 9m 11.5M 1557M 19.1.1-305-g1cf819b7 41d671128357 5afc8bef5343 2024-09-10T10:08:20.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (9m) 2s ago 9m 195M 1557M 17.2.7-1597-g96d63e75 f3fc7d52e233 4fae52756a24 2024-09-10T10:08:20.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (9m) 58s ago 9m 270M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:08:20.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (8m) 58s ago 8m 229M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:08:20.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (8m) 58s ago 8m 228M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:08:20.502 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (2m) 2s ago 11m 56.3M - 2.43.0 a07b618ecd1d 47d3ae62ce5e 2024-09-10T10:08:20.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.501+0000 7fb5315f5640 1 -- 172.21.15.71:0/2324383798 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb51806e0b0 msgr2=0x7fb518070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:20.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.501+0000 7fb5315f5640 1 --2- 172.21.15.71:0/2324383798 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb51806e0b0 0x7fb518070560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009fd0 tx=0x7fb51c00b040 comp rx=0 tx=0).stop 2024-09-10T10:08:20.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.501+0000 7fb5315f5640 1 -- 172.21.15.71:0/2324383798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb52c0ffa40 msgr2=0x7fb52c10f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:20.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.501+0000 7fb5315f5640 1 --2- 172.21.15.71:0/2324383798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb52c0ffa40 0x7fb52c10f820 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb5140043d0 tx=0x7fb514009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.501+0000 7fb5315f5640 1 -- 172.21.15.71:0/2324383798 shutdown_connections 2024-09-10T10:08:20.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.501+0000 7fb5315f5640 1 --2- 172.21.15.71:0/2324383798 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb51806e0b0 0x7fb518070560 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.501+0000 7fb5315f5640 1 --2- 172.21.15.71:0/2324383798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb52c0ffa40 0x7fb52c10f820 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.501+0000 7fb5315f5640 1 --2- 172.21.15.71:0/2324383798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb52c0fe770 0x7fb52c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.501+0000 7fb5315f5640 1 -- 172.21.15.71:0/2324383798 >> 172.21.15.71:0/2324383798 conn(0x7fb52c0fa060 msgr2=0x7fb52c0fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:20.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.501+0000 7fb5315f5640 1 -- 172.21.15.71:0/2324383798 shutdown_connections 2024-09-10T10:08:20.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.501+0000 7fb5315f5640 1 -- 172.21.15.71:0/2324383798 wait complete. 2024-09-10T10:08:20.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.584+0000 7f9dcc047640 1 -- 172.21.15.71:0/1378338295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dc40ff6e0 msgr2=0x7f9dc4101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:20.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.584+0000 7f9dcc047640 1 --2- 172.21.15.71:0/1378338295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dc40ff6e0 0x7f9dc4101ac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9db40048d0 tx=0x7f9db4009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.584+0000 7f9dcc047640 1 -- 172.21.15.71:0/1378338295 shutdown_connections 2024-09-10T10:08:20.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.584+0000 7f9dcc047640 1 --2- 172.21.15.71:0/1378338295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dc40ff6e0 0x7f9dc4101ac0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.584+0000 7f9dcc047640 1 --2- 172.21.15.71:0/1378338295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dc4065be0 0x7f9dc40ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.584+0000 7f9dcc047640 1 -- 172.21.15.71:0/1378338295 >> 172.21.15.71:0/1378338295 conn(0x7f9dc40f6c10 msgr2=0x7f9dc40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:20.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.584+0000 7f9dcc047640 1 -- 172.21.15.71:0/1378338295 shutdown_connections 2024-09-10T10:08:20.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.584+0000 7f9dcc047640 1 -- 172.21.15.71:0/1378338295 wait complete. 2024-09-10T10:08:20.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.585+0000 7f9dcc047640 1 Processor -- start 2024-09-10T10:08:20.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.585+0000 7f9dcc047640 1 -- start start 2024-09-10T10:08:20.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.585+0000 7f9dcc047640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dc4065be0 0x7f9dc410d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:20.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.585+0000 7f9dcc047640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dc40ff6e0 0x7f9dc410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:20.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.585+0000 7f9dcc047640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc410dbe0 con 0x7f9dc4065be0 2024-09-10T10:08:20.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.585+0000 7f9dcc047640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc410e400 con 0x7f9dc40ff6e0 2024-09-10T10:08:20.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.585+0000 7f9dc9de3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dc4065be0 0x7f9dc410d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:20.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.585+0000 7f9dc9de3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dc4065be0 0x7f9dc410d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58330/0 (socket says 172.21.15.71:58330) 2024-09-10T10:08:20.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.585+0000 7f9dc9de3640 1 -- 172.21.15.71:0/3718630863 learned_addr learned my addr 172.21.15.71:0/3718630863 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:20.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.585+0000 7f9dc95e2640 1 --2- 172.21.15.71:0/3718630863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dc40ff6e0 0x7f9dc410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:20.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.586+0000 7f9dc9de3640 1 -- 172.21.15.71:0/3718630863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dc40ff6e0 msgr2=0x7f9dc410d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:20.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.586+0000 7f9dc9de3640 1 --2- 172.21.15.71:0/3718630863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dc40ff6e0 0x7f9dc410d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.586+0000 7f9dc9de3640 1 -- 172.21.15.71:0/3718630863 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4005040 con 0x7f9dc4065be0 2024-09-10T10:08:20.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.586+0000 7f9dc9de3640 1 --2- 172.21.15.71:0/3718630863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dc4065be0 0x7f9dc410d050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0002840 tx=0x7f9dc0004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:20.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.586+0000 7f9dba7fc640 1 -- 172.21.15.71:0/3718630863 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dc0007c30 con 0x7f9dc4065be0 2024-09-10T10:08:20.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.586+0000 7f9dba7fc640 1 -- 172.21.15.71:0/3718630863 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9dc000f040 con 0x7f9dc4065be0 2024-09-10T10:08:20.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.586+0000 7f9dba7fc640 1 -- 172.21.15.71:0/3718630863 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dc000d990 con 0x7f9dc4065be0 2024-09-10T10:08:20.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.586+0000 7f9dcc047640 1 -- 172.21.15.71:0/3718630863 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc410e690 con 0x7f9dc4065be0 2024-09-10T10:08:20.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.586+0000 7f9dcc047640 1 -- 172.21.15.71:0/3718630863 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc410eaf0 con 0x7f9dc4065be0 2024-09-10T10:08:20.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.587+0000 7f9dcc047640 1 -- 172.21.15.71:0/3718630863 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc40fa890 con 0x7f9dc4065be0 2024-09-10T10:08:20.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.588+0000 7f9dba7fc640 1 -- 172.21.15.71:0/3718630863 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9dc0009600 con 0x7f9dc4065be0 2024-09-10T10:08:20.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.588+0000 7f9dba7fc640 1 --2- 172.21.15.71:0/3718630863 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9db006e0b0 0x7f9db0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:20.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.589+0000 7f9dba7fc640 1 -- 172.21.15.71:0/3718630863 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9dc008d9e0 con 0x7f9dc4065be0 2024-09-10T10:08:20.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.589+0000 7f9dc95e2640 1 --2- 172.21.15.71:0/3718630863 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9db006e0b0 0x7f9db0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:20.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.589+0000 7f9dc95e2640 1 --2- 172.21.15.71:0/3718630863 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9db006e0b0 0x7f9db0070560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9db40043d0 tx=0x7f9db4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:20.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.593+0000 7f9dba7fc640 1 -- 172.21.15.71:0/3718630863 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9dc0056d10 con 0x7f9dc4065be0 2024-09-10T10:08:20.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.869+0000 7f9dcc047640 1 -- 172.21.15.71:0/3718630863 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9dc404b720 con 0x7f9dc4065be0 2024-09-10T10:08:20.871 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:20 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1[104636]: 2024-09-10T10:08:20.750+0000 7fd153fe6640 -1 osd.1 53 log_to_monitors true 2024-09-10T10:08:20.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.870+0000 7f9dba7fc640 1 -- 172.21.15.71:0/3718630863 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f9dc005a3d0 con 0x7f9dc4065be0 2024-09-10T10:08:20.871 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:08:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:08:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:08:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:08:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:08:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:08:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:08:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:08:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4, 2024-09-10T10:08:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 1 2024-09-10T10:08:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:08:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:08:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:08:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:08:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:08:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 8, 2024-09-10T10:08:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 5 2024-09-10T10:08:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:08:20.873 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:08:20.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.872+0000 7f9dcc047640 1 -- 172.21.15.71:0/3718630863 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9db006e0b0 msgr2=0x7f9db0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:20.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.872+0000 7f9dcc047640 1 --2- 172.21.15.71:0/3718630863 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9db006e0b0 0x7f9db0070560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9db40043d0 tx=0x7f9db4035040 comp rx=0 tx=0).stop 2024-09-10T10:08:20.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.872+0000 7f9dcc047640 1 -- 172.21.15.71:0/3718630863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dc4065be0 msgr2=0x7f9dc410d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:20.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.872+0000 7f9dcc047640 1 --2- 172.21.15.71:0/3718630863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dc4065be0 0x7f9dc410d050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0002840 tx=0x7f9dc0004570 comp rx=0 tx=0).stop 2024-09-10T10:08:20.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.872+0000 7f9dcc047640 1 -- 172.21.15.71:0/3718630863 shutdown_connections 2024-09-10T10:08:20.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.872+0000 7f9dcc047640 1 --2- 172.21.15.71:0/3718630863 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9db006e0b0 0x7f9db0070560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.872+0000 7f9dcc047640 1 --2- 172.21.15.71:0/3718630863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9dc40ff6e0 0x7f9dc410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.872+0000 7f9dcc047640 1 --2- 172.21.15.71:0/3718630863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dc4065be0 0x7f9dc410d050 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.872+0000 7f9dcc047640 1 -- 172.21.15.71:0/3718630863 >> 172.21.15.71:0/3718630863 conn(0x7f9dc40f6c10 msgr2=0x7f9dc40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:20.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.873+0000 7f9dcc047640 1 -- 172.21.15.71:0/3718630863 shutdown_connections 2024-09-10T10:08:20.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.873+0000 7f9dcc047640 1 -- 172.21.15.71:0/3718630863 wait complete. 2024-09-10T10:08:20.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.953+0000 7f41878e7640 1 -- 172.21.15.71:0/651738609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41800fba20 msgr2=0x7f41800fbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:20.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.953+0000 7f41878e7640 1 --2- 172.21.15.71:0/651738609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41800fba20 0x7f41800fbe30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f417c0048d0 tx=0x7f417c009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.953+0000 7f41878e7640 1 -- 172.21.15.71:0/651738609 shutdown_connections 2024-09-10T10:08:20.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.953+0000 7f41878e7640 1 --2- 172.21.15.71:0/651738609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41800fc370 0x7f41800fc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.953+0000 7f41878e7640 1 --2- 172.21.15.71:0/651738609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41800fba20 0x7f41800fbe30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.953+0000 7f41878e7640 1 -- 172.21.15.71:0/651738609 >> 172.21.15.71:0/651738609 conn(0x7f41800f6390 msgr2=0x7f41800f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:20.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.953+0000 7f41878e7640 1 -- 172.21.15.71:0/651738609 shutdown_connections 2024-09-10T10:08:20.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.953+0000 7f41878e7640 1 -- 172.21.15.71:0/651738609 wait complete. 2024-09-10T10:08:20.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.953+0000 7f41878e7640 1 Processor -- start 2024-09-10T10:08:20.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.953+0000 7f41878e7640 1 -- start start 2024-09-10T10:08:20.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f41878e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41800fba20 0x7f418010d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:20.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f41878e7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41800fc370 0x7f418010d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:20.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f41878e7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418010dcb0 con 0x7f41800fc370 2024-09-10T10:08:20.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f41878e7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418010e4d0 con 0x7f41800fba20 2024-09-10T10:08:20.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f4184e82640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41800fc370 0x7f418010d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:20.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f4184e82640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41800fc370 0x7f418010d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58348/0 (socket says 172.21.15.71:58348) 2024-09-10T10:08:20.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f4184e82640 1 -- 172.21.15.71:0/2280441387 learned_addr learned my addr 172.21.15.71:0/2280441387 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:20.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f4185683640 1 --2- 172.21.15.71:0/2280441387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41800fba20 0x7f418010d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f4184e82640 1 -- 172.21.15.71:0/2280441387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41800fba20 msgr2=0x7f418010d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f4184e82640 1 --2- 172.21.15.71:0/2280441387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41800fba20 0x7f418010d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f4184e82640 1 -- 172.21.15.71:0/2280441387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c005040 con 0x7f41800fc370 2024-09-10T10:08:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f4184e82640 1 --2- 172.21.15.71:0/2280441387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41800fc370 0x7f418010d660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4170002a50 tx=0x7f4170004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f4175ffb640 1 -- 172.21.15.71:0/2280441387 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4170007c30 con 0x7f41800fc370 2024-09-10T10:08:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f4175ffb640 1 -- 172.21.15.71:0/2280441387 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f417000f040 con 0x7f41800fc370 2024-09-10T10:08:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.954+0000 7f41878e7640 1 -- 172.21.15.71:0/2280441387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418010e760 con 0x7f41800fc370 2024-09-10T10:08:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.955+0000 7f4175ffb640 1 -- 172.21.15.71:0/2280441387 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f417000da10 con 0x7f41800fc370 2024-09-10T10:08:20.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.955+0000 7f41878e7640 1 -- 172.21.15.71:0/2280441387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418010ed00 con 0x7f41800fc370 2024-09-10T10:08:20.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.956+0000 7f41878e7640 1 -- 172.21.15.71:0/2280441387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41800fa010 con 0x7f41800fc370 2024-09-10T10:08:20.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.956+0000 7f4175ffb640 1 -- 172.21.15.71:0/2280441387 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f417000dc50 con 0x7f41800fc370 2024-09-10T10:08:20.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.957+0000 7f4175ffb640 1 --2- 172.21.15.71:0/2280441387 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f416c06e0b0 0x7f416c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:20.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.957+0000 7f4175ffb640 1 -- 172.21.15.71:0/2280441387 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f417008d2a0 con 0x7f41800fc370 2024-09-10T10:08:20.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.957+0000 7f4185683640 1 --2- 172.21.15.71:0/2280441387 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f416c06e0b0 0x7f416c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:20.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.957+0000 7f4185683640 1 --2- 172.21.15.71:0/2280441387 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f416c06e0b0 0x7f416c070560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f417c000c00 tx=0x7f417c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:20.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:20.961+0000 7f4175ffb640 1 -- 172.21.15.71:0/2280441387 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4170056700 con 0x7f41800fc370 2024-09-10T10:08:21.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.224+0000 7f41878e7640 1 -- 172.21.15.71:0/2280441387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f418010f010 con 0x7f41800fc370 2024-09-10T10:08:21.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.224+0000 7f4175ffb640 1 -- 172.21.15.71:0/2280441387 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1955 (secure 0 0 0) 0x7f4170059dc0 con 0x7f41800fc370 2024-09-10T10:08:21.226 INFO:teuthology.orchestra.run.smithi071.stdout:e24 2024-09-10T10:08:21.226 INFO:teuthology.orchestra.run.smithi071.stdout:btime 2024-09-10T10:07:40:170505+0000 2024-09-10T10:08:21.226 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:08:21.226 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:08:21.226 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:08:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:08:21.226 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:08:21.226 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:08:21.226 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 24 2024-09-10T10:08:21.226 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:08:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:08:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:07:39.792181+0000 2024-09-10T10:08:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:08:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:08:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:08:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:08:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:08:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:08:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:08:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:08:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:08:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:08:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:08:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:08:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:08:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:08:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:08:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:08:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:08:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:08:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:08:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:08:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:08:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:08:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 14464 members: 24267,14464 2024-09-10T10:08:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:08:21.229 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:08:21.229 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:08:21.229 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:08:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:08:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:08:21.229 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 24 2024-09-10T10:08:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.228+0000 7f41878e7640 1 -- 172.21.15.71:0/2280441387 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f416c06e0b0 msgr2=0x7f416c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.228+0000 7f41878e7640 1 --2- 172.21.15.71:0/2280441387 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f416c06e0b0 0x7f416c070560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f417c000c00 tx=0x7f417c035040 comp rx=0 tx=0).stop 2024-09-10T10:08:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.228+0000 7f41878e7640 1 -- 172.21.15.71:0/2280441387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41800fc370 msgr2=0x7f418010d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.228+0000 7f41878e7640 1 --2- 172.21.15.71:0/2280441387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41800fc370 0x7f418010d660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4170002a50 tx=0x7f4170004600 comp rx=0 tx=0).stop 2024-09-10T10:08:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.228+0000 7f41878e7640 1 -- 172.21.15.71:0/2280441387 shutdown_connections 2024-09-10T10:08:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.228+0000 7f41878e7640 1 --2- 172.21.15.71:0/2280441387 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f416c06e0b0 0x7f416c070560 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.228+0000 7f41878e7640 1 --2- 172.21.15.71:0/2280441387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f41800fc370 0x7f418010d660 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.228+0000 7f41878e7640 1 --2- 172.21.15.71:0/2280441387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41800fba20 0x7f418010d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.228+0000 7f41878e7640 1 -- 172.21.15.71:0/2280441387 >> 172.21.15.71:0/2280441387 conn(0x7f41800f6390 msgr2=0x7f41800f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.228+0000 7f41878e7640 1 -- 172.21.15.71:0/2280441387 shutdown_connections 2024-09-10T10:08:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.228+0000 7f41878e7640 1 -- 172.21.15.71:0/2280441387 wait complete. 2024-09-10T10:08:21.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.326+0000 7f9e8d98e640 1 -- 172.21.15.71:0/2189169117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e880fb430 msgr2=0x7f9e880fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:21.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.326+0000 7f9e8d98e640 1 --2- 172.21.15.71:0/2189169117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e880fb430 0x7f9e880fb840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9e780048d0 tx=0x7f9e78009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.326+0000 7f9e8d98e640 1 -- 172.21.15.71:0/2189169117 shutdown_connections 2024-09-10T10:08:21.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.326+0000 7f9e8d98e640 1 --2- 172.21.15.71:0/2189169117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e880fc700 0x7f9e880fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.326+0000 7f9e8d98e640 1 --2- 172.21.15.71:0/2189169117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e880fb430 0x7f9e880fb840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.326+0000 7f9e8d98e640 1 -- 172.21.15.71:0/2189169117 >> 172.21.15.71:0/2189169117 conn(0x7f9e880f6c10 msgr2=0x7f9e880f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:21.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.326+0000 7f9e8d98e640 1 -- 172.21.15.71:0/2189169117 shutdown_connections 2024-09-10T10:08:21.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.326+0000 7f9e8d98e640 1 -- 172.21.15.71:0/2189169117 wait complete. 2024-09-10T10:08:21.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.327+0000 7f9e8d98e640 1 Processor -- start 2024-09-10T10:08:21.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.327+0000 7f9e8d98e640 1 -- start start 2024-09-10T10:08:21.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.327+0000 7f9e8d98e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e880fb430 0x7f9e8810f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:21.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.327+0000 7f9e8d98e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e880fc700 0x7f9e8810f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:21.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.327+0000 7f9e8d98e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8810fe20 con 0x7f9e880fb430 2024-09-10T10:08:21.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.327+0000 7f9e8d98e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e88110640 con 0x7f9e880fc700 2024-09-10T10:08:21.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.327+0000 7f9e86ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e880fb430 0x7f9e8810f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:21.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.327+0000 7f9e86ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e880fb430 0x7f9e8810f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58362/0 (socket says 172.21.15.71:58362) 2024-09-10T10:08:21.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.327+0000 7f9e86ffd640 1 -- 172.21.15.71:0/1409010328 learned_addr learned my addr 172.21.15.71:0/1409010328 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:21.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.327+0000 7f9e867fc640 1 --2- 172.21.15.71:0/1409010328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e880fc700 0x7f9e8810f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:21.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.328+0000 7f9e86ffd640 1 -- 172.21.15.71:0/1409010328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e880fc700 msgr2=0x7f9e8810f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:21.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.328+0000 7f9e86ffd640 1 --2- 172.21.15.71:0/1409010328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e880fc700 0x7f9e8810f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.328+0000 7f9e86ffd640 1 -- 172.21.15.71:0/1409010328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e78005040 con 0x7f9e880fb430 2024-09-10T10:08:21.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.328+0000 7f9e867fc640 1 --2- 172.21.15.71:0/1409010328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e880fc700 0x7f9e8810f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:08:21.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.328+0000 7f9e86ffd640 1 --2- 172.21.15.71:0/1409010328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e880fb430 0x7f9e8810f290 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9e780043d0 tx=0x7f9e78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:21.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.328+0000 7f9e6f7fe640 1 -- 172.21.15.71:0/1409010328 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e78038070 con 0x7f9e880fb430 2024-09-10T10:08:21.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.328+0000 7f9e6f7fe640 1 -- 172.21.15.71:0/1409010328 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9e7802ae90 con 0x7f9e880fb430 2024-09-10T10:08:21.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.328+0000 7f9e6f7fe640 1 -- 172.21.15.71:0/1409010328 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e7803e670 con 0x7f9e880fb430 2024-09-10T10:08:21.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.328+0000 7f9e8d98e640 1 -- 172.21.15.71:0/1409010328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e88110870 con 0x7f9e880fb430 2024-09-10T10:08:21.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.328+0000 7f9e8d98e640 1 -- 172.21.15.71:0/1409010328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e88110e10 con 0x7f9e880fb430 2024-09-10T10:08:21.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.329+0000 7f9e8d98e640 1 -- 172.21.15.71:0/1409010328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e880fa890 con 0x7f9e880fb430 2024-09-10T10:08:21.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.330+0000 7f9e6f7fe640 1 -- 172.21.15.71:0/1409010328 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9e78030020 con 0x7f9e880fb430 2024-09-10T10:08:21.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.330+0000 7f9e6f7fe640 1 --2- 172.21.15.71:0/1409010328 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9e7006e0b0 0x7f9e70070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:21.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.330+0000 7f9e6f7fe640 1 -- 172.21.15.71:0/1409010328 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9e780addd0 con 0x7f9e880fb430 2024-09-10T10:08:21.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.330+0000 7f9e867fc640 1 --2- 172.21.15.71:0/1409010328 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9e7006e0b0 0x7f9e70070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:21.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.331+0000 7f9e867fc640 1 --2- 172.21.15.71:0/1409010328 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9e7006e0b0 0x7f9e70070560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c007fd0 tx=0x7f9e7c009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:21.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.335+0000 7f9e6f7fe640 1 -- 172.21.15.71:0/1409010328 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9e78077180 con 0x7f9e880fb430 2024-09-10T10:08:21.531 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:21 smithi071 ceph-mon[90773]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:21.531 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:21 smithi071 ceph-mon[90773]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 50/321 objects degraded (15.576%) 2024-09-10T10:08:21.531 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:21 smithi071 ceph-mon[90773]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:21.531 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:21 smithi071 ceph-mon[90773]: from='osd.1 [v2:172.21.15.71:6810/1051787900,v1:172.21.15.71:6811/1051787900]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:08:21.531 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:21 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/3718630863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:21.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.556+0000 7f9e8d98e640 1 -- 172.21.15.71:0/1409010328 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e88111080 con 0x7f9e7006e0b0 2024-09-10T10:08:21.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.558+0000 7f9e6f7fe640 1 -- 172.21.15.71:0/1409010328 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9e88111080 con 0x7f9e7006e0b0 2024-09-10T10:08:21.559 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:08:21.559 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:08:21.559 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:08:21.559 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:08:21.559 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:08:21.559 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-09-10T10:08:21.559 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-10T10:08:21.559 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-10T10:08:21.559 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:08:21.559 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "8/21 daemons upgraded", 2024-09-10T10:08:21.560 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T10:08:21.560 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:08:21.560 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:08:21.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.560+0000 7f9e8d98e640 1 -- 172.21.15.71:0/1409010328 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9e7006e0b0 msgr2=0x7f9e70070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:21.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.560+0000 7f9e8d98e640 1 --2- 172.21.15.71:0/1409010328 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9e7006e0b0 0x7f9e70070560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c007fd0 tx=0x7f9e7c009e90 comp rx=0 tx=0).stop 2024-09-10T10:08:21.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.560+0000 7f9e8d98e640 1 -- 172.21.15.71:0/1409010328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e880fb430 msgr2=0x7f9e8810f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:21.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.560+0000 7f9e8d98e640 1 --2- 172.21.15.71:0/1409010328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e880fb430 0x7f9e8810f290 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9e780043d0 tx=0x7f9e78009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.560+0000 7f9e8d98e640 1 -- 172.21.15.71:0/1409010328 shutdown_connections 2024-09-10T10:08:21.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.560+0000 7f9e8d98e640 1 --2- 172.21.15.71:0/1409010328 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9e7006e0b0 0x7f9e70070560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.560+0000 7f9e8d98e640 1 --2- 172.21.15.71:0/1409010328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e880fc700 0x7f9e8810f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.560+0000 7f9e8d98e640 1 --2- 172.21.15.71:0/1409010328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e880fb430 0x7f9e8810f290 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.560+0000 7f9e8d98e640 1 -- 172.21.15.71:0/1409010328 >> 172.21.15.71:0/1409010328 conn(0x7f9e880f6c10 msgr2=0x7f9e880655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:21.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.560+0000 7f9e8d98e640 1 -- 172.21.15.71:0/1409010328 shutdown_connections 2024-09-10T10:08:21.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.560+0000 7f9e8d98e640 1 -- 172.21.15.71:0/1409010328 wait complete. 2024-09-10T10:08:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:21 smithi107 ceph-mon[79396]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:21.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:21 smithi107 ceph-mon[79396]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 50/321 objects degraded (15.576%) 2024-09-10T10:08:21.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:21 smithi107 ceph-mon[79396]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:21.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:21 smithi107 ceph-mon[79396]: from='osd.1 [v2:172.21.15.71:6810/1051787900,v1:172.21.15.71:6811/1051787900]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:08:21.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:21 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/3718630863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:21.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.660+0000 7fb1bacfe640 1 -- 172.21.15.71:0/1233244631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1b40ff6f0 msgr2=0x7fb1b4101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:21.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.660+0000 7fb1bacfe640 1 --2- 172.21.15.71:0/1233244631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1b40ff6f0 0x7fb1b4101ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb1a00048d0 tx=0x7fb1a0009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.660+0000 7fb1bacfe640 1 -- 172.21.15.71:0/1233244631 shutdown_connections 2024-09-10T10:08:21.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.660+0000 7fb1bacfe640 1 --2- 172.21.15.71:0/1233244631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1b40ff6f0 0x7fb1b4101ad0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.660+0000 7fb1bacfe640 1 --2- 172.21.15.71:0/1233244631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1b4066650 0x7fb1b40ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.660+0000 7fb1bacfe640 1 -- 172.21.15.71:0/1233244631 >> 172.21.15.71:0/1233244631 conn(0x7fb1b40f6c20 msgr2=0x7fb1b40f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:21.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.660+0000 7fb1bacfe640 1 -- 172.21.15.71:0/1233244631 shutdown_connections 2024-09-10T10:08:21.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.660+0000 7fb1bacfe640 1 -- 172.21.15.71:0/1233244631 wait complete. 2024-09-10T10:08:21.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.661+0000 7fb1bacfe640 1 Processor -- start 2024-09-10T10:08:21.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.661+0000 7fb1bacfe640 1 -- start start 2024-09-10T10:08:21.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.661+0000 7fb1bacfe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1b4066650 0x7fb1b40fcb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:21.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.662+0000 7fb1bacfe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1b40ff6f0 0x7fb1b40fb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:21.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.662+0000 7fb1bacfe640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40fb5f0 con 0x7fb1b40ff6f0 2024-09-10T10:08:21.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.662+0000 7fb1bacfe640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40fb730 con 0x7fb1b4066650 2024-09-10T10:08:21.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.662+0000 7fb1b8a9a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1b4066650 0x7fb1b40fcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:21.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.662+0000 7fb1b8a9a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1b4066650 0x7fb1b40fcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.71:48016/0 (socket says 172.21.15.71:48016) 2024-09-10T10:08:21.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.662+0000 7fb1b8a9a640 1 -- 172.21.15.71:0/2139848365 learned_addr learned my addr 172.21.15.71:0/2139848365 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:21.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.662+0000 7fb1b3fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1b40ff6f0 0x7fb1b40fb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:21.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.662+0000 7fb1b3fff640 1 -- 172.21.15.71:0/2139848365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1b4066650 msgr2=0x7fb1b40fcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:21.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.662+0000 7fb1b3fff640 1 --2- 172.21.15.71:0/2139848365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1b4066650 0x7fb1b40fcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:21.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.662+0000 7fb1b3fff640 1 -- 172.21.15.71:0/2139848365 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a0005040 con 0x7fb1b40ff6f0 2024-09-10T10:08:21.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.662+0000 7fb1b8a9a640 1 --2- 172.21.15.71:0/2139848365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1b4066650 0x7fb1b40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:08:21.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.663+0000 7fb1b3fff640 1 --2- 172.21.15.71:0/2139848365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1b40ff6f0 0x7fb1b40fb0b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1a002d040 tx=0x7fb1a0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:21.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.663+0000 7fb1b17fa640 1 -- 172.21.15.71:0/2139848365 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a0038070 con 0x7fb1b40ff6f0 2024-09-10T10:08:21.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.663+0000 7fb1b17fa640 1 -- 172.21.15.71:0/2139848365 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb1a0032d30 con 0x7fb1b40ff6f0 2024-09-10T10:08:21.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.663+0000 7fb1bacfe640 1 -- 172.21.15.71:0/2139848365 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b40fb9b0 con 0x7fb1b40ff6f0 2024-09-10T10:08:21.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.663+0000 7fb1bacfe640 1 -- 172.21.15.71:0/2139848365 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b40fbe00 con 0x7fb1b40ff6f0 2024-09-10T10:08:21.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.664+0000 7fb1b17fa640 1 -- 172.21.15.71:0/2139848365 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a003d9f0 con 0x7fb1b40ff6f0 2024-09-10T10:08:21.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.664+0000 7fb1bacfe640 1 -- 172.21.15.71:0/2139848365 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb198005240 con 0x7fb1b40ff6f0 2024-09-10T10:08:21.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.665+0000 7fb1b17fa640 1 -- 172.21.15.71:0/2139848365 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb1a0030020 con 0x7fb1b40ff6f0 2024-09-10T10:08:21.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.666+0000 7fb1b17fa640 1 --2- 172.21.15.71:0/2139848365 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb1a406e0f0 0x7fb1a40705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:21.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.666+0000 7fb1b17fa640 1 -- 172.21.15.71:0/2139848365 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb1a00ae470 con 0x7fb1b40ff6f0 2024-09-10T10:08:21.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.666+0000 7fb1b8a9a640 1 --2- 172.21.15.71:0/2139848365 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb1a406e0f0 0x7fb1a40705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:21.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.667+0000 7fb1b8a9a640 1 --2- 172.21.15.71:0/2139848365 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb1a406e0f0 0x7fb1a40705a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40fc920 tx=0x7fb1a800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:21.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:21.672+0000 7fb1b17fa640 1 -- 172.21.15.71:0/2139848365 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb1a00777a0 con 0x7fb1b40ff6f0 2024-09-10T10:08:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:22.121+0000 7fb1bacfe640 1 -- 172.21.15.71:0/2139848365 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb1980054f0 con 0x7fb1b40ff6f0 2024-09-10T10:08:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:22.122+0000 7fb1b17fa640 1 -- 172.21.15.71:0/2139848365 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1160 (secure 0 0 0) 0x7fb1a007ae60 con 0x7fb1b40ff6f0 2024-09-10T10:08:22.123 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 50/321 objects degraded (15.576%), 16 pgs degraded 2024-09-10T10:08:22.123 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-10T10:08:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: osd.1 (root=default,host=smithi071) is down 2024-09-10T10:08:22.124 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 50/321 objects degraded (15.576%), 16 pgs degraded 2024-09-10T10:08:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-10T10:08:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-10T10:08:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-10T10:08:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-10T10:08:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-10T10:08:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-10T10:08:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-10T10:08:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-10T10:08:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-10T10:08:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-10T10:08:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-10T10:08:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-09-10T10:08:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-10T10:08:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-10T10:08:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-10T10:08:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-10T10:08:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:22.124+0000 7fb1bacfe640 1 -- 172.21.15.71:0/2139848365 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb1a406e0f0 msgr2=0x7fb1a40705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:22.124+0000 7fb1bacfe640 1 --2- 172.21.15.71:0/2139848365 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb1a406e0f0 0x7fb1a40705a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40fc920 tx=0x7fb1a800b040 comp rx=0 tx=0).stop 2024-09-10T10:08:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:22.124+0000 7fb1bacfe640 1 -- 172.21.15.71:0/2139848365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1b40ff6f0 msgr2=0x7fb1b40fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:22.124+0000 7fb1bacfe640 1 --2- 172.21.15.71:0/2139848365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1b40ff6f0 0x7fb1b40fb0b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1a002d040 tx=0x7fb1a0009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:22.124+0000 7fb1bacfe640 1 -- 172.21.15.71:0/2139848365 shutdown_connections 2024-09-10T10:08:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:22.124+0000 7fb1bacfe640 1 --2- 172.21.15.71:0/2139848365 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb1a406e0f0 0x7fb1a40705a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:22.124+0000 7fb1bacfe640 1 --2- 172.21.15.71:0/2139848365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1b40ff6f0 0x7fb1b40fb0b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:22.124+0000 7fb1bacfe640 1 --2- 172.21.15.71:0/2139848365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1b4066650 0x7fb1b40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:22.124+0000 7fb1bacfe640 1 -- 172.21.15.71:0/2139848365 >> 172.21.15.71:0/2139848365 conn(0x7fb1b40f6c20 msgr2=0x7fb1b40f6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:22.124+0000 7fb1bacfe640 1 -- 172.21.15.71:0/2139848365 shutdown_connections 2024-09-10T10:08:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:22.124+0000 7fb1bacfe640 1 -- 172.21.15.71:0/2139848365 wait complete. 2024-09-10T10:08:22.539 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1[104636]: 2024-09-10T10:08:22.111+0000 7fd147d78640 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:08:22.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:22.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='osd.1 [v2:172.21.15.71:6810/1051787900,v1:172.21.15.71:6811/1051787900]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T10:08:22.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: osdmap e56: 6 total, 5 up, 6 in 2024-09-10T10:08:22.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='osd.1 [v2:172.21.15.71:6810/1051787900,v1:172.21.15.71:6811/1051787900]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-10T10:08:22.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2280441387' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:08:22.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:22.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:22.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:22.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:08:22.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:22.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='osd.1 [v2:172.21.15.71:6810/1051787900,v1:172.21.15.71:6811/1051787900]' entity='osd.1' 2024-09-10T10:08:22.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2139848365' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:08:22.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:22.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:22.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:22.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:22.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T10:08:22.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:22.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='osd.1 [v2:172.21.15.71:6810/1051787900,v1:172.21.15.71:6811/1051787900]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T10:08:22.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: osdmap e56: 6 total, 5 up, 6 in 2024-09-10T10:08:22.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='osd.1 [v2:172.21.15.71:6810/1051787900,v1:172.21.15.71:6811/1051787900]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-10T10:08:22.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2280441387' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:08:22.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:22.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:22.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:22.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:08:22.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:22.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='osd.1 [v2:172.21.15.71:6810/1051787900,v1:172.21.15.71:6811/1051787900]' entity='osd.1' 2024-09-10T10:08:22.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2139848365' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:08:22.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:22.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:22.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:22.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:22.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T10:08:23.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:23 smithi071 ceph-mon[90773]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:23.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:23 smithi071 ceph-mon[90773]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 50/321 objects degraded (15.576%) 2024-09-10T10:08:23.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:23 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T10:08:23.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:23 smithi071 ceph-mon[90773]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-10T10:08:23.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:23 smithi071 ceph-mon[90773]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T10:08:23.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:23 smithi071 ceph-mon[90773]: osd.1 [v2:172.21.15.71:6810/1051787900,v1:172.21.15.71:6811/1051787900] boot 2024-09-10T10:08:23.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:23 smithi071 ceph-mon[90773]: osdmap e57: 6 total, 6 up, 6 in 2024-09-10T10:08:23.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:23 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:08:23.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:23 smithi107 ceph-mon[79396]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:23.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:23 smithi107 ceph-mon[79396]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 50/321 objects degraded (15.576%) 2024-09-10T10:08:23.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:23 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T10:08:23.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:23 smithi107 ceph-mon[79396]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-10T10:08:23.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:23 smithi107 ceph-mon[79396]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T10:08:23.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:23 smithi107 ceph-mon[79396]: osd.1 [v2:172.21.15.71:6810/1051787900,v1:172.21.15.71:6811/1051787900] boot 2024-09-10T10:08:23.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:23 smithi107 ceph-mon[79396]: osdmap e57: 6 total, 6 up, 6 in 2024-09-10T10:08:23.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:23 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:08:25.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:25 smithi107 ceph-mon[79396]: osdmap e58: 6 total, 6 up, 6 in 2024-09-10T10:08:25.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:25 smithi107 ceph-mon[79396]: pgmap v73: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 50/321 objects degraded (15.576%) 2024-09-10T10:08:25.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:25 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:25.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:25 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:08:25.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:25 smithi071 ceph-mon[90773]: osdmap e58: 6 total, 6 up, 6 in 2024-09-10T10:08:25.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:25 smithi071 ceph-mon[90773]: pgmap v73: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 50/321 objects degraded (15.576%) 2024-09-10T10:08:25.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:25.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:08:26.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:26 smithi071 ceph-mon[90773]: Health check update: Degraded data redundancy: 21/321 objects degraded (6.542%), 7 pgs degraded (PG_DEGRADED) 2024-09-10T10:08:26.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:26 smithi107 ceph-mon[79396]: Health check update: Degraded data redundancy: 21/321 objects degraded (6.542%), 7 pgs degraded (PG_DEGRADED) 2024-09-10T10:08:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:27 smithi071 ceph-mon[90773]: pgmap v74: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 21/321 objects degraded (6.542%) 2024-09-10T10:08:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:27 smithi107 ceph-mon[79396]: pgmap v74: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 21/321 objects degraded (6.542%) 2024-09-10T10:08:28.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:28 smithi107 ceph-mon[79396]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/321 objects degraded (6.542%), 7 pgs degraded) 2024-09-10T10:08:28.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:28 smithi107 ceph-mon[79396]: Cluster is now healthy 2024-09-10T10:08:28.659 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:28 smithi071 ceph-mon[90773]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/321 objects degraded (6.542%), 7 pgs degraded) 2024-09-10T10:08:28.659 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:28 smithi071 ceph-mon[90773]: Cluster is now healthy 2024-09-10T10:08:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:29 smithi107 ceph-mon[79396]: pgmap v75: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 884 B/s rd, 1 op/s 2024-09-10T10:08:29.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:29 smithi071 ceph-mon[90773]: pgmap v75: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 884 B/s rd, 1 op/s 2024-09-10T10:08:31.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:31 smithi107 ceph-mon[79396]: pgmap v76: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:08:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:31 smithi071 ceph-mon[90773]: pgmap v76: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:08:33.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:33 smithi107 ceph-mon[79396]: pgmap v77: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-10T10:08:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:33 smithi071 ceph-mon[90773]: pgmap v77: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-10T10:08:35.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:35 smithi071 ceph-mon[90773]: pgmap v78: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-10T10:08:35.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:35 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:35.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:35 smithi107 ceph-mon[79396]: pgmap v78: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-10T10:08:35.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:35 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:37.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:37 smithi071 ceph-mon[90773]: pgmap v79: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-10T10:08:37.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T10:08:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:37 smithi107 ceph-mon[79396]: pgmap v79: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-10T10:08:37.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T10:08:38.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:38 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T10:08:38.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:38 smithi071 ceph-mon[90773]: Upgrade: osd.2 is safe to restart 2024-09-10T10:08:38.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:38 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T10:08:38.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:38 smithi107 ceph-mon[79396]: Upgrade: osd.2 is safe to restart 2024-09-10T10:08:39.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:39 smithi071 ceph-mon[90773]: pgmap v80: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:08:39.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:39.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T10:08:39.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:39.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:39.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:08:39.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:39 smithi107 ceph-mon[79396]: pgmap v80: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:08:39.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:39.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T10:08:39.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:39.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:39.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:08:40.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:40 smithi071 ceph-mon[90773]: Upgrade: Updating osd.2 2024-09-10T10:08:40.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:40 smithi071 ceph-mon[90773]: Deploying daemon osd.2 on smithi071 2024-09-10T10:08:40.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:40 smithi107 ceph-mon[79396]: Upgrade: Updating osd.2 2024-09-10T10:08:40.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:40 smithi107 ceph-mon[79396]: Deploying daemon osd.2 on smithi071 2024-09-10T10:08:41.503 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:41 smithi071 ceph-mon[90773]: pgmap v81: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:08:41.504 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:41 smithi071 systemd[1]: Stopping Ceph osd.2 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:08:41.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:41 smithi107 ceph-mon[79396]: pgmap v81: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:08:41.789 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:41 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2[60890]: 2024-09-10T10:08:41.502+0000 7f0abeb61640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:08:41.789 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:41 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2[60890]: 2024-09-10T10:08:41.502+0000 7f0abeb61640 -1 osd.2 58 *** Got signal Terminated *** 2024-09-10T10:08:41.789 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:41 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2[60890]: 2024-09-10T10:08:41.502+0000 7f0abeb61640 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:08:42.471 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:42 smithi071 ceph-mon[90773]: osd.2 marked itself down and dead 2024-09-10T10:08:42.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:42 smithi107 ceph-mon[79396]: osd.2 marked itself down and dead 2024-09-10T10:08:42.789 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:42 smithi071 podman[109545]: 2024-09-10 10:08:42.681909536 +0000 UTC m=+1.280895549 container died 4fae52756a24314aa0790edb87904987d33bda665aa2774308c736d520954b13 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2, RELEASE=quincy-96d63e7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T10:08:43.218 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:43 smithi071 podman[109545]: 2024-09-10 10:08:43.027137298 +0000 UTC m=+1.626123312 container cleanup 4fae52756a24314aa0790edb87904987d33bda665aa2774308c736d520954b13 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-96d63e7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T10:08:43.218 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:43 smithi071 bash[109545]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2 2024-09-10T10:08:43.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:43 smithi071 ceph-mon[90773]: pgmap v82: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:08:43.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:43 smithi071 ceph-mon[90773]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T10:08:43.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:43 smithi071 ceph-mon[90773]: osdmap e59: 6 total, 5 up, 6 in 2024-09-10T10:08:43.507 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:43 smithi071 podman[109571]: 2024-09-10 10:08:43.312028657 +0000 UTC m=+0.630845446 container remove 4fae52756a24314aa0790edb87904987d33bda665aa2774308c736d520954b13 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-96d63e7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T10:08:43.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:43 smithi107 ceph-mon[79396]: pgmap v82: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:08:43.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:43 smithi107 ceph-mon[79396]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T10:08:43.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:43 smithi107 ceph-mon[79396]: osdmap e59: 6 total, 5 up, 6 in 2024-09-10T10:08:43.768 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:43 smithi071 podman[109659]: 2024-09-10 10:08:43.629627578 +0000 UTC m=+0.108269164 container create e9f68b6997168421446dfbb0dfba4055aaa22dfa10da43c71baa977f32197532 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T10:08:43.768 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:43 smithi071 podman[109659]: 2024-09-10 10:08:43.53768935 +0000 UTC m=+0.016330904 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:08:44.227 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:43 smithi071 podman[109659]: 2024-09-10 10:08:43.865359899 +0000 UTC m=+0.344001439 container init e9f68b6997168421446dfbb0dfba4055aaa22dfa10da43c71baa977f32197532 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T10:08:44.227 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:43 smithi071 podman[109659]: 2024-09-10 10:08:43.868685332 +0000 UTC m=+0.347326879 container start e9f68b6997168421446dfbb0dfba4055aaa22dfa10da43c71baa977f32197532 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T10:08:44.227 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:43 smithi071 podman[109659]: 2024-09-10 10:08:43.940394647 +0000 UTC m=+0.419036203 container attach e9f68b6997168421446dfbb0dfba4055aaa22dfa10da43c71baa977f32197532 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T10:08:44.227 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:44 smithi071 podman[109659]: 2024-09-10 10:08:44.057156726 +0000 UTC m=+0.535798271 container died e9f68b6997168421446dfbb0dfba4055aaa22dfa10da43c71baa977f32197532 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T10:08:44.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:44 smithi071 ceph-mon[90773]: osdmap e60: 6 total, 5 up, 6 in 2024-09-10T10:08:44.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:44 smithi107 ceph-mon[79396]: osdmap e60: 6 total, 5 up, 6 in 2024-09-10T10:08:45.039 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:44 smithi071 podman[109682]: 2024-09-10 10:08:44.752950826 +0000 UTC m=+0.689742793 container remove e9f68b6997168421446dfbb0dfba4055aaa22dfa10da43c71baa977f32197532 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T10:08:45.039 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:44 smithi071 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-10T10:08:45.039 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:44 smithi071 systemd[1]: Stopped Ceph osd.2 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:08:45.040 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:44 smithi071 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.2.service: Consumed 52.902s CPU time. 2024-09-10T10:08:45.040 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:44 smithi071 systemd[1]: Starting Ceph osd.2 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:08:45.457 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:45 smithi071 ceph-mon[90773]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T10:08:45.457 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:45 smithi071 podman[109781]: 2024-09-10 10:08:45.106818354 +0000 UTC m=+0.016237139 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:08:45.457 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:45 smithi071 podman[109781]: 2024-09-10 10:08:45.237422363 +0000 UTC m=+0.146841148 container create cad08d697de77efaa80259b9e7956100c1cd57c641080986c6b417bb41d1b29c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:08:45.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:45 smithi107 ceph-mon[79396]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T10:08:45.789 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:45 smithi071 podman[109781]: 2024-09-10 10:08:45.456801245 +0000 UTC m=+0.366220038 container init cad08d697de77efaa80259b9e7956100c1cd57c641080986c6b417bb41d1b29c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T10:08:45.789 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:45 smithi071 podman[109781]: 2024-09-10 10:08:45.460384073 +0000 UTC m=+0.369802867 container start cad08d697de77efaa80259b9e7956100c1cd57c641080986c6b417bb41d1b29c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T10:08:45.789 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:45 smithi071 podman[109781]: 2024-09-10 10:08:45.53142395 +0000 UTC m=+0.440842739 container attach cad08d697de77efaa80259b9e7956100c1cd57c641080986c6b417bb41d1b29c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T10:08:45.789 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:45 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate[109796]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:08:45.789 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:45 smithi071 bash[109781]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:08:45.789 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:45 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate[109796]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:08:45.789 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:45 smithi071 bash[109781]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:08:46.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:46 smithi071 ceph-mon[90773]: Health check failed: Degraded data redundancy: 26/321 objects degraded (8.100%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T10:08:46.539 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate[109796]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T10:08:46.539 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 bash[109781]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T10:08:46.539 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate[109796]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-10T10:08:46.539 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 bash[109781]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-10T10:08:46.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:46 smithi107 ceph-mon[79396]: Health check failed: Degraded data redundancy: 26/321 objects degraded (8.100%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T10:08:46.928 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate[109796]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-10T10:08:46.928 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 bash[109781]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-10T10:08:46.928 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate[109796]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-10T10:08:46.928 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 bash[109781]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-10T10:08:46.928 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate[109796]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-10T10:08:46.928 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 bash[109781]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-10T10:08:46.928 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate[109796]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T10:08:46.928 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 bash[109781]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T10:08:46.929 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate[109796]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-10T10:08:46.929 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 bash[109781]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-10T10:08:46.929 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:46 smithi071 podman[109781]: 2024-09-10 10:08:46.63912257 +0000 UTC m=+1.548541355 container died cad08d697de77efaa80259b9e7956100c1cd57c641080986c6b417bb41d1b29c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T10:08:47.530 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:47 smithi071 ceph-mon[90773]: pgmap v86: 65 pgs: 11 active+undersized, 4 stale+active+clean, 9 active+undersized+degraded, 41 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 26/321 objects degraded (8.100%) 2024-09-10T10:08:47.531 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:47 smithi071 podman[109940]: 2024-09-10 10:08:47.202073427 +0000 UTC m=+0.551797256 container remove cad08d697de77efaa80259b9e7956100c1cd57c641080986c6b417bb41d1b29c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T10:08:47.531 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:47 smithi071 podman[109998]: 2024-09-10 10:08:47.311247148 +0000 UTC m=+0.016030328 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:08:47.531 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:47 smithi071 podman[109998]: 2024-09-10 10:08:47.41973968 +0000 UTC m=+0.124522906 container create 5e5976fcfaa81727e959c26080e1594e5c70fe50c6f5c56dfcdddafccdaa9737 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T10:08:47.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:47 smithi107 ceph-mon[79396]: pgmap v86: 65 pgs: 11 active+undersized, 4 stale+active+clean, 9 active+undersized+degraded, 41 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 26/321 objects degraded (8.100%) 2024-09-10T10:08:48.041 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:47 smithi071 podman[109998]: 2024-09-10 10:08:47.63075463 +0000 UTC m=+0.335537810 container init 5e5976fcfaa81727e959c26080e1594e5c70fe50c6f5c56dfcdddafccdaa9737 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T10:08:48.842 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:47 smithi071 podman[109998]: 2024-09-10 10:08:47.633899238 +0000 UTC m=+0.338682418 container start 5e5976fcfaa81727e959c26080e1594e5c70fe50c6f5c56dfcdddafccdaa9737 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T10:08:48.843 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:47 smithi071 ceph-osd[110016]: -- 172.21.15.71:0/935681061 <== mon.0 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5557a7d3e1e0 con 0x5557a7d3c000 2024-09-10T10:08:48.843 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:47 smithi071 bash[109998]: 5e5976fcfaa81727e959c26080e1594e5c70fe50c6f5c56dfcdddafccdaa9737 2024-09-10T10:08:48.843 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:47 smithi071 systemd[1]: Started Ceph osd.2 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:08:49.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:48 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:49.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:48 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:49.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:48 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:49.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:48 smithi071 ceph-mon[90773]: pgmap v87: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 39/321 objects degraded (12.150%) 2024-09-10T10:08:49.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:48 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:49.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:48 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:49.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:48 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:49.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:48 smithi107 ceph-mon[79396]: pgmap v87: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 39/321 objects degraded (12.150%) 2024-09-10T10:08:49.539 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:49 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2[110012]: 2024-09-10T10:08:49.279+0000 7fb6fb343640 -1 Falling back to public interface 2024-09-10T10:08:51.522 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:51 smithi071 ceph-mon[90773]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 39/321 objects degraded (12.150%) 2024-09-10T10:08:51.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:51 smithi107 ceph-mon[79396]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 39/321 objects degraded (12.150%) 2024-09-10T10:08:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.207+0000 7f49222a4640 1 -- 172.21.15.71:0/3024286359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f491c065c40 msgr2=0x7f491c0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.207+0000 7f49222a4640 1 --2- 172.21.15.71:0/3024286359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f491c065c40 0x7f491c0ff140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f490c0048d0 tx=0x7f490c009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.207+0000 7f49222a4640 1 -- 172.21.15.71:0/3024286359 shutdown_connections 2024-09-10T10:08:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.207+0000 7f49222a4640 1 --2- 172.21.15.71:0/3024286359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f491c0ff680 0x7f491c101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.207+0000 7f49222a4640 1 --2- 172.21.15.71:0/3024286359 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f491c065c40 0x7f491c0ff140 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.207+0000 7f49222a4640 1 -- 172.21.15.71:0/3024286359 >> 172.21.15.71:0/3024286359 conn(0x7f491c0f6c10 msgr2=0x7f491c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.207+0000 7f49222a4640 1 -- 172.21.15.71:0/3024286359 shutdown_connections 2024-09-10T10:08:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.207+0000 7f49222a4640 1 -- 172.21.15.71:0/3024286359 wait complete. 2024-09-10T10:08:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.207+0000 7f49222a4640 1 Processor -- start 2024-09-10T10:08:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.207+0000 7f49222a4640 1 -- start start 2024-09-10T10:08:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f49222a4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f491c065c40 0x7f491c10d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f49222a4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f491c0ff680 0x7f491c10d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f49222a4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c10dca0 con 0x7f491c0ff680 2024-09-10T10:08:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f49222a4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c10e400 con 0x7f491c065c40 2024-09-10T10:08:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f4913fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f491c0ff680 0x7f491c10d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f4913fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f491c0ff680 0x7f491c10d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32858/0 (socket says 172.21.15.71:32858) 2024-09-10T10:08:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f4913fff640 1 -- 172.21.15.71:0/886914342 learned_addr learned my addr 172.21.15.71:0/886914342 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f491bfff640 1 --2- 172.21.15.71:0/886914342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f491c065c40 0x7f491c10d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f4913fff640 1 -- 172.21.15.71:0/886914342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f491c065c40 msgr2=0x7f491c10d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f4913fff640 1 --2- 172.21.15.71:0/886914342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f491c065c40 0x7f491c10d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f4913fff640 1 -- 172.21.15.71:0/886914342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c005040 con 0x7f491c0ff680 2024-09-10T10:08:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f4913fff640 1 --2- 172.21.15.71:0/886914342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f491c0ff680 0x7f491c10d650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4904002a50 tx=0x7f4904004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f49197fa640 1 -- 172.21.15.71:0/886914342 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4904007c30 con 0x7f491c0ff680 2024-09-10T10:08:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f49222a4640 1 -- 172.21.15.71:0/886914342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c10e690 con 0x7f491c0ff680 2024-09-10T10:08:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f49197fa640 1 -- 172.21.15.71:0/886914342 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f490400f040 con 0x7f491c0ff680 2024-09-10T10:08:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f49197fa640 1 -- 172.21.15.71:0/886914342 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f490400da10 con 0x7f491c0ff680 2024-09-10T10:08:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.208+0000 7f49222a4640 1 -- 172.21.15.71:0/886914342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c10ec30 con 0x7f491c0ff680 2024-09-10T10:08:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.209+0000 7f49222a4640 1 -- 172.21.15.71:0/886914342 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c0fa890 con 0x7f491c0ff680 2024-09-10T10:08:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.210+0000 7f49197fa640 1 -- 172.21.15.71:0/886914342 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f490400dc80 con 0x7f491c0ff680 2024-09-10T10:08:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.210+0000 7f49197fa640 1 --2- 172.21.15.71:0/886914342 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f490806e0b0 0x7f4908070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.211+0000 7f49197fa640 1 -- 172.21.15.71:0/886914342 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f490408d390 con 0x7f491c0ff680 2024-09-10T10:08:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.211+0000 7f491bfff640 1 --2- 172.21.15.71:0/886914342 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f490806e0b0 0x7f4908070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.211+0000 7f491bfff640 1 --2- 172.21.15.71:0/886914342 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f490806e0b0 0x7f4908070560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f490c000c00 tx=0x7f490c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:52.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.215+0000 7f49197fa640 1 -- 172.21.15.71:0/886914342 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4904056770 con 0x7f491c0ff680 2024-09-10T10:08:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.407+0000 7f49222a4640 1 -- 172.21.15.71:0/886914342 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f491c10ef10 con 0x7f490806e0b0 2024-09-10T10:08:52.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.408+0000 7f49197fa640 1 -- 172.21.15.71:0/886914342 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f491c10ef10 con 0x7f490806e0b0 2024-09-10T10:08:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.410+0000 7f49222a4640 1 -- 172.21.15.71:0/886914342 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f490806e0b0 msgr2=0x7f4908070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.410+0000 7f49222a4640 1 --2- 172.21.15.71:0/886914342 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f490806e0b0 0x7f4908070560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f490c000c00 tx=0x7f490c035040 comp rx=0 tx=0).stop 2024-09-10T10:08:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.410+0000 7f49222a4640 1 -- 172.21.15.71:0/886914342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f491c0ff680 msgr2=0x7f491c10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.410+0000 7f49222a4640 1 --2- 172.21.15.71:0/886914342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f491c0ff680 0x7f491c10d650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4904002a50 tx=0x7f4904004600 comp rx=0 tx=0).stop 2024-09-10T10:08:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.410+0000 7f49222a4640 1 -- 172.21.15.71:0/886914342 shutdown_connections 2024-09-10T10:08:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.410+0000 7f49222a4640 1 --2- 172.21.15.71:0/886914342 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f490806e0b0 0x7f4908070560 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.410+0000 7f49222a4640 1 --2- 172.21.15.71:0/886914342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f491c0ff680 0x7f491c10d650 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.410+0000 7f49222a4640 1 --2- 172.21.15.71:0/886914342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f491c065c40 0x7f491c10d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.410+0000 7f49222a4640 1 -- 172.21.15.71:0/886914342 >> 172.21.15.71:0/886914342 conn(0x7f491c0f6c10 msgr2=0x7f491c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:52.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.411+0000 7f49222a4640 1 -- 172.21.15.71:0/886914342 shutdown_connections 2024-09-10T10:08:52.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.411+0000 7f49222a4640 1 -- 172.21.15.71:0/886914342 wait complete. 2024-09-10T10:08:52.422 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:08:52.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.499+0000 7f6895c87640 1 -- 172.21.15.71:0/1663889329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68900fc540 msgr2=0x7f68900fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.499+0000 7f6895c87640 1 --2- 172.21.15.71:0/1663889329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68900fc540 0x7f68900fc950 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68800048d0 tx=0x7f6880009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.500+0000 7f6895c87640 1 -- 172.21.15.71:0/1663889329 shutdown_connections 2024-09-10T10:08:52.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.500+0000 7f6895c87640 1 --2- 172.21.15.71:0/1663889329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68900fd810 0x7f68900fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.500+0000 7f6895c87640 1 --2- 172.21.15.71:0/1663889329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68900fc540 0x7f68900fc950 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.500+0000 7f6895c87640 1 -- 172.21.15.71:0/1663889329 >> 172.21.15.71:0/1663889329 conn(0x7f68900f7ce0 msgr2=0x7f68900fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:52.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.500+0000 7f6895c87640 1 -- 172.21.15.71:0/1663889329 shutdown_connections 2024-09-10T10:08:52.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.500+0000 7f6895c87640 1 -- 172.21.15.71:0/1663889329 wait complete. 2024-09-10T10:08:52.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.500+0000 7f6895c87640 1 Processor -- start 2024-09-10T10:08:52.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.500+0000 7f6895c87640 1 -- start start 2024-09-10T10:08:52.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.500+0000 7f6895c87640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68900fc540 0x7f6890071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:52.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f6895c87640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68900fd810 0x7f689006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:52.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f6895c87640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6890070080 con 0x7f68900fc540 2024-09-10T10:08:52.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f6895c87640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900701c0 con 0x7f68900fd810 2024-09-10T10:08:52.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68900fc540 0x7f6890071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:52.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68900fc540 0x7f6890071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32870/0 (socket says 172.21.15.71:32870) 2024-09-10T10:08:52.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f688f7fe640 1 -- 172.21.15.71:0/2725385841 learned_addr learned my addr 172.21.15.71:0/2725385841 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:52.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f688effd640 1 --2- 172.21.15.71:0/2725385841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68900fd810 0x7f689006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:52.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f688f7fe640 1 -- 172.21.15.71:0/2725385841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68900fd810 msgr2=0x7f689006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f688f7fe640 1 --2- 172.21.15.71:0/2725385841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68900fd810 0x7f689006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f688f7fe640 1 -- 172.21.15.71:0/2725385841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6880005040 con 0x7f68900fc540 2024-09-10T10:08:52.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f688f7fe640 1 --2- 172.21.15.71:0/2725385841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68900fc540 0x7f6890071570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6880003080 tx=0x7f6880009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:52.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f6887fff640 1 -- 172.21.15.71:0/2725385841 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6880038070 con 0x7f68900fc540 2024-09-10T10:08:52.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f6887fff640 1 -- 172.21.15.71:0/2725385841 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f688002abd0 con 0x7f68900fc540 2024-09-10T10:08:52.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.501+0000 7f6895c87640 1 -- 172.21.15.71:0/2725385841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6890070440 con 0x7f68900fc540 2024-09-10T10:08:52.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.502+0000 7f6887fff640 1 -- 172.21.15.71:0/2725385841 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f688003e670 con 0x7f68900fc540 2024-09-10T10:08:52.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.502+0000 7f6895c87640 1 -- 172.21.15.71:0/2725385841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6890115140 con 0x7f68900fc540 2024-09-10T10:08:52.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.503+0000 7f6895c87640 1 -- 172.21.15.71:0/2725385841 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68900fb9a0 con 0x7f68900fc540 2024-09-10T10:08:52.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.503+0000 7f6887fff640 1 -- 172.21.15.71:0/2725385841 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6880030020 con 0x7f68900fc540 2024-09-10T10:08:52.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.503+0000 7f6887fff640 1 --2- 172.21.15.71:0/2725385841 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f687c06e0b0 0x7f687c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:52.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.504+0000 7f6887fff640 1 -- 172.21.15.71:0/2725385841 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f68800ade20 con 0x7f68900fc540 2024-09-10T10:08:52.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.504+0000 7f688effd640 1 --2- 172.21.15.71:0/2725385841 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f687c06e0b0 0x7f687c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:52.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.504+0000 7f688effd640 1 --2- 172.21.15.71:0/2725385841 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f687c06e0b0 0x7f687c070560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6878009b50 tx=0x7f6878009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:52.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.508+0000 7f6887fff640 1 -- 172.21.15.71:0/2725385841 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6880077240 con 0x7f68900fc540 2024-09-10T10:08:52.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.706+0000 7f6895c87640 1 -- 172.21.15.71:0/2725385841 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6890101c20 con 0x7f687c06e0b0 2024-09-10T10:08:52.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.707+0000 7f6887fff640 1 -- 172.21.15.71:0/2725385841 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6890101c20 con 0x7f687c06e0b0 2024-09-10T10:08:52.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.709+0000 7f6895c87640 1 -- 172.21.15.71:0/2725385841 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f687c06e0b0 msgr2=0x7f687c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.709+0000 7f6895c87640 1 --2- 172.21.15.71:0/2725385841 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f687c06e0b0 0x7f687c070560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6878009b50 tx=0x7f6878009120 comp rx=0 tx=0).stop 2024-09-10T10:08:52.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.709+0000 7f6895c87640 1 -- 172.21.15.71:0/2725385841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68900fc540 msgr2=0x7f6890071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.709+0000 7f6895c87640 1 --2- 172.21.15.71:0/2725385841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68900fc540 0x7f6890071570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6880003080 tx=0x7f6880009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.709+0000 7f6895c87640 1 -- 172.21.15.71:0/2725385841 shutdown_connections 2024-09-10T10:08:52.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.709+0000 7f6895c87640 1 --2- 172.21.15.71:0/2725385841 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f687c06e0b0 0x7f687c070560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.709+0000 7f6895c87640 1 --2- 172.21.15.71:0/2725385841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68900fd810 0x7f689006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.709+0000 7f6895c87640 1 --2- 172.21.15.71:0/2725385841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68900fc540 0x7f6890071570 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.709+0000 7f6895c87640 1 -- 172.21.15.71:0/2725385841 >> 172.21.15.71:0/2725385841 conn(0x7f68900f7ce0 msgr2=0x7f68900f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:52.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.710+0000 7f6895c87640 1 -- 172.21.15.71:0/2725385841 shutdown_connections 2024-09-10T10:08:52.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.710+0000 7f6895c87640 1 -- 172.21.15.71:0/2725385841 wait complete. 2024-09-10T10:08:52.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.791+0000 7f553551e640 1 -- 172.21.15.71:0/1884263775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55300fc6f0 msgr2=0x7f55300fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.791+0000 7f553551e640 1 --2- 172.21.15.71:0/1884263775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55300fc6f0 0x7f55300fcb60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f55240048d0 tx=0x7f5524009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.791+0000 7f553551e640 1 -- 172.21.15.71:0/1884263775 shutdown_connections 2024-09-10T10:08:52.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.791+0000 7f553551e640 1 --2- 172.21.15.71:0/1884263775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55300fc6f0 0x7f55300fcb60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.791+0000 7f553551e640 1 --2- 172.21.15.71:0/1884263775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55300fb420 0x7f55300fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.791+0000 7f553551e640 1 -- 172.21.15.71:0/1884263775 >> 172.21.15.71:0/1884263775 conn(0x7f55300f6c00 msgr2=0x7f55300f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:52.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.791+0000 7f553551e640 1 -- 172.21.15.71:0/1884263775 shutdown_connections 2024-09-10T10:08:52.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.791+0000 7f553551e640 1 -- 172.21.15.71:0/1884263775 wait complete. 2024-09-10T10:08:52.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.791+0000 7f553551e640 1 Processor -- start 2024-09-10T10:08:52.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.791+0000 7f553551e640 1 -- start start 2024-09-10T10:08:52.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f553551e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55300fb420 0x7f553010fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:52.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f553551e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55300fc6f0 0x7f5530112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:52.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f553551e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55300664f0 con 0x7f55300fb420 2024-09-10T10:08:52.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f553551e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5530066660 con 0x7f55300fc6f0 2024-09-10T10:08:52.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f552effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55300fb420 0x7f553010fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:52.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f552effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55300fb420 0x7f553010fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32886/0 (socket says 172.21.15.71:32886) 2024-09-10T10:08:52.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f552effd640 1 -- 172.21.15.71:0/2691336840 learned_addr learned my addr 172.21.15.71:0/2691336840 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:52.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f552e7fc640 1 --2- 172.21.15.71:0/2691336840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55300fc6f0 0x7f5530112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:52.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f552effd640 1 -- 172.21.15.71:0/2691336840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55300fc6f0 msgr2=0x7f5530112300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f552effd640 1 --2- 172.21.15.71:0/2691336840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55300fc6f0 0x7f5530112300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f552effd640 1 -- 172.21.15.71:0/2691336840 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524005040 con 0x7f55300fb420 2024-09-10T10:08:52.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f552e7fc640 1 --2- 172.21.15.71:0/2691336840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55300fc6f0 0x7f5530112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:08:52.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f552effd640 1 --2- 172.21.15.71:0/2691336840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55300fb420 0x7f553010fdb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5520002a50 tx=0x7f5520004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:52.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f55177fe640 1 -- 172.21.15.71:0/2691336840 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5520007c30 con 0x7f55300fb420 2024-09-10T10:08:52.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f553551e640 1 -- 172.21.15.71:0/2691336840 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55301128a0 con 0x7f55300fb420 2024-09-10T10:08:52.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f553551e640 1 -- 172.21.15.71:0/2691336840 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5530112e10 con 0x7f55300fb420 2024-09-10T10:08:52.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.792+0000 7f55177fe640 1 -- 172.21.15.71:0/2691336840 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f552000f040 con 0x7f55300fb420 2024-09-10T10:08:52.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.793+0000 7f55177fe640 1 -- 172.21.15.71:0/2691336840 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f552000da90 con 0x7f55300fb420 2024-09-10T10:08:52.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.794+0000 7f553551e640 1 -- 172.21.15.71:0/2691336840 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55300fa880 con 0x7f55300fb420 2024-09-10T10:08:52.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.794+0000 7f55177fe640 1 -- 172.21.15.71:0/2691336840 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f552000dcd0 con 0x7f55300fb420 2024-09-10T10:08:52.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.795+0000 7f55177fe640 1 --2- 172.21.15.71:0/2691336840 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f551806e0b0 0x7f5518070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:52.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.795+0000 7f55177fe640 1 -- 172.21.15.71:0/2691336840 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f552008d410 con 0x7f55300fb420 2024-09-10T10:08:52.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.795+0000 7f552e7fc640 1 --2- 172.21.15.71:0/2691336840 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f551806e0b0 0x7f5518070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:52.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.795+0000 7f552e7fc640 1 --2- 172.21.15.71:0/2691336840 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f551806e0b0 0x7f5518070560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5524007ac0 tx=0x7f5524035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:52.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.799+0000 7f55177fe640 1 -- 172.21.15.71:0/2691336840 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f55200567c0 con 0x7f55300fb420 2024-09-10T10:08:52.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.988+0000 7f553551e640 1 -- 172.21.15.71:0/2691336840 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5530100b10 con 0x7f551806e0b0 2024-09-10T10:08:53.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:52.998+0000 7f55177fe640 1 -- 172.21.15.71:0/2691336840 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5530100b10 con 0x7f551806e0b0 2024-09-10T10:08:53.001 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:08:53.001 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (4m) 0s ago 12m 26.4M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:08:53.001 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (99s) 0s ago 12m 6903k - 19.1.1-305-g1cf819b7 41d671128357 5dc74ad01560 2024-09-10T10:08:53.001 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (94s) 91s ago 11m 6891k - 19.1.1-305-g1cf819b7 41d671128357 6f4355e875db 2024-09-10T10:08:53.001 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (4m) 0s ago 12m 78.2M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:08:53.001 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (7m) 0s ago 7m 113M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:08:53.001 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (7m) 0s ago 7m 65.2M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:08:53.001 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (7m) 91s ago 7m 108M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:08:53.001 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (7m) 91s ago 7m 62.7M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:08:53.001 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (3m) 0s ago 14m 498M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:08:53.001 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (2m) 91s ago 11m 439M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:08:53.002 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (2m) 0s ago 14m 47.2M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:08:53.002 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (2m) 91s ago 11m 33.9M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:08:53.002 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (4m) 0s ago 12m 16.2M - 1.5.0 0da6a335fe13 c3d47d79cd22 2024-09-10T10:08:53.002 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (3m) 91s ago 11m 16.9M - 1.5.0 0da6a335fe13 9a25165a0fd1 2024-09-10T10:08:53.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (75s) 0s ago 10m 95.6M 1557M 19.1.1-305-g1cf819b7 41d671128357 f1e9da1144c1 2024-09-10T10:08:53.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (40s) 0s ago 10m 98.8M 1557M 19.1.1-305-g1cf819b7 41d671128357 5afc8bef5343 2024-09-10T10:08:53.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (5s) 0s ago 10m 12.1M 1557M 19.1.1-305-g1cf819b7 41d671128357 5e5976fcfaa8 2024-09-10T10:08:53.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (9m) 91s ago 9m 270M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 04d67e835ea7 2024-09-10T10:08:53.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (9m) 91s ago 9m 229M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:08:53.002 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (8m) 91s ago 8m 228M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:08:53.002 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (2m) 0s ago 12m 56.5M - 2.43.0 a07b618ecd1d 47d3ae62ce5e 2024-09-10T10:08:53.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.000+0000 7f553551e640 1 -- 172.21.15.71:0/2691336840 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f551806e0b0 msgr2=0x7f5518070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.000+0000 7f553551e640 1 --2- 172.21.15.71:0/2691336840 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f551806e0b0 0x7f5518070560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5524007ac0 tx=0x7f5524035040 comp rx=0 tx=0).stop 2024-09-10T10:08:53.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.001+0000 7f553551e640 1 -- 172.21.15.71:0/2691336840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55300fb420 msgr2=0x7f553010fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.001+0000 7f553551e640 1 --2- 172.21.15.71:0/2691336840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55300fb420 0x7f553010fdb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5520002a50 tx=0x7f5520004600 comp rx=0 tx=0).stop 2024-09-10T10:08:53.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.001+0000 7f553551e640 1 -- 172.21.15.71:0/2691336840 shutdown_connections 2024-09-10T10:08:53.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.001+0000 7f553551e640 1 --2- 172.21.15.71:0/2691336840 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f551806e0b0 0x7f5518070560 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.001+0000 7f553551e640 1 --2- 172.21.15.71:0/2691336840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55300fc6f0 0x7f5530112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.001+0000 7f553551e640 1 --2- 172.21.15.71:0/2691336840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55300fb420 0x7f553010fdb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.001+0000 7f553551e640 1 -- 172.21.15.71:0/2691336840 >> 172.21.15.71:0/2691336840 conn(0x7f55300f6c00 msgr2=0x7f55300f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:53.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.001+0000 7f553551e640 1 -- 172.21.15.71:0/2691336840 shutdown_connections 2024-09-10T10:08:53.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.001+0000 7f553551e640 1 -- 172.21.15.71:0/2691336840 wait complete. 2024-09-10T10:08:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.087+0000 7f254e0a0640 1 -- 172.21.15.71:0/1957977068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480fd7f0 msgr2=0x7f25480fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.087+0000 7f254e0a0640 1 --2- 172.21.15.71:0/1957977068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480fd7f0 0x7f25480fdc60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f25300048d0 tx=0x7f2530009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.087+0000 7f254e0a0640 1 -- 172.21.15.71:0/1957977068 shutdown_connections 2024-09-10T10:08:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.087+0000 7f254e0a0640 1 --2- 172.21.15.71:0/1957977068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480fd7f0 0x7f25480fdc60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.087+0000 7f254e0a0640 1 --2- 172.21.15.71:0/1957977068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480fc520 0x7f25480fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.087+0000 7f254e0a0640 1 -- 172.21.15.71:0/1957977068 >> 172.21.15.71:0/1957977068 conn(0x7f25480f7ce0 msgr2=0x7f25480fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.087+0000 7f254e0a0640 1 -- 172.21.15.71:0/1957977068 shutdown_connections 2024-09-10T10:08:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.087+0000 7f254e0a0640 1 -- 172.21.15.71:0/1957977068 wait complete. 2024-09-10T10:08:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.088+0000 7f254e0a0640 1 Processor -- start 2024-09-10T10:08:53.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.088+0000 7f254e0a0640 1 -- start start 2024-09-10T10:08:53.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.088+0000 7f254e0a0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480fc520 0x7f254810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:53.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.088+0000 7f254e0a0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480fd7f0 0x7f254810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:53.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.088+0000 7f254e0a0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254810dc10 con 0x7f25480fc520 2024-09-10T10:08:53.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.088+0000 7f254e0a0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254810e430 con 0x7f25480fd7f0 2024-09-10T10:08:53.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.088+0000 7f25477fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480fc520 0x7f254810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:53.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.088+0000 7f25477fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480fc520 0x7f254810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32902/0 (socket says 172.21.15.71:32902) 2024-09-10T10:08:53.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.088+0000 7f25477fe640 1 -- 172.21.15.71:0/2254450925 learned_addr learned my addr 172.21.15.71:0/2254450925 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.088+0000 7f2546ffd640 1 --2- 172.21.15.71:0/2254450925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480fd7f0 0x7f254810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.089+0000 7f25477fe640 1 -- 172.21.15.71:0/2254450925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480fd7f0 msgr2=0x7f254810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.089+0000 7f25477fe640 1 --2- 172.21.15.71:0/2254450925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480fd7f0 0x7f254810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.089+0000 7f25477fe640 1 -- 172.21.15.71:0/2254450925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2530005040 con 0x7f25480fc520 2024-09-10T10:08:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.089+0000 7f2546ffd640 1 --2- 172.21.15.71:0/2254450925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480fd7f0 0x7f254810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:08:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.089+0000 7f25477fe640 1 --2- 172.21.15.71:0/2254450925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480fc520 0x7f254810d080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f253800cb10 tx=0x7f2538007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.089+0000 7f253ffff640 1 -- 172.21.15.71:0/2254450925 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2538004200 con 0x7f25480fc520 2024-09-10T10:08:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.089+0000 7f253ffff640 1 -- 172.21.15.71:0/2254450925 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f253800acc0 con 0x7f25480fc520 2024-09-10T10:08:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.089+0000 7f254e0a0640 1 -- 172.21.15.71:0/2254450925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254810e6c0 con 0x7f25480fc520 2024-09-10T10:08:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.089+0000 7f253ffff640 1 -- 172.21.15.71:0/2254450925 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2538003cd0 con 0x7f25480fc520 2024-09-10T10:08:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.089+0000 7f254e0a0640 1 -- 172.21.15.71:0/2254450925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254810ec60 con 0x7f25480fc520 2024-09-10T10:08:53.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.090+0000 7f254e0a0640 1 -- 172.21.15.71:0/2254450925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25480fb980 con 0x7f25480fc520 2024-09-10T10:08:53.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.090+0000 7f253ffff640 1 -- 172.21.15.71:0/2254450925 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2538012420 con 0x7f25480fc520 2024-09-10T10:08:53.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.091+0000 7f253ffff640 1 --2- 172.21.15.71:0/2254450925 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f253406e0b0 0x7f2534070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:53.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.091+0000 7f253ffff640 1 -- 172.21.15.71:0/2254450925 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f253808e2b0 con 0x7f25480fc520 2024-09-10T10:08:53.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.091+0000 7f2546ffd640 1 --2- 172.21.15.71:0/2254450925 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f253406e0b0 0x7f2534070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:53.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.091+0000 7f2546ffd640 1 --2- 172.21.15.71:0/2254450925 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f253406e0b0 0x7f2534070560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f253000b020 tx=0x7f2530009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:53.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.095+0000 7f253ffff640 1 -- 172.21.15.71:0/2254450925 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2538057730 con 0x7f25480fc520 2024-09-10T10:08:53.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:53 smithi071 ceph-mon[90773]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 39/321 objects degraded (12.150%) 2024-09-10T10:08:53.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:53 smithi071 ceph-mon[90773]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:53.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:53 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:53.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:53 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:53.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:53 smithi071 ceph-mon[90773]: Health check update: Degraded data redundancy: 39/321 objects degraded (12.150%), 12 pgs degraded (PG_DEGRADED) 2024-09-10T10:08:53.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.347+0000 7f254e0a0640 1 -- 172.21.15.71:0/2254450925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f254810f040 con 0x7f25480fc520 2024-09-10T10:08:53.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.348+0000 7f253ffff640 1 -- 172.21.15.71:0/2254450925 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f253805adf0 con 0x7f25480fc520 2024-09-10T10:08:53.350 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:08:53.351 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:08:53.351 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:08:53.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:08:53.351 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:08:53.351 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:08:53.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:08:53.351 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:08:53.351 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 3, 2024-09-10T10:08:53.351 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:08:53.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:08:53.351 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:08:53.351 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:08:53.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:08:53.352 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:08:53.352 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 7, 2024-09-10T10:08:53.352 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T10:08:53.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:08:53.352 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:08:53.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.350+0000 7f254e0a0640 1 -- 172.21.15.71:0/2254450925 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f253406e0b0 msgr2=0x7f2534070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.350+0000 7f254e0a0640 1 --2- 172.21.15.71:0/2254450925 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f253406e0b0 0x7f2534070560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f253000b020 tx=0x7f2530009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.350+0000 7f254e0a0640 1 -- 172.21.15.71:0/2254450925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480fc520 msgr2=0x7f254810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.350+0000 7f254e0a0640 1 --2- 172.21.15.71:0/2254450925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480fc520 0x7f254810d080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f253800cb10 tx=0x7f2538007ee0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.350+0000 7f254e0a0640 1 -- 172.21.15.71:0/2254450925 shutdown_connections 2024-09-10T10:08:53.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.350+0000 7f254e0a0640 1 --2- 172.21.15.71:0/2254450925 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f253406e0b0 0x7f2534070560 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.350+0000 7f254e0a0640 1 --2- 172.21.15.71:0/2254450925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25480fd7f0 0x7f254810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.350+0000 7f254e0a0640 1 --2- 172.21.15.71:0/2254450925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25480fc520 0x7f254810d080 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.350+0000 7f254e0a0640 1 -- 172.21.15.71:0/2254450925 >> 172.21.15.71:0/2254450925 conn(0x7f25480f7ce0 msgr2=0x7f25480f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:53.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.351+0000 7f254e0a0640 1 -- 172.21.15.71:0/2254450925 shutdown_connections 2024-09-10T10:08:53.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.351+0000 7f254e0a0640 1 -- 172.21.15.71:0/2254450925 wait complete. 2024-09-10T10:08:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.431+0000 7efef3fbf640 1 -- 172.21.15.71:0/765377099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeec0fb430 msgr2=0x7efeec0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.431+0000 7efef3fbf640 1 --2- 172.21.15.71:0/765377099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeec0fb430 0x7efeec0fb840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efee40048d0 tx=0x7efee4009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.431+0000 7efef3fbf640 1 -- 172.21.15.71:0/765377099 shutdown_connections 2024-09-10T10:08:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.431+0000 7efef3fbf640 1 --2- 172.21.15.71:0/765377099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efeec0fc700 0x7efeec0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.431+0000 7efef3fbf640 1 --2- 172.21.15.71:0/765377099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeec0fb430 0x7efeec0fb840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.431+0000 7efef3fbf640 1 -- 172.21.15.71:0/765377099 >> 172.21.15.71:0/765377099 conn(0x7efeec0f6c10 msgr2=0x7efeec0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.431+0000 7efef3fbf640 1 -- 172.21.15.71:0/765377099 shutdown_connections 2024-09-10T10:08:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.431+0000 7efef3fbf640 1 -- 172.21.15.71:0/765377099 wait complete. 2024-09-10T10:08:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.432+0000 7efef3fbf640 1 Processor -- start 2024-09-10T10:08:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.432+0000 7efef3fbf640 1 -- start start 2024-09-10T10:08:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.432+0000 7efef3fbf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeec0fb430 0x7efeec10fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.432+0000 7efef3fbf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efeec0fc700 0x7efeec1122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.432+0000 7efef3fbf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec065cc0 con 0x7efeec0fb430 2024-09-10T10:08:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.432+0000 7efef3fbf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec065e30 con 0x7efeec0fc700 2024-09-10T10:08:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.432+0000 7efef1d5b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeec0fb430 0x7efeec10fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.432+0000 7efef1d5b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeec0fb430 0x7efeec10fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33084/0 (socket says 172.21.15.71:33084) 2024-09-10T10:08:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.432+0000 7efef1d5b640 1 -- 172.21.15.71:0/4185304237 learned_addr learned my addr 172.21.15.71:0/4185304237 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.432+0000 7efef155a640 1 --2- 172.21.15.71:0/4185304237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efeec0fc700 0x7efeec1122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.432+0000 7efef1d5b640 1 -- 172.21.15.71:0/4185304237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efeec0fc700 msgr2=0x7efeec1122b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.432+0000 7efef1d5b640 1 --2- 172.21.15.71:0/4185304237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efeec0fc700 0x7efeec1122b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.432+0000 7efef1d5b640 1 -- 172.21.15.71:0/4185304237 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee4005040 con 0x7efeec0fb430 2024-09-10T10:08:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.433+0000 7efef1d5b640 1 --2- 172.21.15.71:0/4185304237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeec0fb430 0x7efeec10fd60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efee40043d0 tx=0x7efee4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.433+0000 7efeea7fc640 1 -- 172.21.15.71:0/4185304237 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efee4038070 con 0x7efeec0fb430 2024-09-10T10:08:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.433+0000 7efeea7fc640 1 -- 172.21.15.71:0/4185304237 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efee402ae90 con 0x7efeec0fb430 2024-09-10T10:08:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.433+0000 7efeea7fc640 1 -- 172.21.15.71:0/4185304237 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efee403e670 con 0x7efeec0fb430 2024-09-10T10:08:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.433+0000 7efef3fbf640 1 -- 172.21.15.71:0/4185304237 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec112850 con 0x7efeec0fb430 2024-09-10T10:08:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.433+0000 7efef3fbf640 1 -- 172.21.15.71:0/4185304237 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec112dc0 con 0x7efeec0fb430 2024-09-10T10:08:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.434+0000 7efef3fbf640 1 -- 172.21.15.71:0/4185304237 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec0fa890 con 0x7efeec0fb430 2024-09-10T10:08:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.435+0000 7efeea7fc640 1 -- 172.21.15.71:0/4185304237 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efee4030020 con 0x7efeec0fb430 2024-09-10T10:08:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.435+0000 7efeea7fc640 1 --2- 172.21.15.71:0/4185304237 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7efed406e0b0 0x7efed4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.435+0000 7efeea7fc640 1 -- 172.21.15.71:0/4185304237 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6496+0+0 (secure 0 0 0) 0x7efee40adc70 con 0x7efeec0fb430 2024-09-10T10:08:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.435+0000 7efef155a640 1 --2- 172.21.15.71:0/4185304237 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7efed406e0b0 0x7efed4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.436+0000 7efef155a640 1 --2- 172.21.15.71:0/4185304237 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7efed406e0b0 0x7efed4070560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efee0004ed0 tx=0x7efee000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:53.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.439+0000 7efeea7fc640 1 -- 172.21.15.71:0/4185304237 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efee40770d0 con 0x7efeec0fb430 2024-09-10T10:08:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:53 smithi107 ceph-mon[79396]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 39/321 objects degraded (12.150%) 2024-09-10T10:08:53.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:53 smithi107 ceph-mon[79396]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:53.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:53 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:53.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:53 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:53.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:53 smithi107 ceph-mon[79396]: Health check update: Degraded data redundancy: 39/321 objects degraded (12.150%), 12 pgs degraded (PG_DEGRADED) 2024-09-10T10:08:53.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.660+0000 7efef3fbf640 1 -- 172.21.15.71:0/4185304237 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efeec113220 con 0x7efeec0fb430 2024-09-10T10:08:53.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.660+0000 7efeea7fc640 1 -- 172.21.15.71:0/4185304237 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1955 (secure 0 0 0) 0x7efee407a790 con 0x7efeec0fb430 2024-09-10T10:08:53.663 INFO:teuthology.orchestra.run.smithi071.stdout:e24 2024-09-10T10:08:53.663 INFO:teuthology.orchestra.run.smithi071.stdout:btime 2024-09-10T10:07:40:170505+0000 2024-09-10T10:08:53.663 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:08:53.663 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:08:53.663 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:08:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:08:53.663 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:08:53.663 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:08:53.664 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 24 2024-09-10T10:08:53.664 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:08:53.664 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:08:53.664 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:07:39.792181+0000 2024-09-10T10:08:53.664 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:08:53.664 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:08:53.664 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:08:53.664 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:08:53.664 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:08:53.664 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:08:53.664 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:08:53.664 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:08:53.664 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:08:53.665 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:08:53.665 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:08:53.665 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:08:53.665 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:08:53.665 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:08:53.665 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:08:53.665 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:08:53.665 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:08:53.665 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:08:53.665 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:08:53.665 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:08:53.665 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:08:53.666 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:08:53.666 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 14464 members: 24267,14464 2024-09-10T10:08:53.666 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:08:53.666 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:08:53.666 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:08:53.666 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:08:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:08:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:08:53.667 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 24 2024-09-10T10:08:53.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.663+0000 7efef3fbf640 1 -- 172.21.15.71:0/4185304237 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7efed406e0b0 msgr2=0x7efed4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.663+0000 7efef3fbf640 1 --2- 172.21.15.71:0/4185304237 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7efed406e0b0 0x7efed4070560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efee0004ed0 tx=0x7efee000b040 comp rx=0 tx=0).stop 2024-09-10T10:08:53.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.663+0000 7efef3fbf640 1 -- 172.21.15.71:0/4185304237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeec0fb430 msgr2=0x7efeec10fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.663+0000 7efef3fbf640 1 --2- 172.21.15.71:0/4185304237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeec0fb430 0x7efeec10fd60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efee40043d0 tx=0x7efee4009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.664+0000 7efef3fbf640 1 -- 172.21.15.71:0/4185304237 shutdown_connections 2024-09-10T10:08:53.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.664+0000 7efef3fbf640 1 --2- 172.21.15.71:0/4185304237 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7efed406e0b0 0x7efed4070560 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.664+0000 7efef3fbf640 1 --2- 172.21.15.71:0/4185304237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efeec0fc700 0x7efeec1122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.664+0000 7efef3fbf640 1 --2- 172.21.15.71:0/4185304237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efeec0fb430 0x7efeec10fd60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.664+0000 7efef3fbf640 1 -- 172.21.15.71:0/4185304237 >> 172.21.15.71:0/4185304237 conn(0x7efeec0f6c10 msgr2=0x7efeec0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:53.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.664+0000 7efef3fbf640 1 -- 172.21.15.71:0/4185304237 shutdown_connections 2024-09-10T10:08:53.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.664+0000 7efef3fbf640 1 -- 172.21.15.71:0/4185304237 wait complete. 2024-09-10T10:08:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.744+0000 7fe4f06da640 1 -- 172.21.15.71:0/2737161399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4e80ff740 msgr2=0x7fe4e8101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.744+0000 7fe4f06da640 1 --2- 172.21.15.71:0/2737161399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4e80ff740 0x7fe4e8101b20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe4e40048d0 tx=0x7fe4e4009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.744+0000 7fe4f06da640 1 -- 172.21.15.71:0/2737161399 shutdown_connections 2024-09-10T10:08:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.744+0000 7fe4f06da640 1 --2- 172.21.15.71:0/2737161399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4e80ff740 0x7fe4e8101b20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.744+0000 7fe4f06da640 1 --2- 172.21.15.71:0/2737161399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4e8065b80 0x7fe4e80ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.744+0000 7fe4f06da640 1 -- 172.21.15.71:0/2737161399 >> 172.21.15.71:0/2737161399 conn(0x7fe4e80f6c10 msgr2=0x7fe4e80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:53.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.744+0000 7fe4f06da640 1 -- 172.21.15.71:0/2737161399 shutdown_connections 2024-09-10T10:08:53.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.744+0000 7fe4f06da640 1 -- 172.21.15.71:0/2737161399 wait complete. 2024-09-10T10:08:53.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.745+0000 7fe4f06da640 1 Processor -- start 2024-09-10T10:08:53.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.745+0000 7fe4f06da640 1 -- start start 2024-09-10T10:08:53.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.745+0000 7fe4f06da640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4e8065b80 0x7fe4e810d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:53.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.745+0000 7fe4f06da640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4e80ff740 0x7fe4e810d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:53.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.745+0000 7fe4f06da640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e810e490 con 0x7fe4e80ff740 2024-09-10T10:08:53.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.745+0000 7fe4f06da640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e810e600 con 0x7fe4e8065b80 2024-09-10T10:08:53.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.745+0000 7fe4edc75640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4e80ff740 0x7fe4e810d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:53.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.746+0000 7fe4edc75640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4e80ff740 0x7fe4e810d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33088/0 (socket says 172.21.15.71:33088) 2024-09-10T10:08:53.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.746+0000 7fe4edc75640 1 -- 172.21.15.71:0/437546820 learned_addr learned my addr 172.21.15.71:0/437546820 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:53.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.746+0000 7fe4ee476640 1 --2- 172.21.15.71:0/437546820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4e8065b80 0x7fe4e810d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:53.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.746+0000 7fe4edc75640 1 -- 172.21.15.71:0/437546820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4e8065b80 msgr2=0x7fe4e810d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.746+0000 7fe4edc75640 1 --2- 172.21.15.71:0/437546820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4e8065b80 0x7fe4e810d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.746+0000 7fe4edc75640 1 -- 172.21.15.71:0/437546820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e4005040 con 0x7fe4e80ff740 2024-09-10T10:08:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.746+0000 7fe4edc75640 1 --2- 172.21.15.71:0/437546820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4e80ff740 0x7fe4e810d670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4003080 tx=0x7fe4e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.746+0000 7fe4deffd640 1 -- 172.21.15.71:0/437546820 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e4038070 con 0x7fe4e80ff740 2024-09-10T10:08:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.746+0000 7fe4deffd640 1 -- 172.21.15.71:0/437546820 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe4e402abd0 con 0x7fe4e80ff740 2024-09-10T10:08:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.746+0000 7fe4f06da640 1 -- 172.21.15.71:0/437546820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e810e880 con 0x7fe4e80ff740 2024-09-10T10:08:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.746+0000 7fe4deffd640 1 -- 172.21.15.71:0/437546820 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e403e670 con 0x7fe4e80ff740 2024-09-10T10:08:53.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.746+0000 7fe4f06da640 1 -- 172.21.15.71:0/437546820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e810eda0 con 0x7fe4e80ff740 2024-09-10T10:08:53.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.747+0000 7fe4f06da640 1 -- 172.21.15.71:0/437546820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e80fa890 con 0x7fe4e80ff740 2024-09-10T10:08:53.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.748+0000 7fe4deffd640 1 -- 172.21.15.71:0/437546820 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe4e4030020 con 0x7fe4e80ff740 2024-09-10T10:08:53.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.748+0000 7fe4deffd640 1 --2- 172.21.15.71:0/437546820 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fe4d406e0b0 0x7fe4d4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:53.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.749+0000 7fe4deffd640 1 -- 172.21.15.71:0/437546820 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe4e40adfd0 con 0x7fe4e80ff740 2024-09-10T10:08:53.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.749+0000 7fe4ee476640 1 --2- 172.21.15.71:0/437546820 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fe4d406e0b0 0x7fe4d4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:53.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.749+0000 7fe4ee476640 1 --2- 172.21.15.71:0/437546820 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fe4d406e0b0 0x7fe4d4070560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8006fd0 tx=0x7fe4d8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:53.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.753+0000 7fe4deffd640 1 -- 172.21.15.71:0/437546820 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe4e4077300 con 0x7fe4e80ff740 2024-09-10T10:08:53.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.968+0000 7fe4f06da640 1 -- 172.21.15.71:0/437546820 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4e810efc0 con 0x7fe4d406e0b0 2024-09-10T10:08:53.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.970+0000 7fe4deffd640 1 -- 172.21.15.71:0/437546820 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe4e810efc0 con 0x7fe4d406e0b0 2024-09-10T10:08:53.972 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:08:53.972 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:08:53.972 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:08:53.973 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:08:53.973 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:08:53.973 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-09-10T10:08:53.973 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-10T10:08:53.973 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-10T10:08:53.973 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:08:53.973 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "9/21 daemons upgraded", 2024-09-10T10:08:53.973 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T10:08:53.973 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:08:53.973 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:08:53.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.972+0000 7fe4f06da640 1 -- 172.21.15.71:0/437546820 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fe4d406e0b0 msgr2=0x7fe4d4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.972+0000 7fe4f06da640 1 --2- 172.21.15.71:0/437546820 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fe4d406e0b0 0x7fe4d4070560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8006fd0 tx=0x7fe4d8008040 comp rx=0 tx=0).stop 2024-09-10T10:08:53.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.972+0000 7fe4f06da640 1 -- 172.21.15.71:0/437546820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4e80ff740 msgr2=0x7fe4e810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:53.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.972+0000 7fe4f06da640 1 --2- 172.21.15.71:0/437546820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4e80ff740 0x7fe4e810d670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4003080 tx=0x7fe4e4009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.972+0000 7fe4f06da640 1 -- 172.21.15.71:0/437546820 shutdown_connections 2024-09-10T10:08:53.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.972+0000 7fe4f06da640 1 --2- 172.21.15.71:0/437546820 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fe4d406e0b0 0x7fe4d4070560 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.972+0000 7fe4f06da640 1 --2- 172.21.15.71:0/437546820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4e80ff740 0x7fe4e810d670 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.972+0000 7fe4f06da640 1 --2- 172.21.15.71:0/437546820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4e8065b80 0x7fe4e810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:53.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.972+0000 7fe4f06da640 1 -- 172.21.15.71:0/437546820 >> 172.21.15.71:0/437546820 conn(0x7fe4e80f6c10 msgr2=0x7fe4e80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:53.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.973+0000 7fe4f06da640 1 -- 172.21.15.71:0/437546820 shutdown_connections 2024-09-10T10:08:53.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:53.973+0000 7fe4f06da640 1 -- 172.21.15.71:0/437546820 wait complete. 2024-09-10T10:08:54.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.053+0000 7f4bf7e89640 1 -- 172.21.15.71:0/3890080958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf0065c40 msgr2=0x7f4bf00ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:54.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.053+0000 7f4bf7e89640 1 --2- 172.21.15.71:0/3890080958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf0065c40 0x7f4bf00ff140 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0048d0 tx=0x7f4bec009da0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.053+0000 7f4bf7e89640 1 -- 172.21.15.71:0/3890080958 shutdown_connections 2024-09-10T10:08:54.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.053+0000 7f4bf7e89640 1 --2- 172.21.15.71:0/3890080958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf00ff680 0x7f4bf0101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.053+0000 7f4bf7e89640 1 --2- 172.21.15.71:0/3890080958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf0065c40 0x7f4bf00ff140 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.053+0000 7f4bf7e89640 1 -- 172.21.15.71:0/3890080958 >> 172.21.15.71:0/3890080958 conn(0x7f4bf00f6c10 msgr2=0x7f4bf00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:54.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.054+0000 7f4bf7e89640 1 -- 172.21.15.71:0/3890080958 shutdown_connections 2024-09-10T10:08:54.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.054+0000 7f4bf7e89640 1 -- 172.21.15.71:0/3890080958 wait complete. 2024-09-10T10:08:54.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.054+0000 7f4bf7e89640 1 Processor -- start 2024-09-10T10:08:54.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.054+0000 7f4bf7e89640 1 -- start start 2024-09-10T10:08:54.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.054+0000 7f4bf7e89640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf0065c40 0x7f4bf010d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:54.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.054+0000 7f4bf7e89640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf00ff680 0x7f4bf010d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:54.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.054+0000 7f4bf7e89640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf010e490 con 0x7f4bf00ff680 2024-09-10T10:08:54.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.054+0000 7f4bf7e89640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf010e600 con 0x7f4bf0065c40 2024-09-10T10:08:54.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.055+0000 7f4bf5424640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf00ff680 0x7f4bf010d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:54.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.055+0000 7f4bf5424640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf00ff680 0x7f4bf010d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33108/0 (socket says 172.21.15.71:33108) 2024-09-10T10:08:54.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.055+0000 7f4bf5424640 1 -- 172.21.15.71:0/1813771903 learned_addr learned my addr 172.21.15.71:0/1813771903 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:08:54.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.055+0000 7f4bf5c25640 1 --2- 172.21.15.71:0/1813771903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf0065c40 0x7f4bf010d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:54.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.055+0000 7f4bf5424640 1 -- 172.21.15.71:0/1813771903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf0065c40 msgr2=0x7f4bf010d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:54.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.055+0000 7f4bf5424640 1 --2- 172.21.15.71:0/1813771903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf0065c40 0x7f4bf010d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.055+0000 7f4bf5424640 1 -- 172.21.15.71:0/1813771903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec005040 con 0x7f4bf00ff680 2024-09-10T10:08:54.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.055+0000 7f4bf5424640 1 --2- 172.21.15.71:0/1813771903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf00ff680 0x7f4bf010d670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4be000b790 tx=0x7f4be00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:54.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.055+0000 7f4be67fc640 1 -- 172.21.15.71:0/1813771903 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be000c700 con 0x7f4bf00ff680 2024-09-10T10:08:54.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.055+0000 7f4be67fc640 1 -- 172.21.15.71:0/1813771903 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4be000cd00 con 0x7f4bf00ff680 2024-09-10T10:08:54.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.055+0000 7f4bf7e89640 1 -- 172.21.15.71:0/1813771903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf010e8e0 con 0x7f4bf00ff680 2024-09-10T10:08:54.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.055+0000 7f4be67fc640 1 -- 172.21.15.71:0/1813771903 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be0015e80 con 0x7f4bf00ff680 2024-09-10T10:08:54.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.055+0000 7f4bf7e89640 1 -- 172.21.15.71:0/1813771903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf010ee00 con 0x7f4bf00ff680 2024-09-10T10:08:54.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.056+0000 7f4bf7e89640 1 -- 172.21.15.71:0/1813771903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf00fa890 con 0x7f4bf00ff680 2024-09-10T10:08:54.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.057+0000 7f4be67fc640 1 -- 172.21.15.71:0/1813771903 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4be0012070 con 0x7f4bf00ff680 2024-09-10T10:08:54.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.057+0000 7f4be67fc640 1 --2- 172.21.15.71:0/1813771903 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4bdc06e0b0 0x7f4bdc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:54.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.057+0000 7f4be67fc640 1 -- 172.21.15.71:0/1813771903 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4be008d3a0 con 0x7f4bf00ff680 2024-09-10T10:08:54.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.057+0000 7f4bf5c25640 1 --2- 172.21.15.71:0/1813771903 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4bdc06e0b0 0x7f4bdc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:54.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.058+0000 7f4bf5c25640 1 --2- 172.21.15.71:0/1813771903 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4bdc06e0b0 0x7f4bdc070560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000c00 tx=0x7f4bec035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:54.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.062+0000 7f4be67fc640 1 -- 172.21.15.71:0/1813771903 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4be0056750 con 0x7f4bf00ff680 2024-09-10T10:08:54.275 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:54 smithi071 ceph-mon[90773]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:54.275 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:54 smithi071 ceph-mon[90773]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:54.275 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:54 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2254450925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:54.275 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:54.275 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:54.275 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:54 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/4185304237' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:08:54.276 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:54.276 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:08:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.318+0000 7f4bf7e89640 1 -- 172.21.15.71:0/1813771903 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4bf004b720 con 0x7f4bf00ff680 2024-09-10T10:08:54.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.319+0000 7f4be67fc640 1 -- 172.21.15.71:0/1813771903 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+941 (secure 0 0 0) 0x7f4be0059e10 con 0x7f4bf00ff680 2024-09-10T10:08:54.322 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 39/321 objects degraded (12.150%), 12 pgs degraded 2024-09-10T10:08:54.322 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-10T10:08:54.322 INFO:teuthology.orchestra.run.smithi071.stdout: osd.2 (root=default,host=smithi071) is down 2024-09-10T10:08:54.322 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 39/321 objects degraded (12.150%), 12 pgs degraded 2024-09-10T10:08:54.322 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-10T10:08:54.322 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-10T10:08:54.322 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-10T10:08:54.322 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-10T10:08:54.322 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-10T10:08:54.322 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-10T10:08:54.323 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-10T10:08:54.323 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-10T10:08:54.323 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-09-10T10:08:54.323 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-10T10:08:54.323 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-10T10:08:54.323 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-10T10:08:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.321+0000 7f4bf7e89640 1 -- 172.21.15.71:0/1813771903 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4bdc06e0b0 msgr2=0x7f4bdc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.321+0000 7f4bf7e89640 1 --2- 172.21.15.71:0/1813771903 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4bdc06e0b0 0x7f4bdc070560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000c00 tx=0x7f4bec035040 comp rx=0 tx=0).stop 2024-09-10T10:08:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.321+0000 7f4bf7e89640 1 -- 172.21.15.71:0/1813771903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf00ff680 msgr2=0x7f4bf010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.321+0000 7f4bf7e89640 1 --2- 172.21.15.71:0/1813771903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf00ff680 0x7f4bf010d670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4be000b790 tx=0x7f4be00091d0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.321+0000 7f4bf7e89640 1 -- 172.21.15.71:0/1813771903 shutdown_connections 2024-09-10T10:08:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.321+0000 7f4bf7e89640 1 --2- 172.21.15.71:0/1813771903 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4bdc06e0b0 0x7f4bdc070560 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.321+0000 7f4bf7e89640 1 --2- 172.21.15.71:0/1813771903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4bf00ff680 0x7f4bf010d670 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.321+0000 7f4bf7e89640 1 --2- 172.21.15.71:0/1813771903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf0065c40 0x7f4bf010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.321+0000 7f4bf7e89640 1 -- 172.21.15.71:0/1813771903 >> 172.21.15.71:0/1813771903 conn(0x7f4bf00f6c10 msgr2=0x7f4bf00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.322+0000 7f4bf7e89640 1 -- 172.21.15.71:0/1813771903 shutdown_connections 2024-09-10T10:08:54.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:08:54.322+0000 7f4bf7e89640 1 -- 172.21.15.71:0/1813771903 wait complete. 2024-09-10T10:08:54.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:54 smithi107 ceph-mon[79396]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:54 smithi107 ceph-mon[79396]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:54 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2254450925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:54 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/4185304237' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:08:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:54.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:08:55.025 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:54 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2[110012]: 2024-09-10T10:08:54.665+0000 7fb6fb343640 -1 osd.2 58 log_to_monitors true 2024-09-10T10:08:55.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:55 smithi071 ceph-mon[90773]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:55.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:55 smithi071 ceph-mon[90773]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 39/321 objects degraded (12.150%) 2024-09-10T10:08:55.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:55 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/1813771903' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:08:55.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:55 smithi071 ceph-mon[90773]: from='osd.2 [v2:172.21.15.71:6818/2795765103,v1:172.21.15.71:6819/2795765103]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:08:55.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:55 smithi107 ceph-mon[79396]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:08:55.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:55 smithi107 ceph-mon[79396]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 39/321 objects degraded (12.150%) 2024-09-10T10:08:55.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:55 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/1813771903' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:08:55.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:55 smithi107 ceph-mon[79396]: from='osd.2 [v2:172.21.15.71:6818/2795765103,v1:172.21.15.71:6819/2795765103]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:08:56.624 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:08:56 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2[110012]: 2024-09-10T10:08:56.421+0000 7fb6ef0d5640 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:08:56.625 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:56 smithi071 ceph-mon[90773]: from='osd.2 [v2:172.21.15.71:6818/2795765103,v1:172.21.15.71:6819/2795765103]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T10:08:56.625 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:56 smithi071 ceph-mon[90773]: osdmap e61: 6 total, 5 up, 6 in 2024-09-10T10:08:56.625 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:56 smithi071 ceph-mon[90773]: from='osd.2 [v2:172.21.15.71:6818/2795765103,v1:172.21.15.71:6819/2795765103]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-10T10:08:56.625 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:56 smithi071 ceph-mon[90773]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 39/321 objects degraded (12.150%) 2024-09-10T10:08:56.625 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:56 smithi071 ceph-mon[90773]: from='osd.2 [v2:172.21.15.71:6818/2795765103,v1:172.21.15.71:6819/2795765103]' entity='osd.2' 2024-09-10T10:08:56.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:56 smithi107 ceph-mon[79396]: from='osd.2 [v2:172.21.15.71:6818/2795765103,v1:172.21.15.71:6819/2795765103]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T10:08:56.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:56 smithi107 ceph-mon[79396]: osdmap e61: 6 total, 5 up, 6 in 2024-09-10T10:08:56.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:56 smithi107 ceph-mon[79396]: from='osd.2 [v2:172.21.15.71:6818/2795765103,v1:172.21.15.71:6819/2795765103]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-10T10:08:56.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:56 smithi107 ceph-mon[79396]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 39/321 objects degraded (12.150%) 2024-09-10T10:08:56.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:56 smithi107 ceph-mon[79396]: from='osd.2 [v2:172.21.15.71:6818/2795765103,v1:172.21.15.71:6819/2795765103]' entity='osd.2' 2024-09-10T10:08:58.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:58.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:58.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:58.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:08:58.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:58.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:58.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:58.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:58.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:58.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T10:08:58.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T10:08:58.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-10T10:08:58.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T10:08:58.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: osd.2 [v2:172.21.15.71:6818/2795765103,v1:172.21.15.71:6819/2795765103] boot 2024-09-10T10:08:58.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: osdmap e62: 6 total, 6 up, 6 in 2024-09-10T10:08:58.290 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:08:58.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:58.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:58.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:58.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:08:58.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:08:58.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:58.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:58.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:58.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:08:58.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T10:08:58.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T10:08:58.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-10T10:08:58.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T10:08:58.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: osd.2 [v2:172.21.15.71:6818/2795765103,v1:172.21.15.71:6819/2795765103] boot 2024-09-10T10:08:58.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: osdmap e62: 6 total, 6 up, 6 in 2024-09-10T10:08:58.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:08:59.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:59 smithi071 ceph-mon[90773]: pgmap v94: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 39/321 objects degraded (12.150%) 2024-09-10T10:08:59.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:08:59 smithi071 ceph-mon[90773]: osdmap e63: 6 total, 6 up, 6 in 2024-09-10T10:08:59.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:59 smithi107 ceph-mon[79396]: pgmap v94: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 39/321 objects degraded (12.150%) 2024-09-10T10:08:59.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:08:59 smithi107 ceph-mon[79396]: osdmap e63: 6 total, 6 up, 6 in 2024-09-10T10:09:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:00 smithi071 ceph-mon[90773]: pgmap v96: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 4 op/s; 25/321 objects degraded (7.788%) 2024-09-10T10:09:00.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:00 smithi071 ceph-mon[90773]: Health check update: Degraded data redundancy: 25/321 objects degraded (7.788%), 7 pgs degraded (PG_DEGRADED) 2024-09-10T10:09:00.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:00 smithi107 ceph-mon[79396]: pgmap v96: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 4 op/s; 25/321 objects degraded (7.788%) 2024-09-10T10:09:00.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:00 smithi107 ceph-mon[79396]: Health check update: Degraded data redundancy: 25/321 objects degraded (7.788%), 7 pgs degraded (PG_DEGRADED) 2024-09-10T10:09:02.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:02 smithi071 ceph-mon[90773]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/321 objects degraded (7.788%), 7 pgs degraded) 2024-09-10T10:09:02.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:02 smithi071 ceph-mon[90773]: Cluster is now healthy 2024-09-10T10:09:02.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:02 smithi107 ceph-mon[79396]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/321 objects degraded (7.788%), 7 pgs degraded) 2024-09-10T10:09:02.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:02 smithi107 ceph-mon[79396]: Cluster is now healthy 2024-09-10T10:09:03.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:03 smithi071 ceph-mon[90773]: pgmap v97: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-10T10:09:03.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:03 smithi107 ceph-mon[79396]: pgmap v97: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-09-10T10:09:05.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:05 smithi071 ceph-mon[90773]: pgmap v98: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2024-09-10T10:09:05.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:05 smithi107 ceph-mon[79396]: pgmap v98: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2024-09-10T10:09:07.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:07 smithi071 ceph-mon[90773]: pgmap v99: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-10T10:09:07.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:07 smithi107 ceph-mon[79396]: pgmap v99: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-10T10:09:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:09 smithi071 ceph-mon[90773]: pgmap v100: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-10T10:09:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:09:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:09 smithi107 ceph-mon[79396]: pgmap v100: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-10T10:09:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:09:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:11.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:11 smithi071 ceph-mon[90773]: pgmap v101: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-10T10:09:11.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:11 smithi107 ceph-mon[79396]: pgmap v101: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-10T10:09:12.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:12 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T10:09:12.612 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:12 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T10:09:13.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:13 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T10:09:13.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:13 smithi107 ceph-mon[79396]: Upgrade: osd.3 is safe to restart 2024-09-10T10:09:13.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:13 smithi107 ceph-mon[79396]: pgmap v102: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-10T10:09:13.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:13 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T10:09:13.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:13 smithi071 ceph-mon[90773]: Upgrade: osd.3 is safe to restart 2024-09-10T10:09:13.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:13 smithi071 ceph-mon[90773]: pgmap v102: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-10T10:09:14.720 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:14 smithi107 ceph-mon[79396]: Upgrade: Updating osd.3 2024-09-10T10:09:14.721 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:14 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:14.721 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:14 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T10:09:14.721 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:14 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:09:14.721 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:14 smithi107 ceph-mon[79396]: Deploying daemon osd.3 on smithi107 2024-09-10T10:09:14.721 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:14 smithi107 ceph-mon[79396]: pgmap v103: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:09:14.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:14 smithi071 ceph-mon[90773]: Upgrade: Updating osd.3 2024-09-10T10:09:14.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:14 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:14.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:14 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T10:09:14.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:14 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:09:14.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:14 smithi071 ceph-mon[90773]: Deploying daemon osd.3 on smithi107 2024-09-10T10:09:14.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:14 smithi071 ceph-mon[90773]: pgmap v103: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:09:16.646 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:16 smithi107 systemd[1]: Stopping Ceph osd.3 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:09:16.646 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:16 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[39755]: 2024-09-10T10:09:16.507+0000 7fde3ef85640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:09:16.646 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:16 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[39755]: 2024-09-10T10:09:16.507+0000 7fde3ef85640 -1 osd.3 63 *** Got signal Terminated *** 2024-09-10T10:09:16.646 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:16 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[39755]: 2024-09-10T10:09:16.507+0000 7fde3ef85640 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:09:17.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:17 smithi071 ceph-mon[90773]: pgmap v104: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:09:17.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:17 smithi071 ceph-mon[90773]: osd.3 marked itself down and dead 2024-09-10T10:09:17.601 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:17 smithi107 ceph-mon[79396]: pgmap v104: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:09:17.601 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:17 smithi107 ceph-mon[79396]: osd.3 marked itself down and dead 2024-09-10T10:09:17.860 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:17 smithi107 podman[88289]: 2024-09-10 10:09:17.600590253 +0000 UTC m=+1.199248703 container died 04d67e835ea7bc5ec3f9c61237b2c5d32ba3cacdeb3e127b58a31eb3c37aadb7 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3, RELEASE=quincy-96d63e7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T10:09:18.145 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:18 smithi107 podman[88289]: 2024-09-10 10:09:18.017255441 +0000 UTC m=+1.615913887 container cleanup 04d67e835ea7bc5ec3f9c61237b2c5d32ba3cacdeb3e127b58a31eb3c37aadb7 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=quincy-96d63e7, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T10:09:18.145 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:18 smithi107 bash[88289]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3 2024-09-10T10:09:18.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:18 smithi071 ceph-mon[90773]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T10:09:18.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:18 smithi071 ceph-mon[90773]: osdmap e64: 6 total, 5 up, 6 in 2024-09-10T10:09:18.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:18 smithi071 ceph-mon[90773]: osdmap e65: 6 total, 5 up, 6 in 2024-09-10T10:09:18.636 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:18 smithi107 ceph-mon[79396]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T10:09:18.637 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:18 smithi107 ceph-mon[79396]: osdmap e64: 6 total, 5 up, 6 in 2024-09-10T10:09:18.637 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:18 smithi107 ceph-mon[79396]: osdmap e65: 6 total, 5 up, 6 in 2024-09-10T10:09:18.637 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:18 smithi107 podman[88304]: 2024-09-10 10:09:18.226930674 +0000 UTC m=+0.620400695 container remove 04d67e835ea7bc5ec3f9c61237b2c5d32ba3cacdeb3e127b58a31eb3c37aadb7 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-96d63e7, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T10:09:18.895 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:18 smithi107 podman[88397]: 2024-09-10 10:09:18.636053955 +0000 UTC m=+0.110795025 container create 90175928712c31a50c1b8dd10a71d4e68abe0c6575d5cfe0545a372f689a0390 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T10:09:18.896 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:18 smithi107 podman[88397]: 2024-09-10 10:09:18.540714471 +0000 UTC m=+0.015455552 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:09:19.230 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:18 smithi107 podman[88397]: 2024-09-10 10:09:18.923683944 +0000 UTC m=+0.398425014 container init 90175928712c31a50c1b8dd10a71d4e68abe0c6575d5cfe0545a372f689a0390 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T10:09:19.230 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:18 smithi107 podman[88397]: 2024-09-10 10:09:18.92693314 +0000 UTC m=+0.401674211 container start 90175928712c31a50c1b8dd10a71d4e68abe0c6575d5cfe0545a372f689a0390 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T10:09:19.230 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:19 smithi107 podman[88397]: 2024-09-10 10:09:19.013349946 +0000 UTC m=+0.488091017 container attach 90175928712c31a50c1b8dd10a71d4e68abe0c6575d5cfe0545a372f689a0390 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:09:19.230 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:19 smithi107 podman[88397]: 2024-09-10 10:09:19.111733595 +0000 UTC m=+0.586474665 container died 90175928712c31a50c1b8dd10a71d4e68abe0c6575d5cfe0545a372f689a0390 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-10T10:09:19.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:19 smithi071 ceph-mon[90773]: pgmap v106: 65 pgs: 16 stale+active+clean, 49 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:09:19.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:19 smithi107 ceph-mon[79396]: pgmap v106: 65 pgs: 16 stale+active+clean, 49 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:09:20.145 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:19 smithi107 podman[88420]: 2024-09-10 10:09:19.767022877 +0000 UTC m=+0.646501061 container remove 90175928712c31a50c1b8dd10a71d4e68abe0c6575d5cfe0545a372f689a0390 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T10:09:20.146 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:19 smithi107 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-10T10:09:20.146 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:19 smithi107 systemd[1]: Stopped Ceph osd.3 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:09:20.146 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:19 smithi107 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.3.service: Consumed 1min 13.354s CPU time. 2024-09-10T10:09:20.146 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:19 smithi107 systemd[1]: Starting Ceph osd.3 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:09:20.463 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:20 smithi107 ceph-mon[79396]: Health check failed: Degraded data redundancy: 38/321 objects degraded (11.838%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T10:09:20.464 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:20 smithi107 podman[88520]: 2024-09-10 10:09:20.193504156 +0000 UTC m=+0.110014545 container create 54ba87aac291832cb15b497563b7150250781b95d8270ca3dfa43bae2139082d (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:09:20.464 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:20 smithi107 podman[88520]: 2024-09-10 10:09:20.098815035 +0000 UTC m=+0.015325430 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:09:20.464 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:20 smithi107 podman[88520]: 2024-09-10 10:09:20.387584845 +0000 UTC m=+0.304095231 container init 54ba87aac291832cb15b497563b7150250781b95d8270ca3dfa43bae2139082d (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T10:09:20.464 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:20 smithi107 podman[88520]: 2024-09-10 10:09:20.390806495 +0000 UTC m=+0.307316882 container start 54ba87aac291832cb15b497563b7150250781b95d8270ca3dfa43bae2139082d (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T10:09:20.464 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:20 smithi107 podman[88520]: 2024-09-10 10:09:20.463336002 +0000 UTC m=+0.379846415 container attach 54ba87aac291832cb15b497563b7150250781b95d8270ca3dfa43bae2139082d (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:09:20.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:20 smithi071 ceph-mon[90773]: Health check failed: Degraded data redundancy: 38/321 objects degraded (11.838%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T10:09:20.895 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:20 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate[88535]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:09:20.895 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:20 smithi107 bash[88520]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:09:20.896 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:20 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate[88535]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:09:20.896 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:20 smithi107 bash[88520]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:09:21.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:21 smithi071 ceph-mon[90773]: pgmap v108: 65 pgs: 9 active+undersized, 6 stale+active+clean, 9 active+undersized+degraded, 41 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-09-10T10:09:21.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:21 smithi107 ceph-mon[79396]: pgmap v108: 65 pgs: 9 active+undersized, 6 stale+active+clean, 9 active+undersized+degraded, 41 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-09-10T10:09:21.548 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate[88535]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T10:09:21.548 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 bash[88520]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T10:09:21.548 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate[88535]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-10T10:09:21.548 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 bash[88520]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-10T10:09:21.843 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate[88535]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-10T10:09:21.843 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 bash[88520]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-10T10:09:21.843 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate[88535]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-10T10:09:21.844 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 bash[88520]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-10T10:09:21.844 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate[88535]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-10T10:09:21.844 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 bash[88520]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-10T10:09:21.844 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate[88535]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T10:09:21.844 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 bash[88520]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T10:09:21.844 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate[88535]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-10T10:09:21.844 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 bash[88520]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-10T10:09:21.844 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:21 smithi107 podman[88520]: 2024-09-10 10:09:21.575539774 +0000 UTC m=+1.492050174 container died 54ba87aac291832cb15b497563b7150250781b95d8270ca3dfa43bae2139082d (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T10:09:22.397 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:22 smithi107 podman[88667]: 2024-09-10 10:09:22.144065781 +0000 UTC m=+0.559636281 container remove 54ba87aac291832cb15b497563b7150250781b95d8270ca3dfa43bae2139082d (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T10:09:22.397 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:22 smithi107 podman[88725]: 2024-09-10 10:09:22.25126624 +0000 UTC m=+0.015783132 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:09:22.397 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:22 smithi107 podman[88725]: 2024-09-10 10:09:22.370027818 +0000 UTC m=+0.134544757 container create e22ee626ccd010f75e29a705f624a1c29db3da771140f5b570409258df028908 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T10:09:22.725 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:22 smithi107 podman[88725]: 2024-09-10 10:09:22.589385209 +0000 UTC m=+0.353902102 container init e22ee626ccd010f75e29a705f624a1c29db3da771140f5b570409258df028908 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:09:22.725 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:22 smithi107 podman[88725]: 2024-09-10 10:09:22.592870187 +0000 UTC m=+0.357387081 container start e22ee626ccd010f75e29a705f624a1c29db3da771140f5b570409258df028908 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T10:09:22.725 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:22 smithi107 ceph-osd[88744]: -- 172.21.15.107:0/1014166105 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559de513c1e0 con 0x559de42e9c00 2024-09-10T10:09:22.725 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:22 smithi107 bash[88725]: e22ee626ccd010f75e29a705f624a1c29db3da771140f5b570409258df028908 2024-09-10T10:09:23.145 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:22 smithi107 systemd[1]: Started Ceph osd.3 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:09:23.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:23 smithi071 ceph-mon[90773]: pgmap v109: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-10T10:09:23.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:23 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:23.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:23 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:23.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:23 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:09:23.593 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:23 smithi107 ceph-mon[79396]: pgmap v109: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-10T10:09:23.593 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:23 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:23.593 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:23 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:23.593 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:23 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:09:24.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.410+0000 7fd67377d640 1 -- 172.21.15.71:0/3984693060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0fe4f0 msgr2=0x7fd66c0fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.410+0000 7fd67377d640 1 --2- 172.21.15.71:0/3984693060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0fe4f0 0x7fd66c0fa650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0048d0 tx=0x7fd65c009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.410+0000 7fd67377d640 1 -- 172.21.15.71:0/3984693060 shutdown_connections 2024-09-10T10:09:24.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.410+0000 7fd67377d640 1 --2- 172.21.15.71:0/3984693060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0fe4f0 0x7fd66c0fa650 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.410+0000 7fd67377d640 1 --2- 172.21.15.71:0/3984693060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd66c0fdba0 0x7fd66c0fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.410+0000 7fd67377d640 1 -- 172.21.15.71:0/3984693060 >> 172.21.15.71:0/3984693060 conn(0x7fd66c0f63a0 msgr2=0x7fd66c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:24.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.410+0000 7fd67377d640 1 -- 172.21.15.71:0/3984693060 shutdown_connections 2024-09-10T10:09:24.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.410+0000 7fd67377d640 1 -- 172.21.15.71:0/3984693060 wait complete. 2024-09-10T10:09:24.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.410+0000 7fd67377d640 1 Processor -- start 2024-09-10T10:09:24.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.411+0000 7fd67377d640 1 -- start start 2024-09-10T10:09:24.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.411+0000 7fd67377d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd66c0fdba0 0x7fd66c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:24.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.411+0000 7fd67377d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0fe4f0 0x7fd66c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:24.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.411+0000 7fd67377d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c10dc40 con 0x7fd66c0fe4f0 2024-09-10T10:09:24.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.411+0000 7fd67377d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c10e460 con 0x7fd66c0fdba0 2024-09-10T10:09:24.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.411+0000 7fd670d18640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0fe4f0 0x7fd66c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:24.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.411+0000 7fd670d18640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0fe4f0 0x7fd66c10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59712/0 (socket says 172.21.15.71:59712) 2024-09-10T10:09:24.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.411+0000 7fd670d18640 1 -- 172.21.15.71:0/3064870582 learned_addr learned my addr 172.21.15.71:0/3064870582 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:24.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.411+0000 7fd671519640 1 --2- 172.21.15.71:0/3064870582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd66c0fdba0 0x7fd66c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:24.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.411+0000 7fd670d18640 1 -- 172.21.15.71:0/3064870582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd66c0fdba0 msgr2=0x7fd66c10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.411+0000 7fd670d18640 1 --2- 172.21.15.71:0/3064870582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd66c0fdba0 0x7fd66c10d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.411+0000 7fd670d18640 1 -- 172.21.15.71:0/3064870582 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c005040 con 0x7fd66c0fe4f0 2024-09-10T10:09:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.411+0000 7fd670d18640 1 --2- 172.21.15.71:0/3064870582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0fe4f0 0x7fd66c10d5f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0048a0 tx=0x7fd65c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.412+0000 7fd661ffb640 1 -- 172.21.15.71:0/3064870582 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd65c038070 con 0x7fd66c0fe4f0 2024-09-10T10:09:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.412+0000 7fd67377d640 1 -- 172.21.15.71:0/3064870582 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66c10e690 con 0x7fd66c0fe4f0 2024-09-10T10:09:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.412+0000 7fd661ffb640 1 -- 172.21.15.71:0/3064870582 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd65c02abd0 con 0x7fd66c0fe4f0 2024-09-10T10:09:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.412+0000 7fd661ffb640 1 -- 172.21.15.71:0/3064870582 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd65c033640 con 0x7fd66c0fe4f0 2024-09-10T10:09:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.412+0000 7fd67377d640 1 -- 172.21.15.71:0/3064870582 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66c10ec30 con 0x7fd66c0fe4f0 2024-09-10T10:09:24.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.413+0000 7fd67377d640 1 -- 172.21.15.71:0/3064870582 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66c0fa040 con 0x7fd66c0fe4f0 2024-09-10T10:09:24.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.413+0000 7fd661ffb640 1 -- 172.21.15.71:0/3064870582 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd65c030020 con 0x7fd66c0fe4f0 2024-09-10T10:09:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.414+0000 7fd661ffb640 1 --2- 172.21.15.71:0/3064870582 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd65806e0b0 0x7fd658070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.414+0000 7fd661ffb640 1 -- 172.21.15.71:0/3064870582 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd65c0adea0 con 0x7fd66c0fe4f0 2024-09-10T10:09:24.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.414+0000 7fd671519640 1 --2- 172.21.15.71:0/3064870582 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd65806e0b0 0x7fd658070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:24.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.414+0000 7fd671519640 1 --2- 172.21.15.71:0/3064870582 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd65806e0b0 0x7fd658070560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6680041d0 tx=0x7fd668004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:24.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.418+0000 7fd661ffb640 1 -- 172.21.15.71:0/3064870582 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd65c077280 con 0x7fd66c0fe4f0 2024-09-10T10:09:24.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.602+0000 7fd67377d640 1 -- 172.21.15.71:0/3064870582 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd66c10eec0 con 0x7fd65806e0b0 2024-09-10T10:09:24.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.604+0000 7fd661ffb640 1 -- 172.21.15.71:0/3064870582 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd66c10eec0 con 0x7fd65806e0b0 2024-09-10T10:09:24.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.606+0000 7fd67377d640 1 -- 172.21.15.71:0/3064870582 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd65806e0b0 msgr2=0x7fd658070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.606+0000 7fd67377d640 1 --2- 172.21.15.71:0/3064870582 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd65806e0b0 0x7fd658070560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6680041d0 tx=0x7fd668004330 comp rx=0 tx=0).stop 2024-09-10T10:09:24.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.606+0000 7fd67377d640 1 -- 172.21.15.71:0/3064870582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0fe4f0 msgr2=0x7fd66c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.606+0000 7fd67377d640 1 --2- 172.21.15.71:0/3064870582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0fe4f0 0x7fd66c10d5f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0048a0 tx=0x7fd65c009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.606+0000 7fd67377d640 1 -- 172.21.15.71:0/3064870582 shutdown_connections 2024-09-10T10:09:24.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.606+0000 7fd67377d640 1 --2- 172.21.15.71:0/3064870582 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd65806e0b0 0x7fd658070560 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.606+0000 7fd67377d640 1 --2- 172.21.15.71:0/3064870582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66c0fe4f0 0x7fd66c10d5f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.606+0000 7fd67377d640 1 --2- 172.21.15.71:0/3064870582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd66c0fdba0 0x7fd66c10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.606+0000 7fd67377d640 1 -- 172.21.15.71:0/3064870582 >> 172.21.15.71:0/3064870582 conn(0x7fd66c0f63a0 msgr2=0x7fd66c0f7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:24.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.606+0000 7fd67377d640 1 -- 172.21.15.71:0/3064870582 shutdown_connections 2024-09-10T10:09:24.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.606+0000 7fd67377d640 1 -- 172.21.15.71:0/3064870582 wait complete. 2024-09-10T10:09:24.616 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:09:24.645 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:24 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[88740]: 2024-09-10T10:09:24.485+0000 7f5d63b35640 -1 Falling back to public interface 2024-09-10T10:09:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.685+0000 7f267d070640 1 -- 172.21.15.71:0/1450915815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26780fb450 msgr2=0x7f26780fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.685+0000 7f267d070640 1 --2- 172.21.15.71:0/1450915815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26780fb450 0x7f26780fb860 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2670009c50 tx=0x7f2670004d10 comp rx=0 tx=0).stop 2024-09-10T10:09:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.685+0000 7f267d070640 1 -- 172.21.15.71:0/1450915815 shutdown_connections 2024-09-10T10:09:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.685+0000 7f267d070640 1 --2- 172.21.15.71:0/1450915815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26780fc720 0x7f26780fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.686+0000 7f267d070640 1 --2- 172.21.15.71:0/1450915815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26780fb450 0x7f26780fb860 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.686+0000 7f267d070640 1 -- 172.21.15.71:0/1450915815 >> 172.21.15.71:0/1450915815 conn(0x7f26780f6c10 msgr2=0x7f26780f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.686+0000 7f267d070640 1 -- 172.21.15.71:0/1450915815 shutdown_connections 2024-09-10T10:09:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.686+0000 7f267d070640 1 -- 172.21.15.71:0/1450915815 wait complete. 2024-09-10T10:09:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.686+0000 7f267d070640 1 Processor -- start 2024-09-10T10:09:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.686+0000 7f267d070640 1 -- start start 2024-09-10T10:09:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.686+0000 7f267d070640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26780fb450 0x7f26780ff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.686+0000 7f267d070640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26780fc720 0x7f26780fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.686+0000 7f267d070640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26780fdff0 con 0x7f26780fb450 2024-09-10T10:09:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.687+0000 7f267d070640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26780fe130 con 0x7f26780fc720 2024-09-10T10:09:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.687+0000 7f2676d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26780fb450 0x7f26780ff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.687+0000 7f267659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26780fc720 0x7f26780fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.687+0000 7f2676d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26780fb450 0x7f26780ff570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59722/0 (socket says 172.21.15.71:59722) 2024-09-10T10:09:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.687+0000 7f2676d9d640 1 -- 172.21.15.71:0/772521985 learned_addr learned my addr 172.21.15.71:0/772521985 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.687+0000 7f2676d9d640 1 -- 172.21.15.71:0/772521985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26780fc720 msgr2=0x7f26780fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.687+0000 7f2676d9d640 1 --2- 172.21.15.71:0/772521985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26780fc720 0x7f26780fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.687+0000 7f2676d9d640 1 -- 172.21.15.71:0/772521985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26700098b0 con 0x7f26780fb450 2024-09-10T10:09:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.687+0000 7f2676d9d640 1 --2- 172.21.15.71:0/772521985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26780fb450 0x7f26780ff570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2670004a30 tx=0x7f2670004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.687+0000 7f266f7fe640 1 -- 172.21.15.71:0/772521985 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2670009710 con 0x7f26780fb450 2024-09-10T10:09:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.687+0000 7f267d070640 1 -- 172.21.15.71:0/772521985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26780fe3b0 con 0x7f26780fb450 2024-09-10T10:09:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.687+0000 7f266f7fe640 1 -- 172.21.15.71:0/772521985 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2670032b10 con 0x7f26780fb450 2024-09-10T10:09:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.688+0000 7f267d070640 1 -- 172.21.15.71:0/772521985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2678115130 con 0x7f26780fb450 2024-09-10T10:09:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.688+0000 7f266f7fe640 1 -- 172.21.15.71:0/772521985 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f267003db10 con 0x7f26780fb450 2024-09-10T10:09:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.689+0000 7f267d070640 1 -- 172.21.15.71:0/772521985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26780fa8b0 con 0x7f26780fb450 2024-09-10T10:09:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.689+0000 7f266f7fe640 1 -- 172.21.15.71:0/772521985 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f267002f030 con 0x7f26780fb450 2024-09-10T10:09:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.690+0000 7f266f7fe640 1 --2- 172.21.15.71:0/772521985 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f266406e0b0 0x7f2664070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.690+0000 7f266f7fe640 1 -- 172.21.15.71:0/772521985 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f26700af190 con 0x7f26780fb450 2024-09-10T10:09:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.690+0000 7f267659c640 1 --2- 172.21.15.71:0/772521985 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f266406e0b0 0x7f2664070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.690+0000 7f267659c640 1 --2- 172.21.15.71:0/772521985 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f266406e0b0 0x7f2664070560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2660004ed0 tx=0x7f266000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:24.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.694+0000 7f266f7fe640 1 -- 172.21.15.71:0/772521985 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2670078540 con 0x7f26780fb450 2024-09-10T10:09:24.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.876+0000 7f267d070640 1 -- 172.21.15.71:0/772521985 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2678103f80 con 0x7f266406e0b0 2024-09-10T10:09:24.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.877+0000 7f266f7fe640 1 -- 172.21.15.71:0/772521985 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2678103f80 con 0x7f266406e0b0 2024-09-10T10:09:24.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.879+0000 7f267d070640 1 -- 172.21.15.71:0/772521985 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f266406e0b0 msgr2=0x7f2664070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.879+0000 7f267d070640 1 --2- 172.21.15.71:0/772521985 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f266406e0b0 0x7f2664070560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2660004ed0 tx=0x7f266000b040 comp rx=0 tx=0).stop 2024-09-10T10:09:24.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.879+0000 7f267d070640 1 -- 172.21.15.71:0/772521985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26780fb450 msgr2=0x7f26780ff570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.879+0000 7f267d070640 1 --2- 172.21.15.71:0/772521985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26780fb450 0x7f26780ff570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2670004a30 tx=0x7f2670004d10 comp rx=0 tx=0).stop 2024-09-10T10:09:24.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.879+0000 7f267d070640 1 -- 172.21.15.71:0/772521985 shutdown_connections 2024-09-10T10:09:24.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.879+0000 7f267d070640 1 --2- 172.21.15.71:0/772521985 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f266406e0b0 0x7f2664070560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.879+0000 7f267d070640 1 --2- 172.21.15.71:0/772521985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26780fc720 0x7f26780fda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.879+0000 7f267d070640 1 --2- 172.21.15.71:0/772521985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26780fb450 0x7f26780ff570 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.879+0000 7f267d070640 1 -- 172.21.15.71:0/772521985 >> 172.21.15.71:0/772521985 conn(0x7f26780f6c10 msgr2=0x7f2678066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.879+0000 7f267d070640 1 -- 172.21.15.71:0/772521985 shutdown_connections 2024-09-10T10:09:24.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.879+0000 7f267d070640 1 -- 172.21.15.71:0/772521985 wait complete. 2024-09-10T10:09:24.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.957+0000 7fdaa396e640 1 -- 172.21.15.71:0/3447715186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda9c0fc720 msgr2=0x7fda9c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.957+0000 7fdaa396e640 1 --2- 172.21.15.71:0/3447715186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda9c0fc720 0x7fda9c0fcb90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0048d0 tx=0x7fda8c009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.957+0000 7fdaa396e640 1 -- 172.21.15.71:0/3447715186 shutdown_connections 2024-09-10T10:09:24.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.957+0000 7fdaa396e640 1 --2- 172.21.15.71:0/3447715186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda9c0fc720 0x7fda9c0fcb90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.957+0000 7fdaa396e640 1 --2- 172.21.15.71:0/3447715186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda9c0fb450 0x7fda9c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.957+0000 7fdaa396e640 1 -- 172.21.15.71:0/3447715186 >> 172.21.15.71:0/3447715186 conn(0x7fda9c0f6c30 msgr2=0x7fda9c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:24.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.957+0000 7fdaa396e640 1 -- 172.21.15.71:0/3447715186 shutdown_connections 2024-09-10T10:09:24.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.957+0000 7fdaa396e640 1 -- 172.21.15.71:0/3447715186 wait complete. 2024-09-10T10:09:24.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.958+0000 7fdaa396e640 1 Processor -- start 2024-09-10T10:09:24.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.958+0000 7fdaa396e640 1 -- start start 2024-09-10T10:09:24.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.958+0000 7fdaa396e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda9c0fb450 0x7fda9c10f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:24.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.958+0000 7fdaa396e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda9c0fc720 0x7fda9c10f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:24.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.958+0000 7fdaa396e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c10fe40 con 0x7fda9c0fb450 2024-09-10T10:09:24.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.958+0000 7fdaa396e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c110660 con 0x7fda9c0fc720 2024-09-10T10:09:24.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.958+0000 7fdaa170a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda9c0fb450 0x7fda9c10f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:24.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.958+0000 7fdaa170a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda9c0fb450 0x7fda9c10f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59744/0 (socket says 172.21.15.71:59744) 2024-09-10T10:09:24.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.958+0000 7fdaa170a640 1 -- 172.21.15.71:0/3575563840 learned_addr learned my addr 172.21.15.71:0/3575563840 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:24.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.958+0000 7fdaa0f09640 1 --2- 172.21.15.71:0/3575563840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda9c0fc720 0x7fda9c10f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:24.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.959+0000 7fdaa170a640 1 -- 172.21.15.71:0/3575563840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda9c0fc720 msgr2=0x7fda9c10f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.959+0000 7fdaa170a640 1 --2- 172.21.15.71:0/3575563840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda9c0fc720 0x7fda9c10f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.959+0000 7fdaa170a640 1 -- 172.21.15.71:0/3575563840 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c005040 con 0x7fda9c0fb450 2024-09-10T10:09:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.959+0000 7fdaa170a640 1 --2- 172.21.15.71:0/3575563840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda9c0fb450 0x7fda9c10f2b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fda9800ece0 tx=0x7fda9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.959+0000 7fda91ffb640 1 -- 172.21.15.71:0/3575563840 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda9800ee40 con 0x7fda9c0fb450 2024-09-10T10:09:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.959+0000 7fda91ffb640 1 -- 172.21.15.71:0/3575563840 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fda9800f040 con 0x7fda9c0fb450 2024-09-10T10:09:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.959+0000 7fdaa396e640 1 -- 172.21.15.71:0/3575563840 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c1108f0 con 0x7fda9c0fb450 2024-09-10T10:09:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.959+0000 7fda91ffb640 1 -- 172.21.15.71:0/3575563840 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda98009580 con 0x7fda9c0fb450 2024-09-10T10:09:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.959+0000 7fdaa396e640 1 -- 172.21.15.71:0/3575563840 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c110e90 con 0x7fda9c0fb450 2024-09-10T10:09:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.960+0000 7fdaa396e640 1 -- 172.21.15.71:0/3575563840 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c0fa8b0 con 0x7fda9c0fb450 2024-09-10T10:09:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.961+0000 7fda91ffb640 1 -- 172.21.15.71:0/3575563840 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fda9800ccc0 con 0x7fda9c0fb450 2024-09-10T10:09:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.961+0000 7fda91ffb640 1 --2- 172.21.15.71:0/3575563840 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fda8806e0b0 0x7fda88070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:24.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.961+0000 7fda91ffb640 1 -- 172.21.15.71:0/3575563840 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fda9808e110 con 0x7fda9c0fb450 2024-09-10T10:09:24.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.961+0000 7fdaa0f09640 1 --2- 172.21.15.71:0/3575563840 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fda8806e0b0 0x7fda88070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:24.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.962+0000 7fdaa0f09640 1 --2- 172.21.15.71:0/3575563840 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fda8806e0b0 0x7fda88070560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda8c007ac0 tx=0x7fda8c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:24.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:24.966+0000 7fda91ffb640 1 -- 172.21.15.71:0/3575563840 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fda9805aff0 con 0x7fda9c0fb450 2024-09-10T10:09:25.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.139+0000 7fdaa396e640 1 -- 172.21.15.71:0/3575563840 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda9c104020 con 0x7fda8806e0b0 2024-09-10T10:09:25.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.147+0000 7fda91ffb640 1 -- 172.21.15.71:0/3575563840 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fda8c039040 con 0x7fda8806e0b0 2024-09-10T10:09:25.149 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:09:25.149 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (4m) 32s ago 13m 26.4M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:09:25.150 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (2m) 32s ago 13m 6903k - 19.1.1-305-g1cf819b7 41d671128357 5dc74ad01560 2024-09-10T10:09:25.150 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (2m) 2m ago 12m 6891k - 19.1.1-305-g1cf819b7 41d671128357 6f4355e875db 2024-09-10T10:09:25.150 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (4m) 32s ago 13m 78.2M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:09:25.150 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (7m) 32s ago 7m 113M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:09:25.150 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (7m) 32s ago 7m 65.2M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:09:25.150 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (7m) 2m ago 7m 108M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:09:25.151 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (7m) 2m ago 7m 62.7M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:09:25.151 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (3m) 32s ago 14m 498M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:09:25.151 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (3m) 2m ago 12m 439M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:09:25.151 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (3m) 32s ago 14m 47.2M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:09:25.151 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (2m) 2m ago 12m 33.9M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:09:25.151 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (4m) 32s ago 13m 16.2M - 1.5.0 0da6a335fe13 c3d47d79cd22 2024-09-10T10:09:25.152 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (4m) 2m ago 12m 16.9M - 1.5.0 0da6a335fe13 9a25165a0fd1 2024-09-10T10:09:25.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (107s) 32s ago 11m 95.6M 1557M 19.1.1-305-g1cf819b7 41d671128357 f1e9da1144c1 2024-09-10T10:09:25.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (72s) 32s ago 10m 98.8M 1557M 19.1.1-305-g1cf819b7 41d671128357 5afc8bef5343 2024-09-10T10:09:25.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (37s) 32s ago 10m 12.1M 1557M 19.1.1-305-g1cf819b7 41d671128357 5e5976fcfaa8 2024-09-10T10:09:25.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 starting - - - 2581M 2024-09-10T10:09:25.152 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (9m) 2m ago 9m 229M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 b26d5a16099e 2024-09-10T10:09:25.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (9m) 2m ago 9m 228M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:09:25.153 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (3m) 32s ago 12m 56.5M - 2.43.0 a07b618ecd1d 47d3ae62ce5e 2024-09-10T10:09:25.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.149+0000 7fdaa396e640 1 -- 172.21.15.71:0/3575563840 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fda8806e0b0 msgr2=0x7fda88070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:25.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.150+0000 7fdaa396e640 1 --2- 172.21.15.71:0/3575563840 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fda8806e0b0 0x7fda88070560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda8c007ac0 tx=0x7fda8c035040 comp rx=0 tx=0).stop 2024-09-10T10:09:25.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.150+0000 7fdaa396e640 1 -- 172.21.15.71:0/3575563840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda9c0fb450 msgr2=0x7fda9c10f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:25.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.150+0000 7fdaa396e640 1 --2- 172.21.15.71:0/3575563840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda9c0fb450 0x7fda9c10f2b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fda9800ece0 tx=0x7fda9800b040 comp rx=0 tx=0).stop 2024-09-10T10:09:25.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.150+0000 7fdaa396e640 1 -- 172.21.15.71:0/3575563840 shutdown_connections 2024-09-10T10:09:25.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.150+0000 7fdaa396e640 1 --2- 172.21.15.71:0/3575563840 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fda8806e0b0 0x7fda88070560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.150+0000 7fdaa396e640 1 --2- 172.21.15.71:0/3575563840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda9c0fc720 0x7fda9c10f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.150+0000 7fdaa396e640 1 --2- 172.21.15.71:0/3575563840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda9c0fb450 0x7fda9c10f2b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.150+0000 7fdaa396e640 1 -- 172.21.15.71:0/3575563840 >> 172.21.15.71:0/3575563840 conn(0x7fda9c0f6c30 msgr2=0x7fda9c066140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:25.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.150+0000 7fdaa396e640 1 -- 172.21.15.71:0/3575563840 shutdown_connections 2024-09-10T10:09:25.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.150+0000 7fdaa396e640 1 -- 172.21.15.71:0/3575563840 wait complete. 2024-09-10T10:09:25.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.228+0000 7f46accaf640 1 -- 172.21.15.71:0/917010381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a80ff680 msgr2=0x7f46a8101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:25.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.228+0000 7f46accaf640 1 --2- 172.21.15.71:0/917010381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a80ff680 0x7f46a8101a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46900048d0 tx=0x7f4690009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.230 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:25 smithi071 ceph-mon[90773]: pgmap v110: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-10T10:09:25.230 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:25.230 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:09:25.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.228+0000 7f46accaf640 1 -- 172.21.15.71:0/917010381 shutdown_connections 2024-09-10T10:09:25.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.228+0000 7f46accaf640 1 --2- 172.21.15.71:0/917010381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a80ff680 0x7f46a8101a60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.228+0000 7f46accaf640 1 --2- 172.21.15.71:0/917010381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46a8065c40 0x7f46a80ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.228+0000 7f46accaf640 1 -- 172.21.15.71:0/917010381 >> 172.21.15.71:0/917010381 conn(0x7f46a80f6c10 msgr2=0x7f46a80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:25.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.228+0000 7f46accaf640 1 -- 172.21.15.71:0/917010381 shutdown_connections 2024-09-10T10:09:25.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.228+0000 7f46accaf640 1 -- 172.21.15.71:0/917010381 wait complete. 2024-09-10T10:09:25.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.228+0000 7f46accaf640 1 Processor -- start 2024-09-10T10:09:25.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.228+0000 7f46accaf640 1 -- start start 2024-09-10T10:09:25.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.229+0000 7f46accaf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a8065c40 0x7f46a810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:25.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.229+0000 7f46accaf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46a80ff680 0x7f46a810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:25.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.229+0000 7f46accaf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a810dc00 con 0x7f46a8065c40 2024-09-10T10:09:25.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.229+0000 7f46accaf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a810e420 con 0x7f46a80ff680 2024-09-10T10:09:25.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.229+0000 7f46a659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a8065c40 0x7f46a810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:25.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.229+0000 7f46a659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a8065c40 0x7f46a810d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59772/0 (socket says 172.21.15.71:59772) 2024-09-10T10:09:25.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.229+0000 7f46a659c640 1 -- 172.21.15.71:0/2271211657 learned_addr learned my addr 172.21.15.71:0/2271211657 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:25.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.229+0000 7f46a5d9b640 1 --2- 172.21.15.71:0/2271211657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46a80ff680 0x7f46a810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:25.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.229+0000 7f46a659c640 1 -- 172.21.15.71:0/2271211657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46a80ff680 msgr2=0x7f46a810d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:25.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.229+0000 7f46a659c640 1 --2- 172.21.15.71:0/2271211657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46a80ff680 0x7f46a810d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.229+0000 7f46a659c640 1 -- 172.21.15.71:0/2271211657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4690005040 con 0x7f46a8065c40 2024-09-10T10:09:25.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.229+0000 7f46a659c640 1 --2- 172.21.15.71:0/2271211657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a8065c40 0x7f46a810d070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f46a000ece0 tx=0x7f46a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:25.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.229+0000 7f469effd640 1 -- 172.21.15.71:0/2271211657 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46a000cab0 con 0x7f46a8065c40 2024-09-10T10:09:25.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.230+0000 7f469effd640 1 -- 172.21.15.71:0/2271211657 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f46a000f040 con 0x7f46a8065c40 2024-09-10T10:09:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.230+0000 7f469effd640 1 -- 172.21.15.71:0/2271211657 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46a0009680 con 0x7f46a8065c40 2024-09-10T10:09:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.230+0000 7f46accaf640 1 -- 172.21.15.71:0/2271211657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a810e6b0 con 0x7f46a8065c40 2024-09-10T10:09:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.230+0000 7f46accaf640 1 -- 172.21.15.71:0/2271211657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a810ec50 con 0x7f46a8065c40 2024-09-10T10:09:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.231+0000 7f46accaf640 1 -- 172.21.15.71:0/2271211657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a80fa890 con 0x7f46a8065c40 2024-09-10T10:09:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.231+0000 7f469effd640 1 -- 172.21.15.71:0/2271211657 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f46a0007890 con 0x7f46a8065c40 2024-09-10T10:09:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.232+0000 7f469effd640 1 --2- 172.21.15.71:0/2271211657 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f469406e0b0 0x7f4694070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.232+0000 7f46a5d9b640 1 --2- 172.21.15.71:0/2271211657 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f469406e0b0 0x7f4694070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.232+0000 7f469effd640 1 -- 172.21.15.71:0/2271211657 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f46a008e090 con 0x7f46a8065c40 2024-09-10T10:09:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.233+0000 7f46a5d9b640 1 --2- 172.21.15.71:0/2271211657 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f469406e0b0 0x7f4694070560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4690007ac0 tx=0x7f4690035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.236+0000 7f469effd640 1 -- 172.21.15.71:0/2271211657 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f46a0057500 con 0x7f46a8065c40 2024-09-10T10:09:25.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:25 smithi107 ceph-mon[79396]: pgmap v110: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-10T10:09:25.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:25 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:25.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:25 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:09:25.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.468+0000 7f46accaf640 1 -- 172.21.15.71:0/2271211657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f46a804b720 con 0x7f46a8065c40 2024-09-10T10:09:25.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.469+0000 7f469effd640 1 -- 172.21.15.71:0/2271211657 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f46a005abc0 con 0x7f46a8065c40 2024-09-10T10:09:25.470 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:09:25.470 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:09:25.470 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:09:25.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:09:25.470 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:09:25.470 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:09:25.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:09:25.471 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:09:25.471 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2, 2024-09-10T10:09:25.471 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 3 2024-09-10T10:09:25.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:09:25.471 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:09:25.471 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:09:25.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:09:25.471 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:09:25.471 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 6, 2024-09-10T10:09:25.471 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 7 2024-09-10T10:09:25.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:09:25.471 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:09:25.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.470+0000 7f46accaf640 1 -- 172.21.15.71:0/2271211657 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f469406e0b0 msgr2=0x7f4694070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:25.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.470+0000 7f46accaf640 1 --2- 172.21.15.71:0/2271211657 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f469406e0b0 0x7f4694070560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4690007ac0 tx=0x7f4690035040 comp rx=0 tx=0).stop 2024-09-10T10:09:25.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.470+0000 7f46accaf640 1 -- 172.21.15.71:0/2271211657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a8065c40 msgr2=0x7f46a810d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:25.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.471+0000 7f46accaf640 1 --2- 172.21.15.71:0/2271211657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a8065c40 0x7f46a810d070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f46a000ece0 tx=0x7f46a000b040 comp rx=0 tx=0).stop 2024-09-10T10:09:25.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.471+0000 7f46accaf640 1 -- 172.21.15.71:0/2271211657 shutdown_connections 2024-09-10T10:09:25.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.471+0000 7f46accaf640 1 --2- 172.21.15.71:0/2271211657 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f469406e0b0 0x7f4694070560 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.471+0000 7f46accaf640 1 --2- 172.21.15.71:0/2271211657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46a80ff680 0x7f46a810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.471+0000 7f46accaf640 1 --2- 172.21.15.71:0/2271211657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a8065c40 0x7f46a810d070 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.471+0000 7f46accaf640 1 -- 172.21.15.71:0/2271211657 >> 172.21.15.71:0/2271211657 conn(0x7f46a80f6c10 msgr2=0x7f46a80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:25.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.471+0000 7f46accaf640 1 -- 172.21.15.71:0/2271211657 shutdown_connections 2024-09-10T10:09:25.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.471+0000 7f46accaf640 1 -- 172.21.15.71:0/2271211657 wait complete. 2024-09-10T10:09:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.551+0000 7f5958e5c640 1 -- 172.21.15.71:0/4252118297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59540fc550 msgr2=0x7f59540fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.551+0000 7f5958e5c640 1 --2- 172.21.15.71:0/4252118297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59540fc550 0x7f59540fc960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f59440048d0 tx=0x7f5944009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.551+0000 7f5958e5c640 1 -- 172.21.15.71:0/4252118297 shutdown_connections 2024-09-10T10:09:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.551+0000 7f5958e5c640 1 --2- 172.21.15.71:0/4252118297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59540fd820 0x7f59540fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.551+0000 7f5958e5c640 1 --2- 172.21.15.71:0/4252118297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59540fc550 0x7f59540fc960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.551+0000 7f5958e5c640 1 -- 172.21.15.71:0/4252118297 >> 172.21.15.71:0/4252118297 conn(0x7f59540f7d30 msgr2=0x7f59540fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.551+0000 7f5958e5c640 1 -- 172.21.15.71:0/4252118297 shutdown_connections 2024-09-10T10:09:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.551+0000 7f5958e5c640 1 -- 172.21.15.71:0/4252118297 wait complete. 2024-09-10T10:09:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.552+0000 7f5958e5c640 1 Processor -- start 2024-09-10T10:09:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.552+0000 7f5958e5c640 1 -- start start 2024-09-10T10:09:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.552+0000 7f5958e5c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59540fc550 0x7f595410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.552+0000 7f5958e5c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59540fd820 0x7f595410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.552+0000 7f5958e5c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595410dc10 con 0x7f59540fc550 2024-09-10T10:09:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.552+0000 7f5958e5c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595410e430 con 0x7f59540fd820 2024-09-10T10:09:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.552+0000 7f595259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59540fc550 0x7f595410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.552+0000 7f595259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59540fc550 0x7f595410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59782/0 (socket says 172.21.15.71:59782) 2024-09-10T10:09:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.552+0000 7f595259c640 1 -- 172.21.15.71:0/1083238951 learned_addr learned my addr 172.21.15.71:0/1083238951 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.552+0000 7f5951d9b640 1 --2- 172.21.15.71:0/1083238951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59540fd820 0x7f595410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.552+0000 7f595259c640 1 -- 172.21.15.71:0/1083238951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59540fd820 msgr2=0x7f595410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.552+0000 7f595259c640 1 --2- 172.21.15.71:0/1083238951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59540fd820 0x7f595410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.552+0000 7f595259c640 1 -- 172.21.15.71:0/1083238951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944005040 con 0x7f59540fc550 2024-09-10T10:09:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.553+0000 7f595259c640 1 --2- 172.21.15.71:0/1083238951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59540fc550 0x7f595410d080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f59440043d0 tx=0x7f5944009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.553+0000 7f5942ffd640 1 -- 172.21.15.71:0/1083238951 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5944038070 con 0x7f59540fc550 2024-09-10T10:09:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.553+0000 7f5958e5c640 1 -- 172.21.15.71:0/1083238951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595410e660 con 0x7f59540fc550 2024-09-10T10:09:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.553+0000 7f5942ffd640 1 -- 172.21.15.71:0/1083238951 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f594402ae90 con 0x7f59540fc550 2024-09-10T10:09:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.553+0000 7f5942ffd640 1 -- 172.21.15.71:0/1083238951 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f594403e670 con 0x7f59540fc550 2024-09-10T10:09:25.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.553+0000 7f5958e5c640 1 -- 172.21.15.71:0/1083238951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595410ec00 con 0x7f59540fc550 2024-09-10T10:09:25.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.554+0000 7f5958e5c640 1 -- 172.21.15.71:0/1083238951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59540fb9b0 con 0x7f59540fc550 2024-09-10T10:09:25.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.554+0000 7f5942ffd640 1 -- 172.21.15.71:0/1083238951 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5944030020 con 0x7f59540fc550 2024-09-10T10:09:25.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.555+0000 7f5942ffd640 1 --2- 172.21.15.71:0/1083238951 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f593c06e0b0 0x7f593c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:25.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.555+0000 7f5942ffd640 1 -- 172.21.15.71:0/1083238951 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f59440add50 con 0x7f59540fc550 2024-09-10T10:09:25.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.555+0000 7f5951d9b640 1 --2- 172.21.15.71:0/1083238951 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f593c06e0b0 0x7f593c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:25.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.555+0000 7f5951d9b640 1 --2- 172.21.15.71:0/1083238951 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f593c06e0b0 0x7f593c070560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f595410ce30 tx=0x7f594800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.559+0000 7f5942ffd640 1 -- 172.21.15.71:0/1083238951 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5944077130 con 0x7f59540fc550 2024-09-10T10:09:25.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.758+0000 7f5958e5c640 1 -- 172.21.15.71:0/1083238951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f595410eee0 con 0x7f59540fc550 2024-09-10T10:09:25.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.759+0000 7f5942ffd640 1 -- 172.21.15.71:0/1083238951 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1955 (secure 0 0 0) 0x7f594407a7f0 con 0x7f59540fc550 2024-09-10T10:09:25.761 INFO:teuthology.orchestra.run.smithi071.stdout:e24 2024-09-10T10:09:25.761 INFO:teuthology.orchestra.run.smithi071.stdout:btime 2024-09-10T10:07:40:170505+0000 2024-09-10T10:09:25.761 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:09:25.761 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:09:25.761 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:09:25.762 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:09:25.762 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:09:25.762 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:09:25.762 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 24 2024-09-10T10:09:25.762 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:09:25.762 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:09:25.762 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:07:39.792181+0000 2024-09-10T10:09:25.762 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:09:25.762 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:09:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:09:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:09:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:09:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:09:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:09:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:09:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:09:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:09:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:09:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:09:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:09:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:09:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:09:25.764 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:09:25.764 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:09:25.764 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:09:25.764 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:09:25.764 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:09:25.764 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:09:25.764 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:09:25.764 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 14464 members: 24267,14464 2024-09-10T10:09:25.764 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:09:25.764 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:09:25.764 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:09:25.764 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:09:25.764 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:09:25.765 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:09:25.766 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 24 2024-09-10T10:09:25.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.761+0000 7f5958e5c640 1 -- 172.21.15.71:0/1083238951 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f593c06e0b0 msgr2=0x7f593c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:25.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.761+0000 7f5958e5c640 1 --2- 172.21.15.71:0/1083238951 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f593c06e0b0 0x7f593c070560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f595410ce30 tx=0x7f594800b040 comp rx=0 tx=0).stop 2024-09-10T10:09:25.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.761+0000 7f5958e5c640 1 -- 172.21.15.71:0/1083238951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59540fc550 msgr2=0x7f595410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:25.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.761+0000 7f5958e5c640 1 --2- 172.21.15.71:0/1083238951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59540fc550 0x7f595410d080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f59440043d0 tx=0x7f5944009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.761+0000 7f5958e5c640 1 -- 172.21.15.71:0/1083238951 shutdown_connections 2024-09-10T10:09:25.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.761+0000 7f5958e5c640 1 --2- 172.21.15.71:0/1083238951 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f593c06e0b0 0x7f593c070560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.761+0000 7f5958e5c640 1 --2- 172.21.15.71:0/1083238951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59540fd820 0x7f595410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.761+0000 7f5958e5c640 1 --2- 172.21.15.71:0/1083238951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59540fc550 0x7f595410d080 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.761+0000 7f5958e5c640 1 -- 172.21.15.71:0/1083238951 >> 172.21.15.71:0/1083238951 conn(0x7f59540f7d30 msgr2=0x7f59540f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:25.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.761+0000 7f5958e5c640 1 -- 172.21.15.71:0/1083238951 shutdown_connections 2024-09-10T10:09:25.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.761+0000 7f5958e5c640 1 -- 172.21.15.71:0/1083238951 wait complete. 2024-09-10T10:09:25.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.840+0000 7f71b88a6640 1 -- 172.21.15.71:0/3460759985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71b40fd7f0 msgr2=0x7f71b40fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:25.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.840+0000 7f71b88a6640 1 --2- 172.21.15.71:0/3460759985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71b40fd7f0 0x7f71b40fdc60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f719c0048d0 tx=0x7f719c009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.841+0000 7f71b88a6640 1 -- 172.21.15.71:0/3460759985 shutdown_connections 2024-09-10T10:09:25.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.841+0000 7f71b88a6640 1 --2- 172.21.15.71:0/3460759985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71b40fd7f0 0x7f71b40fdc60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.841+0000 7f71b88a6640 1 --2- 172.21.15.71:0/3460759985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71b40fc520 0x7f71b40fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.841+0000 7f71b88a6640 1 -- 172.21.15.71:0/3460759985 >> 172.21.15.71:0/3460759985 conn(0x7f71b40f7ce0 msgr2=0x7f71b40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:25.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.841+0000 7f71b88a6640 1 -- 172.21.15.71:0/3460759985 shutdown_connections 2024-09-10T10:09:25.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.841+0000 7f71b88a6640 1 -- 172.21.15.71:0/3460759985 wait complete. 2024-09-10T10:09:25.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.841+0000 7f71b88a6640 1 Processor -- start 2024-09-10T10:09:25.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.841+0000 7f71b88a6640 1 -- start start 2024-09-10T10:09:25.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.842+0000 7f71b88a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71b40fc520 0x7f71b410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:25.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.842+0000 7f71b88a6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71b40fd7f0 0x7f71b410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:25.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.842+0000 7f71b88a6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b410dc10 con 0x7f71b40fd7f0 2024-09-10T10:09:25.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.842+0000 7f71b88a6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b410e430 con 0x7f71b40fc520 2024-09-10T10:09:25.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.842+0000 7f71b1d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71b40fd7f0 0x7f71b410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:25.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.842+0000 7f71b1d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71b40fd7f0 0x7f71b410d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59794/0 (socket says 172.21.15.71:59794) 2024-09-10T10:09:25.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.842+0000 7f71b1d9b640 1 -- 172.21.15.71:0/2515827615 learned_addr learned my addr 172.21.15.71:0/2515827615 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:25.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.842+0000 7f71b259c640 1 --2- 172.21.15.71:0/2515827615 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71b40fc520 0x7f71b410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:25.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.842+0000 7f71b1d9b640 1 -- 172.21.15.71:0/2515827615 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71b40fc520 msgr2=0x7f71b410d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:25.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.842+0000 7f71b1d9b640 1 --2- 172.21.15.71:0/2515827615 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71b40fc520 0x7f71b410d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:25.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.842+0000 7f71b1d9b640 1 -- 172.21.15.71:0/2515827615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c005040 con 0x7f71b40fd7f0 2024-09-10T10:09:25.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.842+0000 7f71b1d9b640 1 --2- 172.21.15.71:0/2515827615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71b40fd7f0 0x7f71b410d5c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f719c0043d0 tx=0x7f719c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:25.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.842+0000 7f71aaffd640 1 -- 172.21.15.71:0/2515827615 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f719c038070 con 0x7f71b40fd7f0 2024-09-10T10:09:25.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.843+0000 7f71aaffd640 1 -- 172.21.15.71:0/2515827615 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f719c02ae90 con 0x7f71b40fd7f0 2024-09-10T10:09:25.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.843+0000 7f71b88a6640 1 -- 172.21.15.71:0/2515827615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b410e660 con 0x7f71b40fd7f0 2024-09-10T10:09:25.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.843+0000 7f71aaffd640 1 -- 172.21.15.71:0/2515827615 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f719c03e670 con 0x7f71b40fd7f0 2024-09-10T10:09:25.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.843+0000 7f71b88a6640 1 -- 172.21.15.71:0/2515827615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b410ec00 con 0x7f71b40fd7f0 2024-09-10T10:09:25.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.844+0000 7f71b88a6640 1 -- 172.21.15.71:0/2515827615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b40fb980 con 0x7f71b40fd7f0 2024-09-10T10:09:25.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.845+0000 7f71aaffd640 1 -- 172.21.15.71:0/2515827615 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f719c030020 con 0x7f71b40fd7f0 2024-09-10T10:09:25.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.845+0000 7f71aaffd640 1 --2- 172.21.15.71:0/2515827615 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f71a006e0b0 0x7f71a0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:25.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.845+0000 7f71aaffd640 1 -- 172.21.15.71:0/2515827615 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f719c0ad600 con 0x7f71b40fd7f0 2024-09-10T10:09:25.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.845+0000 7f71b259c640 1 --2- 172.21.15.71:0/2515827615 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f71a006e0b0 0x7f71a0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:25.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.846+0000 7f71b259c640 1 --2- 172.21.15.71:0/2515827615 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f71a006e0b0 0x7f71a0070560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71a4004ed0 tx=0x7f71a400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:25.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:25.852+0000 7f71aaffd640 1 -- 172.21.15.71:0/2515827615 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f719c076a60 con 0x7f71b40fd7f0 2024-09-10T10:09:26.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.035+0000 7f71b88a6640 1 -- 172.21.15.71:0/2515827615 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f71b410ef30 con 0x7f71a006e0b0 2024-09-10T10:09:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.036+0000 7f71aaffd640 1 -- 172.21.15.71:0/2515827615 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f71b410ef30 con 0x7f71a006e0b0 2024-09-10T10:09:26.037 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:09:26.037 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:09:26.037 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:09:26.038 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:09:26.038 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:09:26.038 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-09-10T10:09:26.038 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-10T10:09:26.038 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-10T10:09:26.038 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:09:26.038 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "10/21 daemons upgraded", 2024-09-10T10:09:26.038 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T10:09:26.038 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:09:26.038 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:09:26.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.038+0000 7f71b88a6640 1 -- 172.21.15.71:0/2515827615 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f71a006e0b0 msgr2=0x7f71a0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:26.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.038+0000 7f71b88a6640 1 --2- 172.21.15.71:0/2515827615 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f71a006e0b0 0x7f71a0070560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71a4004ed0 tx=0x7f71a400b040 comp rx=0 tx=0).stop 2024-09-10T10:09:26.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.038+0000 7f71b88a6640 1 -- 172.21.15.71:0/2515827615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71b40fd7f0 msgr2=0x7f71b410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:26.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.038+0000 7f71b88a6640 1 --2- 172.21.15.71:0/2515827615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71b40fd7f0 0x7f71b410d5c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f719c0043d0 tx=0x7f719c009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.038+0000 7f71b88a6640 1 -- 172.21.15.71:0/2515827615 shutdown_connections 2024-09-10T10:09:26.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.038+0000 7f71b88a6640 1 --2- 172.21.15.71:0/2515827615 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f71a006e0b0 0x7f71a0070560 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.038+0000 7f71b88a6640 1 --2- 172.21.15.71:0/2515827615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71b40fd7f0 0x7f71b410d5c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.038+0000 7f71b88a6640 1 --2- 172.21.15.71:0/2515827615 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71b40fc520 0x7f71b410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.038+0000 7f71b88a6640 1 -- 172.21.15.71:0/2515827615 >> 172.21.15.71:0/2515827615 conn(0x7f71b40f7ce0 msgr2=0x7f71b40f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:26.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.038+0000 7f71b88a6640 1 -- 172.21.15.71:0/2515827615 shutdown_connections 2024-09-10T10:09:26.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.038+0000 7f71b88a6640 1 -- 172.21.15.71:0/2515827615 wait complete. 2024-09-10T10:09:26.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.116+0000 7f088b89f640 1 -- 172.21.15.71:0/4195333317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08840666b0 msgr2=0x7f08840ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:26.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.116+0000 7f088b89f640 1 --2- 172.21.15.71:0/4195333317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08840666b0 0x7f08840ff1c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f08800048d0 tx=0x7f0880009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.116+0000 7f088b89f640 1 -- 172.21.15.71:0/4195333317 shutdown_connections 2024-09-10T10:09:26.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.116+0000 7f088b89f640 1 --2- 172.21.15.71:0/4195333317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08840ff700 0x7f0884101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.116+0000 7f088b89f640 1 --2- 172.21.15.71:0/4195333317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08840666b0 0x7f08840ff1c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.116+0000 7f088b89f640 1 -- 172.21.15.71:0/4195333317 >> 172.21.15.71:0/4195333317 conn(0x7f08840f6c10 msgr2=0x7f08840f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:26.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.116+0000 7f088b89f640 1 -- 172.21.15.71:0/4195333317 shutdown_connections 2024-09-10T10:09:26.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.116+0000 7f088b89f640 1 -- 172.21.15.71:0/4195333317 wait complete. 2024-09-10T10:09:26.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f088b89f640 1 Processor -- start 2024-09-10T10:09:26.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f088b89f640 1 -- start start 2024-09-10T10:09:26.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f088b89f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08840666b0 0x7f088410d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:26.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f088b89f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08840ff700 0x7f088410d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:26.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f088b89f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088410dd40 con 0x7f08840666b0 2024-09-10T10:09:26.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f088b89f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088410e510 con 0x7f08840ff700 2024-09-10T10:09:26.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f088963b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08840666b0 0x7f088410d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:26.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f088963b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08840666b0 0x7f088410d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59804/0 (socket says 172.21.15.71:59804) 2024-09-10T10:09:26.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f088963b640 1 -- 172.21.15.71:0/719935797 learned_addr learned my addr 172.21.15.71:0/719935797 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:26.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f0888e3a640 1 --2- 172.21.15.71:0/719935797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08840ff700 0x7f088410d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:26.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f088963b640 1 -- 172.21.15.71:0/719935797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08840ff700 msgr2=0x7f088410d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:26.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f088963b640 1 --2- 172.21.15.71:0/719935797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08840ff700 0x7f088410d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f088963b640 1 -- 172.21.15.71:0/719935797 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0880005040 con 0x7f08840666b0 2024-09-10T10:09:26.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.117+0000 7f088963b640 1 --2- 172.21.15.71:0/719935797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08840666b0 0x7f088410d1b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0880000c00 tx=0x7f0880009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:26.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.118+0000 7f0879ffb640 1 -- 172.21.15.71:0/719935797 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0880038070 con 0x7f08840666b0 2024-09-10T10:09:26.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.118+0000 7f0879ffb640 1 -- 172.21.15.71:0/719935797 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0880009740 con 0x7f08840666b0 2024-09-10T10:09:26.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.118+0000 7f088b89f640 1 -- 172.21.15.71:0/719935797 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088410e740 con 0x7f08840666b0 2024-09-10T10:09:26.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.118+0000 7f0879ffb640 1 -- 172.21.15.71:0/719935797 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f088003db90 con 0x7f08840666b0 2024-09-10T10:09:26.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.118+0000 7f088b89f640 1 -- 172.21.15.71:0/719935797 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088410ec80 con 0x7f08840666b0 2024-09-10T10:09:26.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.119+0000 7f088b89f640 1 -- 172.21.15.71:0/719935797 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08840fa8b0 con 0x7f08840666b0 2024-09-10T10:09:26.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.119+0000 7f0879ffb640 1 -- 172.21.15.71:0/719935797 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0880030020 con 0x7f08840666b0 2024-09-10T10:09:26.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.120+0000 7f0879ffb640 1 --2- 172.21.15.71:0/719935797 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f087006e0b0 0x7f0870070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:26.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.120+0000 7f0879ffb640 1 -- 172.21.15.71:0/719935797 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f08800ae460 con 0x7f08840666b0 2024-09-10T10:09:26.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.120+0000 7f0888e3a640 1 --2- 172.21.15.71:0/719935797 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f087006e0b0 0x7f0870070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:26.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.121+0000 7f0888e3a640 1 --2- 172.21.15.71:0/719935797 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f087006e0b0 0x7f0870070560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f088410cf60 tx=0x7f087400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:26.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.124+0000 7f0879ffb640 1 -- 172.21.15.71:0/719935797 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0880077810 con 0x7f08840666b0 2024-09-10T10:09:26.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.362+0000 7f088b89f640 1 -- 172.21.15.71:0/719935797 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f088404b720 con 0x7f08840666b0 2024-09-10T10:09:26.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.362+0000 7f0879ffb640 1 -- 172.21.15.71:0/719935797 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1328 (secure 0 0 0) 0x7f088007aed0 con 0x7f08840666b0 2024-09-10T10:09:26.365 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 66/321 objects degraded (20.561%), 19 pgs degraded 2024-09-10T10:09:26.365 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-10T10:09:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: osd.3 (root=default,host=smithi107) is down 2024-09-10T10:09:26.365 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 66/321 objects degraded (20.561%), 19 pgs degraded 2024-09-10T10:09:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-10T10:09:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-10T10:09:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-10T10:09:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-10T10:09:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-10T10:09:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-10T10:09:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-10T10:09:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-10T10:09:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-10T10:09:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-10T10:09:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.11 is active+undersized+degraded, acting [4,1] 2024-09-10T10:09:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-09-10T10:09:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-10T10:09:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-10T10:09:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-10T10:09:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-10T10:09:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-10T10:09:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-10T10:09:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-10T10:09:26.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.364+0000 7f088b89f640 1 -- 172.21.15.71:0/719935797 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f087006e0b0 msgr2=0x7f0870070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:26.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.364+0000 7f088b89f640 1 --2- 172.21.15.71:0/719935797 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f087006e0b0 0x7f0870070560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f088410cf60 tx=0x7f087400b040 comp rx=0 tx=0).stop 2024-09-10T10:09:26.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.364+0000 7f088b89f640 1 -- 172.21.15.71:0/719935797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08840666b0 msgr2=0x7f088410d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:26.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.364+0000 7f088b89f640 1 --2- 172.21.15.71:0/719935797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08840666b0 0x7f088410d1b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0880000c00 tx=0x7f0880009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.364+0000 7f088b89f640 1 -- 172.21.15.71:0/719935797 shutdown_connections 2024-09-10T10:09:26.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.364+0000 7f088b89f640 1 --2- 172.21.15.71:0/719935797 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f087006e0b0 0x7f0870070560 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.364+0000 7f088b89f640 1 --2- 172.21.15.71:0/719935797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08840ff700 0x7f088410d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.364+0000 7f088b89f640 1 --2- 172.21.15.71:0/719935797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08840666b0 0x7f088410d1b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.364+0000 7f088b89f640 1 -- 172.21.15.71:0/719935797 >> 172.21.15.71:0/719935797 conn(0x7f08840f6c10 msgr2=0x7f08840f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:26.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.364+0000 7f088b89f640 1 -- 172.21.15.71:0/719935797 shutdown_connections 2024-09-10T10:09:26.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:26.364+0000 7f088b89f640 1 -- 172.21.15.71:0/719935797 wait complete. 2024-09-10T10:09:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:26 smithi071 ceph-mon[90773]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:26 smithi071 ceph-mon[90773]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:26 smithi071 ceph-mon[90773]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:26 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2271211657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:09:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:26 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/1083238951' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:09:26.602 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:26 smithi107 ceph-mon[79396]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:26.602 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:26 smithi107 ceph-mon[79396]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:26.602 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:26 smithi107 ceph-mon[79396]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:26.602 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:26 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2271211657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:09:26.602 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:26.602 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:26.602 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:26 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/1083238951' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:09:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:27 smithi071 ceph-mon[90773]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:27 smithi071 ceph-mon[90773]: pgmap v111: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-10T10:09:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:27 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/719935797' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:09:27.592 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:27 smithi107 ceph-mon[79396]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:27.592 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:27 smithi107 ceph-mon[79396]: pgmap v111: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-10T10:09:27.592 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:27.592 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:27.592 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:27 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/719935797' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:09:28.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:28 smithi071 ceph-mon[90773]: Health check update: Degraded data redundancy: 66/321 objects degraded (20.561%), 19 pgs degraded (PG_DEGRADED) 2024-09-10T10:09:28.611 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:28 smithi107 ceph-mon[79396]: Health check update: Degraded data redundancy: 66/321 objects degraded (20.561%), 19 pgs degraded (PG_DEGRADED) 2024-09-10T10:09:29.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:29 smithi107 ceph-mon[79396]: pgmap v112: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-10T10:09:29.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:29 smithi071 ceph-mon[90773]: pgmap v112: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-10T10:09:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:09:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:09:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:09:30.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:09:30.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:09:30.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:09:30.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T10:09:30.596 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:30.597 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:30.597 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:09:30.597 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:09:30.597 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:30.597 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:09:30.597 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:09:30.597 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:09:30.597 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:09:30.597 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T10:09:30.895 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:30 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[88740]: 2024-09-10T10:09:30.594+0000 7f5d63b35640 -1 osd.3 63 log_to_monitors true 2024-09-10T10:09:31.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:31 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T10:09:31.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:31 smithi107 ceph-mon[79396]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-10T10:09:31.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:31 smithi107 ceph-mon[79396]: pgmap v113: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-10T10:09:31.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:31 smithi107 ceph-mon[79396]: from='osd.3 [v2:172.21.15.107:6800/2183123841,v1:172.21.15.107:6801/2183123841]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T10:09:31.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:31 smithi107 ceph-mon[79396]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T10:09:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:31 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T10:09:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:31 smithi071 ceph-mon[90773]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-10T10:09:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:31 smithi071 ceph-mon[90773]: pgmap v113: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-10T10:09:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:31 smithi071 ceph-mon[90773]: from='osd.3 [v2:172.21.15.107:6800/2183123841,v1:172.21.15.107:6801/2183123841]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T10:09:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:31 smithi071 ceph-mon[90773]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T10:09:32.395 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:09:32 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[88740]: 2024-09-10T10:09:32.130+0000 7f5d578c7640 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:09:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:32 smithi107 ceph-mon[79396]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T10:09:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:32 smithi107 ceph-mon[79396]: from='osd.3 [v2:172.21.15.107:6800/2183123841,v1:172.21.15.107:6801/2183123841]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:09:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:32 smithi107 ceph-mon[79396]: osdmap e66: 6 total, 5 up, 6 in 2024-09-10T10:09:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:32 smithi107 ceph-mon[79396]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:09:32.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:32 smithi107 ceph-mon[79396]: from='osd.3 ' entity='osd.3' 2024-09-10T10:09:32.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:32 smithi071 ceph-mon[90773]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T10:09:32.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:32 smithi071 ceph-mon[90773]: from='osd.3 [v2:172.21.15.107:6800/2183123841,v1:172.21.15.107:6801/2183123841]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:09:32.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:32 smithi071 ceph-mon[90773]: osdmap e66: 6 total, 5 up, 6 in 2024-09-10T10:09:32.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:32 smithi071 ceph-mon[90773]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:09:32.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:32 smithi071 ceph-mon[90773]: from='osd.3 ' entity='osd.3' 2024-09-10T10:09:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:33 smithi107 ceph-mon[79396]: pgmap v115: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 66/321 objects degraded (20.561%) 2024-09-10T10:09:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:33 smithi107 ceph-mon[79396]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T10:09:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:33 smithi107 ceph-mon[79396]: osd.3 [v2:172.21.15.107:6800/2183123841,v1:172.21.15.107:6801/2183123841] boot 2024-09-10T10:09:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:33 smithi107 ceph-mon[79396]: osdmap e67: 6 total, 6 up, 6 in 2024-09-10T10:09:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:33 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:09:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:33 smithi071 ceph-mon[90773]: pgmap v115: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 66/321 objects degraded (20.561%) 2024-09-10T10:09:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:33 smithi071 ceph-mon[90773]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T10:09:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:33 smithi071 ceph-mon[90773]: osd.3 [v2:172.21.15.107:6800/2183123841,v1:172.21.15.107:6801/2183123841] boot 2024-09-10T10:09:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:33 smithi071 ceph-mon[90773]: osdmap e67: 6 total, 6 up, 6 in 2024-09-10T10:09:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:33 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:09:35.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:35 smithi107 ceph-mon[79396]: osdmap e68: 6 total, 6 up, 6 in 2024-09-10T10:09:35.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:35 smithi107 ceph-mon[79396]: pgmap v118: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 66/321 objects degraded (20.561%) 2024-09-10T10:09:35.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:35 smithi071 ceph-mon[90773]: osdmap e68: 6 total, 6 up, 6 in 2024-09-10T10:09:35.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:35 smithi071 ceph-mon[90773]: pgmap v118: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 66/321 objects degraded (20.561%) 2024-09-10T10:09:36.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:36 smithi071 ceph-mon[90773]: Health check update: Degraded data redundancy: 52/321 objects degraded (16.199%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T10:09:36.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:36 smithi107 ceph-mon[79396]: Health check update: Degraded data redundancy: 52/321 objects degraded (16.199%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T10:09:37.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:37 smithi071 ceph-mon[90773]: pgmap v119: 65 pgs: 9 active+undersized, 14 active+undersized+degraded, 42 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 3 op/s; 52/321 objects degraded (16.199%) 2024-09-10T10:09:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:37 smithi107 ceph-mon[79396]: pgmap v119: 65 pgs: 9 active+undersized, 14 active+undersized+degraded, 42 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 3 op/s; 52/321 objects degraded (16.199%) 2024-09-10T10:09:38.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:38 smithi107 ceph-mon[79396]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 52/321 objects degraded (16.199%), 14 pgs degraded) 2024-09-10T10:09:38.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:38 smithi107 ceph-mon[79396]: Cluster is now healthy 2024-09-10T10:09:38.659 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:38 smithi071 ceph-mon[90773]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 52/321 objects degraded (16.199%), 14 pgs degraded) 2024-09-10T10:09:38.659 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:38 smithi071 ceph-mon[90773]: Cluster is now healthy 2024-09-10T10:09:39.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:39 smithi107 ceph-mon[79396]: pgmap v120: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T10:09:39.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:39.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:09:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:39 smithi071 ceph-mon[90773]: pgmap v120: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T10:09:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:09:41.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:41 smithi107 ceph-mon[79396]: pgmap v121: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-10T10:09:41.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:41 smithi071 ceph-mon[90773]: pgmap v121: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-10T10:09:43.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:43 smithi107 ceph-mon[79396]: pgmap v122: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:09:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:43 smithi071 ceph-mon[90773]: pgmap v122: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:09:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:45 smithi071 ceph-mon[90773]: pgmap v123: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-10T10:09:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T10:09:45.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:45 smithi107 ceph-mon[79396]: pgmap v123: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-10T10:09:45.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:45.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T10:09:46.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:46 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T10:09:46.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:46 smithi071 ceph-mon[90773]: Upgrade: osd.4 is safe to restart 2024-09-10T10:09:46.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:46 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:46.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:46 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T10:09:46.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:46 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:09:46.550 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:46 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T10:09:46.550 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:46 smithi107 ceph-mon[79396]: Upgrade: osd.4 is safe to restart 2024-09-10T10:09:46.550 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:46 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:46.550 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:46 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T10:09:46.550 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:46 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:09:47.503 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:47 smithi107 ceph-mon[79396]: Upgrade: Updating osd.4 2024-09-10T10:09:47.503 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:47 smithi107 ceph-mon[79396]: Deploying daemon osd.4 on smithi107 2024-09-10T10:09:47.503 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:47 smithi107 ceph-mon[79396]: pgmap v124: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-10T10:09:47.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:47 smithi071 ceph-mon[90773]: Upgrade: Updating osd.4 2024-09-10T10:09:47.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:47 smithi071 ceph-mon[90773]: Deploying daemon osd.4 on smithi107 2024-09-10T10:09:47.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:47 smithi071 ceph-mon[90773]: pgmap v124: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-10T10:09:48.939 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:48 smithi107 systemd[1]: Stopping Ceph osd.4 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:09:49.233 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:48 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[46171]: 2024-09-10T10:09:48.964+0000 7fe5a4f8e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:09:49.233 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:48 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[46171]: 2024-09-10T10:09:48.964+0000 7fe5a4f8e640 -1 osd.4 68 *** Got signal Terminated *** 2024-09-10T10:09:49.233 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:48 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[46171]: 2024-09-10T10:09:48.964+0000 7fe5a4f8e640 -1 osd.4 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:09:49.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:49 smithi071 ceph-mon[90773]: pgmap v125: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:09:49.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:49 smithi071 ceph-mon[90773]: osd.4 marked itself down and dead 2024-09-10T10:09:49.636 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:49 smithi107 ceph-mon[79396]: pgmap v125: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:09:49.636 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:49 smithi107 ceph-mon[79396]: osd.4 marked itself down and dead 2024-09-10T10:09:49.895 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:49 smithi107 podman[93130]: 2024-09-10 10:09:49.635848468 +0000 UTC m=+0.802616588 container died b26d5a16099efec741ac9bee49c7abafe927481ac131a01a94e7d6aef63188b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-96d63e7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T10:09:50.241 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:50 smithi107 podman[93130]: 2024-09-10 10:09:50.047742208 +0000 UTC m=+1.214510314 container cleanup b26d5a16099efec741ac9bee49c7abafe927481ac131a01a94e7d6aef63188b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=quincy-96d63e7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T10:09:50.241 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:50 smithi107 bash[93130]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4 2024-09-10T10:09:50.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:50 smithi071 ceph-mon[90773]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T10:09:50.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:50 smithi071 ceph-mon[90773]: osdmap e69: 6 total, 5 up, 6 in 2024-09-10T10:09:50.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:50 smithi071 ceph-mon[90773]: osdmap e70: 6 total, 5 up, 6 in 2024-09-10T10:09:50.600 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:50 smithi107 ceph-mon[79396]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T10:09:50.600 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:50 smithi107 ceph-mon[79396]: osdmap e69: 6 total, 5 up, 6 in 2024-09-10T10:09:50.601 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:50 smithi107 ceph-mon[79396]: osdmap e70: 6 total, 5 up, 6 in 2024-09-10T10:09:50.601 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:50 smithi107 podman[93155]: 2024-09-10 10:09:50.282941283 +0000 UTC m=+0.644192957 container remove b26d5a16099efec741ac9bee49c7abafe927481ac131a01a94e7d6aef63188b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=quincy-96d63e7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:09:50.870 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:50 smithi107 podman[93242]: 2024-09-10 10:09:50.502514713 +0000 UTC m=+0.016009325 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:09:50.870 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:50 smithi107 podman[93242]: 2024-09-10 10:09:50.617077154 +0000 UTC m=+0.130571755 container create 53d41466f0728877df768b32eb82b6321a8cb41bd31035d572e55fc700ce8220 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T10:09:50.870 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:50 smithi107 podman[93242]: 2024-09-10 10:09:50.869969469 +0000 UTC m=+0.383464072 container init 53d41466f0728877df768b32eb82b6321a8cb41bd31035d572e55fc700ce8220 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T10:09:51.145 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:50 smithi107 podman[93242]: 2024-09-10 10:09:50.873193488 +0000 UTC m=+0.386688087 container start 53d41466f0728877df768b32eb82b6321a8cb41bd31035d572e55fc700ce8220 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:09:51.146 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:50 smithi107 podman[93242]: 2024-09-10 10:09:50.96145852 +0000 UTC m=+0.474953128 container attach 53d41466f0728877df768b32eb82b6321a8cb41bd31035d572e55fc700ce8220 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T10:09:51.146 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:51 smithi107 podman[93242]: 2024-09-10 10:09:51.066997145 +0000 UTC m=+0.580491754 container died 53d41466f0728877df768b32eb82b6321a8cb41bd31035d572e55fc700ce8220 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:09:51.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:51 smithi071 ceph-mon[90773]: pgmap v127: 65 pgs: 5 peering, 5 stale+active+clean, 55 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-09-10T10:09:51.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:51 smithi071 ceph-mon[90773]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-10T10:09:51.620 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:51 smithi107 ceph-mon[79396]: pgmap v127: 65 pgs: 5 peering, 5 stale+active+clean, 55 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-09-10T10:09:51.620 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:51 smithi107 ceph-mon[79396]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-10T10:09:51.896 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:51 smithi107 podman[93265]: 2024-09-10 10:09:51.714968533 +0000 UTC m=+0.638198058 container remove 53d41466f0728877df768b32eb82b6321a8cb41bd31035d572e55fc700ce8220 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T10:09:51.896 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:51 smithi107 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-10T10:09:51.896 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:51 smithi107 systemd[1]: Stopped Ceph osd.4 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:09:51.896 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:51 smithi107 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.4.service: Consumed 1min 519ms CPU time. 2024-09-10T10:09:52.261 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:51 smithi107 systemd[1]: Starting Ceph osd.4 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:09:52.261 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:52 smithi107 podman[93364]: 2024-09-10 10:09:52.132453288 +0000 UTC m=+0.093410391 container create 3579f846778782c855147255126d12408c3de8d145246d1fe5027798f5cab536 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T10:09:52.262 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:52 smithi107 podman[93364]: 2024-09-10 10:09:52.05477215 +0000 UTC m=+0.015729260 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:09:52.517 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:52 smithi107 ceph-mon[79396]: Health check failed: Degraded data redundancy: 47/321 objects degraded (14.642%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T10:09:52.517 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:52 smithi107 podman[93364]: 2024-09-10 10:09:52.385712783 +0000 UTC m=+0.346669896 container init 3579f846778782c855147255126d12408c3de8d145246d1fe5027798f5cab536 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T10:09:52.518 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:52 smithi107 podman[93364]: 2024-09-10 10:09:52.389728042 +0000 UTC m=+0.350685155 container start 3579f846778782c855147255126d12408c3de8d145246d1fe5027798f5cab536 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:09:52.518 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:52 smithi107 podman[93364]: 2024-09-10 10:09:52.468595878 +0000 UTC m=+0.429552992 container attach 3579f846778782c855147255126d12408c3de8d145246d1fe5027798f5cab536 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T10:09:52.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:52 smithi071 ceph-mon[90773]: Health check failed: Degraded data redundancy: 47/321 objects degraded (14.642%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T10:09:52.895 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:52 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate[93380]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:09:52.895 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:52 smithi107 bash[93364]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:09:52.895 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:52 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate[93380]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:09:52.896 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:52 smithi107 bash[93364]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:09:53.536 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:53 smithi107 ceph-mon[79396]: pgmap v129: 65 pgs: 15 active+undersized, 5 peering, 14 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 47/321 objects degraded (14.642%) 2024-09-10T10:09:53.536 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate[93380]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T10:09:53.536 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 bash[93364]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T10:09:53.536 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate[93380]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-10T10:09:53.536 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 bash[93364]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-10T10:09:53.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:53 smithi071 ceph-mon[90773]: pgmap v129: 65 pgs: 15 active+undersized, 5 peering, 14 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 47/321 objects degraded (14.642%) 2024-09-10T10:09:53.856 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate[93380]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-10T10:09:53.856 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 bash[93364]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-10T10:09:53.856 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate[93380]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-10T10:09:53.856 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 bash[93364]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-10T10:09:53.856 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate[93380]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-10T10:09:53.856 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 bash[93364]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-10T10:09:53.856 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate[93380]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T10:09:53.857 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 bash[93364]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T10:09:53.857 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate[93380]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-10T10:09:53.857 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 bash[93364]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-10T10:09:53.857 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:53 smithi107 podman[93364]: 2024-09-10 10:09:53.563870115 +0000 UTC m=+1.524827228 container died 3579f846778782c855147255126d12408c3de8d145246d1fe5027798f5cab536 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:09:54.145 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:54 smithi107 podman[93509]: 2024-09-10 10:09:54.096896057 +0000 UTC m=+0.522078510 container remove 3579f846778782c855147255126d12408c3de8d145246d1fe5027798f5cab536 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:09:54.567 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:54 smithi107 podman[93569]: 2024-09-10 10:09:54.289526754 +0000 UTC m=+0.101438636 container create e92f23ad2c773e0afc75a67e0813420bffacc244b43a5f0ae009cbe410bc989c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T10:09:54.567 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:54 smithi107 podman[93569]: 2024-09-10 10:09:54.203476313 +0000 UTC m=+0.015388195 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:09:54.567 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:54 smithi107 podman[93569]: 2024-09-10 10:09:54.566744676 +0000 UTC m=+0.378656565 container init e92f23ad2c773e0afc75a67e0813420bffacc244b43a5f0ae009cbe410bc989c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T10:09:54.895 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:54 smithi107 podman[93569]: 2024-09-10 10:09:54.56986822 +0000 UTC m=+0.381780101 container start e92f23ad2c773e0afc75a67e0813420bffacc244b43a5f0ae009cbe410bc989c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T10:09:54.895 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:54 smithi107 ceph-osd[93588]: -- 172.21.15.107:0/969972422 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556ee3c921e0 con 0x556ee3c7c000 2024-09-10T10:09:54.895 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:54 smithi107 bash[93569]: e92f23ad2c773e0afc75a67e0813420bffacc244b43a5f0ae009cbe410bc989c 2024-09-10T10:09:54.896 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:54 smithi107 systemd[1]: Started Ceph osd.4 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:09:55.447 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:55 smithi107 ceph-mon[79396]: pgmap v130: 65 pgs: 15 active+undersized, 5 peering, 14 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47/321 objects degraded (14.642%) 2024-09-10T10:09:55.447 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:55.447 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:09:55.447 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:55.447 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:55.447 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:09:55.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:55 smithi071 ceph-mon[90773]: pgmap v130: 65 pgs: 15 active+undersized, 5 peering, 14 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 47/321 objects degraded (14.642%) 2024-09-10T10:09:55.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:55.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:09:55.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:55.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:55.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:09:56.257 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:56 smithi107 ceph-mon[79396]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-10T10:09:56.257 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:09:56 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:09:56.222+0000 7fe65cbb6640 -1 Falling back to public interface 2024-09-10T10:09:56.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.454+0000 7fb0d1542640 1 -- 172.21.15.71:0/3204593063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0cc065bc0 msgr2=0x7fb0cc0ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:56.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.454+0000 7fb0d1542640 1 --2- 172.21.15.71:0/3204593063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0cc065bc0 0x7fb0cc0ff1c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0048d0 tx=0x7fb0bc009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.454+0000 7fb0d1542640 1 -- 172.21.15.71:0/3204593063 shutdown_connections 2024-09-10T10:09:56.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.454+0000 7fb0d1542640 1 --2- 172.21.15.71:0/3204593063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0cc0ff700 0x7fb0cc101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.454+0000 7fb0d1542640 1 --2- 172.21.15.71:0/3204593063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0cc065bc0 0x7fb0cc0ff1c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.454+0000 7fb0d1542640 1 -- 172.21.15.71:0/3204593063 >> 172.21.15.71:0/3204593063 conn(0x7fb0cc0f6c10 msgr2=0x7fb0cc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:56.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.454+0000 7fb0d1542640 1 -- 172.21.15.71:0/3204593063 shutdown_connections 2024-09-10T10:09:56.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.454+0000 7fb0d1542640 1 -- 172.21.15.71:0/3204593063 wait complete. 2024-09-10T10:09:56.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.455+0000 7fb0d1542640 1 Processor -- start 2024-09-10T10:09:56.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.455+0000 7fb0d1542640 1 -- start start 2024-09-10T10:09:56.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.455+0000 7fb0d1542640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0cc065bc0 0x7fb0cc10f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:56.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.455+0000 7fb0d1542640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0cc0ff700 0x7fb0cc10f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:56.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.455+0000 7fb0d1542640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc10fec0 con 0x7fb0cc065bc0 2024-09-10T10:09:56.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0d1542640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc110690 con 0x7fb0cc0ff700 2024-09-10T10:09:56.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0caffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0cc065bc0 0x7fb0cc10f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:56.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0caffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0cc065bc0 0x7fb0cc10f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43626/0 (socket says 172.21.15.71:43626) 2024-09-10T10:09:56.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0caffd640 1 -- 172.21.15.71:0/1824635520 learned_addr learned my addr 172.21.15.71:0/1824635520 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:56.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0ca7fc640 1 --2- 172.21.15.71:0/1824635520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0cc0ff700 0x7fb0cc10f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:56.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0caffd640 1 -- 172.21.15.71:0/1824635520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0cc0ff700 msgr2=0x7fb0cc10f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:56.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0caffd640 1 --2- 172.21.15.71:0/1824635520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0cc0ff700 0x7fb0cc10f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0caffd640 1 -- 172.21.15.71:0/1824635520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc005040 con 0x7fb0cc065bc0 2024-09-10T10:09:56.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0caffd640 1 --2- 172.21.15.71:0/1824635520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0cc065bc0 0x7fb0cc10f330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0043d0 tx=0x7fb0bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:56.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0b37fe640 1 -- 172.21.15.71:0/1824635520 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0bc038070 con 0x7fb0cc065bc0 2024-09-10T10:09:56.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0b37fe640 1 -- 172.21.15.71:0/1824635520 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb0bc02ae90 con 0x7fb0cc065bc0 2024-09-10T10:09:56.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0b37fe640 1 -- 172.21.15.71:0/1824635520 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0bc03e670 con 0x7fb0cc065bc0 2024-09-10T10:09:56.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0d1542640 1 -- 172.21.15.71:0/1824635520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0cc1108c0 con 0x7fb0cc065bc0 2024-09-10T10:09:56.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.456+0000 7fb0d1542640 1 -- 172.21.15.71:0/1824635520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0cc110de0 con 0x7fb0cc065bc0 2024-09-10T10:09:56.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.457+0000 7fb0d1542640 1 -- 172.21.15.71:0/1824635520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0cc0fa890 con 0x7fb0cc065bc0 2024-09-10T10:09:56.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.458+0000 7fb0b37fe640 1 -- 172.21.15.71:0/1824635520 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb0bc030020 con 0x7fb0cc065bc0 2024-09-10T10:09:56.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.458+0000 7fb0b37fe640 1 --2- 172.21.15.71:0/1824635520 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb0b406e0b0 0x7fb0b4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:56.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.459+0000 7fb0b37fe640 1 -- 172.21.15.71:0/1824635520 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb0bc0adc60 con 0x7fb0cc065bc0 2024-09-10T10:09:56.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.459+0000 7fb0ca7fc640 1 --2- 172.21.15.71:0/1824635520 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb0b406e0b0 0x7fb0b4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:56.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.459+0000 7fb0ca7fc640 1 --2- 172.21.15.71:0/1824635520 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb0b406e0b0 0x7fb0b4070560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc10f0e0 tx=0x7fb0c000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:56.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.463+0000 7fb0b37fe640 1 -- 172.21.15.71:0/1824635520 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb0bc0770c0 con 0x7fb0cc065bc0 2024-09-10T10:09:56.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:56 smithi071 ceph-mon[90773]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-10T10:09:56.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.648+0000 7fb0d1542640 1 -- 172.21.15.71:0/1824635520 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0cc105080 con 0x7fb0b406e0b0 2024-09-10T10:09:56.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.649+0000 7fb0b37fe640 1 -- 172.21.15.71:0/1824635520 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb0cc105080 con 0x7fb0b406e0b0 2024-09-10T10:09:56.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.652+0000 7fb0d1542640 1 -- 172.21.15.71:0/1824635520 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb0b406e0b0 msgr2=0x7fb0b4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:56.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.652+0000 7fb0d1542640 1 --2- 172.21.15.71:0/1824635520 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb0b406e0b0 0x7fb0b4070560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc10f0e0 tx=0x7fb0c000b040 comp rx=0 tx=0).stop 2024-09-10T10:09:56.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.652+0000 7fb0d1542640 1 -- 172.21.15.71:0/1824635520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0cc065bc0 msgr2=0x7fb0cc10f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:56.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.652+0000 7fb0d1542640 1 --2- 172.21.15.71:0/1824635520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0cc065bc0 0x7fb0cc10f330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0043d0 tx=0x7fb0bc009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.652+0000 7fb0d1542640 1 -- 172.21.15.71:0/1824635520 shutdown_connections 2024-09-10T10:09:56.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.652+0000 7fb0d1542640 1 --2- 172.21.15.71:0/1824635520 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb0b406e0b0 0x7fb0b4070560 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.652+0000 7fb0d1542640 1 --2- 172.21.15.71:0/1824635520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0cc0ff700 0x7fb0cc10f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.652+0000 7fb0d1542640 1 --2- 172.21.15.71:0/1824635520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0cc065bc0 0x7fb0cc10f330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.652+0000 7fb0d1542640 1 -- 172.21.15.71:0/1824635520 >> 172.21.15.71:0/1824635520 conn(0x7fb0cc0f6c10 msgr2=0x7fb0cc0fb380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:56.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.652+0000 7fb0d1542640 1 -- 172.21.15.71:0/1824635520 shutdown_connections 2024-09-10T10:09:56.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.652+0000 7fb0d1542640 1 -- 172.21.15.71:0/1824635520 wait complete. 2024-09-10T10:09:56.662 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:09:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.731+0000 7fac22961640 1 -- 172.21.15.71:0/2473810509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c0fc700 msgr2=0x7fac1c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.731+0000 7fac22961640 1 --2- 172.21.15.71:0/2473810509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c0fc700 0x7fac1c0fcb70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fac040048d0 tx=0x7fac04009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.731+0000 7fac22961640 1 -- 172.21.15.71:0/2473810509 shutdown_connections 2024-09-10T10:09:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.731+0000 7fac22961640 1 --2- 172.21.15.71:0/2473810509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c0fc700 0x7fac1c0fcb70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.731+0000 7fac22961640 1 --2- 172.21.15.71:0/2473810509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac1c0fb430 0x7fac1c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.731+0000 7fac22961640 1 -- 172.21.15.71:0/2473810509 >> 172.21.15.71:0/2473810509 conn(0x7fac1c0f6c10 msgr2=0x7fac1c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:56.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.731+0000 7fac22961640 1 -- 172.21.15.71:0/2473810509 shutdown_connections 2024-09-10T10:09:56.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.731+0000 7fac22961640 1 -- 172.21.15.71:0/2473810509 wait complete. 2024-09-10T10:09:56.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.731+0000 7fac22961640 1 Processor -- start 2024-09-10T10:09:56.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.731+0000 7fac22961640 1 -- start start 2024-09-10T10:09:56.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac22961640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c0fb430 0x7fac1c10bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:56.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac22961640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac1c0fc700 0x7fac1c10c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:56.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac22961640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c10cad0 con 0x7fac1c0fb430 2024-09-10T10:09:56.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac22961640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c10d2f0 con 0x7fac1c0fc700 2024-09-10T10:09:56.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac1bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c0fb430 0x7fac1c10bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:56.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac1bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c0fb430 0x7fac1c10bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43642/0 (socket says 172.21.15.71:43642) 2024-09-10T10:09:56.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac1bfff640 1 -- 172.21.15.71:0/3034752792 learned_addr learned my addr 172.21.15.71:0/3034752792 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:56.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac1b7fe640 1 --2- 172.21.15.71:0/3034752792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac1c0fc700 0x7fac1c10c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:56.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac1bfff640 1 -- 172.21.15.71:0/3034752792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac1c0fc700 msgr2=0x7fac1c10c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:56.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac1bfff640 1 --2- 172.21.15.71:0/3034752792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac1c0fc700 0x7fac1c10c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac1bfff640 1 -- 172.21.15.71:0/3034752792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac04005040 con 0x7fac1c0fb430 2024-09-10T10:09:56.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac1b7fe640 1 --2- 172.21.15.71:0/3034752792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac1c0fc700 0x7fac1c10c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:09:56.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac1bfff640 1 --2- 172.21.15.71:0/3034752792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c0fb430 0x7fac1c10bf40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00c830 tx=0x7fac0c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:56.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac18ff9640 1 -- 172.21.15.71:0/3034752792 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac0c00a850 con 0x7fac1c0fb430 2024-09-10T10:09:56.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac18ff9640 1 -- 172.21.15.71:0/3034752792 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fac0c00ae50 con 0x7fac1c0fb430 2024-09-10T10:09:56.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac22961640 1 -- 172.21.15.71:0/3034752792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1c10d580 con 0x7fac1c0fb430 2024-09-10T10:09:56.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac18ff9640 1 -- 172.21.15.71:0/3034752792 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac0c0113a0 con 0x7fac1c0fb430 2024-09-10T10:09:56.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.732+0000 7fac22961640 1 -- 172.21.15.71:0/3034752792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1c10db20 con 0x7fac1c0fb430 2024-09-10T10:09:56.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.733+0000 7fac22961640 1 -- 172.21.15.71:0/3034752792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1c0fa890 con 0x7fac1c0fb430 2024-09-10T10:09:56.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.734+0000 7fac18ff9640 1 -- 172.21.15.71:0/3034752792 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fac0c012400 con 0x7fac1c0fb430 2024-09-10T10:09:56.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.734+0000 7fac18ff9640 1 --2- 172.21.15.71:0/3034752792 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fac0806e0b0 0x7fac08070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:56.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.735+0000 7fac18ff9640 1 -- 172.21.15.71:0/3034752792 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fac0c08ddf0 con 0x7fac1c0fb430 2024-09-10T10:09:56.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.735+0000 7fac1b7fe640 1 --2- 172.21.15.71:0/3034752792 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fac0806e0b0 0x7fac08070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:56.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.735+0000 7fac1b7fe640 1 --2- 172.21.15.71:0/3034752792 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fac0806e0b0 0x7fac08070560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fac04007ac0 tx=0x7fac04035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:56.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.739+0000 7fac18ff9640 1 -- 172.21.15.71:0/3034752792 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fac0c0571a0 con 0x7fac1c0fb430 2024-09-10T10:09:56.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.922+0000 7fac22961640 1 -- 172.21.15.71:0/3034752792 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac1c10de10 con 0x7fac0806e0b0 2024-09-10T10:09:56.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.923+0000 7fac18ff9640 1 -- 172.21.15.71:0/3034752792 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fac1c10de10 con 0x7fac0806e0b0 2024-09-10T10:09:56.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.925+0000 7fac22961640 1 -- 172.21.15.71:0/3034752792 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fac0806e0b0 msgr2=0x7fac08070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:56.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.925+0000 7fac22961640 1 --2- 172.21.15.71:0/3034752792 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fac0806e0b0 0x7fac08070560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fac04007ac0 tx=0x7fac04035040 comp rx=0 tx=0).stop 2024-09-10T10:09:56.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.925+0000 7fac22961640 1 -- 172.21.15.71:0/3034752792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c0fb430 msgr2=0x7fac1c10bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:56.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.925+0000 7fac22961640 1 --2- 172.21.15.71:0/3034752792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c0fb430 0x7fac1c10bf40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00c830 tx=0x7fac0c004430 comp rx=0 tx=0).stop 2024-09-10T10:09:56.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.925+0000 7fac22961640 1 -- 172.21.15.71:0/3034752792 shutdown_connections 2024-09-10T10:09:56.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.925+0000 7fac22961640 1 --2- 172.21.15.71:0/3034752792 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fac0806e0b0 0x7fac08070560 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.925+0000 7fac22961640 1 --2- 172.21.15.71:0/3034752792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac1c0fc700 0x7fac1c10c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.925+0000 7fac22961640 1 --2- 172.21.15.71:0/3034752792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac1c0fb430 0x7fac1c10bf40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:56.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.925+0000 7fac22961640 1 -- 172.21.15.71:0/3034752792 >> 172.21.15.71:0/3034752792 conn(0x7fac1c0f6c10 msgr2=0x7fac1c0f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:56.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.925+0000 7fac22961640 1 -- 172.21.15.71:0/3034752792 shutdown_connections 2024-09-10T10:09:56.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:56.925+0000 7fac22961640 1 -- 172.21.15.71:0/3034752792 wait complete. 2024-09-10T10:09:57.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.004+0000 7ff489951640 1 -- 172.21.15.71:0/3187973419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4840fd840 msgr2=0x7ff4840fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.004+0000 7ff489951640 1 --2- 172.21.15.71:0/3187973419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4840fd840 0x7ff4840fdcb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0048d0 tx=0x7ff46c009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.004+0000 7ff489951640 1 -- 172.21.15.71:0/3187973419 shutdown_connections 2024-09-10T10:09:57.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.004+0000 7ff489951640 1 --2- 172.21.15.71:0/3187973419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4840fd840 0x7ff4840fdcb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.004+0000 7ff489951640 1 --2- 172.21.15.71:0/3187973419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4840fc570 0x7ff4840fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.004+0000 7ff489951640 1 -- 172.21.15.71:0/3187973419 >> 172.21.15.71:0/3187973419 conn(0x7ff4840f7d10 msgr2=0x7ff4840fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:57.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.004+0000 7ff489951640 1 -- 172.21.15.71:0/3187973419 shutdown_connections 2024-09-10T10:09:57.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.004+0000 7ff489951640 1 -- 172.21.15.71:0/3187973419 wait complete. 2024-09-10T10:09:57.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.004+0000 7ff489951640 1 Processor -- start 2024-09-10T10:09:57.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.004+0000 7ff489951640 1 -- start start 2024-09-10T10:09:57.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff489951640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4840fc570 0x7ff48410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff489951640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4840fd840 0x7ff48410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff489951640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48410dc10 con 0x7ff4840fd840 2024-09-10T10:09:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff489951640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48410e430 con 0x7ff4840fc570 2024-09-10T10:09:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff4827fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4840fd840 0x7ff48410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff4827fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4840fd840 0x7ff48410d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43660/0 (socket says 172.21.15.71:43660) 2024-09-10T10:09:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff4827fc640 1 -- 172.21.15.71:0/313276414 learned_addr learned my addr 172.21.15.71:0/313276414 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff482ffd640 1 --2- 172.21.15.71:0/313276414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4840fc570 0x7ff48410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff4827fc640 1 -- 172.21.15.71:0/313276414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4840fc570 msgr2=0x7ff48410d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff4827fc640 1 --2- 172.21.15.71:0/313276414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4840fc570 0x7ff48410d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff4827fc640 1 -- 172.21.15.71:0/313276414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c005040 con 0x7ff4840fd840 2024-09-10T10:09:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff4827fc640 1 --2- 172.21.15.71:0/313276414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4840fd840 0x7ff48410d5c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0048a0 tx=0x7ff46c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff47b7fe640 1 -- 172.21.15.71:0/313276414 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff46c038070 con 0x7ff4840fd840 2024-09-10T10:09:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff489951640 1 -- 172.21.15.71:0/313276414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48410e660 con 0x7ff4840fd840 2024-09-10T10:09:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff47b7fe640 1 -- 172.21.15.71:0/313276414 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff46c004290 con 0x7ff4840fd840 2024-09-10T10:09:57.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff47b7fe640 1 -- 172.21.15.71:0/313276414 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff46c033660 con 0x7ff4840fd840 2024-09-10T10:09:57.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.005+0000 7ff489951640 1 -- 172.21.15.71:0/313276414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48410ec00 con 0x7ff4840fd840 2024-09-10T10:09:57.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.007+0000 7ff489951640 1 -- 172.21.15.71:0/313276414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4840fb9d0 con 0x7ff4840fd840 2024-09-10T10:09:57.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.007+0000 7ff47b7fe640 1 -- 172.21.15.71:0/313276414 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff46c030020 con 0x7ff4840fd840 2024-09-10T10:09:57.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.007+0000 7ff47b7fe640 1 --2- 172.21.15.71:0/313276414 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff47006e0b0 0x7ff470070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.007+0000 7ff47b7fe640 1 -- 172.21.15.71:0/313276414 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff46c0adcd0 con 0x7ff4840fd840 2024-09-10T10:09:57.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.007+0000 7ff482ffd640 1 --2- 172.21.15.71:0/313276414 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff47006e0b0 0x7ff470070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.008+0000 7ff482ffd640 1 --2- 172.21.15.71:0/313276414 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff47006e0b0 0x7ff470070560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff474009af0 tx=0x7ff47400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:57.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.012+0000 7ff47b7fe640 1 -- 172.21.15.71:0/313276414 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff46c0770b0 con 0x7ff4840fd840 2024-09-10T10:09:57.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.185+0000 7ff489951640 1 -- 172.21.15.71:0/313276414 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff48410eec0 con 0x7ff47006e0b0 2024-09-10T10:09:57.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.194+0000 7ff47b7fe640 1 -- 172.21.15.71:0/313276414 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff48410eec0 con 0x7ff47006e0b0 2024-09-10T10:09:57.195 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:09:57.195 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (5m) 64s ago 13m 26.4M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:09:57.195 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (2m) 64s ago 13m 6903k - 19.1.1-305-g1cf819b7 41d671128357 5dc74ad01560 2024-09-10T10:09:57.195 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (2m) 31s ago 13m 6891k - 19.1.1-305-g1cf819b7 41d671128357 6f4355e875db 2024-09-10T10:09:57.195 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (5m) 64s ago 13m 78.2M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (8m) 64s ago 8m 113M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (8m) 64s ago 8m 65.2M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (8m) 31s ago 8m 108M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (8m) 31s ago 8m 62.7M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (4m) 64s ago 15m 498M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (3m) 31s ago 12m 440M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (3m) 64s ago 15m 47.2M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (3m) 31s ago 12m 39.0M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (5m) 64s ago 13m 16.2M - 1.5.0 0da6a335fe13 c3d47d79cd22 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (4m) 31s ago 12m 17.0M - 1.5.0 0da6a335fe13 9a25165a0fd1 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (2m) 64s ago 11m 95.6M 1557M 19.1.1-305-g1cf819b7 41d671128357 f1e9da1144c1 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (104s) 64s ago 11m 98.8M 1557M 19.1.1-305-g1cf819b7 41d671128357 5afc8bef5343 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (69s) 64s ago 11m 12.1M 1557M 19.1.1-305-g1cf819b7 41d671128357 5e5976fcfaa8 2024-09-10T10:09:57.196 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (34s) 31s ago 10m 11.1M 2581M 19.1.1-305-g1cf819b7 41d671128357 e22ee626ccd0 2024-09-10T10:09:57.197 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 starting - - - 2581M 2024-09-10T10:09:57.197 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (9m) 31s ago 9m 228M 2581M 17.2.7-1597-g96d63e75 f3fc7d52e233 bfad681712bd 2024-09-10T10:09:57.197 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (3m) 64s ago 13m 56.5M - 2.43.0 a07b618ecd1d 47d3ae62ce5e 2024-09-10T10:09:57.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.196+0000 7ff489951640 1 -- 172.21.15.71:0/313276414 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff47006e0b0 msgr2=0x7ff470070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.196+0000 7ff489951640 1 --2- 172.21.15.71:0/313276414 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff47006e0b0 0x7ff470070560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff474009af0 tx=0x7ff47400b040 comp rx=0 tx=0).stop 2024-09-10T10:09:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.196+0000 7ff489951640 1 -- 172.21.15.71:0/313276414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4840fd840 msgr2=0x7ff48410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.196+0000 7ff489951640 1 --2- 172.21.15.71:0/313276414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4840fd840 0x7ff48410d5c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0048a0 tx=0x7ff46c009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.196+0000 7ff489951640 1 -- 172.21.15.71:0/313276414 shutdown_connections 2024-09-10T10:09:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.196+0000 7ff489951640 1 --2- 172.21.15.71:0/313276414 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff47006e0b0 0x7ff470070560 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.196+0000 7ff489951640 1 --2- 172.21.15.71:0/313276414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4840fd840 0x7ff48410d5c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.196+0000 7ff489951640 1 --2- 172.21.15.71:0/313276414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4840fc570 0x7ff48410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.196+0000 7ff489951640 1 -- 172.21.15.71:0/313276414 >> 172.21.15.71:0/313276414 conn(0x7ff4840f7d10 msgr2=0x7ff4840f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.196+0000 7ff489951640 1 -- 172.21.15.71:0/313276414 shutdown_connections 2024-09-10T10:09:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.196+0000 7ff489951640 1 -- 172.21.15.71:0/313276414 wait complete. 2024-09-10T10:09:57.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.274+0000 7fcce64f2640 1 -- 172.21.15.71:0/941488796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcce00fd800 msgr2=0x7fcce00fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.274+0000 7fcce64f2640 1 --2- 172.21.15.71:0/941488796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcce00fd800 0x7fcce00fdc70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fccc80048d0 tx=0x7fccc8009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.274+0000 7fcce64f2640 1 -- 172.21.15.71:0/941488796 shutdown_connections 2024-09-10T10:09:57.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.274+0000 7fcce64f2640 1 --2- 172.21.15.71:0/941488796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcce00fd800 0x7fcce00fdc70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.274+0000 7fcce64f2640 1 --2- 172.21.15.71:0/941488796 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcce00fc530 0x7fcce00fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.274+0000 7fcce64f2640 1 -- 172.21.15.71:0/941488796 >> 172.21.15.71:0/941488796 conn(0x7fcce00f7d10 msgr2=0x7fcce00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:57.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.274+0000 7fcce64f2640 1 -- 172.21.15.71:0/941488796 shutdown_connections 2024-09-10T10:09:57.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.274+0000 7fcce64f2640 1 -- 172.21.15.71:0/941488796 wait complete. 2024-09-10T10:09:57.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.275+0000 7fcce64f2640 1 Processor -- start 2024-09-10T10:09:57.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.275+0000 7fcce64f2640 1 -- start start 2024-09-10T10:09:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.275+0000 7fcce64f2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcce00fc530 0x7fcce010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.275+0000 7fcce64f2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcce00fd800 0x7fcce010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.275+0000 7fcce64f2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce010dc30 con 0x7fcce00fd800 2024-09-10T10:09:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.275+0000 7fcce64f2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce010e450 con 0x7fcce00fc530 2024-09-10T10:09:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.275+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcce00fd800 0x7fcce010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.275+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcce00fd800 0x7fcce010d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43692/0 (socket says 172.21.15.71:43692) 2024-09-10T10:09:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.275+0000 7fccd7fff640 1 -- 172.21.15.71:0/365198270 learned_addr learned my addr 172.21.15.71:0/365198270 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.275+0000 7fccdffff640 1 --2- 172.21.15.71:0/365198270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcce00fc530 0x7fcce010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.275+0000 7fccd7fff640 1 -- 172.21.15.71:0/365198270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcce00fc530 msgr2=0x7fcce010d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.276+0000 7fccd7fff640 1 --2- 172.21.15.71:0/365198270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcce00fc530 0x7fcce010d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.276+0000 7fccd7fff640 1 -- 172.21.15.71:0/365198270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc8005040 con 0x7fcce00fd800 2024-09-10T10:09:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.276+0000 7fccd7fff640 1 --2- 172.21.15.71:0/365198270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcce00fd800 0x7fcce010d5e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fccc8003080 tx=0x7fccc8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.276+0000 7fccdd7fa640 1 -- 172.21.15.71:0/365198270 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc8038070 con 0x7fcce00fd800 2024-09-10T10:09:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.276+0000 7fccdd7fa640 1 -- 172.21.15.71:0/365198270 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fccc802abd0 con 0x7fcce00fd800 2024-09-10T10:09:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.276+0000 7fcce64f2640 1 -- 172.21.15.71:0/365198270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce010e680 con 0x7fcce00fd800 2024-09-10T10:09:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.276+0000 7fccdd7fa640 1 -- 172.21.15.71:0/365198270 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc803e670 con 0x7fcce00fd800 2024-09-10T10:09:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.276+0000 7fcce64f2640 1 -- 172.21.15.71:0/365198270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce010ec20 con 0x7fcce00fd800 2024-09-10T10:09:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.277+0000 7fcce64f2640 1 -- 172.21.15.71:0/365198270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce00fb990 con 0x7fcce00fd800 2024-09-10T10:09:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.277+0000 7fccdd7fa640 1 -- 172.21.15.71:0/365198270 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fccc8030020 con 0x7fcce00fd800 2024-09-10T10:09:57.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.278+0000 7fccdd7fa640 1 --2- 172.21.15.71:0/365198270 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fcccc06e0b0 0x7fcccc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.278+0000 7fccdd7fa640 1 -- 172.21.15.71:0/365198270 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fccc80adfd0 con 0x7fcce00fd800 2024-09-10T10:09:57.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.278+0000 7fccdffff640 1 --2- 172.21.15.71:0/365198270 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fcccc06e0b0 0x7fcccc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.279+0000 7fccdffff640 1 --2- 172.21.15.71:0/365198270 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fcccc06e0b0 0x7fcccc070560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fccd00041d0 tx=0x7fccd0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:57.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.282+0000 7fccdd7fa640 1 -- 172.21.15.71:0/365198270 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fccc8077300 con 0x7fcce00fd800 2024-09-10T10:09:57.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.516+0000 7fcce64f2640 1 -- 172.21.15.71:0/365198270 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcce010ee70 con 0x7fcce00fd800 2024-09-10T10:09:57.518 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:57 smithi071 ceph-mon[90773]: pgmap v131: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 52/321 objects degraded (16.199%) 2024-09-10T10:09:57.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.517+0000 7fccdd7fa640 1 -- 172.21.15.71:0/365198270 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fccc807a9c0 con 0x7fcce00fd800 2024-09-10T10:09:57.519 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:09:57.519 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:09:57.519 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:09:57.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:09:57.519 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:09:57.519 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:09:57.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:09:57.519 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:09:57.519 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 1, 2024-09-10T10:09:57.519 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T10:09:57.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:09:57.519 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:09:57.519 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:09:57.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:09:57.520 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:09:57.520 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 5, 2024-09-10T10:09:57.520 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 8 2024-09-10T10:09:57.520 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:09:57.520 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:09:57.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.520+0000 7fcce64f2640 1 -- 172.21.15.71:0/365198270 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fcccc06e0b0 msgr2=0x7fcccc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.520+0000 7fcce64f2640 1 --2- 172.21.15.71:0/365198270 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fcccc06e0b0 0x7fcccc070560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fccd00041d0 tx=0x7fccd0009040 comp rx=0 tx=0).stop 2024-09-10T10:09:57.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.520+0000 7fcce64f2640 1 -- 172.21.15.71:0/365198270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcce00fd800 msgr2=0x7fcce010d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.520+0000 7fcce64f2640 1 --2- 172.21.15.71:0/365198270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcce00fd800 0x7fcce010d5e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fccc8003080 tx=0x7fccc8009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.520+0000 7fcce64f2640 1 -- 172.21.15.71:0/365198270 shutdown_connections 2024-09-10T10:09:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.520+0000 7fcce64f2640 1 --2- 172.21.15.71:0/365198270 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fcccc06e0b0 0x7fcccc070560 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.520+0000 7fcce64f2640 1 --2- 172.21.15.71:0/365198270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcce00fd800 0x7fcce010d5e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.520+0000 7fcce64f2640 1 --2- 172.21.15.71:0/365198270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcce00fc530 0x7fcce010d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.520+0000 7fcce64f2640 1 -- 172.21.15.71:0/365198270 >> 172.21.15.71:0/365198270 conn(0x7fcce00f7d10 msgr2=0x7fcce00f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.520+0000 7fcce64f2640 1 -- 172.21.15.71:0/365198270 shutdown_connections 2024-09-10T10:09:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.520+0000 7fcce64f2640 1 -- 172.21.15.71:0/365198270 wait complete. 2024-09-10T10:09:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.600+0000 7f7d3660c640 1 -- 172.21.15.71:0/1203299540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d300fb470 msgr2=0x7f7d300fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.600+0000 7f7d3660c640 1 --2- 172.21.15.71:0/1203299540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d300fb470 0x7f7d300fb880 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7d200048d0 tx=0x7f7d20009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d3660c640 1 -- 172.21.15.71:0/1203299540 shutdown_connections 2024-09-10T10:09:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d3660c640 1 --2- 172.21.15.71:0/1203299540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d300fc740 0x7f7d300fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d3660c640 1 --2- 172.21.15.71:0/1203299540 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d300fb470 0x7f7d300fb880 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d3660c640 1 -- 172.21.15.71:0/1203299540 >> 172.21.15.71:0/1203299540 conn(0x7f7d300f6c30 msgr2=0x7f7d300f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d3660c640 1 -- 172.21.15.71:0/1203299540 shutdown_connections 2024-09-10T10:09:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d3660c640 1 -- 172.21.15.71:0/1203299540 wait complete. 2024-09-10T10:09:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d3660c640 1 Processor -- start 2024-09-10T10:09:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d3660c640 1 -- start start 2024-09-10T10:09:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d3660c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d300fb470 0x7f7d300ff590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d3660c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d300fc740 0x7f7d300fda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d3660c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300fe010 con 0x7f7d300fb470 2024-09-10T10:09:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d3660c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300fe150 con 0x7f7d300fc740 2024-09-10T10:09:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d2ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d300fb470 0x7f7d300ff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d2ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d300fb470 0x7f7d300ff590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43710/0 (socket says 172.21.15.71:43710) 2024-09-10T10:09:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.601+0000 7f7d2ffff640 1 -- 172.21.15.71:0/4001255856 learned_addr learned my addr 172.21.15.71:0/4001255856 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.602+0000 7f7d27fff640 1 --2- 172.21.15.71:0/4001255856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d300fc740 0x7f7d300fda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.602+0000 7f7d2ffff640 1 -- 172.21.15.71:0/4001255856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d300fc740 msgr2=0x7f7d300fda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.602+0000 7f7d2ffff640 1 --2- 172.21.15.71:0/4001255856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d300fc740 0x7f7d300fda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.602+0000 7f7d2ffff640 1 -- 172.21.15.71:0/4001255856 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d20005040 con 0x7f7d300fb470 2024-09-10T10:09:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.602+0000 7f7d2ffff640 1 --2- 172.21.15.71:0/4001255856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d300fb470 0x7f7d300ff590 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7d20000c00 tx=0x7f7d20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.602+0000 7f7d2d7fa640 1 -- 172.21.15.71:0/4001255856 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d20038070 con 0x7f7d300fb470 2024-09-10T10:09:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.602+0000 7f7d2d7fa640 1 -- 172.21.15.71:0/4001255856 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7d20004290 con 0x7f7d300fb470 2024-09-10T10:09:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.602+0000 7f7d3660c640 1 -- 172.21.15.71:0/4001255856 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d300fe3d0 con 0x7f7d300fb470 2024-09-10T10:09:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.602+0000 7f7d2d7fa640 1 -- 172.21.15.71:0/4001255856 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d2003e430 con 0x7f7d300fb470 2024-09-10T10:09:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.602+0000 7f7d3660c640 1 -- 172.21.15.71:0/4001255856 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d30115110 con 0x7f7d300fb470 2024-09-10T10:09:57.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.603+0000 7f7d3660c640 1 -- 172.21.15.71:0/4001255856 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3004b720 con 0x7f7d300fb470 2024-09-10T10:09:57.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.604+0000 7f7d2d7fa640 1 -- 172.21.15.71:0/4001255856 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7d20030020 con 0x7f7d300fb470 2024-09-10T10:09:57.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.604+0000 7f7d2d7fa640 1 --2- 172.21.15.71:0/4001255856 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7d1c06e0b0 0x7f7d1c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.604+0000 7f7d2d7fa640 1 -- 172.21.15.71:0/4001255856 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7d200adcb0 con 0x7f7d300fb470 2024-09-10T10:09:57.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.604+0000 7f7d27fff640 1 --2- 172.21.15.71:0/4001255856 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7d1c06e0b0 0x7f7d1c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.605+0000 7f7d27fff640 1 --2- 172.21.15.71:0/4001255856 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7d1c06e0b0 0x7f7d1c070560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009af0 tx=0x7f7d1800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:57.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.608+0000 7f7d2d7fa640 1 -- 172.21.15.71:0/4001255856 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7d20077090 con 0x7f7d300fb470 2024-09-10T10:09:57.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:57 smithi107 ceph-mon[79396]: pgmap v131: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 52/321 objects degraded (16.199%) 2024-09-10T10:09:57.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.818+0000 7f7d3660c640 1 -- 172.21.15.71:0/4001255856 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7d300fe560 con 0x7f7d300fb470 2024-09-10T10:09:57.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.818+0000 7f7d2d7fa640 1 -- 172.21.15.71:0/4001255856 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1955 (secure 0 0 0) 0x7f7d300fe560 con 0x7f7d300fb470 2024-09-10T10:09:57.820 INFO:teuthology.orchestra.run.smithi071.stdout:e24 2024-09-10T10:09:57.820 INFO:teuthology.orchestra.run.smithi071.stdout:btime 2024-09-10T10:07:40:170505+0000 2024-09-10T10:09:57.820 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:09:57.820 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:09:57.820 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:09:57.820 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:09:57.820 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:09:57.821 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:09:57.821 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 24 2024-09-10T10:09:57.821 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:09:57.821 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:09:57.821 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:07:39.792181+0000 2024-09-10T10:09:57.821 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:09:57.821 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:09:57.821 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:09:57.821 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:09:57.821 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:09:57.821 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:09:57.821 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:09:57.821 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:09:57.822 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:09:57.822 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:09:57.822 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:09:57.822 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:09:57.822 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:09:57.822 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:09:57.822 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:09:57.822 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:09:57.822 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:09:57.822 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:09:57.822 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:09:57.822 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:09:57.822 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:09:57.823 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:09:57.823 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 14464 members: 24267,14464 2024-09-10T10:09:57.823 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:09:57.823 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:09:57.823 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:09:57.823 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:09:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:09:57.823 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:09:57.824 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 24 2024-09-10T10:09:57.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.821+0000 7f7d3660c640 1 -- 172.21.15.71:0/4001255856 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7d1c06e0b0 msgr2=0x7f7d1c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.821+0000 7f7d3660c640 1 --2- 172.21.15.71:0/4001255856 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7d1c06e0b0 0x7f7d1c070560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009af0 tx=0x7f7d1800b040 comp rx=0 tx=0).stop 2024-09-10T10:09:57.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.821+0000 7f7d3660c640 1 -- 172.21.15.71:0/4001255856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d300fb470 msgr2=0x7f7d300ff590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.821+0000 7f7d3660c640 1 --2- 172.21.15.71:0/4001255856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d300fb470 0x7f7d300ff590 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7d20000c00 tx=0x7f7d20009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.821+0000 7f7d3660c640 1 -- 172.21.15.71:0/4001255856 shutdown_connections 2024-09-10T10:09:57.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.821+0000 7f7d3660c640 1 --2- 172.21.15.71:0/4001255856 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7d1c06e0b0 0x7f7d1c070560 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.821+0000 7f7d3660c640 1 --2- 172.21.15.71:0/4001255856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d300fc740 0x7f7d300fda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.821+0000 7f7d3660c640 1 --2- 172.21.15.71:0/4001255856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d300fb470 0x7f7d300ff590 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.821+0000 7f7d3660c640 1 -- 172.21.15.71:0/4001255856 >> 172.21.15.71:0/4001255856 conn(0x7f7d300f6c30 msgr2=0x7f7d300660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:57.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.821+0000 7f7d3660c640 1 -- 172.21.15.71:0/4001255856 shutdown_connections 2024-09-10T10:09:57.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.821+0000 7f7d3660c640 1 -- 172.21.15.71:0/4001255856 wait complete. 2024-09-10T10:09:57.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.905+0000 7f2d36290640 1 -- 172.21.15.71:0/2468256859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d300fb440 msgr2=0x7f2d300fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.905+0000 7f2d36290640 1 --2- 172.21.15.71:0/2468256859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d300fb440 0x7f2d300fb850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2d200048d0 tx=0x7f2d20009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.905+0000 7f2d36290640 1 -- 172.21.15.71:0/2468256859 shutdown_connections 2024-09-10T10:09:57.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.905+0000 7f2d36290640 1 --2- 172.21.15.71:0/2468256859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d300fc710 0x7f2d300fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.905+0000 7f2d36290640 1 --2- 172.21.15.71:0/2468256859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d300fb440 0x7f2d300fb850 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.905+0000 7f2d36290640 1 -- 172.21.15.71:0/2468256859 >> 172.21.15.71:0/2468256859 conn(0x7f2d300f6c00 msgr2=0x7f2d300f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:57.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.905+0000 7f2d36290640 1 -- 172.21.15.71:0/2468256859 shutdown_connections 2024-09-10T10:09:57.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.905+0000 7f2d36290640 1 -- 172.21.15.71:0/2468256859 wait complete. 2024-09-10T10:09:57.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.906+0000 7f2d36290640 1 Processor -- start 2024-09-10T10:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.906+0000 7f2d36290640 1 -- start start 2024-09-10T10:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.906+0000 7f2d36290640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d300fb440 0x7f2d3010bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.906+0000 7f2d36290640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d300fc710 0x7f2d3010c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.906+0000 7f2d36290640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3010cb30 con 0x7f2d300fb440 2024-09-10T10:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.906+0000 7f2d36290640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3010d300 con 0x7f2d300fc710 2024-09-10T10:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.906+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d300fb440 0x7f2d3010bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.906+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d300fb440 0x7f2d3010bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43720/0 (socket says 172.21.15.71:43720) 2024-09-10T10:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.906+0000 7f2d2ffff640 1 -- 172.21.15.71:0/295347375 learned_addr learned my addr 172.21.15.71:0/295347375 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.907+0000 7f2d2f7fe640 1 --2- 172.21.15.71:0/295347375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d300fc710 0x7f2d3010c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.907+0000 7f2d2ffff640 1 -- 172.21.15.71:0/295347375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d300fc710 msgr2=0x7f2d3010c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.907+0000 7f2d2ffff640 1 --2- 172.21.15.71:0/295347375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d300fc710 0x7f2d3010c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.907+0000 7f2d2ffff640 1 -- 172.21.15.71:0/295347375 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d20005040 con 0x7f2d300fb440 2024-09-10T10:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.907+0000 7f2d2f7fe640 1 --2- 172.21.15.71:0/295347375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d300fc710 0x7f2d3010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.907+0000 7f2d2ffff640 1 --2- 172.21.15.71:0/295347375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d300fb440 0x7f2d3010bfa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d200048a0 tx=0x7f2d20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.907+0000 7f2d2cff9640 1 -- 172.21.15.71:0/295347375 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d20038070 con 0x7f2d300fb440 2024-09-10T10:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.907+0000 7f2d2cff9640 1 -- 172.21.15.71:0/295347375 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2d20004290 con 0x7f2d300fb440 2024-09-10T10:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.907+0000 7f2d36290640 1 -- 172.21.15.71:0/295347375 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3010d530 con 0x7f2d300fb440 2024-09-10T10:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.907+0000 7f2d2cff9640 1 -- 172.21.15.71:0/295347375 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d20033660 con 0x7f2d300fb440 2024-09-10T10:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.907+0000 7f2d36290640 1 -- 172.21.15.71:0/295347375 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3010dad0 con 0x7f2d300fb440 2024-09-10T10:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.908+0000 7f2d36290640 1 -- 172.21.15.71:0/295347375 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d300fa8a0 con 0x7f2d300fb440 2024-09-10T10:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.909+0000 7f2d2cff9640 1 -- 172.21.15.71:0/295347375 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2d20030020 con 0x7f2d300fb440 2024-09-10T10:09:57.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.909+0000 7f2d2cff9640 1 --2- 172.21.15.71:0/295347375 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2d1806e0b0 0x7f2d18070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.909+0000 7f2d2cff9640 1 -- 172.21.15.71:0/295347375 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2d200adcd0 con 0x7f2d300fb440 2024-09-10T10:09:57.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.909+0000 7f2d2f7fe640 1 --2- 172.21.15.71:0/295347375 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2d1806e0b0 0x7f2d18070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.910+0000 7f2d2f7fe640 1 --2- 172.21.15.71:0/295347375 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2d1806e0b0 0x7f2d18070560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d24004fd0 tx=0x7f2d2400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:57.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:57.914+0000 7f2d2cff9640 1 -- 172.21.15.71:0/295347375 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2d200770b0 con 0x7f2d300fb440 2024-09-10T10:09:58.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.096+0000 7f2d36290640 1 -- 172.21.15.71:0/295347375 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d3010de00 con 0x7f2d1806e0b0 2024-09-10T10:09:58.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.098+0000 7f2d2cff9640 1 -- 172.21.15.71:0/295347375 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2d3010de00 con 0x7f2d1806e0b0 2024-09-10T10:09:58.099 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:09:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:09:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:09:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:09:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:09:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-09-10T10:09:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-10T10:09:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-10T10:09:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:09:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "11/21 daemons upgraded", 2024-09-10T10:09:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T10:09:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:09:58.100 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:09:58.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.100+0000 7f2d36290640 1 -- 172.21.15.71:0/295347375 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2d1806e0b0 msgr2=0x7f2d18070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.100+0000 7f2d36290640 1 --2- 172.21.15.71:0/295347375 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2d1806e0b0 0x7f2d18070560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d24004fd0 tx=0x7f2d2400b040 comp rx=0 tx=0).stop 2024-09-10T10:09:58.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.100+0000 7f2d36290640 1 -- 172.21.15.71:0/295347375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d300fb440 msgr2=0x7f2d3010bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.100+0000 7f2d36290640 1 --2- 172.21.15.71:0/295347375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d300fb440 0x7f2d3010bfa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d200048a0 tx=0x7f2d20009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.100+0000 7f2d36290640 1 -- 172.21.15.71:0/295347375 shutdown_connections 2024-09-10T10:09:58.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.100+0000 7f2d36290640 1 --2- 172.21.15.71:0/295347375 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2d1806e0b0 0x7f2d18070560 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.100+0000 7f2d36290640 1 --2- 172.21.15.71:0/295347375 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d300fc710 0x7f2d3010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.100+0000 7f2d36290640 1 --2- 172.21.15.71:0/295347375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d300fb440 0x7f2d3010bfa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.100+0000 7f2d36290640 1 -- 172.21.15.71:0/295347375 >> 172.21.15.71:0/295347375 conn(0x7f2d300f6c00 msgr2=0x7f2d300f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:58.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.100+0000 7f2d36290640 1 -- 172.21.15.71:0/295347375 shutdown_connections 2024-09-10T10:09:58.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.100+0000 7f2d36290640 1 -- 172.21.15.71:0/295347375 wait complete. 2024-09-10T10:09:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.183+0000 7f984e2b1640 1 -- 172.21.15.71:0/1363999458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98480fb450 msgr2=0x7f98480fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.183+0000 7f984e2b1640 1 --2- 172.21.15.71:0/1363999458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98480fb450 0x7f98480fb860 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f98380048d0 tx=0x7f9838009da0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.183+0000 7f984e2b1640 1 -- 172.21.15.71:0/1363999458 shutdown_connections 2024-09-10T10:09:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.183+0000 7f984e2b1640 1 --2- 172.21.15.71:0/1363999458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98480fc720 0x7f98480fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.183+0000 7f984e2b1640 1 --2- 172.21.15.71:0/1363999458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98480fb450 0x7f98480fb860 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.183+0000 7f984e2b1640 1 -- 172.21.15.71:0/1363999458 >> 172.21.15.71:0/1363999458 conn(0x7f98480f6c10 msgr2=0x7f98480f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.183+0000 7f984e2b1640 1 -- 172.21.15.71:0/1363999458 shutdown_connections 2024-09-10T10:09:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.183+0000 7f984e2b1640 1 -- 172.21.15.71:0/1363999458 wait complete. 2024-09-10T10:09:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.184+0000 7f984e2b1640 1 Processor -- start 2024-09-10T10:09:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.184+0000 7f984e2b1640 1 -- start start 2024-09-10T10:09:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.184+0000 7f984e2b1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98480fb450 0x7f984810fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.184+0000 7f984e2b1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98480fc720 0x7f9848112360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.184+0000 7f984e2b1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9848066730 con 0x7f98480fc720 2024-09-10T10:09:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.184+0000 7f984e2b1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98480668a0 con 0x7f98480fb450 2024-09-10T10:09:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.184+0000 7f98477fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98480fc720 0x7f9848112360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.184+0000 7f98477fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98480fc720 0x7f9848112360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43738/0 (socket says 172.21.15.71:43738) 2024-09-10T10:09:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.184+0000 7f98477fe640 1 -- 172.21.15.71:0/2390302866 learned_addr learned my addr 172.21.15.71:0/2390302866 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:09:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.184+0000 7f9847fff640 1 --2- 172.21.15.71:0/2390302866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98480fb450 0x7f984810fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.185+0000 7f98477fe640 1 -- 172.21.15.71:0/2390302866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98480fb450 msgr2=0x7f984810fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.185+0000 7f98477fe640 1 --2- 172.21.15.71:0/2390302866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98480fb450 0x7f984810fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.185+0000 7f98477fe640 1 -- 172.21.15.71:0/2390302866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838005040 con 0x7f98480fc720 2024-09-10T10:09:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.185+0000 7f98477fe640 1 --2- 172.21.15.71:0/2390302866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98480fc720 0x7f9848112360 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9830002a80 tx=0x7f9830004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.185+0000 7f9844ff9640 1 -- 172.21.15.71:0/2390302866 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9830007c30 con 0x7f98480fc720 2024-09-10T10:09:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.185+0000 7f9844ff9640 1 -- 172.21.15.71:0/2390302866 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f983000f040 con 0x7f98480fc720 2024-09-10T10:09:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.185+0000 7f984e2b1640 1 -- 172.21.15.71:0/2390302866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9848112900 con 0x7f98480fc720 2024-09-10T10:09:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.185+0000 7f9844ff9640 1 -- 172.21.15.71:0/2390302866 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f983000dab0 con 0x7f98480fc720 2024-09-10T10:09:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.185+0000 7f984e2b1640 1 -- 172.21.15.71:0/2390302866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9848112df0 con 0x7f98480fc720 2024-09-10T10:09:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.186+0000 7f984e2b1640 1 -- 172.21.15.71:0/2390302866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98480fa8b0 con 0x7f98480fc720 2024-09-10T10:09:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.186+0000 7f9844ff9640 1 -- 172.21.15.71:0/2390302866 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f983000dc10 con 0x7f98480fc720 2024-09-10T10:09:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.187+0000 7f9844ff9640 1 --2- 172.21.15.71:0/2390302866 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f983406e0b0 0x7f9834070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.187+0000 7f9847fff640 1 --2- 172.21.15.71:0/2390302866 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f983406e0b0 0x7f9834070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.187+0000 7f9844ff9640 1 -- 172.21.15.71:0/2390302866 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f983008d3d0 con 0x7f98480fc720 2024-09-10T10:09:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.188+0000 7f9847fff640 1 --2- 172.21.15.71:0/2390302866 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f983406e0b0 0x7f9834070560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9838000c00 tx=0x7f9838035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:58.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.192+0000 7f9844ff9640 1 -- 172.21.15.71:0/2390302866 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f98300567b0 con 0x7f98480fc720 2024-09-10T10:09:58.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.425+0000 7f984e2b1640 1 -- 172.21.15.71:0/2390302866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f984804b720 con 0x7f98480fc720 2024-09-10T10:09:58.426 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:58 smithi071 ceph-mon[90773]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:58.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:58 smithi071 ceph-mon[90773]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:58.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:58 smithi071 ceph-mon[90773]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:58.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:58 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:58.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:58 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:58.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:58 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/365198270' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:09:58.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:58 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/4001255856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:09:58.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:58 smithi071 ceph-mon[90773]: Health check update: Degraded data redundancy: 52/321 objects degraded (16.199%), 16 pgs degraded (PG_DEGRADED) 2024-09-10T10:09:58.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:58 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:58.427 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:58 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:58.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.425+0000 7f9844ff9640 1 -- 172.21.15.71:0/2390302866 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1162 (secure 0 0 0) 0x7f9830059e70 con 0x7f98480fc720 2024-09-10T10:09:58.428 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 52/321 objects degraded (16.199%), 16 pgs degraded 2024-09-10T10:09:58.428 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-10T10:09:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: osd.4 (root=default,host=smithi107) is down 2024-09-10T10:09:58.428 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 52/321 objects degraded (16.199%), 16 pgs degraded 2024-09-10T10:09:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-10T10:09:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-10T10:09:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-10T10:09:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-10T10:09:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-10T10:09:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-10T10:09:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-10T10:09:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-10T10:09:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-09-10T10:09:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-10T10:09:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-10T10:09:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-10T10:09:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-09-10T10:09:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-10T10:09:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-10T10:09:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-10T10:09:58.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.428+0000 7f984e2b1640 1 -- 172.21.15.71:0/2390302866 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f983406e0b0 msgr2=0x7f9834070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.428+0000 7f984e2b1640 1 --2- 172.21.15.71:0/2390302866 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f983406e0b0 0x7f9834070560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9838000c00 tx=0x7f9838035040 comp rx=0 tx=0).stop 2024-09-10T10:09:58.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.428+0000 7f984e2b1640 1 -- 172.21.15.71:0/2390302866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98480fc720 msgr2=0x7f9848112360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.428+0000 7f984e2b1640 1 --2- 172.21.15.71:0/2390302866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98480fc720 0x7f9848112360 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9830002a80 tx=0x7f9830004600 comp rx=0 tx=0).stop 2024-09-10T10:09:58.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.428+0000 7f984e2b1640 1 -- 172.21.15.71:0/2390302866 shutdown_connections 2024-09-10T10:09:58.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.428+0000 7f984e2b1640 1 --2- 172.21.15.71:0/2390302866 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f983406e0b0 0x7f9834070560 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.428+0000 7f984e2b1640 1 --2- 172.21.15.71:0/2390302866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98480fc720 0x7f9848112360 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.428+0000 7f984e2b1640 1 --2- 172.21.15.71:0/2390302866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98480fb450 0x7f984810fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.428+0000 7f984e2b1640 1 -- 172.21.15.71:0/2390302866 >> 172.21.15.71:0/2390302866 conn(0x7f98480f6c10 msgr2=0x7f98480f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:58.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.428+0000 7f984e2b1640 1 -- 172.21.15.71:0/2390302866 shutdown_connections 2024-09-10T10:09:58.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:09:58.428+0000 7f984e2b1640 1 -- 172.21.15.71:0/2390302866 wait complete. 2024-09-10T10:09:58.512 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:58 smithi107 ceph-mon[79396]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:58.512 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:58 smithi107 ceph-mon[79396]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:58.512 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:58 smithi107 ceph-mon[79396]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:58.512 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:58 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:58.512 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:58 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:58.512 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:58 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/365198270' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:09:58.512 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:58 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/4001255856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:09:58.512 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:58 smithi107 ceph-mon[79396]: Health check update: Degraded data redundancy: 52/321 objects degraded (16.199%), 16 pgs degraded (PG_DEGRADED) 2024-09-10T10:09:58.512 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:58 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:58.512 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:58 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:09:59.479 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:59 smithi107 ceph-mon[79396]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:59.479 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:59 smithi107 ceph-mon[79396]: pgmap v132: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 52/321 objects degraded (16.199%) 2024-09-10T10:09:59.479 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:09:59 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2390302866' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:09:59.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:59 smithi071 ceph-mon[90773]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:59.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:59 smithi071 ceph-mon[90773]: pgmap v132: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 52/321 objects degraded (16.199%) 2024-09-10T10:09:59.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:09:59 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2390302866' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:10:00.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: Health detail: HEALTH_WARN 1 osds down; Degraded data redundancy: 52/321 objects degraded (16.199%), 16 pgs degraded 2024-09-10T10:10:00.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: [WRN] OSD_DOWN: 1 osds down 2024-09-10T10:10:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: osd.4 (root=default,host=smithi107) is down 2024-09-10T10:10:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: [WRN] PG_DEGRADED: Degraded data redundancy: 52/321 objects degraded (16.199%), 16 pgs degraded 2024-09-10T10:10:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-10T10:10:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-10T10:10:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-10T10:10:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-10T10:10:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-10T10:10:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-10T10:10:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-10T10:10:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-10T10:10:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-09-10T10:10:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-10T10:10:00.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-10T10:10:00.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-10T10:10:00.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-09-10T10:10:00.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-10T10:10:00.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-10T10:10:00.397 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:00 smithi107 ceph-mon[79396]: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-10T10:10:00.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: Health detail: HEALTH_WARN 1 osds down; Degraded data redundancy: 52/321 objects degraded (16.199%), 16 pgs degraded 2024-09-10T10:10:00.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: [WRN] OSD_DOWN: 1 osds down 2024-09-10T10:10:00.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: osd.4 (root=default,host=smithi107) is down 2024-09-10T10:10:00.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: [WRN] PG_DEGRADED: Degraded data redundancy: 52/321 objects degraded (16.199%), 16 pgs degraded 2024-09-10T10:10:00.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-10T10:10:00.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-10T10:10:00.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-10T10:10:00.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-10T10:10:00.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-10T10:10:00.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-10T10:10:00.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-10T10:10:00.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-10T10:10:00.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-09-10T10:10:00.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-10T10:10:00.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-10T10:10:00.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-10T10:10:00.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-09-10T10:10:00.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-10T10:10:00.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-10T10:10:00.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:00 smithi071 ceph-mon[90773]: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-10T10:10:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:01 smithi071 ceph-mon[90773]: pgmap v133: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 52/321 objects degraded (16.199%) 2024-09-10T10:10:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:01.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:01 smithi107 ceph-mon[79396]: pgmap v133: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 52/321 objects degraded (16.199%) 2024-09-10T10:10:01.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:01.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:01.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:01.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:01.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:02.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:02.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:02.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:02.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:02.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T10:10:02.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:02 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T10:10:02.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:02 smithi071 ceph-mon[90773]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-10T10:10:02.645 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:10:02 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:10:02.282+0000 7fe65cbb6640 -1 osd.4 68 log_to_monitors true 2024-09-10T10:10:02.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:02.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:02.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:02.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:02.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T10:10:02.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:02 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T10:10:02.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:02 smithi107 ceph-mon[79396]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-10T10:10:03.506 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:03 smithi071 ceph-mon[90773]: pgmap v134: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 52/321 objects degraded (16.199%) 2024-09-10T10:10:03.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:03 smithi071 ceph-mon[90773]: from='osd.4 [v2:172.21.15.107:6808/4009635923,v1:172.21.15.107:6809/4009635923]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:10:03.507 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:03 smithi071 ceph-mon[90773]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:10:03.645 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:10:03 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:10:03.267+0000 7fe654950640 -1 osd.4 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:10:03.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:03 smithi107 ceph-mon[79396]: pgmap v134: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 52/321 objects degraded (16.199%) 2024-09-10T10:10:03.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:03 smithi107 ceph-mon[79396]: from='osd.4 [v2:172.21.15.107:6808/4009635923,v1:172.21.15.107:6809/4009635923]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:10:03.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:03 smithi107 ceph-mon[79396]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:10:04.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:04 smithi071 ceph-mon[90773]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T10:10:04.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:04 smithi071 ceph-mon[90773]: osdmap e71: 6 total, 5 up, 6 in 2024-09-10T10:10:04.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:04 smithi071 ceph-mon[90773]: from='osd.4 [v2:172.21.15.107:6808/4009635923,v1:172.21.15.107:6809/4009635923]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:10:04.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:04 smithi071 ceph-mon[90773]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:10:04.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:04 smithi107 ceph-mon[79396]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T10:10:04.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:04 smithi107 ceph-mon[79396]: osdmap e71: 6 total, 5 up, 6 in 2024-09-10T10:10:04.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:04 smithi107 ceph-mon[79396]: from='osd.4 [v2:172.21.15.107:6808/4009635923,v1:172.21.15.107:6809/4009635923]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:10:04.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:04 smithi107 ceph-mon[79396]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:10:05.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:05 smithi071 ceph-mon[90773]: pgmap v136: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 52/321 objects degraded (16.199%) 2024-09-10T10:10:05.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:05 smithi071 ceph-mon[90773]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T10:10:05.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:05 smithi071 ceph-mon[90773]: osd.4 [v2:172.21.15.107:6808/4009635923,v1:172.21.15.107:6809/4009635923] boot 2024-09-10T10:10:05.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:05 smithi071 ceph-mon[90773]: osdmap e72: 6 total, 6 up, 6 in 2024-09-10T10:10:05.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:10:05.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:05 smithi071 ceph-mon[90773]: osdmap e73: 6 total, 6 up, 6 in 2024-09-10T10:10:05.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:05 smithi107 ceph-mon[79396]: pgmap v136: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 52/321 objects degraded (16.199%) 2024-09-10T10:10:05.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:05 smithi107 ceph-mon[79396]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T10:10:05.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:05 smithi107 ceph-mon[79396]: osd.4 [v2:172.21.15.107:6808/4009635923,v1:172.21.15.107:6809/4009635923] boot 2024-09-10T10:10:05.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:05 smithi107 ceph-mon[79396]: osdmap e72: 6 total, 6 up, 6 in 2024-09-10T10:10:05.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:10:05.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:05 smithi107 ceph-mon[79396]: osdmap e73: 6 total, 6 up, 6 in 2024-09-10T10:10:06.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:06 smithi107 ceph-mon[79396]: Health check update: Degraded data redundancy: 38/321 objects degraded (11.838%), 12 pgs degraded (PG_DEGRADED) 2024-09-10T10:10:06.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:06 smithi071 ceph-mon[90773]: Health check update: Degraded data redundancy: 38/321 objects degraded (11.838%), 12 pgs degraded (PG_DEGRADED) 2024-09-10T10:10:07.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:07 smithi107 ceph-mon[79396]: pgmap v139: 65 pgs: 4 peering, 11 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 38/321 objects degraded (11.838%) 2024-09-10T10:10:07.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:07 smithi071 ceph-mon[90773]: pgmap v139: 65 pgs: 4 peering, 11 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 38/321 objects degraded (11.838%) 2024-09-10T10:10:09.591 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:09 smithi071 ceph-mon[90773]: pgmap v140: 65 pgs: 4 peering, 3 active+undersized, 3 active+undersized+degraded, 55 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 6/321 objects degraded (1.869%) 2024-09-10T10:10:09.591 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:09.591 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:10:09.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:09 smithi107 ceph-mon[79396]: pgmap v140: 65 pgs: 4 peering, 3 active+undersized, 3 active+undersized+degraded, 55 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 6/321 objects degraded (1.869%) 2024-09-10T10:10:09.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:10:10.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:10 smithi071 ceph-mon[90773]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/321 objects degraded (1.869%), 3 pgs degraded) 2024-09-10T10:10:10.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:10 smithi071 ceph-mon[90773]: Cluster is now healthy 2024-09-10T10:10:10.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:10 smithi107 ceph-mon[79396]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/321 objects degraded (1.869%), 3 pgs degraded) 2024-09-10T10:10:10.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:10 smithi107 ceph-mon[79396]: Cluster is now healthy 2024-09-10T10:10:11.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:11 smithi107 ceph-mon[79396]: pgmap v141: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-10T10:10:11.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:11 smithi071 ceph-mon[90773]: pgmap v141: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-10T10:10:13.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:13 smithi107 ceph-mon[79396]: pgmap v142: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-10T10:10:13.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:13 smithi071 ceph-mon[90773]: pgmap v142: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-10T10:10:15.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:15 smithi107 ceph-mon[79396]: pgmap v143: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-10T10:10:15.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:15 smithi071 ceph-mon[90773]: pgmap v143: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-10T10:10:16.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:16 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T10:10:16.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:16 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T10:10:17.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:17 smithi107 ceph-mon[79396]: pgmap v144: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-09-10T10:10:17.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:17 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T10:10:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:17 smithi107 ceph-mon[79396]: Upgrade: osd.5 is safe to restart 2024-09-10T10:10:17.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:17 smithi071 ceph-mon[90773]: pgmap v144: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-09-10T10:10:17.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:17 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T10:10:17.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:17 smithi071 ceph-mon[90773]: Upgrade: osd.5 is safe to restart 2024-09-10T10:10:18.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:18 smithi107 ceph-mon[79396]: Upgrade: Updating osd.5 2024-09-10T10:10:18.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:18 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:18.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:18 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:10:18.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:18 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:18.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:18 smithi107 ceph-mon[79396]: Deploying daemon osd.5 on smithi107 2024-09-10T10:10:18.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:18 smithi107 ceph-mon[79396]: pgmap v145: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-10T10:10:19.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:18 smithi071 ceph-mon[90773]: Upgrade: Updating osd.5 2024-09-10T10:10:19.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:18 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:19.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:18 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:10:19.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:18 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:19.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:18 smithi071 ceph-mon[90773]: Deploying daemon osd.5 on smithi107 2024-09-10T10:10:19.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:18 smithi071 ceph-mon[90773]: pgmap v145: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-10T10:10:20.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:20 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:20.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:20 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:21.031 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:20 smithi107 systemd[1]: Stopping Ceph osd.5 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:10:21.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:21 smithi107 ceph-mon[79396]: pgmap v146: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:10:21.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:21 smithi107 ceph-mon[79396]: osd.5 marked itself down and dead 2024-09-10T10:10:21.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:21 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[52864]: 2024-09-10T10:10:21.028+0000 7f3fd4fb6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:10:21.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:21 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[52864]: 2024-09-10T10:10:21.028+0000 7f3fd4fb6640 -1 osd.5 73 *** Got signal Terminated *** 2024-09-10T10:10:21.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:21 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[52864]: 2024-09-10T10:10:21.028+0000 7f3fd4fb6640 -1 osd.5 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:10:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:21 smithi071 ceph-mon[90773]: pgmap v146: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:10:21.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:21 smithi071 ceph-mon[90773]: osd.5 marked itself down and dead 2024-09-10T10:10:21.921 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:21 smithi107 podman[98407]: 2024-09-10 10:10:21.670136862 +0000 UTC m=+0.734975945 container died bfad681712bdb76b92fbd23242e24c191457d6c067df994cdf45b7bdbbf22bfc (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=quincy-96d63e7, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:10:22.239 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:22 smithi107 podman[98407]: 2024-09-10 10:10:22.028104714 +0000 UTC m=+1.092943799 container cleanup bfad681712bdb76b92fbd23242e24c191457d6c067df994cdf45b7bdbbf22bfc (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=quincy-96d63e7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:10:22.239 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:22 smithi107 bash[98407]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5 2024-09-10T10:10:22.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:22 smithi071 ceph-mon[90773]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T10:10:22.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:22 smithi071 ceph-mon[90773]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-10T10:10:22.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:22 smithi071 ceph-mon[90773]: osdmap e74: 6 total, 5 up, 6 in 2024-09-10T10:10:22.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:22 smithi107 ceph-mon[79396]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T10:10:22.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:22 smithi107 ceph-mon[79396]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-10T10:10:22.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:22 smithi107 ceph-mon[79396]: osdmap e74: 6 total, 5 up, 6 in 2024-09-10T10:10:22.646 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:22 smithi107 podman[98432]: 2024-09-10 10:10:22.237912881 +0000 UTC m=+0.564920674 container remove bfad681712bdb76b92fbd23242e24c191457d6c067df994cdf45b7bdbbf22bfc (image=quay.ceph.io/ceph-ci/ceph@sha256:c9bbffaf080b46b53359192d4bae820bb33123e2f2d16ca56c5edea7e111124e, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=quincy-96d63e7, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:10:22.984 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:22 smithi107 podman[98519]: 2024-09-10 10:10:22.581317237 +0000 UTC m=+0.016121414 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:10:22.984 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:22 smithi107 podman[98519]: 2024-09-10 10:10:22.688920485 +0000 UTC m=+0.123724656 container create 353916d452288c6188873726edc3b6beac82ebca27f25f046b1426c7d95794ca (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T10:10:22.984 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:22 smithi107 podman[98519]: 2024-09-10 10:10:22.908128675 +0000 UTC m=+0.342932845 container init 353916d452288c6188873726edc3b6beac82ebca27f25f046b1426c7d95794ca (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:10:22.985 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:22 smithi107 podman[98519]: 2024-09-10 10:10:22.911557201 +0000 UTC m=+0.346361372 container start 353916d452288c6188873726edc3b6beac82ebca27f25f046b1426c7d95794ca (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T10:10:22.985 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:22 smithi107 podman[98519]: 2024-09-10 10:10:22.98309234 +0000 UTC m=+0.417896511 container attach 353916d452288c6188873726edc3b6beac82ebca27f25f046b1426c7d95794ca (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T10:10:23.242 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:23 smithi107 podman[98519]: 2024-09-10 10:10:23.104833625 +0000 UTC m=+0.539637797 container died 353916d452288c6188873726edc3b6beac82ebca27f25f046b1426c7d95794ca (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T10:10:23.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:23 smithi071 ceph-mon[90773]: pgmap v148: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-10T10:10:23.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:23 smithi071 ceph-mon[90773]: osdmap e75: 6 total, 5 up, 6 in 2024-09-10T10:10:23.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:23 smithi071 ceph-mon[90773]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-10T10:10:23.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:23 smithi107 ceph-mon[79396]: pgmap v148: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-10T10:10:23.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:23 smithi107 ceph-mon[79396]: osdmap e75: 6 total, 5 up, 6 in 2024-09-10T10:10:23.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:23 smithi107 ceph-mon[79396]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-10T10:10:24.139 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:23 smithi107 podman[98542]: 2024-09-10 10:10:23.712029927 +0000 UTC m=+0.601078810 container remove 353916d452288c6188873726edc3b6beac82ebca27f25f046b1426c7d95794ca (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T10:10:24.139 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:23 smithi107 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-10T10:10:24.139 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:23 smithi107 systemd[1]: Stopped Ceph osd.5 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:10:24.139 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:23 smithi107 systemd[1]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.5.service: Consumed 1min 4.447s CPU time. 2024-09-10T10:10:24.139 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:23 smithi107 systemd[1]: Starting Ceph osd.5 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:10:24.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:24 smithi107 podman[98641]: 2024-09-10 10:10:24.137969625 +0000 UTC m=+0.111528066 container create 356f50fd26e1d662797ef3cb874fc7ec31fbf9fe9c6c7e56cb431c351b85d904 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T10:10:24.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:24 smithi107 podman[98641]: 2024-09-10 10:10:24.042082751 +0000 UTC m=+0.015641164 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:10:24.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:24 smithi107 podman[98641]: 2024-09-10 10:10:24.349098877 +0000 UTC m=+0.322657284 container init 356f50fd26e1d662797ef3cb874fc7ec31fbf9fe9c6c7e56cb431c351b85d904 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T10:10:24.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:24 smithi107 podman[98641]: 2024-09-10 10:10:24.352626909 +0000 UTC m=+0.326185308 container start 356f50fd26e1d662797ef3cb874fc7ec31fbf9fe9c6c7e56cb431c351b85d904 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True) 2024-09-10T10:10:24.895 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:24 smithi107 podman[98641]: 2024-09-10 10:10:24.424184607 +0000 UTC m=+0.397743016 container attach 356f50fd26e1d662797ef3cb874fc7ec31fbf9fe9c6c7e56cb431c351b85d904 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T10:10:24.896 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:24 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate[98656]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:10:24.896 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:24 smithi107 bash[98641]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:10:24.896 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:24 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate[98656]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:10:24.896 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:24 smithi107 bash[98641]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T10:10:25.499 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:25 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:25.499 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:25 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:10:25.500 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:25 smithi107 ceph-mon[79396]: pgmap v150: 65 pgs: 4 active+undersized, 10 peering, 6 stale+active+clean, 3 active+undersized+degraded, 42 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/321 objects degraded (2.181%) 2024-09-10T10:10:25.500 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate[98656]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T10:10:25.500 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 bash[98641]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T10:10:25.500 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate[98656]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-10T10:10:25.500 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 bash[98641]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-10T10:10:25.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:25.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:10:25.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:25 smithi071 ceph-mon[90773]: pgmap v150: 65 pgs: 4 active+undersized, 10 peering, 6 stale+active+clean, 3 active+undersized+degraded, 42 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/321 objects degraded (2.181%) 2024-09-10T10:10:25.820 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate[98656]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-10T10:10:25.820 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 bash[98641]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-10T10:10:25.821 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate[98656]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-10T10:10:25.821 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 bash[98641]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-10T10:10:25.821 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate[98656]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-10T10:10:25.821 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 bash[98641]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-10T10:10:25.821 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate[98656]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T10:10:25.821 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 bash[98641]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T10:10:25.821 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate[98656]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-10T10:10:25.821 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 bash[98641]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-10T10:10:25.821 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:25 smithi107 podman[98641]: 2024-09-10 10:10:25.529999586 +0000 UTC m=+1.503557993 container died 356f50fd26e1d662797ef3cb874fc7ec31fbf9fe9c6c7e56cb431c351b85d904 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True) 2024-09-10T10:10:26.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:26 smithi107 ceph-mon[79396]: Health check failed: Degraded data redundancy: 7/321 objects degraded (2.181%), 3 pgs degraded (PG_DEGRADED) 2024-09-10T10:10:26.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:26 smithi107 podman[98796]: 2024-09-10 10:10:26.094816439 +0000 UTC m=+0.553057204 container remove 356f50fd26e1d662797ef3cb874fc7ec31fbf9fe9c6c7e56cb431c351b85d904 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-activate, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-10T10:10:26.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:26 smithi107 podman[98855]: 2024-09-10 10:10:26.201932385 +0000 UTC m=+0.015728265 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:10:26.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:26 smithi107 podman[98855]: 2024-09-10 10:10:26.304103367 +0000 UTC m=+0.117899234 container create 3440ee1c721ec21914d35b843b4d8dfff13653127ebeda2a619ca920f7c90dbd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:10:26.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:26 smithi071 ceph-mon[90773]: Health check failed: Degraded data redundancy: 7/321 objects degraded (2.181%), 3 pgs degraded (PG_DEGRADED) 2024-09-10T10:10:26.895 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:26 smithi107 podman[98855]: 2024-09-10 10:10:26.515250533 +0000 UTC m=+0.329046408 container init 3440ee1c721ec21914d35b843b4d8dfff13653127ebeda2a619ca920f7c90dbd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:10:26.896 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:26 smithi107 podman[98855]: 2024-09-10 10:10:26.518365021 +0000 UTC m=+0.332160890 container start 3440ee1c721ec21914d35b843b4d8dfff13653127ebeda2a619ca920f7c90dbd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:10:26.896 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:26 smithi107 ceph-osd[98874]: -- 172.21.15.107:0/1668106549 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55806749e1e0 con 0x558067430000 2024-09-10T10:10:26.896 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:26 smithi107 bash[98855]: 3440ee1c721ec21914d35b843b4d8dfff13653127ebeda2a619ca920f7c90dbd 2024-09-10T10:10:26.896 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:26 smithi107 systemd[1]: Started Ceph osd.5 for 9dae8622-6f5a-11ef-bcea-c7b262605968. 2024-09-10T10:10:27.485 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:27 smithi107 ceph-mon[79396]: pgmap v151: 65 pgs: 9 active+undersized, 10 peering, 1 stale+active+clean, 6 active+undersized+degraded, 39 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 14/321 objects degraded (4.361%) 2024-09-10T10:10:27.485 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:27.485 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:27.485 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:27 smithi071 ceph-mon[90773]: pgmap v151: 65 pgs: 9 active+undersized, 10 peering, 1 stale+active+clean, 6 active+undersized+degraded, 39 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 14/321 objects degraded (4.361%) 2024-09-10T10:10:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:28.522 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:28 smithi071 ceph-mon[90773]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-10T10:10:28.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.520+0000 7f984ce34640 1 -- 172.21.15.71:0/2139901744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98480ff740 msgr2=0x7f9848101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:28.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.520+0000 7f984ce34640 1 --2- 172.21.15.71:0/2139901744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98480ff740 0x7f9848101b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f983c0048d0 tx=0x7f983c009da0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.520+0000 7f984ce34640 1 -- 172.21.15.71:0/2139901744 shutdown_connections 2024-09-10T10:10:28.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.520+0000 7f984ce34640 1 --2- 172.21.15.71:0/2139901744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98480ff740 0x7f9848101b20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.520+0000 7f984ce34640 1 --2- 172.21.15.71:0/2139901744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9848065b80 0x7f98480ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.520+0000 7f984ce34640 1 -- 172.21.15.71:0/2139901744 >> 172.21.15.71:0/2139901744 conn(0x7f98480f6c10 msgr2=0x7f98480f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:28.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.520+0000 7f984ce34640 1 -- 172.21.15.71:0/2139901744 shutdown_connections 2024-09-10T10:10:28.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.520+0000 7f984ce34640 1 -- 172.21.15.71:0/2139901744 wait complete. 2024-09-10T10:10:28.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.521+0000 7f984ce34640 1 Processor -- start 2024-09-10T10:10:28.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.521+0000 7f984ce34640 1 -- start start 2024-09-10T10:10:28.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.521+0000 7f984ce34640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848065b80 0x7f984810d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:28.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.521+0000 7f984ce34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98480ff740 0x7f984810d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:28.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.521+0000 7f984ce34640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984810dc60 con 0x7f9848065b80 2024-09-10T10:10:28.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.521+0000 7f984ce34640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984810e430 con 0x7f98480ff740 2024-09-10T10:10:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.521+0000 7f984659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848065b80 0x7f984810d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.521+0000 7f984659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848065b80 0x7f984810d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37668/0 (socket says 172.21.15.71:37668) 2024-09-10T10:10:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.521+0000 7f984659c640 1 -- 172.21.15.71:0/3165428583 learned_addr learned my addr 172.21.15.71:0/3165428583 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:10:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.521+0000 7f9845d9b640 1 --2- 172.21.15.71:0/3165428583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98480ff740 0x7f984810d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.522+0000 7f984659c640 1 -- 172.21.15.71:0/3165428583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98480ff740 msgr2=0x7f984810d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.522+0000 7f984659c640 1 --2- 172.21.15.71:0/3165428583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98480ff740 0x7f984810d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.522+0000 7f984659c640 1 -- 172.21.15.71:0/3165428583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c005040 con 0x7f9848065b80 2024-09-10T10:10:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.522+0000 7f984659c640 1 --2- 172.21.15.71:0/3165428583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848065b80 0x7f984810d0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f983800ece0 tx=0x7f983800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.522+0000 7f9836ffd640 1 -- 172.21.15.71:0/3165428583 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f983800cab0 con 0x7f9848065b80 2024-09-10T10:10:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.522+0000 7f9836ffd640 1 -- 172.21.15.71:0/3165428583 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f983800f040 con 0x7f9848065b80 2024-09-10T10:10:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.522+0000 7f984ce34640 1 -- 172.21.15.71:0/3165428583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984810e6c0 con 0x7f9848065b80 2024-09-10T10:10:28.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.522+0000 7f9836ffd640 1 -- 172.21.15.71:0/3165428583 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9838009680 con 0x7f9848065b80 2024-09-10T10:10:28.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.522+0000 7f984ce34640 1 -- 172.21.15.71:0/3165428583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984810ec60 con 0x7f9848065b80 2024-09-10T10:10:28.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.523+0000 7f984ce34640 1 -- 172.21.15.71:0/3165428583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98480fa890 con 0x7f9848065b80 2024-09-10T10:10:28.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.524+0000 7f9836ffd640 1 -- 172.21.15.71:0/3165428583 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9838007890 con 0x7f9848065b80 2024-09-10T10:10:28.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.524+0000 7f9836ffd640 1 --2- 172.21.15.71:0/3165428583 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f983006e0b0 0x7f9830070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.524+0000 7f9836ffd640 1 -- 172.21.15.71:0/3165428583 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f983808e090 con 0x7f9848065b80 2024-09-10T10:10:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.524+0000 7f9845d9b640 1 --2- 172.21.15.71:0/3165428583 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f983006e0b0 0x7f9830070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:28.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.525+0000 7f9845d9b640 1 --2- 172.21.15.71:0/3165428583 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f983006e0b0 0x7f9830070560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f984810ce80 tx=0x7f983c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:28.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.529+0000 7f9836ffd640 1 -- 172.21.15.71:0/3165428583 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9838057500 con 0x7f9848065b80 2024-09-10T10:10:28.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:28 smithi107 ceph-mon[79396]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-10T10:10:28.645 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:28 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:10:28.392+0000 7f908c044640 -1 Falling back to public interface 2024-09-10T10:10:28.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.714+0000 7f984ce34640 1 -- 172.21.15.71:0/3165428583 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f984810f060 con 0x7f983006e0b0 2024-09-10T10:10:28.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.715+0000 7f9836ffd640 1 -- 172.21.15.71:0/3165428583 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f984810f060 con 0x7f983006e0b0 2024-09-10T10:10:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.717+0000 7f984ce34640 1 -- 172.21.15.71:0/3165428583 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f983006e0b0 msgr2=0x7f9830070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.717+0000 7f984ce34640 1 --2- 172.21.15.71:0/3165428583 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f983006e0b0 0x7f9830070560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f984810ce80 tx=0x7f983c035040 comp rx=0 tx=0).stop 2024-09-10T10:10:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.717+0000 7f984ce34640 1 -- 172.21.15.71:0/3165428583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848065b80 msgr2=0x7f984810d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.717+0000 7f984ce34640 1 --2- 172.21.15.71:0/3165428583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848065b80 0x7f984810d0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f983800ece0 tx=0x7f983800b040 comp rx=0 tx=0).stop 2024-09-10T10:10:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.717+0000 7f984ce34640 1 -- 172.21.15.71:0/3165428583 shutdown_connections 2024-09-10T10:10:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.717+0000 7f984ce34640 1 --2- 172.21.15.71:0/3165428583 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f983006e0b0 0x7f9830070560 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.717+0000 7f984ce34640 1 --2- 172.21.15.71:0/3165428583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98480ff740 0x7f984810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.717+0000 7f984ce34640 1 --2- 172.21.15.71:0/3165428583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9848065b80 0x7f984810d0d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.718+0000 7f984ce34640 1 -- 172.21.15.71:0/3165428583 >> 172.21.15.71:0/3165428583 conn(0x7f98480f6c10 msgr2=0x7f98480f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.718+0000 7f984ce34640 1 -- 172.21.15.71:0/3165428583 shutdown_connections 2024-09-10T10:10:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.718+0000 7f984ce34640 1 -- 172.21.15.71:0/3165428583 wait complete. 2024-09-10T10:10:28.728 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:10:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.798+0000 7f0575e1a640 1 -- 172.21.15.71:0/1721464672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05700fd7f0 msgr2=0x7f05700fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.798+0000 7f0575e1a640 1 --2- 172.21.15.71:0/1721464672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05700fd7f0 0x7f05700fdc60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f05580048d0 tx=0x7f0558009da0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.798+0000 7f0575e1a640 1 -- 172.21.15.71:0/1721464672 shutdown_connections 2024-09-10T10:10:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.798+0000 7f0575e1a640 1 --2- 172.21.15.71:0/1721464672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05700fd7f0 0x7f05700fdc60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.798+0000 7f0575e1a640 1 --2- 172.21.15.71:0/1721464672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05700fc520 0x7f05700fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.798+0000 7f0575e1a640 1 -- 172.21.15.71:0/1721464672 >> 172.21.15.71:0/1721464672 conn(0x7f05700f7ce0 msgr2=0x7f05700fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.798+0000 7f0575e1a640 1 -- 172.21.15.71:0/1721464672 shutdown_connections 2024-09-10T10:10:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.798+0000 7f0575e1a640 1 -- 172.21.15.71:0/1721464672 wait complete. 2024-09-10T10:10:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.798+0000 7f0575e1a640 1 Processor -- start 2024-09-10T10:10:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.798+0000 7f0575e1a640 1 -- start start 2024-09-10T10:10:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.798+0000 7f0575e1a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05700fc520 0x7f057010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:28.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f0575e1a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05700fd7f0 0x7f057010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f0575e1a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057010dc10 con 0x7f05700fd7f0 2024-09-10T10:10:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f0575e1a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057010e430 con 0x7f05700fc520 2024-09-10T10:10:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f056effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05700fd7f0 0x7f057010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f056effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05700fd7f0 0x7f057010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37678/0 (socket says 172.21.15.71:37678) 2024-09-10T10:10:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f056effd640 1 -- 172.21.15.71:0/3865142791 learned_addr learned my addr 172.21.15.71:0/3865142791 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:10:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f056f7fe640 1 --2- 172.21.15.71:0/3865142791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05700fc520 0x7f057010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f056effd640 1 -- 172.21.15.71:0/3865142791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05700fc520 msgr2=0x7f057010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f056effd640 1 --2- 172.21.15.71:0/3865142791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05700fc520 0x7f057010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f056effd640 1 -- 172.21.15.71:0/3865142791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0558005040 con 0x7f05700fd7f0 2024-09-10T10:10:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f056effd640 1 --2- 172.21.15.71:0/3865142791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05700fd7f0 0x7f057010d5c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f05580043d0 tx=0x7f0558009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f0567fff640 1 -- 172.21.15.71:0/3865142791 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0558038070 con 0x7f05700fd7f0 2024-09-10T10:10:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f0567fff640 1 -- 172.21.15.71:0/3865142791 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f055802ae90 con 0x7f05700fd7f0 2024-09-10T10:10:28.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f0567fff640 1 -- 172.21.15.71:0/3865142791 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f055803e670 con 0x7f05700fd7f0 2024-09-10T10:10:28.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f0575e1a640 1 -- 172.21.15.71:0/3865142791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057010e660 con 0x7f05700fd7f0 2024-09-10T10:10:28.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.799+0000 7f0575e1a640 1 -- 172.21.15.71:0/3865142791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057010ec00 con 0x7f05700fd7f0 2024-09-10T10:10:28.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.800+0000 7f0575e1a640 1 -- 172.21.15.71:0/3865142791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05700fb980 con 0x7f05700fd7f0 2024-09-10T10:10:28.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.801+0000 7f0567fff640 1 -- 172.21.15.71:0/3865142791 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0558030020 con 0x7f05700fd7f0 2024-09-10T10:10:28.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.801+0000 7f0567fff640 1 --2- 172.21.15.71:0/3865142791 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f055c06e0b0 0x7f055c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:28.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.801+0000 7f0567fff640 1 -- 172.21.15.71:0/3865142791 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f05580ade40 con 0x7f05700fd7f0 2024-09-10T10:10:28.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.801+0000 7f056f7fe640 1 --2- 172.21.15.71:0/3865142791 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f055c06e0b0 0x7f055c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:28.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.802+0000 7f056f7fe640 1 --2- 172.21.15.71:0/3865142791 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f055c06e0b0 0x7f055c070560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0560007fd0 tx=0x7f0560009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:28.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.806+0000 7f0567fff640 1 -- 172.21.15.71:0/3865142791 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0558077170 con 0x7f05700fd7f0 2024-09-10T10:10:28.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.990+0000 7f0575e1a640 1 -- 172.21.15.71:0/3865142791 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f057010ef90 con 0x7f055c06e0b0 2024-09-10T10:10:28.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.991+0000 7f0567fff640 1 -- 172.21.15.71:0/3865142791 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f057010ef90 con 0x7f055c06e0b0 2024-09-10T10:10:28.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.993+0000 7f0575e1a640 1 -- 172.21.15.71:0/3865142791 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f055c06e0b0 msgr2=0x7f055c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:28.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.993+0000 7f0575e1a640 1 --2- 172.21.15.71:0/3865142791 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f055c06e0b0 0x7f055c070560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0560007fd0 tx=0x7f0560009e90 comp rx=0 tx=0).stop 2024-09-10T10:10:28.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.993+0000 7f0575e1a640 1 -- 172.21.15.71:0/3865142791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05700fd7f0 msgr2=0x7f057010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:28.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.993+0000 7f0575e1a640 1 --2- 172.21.15.71:0/3865142791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05700fd7f0 0x7f057010d5c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f05580043d0 tx=0x7f0558009da0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.993+0000 7f0575e1a640 1 -- 172.21.15.71:0/3865142791 shutdown_connections 2024-09-10T10:10:28.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.993+0000 7f0575e1a640 1 --2- 172.21.15.71:0/3865142791 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f055c06e0b0 0x7f055c070560 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.993+0000 7f0575e1a640 1 --2- 172.21.15.71:0/3865142791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05700fd7f0 0x7f057010d5c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.993+0000 7f0575e1a640 1 --2- 172.21.15.71:0/3865142791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05700fc520 0x7f057010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.993+0000 7f0575e1a640 1 -- 172.21.15.71:0/3865142791 >> 172.21.15.71:0/3865142791 conn(0x7f05700f7ce0 msgr2=0x7f05700f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:28.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.993+0000 7f0575e1a640 1 -- 172.21.15.71:0/3865142791 shutdown_connections 2024-09-10T10:10:28.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:28.993+0000 7f0575e1a640 1 -- 172.21.15.71:0/3865142791 wait complete. 2024-09-10T10:10:29.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.071+0000 7f80edac5640 1 -- 172.21.15.71:0/2934937677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e80fd820 msgr2=0x7f80e80fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.071+0000 7f80edac5640 1 --2- 172.21.15.71:0/2934937677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e80fd820 0x7f80e80fdc90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0048d0 tx=0x7f80dc009da0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.071+0000 7f80edac5640 1 -- 172.21.15.71:0/2934937677 shutdown_connections 2024-09-10T10:10:29.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.071+0000 7f80edac5640 1 --2- 172.21.15.71:0/2934937677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e80fd820 0x7f80e80fdc90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.071+0000 7f80edac5640 1 --2- 172.21.15.71:0/2934937677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80fc550 0x7f80e80fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.071+0000 7f80edac5640 1 -- 172.21.15.71:0/2934937677 >> 172.21.15.71:0/2934937677 conn(0x7f80e80f7d30 msgr2=0x7f80e80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:29.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.072+0000 7f80edac5640 1 -- 172.21.15.71:0/2934937677 shutdown_connections 2024-09-10T10:10:29.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.072+0000 7f80edac5640 1 -- 172.21.15.71:0/2934937677 wait complete. 2024-09-10T10:10:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.072+0000 7f80edac5640 1 Processor -- start 2024-09-10T10:10:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.072+0000 7f80edac5640 1 -- start start 2024-09-10T10:10:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.072+0000 7f80edac5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80fc550 0x7f80e810f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.072+0000 7f80edac5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e80fd820 0x7f80e810f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.072+0000 7f80edac5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e810fe70 con 0x7f80e80fd820 2024-09-10T10:10:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.072+0000 7f80edac5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8110690 con 0x7f80e80fc550 2024-09-10T10:10:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80e6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e80fd820 0x7f80e810f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80e6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e80fd820 0x7f80e810f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37690/0 (socket says 172.21.15.71:37690) 2024-09-10T10:10:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80e6ffd640 1 -- 172.21.15.71:0/3737198828 learned_addr learned my addr 172.21.15.71:0/3737198828 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:10:29.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80e77fe640 1 --2- 172.21.15.71:0/3737198828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80fc550 0x7f80e810f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80e77fe640 1 -- 172.21.15.71:0/3737198828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e80fd820 msgr2=0x7f80e810f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80e77fe640 1 --2- 172.21.15.71:0/3737198828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e80fd820 0x7f80e810f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80e77fe640 1 -- 172.21.15.71:0/3737198828 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc005040 con 0x7f80e80fc550 2024-09-10T10:10:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80e6ffd640 1 --2- 172.21.15.71:0/3737198828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e80fd820 0x7f80e810f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80e77fe640 1 --2- 172.21.15.71:0/3737198828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80fc550 0x7f80e810f2e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f80d80027a0 tx=0x7f80d8009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80cffff640 1 -- 172.21.15.71:0/3737198828 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80d8002d30 con 0x7f80e80fc550 2024-09-10T10:10:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80cffff640 1 -- 172.21.15.71:0/3737198828 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f80d800f040 con 0x7f80e80fc550 2024-09-10T10:10:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80edac5640 1 -- 172.21.15.71:0/3737198828 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e8110920 con 0x7f80e80fc550 2024-09-10T10:10:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80cffff640 1 -- 172.21.15.71:0/3737198828 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80d8009430 con 0x7f80e80fc550 2024-09-10T10:10:29.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.073+0000 7f80edac5640 1 -- 172.21.15.71:0/3737198828 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e8110ec0 con 0x7f80e80fc550 2024-09-10T10:10:29.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.074+0000 7f80edac5640 1 -- 172.21.15.71:0/3737198828 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e80fb9b0 con 0x7f80e80fc550 2024-09-10T10:10:29.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.075+0000 7f80cffff640 1 -- 172.21.15.71:0/3737198828 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f80d80096b0 con 0x7f80e80fc550 2024-09-10T10:10:29.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.076+0000 7f80cffff640 1 --2- 172.21.15.71:0/3737198828 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f80d006e0b0 0x7f80d0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:29.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.076+0000 7f80cffff640 1 -- 172.21.15.71:0/3737198828 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f80d808d9a0 con 0x7f80e80fc550 2024-09-10T10:10:29.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.076+0000 7f80e6ffd640 1 --2- 172.21.15.71:0/3737198828 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f80d006e0b0 0x7f80d0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:29.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.076+0000 7f80e6ffd640 1 --2- 172.21.15.71:0/3737198828 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f80d006e0b0 0x7f80d0070560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80e810f090 tx=0x7f80dc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:29.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.080+0000 7f80cffff640 1 -- 172.21.15.71:0/3737198828 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f80d8056cd0 con 0x7f80e80fc550 2024-09-10T10:10:29.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.255+0000 7f80edac5640 1 -- 172.21.15.71:0/3737198828 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f80e8111260 con 0x7f80d006e0b0 2024-09-10T10:10:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.263+0000 7f80cffff640 1 -- 172.21.15.71:0/3737198828 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f80e8111260 con 0x7f80d006e0b0 2024-09-10T10:10:29.264 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:10:29.265 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (5m) 96s ago 14m 26.4M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:10:29.265 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (3m) 96s ago 14m 6903k - 19.1.1-305-g1cf819b7 41d671128357 5dc74ad01560 2024-09-10T10:10:29.265 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (3m) 31s ago 13m 6891k - 19.1.1-305-g1cf819b7 41d671128357 6f4355e875db 2024-09-10T10:10:29.265 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (5m) 96s ago 14m 78.2M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:10:29.265 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (8m) 96s ago 8m 113M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:10:29.265 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (8m) 96s ago 8m 65.2M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:10:29.265 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (8m) 31s ago 8m 108M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:10:29.265 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (8m) 31s ago 8m 62.7M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:10:29.265 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (5m) 96s ago 15m 498M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:10:29.265 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (4m) 31s ago 13m 440M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:10:29.265 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (4m) 96s ago 15m 47.2M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:10:29.265 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (3m) 31s ago 13m 39.9M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:10:29.266 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (5m) 96s ago 14m 16.2M - 1.5.0 0da6a335fe13 c3d47d79cd22 2024-09-10T10:10:29.266 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (5m) 31s ago 13m 16.7M - 1.5.0 0da6a335fe13 9a25165a0fd1 2024-09-10T10:10:29.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (2m) 96s ago 12m 95.6M 1557M 19.1.1-305-g1cf819b7 41d671128357 f1e9da1144c1 2024-09-10T10:10:29.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (2m) 96s ago 12m 98.8M 1557M 19.1.1-305-g1cf819b7 41d671128357 5afc8bef5343 2024-09-10T10:10:29.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (101s) 96s ago 11m 12.1M 1557M 19.1.1-305-g1cf819b7 41d671128357 5e5976fcfaa8 2024-09-10T10:10:29.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (67s) 31s ago 11m 104M 2581M 19.1.1-305-g1cf819b7 41d671128357 e22ee626ccd0 2024-09-10T10:10:29.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (35s) 31s ago 10m 11.5M 2581M 19.1.1-305-g1cf819b7 41d671128357 e92f23ad2c77 2024-09-10T10:10:29.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 starting - - - 2581M 2024-09-10T10:10:29.266 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (4m) 96s ago 13m 56.5M - 2.43.0 a07b618ecd1d 47d3ae62ce5e 2024-09-10T10:10:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.265+0000 7f80edac5640 1 -- 172.21.15.71:0/3737198828 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f80d006e0b0 msgr2=0x7f80d0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.265+0000 7f80edac5640 1 --2- 172.21.15.71:0/3737198828 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f80d006e0b0 0x7f80d0070560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80e810f090 tx=0x7f80dc035040 comp rx=0 tx=0).stop 2024-09-10T10:10:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.265+0000 7f80edac5640 1 -- 172.21.15.71:0/3737198828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80fc550 msgr2=0x7f80e810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.265+0000 7f80edac5640 1 --2- 172.21.15.71:0/3737198828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80fc550 0x7f80e810f2e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f80d80027a0 tx=0x7f80d8009f30 comp rx=0 tx=0).stop 2024-09-10T10:10:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.265+0000 7f80edac5640 1 -- 172.21.15.71:0/3737198828 shutdown_connections 2024-09-10T10:10:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.265+0000 7f80edac5640 1 --2- 172.21.15.71:0/3737198828 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f80d006e0b0 0x7f80d0070560 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.265+0000 7f80edac5640 1 --2- 172.21.15.71:0/3737198828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e80fd820 0x7f80e810f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.265+0000 7f80edac5640 1 --2- 172.21.15.71:0/3737198828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80fc550 0x7f80e810f2e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.265+0000 7f80edac5640 1 -- 172.21.15.71:0/3737198828 >> 172.21.15.71:0/3737198828 conn(0x7f80e80f7d30 msgr2=0x7f80e80f9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.265+0000 7f80edac5640 1 -- 172.21.15.71:0/3737198828 shutdown_connections 2024-09-10T10:10:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.265+0000 7f80edac5640 1 -- 172.21.15.71:0/3737198828 wait complete. 2024-09-10T10:10:29.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.344+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/3408122513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440fd820 msgr2=0x7f0d440fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.344+0000 7f0d4c5e8640 1 --2- 172.21.15.71:0/3408122513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440fd820 0x7f0d440fdc90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d400048d0 tx=0x7f0d40009da0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.346 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:29 smithi071 ceph-mon[90773]: pgmap v152: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-10T10:10:29.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.345+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/3408122513 shutdown_connections 2024-09-10T10:10:29.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.345+0000 7f0d4c5e8640 1 --2- 172.21.15.71:0/3408122513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440fd820 0x7f0d440fdc90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.345+0000 7f0d4c5e8640 1 --2- 172.21.15.71:0/3408122513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d440fc550 0x7f0d440fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.345+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/3408122513 >> 172.21.15.71:0/3408122513 conn(0x7f0d440f7d30 msgr2=0x7f0d440fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:29.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.345+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/3408122513 shutdown_connections 2024-09-10T10:10:29.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.345+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/3408122513 wait complete. 2024-09-10T10:10:29.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.345+0000 7f0d4c5e8640 1 Processor -- start 2024-09-10T10:10:29.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.345+0000 7f0d4c5e8640 1 -- start start 2024-09-10T10:10:29.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d4c5e8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440fc550 0x7f0d4410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:29.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d4c5e8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d440fd820 0x7f0d4410d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:29.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d4c5e8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4410dc40 con 0x7f0d440fc550 2024-09-10T10:10:29.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d4c5e8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4410e460 con 0x7f0d440fd820 2024-09-10T10:10:29.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d4a384640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440fc550 0x7f0d4410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:29.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d4a384640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440fc550 0x7f0d4410d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37712/0 (socket says 172.21.15.71:37712) 2024-09-10T10:10:29.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d4a384640 1 -- 172.21.15.71:0/2757066473 learned_addr learned my addr 172.21.15.71:0/2757066473 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:10:29.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d49b83640 1 --2- 172.21.15.71:0/2757066473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d440fd820 0x7f0d4410d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:29.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d4a384640 1 -- 172.21.15.71:0/2757066473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d440fd820 msgr2=0x7f0d4410d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d4a384640 1 --2- 172.21.15.71:0/2757066473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d440fd820 0x7f0d4410d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d4a384640 1 -- 172.21.15.71:0/2757066473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d40005040 con 0x7f0d440fc550 2024-09-10T10:10:29.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d4a384640 1 --2- 172.21.15.71:0/2757066473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440fc550 0x7f0d4410d0b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800eb70 tx=0x7f0d3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:29.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d36ffd640 1 -- 172.21.15.71:0/2757066473 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d38007c30 con 0x7f0d440fc550 2024-09-10T10:10:29.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.346+0000 7f0d36ffd640 1 -- 172.21.15.71:0/2757066473 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0d3800f040 con 0x7f0d440fc550 2024-09-10T10:10:29.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.347+0000 7f0d36ffd640 1 -- 172.21.15.71:0/2757066473 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d3800ca60 con 0x7f0d440fc550 2024-09-10T10:10:29.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.347+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/2757066473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4410e690 con 0x7f0d440fc550 2024-09-10T10:10:29.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.347+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/2757066473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4410ebe0 con 0x7f0d440fc550 2024-09-10T10:10:29.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.348+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/2757066473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d440fb9b0 con 0x7f0d440fc550 2024-09-10T10:10:29.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.348+0000 7f0d36ffd640 1 -- 172.21.15.71:0/2757066473 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0d3800cbc0 con 0x7f0d440fc550 2024-09-10T10:10:29.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.349+0000 7f0d36ffd640 1 --2- 172.21.15.71:0/2757066473 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f0d3006e0b0 0x7f0d30070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:29.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.349+0000 7f0d36ffd640 1 -- 172.21.15.71:0/2757066473 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0d3808d7a0 con 0x7f0d440fc550 2024-09-10T10:10:29.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.349+0000 7f0d49b83640 1 --2- 172.21.15.71:0/2757066473 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f0d3006e0b0 0x7f0d30070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:29.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.349+0000 7f0d49b83640 1 --2- 172.21.15.71:0/2757066473 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f0d3006e0b0 0x7f0d30070560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d4410ce60 tx=0x7f0d40035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:29.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.353+0000 7f0d36ffd640 1 -- 172.21.15.71:0/2757066473 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0d38056b80 con 0x7f0d440fc550 2024-09-10T10:10:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.589+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/2757066473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0d4410eef0 con 0x7f0d440fc550 2024-09-10T10:10:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.590+0000 7f0d36ffd640 1 -- 172.21.15.71:0/2757066473 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7f0d3805a240 con 0x7f0d440fc550 2024-09-10T10:10:29.591 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:10:29.592 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:10:29.592 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:10:29.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:10:29.592 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:10:29.592 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:10:29.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:10:29.592 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:10:29.592 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 5 2024-09-10T10:10:29.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:10:29.592 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:10:29.592 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:10:29.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:10:29.592 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:10:29.593 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4, 2024-09-10T10:10:29.593 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 9 2024-09-10T10:10:29.593 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:10:29.593 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:10:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.592+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/2757066473 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f0d3006e0b0 msgr2=0x7f0d30070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.592+0000 7f0d4c5e8640 1 --2- 172.21.15.71:0/2757066473 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f0d3006e0b0 0x7f0d30070560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d4410ce60 tx=0x7f0d40035040 comp rx=0 tx=0).stop 2024-09-10T10:10:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.592+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/2757066473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440fc550 msgr2=0x7f0d4410d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.592+0000 7f0d4c5e8640 1 --2- 172.21.15.71:0/2757066473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440fc550 0x7f0d4410d0b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800eb70 tx=0x7f0d3800b040 comp rx=0 tx=0).stop 2024-09-10T10:10:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.592+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/2757066473 shutdown_connections 2024-09-10T10:10:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.592+0000 7f0d4c5e8640 1 --2- 172.21.15.71:0/2757066473 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f0d3006e0b0 0x7f0d30070560 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.592+0000 7f0d4c5e8640 1 --2- 172.21.15.71:0/2757066473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d440fd820 0x7f0d4410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.592+0000 7f0d4c5e8640 1 --2- 172.21.15.71:0/2757066473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440fc550 0x7f0d4410d0b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.592+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/2757066473 >> 172.21.15.71:0/2757066473 conn(0x7f0d440f7d30 msgr2=0x7f0d440f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.593+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/2757066473 shutdown_connections 2024-09-10T10:10:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.593+0000 7f0d4c5e8640 1 -- 172.21.15.71:0/2757066473 wait complete. 2024-09-10T10:10:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:29 smithi107 ceph-mon[79396]: pgmap v152: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-10T10:10:29.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.671+0000 7fd17f882640 1 -- 172.21.15.71:0/1916778542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1780fc550 msgr2=0x7fd1780fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.671+0000 7fd17f882640 1 --2- 172.21.15.71:0/1916778542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1780fc550 0x7fd1780fc960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1680048d0 tx=0x7fd168009da0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.671+0000 7fd17f882640 1 -- 172.21.15.71:0/1916778542 shutdown_connections 2024-09-10T10:10:29.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.671+0000 7fd17f882640 1 --2- 172.21.15.71:0/1916778542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1780fd820 0x7fd1780fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.671+0000 7fd17f882640 1 --2- 172.21.15.71:0/1916778542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1780fc550 0x7fd1780fc960 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.671+0000 7fd17f882640 1 -- 172.21.15.71:0/1916778542 >> 172.21.15.71:0/1916778542 conn(0x7fd1780f7d30 msgr2=0x7fd1780fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:29.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.671+0000 7fd17f882640 1 -- 172.21.15.71:0/1916778542 shutdown_connections 2024-09-10T10:10:29.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.671+0000 7fd17f882640 1 -- 172.21.15.71:0/1916778542 wait complete. 2024-09-10T10:10:29.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.671+0000 7fd17f882640 1 Processor -- start 2024-09-10T10:10:29.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.671+0000 7fd17f882640 1 -- start start 2024-09-10T10:10:29.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.672+0000 7fd17f882640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1780fc550 0x7fd17810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.672+0000 7fd17f882640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1780fd820 0x7fd17810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.672+0000 7fd17f882640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17810dc10 con 0x7fd1780fd820 2024-09-10T10:10:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.672+0000 7fd17f882640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17810e430 con 0x7fd1780fc550 2024-09-10T10:10:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.672+0000 7fd17ce1d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1780fd820 0x7fd17810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.672+0000 7fd17ce1d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1780fd820 0x7fd17810d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37726/0 (socket says 172.21.15.71:37726) 2024-09-10T10:10:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.672+0000 7fd17d61e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1780fc550 0x7fd17810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.672+0000 7fd17ce1d640 1 -- 172.21.15.71:0/1058231600 learned_addr learned my addr 172.21.15.71:0/1058231600 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:10:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.672+0000 7fd17ce1d640 1 -- 172.21.15.71:0/1058231600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1780fc550 msgr2=0x7fd17810d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.672+0000 7fd17ce1d640 1 --2- 172.21.15.71:0/1058231600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1780fc550 0x7fd17810d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.672+0000 7fd17ce1d640 1 -- 172.21.15.71:0/1058231600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd168005040 con 0x7fd1780fd820 2024-09-10T10:10:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.672+0000 7fd17ce1d640 1 --2- 172.21.15.71:0/1058231600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1780fd820 0x7fd17810d5c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd174002a80 tx=0x7fd174004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:29.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.673+0000 7fd16dffb640 1 -- 172.21.15.71:0/1058231600 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd174007c30 con 0x7fd1780fd820 2024-09-10T10:10:29.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.673+0000 7fd17f882640 1 -- 172.21.15.71:0/1058231600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17810e6c0 con 0x7fd1780fd820 2024-09-10T10:10:29.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.673+0000 7fd16dffb640 1 -- 172.21.15.71:0/1058231600 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd17400f040 con 0x7fd1780fd820 2024-09-10T10:10:29.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.673+0000 7fd16dffb640 1 -- 172.21.15.71:0/1058231600 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd17400dab0 con 0x7fd1780fd820 2024-09-10T10:10:29.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.673+0000 7fd17f882640 1 -- 172.21.15.71:0/1058231600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17810ebe0 con 0x7fd1780fd820 2024-09-10T10:10:29.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.674+0000 7fd17f882640 1 -- 172.21.15.71:0/1058231600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1780fb9b0 con 0x7fd1780fd820 2024-09-10T10:10:29.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.675+0000 7fd16dffb640 1 -- 172.21.15.71:0/1058231600 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd17400dc10 con 0x7fd1780fd820 2024-09-10T10:10:29.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.675+0000 7fd16dffb640 1 --2- 172.21.15.71:0/1058231600 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd16406e0b0 0x7fd164070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:29.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.675+0000 7fd16dffb640 1 -- 172.21.15.71:0/1058231600 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd17408d410 con 0x7fd1780fd820 2024-09-10T10:10:29.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.675+0000 7fd17d61e640 1 --2- 172.21.15.71:0/1058231600 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd16406e0b0 0x7fd164070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:29.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.676+0000 7fd17d61e640 1 --2- 172.21.15.71:0/1058231600 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd16406e0b0 0x7fd164070560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd16800b020 tx=0x7fd168035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:29.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.680+0000 7fd16dffb640 1 -- 172.21.15.71:0/1058231600 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd1740567f0 con 0x7fd1780fd820 2024-09-10T10:10:29.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.882+0000 7fd17f882640 1 -- 172.21.15.71:0/1058231600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd17810ef00 con 0x7fd1780fd820 2024-09-10T10:10:29.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.882+0000 7fd16dffb640 1 -- 172.21.15.71:0/1058231600 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1955 (secure 0 0 0) 0x7fd174059eb0 con 0x7fd1780fd820 2024-09-10T10:10:29.884 INFO:teuthology.orchestra.run.smithi071.stdout:e24 2024-09-10T10:10:29.884 INFO:teuthology.orchestra.run.smithi071.stdout:btime 2024-09-10T10:07:40:170505+0000 2024-09-10T10:10:29.884 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:10:29.884 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:10:29.884 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:10:29.884 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:10:29.884 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:10:29.884 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:10:29.884 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 24 2024-09-10T10:10:29.884 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:10:29.885 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:10:29.885 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:07:39.792181+0000 2024-09-10T10:10:29.885 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:10:29.885 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:10:29.885 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:10:29.885 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:10:29.885 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:10:29.885 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:10:29.885 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:10:29.885 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:10:29.885 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 45 2024-09-10T10:10:29.885 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:10:29.885 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:10:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:10:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464,1=24267} 2024-09-10T10:10:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:10:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:10:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:10:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:10:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:10:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:10:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:10:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:10:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:10:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 14464 members: 24267,14464 2024-09-10T10:10:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:10:29.887 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:14478} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1596759135,v1:172.21.15.71:6827/1596759135] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:10:29.887 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:10:29.887 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.107:6826/132718485,v1:172.21.15.107:6827/132718485] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:10:29.887 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:10:29.887 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:10:29.888 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 24 2024-09-10T10:10:29.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.884+0000 7fd17f882640 1 -- 172.21.15.71:0/1058231600 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd16406e0b0 msgr2=0x7fd164070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.884+0000 7fd17f882640 1 --2- 172.21.15.71:0/1058231600 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd16406e0b0 0x7fd164070560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd16800b020 tx=0x7fd168035040 comp rx=0 tx=0).stop 2024-09-10T10:10:29.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.884+0000 7fd17f882640 1 -- 172.21.15.71:0/1058231600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1780fd820 msgr2=0x7fd17810d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.884+0000 7fd17f882640 1 --2- 172.21.15.71:0/1058231600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1780fd820 0x7fd17810d5c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd174002a80 tx=0x7fd174004600 comp rx=0 tx=0).stop 2024-09-10T10:10:29.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.884+0000 7fd17f882640 1 -- 172.21.15.71:0/1058231600 shutdown_connections 2024-09-10T10:10:29.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.884+0000 7fd17f882640 1 --2- 172.21.15.71:0/1058231600 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd16406e0b0 0x7fd164070560 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.884+0000 7fd17f882640 1 --2- 172.21.15.71:0/1058231600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1780fd820 0x7fd17810d5c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.884+0000 7fd17f882640 1 --2- 172.21.15.71:0/1058231600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1780fc550 0x7fd17810d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.884+0000 7fd17f882640 1 -- 172.21.15.71:0/1058231600 >> 172.21.15.71:0/1058231600 conn(0x7fd1780f7d30 msgr2=0x7fd1780f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:29.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.884+0000 7fd17f882640 1 -- 172.21.15.71:0/1058231600 shutdown_connections 2024-09-10T10:10:29.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.884+0000 7fd17f882640 1 -- 172.21.15.71:0/1058231600 wait complete. 2024-09-10T10:10:29.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.964+0000 7f2eddd95640 1 -- 172.21.15.71:0/1562412172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed8065c40 msgr2=0x7f2ed80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.964+0000 7f2eddd95640 1 --2- 172.21.15.71:0/1562412172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed8065c40 0x7f2ed80ff140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80048d0 tx=0x7f2ec8009da0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.964+0000 7f2eddd95640 1 -- 172.21.15.71:0/1562412172 shutdown_connections 2024-09-10T10:10:29.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.964+0000 7f2eddd95640 1 --2- 172.21.15.71:0/1562412172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ed80ff680 0x7f2ed8101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.964+0000 7f2eddd95640 1 --2- 172.21.15.71:0/1562412172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed8065c40 0x7f2ed80ff140 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.964+0000 7f2eddd95640 1 -- 172.21.15.71:0/1562412172 >> 172.21.15.71:0/1562412172 conn(0x7f2ed80f6c10 msgr2=0x7f2ed80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:29.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.964+0000 7f2eddd95640 1 -- 172.21.15.71:0/1562412172 shutdown_connections 2024-09-10T10:10:29.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.964+0000 7f2eddd95640 1 -- 172.21.15.71:0/1562412172 wait complete. 2024-09-10T10:10:29.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.964+0000 7f2eddd95640 1 Processor -- start 2024-09-10T10:10:29.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.964+0000 7f2eddd95640 1 -- start start 2024-09-10T10:10:29.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2eddd95640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ed8065c40 0x7f2ed810d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:29.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2eddd95640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed80ff680 0x7f2ed810d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:29.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2eddd95640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed810dca0 con 0x7f2ed80ff680 2024-09-10T10:10:29.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2eddd95640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed810e470 con 0x7f2ed8065c40 2024-09-10T10:10:29.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2ecffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed80ff680 0x7f2ed810d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:29.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2ecffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed80ff680 0x7f2ed810d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37744/0 (socket says 172.21.15.71:37744) 2024-09-10T10:10:29.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2ecffff640 1 -- 172.21.15.71:0/197288764 learned_addr learned my addr 172.21.15.71:0/197288764 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:10:29.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2ed77fe640 1 --2- 172.21.15.71:0/197288764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ed8065c40 0x7f2ed810d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:29.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2ecffff640 1 -- 172.21.15.71:0/197288764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ed8065c40 msgr2=0x7f2ed810d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:29.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2ecffff640 1 --2- 172.21.15.71:0/197288764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ed8065c40 0x7f2ed810d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:29.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2ecffff640 1 -- 172.21.15.71:0/197288764 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec8005040 con 0x7f2ed80ff680 2024-09-10T10:10:29.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2ed77fe640 1 --2- 172.21.15.71:0/197288764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ed8065c40 0x7f2ed810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:29.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2ecffff640 1 --2- 172.21.15.71:0/197288764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed80ff680 0x7f2ed810d650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000eb70 tx=0x7f2ec000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:29.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2ed4ff9640 1 -- 172.21.15.71:0/197288764 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ec0007c30 con 0x7f2ed80ff680 2024-09-10T10:10:29.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2ed4ff9640 1 -- 172.21.15.71:0/197288764 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2ec000f040 con 0x7f2ed80ff680 2024-09-10T10:10:29.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2eddd95640 1 -- 172.21.15.71:0/197288764 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed810e6a0 con 0x7f2ed80ff680 2024-09-10T10:10:29.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.965+0000 7f2ed4ff9640 1 -- 172.21.15.71:0/197288764 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ec0009470 con 0x7f2ed80ff680 2024-09-10T10:10:29.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.966+0000 7f2eddd95640 1 -- 172.21.15.71:0/197288764 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed810ec40 con 0x7f2ed80ff680 2024-09-10T10:10:29.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.967+0000 7f2eddd95640 1 -- 172.21.15.71:0/197288764 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed80fa890 con 0x7f2ed80ff680 2024-09-10T10:10:29.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.968+0000 7f2ed4ff9640 1 -- 172.21.15.71:0/197288764 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2ec00096e0 con 0x7f2ed80ff680 2024-09-10T10:10:29.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.968+0000 7f2ed4ff9640 1 --2- 172.21.15.71:0/197288764 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2ec406e0b0 0x7f2ec4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:29.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.968+0000 7f2ed4ff9640 1 -- 172.21.15.71:0/197288764 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2ec008d800 con 0x7f2ed80ff680 2024-09-10T10:10:29.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.968+0000 7f2ed77fe640 1 --2- 172.21.15.71:0/197288764 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2ec406e0b0 0x7f2ec4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:29.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.969+0000 7f2ed77fe640 1 --2- 172.21.15.71:0/197288764 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2ec406e0b0 0x7f2ec4070560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8000c00 tx=0x7f2ec8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:29.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:29.974+0000 7f2ed4ff9640 1 -- 172.21.15.71:0/197288764 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2ec0056be0 con 0x7f2ed80ff680 2024-09-10T10:10:30.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.162+0000 7f2eddd95640 1 -- 172.21.15.71:0/197288764 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ed810ef70 con 0x7f2ec406e0b0 2024-09-10T10:10:30.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.163+0000 7f2ed4ff9640 1 -- 172.21.15.71:0/197288764 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2ed810ef70 con 0x7f2ec406e0b0 2024-09-10T10:10:30.164 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:10:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:10:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:10:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:10:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:10:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "osd", 2024-09-10T10:10:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-09-10T10:10:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-10T10:10:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-10T10:10:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:10:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "12/21 daemons upgraded", 2024-09-10T10:10:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T10:10:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:10:30.165 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:10:30.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.165+0000 7f2eddd95640 1 -- 172.21.15.71:0/197288764 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2ec406e0b0 msgr2=0x7f2ec4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:30.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.165+0000 7f2eddd95640 1 --2- 172.21.15.71:0/197288764 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2ec406e0b0 0x7f2ec4070560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8000c00 tx=0x7f2ec8035040 comp rx=0 tx=0).stop 2024-09-10T10:10:30.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.165+0000 7f2eddd95640 1 -- 172.21.15.71:0/197288764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed80ff680 msgr2=0x7f2ed810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:30.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.165+0000 7f2eddd95640 1 --2- 172.21.15.71:0/197288764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed80ff680 0x7f2ed810d650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000eb70 tx=0x7f2ec000b040 comp rx=0 tx=0).stop 2024-09-10T10:10:30.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.165+0000 7f2eddd95640 1 -- 172.21.15.71:0/197288764 shutdown_connections 2024-09-10T10:10:30.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.165+0000 7f2eddd95640 1 --2- 172.21.15.71:0/197288764 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f2ec406e0b0 0x7f2ec4070560 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.165+0000 7f2eddd95640 1 --2- 172.21.15.71:0/197288764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ed80ff680 0x7f2ed810d650 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.165+0000 7f2eddd95640 1 --2- 172.21.15.71:0/197288764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ed8065c40 0x7f2ed810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.165+0000 7f2eddd95640 1 -- 172.21.15.71:0/197288764 >> 172.21.15.71:0/197288764 conn(0x7f2ed80f6c10 msgr2=0x7f2ed80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:30.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.165+0000 7f2eddd95640 1 -- 172.21.15.71:0/197288764 shutdown_connections 2024-09-10T10:10:30.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.165+0000 7f2eddd95640 1 -- 172.21.15.71:0/197288764 wait complete. 2024-09-10T10:10:30.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.245+0000 7fbe1d800640 1 -- 172.21.15.71:0/616989092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe180fd690 msgr2=0x7fbe180fdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.245+0000 7fbe1d800640 1 --2- 172.21.15.71:0/616989092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe180fd690 0x7fbe180fdb00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0048d0 tx=0x7fbe0c009da0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.245+0000 7fbe1d800640 1 -- 172.21.15.71:0/616989092 shutdown_connections 2024-09-10T10:10:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.245+0000 7fbe1d800640 1 --2- 172.21.15.71:0/616989092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe180fd690 0x7fbe180fdb00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.245+0000 7fbe1d800640 1 --2- 172.21.15.71:0/616989092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe180fc3c0 0x7fbe180fc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.245+0000 7fbe1d800640 1 -- 172.21.15.71:0/616989092 >> 172.21.15.71:0/616989092 conn(0x7fbe180f7bc0 msgr2=0x7fbe180f9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.245+0000 7fbe1d800640 1 -- 172.21.15.71:0/616989092 shutdown_connections 2024-09-10T10:10:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.245+0000 7fbe1d800640 1 -- 172.21.15.71:0/616989092 wait complete. 2024-09-10T10:10:30.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.246+0000 7fbe1d800640 1 Processor -- start 2024-09-10T10:10:30.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.246+0000 7fbe1d800640 1 -- start start 2024-09-10T10:10:30.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.246+0000 7fbe1d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe180fc3c0 0x7fbe1810f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:30.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.246+0000 7fbe1d800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe180fd690 0x7fbe1810f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:30.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.246+0000 7fbe1d800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1810fca0 con 0x7fbe180fc3c0 2024-09-10T10:10:30.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.246+0000 7fbe1d800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe181104c0 con 0x7fbe180fd690 2024-09-10T10:10:30.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.246+0000 7fbe16ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe180fc3c0 0x7fbe1810f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:30.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.246+0000 7fbe16ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe180fc3c0 0x7fbe1810f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37760/0 (socket says 172.21.15.71:37760) 2024-09-10T10:10:30.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.246+0000 7fbe16ffd640 1 -- 172.21.15.71:0/3975063316 learned_addr learned my addr 172.21.15.71:0/3975063316 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:10:30.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.246+0000 7fbe167fc640 1 --2- 172.21.15.71:0/3975063316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe180fd690 0x7fbe1810f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:30.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.246+0000 7fbe16ffd640 1 -- 172.21.15.71:0/3975063316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe180fd690 msgr2=0x7fbe1810f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:30.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.246+0000 7fbe16ffd640 1 --2- 172.21.15.71:0/3975063316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe180fd690 0x7fbe1810f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.246+0000 7fbe16ffd640 1 -- 172.21.15.71:0/3975063316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c005040 con 0x7fbe180fc3c0 2024-09-10T10:10:30.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.247+0000 7fbe16ffd640 1 --2- 172.21.15.71:0/3975063316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe180fc3c0 0x7fbe1810f110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800eb70 tx=0x7fbe0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:30.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.247+0000 7fbdff7fe640 1 -- 172.21.15.71:0/3975063316 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe08007c30 con 0x7fbe180fc3c0 2024-09-10T10:10:30.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.247+0000 7fbe1d800640 1 -- 172.21.15.71:0/3975063316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe181106f0 con 0x7fbe180fc3c0 2024-09-10T10:10:30.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.247+0000 7fbdff7fe640 1 -- 172.21.15.71:0/3975063316 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbe0800f040 con 0x7fbe180fc3c0 2024-09-10T10:10:30.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.247+0000 7fbdff7fe640 1 -- 172.21.15.71:0/3975063316 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe0800ca60 con 0x7fbe180fc3c0 2024-09-10T10:10:30.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.247+0000 7fbe1d800640 1 -- 172.21.15.71:0/3975063316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe18110c90 con 0x7fbe180fc3c0 2024-09-10T10:10:30.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.248+0000 7fbe1d800640 1 -- 172.21.15.71:0/3975063316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe1805ed70 con 0x7fbe180fc3c0 2024-09-10T10:10:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.249+0000 7fbdff7fe640 1 -- 172.21.15.71:0/3975063316 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbe0800cbc0 con 0x7fbe180fc3c0 2024-09-10T10:10:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.249+0000 7fbdff7fe640 1 --2- 172.21.15.71:0/3975063316 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fbe0006e0b0 0x7fbe00070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.250+0000 7fbdff7fe640 1 -- 172.21.15.71:0/3975063316 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fbe0808dbe0 con 0x7fbe180fc3c0 2024-09-10T10:10:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.250+0000 7fbe167fc640 1 --2- 172.21.15.71:0/3975063316 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fbe0006e0b0 0x7fbe00070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.250+0000 7fbe167fc640 1 --2- 172.21.15.71:0/3975063316 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fbe0006e0b0 0x7fbe00070560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c007ac0 tx=0x7fbe0c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:30.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.254+0000 7fbdff7fe640 1 -- 172.21.15.71:0/3975063316 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbe08057040 con 0x7fbe180fc3c0 2024-09-10T10:10:30.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.486+0000 7fbe1d800640 1 -- 172.21.15.71:0/3975063316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbe1804b720 con 0x7fbe180fc3c0 2024-09-10T10:10:30.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.487+0000 7fbdff7fe640 1 -- 172.21.15.71:0/3975063316 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1290 (secure 0 0 0) 0x7fbe0805a700 con 0x7fbe180fc3c0 2024-09-10T10:10:30.488 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 51/321 objects degraded (15.888%), 14 pgs degraded 2024-09-10T10:10:30.488 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-10T10:10:30.488 INFO:teuthology.orchestra.run.smithi071.stdout: osd.5 (root=default,host=smithi107) is down 2024-09-10T10:10:30.489 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-10T10:10:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-10T10:10:30.489 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 51/321 objects degraded (15.888%), 14 pgs degraded 2024-09-10T10:10:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-10T10:10:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-10T10:10:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-09-10T10:10:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-10T10:10:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-10T10:10:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-10T10:10:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-10T10:10:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-09-10T10:10:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-10T10:10:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-10T10:10:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-10T10:10:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-10T10:10:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-10T10:10:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-10T10:10:30.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.489+0000 7fbe1d800640 1 -- 172.21.15.71:0/3975063316 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fbe0006e0b0 msgr2=0x7fbe00070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:30.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.489+0000 7fbe1d800640 1 --2- 172.21.15.71:0/3975063316 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fbe0006e0b0 0x7fbe00070560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c007ac0 tx=0x7fbe0c035040 comp rx=0 tx=0).stop 2024-09-10T10:10:30.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.489+0000 7fbe1d800640 1 -- 172.21.15.71:0/3975063316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe180fc3c0 msgr2=0x7fbe1810f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:30.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.489+0000 7fbe1d800640 1 --2- 172.21.15.71:0/3975063316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe180fc3c0 0x7fbe1810f110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800eb70 tx=0x7fbe0800b040 comp rx=0 tx=0).stop 2024-09-10T10:10:30.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.489+0000 7fbe1d800640 1 -- 172.21.15.71:0/3975063316 shutdown_connections 2024-09-10T10:10:30.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.489+0000 7fbe1d800640 1 --2- 172.21.15.71:0/3975063316 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fbe0006e0b0 0x7fbe00070560 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.489+0000 7fbe1d800640 1 --2- 172.21.15.71:0/3975063316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe180fd690 0x7fbe1810f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.489+0000 7fbe1d800640 1 --2- 172.21.15.71:0/3975063316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe180fc3c0 0x7fbe1810f110 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.489+0000 7fbe1d800640 1 -- 172.21.15.71:0/3975063316 >> 172.21.15.71:0/3975063316 conn(0x7fbe180f7bc0 msgr2=0x7fbe180f93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:30.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.489+0000 7fbe1d800640 1 -- 172.21.15.71:0/3975063316 shutdown_connections 2024-09-10T10:10:30.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:10:30.489+0000 7fbe1d800640 1 -- 172.21.15.71:0/3975063316 wait complete. 2024-09-10T10:10:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:30 smithi071 ceph-mon[90773]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:30 smithi071 ceph-mon[90773]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:30 smithi071 ceph-mon[90773]: from='client.44291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:30 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2757066473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:30 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/1058231600' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:10:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:30.839 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:30 smithi107 ceph-mon[79396]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:30.839 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:30 smithi107 ceph-mon[79396]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:30.839 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:30 smithi107 ceph-mon[79396]: from='client.44291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:30.839 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:30.839 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:30.840 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:30 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2757066473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:30.840 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:30 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/1058231600' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:10:30.840 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:30.840 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:31.748 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:31 smithi107 ceph-mon[79396]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:31.748 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:31 smithi107 ceph-mon[79396]: pgmap v153: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-10T10:10:31.748 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:31 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/3975063316' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:10:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:31 smithi071 ceph-mon[90773]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:31 smithi071 ceph-mon[90773]: pgmap v153: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-10T10:10:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:31 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/3975063316' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:10:33.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:33 smithi107 ceph-mon[79396]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-10T10:10:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:33 smithi107 ceph-mon[79396]: Health check update: Degraded data redundancy: 51/321 objects degraded (15.888%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T10:10:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:33 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:33 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:33 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:33 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:33.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:33 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:33.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:33 smithi071 ceph-mon[90773]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-10T10:10:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:33 smithi071 ceph-mon[90773]: Health check update: Degraded data redundancy: 51/321 objects degraded (15.888%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T10:10:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:33 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:33 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:33 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:33 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:33 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:34.645 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:10:34.302+0000 7f908c044640 -1 osd.5 73 log_to_monitors true 2024-09-10T10:10:34.646 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:10:34.487+0000 7f9083dde640 -1 osd.5 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:10:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: Upgrade: Setting container_image for all osd 2024-09-10T10:10:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-10T10:10:34.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-10T10:10:34.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-10T10:10:34.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-10T10:10:34.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-10T10:10:34.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-10T10:10:34.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-10T10:10:34.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-10T10:10:34.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-10T10:10:34.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-10T10:10:34.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-10T10:10:34.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-10T10:10:34.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-10T10:10:34.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='osd.5 [v2:172.21.15.107:6816/1791678831,v1:172.21.15.107:6817/1791678831]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:10:34.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:34 smithi107 ceph-mon[79396]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:10:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: Upgrade: Setting container_image for all osd 2024-09-10T10:10:34.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:34.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-10T10:10:34.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-10T10:10:34.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-10T10:10:34.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-10T10:10:34.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-10T10:10:34.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-10T10:10:34.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-10T10:10:34.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-10T10:10:34.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-10T10:10:34.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-10T10:10:34.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-10T10:10:34.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-10T10:10:34.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-10T10:10:34.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='osd.5 [v2:172.21.15.107:6816/1791678831,v1:172.21.15.107:6817/1791678831]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:10:34.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:34 smithi071 ceph-mon[90773]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:10:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:35 smithi071 ceph-mon[90773]: Upgrade: Setting require_osd_release to 19 squid 2024-09-10T10:10:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:35 smithi071 ceph-mon[90773]: pgmap v155: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-10T10:10:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:35 smithi071 ceph-mon[90773]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-10T10:10:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:35 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-10T10:10:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:35 smithi071 ceph-mon[90773]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T10:10:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:35 smithi071 ceph-mon[90773]: from='osd.5 [v2:172.21.15.107:6816/1791678831,v1:172.21.15.107:6817/1791678831]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:10:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:35 smithi071 ceph-mon[90773]: osdmap e76: 6 total, 5 up, 6 in 2024-09-10T10:10:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:35 smithi071 ceph-mon[90773]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:10:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:35 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:35 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-10T10:10:35.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:35 smithi107 ceph-mon[79396]: Upgrade: Setting require_osd_release to 19 squid 2024-09-10T10:10:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:35 smithi107 ceph-mon[79396]: pgmap v155: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-10T10:10:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:35 smithi107 ceph-mon[79396]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-10T10:10:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:35 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-10T10:10:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:35 smithi107 ceph-mon[79396]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T10:10:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:35 smithi107 ceph-mon[79396]: from='osd.5 [v2:172.21.15.107:6816/1791678831,v1:172.21.15.107:6817/1791678831]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:10:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:35 smithi107 ceph-mon[79396]: osdmap e76: 6 total, 5 up, 6 in 2024-09-10T10:10:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:35 smithi107 ceph-mon[79396]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-10T10:10:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:35 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:35.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:35 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-10T10:10:36.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-10T10:10:36.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: osdmap e77: 6 total, 5 up, 6 in 2024-09-10T10:10:36.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-10T10:10:36.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-10T10:10:36.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2024-09-10T10:10:36.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:36.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:36.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:36.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:36.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:36.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:36.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:36.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:36.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:36.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:36.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:36 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-10T10:10:36.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-10T10:10:36.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: osdmap e77: 6 total, 5 up, 6 in 2024-09-10T10:10:36.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-10T10:10:36.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-10T10:10:36.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2024-09-10T10:10:36.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:36.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:36.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:36.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:36.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:36.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:36.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:36.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:36.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:36.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:36.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:36 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-10T10:10:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: Upgrade: Scaling down filesystem cephfs 2024-09-10T10:10:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: pgmap v158: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s; 51/321 objects degraded (15.888%) 2024-09-10T10:10:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T10:10:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: osd.5 [v2:172.21.15.107:6816/1791678831,v1:172.21.15.107:6817/1791678831] boot 2024-09-10T10:10:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: osdmap e78: 6 total, 6 up, 6 in 2024-09-10T10:10:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:10:37.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-10T10:10:37.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-10T10:10:37.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: mds.? [v2:172.21.15.107:6826/3716221026,v1:172.21.15.107:6827/3716221026] up:boot 2024-09-10T10:10:37.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: mds.? [v2:172.21.15.71:6826/1437303195,v1:172.21.15.71:6827/1437303195] up:boot 2024-09-10T10:10:37.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: stopping daemon mds.cephfs.smithi107.nycoxn 2024-09-10T10:10:37.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby 2024-09-10T10:10:37.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:10:37.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:10:37.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:37.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:37.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:stopping} 2 up:standby 2024-09-10T10:10:37.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:37.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:37.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:37.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:37.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:37.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:37.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:37.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:37 smithi071 ceph-mon[90773]: osdmap e79: 6 total, 6 up, 6 in 2024-09-10T10:10:37.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: Upgrade: Scaling down filesystem cephfs 2024-09-10T10:10:37.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: pgmap v158: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s; 51/321 objects degraded (15.888%) 2024-09-10T10:10:37.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T10:10:37.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: osd.5 [v2:172.21.15.107:6816/1791678831,v1:172.21.15.107:6817/1791678831] boot 2024-09-10T10:10:37.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: osdmap e78: 6 total, 6 up, 6 in 2024-09-10T10:10:37.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:10:37.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-10T10:10:37.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-10T10:10:37.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: mds.? [v2:172.21.15.107:6826/3716221026,v1:172.21.15.107:6827/3716221026] up:boot 2024-09-10T10:10:37.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: mds.? [v2:172.21.15.71:6826/1437303195,v1:172.21.15.71:6827/1437303195] up:boot 2024-09-10T10:10:37.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: stopping daemon mds.cephfs.smithi107.nycoxn 2024-09-10T10:10:37.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:active} 2 up:standby 2024-09-10T10:10:37.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:10:37.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:10:37.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:37.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:37.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: fsmap cephfs:2 {0=cephfs.smithi071.omoqqq=up:active,1=cephfs.smithi107.nycoxn=up:stopping} 2 up:standby 2024-09-10T10:10:37.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:37.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:37.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:37.898 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:37.898 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:37.898 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:37.898 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:37.898 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:37 smithi107 ceph-mon[79396]: osdmap e79: 6 total, 6 up, 6 in 2024-09-10T10:10:38.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:38 smithi071 ceph-mon[90773]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-10T10:10:38.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:38 smithi107 ceph-mon[79396]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-10T10:10:39.690 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:39 smithi071 ceph-mon[90773]: pgmap v161: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 51/321 objects degraded (15.888%) 2024-09-10T10:10:39.690 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:39.690 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:10:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:39 smithi107 ceph-mon[79396]: pgmap v161: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 51/321 objects degraded (15.888%) 2024-09-10T10:10:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:39.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:10:40.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:40 smithi071 ceph-mon[90773]: pgmap v162: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 254 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 32/321 objects degraded (9.969%) 2024-09-10T10:10:40.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:40 smithi071 ceph-mon[90773]: Health check update: Degraded data redundancy: 32/321 objects degraded (9.969%), 7 pgs degraded (PG_DEGRADED) 2024-09-10T10:10:40.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:40 smithi107 ceph-mon[79396]: pgmap v162: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 254 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 32/321 objects degraded (9.969%) 2024-09-10T10:10:40.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:40 smithi107 ceph-mon[79396]: Health check update: Degraded data redundancy: 32/321 objects degraded (9.969%), 7 pgs degraded (PG_DEGRADED) 2024-09-10T10:10:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:42 smithi071 ceph-mon[90773]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/321 objects degraded (9.969%), 7 pgs degraded) 2024-09-10T10:10:42.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:42 smithi071 ceph-mon[90773]: Cluster is now healthy 2024-09-10T10:10:42.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:42 smithi107 ceph-mon[79396]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/321 objects degraded (9.969%), 7 pgs degraded) 2024-09-10T10:10:42.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:42 smithi107 ceph-mon[79396]: Cluster is now healthy 2024-09-10T10:10:43.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:43 smithi071 ceph-mon[90773]: pgmap v163: 65 pgs: 65 active+clean; 254 MiB data, 993 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 453 B/s wr, 1 op/s 2024-09-10T10:10:43.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:43 smithi107 ceph-mon[79396]: pgmap v163: 65 pgs: 65 active+clean; 254 MiB data, 993 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 453 B/s wr, 1 op/s 2024-09-10T10:10:45.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:45 smithi107 ceph-mon[79396]: pgmap v164: 65 pgs: 65 active+clean; 254 MiB data, 993 MiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-10T10:10:45.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:45 smithi071 ceph-mon[90773]: pgmap v164: 65 pgs: 65 active+clean; 254 MiB data, 993 MiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-10T10:10:47.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:47 smithi107 ceph-mon[79396]: pgmap v165: 65 pgs: 65 active+clean; 250 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 524 B/s wr, 1 op/s 2024-09-10T10:10:47.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:47.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:47.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:47.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:47.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:47.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:47.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:47.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:47.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:47 smithi071 ceph-mon[90773]: pgmap v165: 65 pgs: 65 active+clean; 250 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 524 B/s wr, 1 op/s 2024-09-10T10:10:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:48.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:48 smithi107 ceph-mon[79396]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-10T10:10:48.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:48 smithi071 ceph-mon[90773]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-10T10:10:49.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:49 smithi107 ceph-mon[79396]: pgmap v166: 65 pgs: 65 active+clean; 222 MiB data, 933 MiB used, 536 GiB / 536 GiB avail; 570 B/s wr, 4 op/s 2024-09-10T10:10:49.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:49 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:49 smithi071 ceph-mon[90773]: pgmap v166: 65 pgs: 65 active+clean; 222 MiB data, 933 MiB used, 536 GiB / 536 GiB avail; 570 B/s wr, 4 op/s 2024-09-10T10:10:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:49 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:51.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:51 smithi107 ceph-mon[79396]: pgmap v167: 65 pgs: 65 active+clean; 210 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 5 op/s 2024-09-10T10:10:51.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:51 smithi071 ceph-mon[90773]: pgmap v167: 65 pgs: 65 active+clean; 210 MiB data, 901 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 5 op/s 2024-09-10T10:10:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:53 smithi107 ceph-mon[79396]: pgmap v168: 65 pgs: 65 active+clean; 154 MiB data, 829 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-10T10:10:53.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:53 smithi071 ceph-mon[90773]: pgmap v168: 65 pgs: 65 active+clean; 154 MiB data, 829 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-10T10:10:55.447 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:55.448 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:55 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:10:55.448 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:55 smithi107 ceph-mon[79396]: pgmap v169: 65 pgs: 65 active+clean; 154 MiB data, 797 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 7 op/s 2024-09-10T10:10:55.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:55.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:55 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:10:55.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:55 smithi071 ceph-mon[90773]: pgmap v169: 65 pgs: 65 active+clean; 154 MiB data, 797 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 7 op/s 2024-09-10T10:10:57.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:57 smithi071 ceph-mon[90773]: pgmap v170: 65 pgs: 65 active+clean; 138 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 7 op/s 2024-09-10T10:10:57.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:57.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:57.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:57.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:57.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:57 smithi107 ceph-mon[79396]: pgmap v170: 65 pgs: 65 active+clean; 138 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 7 op/s 2024-09-10T10:10:57.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:57.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:57.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:57.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:10:58.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:58 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:58.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:58 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:58.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:58 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:58.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:58 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:58.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:58 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:58.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:58 smithi071 ceph-mon[90773]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-10T10:10:58.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:58 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:58.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:58 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:58.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:58 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:58.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:58 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:58.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:58 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:10:58.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:58 smithi107 ceph-mon[79396]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-10T10:10:59.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:10:59 smithi071 ceph-mon[90773]: pgmap v171: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 6 op/s 2024-09-10T10:10:59.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:10:59 smithi107 ceph-mon[79396]: pgmap v171: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 6 op/s 2024-09-10T10:11:00.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:00 smithi071 ceph-mon[90773]: daemon mds.cephfs.smithi107.nycoxn finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-10T10:11:00.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.581+0000 7ff4b210a640 1 -- 172.21.15.71:0/185812541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4ac0fc700 msgr2=0x7ff4ac0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:00.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.581+0000 7ff4b210a640 1 --2- 172.21.15.71:0/185812541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4ac0fc700 0x7ff4ac0fcb70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff4940048d0 tx=0x7ff494009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:00.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.581+0000 7ff4b210a640 1 -- 172.21.15.71:0/185812541 shutdown_connections 2024-09-10T10:11:00.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.581+0000 7ff4b210a640 1 --2- 172.21.15.71:0/185812541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4ac0fc700 0x7ff4ac0fcb70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:00.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.581+0000 7ff4b210a640 1 --2- 172.21.15.71:0/185812541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4ac0fb430 0x7ff4ac0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:00.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.581+0000 7ff4b210a640 1 -- 172.21.15.71:0/185812541 >> 172.21.15.71:0/185812541 conn(0x7ff4ac0f6c10 msgr2=0x7ff4ac0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:00.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.581+0000 7ff4b210a640 1 -- 172.21.15.71:0/185812541 shutdown_connections 2024-09-10T10:11:00.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.581+0000 7ff4b210a640 1 -- 172.21.15.71:0/185812541 wait complete. 2024-09-10T10:11:00.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.582+0000 7ff4b210a640 1 Processor -- start 2024-09-10T10:11:00.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.582+0000 7ff4b210a640 1 -- start start 2024-09-10T10:11:00.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.582+0000 7ff4b210a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4ac0fb430 0x7ff4ac10d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:00.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.582+0000 7ff4b210a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4ac0fc700 0x7ff4ac10d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:00.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.582+0000 7ff4b210a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac10dbd0 con 0x7ff4ac0fb430 2024-09-10T10:11:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.582+0000 7ff4b210a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac10e3f0 con 0x7ff4ac0fc700 2024-09-10T10:11:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.582+0000 7ff4ab7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4ac0fb430 0x7ff4ac10d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.582+0000 7ff4ab7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4ac0fb430 0x7ff4ac10d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50380/0 (socket says 172.21.15.71:50380) 2024-09-10T10:11:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.582+0000 7ff4ab7fe640 1 -- 172.21.15.71:0/283803307 learned_addr learned my addr 172.21.15.71:0/283803307 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.582+0000 7ff4a3fff640 1 --2- 172.21.15.71:0/283803307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4ac0fc700 0x7ff4ac10d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.582+0000 7ff4ab7fe640 1 -- 172.21.15.71:0/283803307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4ac0fc700 msgr2=0x7ff4ac10d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.582+0000 7ff4ab7fe640 1 --2- 172.21.15.71:0/283803307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4ac0fc700 0x7ff4ac10d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:00.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.582+0000 7ff4ab7fe640 1 -- 172.21.15.71:0/283803307 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff494005040 con 0x7ff4ac0fb430 2024-09-10T10:11:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.583+0000 7ff4ab7fe640 1 --2- 172.21.15.71:0/283803307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4ac0fb430 0x7ff4ac10d040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00c810 tx=0x7ff49c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.583+0000 7ff4a8ff9640 1 -- 172.21.15.71:0/283803307 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff49c00a820 con 0x7ff4ac0fb430 2024-09-10T10:11:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.583+0000 7ff4b210a640 1 -- 172.21.15.71:0/283803307 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ac10e680 con 0x7ff4ac0fb430 2024-09-10T10:11:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.583+0000 7ff4a8ff9640 1 -- 172.21.15.71:0/283803307 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff49c00ae20 con 0x7ff4ac0fb430 2024-09-10T10:11:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.583+0000 7ff4a8ff9640 1 -- 172.21.15.71:0/283803307 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff49c0115c0 con 0x7ff4ac0fb430 2024-09-10T10:11:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.583+0000 7ff4b210a640 1 -- 172.21.15.71:0/283803307 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ac10ec20 con 0x7ff4ac0fb430 2024-09-10T10:11:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.584+0000 7ff4b210a640 1 -- 172.21.15.71:0/283803307 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ac0fa890 con 0x7ff4ac0fb430 2024-09-10T10:11:00.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.585+0000 7ff4a8ff9640 1 -- 172.21.15.71:0/283803307 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff49c00a980 con 0x7ff4ac0fb430 2024-09-10T10:11:00.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.585+0000 7ff4a8ff9640 1 --2- 172.21.15.71:0/283803307 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff49806e0b0 0x7ff498070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:00.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.585+0000 7ff4a8ff9640 1 -- 172.21.15.71:0/283803307 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff49c08e130 con 0x7ff4ac0fb430 2024-09-10T10:11:00.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.585+0000 7ff4a3fff640 1 --2- 172.21.15.71:0/283803307 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff49806e0b0 0x7ff498070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:00.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.586+0000 7ff4a3fff640 1 --2- 172.21.15.71:0/283803307 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff49806e0b0 0x7ff498070560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff494007ac0 tx=0x7ff494035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:00.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.590+0000 7ff4a8ff9640 1 -- 172.21.15.71:0/283803307 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff49c05af90 con 0x7ff4ac0fb430 2024-09-10T10:11:00.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:00 smithi107 ceph-mon[79396]: daemon mds.cephfs.smithi107.nycoxn finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-10T10:11:00.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.773+0000 7ff4b210a640 1 -- 172.21.15.71:0/283803307 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4ac10eea0 con 0x7ff49806e0b0 2024-09-10T10:11:00.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.775+0000 7ff4a8ff9640 1 -- 172.21.15.71:0/283803307 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff4ac10eea0 con 0x7ff49806e0b0 2024-09-10T10:11:00.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.777+0000 7ff4b210a640 1 -- 172.21.15.71:0/283803307 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff49806e0b0 msgr2=0x7ff498070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:00.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.777+0000 7ff4b210a640 1 --2- 172.21.15.71:0/283803307 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff49806e0b0 0x7ff498070560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff494007ac0 tx=0x7ff494035040 comp rx=0 tx=0).stop 2024-09-10T10:11:00.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.777+0000 7ff4b210a640 1 -- 172.21.15.71:0/283803307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4ac0fb430 msgr2=0x7ff4ac10d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:00.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.777+0000 7ff4b210a640 1 --2- 172.21.15.71:0/283803307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4ac0fb430 0x7ff4ac10d040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00c810 tx=0x7ff49c0043c0 comp rx=0 tx=0).stop 2024-09-10T10:11:00.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.777+0000 7ff4b210a640 1 -- 172.21.15.71:0/283803307 shutdown_connections 2024-09-10T10:11:00.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.777+0000 7ff4b210a640 1 --2- 172.21.15.71:0/283803307 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff49806e0b0 0x7ff498070560 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:00.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.777+0000 7ff4b210a640 1 --2- 172.21.15.71:0/283803307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4ac0fc700 0x7ff4ac10d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:00.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.777+0000 7ff4b210a640 1 --2- 172.21.15.71:0/283803307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4ac0fb430 0x7ff4ac10d040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:00.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.777+0000 7ff4b210a640 1 -- 172.21.15.71:0/283803307 >> 172.21.15.71:0/283803307 conn(0x7ff4ac0f6c10 msgr2=0x7ff4ac0655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:00.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.777+0000 7ff4b210a640 1 -- 172.21.15.71:0/283803307 shutdown_connections 2024-09-10T10:11:00.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.777+0000 7ff4b210a640 1 -- 172.21.15.71:0/283803307 wait complete. 2024-09-10T10:11:00.787 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:11:00.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.856+0000 7f1809b19640 1 -- 172.21.15.71:0/1741208199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1804066690 msgr2=0x7f18040ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:00.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.856+0000 7f1809b19640 1 --2- 172.21.15.71:0/1741208199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1804066690 0x7f18040ff1e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f17f40048d0 tx=0x7f17f4009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:00.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.856+0000 7f1809b19640 1 -- 172.21.15.71:0/1741208199 shutdown_connections 2024-09-10T10:11:00.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.856+0000 7f1809b19640 1 --2- 172.21.15.71:0/1741208199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18040ff720 0x7f1804101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:00.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.856+0000 7f1809b19640 1 --2- 172.21.15.71:0/1741208199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1804066690 0x7f18040ff1e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:00.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.856+0000 7f1809b19640 1 -- 172.21.15.71:0/1741208199 >> 172.21.15.71:0/1741208199 conn(0x7f18040f6c10 msgr2=0x7f18040f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:00.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.856+0000 7f1809b19640 1 -- 172.21.15.71:0/1741208199 shutdown_connections 2024-09-10T10:11:00.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.856+0000 7f1809b19640 1 -- 172.21.15.71:0/1741208199 wait complete. 2024-09-10T10:11:00.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.857+0000 7f1809b19640 1 Processor -- start 2024-09-10T10:11:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.857+0000 7f1809b19640 1 -- start start 2024-09-10T10:11:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.857+0000 7f1809b19640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1804066690 0x7f180410d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.857+0000 7f1809b19640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18040ff720 0x7f180410d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.857+0000 7f1809b19640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180410dcf0 con 0x7f18040ff720 2024-09-10T10:11:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.857+0000 7f1809b19640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180410e510 con 0x7f1804066690 2024-09-10T10:11:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.857+0000 7f1802ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18040ff720 0x7f180410d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.857+0000 7f1802ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18040ff720 0x7f180410d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50394/0 (socket says 172.21.15.71:50394) 2024-09-10T10:11:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.857+0000 7f1802ffd640 1 -- 172.21.15.71:0/1034887985 learned_addr learned my addr 172.21.15.71:0/1034887985 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.858+0000 7f18037fe640 1 --2- 172.21.15.71:0/1034887985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1804066690 0x7f180410d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.858+0000 7f1802ffd640 1 -- 172.21.15.71:0/1034887985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1804066690 msgr2=0x7f180410d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.858+0000 7f1802ffd640 1 --2- 172.21.15.71:0/1034887985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1804066690 0x7f180410d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.858+0000 7f1802ffd640 1 -- 172.21.15.71:0/1034887985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4005040 con 0x7f18040ff720 2024-09-10T10:11:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.858+0000 7f1802ffd640 1 --2- 172.21.15.71:0/1034887985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18040ff720 0x7f180410d6a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00c800 tx=0x7f17ec004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.858+0000 7f17fbfff640 1 -- 172.21.15.71:0/1034887985 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17ec00a7a0 con 0x7f18040ff720 2024-09-10T10:11:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.858+0000 7f17fbfff640 1 -- 172.21.15.71:0/1034887985 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f17ec00ada0 con 0x7f18040ff720 2024-09-10T10:11:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.858+0000 7f1809b19640 1 -- 172.21.15.71:0/1034887985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180410e7a0 con 0x7f18040ff720 2024-09-10T10:11:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.858+0000 7f17fbfff640 1 -- 172.21.15.71:0/1034887985 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17ec0113a0 con 0x7f18040ff720 2024-09-10T10:11:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.858+0000 7f1809b19640 1 -- 172.21.15.71:0/1034887985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180410ed40 con 0x7f18040ff720 2024-09-10T10:11:00.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.859+0000 7f1809b19640 1 -- 172.21.15.71:0/1034887985 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18040fa8b0 con 0x7f18040ff720 2024-09-10T10:11:00.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.860+0000 7f17fbfff640 1 -- 172.21.15.71:0/1034887985 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f17ec012400 con 0x7f18040ff720 2024-09-10T10:11:00.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.860+0000 7f17fbfff640 1 --2- 172.21.15.71:0/1034887985 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f17f006e0b0 0x7f17f0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:00.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.860+0000 7f17fbfff640 1 -- 172.21.15.71:0/1034887985 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f17ec08dbc0 con 0x7f18040ff720 2024-09-10T10:11:00.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.861+0000 7f18037fe640 1 --2- 172.21.15.71:0/1034887985 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f17f006e0b0 0x7f17f0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:00.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.861+0000 7f18037fe640 1 --2- 172.21.15.71:0/1034887985 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f17f006e0b0 0x7f17f0070560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f17f4000c00 tx=0x7f17f4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:00.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:00.865+0000 7f17fbfff640 1 -- 172.21.15.71:0/1034887985 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f17ec057030 con 0x7f18040ff720 2024-09-10T10:11:01.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.048+0000 7f1809b19640 1 -- 172.21.15.71:0/1034887985 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f180410f0e0 con 0x7f17f006e0b0 2024-09-10T10:11:01.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.049+0000 7f17fbfff640 1 -- 172.21.15.71:0/1034887985 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f180410f0e0 con 0x7f17f006e0b0 2024-09-10T10:11:01.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.051+0000 7f1809b19640 1 -- 172.21.15.71:0/1034887985 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f17f006e0b0 msgr2=0x7f17f0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.051+0000 7f1809b19640 1 --2- 172.21.15.71:0/1034887985 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f17f006e0b0 0x7f17f0070560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f17f4000c00 tx=0x7f17f4035040 comp rx=0 tx=0).stop 2024-09-10T10:11:01.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.051+0000 7f1809b19640 1 -- 172.21.15.71:0/1034887985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18040ff720 msgr2=0x7f180410d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.051+0000 7f1809b19640 1 --2- 172.21.15.71:0/1034887985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18040ff720 0x7f180410d6a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00c800 tx=0x7f17ec004430 comp rx=0 tx=0).stop 2024-09-10T10:11:01.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.051+0000 7f1809b19640 1 -- 172.21.15.71:0/1034887985 shutdown_connections 2024-09-10T10:11:01.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.051+0000 7f1809b19640 1 --2- 172.21.15.71:0/1034887985 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f17f006e0b0 0x7f17f0070560 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.051+0000 7f1809b19640 1 --2- 172.21.15.71:0/1034887985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18040ff720 0x7f180410d6a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.051+0000 7f1809b19640 1 --2- 172.21.15.71:0/1034887985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1804066690 0x7f180410d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.051+0000 7f1809b19640 1 -- 172.21.15.71:0/1034887985 >> 172.21.15.71:0/1034887985 conn(0x7f18040f6c10 msgr2=0x7f18040f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:01.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.052+0000 7f1809b19640 1 -- 172.21.15.71:0/1034887985 shutdown_connections 2024-09-10T10:11:01.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.052+0000 7f1809b19640 1 -- 172.21.15.71:0/1034887985 wait complete. 2024-09-10T10:11:01.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.129+0000 7f4509bdc640 1 -- 172.21.15.71:0/4219199018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4504066710 msgr2=0x7f45040ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.129+0000 7f4509bdc640 1 --2- 172.21.15.71:0/4219199018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4504066710 0x7f45040ff180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f44f40048d0 tx=0x7f44f4009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.129+0000 7f4509bdc640 1 -- 172.21.15.71:0/4219199018 shutdown_connections 2024-09-10T10:11:01.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.129+0000 7f4509bdc640 1 --2- 172.21.15.71:0/4219199018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45040ff6c0 0x7f4504101aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.129+0000 7f4509bdc640 1 --2- 172.21.15.71:0/4219199018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4504066710 0x7f45040ff180 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.129+0000 7f4509bdc640 1 -- 172.21.15.71:0/4219199018 >> 172.21.15.71:0/4219199018 conn(0x7f45040f6c10 msgr2=0x7f45040f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:01.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.129+0000 7f4509bdc640 1 -- 172.21.15.71:0/4219199018 shutdown_connections 2024-09-10T10:11:01.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.129+0000 7f4509bdc640 1 -- 172.21.15.71:0/4219199018 wait complete. 2024-09-10T10:11:01.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.130+0000 7f4509bdc640 1 Processor -- start 2024-09-10T10:11:01.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.130+0000 7f4509bdc640 1 -- start start 2024-09-10T10:11:01.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.130+0000 7f4509bdc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4504066710 0x7f45040fcb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:01.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.130+0000 7f4509bdc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45040ff6c0 0x7f45040fb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:01.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.130+0000 7f4509bdc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040fb610 con 0x7f4504066710 2024-09-10T10:11:01.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.130+0000 7f4509bdc640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040fb750 con 0x7f45040ff6c0 2024-09-10T10:11:01.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.130+0000 7f45037fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4504066710 0x7f45040fcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:01.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.131+0000 7f45037fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4504066710 0x7f45040fcb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50414/0 (socket says 172.21.15.71:50414) 2024-09-10T10:11:01.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.131+0000 7f45037fe640 1 -- 172.21.15.71:0/812686225 learned_addr learned my addr 172.21.15.71:0/812686225 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:01.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.131+0000 7f4502ffd640 1 --2- 172.21.15.71:0/812686225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45040ff6c0 0x7f45040fb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:01.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.131+0000 7f45037fe640 1 -- 172.21.15.71:0/812686225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45040ff6c0 msgr2=0x7f45040fb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.131+0000 7f45037fe640 1 --2- 172.21.15.71:0/812686225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45040ff6c0 0x7f45040fb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.131+0000 7f45037fe640 1 -- 172.21.15.71:0/812686225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4005040 con 0x7f4504066710 2024-09-10T10:11:01.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.131+0000 7f4502ffd640 1 --2- 172.21.15.71:0/812686225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45040ff6c0 0x7f45040fb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:11:01.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.131+0000 7f45037fe640 1 --2- 172.21.15.71:0/812686225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4504066710 0x7f45040fcb90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44f40048a0 tx=0x7f44f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:01.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.131+0000 7f44ebfff640 1 -- 172.21.15.71:0/812686225 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f4038070 con 0x7f4504066710 2024-09-10T10:11:01.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.131+0000 7f4509bdc640 1 -- 172.21.15.71:0/812686225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45040fb9d0 con 0x7f4504066710 2024-09-10T10:11:01.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.131+0000 7f44ebfff640 1 -- 172.21.15.71:0/812686225 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f44f4004290 con 0x7f4504066710 2024-09-10T10:11:01.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.131+0000 7f44ebfff640 1 -- 172.21.15.71:0/812686225 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f403e650 con 0x7f4504066710 2024-09-10T10:11:01.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.131+0000 7f4509bdc640 1 -- 172.21.15.71:0/812686225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4504115110 con 0x7f4504066710 2024-09-10T10:11:01.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.133+0000 7f4509bdc640 1 -- 172.21.15.71:0/812686225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45040fa8d0 con 0x7f4504066710 2024-09-10T10:11:01.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.133+0000 7f44ebfff640 1 -- 172.21.15.71:0/812686225 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f44f4030020 con 0x7f4504066710 2024-09-10T10:11:01.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.133+0000 7f44ebfff640 1 --2- 172.21.15.71:0/812686225 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f44ec06e0b0 0x7f44ec070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:01.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.133+0000 7f44ebfff640 1 -- 172.21.15.71:0/812686225 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f44f40add50 con 0x7f4504066710 2024-09-10T10:11:01.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.133+0000 7f4502ffd640 1 --2- 172.21.15.71:0/812686225 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f44ec06e0b0 0x7f44ec070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:01.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.134+0000 7f4502ffd640 1 --2- 172.21.15.71:0/812686225 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f44ec06e0b0 0x7f44ec070560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44f8004ab0 tx=0x7f44f800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:01.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.138+0000 7f44ebfff640 1 -- 172.21.15.71:0/812686225 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f44f4077080 con 0x7f4504066710 2024-09-10T10:11:01.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.314+0000 7f4509bdc640 1 -- 172.21.15.71:0/812686225 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f45040f8770 con 0x7f44ec06e0b0 2024-09-10T10:11:01.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.323+0000 7f44ebfff640 1 -- 172.21.15.71:0/812686225 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f45040f8770 con 0x7f44ec06e0b0 2024-09-10T10:11:01.324 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:11:01.325 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (6m) 2m ago 14m 26.4M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:11:01.325 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (3m) 2m ago 15m 6903k - 19.1.1-305-g1cf819b7 41d671128357 5dc74ad01560 2024-09-10T10:11:01.325 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (3m) 31s ago 14m 6891k - 19.1.1-305-g1cf819b7 41d671128357 6f4355e875db 2024-09-10T10:11:01.325 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (6m) 2m ago 14m 78.2M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:11:01.325 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (9m) 2m ago 9m 113M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:11:01.325 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (9m) 2m ago 9m 65.2M - 17.2.7-1597-g96d63e75 f3fc7d52e233 09c4fa2eebce 2024-09-10T10:11:01.325 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (9m) 31s ago 9m 108M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:11:01.326 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (9m) 31s ago 9m 62.7M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:11:01.326 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (5m) 2m ago 16m 498M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:11:01.326 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (4m) 31s ago 13m 441M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:11:01.326 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (4m) 2m ago 16m 47.2M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:11:01.326 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (4m) 31s ago 13m 41.1M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:11:01.326 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (6m) 2m ago 14m 16.2M - 1.5.0 0da6a335fe13 c3d47d79cd22 2024-09-10T10:11:01.326 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (5m) 31s ago 14m 16.5M - 1.5.0 0da6a335fe13 9a25165a0fd1 2024-09-10T10:11:01.326 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (3m) 2m ago 13m 95.6M 1557M 19.1.1-305-g1cf819b7 41d671128357 f1e9da1144c1 2024-09-10T10:11:01.326 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (2m) 2m ago 12m 98.8M 1557M 19.1.1-305-g1cf819b7 41d671128357 5afc8bef5343 2024-09-10T10:11:01.327 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (2m) 2m ago 12m 12.1M 1557M 19.1.1-305-g1cf819b7 41d671128357 5e5976fcfaa8 2024-09-10T10:11:01.327 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (99s) 31s ago 11m 104M 2581M 19.1.1-305-g1cf819b7 41d671128357 e22ee626ccd0 2024-09-10T10:11:01.327 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (67s) 31s ago 11m 92.3M 2581M 19.1.1-305-g1cf819b7 41d671128357 e92f23ad2c77 2024-09-10T10:11:01.327 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (35s) 31s ago 10m 11.8M 2581M 19.1.1-305-g1cf819b7 41d671128357 3440ee1c721e 2024-09-10T10:11:01.327 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (5m) 2m ago 14m 56.5M - 2.43.0 a07b618ecd1d 47d3ae62ce5e 2024-09-10T10:11:01.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.325+0000 7f4509bdc640 1 -- 172.21.15.71:0/812686225 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f44ec06e0b0 msgr2=0x7f44ec070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.325+0000 7f4509bdc640 1 --2- 172.21.15.71:0/812686225 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f44ec06e0b0 0x7f44ec070560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44f8004ab0 tx=0x7f44f800b040 comp rx=0 tx=0).stop 2024-09-10T10:11:01.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.325+0000 7f4509bdc640 1 -- 172.21.15.71:0/812686225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4504066710 msgr2=0x7f45040fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.325+0000 7f4509bdc640 1 --2- 172.21.15.71:0/812686225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4504066710 0x7f45040fcb90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44f40048a0 tx=0x7f44f4009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.325+0000 7f4509bdc640 1 -- 172.21.15.71:0/812686225 shutdown_connections 2024-09-10T10:11:01.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.325+0000 7f4509bdc640 1 --2- 172.21.15.71:0/812686225 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f44ec06e0b0 0x7f44ec070560 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.325+0000 7f4509bdc640 1 --2- 172.21.15.71:0/812686225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45040ff6c0 0x7f45040fb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.325+0000 7f4509bdc640 1 --2- 172.21.15.71:0/812686225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4504066710 0x7f45040fcb90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.325+0000 7f4509bdc640 1 -- 172.21.15.71:0/812686225 >> 172.21.15.71:0/812686225 conn(0x7f45040f6c10 msgr2=0x7f45040f7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:01.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.325+0000 7f4509bdc640 1 -- 172.21.15.71:0/812686225 shutdown_connections 2024-09-10T10:11:01.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.325+0000 7f4509bdc640 1 -- 172.21.15.71:0/812686225 wait complete. 2024-09-10T10:11:01.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.402+0000 7f6825955640 1 -- 172.21.15.71:0/1604435857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6820065c40 msgr2=0x7f68200ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.402+0000 7f6825955640 1 --2- 172.21.15.71:0/1604435857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6820065c40 0x7f68200ff140 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f68100048d0 tx=0x7f6810009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.402+0000 7f6825955640 1 -- 172.21.15.71:0/1604435857 shutdown_connections 2024-09-10T10:11:01.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.402+0000 7f6825955640 1 --2- 172.21.15.71:0/1604435857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68200ff680 0x7f6820101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.402+0000 7f6825955640 1 --2- 172.21.15.71:0/1604435857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6820065c40 0x7f68200ff140 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.402+0000 7f6825955640 1 -- 172.21.15.71:0/1604435857 >> 172.21.15.71:0/1604435857 conn(0x7f68200f6c10 msgr2=0x7f68200f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:01.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.403+0000 7f6825955640 1 -- 172.21.15.71:0/1604435857 shutdown_connections 2024-09-10T10:11:01.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:01 smithi071 ceph-mon[90773]: pgmap v172: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 3 op/s 2024-09-10T10:11:01.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:01 smithi071 ceph-mon[90773]: mds.1 [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] down:stopped 2024-09-10T10:11:01.405 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:01 smithi071 ceph-mon[90773]: fsmap cephfs:1 {0=cephfs.smithi071.omoqqq=up:active} 2 up:standby 2024-09-10T10:11:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.403+0000 7f6825955640 1 -- 172.21.15.71:0/1604435857 wait complete. 2024-09-10T10:11:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.403+0000 7f6825955640 1 Processor -- start 2024-09-10T10:11:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.403+0000 7f6825955640 1 -- start start 2024-09-10T10:11:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.403+0000 7f6825955640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6820065c40 0x7f682010d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.403+0000 7f6825955640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68200ff680 0x7f682010d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.403+0000 7f6825955640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682010dca0 con 0x7f68200ff680 2024-09-10T10:11:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.403+0000 7f6825955640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682010e470 con 0x7f6820065c40 2024-09-10T10:11:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.404+0000 7f681e7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68200ff680 0x7f682010d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.404+0000 7f681e7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68200ff680 0x7f682010d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50436/0 (socket says 172.21.15.71:50436) 2024-09-10T10:11:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.404+0000 7f681e7fc640 1 -- 172.21.15.71:0/720844609 learned_addr learned my addr 172.21.15.71:0/720844609 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:01.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.404+0000 7f681effd640 1 --2- 172.21.15.71:0/720844609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6820065c40 0x7f682010d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.404+0000 7f681e7fc640 1 -- 172.21.15.71:0/720844609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6820065c40 msgr2=0x7f682010d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.404+0000 7f681e7fc640 1 --2- 172.21.15.71:0/720844609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6820065c40 0x7f682010d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.404+0000 7f681e7fc640 1 -- 172.21.15.71:0/720844609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6810005040 con 0x7f68200ff680 2024-09-10T10:11:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.404+0000 7f681e7fc640 1 --2- 172.21.15.71:0/720844609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68200ff680 0x7f682010d650 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6814002a50 tx=0x7f6814004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.404+0000 7f68077fe640 1 -- 172.21.15.71:0/720844609 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6814007c30 con 0x7f68200ff680 2024-09-10T10:11:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.404+0000 7f68077fe640 1 -- 172.21.15.71:0/720844609 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f681400f040 con 0x7f68200ff680 2024-09-10T10:11:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.404+0000 7f6825955640 1 -- 172.21.15.71:0/720844609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682010e700 con 0x7f68200ff680 2024-09-10T10:11:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.404+0000 7f68077fe640 1 -- 172.21.15.71:0/720844609 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f681400da10 con 0x7f68200ff680 2024-09-10T10:11:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.404+0000 7f6825955640 1 -- 172.21.15.71:0/720844609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682010eca0 con 0x7f68200ff680 2024-09-10T10:11:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.406+0000 7f6825955640 1 -- 172.21.15.71:0/720844609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68200fa890 con 0x7f68200ff680 2024-09-10T10:11:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.407+0000 7f68077fe640 1 -- 172.21.15.71:0/720844609 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f681400db70 con 0x7f68200ff680 2024-09-10T10:11:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.407+0000 7f68077fe640 1 --2- 172.21.15.71:0/720844609 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f680806e0b0 0x7f6808070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.407+0000 7f68077fe640 1 -- 172.21.15.71:0/720844609 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f681408d430 con 0x7f68200ff680 2024-09-10T10:11:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.408+0000 7f681effd640 1 --2- 172.21.15.71:0/720844609 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f680806e0b0 0x7f6808070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.408+0000 7f681effd640 1 --2- 172.21.15.71:0/720844609 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f680806e0b0 0x7f6808070560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6810000c00 tx=0x7f6810035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.411+0000 7f68077fe640 1 -- 172.21.15.71:0/720844609 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6814056950 con 0x7f68200ff680 2024-09-10T10:11:01.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.643+0000 7f6825955640 1 -- 172.21.15.71:0/720844609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f682004b720 con 0x7f68200ff680 2024-09-10T10:11:01.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.644+0000 7f68077fe640 1 -- 172.21.15.71:0/720844609 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f681405a010 con 0x7f68200ff680 2024-09-10T10:11:01.645 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:11:01.645 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:11:01.645 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:11:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:11:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:11:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:11:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:11:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:11:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T10:11:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:11:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:11:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4 2024-09-10T10:11:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:11:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:11:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 4, 2024-09-10T10:11:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 10 2024-09-10T10:11:01.647 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:11:01.647 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:11:01.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:01 smithi107 ceph-mon[79396]: pgmap v172: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 3 op/s 2024-09-10T10:11:01.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:01 smithi107 ceph-mon[79396]: mds.1 [v2:172.21.15.107:6824/2124995551,v1:172.21.15.107:6825/2124995551] down:stopped 2024-09-10T10:11:01.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:01 smithi107 ceph-mon[79396]: fsmap cephfs:1 {0=cephfs.smithi071.omoqqq=up:active} 2 up:standby 2024-09-10T10:11:01.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.646+0000 7f6825955640 1 -- 172.21.15.71:0/720844609 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f680806e0b0 msgr2=0x7f6808070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.646+0000 7f6825955640 1 --2- 172.21.15.71:0/720844609 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f680806e0b0 0x7f6808070560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6810000c00 tx=0x7f6810035040 comp rx=0 tx=0).stop 2024-09-10T10:11:01.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.646+0000 7f6825955640 1 -- 172.21.15.71:0/720844609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68200ff680 msgr2=0x7f682010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.646+0000 7f6825955640 1 --2- 172.21.15.71:0/720844609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68200ff680 0x7f682010d650 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6814002a50 tx=0x7f6814004600 comp rx=0 tx=0).stop 2024-09-10T10:11:01.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.646+0000 7f6825955640 1 -- 172.21.15.71:0/720844609 shutdown_connections 2024-09-10T10:11:01.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.646+0000 7f6825955640 1 --2- 172.21.15.71:0/720844609 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f680806e0b0 0x7f6808070560 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.646+0000 7f6825955640 1 --2- 172.21.15.71:0/720844609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68200ff680 0x7f682010d650 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.646+0000 7f6825955640 1 --2- 172.21.15.71:0/720844609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6820065c40 0x7f682010d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.646+0000 7f6825955640 1 -- 172.21.15.71:0/720844609 >> 172.21.15.71:0/720844609 conn(0x7f68200f6c10 msgr2=0x7f68200f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:01.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.647+0000 7f6825955640 1 -- 172.21.15.71:0/720844609 shutdown_connections 2024-09-10T10:11:01.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.647+0000 7f6825955640 1 -- 172.21.15.71:0/720844609 wait complete. 2024-09-10T10:11:01.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.725+0000 7f8634b94640 1 -- 172.21.15.71:0/116009841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86300fc550 msgr2=0x7f86300fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.725+0000 7f8634b94640 1 --2- 172.21.15.71:0/116009841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86300fc550 0x7f86300fc960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f86200048d0 tx=0x7f8620009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.725+0000 7f8634b94640 1 -- 172.21.15.71:0/116009841 shutdown_connections 2024-09-10T10:11:01.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.725+0000 7f8634b94640 1 --2- 172.21.15.71:0/116009841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86300fd820 0x7f86300fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.725+0000 7f8634b94640 1 --2- 172.21.15.71:0/116009841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86300fc550 0x7f86300fc960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.725+0000 7f8634b94640 1 -- 172.21.15.71:0/116009841 >> 172.21.15.71:0/116009841 conn(0x7f86300f7d30 msgr2=0x7f86300fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:01.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.725+0000 7f8634b94640 1 -- 172.21.15.71:0/116009841 shutdown_connections 2024-09-10T10:11:01.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.725+0000 7f8634b94640 1 -- 172.21.15.71:0/116009841 wait complete. 2024-09-10T10:11:01.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.726+0000 7f8634b94640 1 Processor -- start 2024-09-10T10:11:01.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.726+0000 7f8634b94640 1 -- start start 2024-09-10T10:11:01.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.726+0000 7f8634b94640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86300fc550 0x7f863010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:01.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.726+0000 7f8634b94640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86300fd820 0x7f863010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:01.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.726+0000 7f8634b94640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863010dc10 con 0x7f86300fd820 2024-09-10T10:11:01.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.726+0000 7f8634b94640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863010e430 con 0x7f86300fc550 2024-09-10T10:11:01.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.726+0000 7f862dd9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86300fd820 0x7f863010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:01.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.726+0000 7f862dd9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86300fd820 0x7f863010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50450/0 (socket says 172.21.15.71:50450) 2024-09-10T10:11:01.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.726+0000 7f862dd9b640 1 -- 172.21.15.71:0/374784497 learned_addr learned my addr 172.21.15.71:0/374784497 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:01.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.726+0000 7f862e59c640 1 --2- 172.21.15.71:0/374784497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86300fc550 0x7f863010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:01.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.726+0000 7f862dd9b640 1 -- 172.21.15.71:0/374784497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86300fc550 msgr2=0x7f863010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.726+0000 7f862dd9b640 1 --2- 172.21.15.71:0/374784497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86300fc550 0x7f863010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.726+0000 7f862dd9b640 1 -- 172.21.15.71:0/374784497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8620005040 con 0x7f86300fd820 2024-09-10T10:11:01.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.727+0000 7f862dd9b640 1 --2- 172.21.15.71:0/374784497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86300fd820 0x7f863010d5c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f861800c790 tx=0x7f86180043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:01.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.727+0000 7f8626ffd640 1 -- 172.21.15.71:0/374784497 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f861800a7a0 con 0x7f86300fd820 2024-09-10T10:11:01.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.727+0000 7f8626ffd640 1 -- 172.21.15.71:0/374784497 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f861800ada0 con 0x7f86300fd820 2024-09-10T10:11:01.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.727+0000 7f8634b94640 1 -- 172.21.15.71:0/374784497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863010e6c0 con 0x7f86300fd820 2024-09-10T10:11:01.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.727+0000 7f8626ffd640 1 -- 172.21.15.71:0/374784497 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86180113a0 con 0x7f86300fd820 2024-09-10T10:11:01.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.727+0000 7f8634b94640 1 -- 172.21.15.71:0/374784497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863010ec60 con 0x7f86300fd820 2024-09-10T10:11:01.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.728+0000 7f8634b94640 1 -- 172.21.15.71:0/374784497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86300fb9b0 con 0x7f86300fd820 2024-09-10T10:11:01.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.729+0000 7f8626ffd640 1 -- 172.21.15.71:0/374784497 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f861800a900 con 0x7f86300fd820 2024-09-10T10:11:01.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.729+0000 7f8626ffd640 1 --2- 172.21.15.71:0/374784497 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f861c06dea0 0x7f861c070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:01.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.729+0000 7f8626ffd640 1 -- 172.21.15.71:0/374784497 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f861808da00 con 0x7f86300fd820 2024-09-10T10:11:01.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.729+0000 7f862e59c640 1 --2- 172.21.15.71:0/374784497 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f861c06dea0 0x7f861c070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:01.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.730+0000 7f862e59c640 1 --2- 172.21.15.71:0/374784497 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f861c06dea0 0x7f861c070350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8620000c00 tx=0x7f8620035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:01.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.733+0000 7f8626ffd640 1 -- 172.21.15.71:0/374784497 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8618056e60 con 0x7f86300fd820 2024-09-10T10:11:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.933+0000 7f8634b94640 1 -- 172.21.15.71:0/374784497 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f863010ef00 con 0x7f86300fd820 2024-09-10T10:11:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.933+0000 7f8626ffd640 1 -- 172.21.15.71:0/374784497 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1929 (secure 0 0 0) 0x7f861805a520 con 0x7f86300fd820 2024-09-10T10:11:01.935 INFO:teuthology.orchestra.run.smithi071.stdout:e29 2024-09-10T10:11:01.935 INFO:teuthology.orchestra.run.smithi071.stdout:btime 2024-09-10T10:11:01:249365+0000 2024-09-10T10:11:01.935 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:11:01.935 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:11:01.935 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:11:01.935 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:11:01.936 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:11:01.936 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:11:01.936 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 28 2024-09-10T10:11:01.936 INFO:teuthology.orchestra.run.smithi071.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-10T10:11:01.936 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:11:01.936 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:10:59.796932+0000 2024-09-10T10:11:01.936 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:11:01.936 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:11:01.936 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:11:01.936 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:11:01.936 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:11:01.936 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:11:01.936 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 0 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 1 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:in 0 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=14464} 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 1 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:11:01.937 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:11:01.938 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:11:01.938 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 14464 members: 14464 2024-09-10T10:11:01.938 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.71:6828/3739086646,v1:172.21.15.71:6829/3739086646] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:11:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:11:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:11:01.938 INFO:teuthology.orchestra.run.smithi071.stdout:Standby daemons: 2024-09-10T10:11:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:11:01.938 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{-1:34380} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1437303195,v1:172.21.15.71:6827/1437303195] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:11:01.938 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{-1:44315} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/3716221026,v1:172.21.15.107:6827/3716221026] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:11:01.938 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6824/1526152997,v1:172.21.15.107:6825/1526152997] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:11:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 29 2024-09-10T10:11:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.935+0000 7f8634b94640 1 -- 172.21.15.71:0/374784497 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f861c06dea0 msgr2=0x7f861c070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.935+0000 7f8634b94640 1 --2- 172.21.15.71:0/374784497 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f861c06dea0 0x7f861c070350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8620000c00 tx=0x7f8620035040 comp rx=0 tx=0).stop 2024-09-10T10:11:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.935+0000 7f8634b94640 1 -- 172.21.15.71:0/374784497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86300fd820 msgr2=0x7f863010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.935+0000 7f8634b94640 1 --2- 172.21.15.71:0/374784497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86300fd820 0x7f863010d5c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f861800c790 tx=0x7f86180043c0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.935+0000 7f8634b94640 1 -- 172.21.15.71:0/374784497 shutdown_connections 2024-09-10T10:11:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.935+0000 7f8634b94640 1 --2- 172.21.15.71:0/374784497 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f861c06dea0 0x7f861c070350 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.935+0000 7f8634b94640 1 --2- 172.21.15.71:0/374784497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86300fd820 0x7f863010d5c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.935+0000 7f8634b94640 1 --2- 172.21.15.71:0/374784497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86300fc550 0x7f863010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.935+0000 7f8634b94640 1 -- 172.21.15.71:0/374784497 >> 172.21.15.71:0/374784497 conn(0x7f86300f7d30 msgr2=0x7f86300f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.936+0000 7f8634b94640 1 -- 172.21.15.71:0/374784497 shutdown_connections 2024-09-10T10:11:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:01.936+0000 7f8634b94640 1 -- 172.21.15.71:0/374784497 wait complete. 2024-09-10T10:11:02.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.014+0000 7fca79843640 1 -- 172.21.15.71:0/2105125955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca740fc6b0 msgr2=0x7fca740fcb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:02.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.014+0000 7fca79843640 1 --2- 172.21.15.71:0/2105125955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca740fc6b0 0x7fca740fcb20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fca680048d0 tx=0x7fca68009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.014+0000 7fca79843640 1 -- 172.21.15.71:0/2105125955 shutdown_connections 2024-09-10T10:11:02.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.014+0000 7fca79843640 1 --2- 172.21.15.71:0/2105125955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca740fc6b0 0x7fca740fcb20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.014+0000 7fca79843640 1 --2- 172.21.15.71:0/2105125955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca740fb3e0 0x7fca740fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.014+0000 7fca79843640 1 -- 172.21.15.71:0/2105125955 >> 172.21.15.71:0/2105125955 conn(0x7fca740f6b80 msgr2=0x7fca740f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.014+0000 7fca79843640 1 -- 172.21.15.71:0/2105125955 shutdown_connections 2024-09-10T10:11:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.014+0000 7fca79843640 1 -- 172.21.15.71:0/2105125955 wait complete. 2024-09-10T10:11:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.015+0000 7fca79843640 1 Processor -- start 2024-09-10T10:11:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.015+0000 7fca79843640 1 -- start start 2024-09-10T10:11:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.015+0000 7fca79843640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca740fb3e0 0x7fca74066560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.015+0000 7fca79843640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca740fc6b0 0x7fca74111d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.015+0000 7fca79843640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca741123c0 con 0x7fca740fc6b0 2024-09-10T10:11:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.015+0000 7fca79843640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca74112500 con 0x7fca740fb3e0 2024-09-10T10:11:02.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.016+0000 7fca727fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca740fc6b0 0x7fca74111d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:02.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.016+0000 7fca727fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca740fc6b0 0x7fca74111d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50460/0 (socket says 172.21.15.71:50460) 2024-09-10T10:11:02.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.016+0000 7fca727fc640 1 -- 172.21.15.71:0/2576260475 learned_addr learned my addr 172.21.15.71:0/2576260475 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:02.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.016+0000 7fca72ffd640 1 --2- 172.21.15.71:0/2576260475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca740fb3e0 0x7fca74066560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:02.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.016+0000 7fca727fc640 1 -- 172.21.15.71:0/2576260475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca740fb3e0 msgr2=0x7fca74066560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:02.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.016+0000 7fca727fc640 1 --2- 172.21.15.71:0/2576260475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca740fb3e0 0x7fca74066560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.016+0000 7fca727fc640 1 -- 172.21.15.71:0/2576260475 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68005040 con 0x7fca740fc6b0 2024-09-10T10:11:02.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.016+0000 7fca727fc640 1 --2- 172.21.15.71:0/2576260475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca740fc6b0 0x7fca74111d90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fca68003080 tx=0x7fca68009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:02.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.016+0000 7fca5b7fe640 1 -- 172.21.15.71:0/2576260475 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca68038070 con 0x7fca740fc6b0 2024-09-10T10:11:02.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.016+0000 7fca5b7fe640 1 -- 172.21.15.71:0/2576260475 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fca6802abd0 con 0x7fca740fc6b0 2024-09-10T10:11:02.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.016+0000 7fca5b7fe640 1 -- 172.21.15.71:0/2576260475 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca6803e670 con 0x7fca740fc6b0 2024-09-10T10:11:02.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.016+0000 7fca79843640 1 -- 172.21.15.71:0/2576260475 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca74112780 con 0x7fca740fc6b0 2024-09-10T10:11:02.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.016+0000 7fca79843640 1 -- 172.21.15.71:0/2576260475 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca74112d20 con 0x7fca740fc6b0 2024-09-10T10:11:02.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.018+0000 7fca79843640 1 -- 172.21.15.71:0/2576260475 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7405ed70 con 0x7fca740fc6b0 2024-09-10T10:11:02.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.018+0000 7fca5b7fe640 1 -- 172.21.15.71:0/2576260475 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fca68030020 con 0x7fca740fc6b0 2024-09-10T10:11:02.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.019+0000 7fca5b7fe640 1 --2- 172.21.15.71:0/2576260475 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fca5c06e0b0 0x7fca5c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:02.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.019+0000 7fca5b7fe640 1 -- 172.21.15.71:0/2576260475 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fca680adec0 con 0x7fca740fc6b0 2024-09-10T10:11:02.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.019+0000 7fca72ffd640 1 --2- 172.21.15.71:0/2576260475 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fca5c06e0b0 0x7fca5c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:02.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.019+0000 7fca72ffd640 1 --2- 172.21.15.71:0/2576260475 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fca5c06e0b0 0x7fca5c070560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fca640041d0 tx=0x7fca64009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:02.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.023+0000 7fca5b7fe640 1 -- 172.21.15.71:0/2576260475 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fca68077270 con 0x7fca740fc6b0 2024-09-10T10:11:02.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.206+0000 7fca79843640 1 -- 172.21.15.71:0/2576260475 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca74100ac0 con 0x7fca5c06e0b0 2024-09-10T10:11:02.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.207+0000 7fca5b7fe640 1 -- 172.21.15.71:0/2576260475 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fca74100ac0 con 0x7fca5c06e0b0 2024-09-10T10:11:02.208 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:11:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:11:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:11:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:11:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:11:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: "osd", 2024-09-10T10:11:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-09-10T10:11:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-10T10:11:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-10T10:11:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:11:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "12/21 daemons upgraded", 2024-09-10T10:11:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T10:11:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:11:02.209 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:11:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.209+0000 7fca79843640 1 -- 172.21.15.71:0/2576260475 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fca5c06e0b0 msgr2=0x7fca5c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.209+0000 7fca79843640 1 --2- 172.21.15.71:0/2576260475 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fca5c06e0b0 0x7fca5c070560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fca640041d0 tx=0x7fca64009040 comp rx=0 tx=0).stop 2024-09-10T10:11:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.209+0000 7fca79843640 1 -- 172.21.15.71:0/2576260475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca740fc6b0 msgr2=0x7fca74111d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.209+0000 7fca79843640 1 --2- 172.21.15.71:0/2576260475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca740fc6b0 0x7fca74111d90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fca68003080 tx=0x7fca68009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.209+0000 7fca79843640 1 -- 172.21.15.71:0/2576260475 shutdown_connections 2024-09-10T10:11:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.209+0000 7fca79843640 1 --2- 172.21.15.71:0/2576260475 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fca5c06e0b0 0x7fca5c070560 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.209+0000 7fca79843640 1 --2- 172.21.15.71:0/2576260475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca740fc6b0 0x7fca74111d90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.209+0000 7fca79843640 1 --2- 172.21.15.71:0/2576260475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca740fb3e0 0x7fca74066560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.209+0000 7fca79843640 1 -- 172.21.15.71:0/2576260475 >> 172.21.15.71:0/2576260475 conn(0x7fca740f6b80 msgr2=0x7fca740f8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.209+0000 7fca79843640 1 -- 172.21.15.71:0/2576260475 shutdown_connections 2024-09-10T10:11:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.209+0000 7fca79843640 1 -- 172.21.15.71:0/2576260475 wait complete. 2024-09-10T10:11:02.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:02 smithi071 ceph-mon[90773]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:02.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:02 smithi071 ceph-mon[90773]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:02.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:02 smithi071 ceph-mon[90773]: mds.? [v2:172.21.15.107:6824/1526152997,v1:172.21.15.107:6825/1526152997] up:boot 2024-09-10T10:11:02.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:02 smithi071 ceph-mon[90773]: fsmap cephfs:1 {0=cephfs.smithi071.omoqqq=up:active} 3 up:standby 2024-09-10T10:11:02.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:11:02.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:02 smithi071 ceph-mon[90773]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:02.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:02 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/720844609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:02.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:02 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/374784497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:11:02.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.291+0000 7fa155e40640 1 -- 172.21.15.71:0/736880012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1500fdb70 msgr2=0x7fa1500fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:02.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.291+0000 7fa155e40640 1 --2- 172.21.15.71:0/736880012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1500fdb70 0x7fa1500fdf80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa1440048d0 tx=0x7fa144009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.291+0000 7fa155e40640 1 -- 172.21.15.71:0/736880012 shutdown_connections 2024-09-10T10:11:02.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.291+0000 7fa155e40640 1 --2- 172.21.15.71:0/736880012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1500fe4c0 0x7fa1500fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.291+0000 7fa155e40640 1 --2- 172.21.15.71:0/736880012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1500fdb70 0x7fa1500fdf80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.291+0000 7fa155e40640 1 -- 172.21.15.71:0/736880012 >> 172.21.15.71:0/736880012 conn(0x7fa1500f6390 msgr2=0x7fa1500f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:02.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.291+0000 7fa155e40640 1 -- 172.21.15.71:0/736880012 shutdown_connections 2024-09-10T10:11:02.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.291+0000 7fa155e40640 1 -- 172.21.15.71:0/736880012 wait complete. 2024-09-10T10:11:02.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.292+0000 7fa155e40640 1 Processor -- start 2024-09-10T10:11:02.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.292+0000 7fa155e40640 1 -- start start 2024-09-10T10:11:02.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.292+0000 7fa155e40640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1500fdb70 0x7fa15010d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:02.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.292+0000 7fa155e40640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1500fe4c0 0x7fa15010d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:02.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.292+0000 7fa155e40640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15010e4a0 con 0x7fa1500fe4c0 2024-09-10T10:11:02.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.292+0000 7fa155e40640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15010e610 con 0x7fa1500fdb70 2024-09-10T10:11:02.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.292+0000 7fa14effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1500fe4c0 0x7fa15010d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:02.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.292+0000 7fa14effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1500fe4c0 0x7fa15010d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50486/0 (socket says 172.21.15.71:50486) 2024-09-10T10:11:02.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.292+0000 7fa14effd640 1 -- 172.21.15.71:0/184451780 learned_addr learned my addr 172.21.15.71:0/184451780 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:02.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.292+0000 7fa14f7fe640 1 --2- 172.21.15.71:0/184451780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1500fdb70 0x7fa15010d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:02.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.293+0000 7fa14effd640 1 -- 172.21.15.71:0/184451780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1500fdb70 msgr2=0x7fa15010d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:02.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.293+0000 7fa14effd640 1 --2- 172.21.15.71:0/184451780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1500fdb70 0x7fa15010d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.293+0000 7fa14effd640 1 -- 172.21.15.71:0/184451780 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa144005040 con 0x7fa1500fe4c0 2024-09-10T10:11:02.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.293+0000 7fa14effd640 1 --2- 172.21.15.71:0/184451780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1500fe4c0 0x7fa15010d630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa14000b580 tx=0x7fa1400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:02.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.293+0000 7fa137fff640 1 -- 172.21.15.71:0/184451780 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa14000f6f0 con 0x7fa1500fe4c0 2024-09-10T10:11:02.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.293+0000 7fa137fff640 1 -- 172.21.15.71:0/184451780 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa14000fcf0 con 0x7fa1500fe4c0 2024-09-10T10:11:02.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.293+0000 7fa137fff640 1 -- 172.21.15.71:0/184451780 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1400103a0 con 0x7fa1500fe4c0 2024-09-10T10:11:02.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.293+0000 7fa155e40640 1 -- 172.21.15.71:0/184451780 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15010e8f0 con 0x7fa1500fe4c0 2024-09-10T10:11:02.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.293+0000 7fa155e40640 1 -- 172.21.15.71:0/184451780 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15010ee10 con 0x7fa1500fe4c0 2024-09-10T10:11:02.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.294+0000 7fa155e40640 1 -- 172.21.15.71:0/184451780 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1500fa010 con 0x7fa1500fe4c0 2024-09-10T10:11:02.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.294+0000 7fa137fff640 1 -- 172.21.15.71:0/184451780 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa1400116b0 con 0x7fa1500fe4c0 2024-09-10T10:11:02.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.295+0000 7fa137fff640 1 --2- 172.21.15.71:0/184451780 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa13806e0b0 0x7fa138070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:02.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.295+0000 7fa137fff640 1 -- 172.21.15.71:0/184451780 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa14008d8e0 con 0x7fa1500fe4c0 2024-09-10T10:11:02.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.295+0000 7fa14f7fe640 1 --2- 172.21.15.71:0/184451780 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa13806e0b0 0x7fa138070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:02.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.295+0000 7fa14f7fe640 1 --2- 172.21.15.71:0/184451780 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa13806e0b0 0x7fa138070560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa144000c00 tx=0x7fa144035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:02.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.299+0000 7fa137fff640 1 -- 172.21.15.71:0/184451780 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa140056d50 con 0x7fa1500fe4c0 2024-09-10T10:11:02.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.533+0000 7fa155e40640 1 -- 172.21.15.71:0/184451780 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa15004b720 con 0x7fa1500fe4c0 2024-09-10T10:11:02.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.533+0000 7fa137fff640 1 -- 172.21.15.71:0/184451780 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa14005a410 con 0x7fa1500fe4c0 2024-09-10T10:11:02.535 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:11:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.535+0000 7fa155e40640 1 -- 172.21.15.71:0/184451780 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa13806e0b0 msgr2=0x7fa138070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.535+0000 7fa155e40640 1 --2- 172.21.15.71:0/184451780 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa13806e0b0 0x7fa138070560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa144000c00 tx=0x7fa144035040 comp rx=0 tx=0).stop 2024-09-10T10:11:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.535+0000 7fa155e40640 1 -- 172.21.15.71:0/184451780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1500fe4c0 msgr2=0x7fa15010d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.535+0000 7fa155e40640 1 --2- 172.21.15.71:0/184451780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1500fe4c0 0x7fa15010d630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa14000b580 tx=0x7fa1400091a0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.535+0000 7fa155e40640 1 -- 172.21.15.71:0/184451780 shutdown_connections 2024-09-10T10:11:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.535+0000 7fa155e40640 1 --2- 172.21.15.71:0/184451780 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa13806e0b0 0x7fa138070560 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.535+0000 7fa155e40640 1 --2- 172.21.15.71:0/184451780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1500fe4c0 0x7fa15010d630 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.535+0000 7fa155e40640 1 --2- 172.21.15.71:0/184451780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1500fdb70 0x7fa15010d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.535+0000 7fa155e40640 1 -- 172.21.15.71:0/184451780 >> 172.21.15.71:0/184451780 conn(0x7fa1500f6390 msgr2=0x7fa1500f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.535+0000 7fa155e40640 1 -- 172.21.15.71:0/184451780 shutdown_connections 2024-09-10T10:11:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:02.535+0000 7fa155e40640 1 -- 172.21.15.71:0/184451780 wait complete. 2024-09-10T10:11:02.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:02 smithi107 ceph-mon[79396]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:02.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:02 smithi107 ceph-mon[79396]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:02.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:02 smithi107 ceph-mon[79396]: mds.? [v2:172.21.15.107:6824/1526152997,v1:172.21.15.107:6825/1526152997] up:boot 2024-09-10T10:11:02.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:02 smithi107 ceph-mon[79396]: fsmap cephfs:1 {0=cephfs.smithi071.omoqqq=up:active} 3 up:standby 2024-09-10T10:11:02.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:11:02.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:02 smithi107 ceph-mon[79396]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:02.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:02 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/720844609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:02.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:02 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/374784497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:11:03.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:03 smithi071 ceph-mon[90773]: pgmap v173: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 1 op/s 2024-09-10T10:11:03.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:03 smithi071 ceph-mon[90773]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:03.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:03 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/184451780' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:11:03.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:03 smithi107 ceph-mon[79396]: pgmap v173: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 1 op/s 2024-09-10T10:11:03.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:03 smithi107 ceph-mon[79396]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:03.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:03 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/184451780' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:11:05.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:05 smithi071 ceph-mon[90773]: pgmap v174: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-10T10:11:05.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:05 smithi107 ceph-mon[79396]: pgmap v174: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-10T10:11:07.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:07 smithi071 ceph-mon[90773]: pgmap v175: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-10T10:11:07.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:07 smithi107 ceph-mon[79396]: pgmap v175: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-10T10:11:08.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:08.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:08.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:11:08.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:08.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:08.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:08.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:08.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:08.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:08.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:08 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi071.toijsg"]}]: dispatch 2024-09-10T10:11:08.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:08 smithi071 ceph-mon[90773]: Upgrade: It appears safe to stop mds.cephfs.smithi071.toijsg 2024-09-10T10:11:08.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:11:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:08 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi071.toijsg"]}]: dispatch 2024-09-10T10:11:08.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:08 smithi107 ceph-mon[79396]: Upgrade: It appears safe to stop mds.cephfs.smithi071.toijsg 2024-09-10T10:11:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:09 smithi071 ceph-mon[90773]: pgmap v176: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T10:11:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.toijsg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:11:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:11:09.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:09 smithi107 ceph-mon[79396]: pgmap v176: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T10:11:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.toijsg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:11:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:11:10.463 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:10 smithi071 ceph-mon[90773]: Upgrade: Updating mds.cephfs.smithi071.toijsg 2024-09-10T10:11:10.463 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:10 smithi071 ceph-mon[90773]: Deploying daemon mds.cephfs.smithi071.toijsg on smithi071 2024-09-10T10:11:10.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:10 smithi107 ceph-mon[79396]: Upgrade: Updating mds.cephfs.smithi071.toijsg 2024-09-10T10:11:10.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:10 smithi107 ceph-mon[79396]: Deploying daemon mds.cephfs.smithi071.toijsg on smithi071 2024-09-10T10:11:11.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:11 smithi107 ceph-mon[79396]: pgmap v177: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T10:11:11.670 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:11 smithi071 ceph-mon[90773]: pgmap v177: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-10T10:11:12.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:12 smithi107 ceph-mon[79396]: osdmap e80: 6 total, 6 up, 6 in 2024-09-10T10:11:12.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:12 smithi107 ceph-mon[79396]: fsmap cephfs:1 {0=cephfs.smithi071.omoqqq=up:active} 2 up:standby 2024-09-10T10:11:12.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:12 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:11:12.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:12 smithi071 ceph-mon[90773]: osdmap e80: 6 total, 6 up, 6 in 2024-09-10T10:11:12.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:12 smithi071 ceph-mon[90773]: fsmap cephfs:1 {0=cephfs.smithi071.omoqqq=up:active} 2 up:standby 2024-09-10T10:11:12.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:12 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:11:13.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:13 smithi107 ceph-mon[79396]: pgmap v179: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:13.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:13 smithi071 ceph-mon[90773]: pgmap v179: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:15.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:15 smithi071 ceph-mon[90773]: pgmap v180: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:15.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:15 smithi107 ceph-mon[79396]: pgmap v180: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:17.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:17 smithi071 ceph-mon[90773]: pgmap v181: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:17.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:17.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:17.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:17.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:17 smithi107 ceph-mon[79396]: pgmap v181: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:18.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:18 smithi071 ceph-mon[90773]: mds.? [v2:172.21.15.71:6826/1701579524,v1:172.21.15.71:6827/1701579524] up:boot 2024-09-10T10:11:18.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:18 smithi071 ceph-mon[90773]: fsmap cephfs:1 {0=cephfs.smithi071.omoqqq=up:active} 3 up:standby 2024-09-10T10:11:18.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:18 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:11:18.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:18 smithi107 ceph-mon[79396]: mds.? [v2:172.21.15.71:6826/1701579524,v1:172.21.15.71:6827/1701579524] up:boot 2024-09-10T10:11:18.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:18 smithi107 ceph-mon[79396]: fsmap cephfs:1 {0=cephfs.smithi071.omoqqq=up:active} 3 up:standby 2024-09-10T10:11:18.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:18 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:11:19.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:19 smithi107 ceph-mon[79396]: pgmap v182: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:19.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:19 smithi071 ceph-mon[90773]: pgmap v182: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:21 smithi107 ceph-mon[79396]: pgmap v183: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:21.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:21 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:21.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:21 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:21.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:21 smithi071 ceph-mon[90773]: pgmap v183: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:21.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:21 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:21.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:21 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:23.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:23.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:23.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:22 smithi071 ceph-mon[90773]: pgmap v184: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:23.400 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:23.401 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:23.401 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:22 smithi107 ceph-mon[79396]: pgmap v184: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:24.477 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:11:24.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:11:25.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:25 smithi071 ceph-mon[90773]: pgmap v185: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:25.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:25.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:25.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:25.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:11:25.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:25 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:25.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:25 smithi107 ceph-mon[79396]: pgmap v185: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:25.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:25 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:25.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:25 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:25.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:25 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:25.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:25 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:11:25.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:25 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:26 smithi071 ceph-mon[90773]: Detected new or changed devices on smithi071 2024-09-10T10:11:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi071.omoqqq"]}]: dispatch 2024-09-10T10:11:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:26 smithi071 ceph-mon[90773]: Upgrade: It appears safe to stop mds.cephfs.smithi071.omoqqq 2024-09-10T10:11:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:26 smithi107 ceph-mon[79396]: Detected new or changed devices on smithi071 2024-09-10T10:11:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi071.omoqqq"]}]: dispatch 2024-09-10T10:11:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:26 smithi107 ceph-mon[79396]: Upgrade: It appears safe to stop mds.cephfs.smithi071.omoqqq 2024-09-10T10:11:27.329 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:27 smithi071 ceph-mon[90773]: pgmap v186: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:27.330 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:27.330 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.omoqqq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:11:27.330 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:27 smithi107 ceph-mon[79396]: pgmap v186: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi071.omoqqq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:11:27.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:28.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:28 smithi071 ceph-mon[90773]: Upgrade: Updating mds.cephfs.smithi071.omoqqq 2024-09-10T10:11:28.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:28 smithi071 ceph-mon[90773]: Deploying daemon mds.cephfs.smithi071.omoqqq on smithi071 2024-09-10T10:11:28.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:28 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071[90769]: 2024-09-10T10:11:28.471+0000 7f684c075640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:11:28.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:28 smithi107 ceph-mon[79396]: Upgrade: Updating mds.cephfs.smithi071.omoqqq 2024-09-10T10:11:28.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:28 smithi107 ceph-mon[79396]: Deploying daemon mds.cephfs.smithi071.omoqqq on smithi071 2024-09-10T10:11:29.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:29 smithi071 ceph-mon[90773]: pgmap v187: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:29.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:29 smithi071 ceph-mon[90773]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T10:11:29.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:29 smithi071 ceph-mon[90773]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:11:29.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:29 smithi071 ceph-mon[90773]: osdmap e81: 6 total, 6 up, 6 in 2024-09-10T10:11:29.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:29 smithi071 ceph-mon[90773]: Standby daemon mds.cephfs.smithi071.toijsg assigned to filesystem cephfs as rank 0 2024-09-10T10:11:29.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:29 smithi071 ceph-mon[90773]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T10:11:29.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:29 smithi071 ceph-mon[90773]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-10T10:11:29.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:29 smithi071 ceph-mon[90773]: fsmap cephfs:1/1 {0=cephfs.smithi071.toijsg=up:replay} 2 up:standby 2024-09-10T10:11:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:29 smithi107 ceph-mon[79396]: pgmap v187: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:29 smithi107 ceph-mon[79396]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T10:11:29.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:29 smithi107 ceph-mon[79396]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:11:29.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:29 smithi107 ceph-mon[79396]: osdmap e81: 6 total, 6 up, 6 in 2024-09-10T10:11:29.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:29 smithi107 ceph-mon[79396]: Standby daemon mds.cephfs.smithi071.toijsg assigned to filesystem cephfs as rank 0 2024-09-10T10:11:29.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:29 smithi107 ceph-mon[79396]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T10:11:29.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:29 smithi107 ceph-mon[79396]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-10T10:11:29.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:29 smithi107 ceph-mon[79396]: fsmap cephfs:1/1 {0=cephfs.smithi071.toijsg=up:replay} 2 up:standby 2024-09-10T10:11:31.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:31 smithi071 ceph-mon[90773]: pgmap v189: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-09-10T10:11:31.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:31 smithi107 ceph-mon[79396]: pgmap v189: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-09-10T10:11:32.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.641+0000 7f040d98f640 1 -- 172.21.15.71:0/266646413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04080ff670 msgr2=0x7f0408101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.641+0000 7f040d98f640 1 --2- 172.21.15.71:0/266646413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04080ff670 0x7f0408101a50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0048d0 tx=0x7f03fc009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.642+0000 7f040d98f640 1 -- 172.21.15.71:0/266646413 shutdown_connections 2024-09-10T10:11:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.642+0000 7f040d98f640 1 --2- 172.21.15.71:0/266646413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04080ff670 0x7f0408101a50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.642+0000 7f040d98f640 1 --2- 172.21.15.71:0/266646413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04080664d0 0x7f04080ff130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.642+0000 7f040d98f640 1 -- 172.21.15.71:0/266646413 >> 172.21.15.71:0/266646413 conn(0x7f04080f6c00 msgr2=0x7f04080f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.642+0000 7f040d98f640 1 -- 172.21.15.71:0/266646413 shutdown_connections 2024-09-10T10:11:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.642+0000 7f040d98f640 1 -- 172.21.15.71:0/266646413 wait complete. 2024-09-10T10:11:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.642+0000 7f040d98f640 1 Processor -- start 2024-09-10T10:11:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.643+0000 7f040d98f640 1 -- start start 2024-09-10T10:11:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.643+0000 7f040d98f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04080664d0 0x7f040810d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.643+0000 7f040d98f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04080ff670 0x7f040810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:32.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.643+0000 7f040d98f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040810daa0 con 0x7f04080664d0 2024-09-10T10:11:32.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.643+0000 7f040d98f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040810dbe0 con 0x7f04080ff670 2024-09-10T10:11:32.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.643+0000 7f0406ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04080664d0 0x7f040810d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:32.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.643+0000 7f0406ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04080664d0 0x7f040810d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55680/0 (socket says 172.21.15.71:55680) 2024-09-10T10:11:32.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.643+0000 7f0406ffd640 1 -- 172.21.15.71:0/538936093 learned_addr learned my addr 172.21.15.71:0/538936093 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:32.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.643+0000 7f04067fc640 1 --2- 172.21.15.71:0/538936093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04080ff670 0x7f040810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:32.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.643+0000 7f0406ffd640 1 -- 172.21.15.71:0/538936093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04080ff670 msgr2=0x7f040810d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:32.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.643+0000 7f0406ffd640 1 --2- 172.21.15.71:0/538936093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04080ff670 0x7f040810d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:32.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.643+0000 7f0406ffd640 1 -- 172.21.15.71:0/538936093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc005040 con 0x7f04080664d0 2024-09-10T10:11:32.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.643+0000 7f04067fc640 1 --2- 172.21.15.71:0/538936093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04080ff670 0x7f040810d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:11:32.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.644+0000 7f0406ffd640 1 --2- 172.21.15.71:0/538936093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04080664d0 0x7f040810d020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f03f8002ab0 tx=0x7f03f8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:32.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.644+0000 7f03ef7fe640 1 -- 172.21.15.71:0/538936093 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03f8007c30 con 0x7f04080664d0 2024-09-10T10:11:32.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.644+0000 7f03ef7fe640 1 -- 172.21.15.71:0/538936093 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f03f800f040 con 0x7f04080664d0 2024-09-10T10:11:32.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.644+0000 7f040d98f640 1 -- 172.21.15.71:0/538936093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040810e470 con 0x7f04080664d0 2024-09-10T10:11:32.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.644+0000 7f040d98f640 1 -- 172.21.15.71:0/538936093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040810e9e0 con 0x7f04080664d0 2024-09-10T10:11:32.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.644+0000 7f03ef7fe640 1 -- 172.21.15.71:0/538936093 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03f8009640 con 0x7f04080664d0 2024-09-10T10:11:32.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.645+0000 7f040d98f640 1 -- 172.21.15.71:0/538936093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04080fa880 con 0x7f04080664d0 2024-09-10T10:11:32.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.646+0000 7f03ef7fe640 1 -- 172.21.15.71:0/538936093 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f03f80097a0 con 0x7f04080664d0 2024-09-10T10:11:32.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.646+0000 7f03ef7fe640 1 --2- 172.21.15.71:0/538936093 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f03f006e0b0 0x7f03f0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:32.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.646+0000 7f03ef7fe640 1 -- 172.21.15.71:0/538936093 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f03f808db60 con 0x7f04080664d0 2024-09-10T10:11:32.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.646+0000 7f04067fc640 1 --2- 172.21.15.71:0/538936093 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f03f006e0b0 0x7f03f0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:32.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.647+0000 7f04067fc640 1 --2- 172.21.15.71:0/538936093 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f03f006e0b0 0x7f03f0070560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f03fc007ac0 tx=0x7f03fc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:32.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.655+0000 7f03ef7fe640 1 -- 172.21.15.71:0/538936093 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f03f8056e30 con 0x7f04080664d0 2024-09-10T10:11:32.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.861+0000 7f040d98f640 1 -- 172.21.15.71:0/538936093 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f040810ede0 con 0x7f03f006e0b0 2024-09-10T10:11:32.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.863+0000 7f03ef7fe640 1 -- 172.21.15.71:0/538936093 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f040810ede0 con 0x7f03f006e0b0 2024-09-10T10:11:32.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.865+0000 7f040d98f640 1 -- 172.21.15.71:0/538936093 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f03f006e0b0 msgr2=0x7f03f0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:32.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.865+0000 7f040d98f640 1 --2- 172.21.15.71:0/538936093 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f03f006e0b0 0x7f03f0070560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f03fc007ac0 tx=0x7f03fc035040 comp rx=0 tx=0).stop 2024-09-10T10:11:32.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.865+0000 7f040d98f640 1 -- 172.21.15.71:0/538936093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04080664d0 msgr2=0x7f040810d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:32.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.865+0000 7f040d98f640 1 --2- 172.21.15.71:0/538936093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04080664d0 0x7f040810d020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f03f8002ab0 tx=0x7f03f8004570 comp rx=0 tx=0).stop 2024-09-10T10:11:32.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.865+0000 7f040d98f640 1 -- 172.21.15.71:0/538936093 shutdown_connections 2024-09-10T10:11:32.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.865+0000 7f040d98f640 1 --2- 172.21.15.71:0/538936093 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f03f006e0b0 0x7f03f0070560 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:32.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.865+0000 7f040d98f640 1 --2- 172.21.15.71:0/538936093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04080ff670 0x7f040810d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:32.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.865+0000 7f040d98f640 1 --2- 172.21.15.71:0/538936093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04080664d0 0x7f040810d020 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:32.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.865+0000 7f040d98f640 1 -- 172.21.15.71:0/538936093 >> 172.21.15.71:0/538936093 conn(0x7f04080f6c00 msgr2=0x7f04080f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:32.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.865+0000 7f040d98f640 1 -- 172.21.15.71:0/538936093 shutdown_connections 2024-09-10T10:11:32.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.865+0000 7f040d98f640 1 -- 172.21.15.71:0/538936093 wait complete. 2024-09-10T10:11:32.876 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:11:32.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.954+0000 7f7cf591a640 1 -- 172.21.15.71:0/1238053011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf00fc370 msgr2=0x7f7cf00fc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:32.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.954+0000 7f7cf591a640 1 --2- 172.21.15.71:0/1238053011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf00fc370 0x7f7cf00fc7e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40048d0 tx=0x7f7ce4009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:32.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.954+0000 7f7cf591a640 1 -- 172.21.15.71:0/1238053011 shutdown_connections 2024-09-10T10:11:32.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.954+0000 7f7cf591a640 1 --2- 172.21.15.71:0/1238053011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf00fc370 0x7f7cf00fc7e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:32.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.954+0000 7f7cf591a640 1 --2- 172.21.15.71:0/1238053011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cf00fba20 0x7f7cf00fbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:32.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.954+0000 7f7cf591a640 1 -- 172.21.15.71:0/1238053011 >> 172.21.15.71:0/1238053011 conn(0x7f7cf00f6390 msgr2=0x7f7cf00f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:32.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.954+0000 7f7cf591a640 1 -- 172.21.15.71:0/1238053011 shutdown_connections 2024-09-10T10:11:32.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.955+0000 7f7cf591a640 1 -- 172.21.15.71:0/1238053011 wait complete. 2024-09-10T10:11:32.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.956+0000 7f7cf591a640 1 Processor -- start 2024-09-10T10:11:32.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.956+0000 7f7cf591a640 1 -- start start 2024-09-10T10:11:32.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.956+0000 7f7cf591a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cf00fba20 0x7f7cf0103670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:32.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.956+0000 7f7cf591a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf00fc370 0x7f7cf0101b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:32.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.956+0000 7f7cf591a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf01020f0 con 0x7f7cf00fc370 2024-09-10T10:11:32.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.956+0000 7f7cf591a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf0102230 con 0x7f7cf00fba20 2024-09-10T10:11:32.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.956+0000 7f7cee7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf00fc370 0x7f7cf0101b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:32.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.956+0000 7f7cee7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf00fc370 0x7f7cf0101b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55704/0 (socket says 172.21.15.71:55704) 2024-09-10T10:11:32.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.956+0000 7f7cee7fc640 1 -- 172.21.15.71:0/3731368986 learned_addr learned my addr 172.21.15.71:0/3731368986 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:32.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.956+0000 7f7ceeffd640 1 --2- 172.21.15.71:0/3731368986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cf00fba20 0x7f7cf0103670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:32.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.956+0000 7f7cee7fc640 1 -- 172.21.15.71:0/3731368986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cf00fba20 msgr2=0x7f7cf0103670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:32.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.956+0000 7f7cee7fc640 1 --2- 172.21.15.71:0/3731368986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cf00fba20 0x7f7cf0103670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:32.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.956+0000 7f7cee7fc640 1 -- 172.21.15.71:0/3731368986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce4005040 con 0x7f7cf00fc370 2024-09-10T10:11:32.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.957+0000 7f7cee7fc640 1 --2- 172.21.15.71:0/3731368986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf00fc370 0x7f7cf0101b60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4003080 tx=0x7f7ce4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:32.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.957+0000 7f7cd77fe640 1 -- 172.21.15.71:0/3731368986 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ce4038070 con 0x7f7cf00fc370 2024-09-10T10:11:32.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.957+0000 7f7cd77fe640 1 -- 172.21.15.71:0/3731368986 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7ce402abd0 con 0x7f7cf00fc370 2024-09-10T10:11:32.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.957+0000 7f7cf591a640 1 -- 172.21.15.71:0/3731368986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf01024b0 con 0x7f7cf00fc370 2024-09-10T10:11:32.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.957+0000 7f7cf591a640 1 -- 172.21.15.71:0/3731368986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf01150c0 con 0x7f7cf00fc370 2024-09-10T10:11:32.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.957+0000 7f7cd77fe640 1 -- 172.21.15.71:0/3731368986 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ce403e670 con 0x7f7cf00fc370 2024-09-10T10:11:32.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.958+0000 7f7cf591a640 1 -- 172.21.15.71:0/3731368986 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf004b720 con 0x7f7cf00fc370 2024-09-10T10:11:32.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.959+0000 7f7cd77fe640 1 -- 172.21.15.71:0/3731368986 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7ce4030020 con 0x7f7cf00fc370 2024-09-10T10:11:32.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.960+0000 7f7cd77fe640 1 --2- 172.21.15.71:0/3731368986 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7cd806e0b0 0x7f7cd8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:32.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.960+0000 7f7cd77fe640 1 -- 172.21.15.71:0/3731368986 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f7ce40adf20 con 0x7f7cf00fc370 2024-09-10T10:11:32.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.961+0000 7f7ceeffd640 1 --2- 172.21.15.71:0/3731368986 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7cd806e0b0 0x7f7cd8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:32.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.961+0000 7f7ceeffd640 1 --2- 172.21.15.71:0/3731368986 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7cd806e0b0 0x7f7cd8070560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0103420 tx=0x7f7ce0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:32.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:32.965+0000 7f7cd77fe640 1 -- 172.21.15.71:0/3731368986 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7ce40e31b0 con 0x7f7cf00fc370 2024-09-10T10:11:33.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.175+0000 7f7cf591a640 1 -- 172.21.15.71:0/3731368986 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cf0100bb0 con 0x7f7cd806e0b0 2024-09-10T10:11:33.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.177+0000 7f7cd77fe640 1 -- 172.21.15.71:0/3731368986 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7cf0100bb0 con 0x7f7cd806e0b0 2024-09-10T10:11:33.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.179+0000 7f7cf591a640 1 -- 172.21.15.71:0/3731368986 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7cd806e0b0 msgr2=0x7f7cd8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.179+0000 7f7cf591a640 1 --2- 172.21.15.71:0/3731368986 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7cd806e0b0 0x7f7cd8070560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0103420 tx=0x7f7ce0009040 comp rx=0 tx=0).stop 2024-09-10T10:11:33.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.179+0000 7f7cf591a640 1 -- 172.21.15.71:0/3731368986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf00fc370 msgr2=0x7f7cf0101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.179+0000 7f7cf591a640 1 --2- 172.21.15.71:0/3731368986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf00fc370 0x7f7cf0101b60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4003080 tx=0x7f7ce4009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.179+0000 7f7cf591a640 1 -- 172.21.15.71:0/3731368986 shutdown_connections 2024-09-10T10:11:33.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.179+0000 7f7cf591a640 1 --2- 172.21.15.71:0/3731368986 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7cd806e0b0 0x7f7cd8070560 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.179+0000 7f7cf591a640 1 --2- 172.21.15.71:0/3731368986 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cf00fc370 0x7f7cf0101b60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.179+0000 7f7cf591a640 1 --2- 172.21.15.71:0/3731368986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7cf00fba20 0x7f7cf0103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.179+0000 7f7cf591a640 1 -- 172.21.15.71:0/3731368986 >> 172.21.15.71:0/3731368986 conn(0x7f7cf00f6390 msgr2=0x7f7cf00f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:33.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.179+0000 7f7cf591a640 1 -- 172.21.15.71:0/3731368986 shutdown_connections 2024-09-10T10:11:33.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.179+0000 7f7cf591a640 1 -- 172.21.15.71:0/3731368986 wait complete. 2024-09-10T10:11:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.261+0000 7f028ef85640 1 -- 172.21.15.71:0/1173293622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02880fc720 msgr2=0x7f02880fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.261+0000 7f028ef85640 1 --2- 172.21.15.71:0/1173293622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02880fc720 0x7f02880fcb90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f02740048d0 tx=0x7f0274009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.261+0000 7f028ef85640 1 -- 172.21.15.71:0/1173293622 shutdown_connections 2024-09-10T10:11:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.261+0000 7f028ef85640 1 --2- 172.21.15.71:0/1173293622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02880fc720 0x7f02880fcb90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.261+0000 7f028ef85640 1 --2- 172.21.15.71:0/1173293622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880fb450 0x7f02880fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.261+0000 7f028ef85640 1 -- 172.21.15.71:0/1173293622 >> 172.21.15.71:0/1173293622 conn(0x7f02880f6c10 msgr2=0x7f02880f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.262+0000 7f028ef85640 1 -- 172.21.15.71:0/1173293622 shutdown_connections 2024-09-10T10:11:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.262+0000 7f028ef85640 1 -- 172.21.15.71:0/1173293622 wait complete. 2024-09-10T10:11:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.262+0000 7f028ef85640 1 Processor -- start 2024-09-10T10:11:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.262+0000 7f028ef85640 1 -- start start 2024-09-10T10:11:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.262+0000 7f028ef85640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880fb450 0x7f028810c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.262+0000 7f028ef85640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02880fc720 0x7f028810c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.262+0000 7f028ef85640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028810cbb0 con 0x7f02880fc720 2024-09-10T10:11:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.262+0000 7f028ef85640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028810d3d0 con 0x7f02880fb450 2024-09-10T10:11:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.263+0000 7f0287fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02880fc720 0x7f028810c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.263+0000 7f0287fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02880fc720 0x7f028810c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60532/0 (socket says 172.21.15.71:60532) 2024-09-10T10:11:33.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.263+0000 7f0287fff640 1 -- 172.21.15.71:0/3877965324 learned_addr learned my addr 172.21.15.71:0/3877965324 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:33.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.263+0000 7f028cd21640 1 --2- 172.21.15.71:0/3877965324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880fb450 0x7f028810c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:33.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.263+0000 7f0287fff640 1 -- 172.21.15.71:0/3877965324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880fb450 msgr2=0x7f028810c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.263+0000 7f0287fff640 1 --2- 172.21.15.71:0/3877965324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880fb450 0x7f028810c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.263+0000 7f0287fff640 1 -- 172.21.15.71:0/3877965324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0274005040 con 0x7f02880fc720 2024-09-10T10:11:33.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.263+0000 7f0287fff640 1 --2- 172.21.15.71:0/3877965324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02880fc720 0x7f028810c560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0274000c00 tx=0x7f0274009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:33.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.263+0000 7f02857fa640 1 -- 172.21.15.71:0/3877965324 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f027403a070 con 0x7f02880fc720 2024-09-10T10:11:33.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.263+0000 7f02857fa640 1 -- 172.21.15.71:0/3877965324 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0274009880 con 0x7f02880fc720 2024-09-10T10:11:33.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.263+0000 7f028ef85640 1 -- 172.21.15.71:0/3877965324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028810d600 con 0x7f02880fc720 2024-09-10T10:11:33.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.264+0000 7f02857fa640 1 -- 172.21.15.71:0/3877965324 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f027403e8b0 con 0x7f02880fc720 2024-09-10T10:11:33.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.264+0000 7f028ef85640 1 -- 172.21.15.71:0/3877965324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028810da90 con 0x7f02880fc720 2024-09-10T10:11:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.265+0000 7f028ef85640 1 -- 172.21.15.71:0/3877965324 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02880fa8b0 con 0x7f02880fc720 2024-09-10T10:11:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.266+0000 7f02857fa640 1 -- 172.21.15.71:0/3877965324 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0274030020 con 0x7f02880fc720 2024-09-10T10:11:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.266+0000 7f02857fa640 1 --2- 172.21.15.71:0/3877965324 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f027806e0b0 0x7f0278070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.267+0000 7f02857fa640 1 -- 172.21.15.71:0/3877965324 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f02740afa90 con 0x7f02880fc720 2024-09-10T10:11:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.267+0000 7f028cd21640 1 --2- 172.21.15.71:0/3877965324 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f027806e0b0 0x7f0278070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.267+0000 7f028cd21640 1 --2- 172.21.15.71:0/3877965324 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f027806e0b0 0x7f0278070560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f027c004ed0 tx=0x7f027c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:33.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.273+0000 7f02857fa640 1 -- 172.21.15.71:0/3877965324 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0274078e10 con 0x7f02880fc720 2024-09-10T10:11:33.403 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:33 smithi071 ceph-mon[90773]: pgmap v190: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-10T10:11:33.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.513+0000 7f028ef85640 1 -- 172.21.15.71:0/3877965324 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f028810df50 con 0x7f027806e0b0 2024-09-10T10:11:33.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.523+0000 7f02857fa640 1 -- 172.21.15.71:0/3877965324 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f028810df50 con 0x7f027806e0b0 2024-09-10T10:11:33.524 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:11:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (6m) 12s ago 15m 25.5M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:11:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (4m) 12s ago 15m 6903k - 19.1.1-305-g1cf819b7 41d671128357 5dc74ad01560 2024-09-10T10:11:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (4m) 64s ago 14m 6891k - 19.1.1-305-g1cf819b7 41d671128357 6f4355e875db 2024-09-10T10:11:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (6m) 12s ago 15m 85.9M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:11:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (9m) 12s ago 9m 113M - 17.2.7-1597-g96d63e75 f3fc7d52e233 69ae8b1f06b1 2024-09-10T10:11:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (17s) 12s ago 10m 13.8M - 19.1.1-305-g1cf819b7 41d671128357 58af9b545bf4 2024-09-10T10:11:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (9m) 64s ago 9m 108M - 17.2.7-1597-g96d63e75 f3fc7d52e233 1104a1a3ebb5 2024-09-10T10:11:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (9m) 64s ago 9m 62.7M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:11:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (6m) 12s ago 16m 504M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:11:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (5m) 64s ago 14m 441M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:11:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (5m) 12s ago 16m 51.1M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:11:33.525 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (4m) 64s ago 14m 41.1M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:11:33.526 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (6m) 12s ago 15m 16.9M - 1.5.0 0da6a335fe13 c3d47d79cd22 2024-09-10T10:11:33.526 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (6m) 64s ago 14m 16.5M - 1.5.0 0da6a335fe13 9a25165a0fd1 2024-09-10T10:11:33.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (3m) 12s ago 13m 100M 1557M 19.1.1-305-g1cf819b7 41d671128357 f1e9da1144c1 2024-09-10T10:11:33.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (3m) 12s ago 13m 104M 1557M 19.1.1-305-g1cf819b7 41d671128357 5afc8bef5343 2024-09-10T10:11:33.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (2m) 12s ago 12m 91.8M 1557M 19.1.1-305-g1cf819b7 41d671128357 5e5976fcfaa8 2024-09-10T10:11:33.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (2m) 64s ago 12m 104M 2581M 19.1.1-305-g1cf819b7 41d671128357 e22ee626ccd0 2024-09-10T10:11:33.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (99s) 64s ago 11m 92.3M 2581M 19.1.1-305-g1cf819b7 41d671128357 e92f23ad2c77 2024-09-10T10:11:33.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (67s) 64s ago 11m 11.8M 2581M 19.1.1-305-g1cf819b7 41d671128357 3440ee1c721e 2024-09-10T10:11:33.526 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (5m) 12s ago 14m 63.2M - 2.43.0 a07b618ecd1d 47d3ae62ce5e 2024-09-10T10:11:33.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.525+0000 7f028ef85640 1 -- 172.21.15.71:0/3877965324 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f027806e0b0 msgr2=0x7f0278070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.525+0000 7f028ef85640 1 --2- 172.21.15.71:0/3877965324 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f027806e0b0 0x7f0278070560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f027c004ed0 tx=0x7f027c00b040 comp rx=0 tx=0).stop 2024-09-10T10:11:33.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.525+0000 7f028ef85640 1 -- 172.21.15.71:0/3877965324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02880fc720 msgr2=0x7f028810c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.525+0000 7f028ef85640 1 --2- 172.21.15.71:0/3877965324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02880fc720 0x7f028810c560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0274000c00 tx=0x7f0274009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.525+0000 7f028ef85640 1 -- 172.21.15.71:0/3877965324 shutdown_connections 2024-09-10T10:11:33.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.525+0000 7f028ef85640 1 --2- 172.21.15.71:0/3877965324 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f027806e0b0 0x7f0278070560 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.525+0000 7f028ef85640 1 --2- 172.21.15.71:0/3877965324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02880fc720 0x7f028810c560 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.525+0000 7f028ef85640 1 --2- 172.21.15.71:0/3877965324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02880fb450 0x7f028810c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.525+0000 7f028ef85640 1 -- 172.21.15.71:0/3877965324 >> 172.21.15.71:0/3877965324 conn(0x7f02880f6c10 msgr2=0x7f02880f8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:33.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.526+0000 7f028ef85640 1 -- 172.21.15.71:0/3877965324 shutdown_connections 2024-09-10T10:11:33.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.526+0000 7f028ef85640 1 -- 172.21.15.71:0/3877965324 wait complete. 2024-09-10T10:11:33.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.612+0000 7f84430db640 1 -- 172.21.15.71:0/4258068940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f843c0664d0 msgr2=0x7f843c0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.612+0000 7f84430db640 1 --2- 172.21.15.71:0/4258068940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f843c0664d0 0x7f843c0ff130 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f84300048d0 tx=0x7f8430009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.612+0000 7f84430db640 1 -- 172.21.15.71:0/4258068940 shutdown_connections 2024-09-10T10:11:33.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.612+0000 7f84430db640 1 --2- 172.21.15.71:0/4258068940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f843c0ff670 0x7f843c101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.612+0000 7f84430db640 1 --2- 172.21.15.71:0/4258068940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f843c0664d0 0x7f843c0ff130 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.612+0000 7f84430db640 1 -- 172.21.15.71:0/4258068940 >> 172.21.15.71:0/4258068940 conn(0x7f843c0f6c00 msgr2=0x7f843c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:33.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.612+0000 7f84430db640 1 -- 172.21.15.71:0/4258068940 shutdown_connections 2024-09-10T10:11:33.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.613+0000 7f84430db640 1 -- 172.21.15.71:0/4258068940 wait complete. 2024-09-10T10:11:33.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.613+0000 7f84430db640 1 Processor -- start 2024-09-10T10:11:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.613+0000 7f84430db640 1 -- start start 2024-09-10T10:11:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.614+0000 7f84430db640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f843c0664d0 0x7f843c10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.614+0000 7f84430db640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f843c0ff670 0x7f843c10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.614+0000 7f84430db640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c10dc10 con 0x7f843c0664d0 2024-09-10T10:11:33.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.614+0000 7f84430db640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c10e430 con 0x7f843c0ff670 2024-09-10T10:11:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.615+0000 7f843bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f843c0ff670 0x7f843c10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.615+0000 7f843bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f843c0ff670 0x7f843c10d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.71:59078/0 (socket says 172.21.15.71:59078) 2024-09-10T10:11:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.615+0000 7f843bfff640 1 -- 172.21.15.71:0/7051865 learned_addr learned my addr 172.21.15.71:0/7051865 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.615+0000 7f8440e77640 1 --2- 172.21.15.71:0/7051865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f843c0664d0 0x7f843c10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.616+0000 7f843bfff640 1 -- 172.21.15.71:0/7051865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f843c0664d0 msgr2=0x7f843c10d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.616+0000 7f843bfff640 1 --2- 172.21.15.71:0/7051865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f843c0664d0 0x7f843c10d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.616+0000 7f843bfff640 1 -- 172.21.15.71:0/7051865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430005040 con 0x7f843c0ff670 2024-09-10T10:11:33.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.616+0000 7f843bfff640 1 --2- 172.21.15.71:0/7051865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f843c0ff670 0x7f843c10d5c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f842800eb70 tx=0x7f842800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:33.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.616+0000 7f84397fa640 1 -- 172.21.15.71:0/7051865 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8428007c30 con 0x7f843c0ff670 2024-09-10T10:11:33.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.616+0000 7f84397fa640 1 -- 172.21.15.71:0/7051865 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f842800f040 con 0x7f843c0ff670 2024-09-10T10:11:33.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.616+0000 7f84430db640 1 -- 172.21.15.71:0/7051865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843c10e660 con 0x7f843c0ff670 2024-09-10T10:11:33.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.616+0000 7f84397fa640 1 -- 172.21.15.71:0/7051865 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8428009470 con 0x7f843c0ff670 2024-09-10T10:11:33.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.616+0000 7f84430db640 1 -- 172.21.15.71:0/7051865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843c10ec00 con 0x7f843c0ff670 2024-09-10T10:11:33.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.617+0000 7f84430db640 1 -- 172.21.15.71:0/7051865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c0fa880 con 0x7f843c0ff670 2024-09-10T10:11:33.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.618+0000 7f84397fa640 1 -- 172.21.15.71:0/7051865 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f84280096e0 con 0x7f843c0ff670 2024-09-10T10:11:33.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.618+0000 7f84397fa640 1 --2- 172.21.15.71:0/7051865 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f842c06e0f0 0x7f842c0705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:33.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.618+0000 7f84397fa640 1 -- 172.21.15.71:0/7051865 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f842808d8a0 con 0x7f843c0ff670 2024-09-10T10:11:33.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.618+0000 7f8440e77640 1 --2- 172.21.15.71:0/7051865 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f842c06e0f0 0x7f842c0705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:33.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.619+0000 7f8440e77640 1 --2- 172.21.15.71:0/7051865 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f842c06e0f0 0x7f842c0705a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8430000c00 tx=0x7f8430035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:33.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.623+0000 7f84397fa640 1 -- 172.21.15.71:0/7051865 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8428056b80 con 0x7f843c0ff670 2024-09-10T10:11:33.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:33 smithi107 ceph-mon[79396]: pgmap v190: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-10T10:11:33.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.870+0000 7f84430db640 1 -- 172.21.15.71:0/7051865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f843c04b720 con 0x7f843c0ff670 2024-09-10T10:11:33.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.870+0000 7f84397fa640 1 -- 172.21.15.71:0/7051865 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7f842805a240 con 0x7f843c0ff670 2024-09-10T10:11:33.872 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:11:33.872 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:11:33.872 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:11:33.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:11:33.872 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:11:33.872 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:11:33.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:11:33.872 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:11:33.872 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T10:11:33.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:11:33.873 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:11:33.873 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2, 2024-09-10T10:11:33.873 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:11:33.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:11:33.873 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:11:33.873 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.7-1597-g96d63e75 (96d63e75d310869e716ce7c8655577b0e88a04aa) quincy (stable)": 2, 2024-09-10T10:11:33.873 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 12 2024-09-10T10:11:33.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:11:33.873 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:11:33.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.873+0000 7f84430db640 1 -- 172.21.15.71:0/7051865 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f842c06e0f0 msgr2=0x7f842c0705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.873+0000 7f84430db640 1 --2- 172.21.15.71:0/7051865 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f842c06e0f0 0x7f842c0705a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8430000c00 tx=0x7f8430035040 comp rx=0 tx=0).stop 2024-09-10T10:11:33.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.873+0000 7f84430db640 1 -- 172.21.15.71:0/7051865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f843c0ff670 msgr2=0x7f843c10d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.873+0000 7f84430db640 1 --2- 172.21.15.71:0/7051865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f843c0ff670 0x7f843c10d5c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f842800eb70 tx=0x7f842800b040 comp rx=0 tx=0).stop 2024-09-10T10:11:33.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.873+0000 7f84430db640 1 -- 172.21.15.71:0/7051865 shutdown_connections 2024-09-10T10:11:33.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.873+0000 7f84430db640 1 --2- 172.21.15.71:0/7051865 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f842c06e0f0 0x7f842c0705a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.873+0000 7f84430db640 1 --2- 172.21.15.71:0/7051865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f843c0ff670 0x7f843c10d5c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.873+0000 7f84430db640 1 --2- 172.21.15.71:0/7051865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f843c0664d0 0x7f843c10d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.873+0000 7f84430db640 1 -- 172.21.15.71:0/7051865 >> 172.21.15.71:0/7051865 conn(0x7f843c0f6c00 msgr2=0x7f843c0f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:33.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.873+0000 7f84430db640 1 -- 172.21.15.71:0/7051865 shutdown_connections 2024-09-10T10:11:33.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.873+0000 7f84430db640 1 -- 172.21.15.71:0/7051865 wait complete. 2024-09-10T10:11:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.958+0000 7ff2ae863640 1 -- 172.21.15.71:0/456380076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a80fd7f0 msgr2=0x7ff2a80fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.958+0000 7ff2ae863640 1 --2- 172.21.15.71:0/456380076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a80fd7f0 0x7ff2a80fdc60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0048d0 tx=0x7ff29c009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.958+0000 7ff2ae863640 1 -- 172.21.15.71:0/456380076 shutdown_connections 2024-09-10T10:11:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.958+0000 7ff2ae863640 1 --2- 172.21.15.71:0/456380076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a80fd7f0 0x7ff2a80fdc60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.958+0000 7ff2ae863640 1 --2- 172.21.15.71:0/456380076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a80fc520 0x7ff2a80fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.958+0000 7ff2ae863640 1 -- 172.21.15.71:0/456380076 >> 172.21.15.71:0/456380076 conn(0x7ff2a80f7ce0 msgr2=0x7ff2a80fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.958+0000 7ff2ae863640 1 -- 172.21.15.71:0/456380076 shutdown_connections 2024-09-10T10:11:33.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.958+0000 7ff2ae863640 1 -- 172.21.15.71:0/456380076 wait complete. 2024-09-10T10:11:33.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.958+0000 7ff2ae863640 1 Processor -- start 2024-09-10T10:11:33.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.959+0000 7ff2ae863640 1 -- start start 2024-09-10T10:11:33.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.959+0000 7ff2ae863640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a80fc520 0x7ff2a810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:33.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.959+0000 7ff2ae863640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a80fd7f0 0x7ff2a810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:33.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.959+0000 7ff2ae863640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a810dc10 con 0x7ff2a80fc520 2024-09-10T10:11:33.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.959+0000 7ff2ae863640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a810e430 con 0x7ff2a80fd7f0 2024-09-10T10:11:33.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.959+0000 7ff2a7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a80fc520 0x7ff2a810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.959+0000 7ff2a7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a80fc520 0x7ff2a810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60586/0 (socket says 172.21.15.71:60586) 2024-09-10T10:11:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.959+0000 7ff2a7fff640 1 -- 172.21.15.71:0/3369242625 learned_addr learned my addr 172.21.15.71:0/3369242625 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.959+0000 7ff2a77fe640 1 --2- 172.21.15.71:0/3369242625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a80fd7f0 0x7ff2a810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.959+0000 7ff2a7fff640 1 -- 172.21.15.71:0/3369242625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a80fd7f0 msgr2=0x7ff2a810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.959+0000 7ff2a7fff640 1 --2- 172.21.15.71:0/3369242625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a80fd7f0 0x7ff2a810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.959+0000 7ff2a7fff640 1 -- 172.21.15.71:0/3369242625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c005040 con 0x7ff2a80fc520 2024-09-10T10:11:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.960+0000 7ff2a7fff640 1 --2- 172.21.15.71:0/3369242625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a80fc520 0x7ff2a810d080 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff29800eb70 tx=0x7ff29800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.960+0000 7ff2a4ff9640 1 -- 172.21.15.71:0/3369242625 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff298007c30 con 0x7ff2a80fc520 2024-09-10T10:11:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.960+0000 7ff2a4ff9640 1 -- 172.21.15.71:0/3369242625 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff29800f040 con 0x7ff2a80fc520 2024-09-10T10:11:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.960+0000 7ff2ae863640 1 -- 172.21.15.71:0/3369242625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a810e660 con 0x7ff2a80fc520 2024-09-10T10:11:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.960+0000 7ff2a4ff9640 1 -- 172.21.15.71:0/3369242625 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff29800ca60 con 0x7ff2a80fc520 2024-09-10T10:11:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.960+0000 7ff2ae863640 1 -- 172.21.15.71:0/3369242625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a810ec00 con 0x7ff2a80fc520 2024-09-10T10:11:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.961+0000 7ff2ae863640 1 -- 172.21.15.71:0/3369242625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a80fb980 con 0x7ff2a80fc520 2024-09-10T10:11:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.961+0000 7ff2a4ff9640 1 -- 172.21.15.71:0/3369242625 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff29800cbc0 con 0x7ff2a80fc520 2024-09-10T10:11:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.962+0000 7ff2a4ff9640 1 --2- 172.21.15.71:0/3369242625 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff2900724c0 0x7ff290074970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.962+0000 7ff2a4ff9640 1 -- 172.21.15.71:0/3369242625 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff29808d760 con 0x7ff2a80fc520 2024-09-10T10:11:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.962+0000 7ff2a77fe640 1 --2- 172.21.15.71:0/3369242625 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff2900724c0 0x7ff290074970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.963+0000 7ff2a77fe640 1 --2- 172.21.15.71:0/3369242625 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff2900724c0 0x7ff290074970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff29c007ac0 tx=0x7ff29c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:33.967+0000 7ff2a4ff9640 1 -- 172.21.15.71:0/3369242625 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff298056b60 con 0x7ff2a80fc520 2024-09-10T10:11:34.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.173+0000 7ff2ae863640 1 -- 172.21.15.71:0/3369242625 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff2a804b720 con 0x7ff2a80fc520 2024-09-10T10:11:34.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.173+0000 7ff2a4ff9640 1 -- 172.21.15.71:0/3369242625 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1790 (secure 0 0 0) 0x7ff29805a220 con 0x7ff2a80fc520 2024-09-10T10:11:34.175 INFO:teuthology.orchestra.run.smithi071.stdout:e33 2024-09-10T10:11:34.175 INFO:teuthology.orchestra.run.smithi071.stdout:btime 2024-09-10T10:11:28:481338+0000 2024-09-10T10:11:34.175 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:11:34.175 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:11:34.175 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:11:34.175 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:11:34.176 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:11:34.176 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:11:34.176 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 33 2024-09-10T10:11:34.176 INFO:teuthology.orchestra.run.smithi071.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-10T10:11:34.176 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:11:34.176 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:11:28.481324+0000 2024-09-10T10:11:34.176 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:11:34.176 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:11:34.176 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:11:34.176 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:11:34.176 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:11:34.176 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:11:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:11:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:11:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 81 2024-09-10T10:11:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T10:11:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 1 2024-09-10T10:11:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:in 0 2024-09-10T10:11:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=34416} 2024-09-10T10:11:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:11:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:11:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 1 2024-09-10T10:11:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:11:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:11:34.177 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:11:34.178 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:11:34.178 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:11:34.178 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:11:34.178 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 0 members: 2024-09-10T10:11:34.178 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:34416} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.71:6826/1701579524,v1:172.21.15.71:6827/1701579524] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:11:34.178 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:11:34.178 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:11:34.178 INFO:teuthology.orchestra.run.smithi071.stdout:Standby daemons: 2024-09-10T10:11:34.178 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:11:34.178 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{-1:44315} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/3716221026,v1:172.21.15.107:6827/3716221026] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:11:34.178 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6824/1526152997,v1:172.21.15.107:6825/1526152997] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T10:11:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 33 2024-09-10T10:11:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.176+0000 7ff2ae863640 1 -- 172.21.15.71:0/3369242625 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff2900724c0 msgr2=0x7ff290074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.176+0000 7ff2ae863640 1 --2- 172.21.15.71:0/3369242625 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff2900724c0 0x7ff290074970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff29c007ac0 tx=0x7ff29c035040 comp rx=0 tx=0).stop 2024-09-10T10:11:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.176+0000 7ff2ae863640 1 -- 172.21.15.71:0/3369242625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a80fc520 msgr2=0x7ff2a810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.176+0000 7ff2ae863640 1 --2- 172.21.15.71:0/3369242625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a80fc520 0x7ff2a810d080 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff29800eb70 tx=0x7ff29800b040 comp rx=0 tx=0).stop 2024-09-10T10:11:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.176+0000 7ff2ae863640 1 -- 172.21.15.71:0/3369242625 shutdown_connections 2024-09-10T10:11:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.176+0000 7ff2ae863640 1 --2- 172.21.15.71:0/3369242625 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff2900724c0 0x7ff290074970 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.176+0000 7ff2ae863640 1 --2- 172.21.15.71:0/3369242625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2a80fd7f0 0x7ff2a810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.176+0000 7ff2ae863640 1 --2- 172.21.15.71:0/3369242625 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2a80fc520 0x7ff2a810d080 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.176+0000 7ff2ae863640 1 -- 172.21.15.71:0/3369242625 >> 172.21.15.71:0/3369242625 conn(0x7ff2a80f7ce0 msgr2=0x7ff2a80f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.177+0000 7ff2ae863640 1 -- 172.21.15.71:0/3369242625 shutdown_connections 2024-09-10T10:11:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.177+0000 7ff2ae863640 1 -- 172.21.15.71:0/3369242625 wait complete. 2024-09-10T10:11:34.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.261+0000 7fc5977f7640 1 -- 172.21.15.71:0/2295631132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5900fd810 msgr2=0x7fc5900fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:34.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.261+0000 7fc5977f7640 1 --2- 172.21.15.71:0/2295631132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5900fd810 0x7fc5900fdc80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0048d0 tx=0x7fc58c009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.261+0000 7fc5977f7640 1 -- 172.21.15.71:0/2295631132 shutdown_connections 2024-09-10T10:11:34.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.261+0000 7fc5977f7640 1 --2- 172.21.15.71:0/2295631132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5900fd810 0x7fc5900fdc80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.261+0000 7fc5977f7640 1 --2- 172.21.15.71:0/2295631132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5900fc540 0x7fc5900fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.261+0000 7fc5977f7640 1 -- 172.21.15.71:0/2295631132 >> 172.21.15.71:0/2295631132 conn(0x7fc5900f7d00 msgr2=0x7fc5900fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:34.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.261+0000 7fc5977f7640 1 -- 172.21.15.71:0/2295631132 shutdown_connections 2024-09-10T10:11:34.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.261+0000 7fc5977f7640 1 -- 172.21.15.71:0/2295631132 wait complete. 2024-09-10T10:11:34.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc5977f7640 1 Processor -- start 2024-09-10T10:11:34.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc5977f7640 1 -- start start 2024-09-10T10:11:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc5977f7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5900fc540 0x7fc59010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc5977f7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5900fd810 0x7fc59010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc5977f7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59010dc20 con 0x7fc5900fd810 2024-09-10T10:11:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc5977f7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59010e3f0 con 0x7fc5900fc540 2024-09-10T10:11:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc594d92640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5900fd810 0x7fc59010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc594d92640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5900fd810 0x7fc59010d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60608/0 (socket says 172.21.15.71:60608) 2024-09-10T10:11:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc594d92640 1 -- 172.21.15.71:0/4013631666 learned_addr learned my addr 172.21.15.71:0/4013631666 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc595593640 1 --2- 172.21.15.71:0/4013631666 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5900fc540 0x7fc59010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:34.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc594d92640 1 -- 172.21.15.71:0/4013631666 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5900fc540 msgr2=0x7fc59010d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc594d92640 1 --2- 172.21.15.71:0/4013631666 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5900fc540 0x7fc59010d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc594d92640 1 -- 172.21.15.71:0/4013631666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c005040 con 0x7fc5900fd810 2024-09-10T10:11:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc595593640 1 --2- 172.21.15.71:0/4013631666 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5900fc540 0x7fc59010d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:11:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc594d92640 1 --2- 172.21.15.71:0/4013631666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5900fd810 0x7fc59010d5d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0043d0 tx=0x7fc58c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.262+0000 7fc585ffb640 1 -- 172.21.15.71:0/4013631666 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc58c038070 con 0x7fc5900fd810 2024-09-10T10:11:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.263+0000 7fc585ffb640 1 -- 172.21.15.71:0/4013631666 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc58c02ae90 con 0x7fc5900fd810 2024-09-10T10:11:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.263+0000 7fc5977f7640 1 -- 172.21.15.71:0/4013631666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59010e620 con 0x7fc5900fd810 2024-09-10T10:11:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.263+0000 7fc585ffb640 1 -- 172.21.15.71:0/4013631666 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc58c03e670 con 0x7fc5900fd810 2024-09-10T10:11:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.263+0000 7fc5977f7640 1 -- 172.21.15.71:0/4013631666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59010ebc0 con 0x7fc5900fd810 2024-09-10T10:11:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.264+0000 7fc5977f7640 1 -- 172.21.15.71:0/4013631666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5900fb9a0 con 0x7fc5900fd810 2024-09-10T10:11:34.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.264+0000 7fc585ffb640 1 -- 172.21.15.71:0/4013631666 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc58c030020 con 0x7fc5900fd810 2024-09-10T10:11:34.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.265+0000 7fc585ffb640 1 --2- 172.21.15.71:0/4013631666 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc57c06e0b0 0x7fc57c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:34.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.265+0000 7fc585ffb640 1 -- 172.21.15.71:0/4013631666 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc58c0ade60 con 0x7fc5900fd810 2024-09-10T10:11:34.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.265+0000 7fc595593640 1 --2- 172.21.15.71:0/4013631666 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc57c06e0b0 0x7fc57c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:34.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.265+0000 7fc595593640 1 --2- 172.21.15.71:0/4013631666 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc57c06e0b0 0x7fc57c070560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc580004d60 tx=0x7fc58000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:34.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.269+0000 7fc585ffb640 1 -- 172.21.15.71:0/4013631666 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc58c077130 con 0x7fc5900fd810 2024-09-10T10:11:34.433 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:34 smithi071 ceph-mon[90773]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:34.433 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:34 smithi071 ceph-mon[90773]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:34.434 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:34.434 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:34.434 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:34.434 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:34 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/7051865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:34.434 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:34 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/3369242625' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:11:34.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.463+0000 7fc5977f7640 1 -- 172.21.15.71:0/4013631666 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc59010ef40 con 0x7fc57c06e0b0 2024-09-10T10:11:34.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.464+0000 7fc585ffb640 1 -- 172.21.15.71:0/4013631666 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc59010ef40 con 0x7fc57c06e0b0 2024-09-10T10:11:34.465 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:11:34.466 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:11:34.466 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:11:34.466 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:11:34.466 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:11:34.466 INFO:teuthology.orchestra.run.smithi071.stdout: "osd", 2024-09-10T10:11:34.466 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-09-10T10:11:34.466 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-10T10:11:34.466 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-10T10:11:34.466 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:11:34.467 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "13/21 daemons upgraded", 2024-09-10T10:11:34.467 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mds daemons", 2024-09-10T10:11:34.467 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:11:34.467 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:11:34.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.466+0000 7fc5977f7640 1 -- 172.21.15.71:0/4013631666 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc57c06e0b0 msgr2=0x7fc57c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:34.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.466+0000 7fc5977f7640 1 --2- 172.21.15.71:0/4013631666 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc57c06e0b0 0x7fc57c070560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc580004d60 tx=0x7fc58000b040 comp rx=0 tx=0).stop 2024-09-10T10:11:34.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.466+0000 7fc5977f7640 1 -- 172.21.15.71:0/4013631666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5900fd810 msgr2=0x7fc59010d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:34.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.466+0000 7fc5977f7640 1 --2- 172.21.15.71:0/4013631666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5900fd810 0x7fc59010d5d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0043d0 tx=0x7fc58c009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.466+0000 7fc5977f7640 1 -- 172.21.15.71:0/4013631666 shutdown_connections 2024-09-10T10:11:34.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.466+0000 7fc5977f7640 1 --2- 172.21.15.71:0/4013631666 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc57c06e0b0 0x7fc57c070560 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.466+0000 7fc5977f7640 1 --2- 172.21.15.71:0/4013631666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5900fd810 0x7fc59010d5d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.466+0000 7fc5977f7640 1 --2- 172.21.15.71:0/4013631666 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5900fc540 0x7fc59010d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.466+0000 7fc5977f7640 1 -- 172.21.15.71:0/4013631666 >> 172.21.15.71:0/4013631666 conn(0x7fc5900f7d00 msgr2=0x7fc5900f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:34.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.467+0000 7fc5977f7640 1 -- 172.21.15.71:0/4013631666 shutdown_connections 2024-09-10T10:11:34.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.467+0000 7fc5977f7640 1 -- 172.21.15.71:0/4013631666 wait complete. 2024-09-10T10:11:34.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.544+0000 7fbfb1064640 1 -- 172.21.15.71:0/699384112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfac0ff6a0 msgr2=0x7fbfac101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:34.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.544+0000 7fbfb1064640 1 --2- 172.21.15.71:0/699384112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfac0ff6a0 0x7fbfac101a80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c0048d0 tx=0x7fbf9c009da0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.544+0000 7fbfb1064640 1 -- 172.21.15.71:0/699384112 shutdown_connections 2024-09-10T10:11:34.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.544+0000 7fbfb1064640 1 --2- 172.21.15.71:0/699384112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfac0ff6a0 0x7fbfac101a80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.544+0000 7fbfb1064640 1 --2- 172.21.15.71:0/699384112 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfac066730 0x7fbfac0ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.544+0000 7fbfb1064640 1 -- 172.21.15.71:0/699384112 >> 172.21.15.71:0/699384112 conn(0x7fbfac0f6c10 msgr2=0x7fbfac0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:34.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.544+0000 7fbfb1064640 1 -- 172.21.15.71:0/699384112 shutdown_connections 2024-09-10T10:11:34.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.544+0000 7fbfb1064640 1 -- 172.21.15.71:0/699384112 wait complete. 2024-09-10T10:11:34.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.545+0000 7fbfb1064640 1 Processor -- start 2024-09-10T10:11:34.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.545+0000 7fbfb1064640 1 -- start start 2024-09-10T10:11:34.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.545+0000 7fbfb1064640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfac066730 0x7fbfac0fcb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:34.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.545+0000 7fbfb1064640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfac0ff6a0 0x7fbfac0fb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:34.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.545+0000 7fbfb1064640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0fb5f0 con 0x7fbfac066730 2024-09-10T10:11:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.545+0000 7fbfb1064640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0fb730 con 0x7fbfac0ff6a0 2024-09-10T10:11:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.545+0000 7fbfaad9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfac066730 0x7fbfac0fcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.545+0000 7fbfaad9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfac066730 0x7fbfac0fcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60628/0 (socket says 172.21.15.71:60628) 2024-09-10T10:11:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.545+0000 7fbfaad9d640 1 -- 172.21.15.71:0/3762853652 learned_addr learned my addr 172.21.15.71:0/3762853652 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:11:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.545+0000 7fbfaa59c640 1 --2- 172.21.15.71:0/3762853652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfac0ff6a0 0x7fbfac0fb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.545+0000 7fbfaad9d640 1 -- 172.21.15.71:0/3762853652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfac0ff6a0 msgr2=0x7fbfac0fb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.545+0000 7fbfaad9d640 1 --2- 172.21.15.71:0/3762853652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfac0ff6a0 0x7fbfac0fb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.545+0000 7fbfaad9d640 1 -- 172.21.15.71:0/3762853652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c005040 con 0x7fbfac066730 2024-09-10T10:11:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.546+0000 7fbfaad9d640 1 --2- 172.21.15.71:0/3762853652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfac066730 0x7fbfac0fcb70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbf94002a80 tx=0x7fbf94004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.546+0000 7fbfa37fe640 1 -- 172.21.15.71:0/3762853652 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf94007c30 con 0x7fbfac066730 2024-09-10T10:11:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.546+0000 7fbfa37fe640 1 -- 172.21.15.71:0/3762853652 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbf9400f040 con 0x7fbfac066730 2024-09-10T10:11:34.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.546+0000 7fbfb1064640 1 -- 172.21.15.71:0/3762853652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac0fba10 con 0x7fbfac066730 2024-09-10T10:11:34.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.546+0000 7fbfa37fe640 1 -- 172.21.15.71:0/3762853652 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf94009580 con 0x7fbfac066730 2024-09-10T10:11:34.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.546+0000 7fbfb1064640 1 -- 172.21.15.71:0/3762853652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac1150d0 con 0x7fbfac066730 2024-09-10T10:11:34.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.547+0000 7fbfb1064640 1 -- 172.21.15.71:0/3762853652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac0fa8b0 con 0x7fbfac066730 2024-09-10T10:11:34.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.547+0000 7fbfa37fe640 1 -- 172.21.15.71:0/3762853652 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbf940096e0 con 0x7fbfac066730 2024-09-10T10:11:34.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.548+0000 7fbfa37fe640 1 --2- 172.21.15.71:0/3762853652 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fbf9806e0b0 0x7fbf98070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:34.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.548+0000 7fbfa37fe640 1 -- 172.21.15.71:0/3762853652 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fbf9408dae0 con 0x7fbfac066730 2024-09-10T10:11:34.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.548+0000 7fbfaa59c640 1 --2- 172.21.15.71:0/3762853652 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fbf9806e0b0 0x7fbf98070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:34.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.548+0000 7fbfaa59c640 1 --2- 172.21.15.71:0/3762853652 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fbf9806e0b0 0x7fbf98070560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c007ac0 tx=0x7fbf9c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:34.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.552+0000 7fbfa37fe640 1 -- 172.21.15.71:0/3762853652 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbf94056e30 con 0x7fbfac066730 2024-09-10T10:11:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:34 smithi107 ceph-mon[79396]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:34 smithi107 ceph-mon[79396]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:34 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/7051865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:34.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:34 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/3369242625' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:11:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.819+0000 7fbfb1064640 1 -- 172.21.15.71:0/3762853652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbfac04b720 con 0x7fbfac066730 2024-09-10T10:11:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.819+0000 7fbfa37fe640 1 -- 172.21.15.71:0/3762853652 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7fbf9405a4f0 con 0x7fbfac066730 2024-09-10T10:11:34.821 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 filesystem is degraded 2024-09-10T10:11:34.821 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-10T10:11:34.821 INFO:teuthology.orchestra.run.smithi071.stdout: fs cephfs is degraded 2024-09-10T10:11:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.822+0000 7fbfb1064640 1 -- 172.21.15.71:0/3762853652 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fbf9806e0b0 msgr2=0x7fbf98070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.822+0000 7fbfb1064640 1 --2- 172.21.15.71:0/3762853652 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fbf9806e0b0 0x7fbf98070560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c007ac0 tx=0x7fbf9c035040 comp rx=0 tx=0).stop 2024-09-10T10:11:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.822+0000 7fbfb1064640 1 -- 172.21.15.71:0/3762853652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfac066730 msgr2=0x7fbfac0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.822+0000 7fbfb1064640 1 --2- 172.21.15.71:0/3762853652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfac066730 0x7fbfac0fcb70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbf94002a80 tx=0x7fbf94004570 comp rx=0 tx=0).stop 2024-09-10T10:11:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.822+0000 7fbfb1064640 1 -- 172.21.15.71:0/3762853652 shutdown_connections 2024-09-10T10:11:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.822+0000 7fbfb1064640 1 --2- 172.21.15.71:0/3762853652 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fbf9806e0b0 0x7fbf98070560 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.822+0000 7fbfb1064640 1 --2- 172.21.15.71:0/3762853652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfac0ff6a0 0x7fbfac0fb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.822+0000 7fbfb1064640 1 --2- 172.21.15.71:0/3762853652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfac066730 0x7fbfac0fcb70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.822+0000 7fbfb1064640 1 -- 172.21.15.71:0/3762853652 >> 172.21.15.71:0/3762853652 conn(0x7fbfac0f6c10 msgr2=0x7fbfac0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:34.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.822+0000 7fbfb1064640 1 -- 172.21.15.71:0/3762853652 shutdown_connections 2024-09-10T10:11:34.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:11:34.822+0000 7fbfb1064640 1 -- 172.21.15.71:0/3762853652 wait complete. 2024-09-10T10:11:35.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:35 smithi071 ceph-mon[90773]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:35.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:35 smithi071 ceph-mon[90773]: pgmap v191: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-10T10:11:35.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:35 smithi071 ceph-mon[90773]: reconnect by client.14502 192.168.0.1:0/1640522611 after 0 2024-09-10T10:11:35.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:35 smithi071 ceph-mon[90773]: reconnect by client.24307 192.168.0.1:0/117341327 after 0 2024-09-10T10:11:35.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:35 smithi071 ceph-mon[90773]: mds.? [v2:172.21.15.71:6828/1608732243,v1:172.21.15.71:6829/1608732243] up:boot 2024-09-10T10:11:35.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:35 smithi071 ceph-mon[90773]: mds.? [v2:172.21.15.71:6826/1701579524,v1:172.21.15.71:6827/1701579524] up:reconnect 2024-09-10T10:11:35.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:35 smithi071 ceph-mon[90773]: fsmap cephfs:1/1 {0=cephfs.smithi071.toijsg=up:reconnect} 3 up:standby 2024-09-10T10:11:35.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:35 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.omoqqq"}]: dispatch 2024-09-10T10:11:35.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:35 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/3762853652' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:11:35.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:35 smithi071 ceph-mon[90773]: mds.? [v2:172.21.15.71:6826/1701579524,v1:172.21.15.71:6827/1701579524] up:rejoin 2024-09-10T10:11:35.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:35 smithi071 ceph-mon[90773]: fsmap cephfs:1/1 {0=cephfs.smithi071.toijsg=up:rejoin} 3 up:standby 2024-09-10T10:11:35.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:35 smithi107 ceph-mon[79396]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:35.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:35 smithi107 ceph-mon[79396]: pgmap v191: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-10T10:11:35.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:35 smithi107 ceph-mon[79396]: reconnect by client.14502 192.168.0.1:0/1640522611 after 0 2024-09-10T10:11:35.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:35 smithi107 ceph-mon[79396]: reconnect by client.24307 192.168.0.1:0/117341327 after 0 2024-09-10T10:11:35.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:35 smithi107 ceph-mon[79396]: mds.? [v2:172.21.15.71:6828/1608732243,v1:172.21.15.71:6829/1608732243] up:boot 2024-09-10T10:11:35.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:35 smithi107 ceph-mon[79396]: mds.? [v2:172.21.15.71:6826/1701579524,v1:172.21.15.71:6827/1701579524] up:reconnect 2024-09-10T10:11:35.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:35 smithi107 ceph-mon[79396]: fsmap cephfs:1/1 {0=cephfs.smithi071.toijsg=up:reconnect} 3 up:standby 2024-09-10T10:11:35.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:35 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi071.omoqqq"}]: dispatch 2024-09-10T10:11:35.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:35 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/3762853652' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:11:35.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:35 smithi107 ceph-mon[79396]: mds.? [v2:172.21.15.71:6826/1701579524,v1:172.21.15.71:6827/1701579524] up:rejoin 2024-09-10T10:11:35.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:35 smithi107 ceph-mon[79396]: fsmap cephfs:1/1 {0=cephfs.smithi071.toijsg=up:rejoin} 3 up:standby 2024-09-10T10:11:36.577 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:36 smithi071 ceph-mon[90773]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:36.578 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:36 smithi071 ceph-mon[90773]: daemon mds.cephfs.smithi071.toijsg is now active in filesystem cephfs as rank 0 2024-09-10T10:11:36.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:36 smithi107 ceph-mon[79396]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:11:36.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:36 smithi107 ceph-mon[79396]: daemon mds.cephfs.smithi071.toijsg is now active in filesystem cephfs as rank 0 2024-09-10T10:11:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:37 smithi107 ceph-mon[79396]: pgmap v192: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 102 B/s wr, 4 op/s 2024-09-10T10:11:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:37 smithi107 ceph-mon[79396]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T10:11:37.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:37 smithi107 ceph-mon[79396]: Cluster is now healthy 2024-09-10T10:11:37.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:37 smithi107 ceph-mon[79396]: mds.? [v2:172.21.15.71:6826/1701579524,v1:172.21.15.71:6827/1701579524] up:active 2024-09-10T10:11:37.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:37 smithi107 ceph-mon[79396]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 3 up:standby 2024-09-10T10:11:37.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:37 smithi071 ceph-mon[90773]: pgmap v192: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 102 B/s wr, 4 op/s 2024-09-10T10:11:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:37 smithi071 ceph-mon[90773]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T10:11:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:37 smithi071 ceph-mon[90773]: Cluster is now healthy 2024-09-10T10:11:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:37 smithi071 ceph-mon[90773]: mds.? [v2:172.21.15.71:6826/1701579524,v1:172.21.15.71:6827/1701579524] up:active 2024-09-10T10:11:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:37 smithi071 ceph-mon[90773]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 3 up:standby 2024-09-10T10:11:39.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:39 smithi107 ceph-mon[79396]: pgmap v193: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 204 B/s wr, 5 op/s 2024-09-10T10:11:39.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:11:39.660 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:39 smithi071 ceph-mon[90773]: pgmap v193: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 204 B/s wr, 5 op/s 2024-09-10T10:11:39.660 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:11:41.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:41 smithi107 ceph-mon[79396]: pgmap v194: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 174 B/s wr, 5 op/s 2024-09-10T10:11:41.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:41 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:41.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:41 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:41.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:41 smithi071 ceph-mon[90773]: pgmap v194: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 174 B/s wr, 5 op/s 2024-09-10T10:11:41.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:41 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:41.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:41 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:42.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:42 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:42.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:42 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:42.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:42 smithi071 ceph-mon[90773]: pgmap v195: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-10T10:11:42.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:42 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:42.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:42 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:42.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:42 smithi107 ceph-mon[79396]: pgmap v195: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-10T10:11:45.480 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:45 smithi107 ceph-mon[79396]: pgmap v196: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-10T10:11:45.480 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:45.480 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:45.480 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:45.480 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:11:45.480 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:45.480 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:45.480 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:45.480 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:45.481 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:45.481 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:45.481 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:45 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi107.nycoxn"]}]: dispatch 2024-09-10T10:11:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:45 smithi071 ceph-mon[90773]: pgmap v196: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-10T10:11:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:11:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:45.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:45.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:11:45.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:45 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi107.nycoxn"]}]: dispatch 2024-09-10T10:11:46.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:46 smithi071 ceph-mon[90773]: Upgrade: It appears safe to stop mds.cephfs.smithi107.nycoxn 2024-09-10T10:11:46.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:46 smithi107 ceph-mon[79396]: Upgrade: It appears safe to stop mds.cephfs.smithi107.nycoxn 2024-09-10T10:11:47.623 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:47 smithi107 ceph-mon[79396]: pgmap v197: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-10T10:11:47.623 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:47 smithi107 ceph-mon[79396]: Upgrade: Updating mds.cephfs.smithi107.nycoxn 2024-09-10T10:11:47.624 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:47.624 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.nycoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:11:47.624 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:47 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:47.624 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:47 smithi107 ceph-mon[79396]: Deploying daemon mds.cephfs.smithi107.nycoxn on smithi107 2024-09-10T10:11:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:47 smithi071 ceph-mon[90773]: pgmap v197: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-10T10:11:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:47 smithi071 ceph-mon[90773]: Upgrade: Updating mds.cephfs.smithi107.nycoxn 2024-09-10T10:11:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.nycoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:11:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:47 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:47 smithi071 ceph-mon[90773]: Deploying daemon mds.cephfs.smithi107.nycoxn on smithi107 2024-09-10T10:11:49.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:49 smithi107 ceph-mon[79396]: pgmap v198: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-10T10:11:49.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:49 smithi107 ceph-mon[79396]: osdmap e82: 6 total, 6 up, 6 in 2024-09-10T10:11:49.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:49 smithi107 ceph-mon[79396]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 2 up:standby 2024-09-10T10:11:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:49 smithi071 ceph-mon[90773]: pgmap v198: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-10T10:11:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:49 smithi071 ceph-mon[90773]: osdmap e82: 6 total, 6 up, 6 in 2024-09-10T10:11:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:49 smithi071 ceph-mon[90773]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 2 up:standby 2024-09-10T10:11:51.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:51 smithi107 ceph-mon[79396]: pgmap v200: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.9 KiB/s wr, 4 op/s 2024-09-10T10:11:51.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:51 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:11:51.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:51 smithi071 ceph-mon[90773]: pgmap v200: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.9 KiB/s wr, 4 op/s 2024-09-10T10:11:51.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:51 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:11:53.495 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:53 smithi107 ceph-mon[79396]: pgmap v201: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:53.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:53 smithi071 ceph-mon[90773]: pgmap v201: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:55.020 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:55.020 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:55.020 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:55.020 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:11:55.020 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:54 smithi107 ceph-mon[79396]: pgmap v202: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:55.021 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:54 smithi107 ceph-mon[79396]: mds.? [v2:172.21.15.107:6824/1627286097,v1:172.21.15.107:6825/1627286097] up:boot 2024-09-10T10:11:55.021 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:54 smithi107 ceph-mon[79396]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 3 up:standby 2024-09-10T10:11:55.021 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:11:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:11:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:54 smithi071 ceph-mon[90773]: pgmap v202: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:54 smithi071 ceph-mon[90773]: mds.? [v2:172.21.15.107:6824/1627286097,v1:172.21.15.107:6825/1627286097] up:boot 2024-09-10T10:11:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:54 smithi071 ceph-mon[90773]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 3 up:standby 2024-09-10T10:11:55.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:11:57.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:57 smithi071 ceph-mon[90773]: pgmap v203: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:57.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:57.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:57.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:57.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:57.577 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:57 smithi107 ceph-mon[79396]: pgmap v203: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:57.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:57.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:57.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:57.578 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:11:59.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:11:58 smithi107 ceph-mon[79396]: pgmap v204: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:11:59.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:11:58 smithi071 ceph-mon[90773]: pgmap v204: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:01 smithi071 ceph-mon[90773]: pgmap v205: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:12:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:12:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:01.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:01.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:01.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:01.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:01.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi107.rvgklu"]}]: dispatch 2024-09-10T10:12:01.625 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:01 smithi107 ceph-mon[79396]: pgmap v205: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:01.625 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:01.625 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:01.625 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:12:01.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:12:01.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:01.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:01.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:01.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:01.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:01.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:01.626 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi107.rvgklu"]}]: dispatch 2024-09-10T10:12:02.535 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:02 smithi107 ceph-mon[79396]: Detected new or changed devices on smithi107 2024-09-10T10:12:02.535 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:02 smithi107 ceph-mon[79396]: Upgrade: It appears safe to stop mds.cephfs.smithi107.rvgklu 2024-09-10T10:12:02.535 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:02.535 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.rvgklu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:12:02.535 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:02 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:12:02.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:02 smithi071 ceph-mon[90773]: Detected new or changed devices on smithi107 2024-09-10T10:12:02.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:02 smithi071 ceph-mon[90773]: Upgrade: It appears safe to stop mds.cephfs.smithi107.rvgklu 2024-09-10T10:12:02.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:02.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi107.rvgklu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:12:02.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:02 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:12:03.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:03 smithi071 ceph-mon[90773]: Upgrade: Updating mds.cephfs.smithi107.rvgklu 2024-09-10T10:12:03.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:03 smithi071 ceph-mon[90773]: Deploying daemon mds.cephfs.smithi107.rvgklu on smithi107 2024-09-10T10:12:03.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:03 smithi071 ceph-mon[90773]: pgmap v206: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:03.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:03 smithi107 ceph-mon[79396]: Upgrade: Updating mds.cephfs.smithi107.rvgklu 2024-09-10T10:12:03.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:03 smithi107 ceph-mon[79396]: Deploying daemon mds.cephfs.smithi107.rvgklu on smithi107 2024-09-10T10:12:03.564 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:03 smithi107 ceph-mon[79396]: pgmap v206: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:04.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.915+0000 7fac11d4e640 1 -- 172.21.15.71:0/1184421323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac0c0fc550 msgr2=0x7fac0c0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:04.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.915+0000 7fac11d4e640 1 --2- 172.21.15.71:0/1184421323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac0c0fc550 0x7fac0c0fc960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0048d0 tx=0x7fabfc009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:04.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.915+0000 7fac11d4e640 1 -- 172.21.15.71:0/1184421323 shutdown_connections 2024-09-10T10:12:04.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.915+0000 7fac11d4e640 1 --2- 172.21.15.71:0/1184421323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac0c0fd820 0x7fac0c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:04.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.915+0000 7fac11d4e640 1 --2- 172.21.15.71:0/1184421323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac0c0fc550 0x7fac0c0fc960 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:04.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.915+0000 7fac11d4e640 1 -- 172.21.15.71:0/1184421323 >> 172.21.15.71:0/1184421323 conn(0x7fac0c0f7d30 msgr2=0x7fac0c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:04.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.915+0000 7fac11d4e640 1 -- 172.21.15.71:0/1184421323 shutdown_connections 2024-09-10T10:12:04.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.915+0000 7fac11d4e640 1 -- 172.21.15.71:0/1184421323 wait complete. 2024-09-10T10:12:04.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.916+0000 7fac11d4e640 1 Processor -- start 2024-09-10T10:12:04.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.916+0000 7fac11d4e640 1 -- start start 2024-09-10T10:12:04.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.916+0000 7fac11d4e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac0c0fc550 0x7fac0c10f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:04.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.916+0000 7fac11d4e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac0c0fd820 0x7fac0c10f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:04.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.916+0000 7fac11d4e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c10fe40 con 0x7fac0c0fc550 2024-09-10T10:12:04.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.916+0000 7fac11d4e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c110660 con 0x7fac0c0fd820 2024-09-10T10:12:04.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.916+0000 7fac0b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac0c0fc550 0x7fac0c10f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:04.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.917+0000 7fac0b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac0c0fc550 0x7fac0c10f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38544/0 (socket says 172.21.15.71:38544) 2024-09-10T10:12:04.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.917+0000 7fac0b7fe640 1 -- 172.21.15.71:0/2390721727 learned_addr learned my addr 172.21.15.71:0/2390721727 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:04.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.917+0000 7fac0affd640 1 --2- 172.21.15.71:0/2390721727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac0c0fd820 0x7fac0c10f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:04.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.917+0000 7fac0b7fe640 1 -- 172.21.15.71:0/2390721727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac0c0fd820 msgr2=0x7fac0c10f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:04.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.917+0000 7fac0b7fe640 1 --2- 172.21.15.71:0/2390721727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac0c0fd820 0x7fac0c10f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:04.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.917+0000 7fac0b7fe640 1 -- 172.21.15.71:0/2390721727 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc005040 con 0x7fac0c0fc550 2024-09-10T10:12:04.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.917+0000 7fac0b7fe640 1 --2- 172.21.15.71:0/2390721727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac0c0fc550 0x7fac0c10f2b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0043d0 tx=0x7fabfc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:04.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.917+0000 7fabf3fff640 1 -- 172.21.15.71:0/2390721727 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabfc038070 con 0x7fac0c0fc550 2024-09-10T10:12:04.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.917+0000 7fabf3fff640 1 -- 172.21.15.71:0/2390721727 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fabfc02ae90 con 0x7fac0c0fc550 2024-09-10T10:12:04.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.917+0000 7fac11d4e640 1 -- 172.21.15.71:0/2390721727 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c110890 con 0x7fac0c0fc550 2024-09-10T10:12:04.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.917+0000 7fabf3fff640 1 -- 172.21.15.71:0/2390721727 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabfc03e670 con 0x7fac0c0fc550 2024-09-10T10:12:04.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.917+0000 7fac11d4e640 1 -- 172.21.15.71:0/2390721727 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c110e30 con 0x7fac0c0fc550 2024-09-10T10:12:04.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.918+0000 7fac11d4e640 1 -- 172.21.15.71:0/2390721727 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c0fb9b0 con 0x7fac0c0fc550 2024-09-10T10:12:04.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.919+0000 7fabf3fff640 1 -- 172.21.15.71:0/2390721727 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fabfc030020 con 0x7fac0c0fc550 2024-09-10T10:12:04.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.919+0000 7fabf3fff640 1 --2- 172.21.15.71:0/2390721727 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fabf406e0b0 0x7fabf4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:04.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.920+0000 7fabf3fff640 1 -- 172.21.15.71:0/2390721727 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fabfc0addb0 con 0x7fac0c0fc550 2024-09-10T10:12:04.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.920+0000 7fac0affd640 1 --2- 172.21.15.71:0/2390721727 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fabf406e0b0 0x7fabf4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:04.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.920+0000 7fac0affd640 1 --2- 172.21.15.71:0/2390721727 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fabf406e0b0 0x7fabf4070560 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fac0c10f060 tx=0x7fac0000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:04.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:04.924+0000 7fabf3fff640 1 -- 172.21.15.71:0/2390721727 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fabfc077130 con 0x7fac0c0fc550 2024-09-10T10:12:05.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.106+0000 7fac11d4e640 1 -- 172.21.15.71:0/2390721727 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac0c111110 con 0x7fabf406e0b0 2024-09-10T10:12:05.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.107+0000 7fabf3fff640 1 -- 172.21.15.71:0/2390721727 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fac0c111110 con 0x7fabf406e0b0 2024-09-10T10:12:05.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.109+0000 7fac11d4e640 1 -- 172.21.15.71:0/2390721727 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fabf406e0b0 msgr2=0x7fabf4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.109+0000 7fac11d4e640 1 --2- 172.21.15.71:0/2390721727 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fabf406e0b0 0x7fabf4070560 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fac0c10f060 tx=0x7fac0000b040 comp rx=0 tx=0).stop 2024-09-10T10:12:05.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.109+0000 7fac11d4e640 1 -- 172.21.15.71:0/2390721727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac0c0fc550 msgr2=0x7fac0c10f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.109+0000 7fac11d4e640 1 --2- 172.21.15.71:0/2390721727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac0c0fc550 0x7fac0c10f2b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0043d0 tx=0x7fabfc009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.109+0000 7fac11d4e640 1 -- 172.21.15.71:0/2390721727 shutdown_connections 2024-09-10T10:12:05.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.109+0000 7fac11d4e640 1 --2- 172.21.15.71:0/2390721727 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fabf406e0b0 0x7fabf4070560 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.109+0000 7fac11d4e640 1 --2- 172.21.15.71:0/2390721727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac0c0fd820 0x7fac0c10f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.109+0000 7fac11d4e640 1 --2- 172.21.15.71:0/2390721727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac0c0fc550 0x7fac0c10f2b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.109+0000 7fac11d4e640 1 -- 172.21.15.71:0/2390721727 >> 172.21.15.71:0/2390721727 conn(0x7fac0c0f7d30 msgr2=0x7fac0c0f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:05.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.110+0000 7fac11d4e640 1 -- 172.21.15.71:0/2390721727 shutdown_connections 2024-09-10T10:12:05.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.110+0000 7fac11d4e640 1 -- 172.21.15.71:0/2390721727 wait complete. 2024-09-10T10:12:05.119 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:12:05.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.188+0000 7f3987ba2640 1 -- 172.21.15.71:0/2260782012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3980066710 msgr2=0x7f39800ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.188+0000 7f3987ba2640 1 --2- 172.21.15.71:0/2260782012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3980066710 0x7f39800ff160 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f39700048d0 tx=0x7f3970009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.188+0000 7f3987ba2640 1 -- 172.21.15.71:0/2260782012 shutdown_connections 2024-09-10T10:12:05.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.188+0000 7f3987ba2640 1 --2- 172.21.15.71:0/2260782012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39800ff6a0 0x7f3980101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.188+0000 7f3987ba2640 1 --2- 172.21.15.71:0/2260782012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3980066710 0x7f39800ff160 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.188+0000 7f3987ba2640 1 -- 172.21.15.71:0/2260782012 >> 172.21.15.71:0/2260782012 conn(0x7f39800f6c10 msgr2=0x7f39800f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:05.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.188+0000 7f3987ba2640 1 -- 172.21.15.71:0/2260782012 shutdown_connections 2024-09-10T10:12:05.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.188+0000 7f3987ba2640 1 -- 172.21.15.71:0/2260782012 wait complete. 2024-09-10T10:12:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.189+0000 7f3987ba2640 1 Processor -- start 2024-09-10T10:12:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.189+0000 7f3987ba2640 1 -- start start 2024-09-10T10:12:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.189+0000 7f3987ba2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3980066710 0x7f39800fcb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.189+0000 7f3987ba2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800ff6a0 0x7f39800fb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.189+0000 7f3987ba2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39800fb5a0 con 0x7f39800ff6a0 2024-09-10T10:12:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.189+0000 7f3987ba2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39800fb6e0 con 0x7f3980066710 2024-09-10T10:12:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.189+0000 7f398513d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800ff6a0 0x7f39800fb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:05.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.189+0000 7f398513d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800ff6a0 0x7f39800fb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38566/0 (socket says 172.21.15.71:38566) 2024-09-10T10:12:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.189+0000 7f398513d640 1 -- 172.21.15.71:0/3093512776 learned_addr learned my addr 172.21.15.71:0/3093512776 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.190+0000 7f398593e640 1 --2- 172.21.15.71:0/3093512776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3980066710 0x7f39800fcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.190+0000 7f398513d640 1 -- 172.21.15.71:0/3093512776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3980066710 msgr2=0x7f39800fcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.190+0000 7f398513d640 1 --2- 172.21.15.71:0/3093512776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3980066710 0x7f39800fcb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.190+0000 7f398513d640 1 -- 172.21.15.71:0/3093512776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3970005040 con 0x7f39800ff6a0 2024-09-10T10:12:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.190+0000 7f398513d640 1 --2- 172.21.15.71:0/3093512776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800ff6a0 0x7f39800fb060 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f397c002a50 tx=0x7f397c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.190+0000 7f39767fc640 1 -- 172.21.15.71:0/3093512776 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f397c007c30 con 0x7f39800ff6a0 2024-09-10T10:12:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.190+0000 7f3987ba2640 1 -- 172.21.15.71:0/3093512776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39800fb9c0 con 0x7f39800ff6a0 2024-09-10T10:12:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.190+0000 7f39767fc640 1 -- 172.21.15.71:0/3093512776 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f397c00f040 con 0x7f39800ff6a0 2024-09-10T10:12:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.190+0000 7f39767fc640 1 -- 172.21.15.71:0/3093512776 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f397c00da90 con 0x7f39800ff6a0 2024-09-10T10:12:05.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.190+0000 7f3987ba2640 1 -- 172.21.15.71:0/3093512776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39801151e0 con 0x7f39800ff6a0 2024-09-10T10:12:05.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.191+0000 7f3987ba2640 1 -- 172.21.15.71:0/3093512776 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39800fa8b0 con 0x7f39800ff6a0 2024-09-10T10:12:05.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.192+0000 7f39767fc640 1 -- 172.21.15.71:0/3093512776 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f397c00dd00 con 0x7f39800ff6a0 2024-09-10T10:12:05.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.192+0000 7f39767fc640 1 --2- 172.21.15.71:0/3093512776 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f396c06e0b0 0x7f396c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:05.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.192+0000 7f39767fc640 1 -- 172.21.15.71:0/3093512776 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f397c08d4f0 con 0x7f39800ff6a0 2024-09-10T10:12:05.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.192+0000 7f398593e640 1 --2- 172.21.15.71:0/3093512776 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f396c06e0b0 0x7f396c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:05.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.193+0000 7f398593e640 1 --2- 172.21.15.71:0/3093512776 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f396c06e0b0 0x7f396c070560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3970000c00 tx=0x7f3970035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:05.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.197+0000 7f39767fc640 1 -- 172.21.15.71:0/3093512776 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f397c0567c0 con 0x7f39800ff6a0 2024-09-10T10:12:05.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.381+0000 7f3987ba2640 1 -- 172.21.15.71:0/3093512776 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39800f8750 con 0x7f396c06e0b0 2024-09-10T10:12:05.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.382+0000 7f39767fc640 1 -- 172.21.15.71:0/3093512776 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f39800f8750 con 0x7f396c06e0b0 2024-09-10T10:12:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.384+0000 7f3987ba2640 1 -- 172.21.15.71:0/3093512776 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f396c06e0b0 msgr2=0x7f396c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.384+0000 7f3987ba2640 1 --2- 172.21.15.71:0/3093512776 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f396c06e0b0 0x7f396c070560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3970000c00 tx=0x7f3970035040 comp rx=0 tx=0).stop 2024-09-10T10:12:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.384+0000 7f3987ba2640 1 -- 172.21.15.71:0/3093512776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800ff6a0 msgr2=0x7f39800fb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.384+0000 7f3987ba2640 1 --2- 172.21.15.71:0/3093512776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800ff6a0 0x7f39800fb060 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f397c002a50 tx=0x7f397c004600 comp rx=0 tx=0).stop 2024-09-10T10:12:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.384+0000 7f3987ba2640 1 -- 172.21.15.71:0/3093512776 shutdown_connections 2024-09-10T10:12:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.384+0000 7f3987ba2640 1 --2- 172.21.15.71:0/3093512776 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f396c06e0b0 0x7f396c070560 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.384+0000 7f3987ba2640 1 --2- 172.21.15.71:0/3093512776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800ff6a0 0x7f39800fb060 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.384+0000 7f3987ba2640 1 --2- 172.21.15.71:0/3093512776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3980066710 0x7f39800fcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.384+0000 7f3987ba2640 1 -- 172.21.15.71:0/3093512776 >> 172.21.15.71:0/3093512776 conn(0x7f39800f6c10 msgr2=0x7f39800f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.384+0000 7f3987ba2640 1 -- 172.21.15.71:0/3093512776 shutdown_connections 2024-09-10T10:12:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.384+0000 7f3987ba2640 1 -- 172.21.15.71:0/3093512776 wait complete. 2024-09-10T10:12:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.464+0000 7fc28384b640 1 -- 172.21.15.71:0/1733742717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0fc550 msgr2=0x7fc27c0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.464+0000 7fc28384b640 1 --2- 172.21.15.71:0/1733742717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0fc550 0x7fc27c0fc960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc2780048d0 tx=0x7fc278009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.464+0000 7fc28384b640 1 -- 172.21.15.71:0/1733742717 shutdown_connections 2024-09-10T10:12:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.464+0000 7fc28384b640 1 --2- 172.21.15.71:0/1733742717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0fd820 0x7fc27c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.464+0000 7fc28384b640 1 --2- 172.21.15.71:0/1733742717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0fc550 0x7fc27c0fc960 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.464+0000 7fc28384b640 1 -- 172.21.15.71:0/1733742717 >> 172.21.15.71:0/1733742717 conn(0x7fc27c0f7d30 msgr2=0x7fc27c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:05.467 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:05 smithi071 ceph-mon[90773]: pgmap v207: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:05.467 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:05 smithi071 ceph-mon[90773]: osdmap e83: 6 total, 6 up, 6 in 2024-09-10T10:12:05.467 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:05 smithi071 ceph-mon[90773]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 2 up:standby 2024-09-10T10:12:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.464+0000 7fc28384b640 1 -- 172.21.15.71:0/1733742717 shutdown_connections 2024-09-10T10:12:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.464+0000 7fc28384b640 1 -- 172.21.15.71:0/1733742717 wait complete. 2024-09-10T10:12:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.465+0000 7fc28384b640 1 Processor -- start 2024-09-10T10:12:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.465+0000 7fc28384b640 1 -- start start 2024-09-10T10:12:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.465+0000 7fc28384b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0fc550 0x7fc27c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.465+0000 7fc28384b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0fd820 0x7fc27c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.465+0000 7fc28384b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c06fff0 con 0x7fc27c0fc550 2024-09-10T10:12:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.465+0000 7fc28384b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c070130 con 0x7fc27c0fd820 2024-09-10T10:12:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.465+0000 7fc2815e7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0fc550 0x7fc27c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.465+0000 7fc2815e7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0fc550 0x7fc27c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38582/0 (socket says 172.21.15.71:38582) 2024-09-10T10:12:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.465+0000 7fc2815e7640 1 -- 172.21.15.71:0/1655423575 learned_addr learned my addr 172.21.15.71:0/1655423575 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.465+0000 7fc280de6640 1 --2- 172.21.15.71:0/1655423575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0fd820 0x7fc27c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.466+0000 7fc2815e7640 1 -- 172.21.15.71:0/1655423575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0fd820 msgr2=0x7fc27c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.466+0000 7fc2815e7640 1 --2- 172.21.15.71:0/1655423575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0fd820 0x7fc27c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.466+0000 7fc2815e7640 1 -- 172.21.15.71:0/1655423575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc278005040 con 0x7fc27c0fc550 2024-09-10T10:12:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.466+0000 7fc2815e7640 1 --2- 172.21.15.71:0/1655423575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0fc550 0x7fc27c071570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc278003080 tx=0x7fc278009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.466+0000 7fc271ffb640 1 -- 172.21.15.71:0/1655423575 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc278038070 con 0x7fc27c0fc550 2024-09-10T10:12:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.466+0000 7fc271ffb640 1 -- 172.21.15.71:0/1655423575 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc278009800 con 0x7fc27c0fc550 2024-09-10T10:12:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.466+0000 7fc28384b640 1 -- 172.21.15.71:0/1655423575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c0703b0 con 0x7fc27c0fc550 2024-09-10T10:12:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.466+0000 7fc271ffb640 1 -- 172.21.15.71:0/1655423575 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc278033660 con 0x7fc27c0fc550 2024-09-10T10:12:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.466+0000 7fc28384b640 1 -- 172.21.15.71:0/1655423575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c1150d0 con 0x7fc27c0fc550 2024-09-10T10:12:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.467+0000 7fc28384b640 1 -- 172.21.15.71:0/1655423575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27c0fb9b0 con 0x7fc27c0fc550 2024-09-10T10:12:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.468+0000 7fc271ffb640 1 -- 172.21.15.71:0/1655423575 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc278030020 con 0x7fc27c0fc550 2024-09-10T10:12:05.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.468+0000 7fc271ffb640 1 --2- 172.21.15.71:0/1655423575 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc26806e0b0 0x7fc268070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:05.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.468+0000 7fc271ffb640 1 -- 172.21.15.71:0/1655423575 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc2780adc10 con 0x7fc27c0fc550 2024-09-10T10:12:05.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.468+0000 7fc280de6640 1 --2- 172.21.15.71:0/1655423575 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc26806e0b0 0x7fc268070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:05.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.469+0000 7fc280de6640 1 --2- 172.21.15.71:0/1655423575 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc26806e0b0 0x7fc268070560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc26c007fd0 tx=0x7fc26c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:05.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.472+0000 7fc271ffb640 1 -- 172.21.15.71:0/1655423575 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc278077010 con 0x7fc27c0fc550 2024-09-10T10:12:05.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:05 smithi107 ceph-mon[79396]: pgmap v207: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:05.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:05 smithi107 ceph-mon[79396]: osdmap e83: 6 total, 6 up, 6 in 2024-09-10T10:12:05.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:05 smithi107 ceph-mon[79396]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 2 up:standby 2024-09-10T10:12:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.649+0000 7fc28384b640 1 -- 172.21.15.71:0/1655423575 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc27c101c80 con 0x7fc26806e0b0 2024-09-10T10:12:05.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.658+0000 7fc271ffb640 1 -- 172.21.15.71:0/1655423575 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc27c101c80 con 0x7fc26806e0b0 2024-09-10T10:12:05.659 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:12:05.659 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (7m) 24s ago 15m 25.5M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:12:05.659 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (4m) 24s ago 16m 6903k - 19.1.1-305-g1cf819b7 41d671128357 5dc74ad01560 2024-09-10T10:12:05.659 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (4m) 9s ago 15m 6891k - 19.1.1-305-g1cf819b7 41d671128357 6f4355e875db 2024-09-10T10:12:05.659 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (7m) 24s ago 15m 85.9M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:12:05.659 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (32s) 24s ago 10m 11.8M - 19.1.1-305-g1cf819b7 41d671128357 6ec036debe92 2024-09-10T10:12:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (49s) 24s ago 10m 138M - 19.1.1-305-g1cf819b7 41d671128357 58af9b545bf4 2024-09-10T10:12:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (12s) 9s ago 10m 11.0M - 19.1.1-305-g1cf819b7 41d671128357 b3a09b16124b 2024-09-10T10:12:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (10m) 9s ago 10m 11.2M - 17.2.7-1597-g96d63e75 f3fc7d52e233 e66269c4e43c 2024-09-10T10:12:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (6m) 24s ago 17m 504M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:12:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (6m) 9s ago 15m 442M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:12:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (5m) 24s ago 17m 51.6M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:12:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (5m) 9s ago 14m 38.7M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:12:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (7m) 24s ago 16m 16.1M - 1.5.0 0da6a335fe13 c3d47d79cd22 2024-09-10T10:12:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (6m) 9s ago 15m 17.0M - 1.5.0 0da6a335fe13 9a25165a0fd1 2024-09-10T10:12:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (4m) 24s ago 14m 104M 1557M 19.1.1-305-g1cf819b7 41d671128357 f1e9da1144c1 2024-09-10T10:12:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (3m) 24s ago 13m 109M 1557M 19.1.1-305-g1cf819b7 41d671128357 5afc8bef5343 2024-09-10T10:12:05.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (3m) 24s ago 13m 95.6M 1557M 19.1.1-305-g1cf819b7 41d671128357 5e5976fcfaa8 2024-09-10T10:12:05.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (2m) 9s ago 12m 114M 2581M 19.1.1-305-g1cf819b7 41d671128357 e22ee626ccd0 2024-09-10T10:12:05.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (2m) 9s ago 12m 98.3M 2581M 19.1.1-305-g1cf819b7 41d671128357 e92f23ad2c77 2024-09-10T10:12:05.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (99s) 9s ago 12m 93.7M 2581M 19.1.1-305-g1cf819b7 41d671128357 3440ee1c721e 2024-09-10T10:12:05.661 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (6m) 24s ago 15m 65.3M - 2.43.0 a07b618ecd1d 47d3ae62ce5e 2024-09-10T10:12:05.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.660+0000 7fc28384b640 1 -- 172.21.15.71:0/1655423575 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc26806e0b0 msgr2=0x7fc268070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.660+0000 7fc28384b640 1 --2- 172.21.15.71:0/1655423575 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc26806e0b0 0x7fc268070560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc26c007fd0 tx=0x7fc26c009040 comp rx=0 tx=0).stop 2024-09-10T10:12:05.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.660+0000 7fc28384b640 1 -- 172.21.15.71:0/1655423575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0fc550 msgr2=0x7fc27c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.660+0000 7fc28384b640 1 --2- 172.21.15.71:0/1655423575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0fc550 0x7fc27c071570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc278003080 tx=0x7fc278009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.660+0000 7fc28384b640 1 -- 172.21.15.71:0/1655423575 shutdown_connections 2024-09-10T10:12:05.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.660+0000 7fc28384b640 1 --2- 172.21.15.71:0/1655423575 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc26806e0b0 0x7fc268070560 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.660+0000 7fc28384b640 1 --2- 172.21.15.71:0/1655423575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc27c0fd820 0x7fc27c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.660+0000 7fc28384b640 1 --2- 172.21.15.71:0/1655423575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0fc550 0x7fc27c071570 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.660+0000 7fc28384b640 1 -- 172.21.15.71:0/1655423575 >> 172.21.15.71:0/1655423575 conn(0x7fc27c0f7d30 msgr2=0x7fc27c0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:05.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.660+0000 7fc28384b640 1 -- 172.21.15.71:0/1655423575 shutdown_connections 2024-09-10T10:12:05.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.660+0000 7fc28384b640 1 -- 172.21.15.71:0/1655423575 wait complete. 2024-09-10T10:12:05.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.736+0000 7f7b54c13640 1 -- 172.21.15.71:0/2480422988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b500fb2d0 msgr2=0x7f7b500fdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.736+0000 7f7b54c13640 1 --2- 172.21.15.71:0/2480422988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b500fb2d0 0x7f7b500fdb50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7b380048d0 tx=0x7f7b38009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.737+0000 7f7b54c13640 1 -- 172.21.15.71:0/2480422988 shutdown_connections 2024-09-10T10:12:05.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.737+0000 7f7b54c13640 1 --2- 172.21.15.71:0/2480422988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b500fb2d0 0x7f7b500fdb50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.737+0000 7f7b54c13640 1 --2- 172.21.15.71:0/2480422988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b500fa980 0x7f7b500fad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.737+0000 7f7b54c13640 1 -- 172.21.15.71:0/2480422988 >> 172.21.15.71:0/2480422988 conn(0x7f7b500f63c0 msgr2=0x7f7b500f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:05.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.737+0000 7f7b54c13640 1 -- 172.21.15.71:0/2480422988 shutdown_connections 2024-09-10T10:12:05.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.737+0000 7f7b54c13640 1 -- 172.21.15.71:0/2480422988 wait complete. 2024-09-10T10:12:05.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.737+0000 7f7b54c13640 1 Processor -- start 2024-09-10T10:12:05.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.737+0000 7f7b54c13640 1 -- start start 2024-09-10T10:12:05.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.737+0000 7f7b54c13640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b500fa980 0x7f7b500fd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:05.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.737+0000 7f7b54c13640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b500fb2d0 0x7f7b500fb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:05.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.737+0000 7f7b54c13640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500fbf10 con 0x7f7b500fa980 2024-09-10T10:12:05.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.737+0000 7f7b54c13640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500fc050 con 0x7f7b500fb2d0 2024-09-10T10:12:05.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.738+0000 7f7b4e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b500fa980 0x7f7b500fd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:05.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.738+0000 7f7b4e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b500fa980 0x7f7b500fd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38604/0 (socket says 172.21.15.71:38604) 2024-09-10T10:12:05.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.738+0000 7f7b4e59c640 1 -- 172.21.15.71:0/3160359013 learned_addr learned my addr 172.21.15.71:0/3160359013 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:05.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.738+0000 7f7b4dd9b640 1 --2- 172.21.15.71:0/3160359013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b500fb2d0 0x7f7b500fb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:05.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.738+0000 7f7b4e59c640 1 -- 172.21.15.71:0/3160359013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b500fb2d0 msgr2=0x7f7b500fb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.738+0000 7f7b4e59c640 1 --2- 172.21.15.71:0/3160359013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b500fb2d0 0x7f7b500fb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.738+0000 7f7b4e59c640 1 -- 172.21.15.71:0/3160359013 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38005040 con 0x7f7b500fa980 2024-09-10T10:12:05.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.738+0000 7f7b4dd9b640 1 --2- 172.21.15.71:0/3160359013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b500fb2d0 0x7f7b500fb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:12:05.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.738+0000 7f7b4e59c640 1 --2- 172.21.15.71:0/3160359013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b500fa980 0x7f7b500fd490 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800c830 tx=0x7f7b48004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:05.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.738+0000 7f7b46ffd640 1 -- 172.21.15.71:0/3160359013 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b4800a850 con 0x7f7b500fa980 2024-09-10T10:12:05.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.738+0000 7f7b54c13640 1 -- 172.21.15.71:0/3160359013 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b500fc330 con 0x7f7b500fa980 2024-09-10T10:12:05.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.738+0000 7f7b46ffd640 1 -- 172.21.15.71:0/3160359013 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7b4800ae50 con 0x7f7b500fa980 2024-09-10T10:12:05.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.739+0000 7f7b46ffd640 1 -- 172.21.15.71:0/3160359013 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b480113a0 con 0x7f7b500fa980 2024-09-10T10:12:05.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.739+0000 7f7b54c13640 1 -- 172.21.15.71:0/3160359013 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b501153a0 con 0x7f7b500fa980 2024-09-10T10:12:05.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.739+0000 7f7b54c13640 1 -- 172.21.15.71:0/3160359013 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b500fa060 con 0x7f7b500fa980 2024-09-10T10:12:05.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.740+0000 7f7b46ffd640 1 -- 172.21.15.71:0/3160359013 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7b48012400 con 0x7f7b500fa980 2024-09-10T10:12:05.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.741+0000 7f7b46ffd640 1 --2- 172.21.15.71:0/3160359013 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7b3c06e0b0 0x7f7b3c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:05.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.741+0000 7f7b46ffd640 1 -- 172.21.15.71:0/3160359013 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f7b4808de40 con 0x7f7b500fa980 2024-09-10T10:12:05.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.741+0000 7f7b4dd9b640 1 --2- 172.21.15.71:0/3160359013 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7b3c06e0b0 0x7f7b3c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:05.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.741+0000 7f7b4dd9b640 1 --2- 172.21.15.71:0/3160359013 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7b3c06e0b0 0x7f7b3c070560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7b38007ac0 tx=0x7f7b38035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:05.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.745+0000 7f7b46ffd640 1 -- 172.21.15.71:0/3160359013 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7b48057190 con 0x7f7b500fa980 2024-09-10T10:12:05.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.977+0000 7f7b54c13640 1 -- 172.21.15.71:0/3160359013 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7b5004b720 con 0x7f7b500fa980 2024-09-10T10:12:05.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.977+0000 7f7b46ffd640 1 -- 172.21.15.71:0/3160359013 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f7b4805a850 con 0x7f7b500fa980 2024-09-10T10:12:05.979 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:12:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:12:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:12:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:12:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:12:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:12:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:12:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:12:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T10:12:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:12:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:12:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 3 2024-09-10T10:12:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:12:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:12:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 13 2024-09-10T10:12:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:12:05.980 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:12:05.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.979+0000 7f7b54c13640 1 -- 172.21.15.71:0/3160359013 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7b3c06e0b0 msgr2=0x7f7b3c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.979+0000 7f7b54c13640 1 --2- 172.21.15.71:0/3160359013 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7b3c06e0b0 0x7f7b3c070560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7b38007ac0 tx=0x7f7b38035040 comp rx=0 tx=0).stop 2024-09-10T10:12:05.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.979+0000 7f7b54c13640 1 -- 172.21.15.71:0/3160359013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b500fa980 msgr2=0x7f7b500fd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.979+0000 7f7b54c13640 1 --2- 172.21.15.71:0/3160359013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b500fa980 0x7f7b500fd490 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800c830 tx=0x7f7b48004430 comp rx=0 tx=0).stop 2024-09-10T10:12:05.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.980+0000 7f7b54c13640 1 -- 172.21.15.71:0/3160359013 shutdown_connections 2024-09-10T10:12:05.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.980+0000 7f7b54c13640 1 --2- 172.21.15.71:0/3160359013 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7b3c06e0b0 0x7f7b3c070560 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.980+0000 7f7b54c13640 1 --2- 172.21.15.71:0/3160359013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b500fb2d0 0x7f7b500fb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.980+0000 7f7b54c13640 1 --2- 172.21.15.71:0/3160359013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b500fa980 0x7f7b500fd490 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.980+0000 7f7b54c13640 1 -- 172.21.15.71:0/3160359013 >> 172.21.15.71:0/3160359013 conn(0x7f7b500f63c0 msgr2=0x7f7b500f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:05.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.980+0000 7f7b54c13640 1 -- 172.21.15.71:0/3160359013 shutdown_connections 2024-09-10T10:12:05.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:05.980+0000 7f7b54c13640 1 -- 172.21.15.71:0/3160359013 wait complete. 2024-09-10T10:12:06.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.059+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/912366554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f680666b0 msgr2=0x7f8f680ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.059+0000 7f8f6e3d3640 1 --2- 172.21.15.71:0/912366554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f680666b0 0x7f8f680ff1c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8f580048d0 tx=0x7f8f58009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.059+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/912366554 shutdown_connections 2024-09-10T10:12:06.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.059+0000 7f8f6e3d3640 1 --2- 172.21.15.71:0/912366554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f680ff700 0x7f8f68101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.059+0000 7f8f6e3d3640 1 --2- 172.21.15.71:0/912366554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f680666b0 0x7f8f680ff1c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.059+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/912366554 >> 172.21.15.71:0/912366554 conn(0x7f8f680f6c10 msgr2=0x7f8f680f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:06.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.059+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/912366554 shutdown_connections 2024-09-10T10:12:06.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.059+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/912366554 wait complete. 2024-09-10T10:12:06.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.060+0000 7f8f6e3d3640 1 Processor -- start 2024-09-10T10:12:06.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.060+0000 7f8f6e3d3640 1 -- start start 2024-09-10T10:12:06.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.060+0000 7f8f6e3d3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f680666b0 0x7f8f6810d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.060+0000 7f8f6e3d3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f680ff700 0x7f8f6810d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.060+0000 7f8f6e3d3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6810dd10 con 0x7f8f680666b0 2024-09-10T10:12:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.060+0000 7f8f6e3d3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6810e4e0 con 0x7f8f680ff700 2024-09-10T10:12:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.060+0000 7f8f67fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f680666b0 0x7f8f6810d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.060+0000 7f8f67fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f680666b0 0x7f8f6810d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38614/0 (socket says 172.21.15.71:38614) 2024-09-10T10:12:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.060+0000 7f8f67fff640 1 -- 172.21.15.71:0/894787011 learned_addr learned my addr 172.21.15.71:0/894787011 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.061+0000 7f8f677fe640 1 --2- 172.21.15.71:0/894787011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f680ff700 0x7f8f6810d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.061+0000 7f8f67fff640 1 -- 172.21.15.71:0/894787011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f680ff700 msgr2=0x7f8f6810d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.061+0000 7f8f67fff640 1 --2- 172.21.15.71:0/894787011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f680ff700 0x7f8f6810d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.061+0000 7f8f67fff640 1 -- 172.21.15.71:0/894787011 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f58005040 con 0x7f8f680666b0 2024-09-10T10:12:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.061+0000 7f8f677fe640 1 --2- 172.21.15.71:0/894787011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f680ff700 0x7f8f6810d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:12:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.061+0000 7f8f67fff640 1 --2- 172.21.15.71:0/894787011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f680666b0 0x7f8f6810d180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8f58000c00 tx=0x7f8f58009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.061+0000 7f8f64ff9640 1 -- 172.21.15.71:0/894787011 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f58038070 con 0x7f8f680666b0 2024-09-10T10:12:06.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.061+0000 7f8f64ff9640 1 -- 172.21.15.71:0/894787011 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8f58009760 con 0x7f8f680666b0 2024-09-10T10:12:06.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.061+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/894787011 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6810e710 con 0x7f8f680666b0 2024-09-10T10:12:06.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.061+0000 7f8f64ff9640 1 -- 172.21.15.71:0/894787011 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f5803db90 con 0x7f8f680666b0 2024-09-10T10:12:06.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.061+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/894787011 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6810ec50 con 0x7f8f680666b0 2024-09-10T10:12:06.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.062+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/894787011 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f680fa8b0 con 0x7f8f680666b0 2024-09-10T10:12:06.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.063+0000 7f8f64ff9640 1 -- 172.21.15.71:0/894787011 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8f58030020 con 0x7f8f680666b0 2024-09-10T10:12:06.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.063+0000 7f8f64ff9640 1 --2- 172.21.15.71:0/894787011 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8f5006e0b0 0x7f8f50070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.063+0000 7f8f64ff9640 1 -- 172.21.15.71:0/894787011 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8f580ae670 con 0x7f8f680666b0 2024-09-10T10:12:06.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.063+0000 7f8f677fe640 1 --2- 172.21.15.71:0/894787011 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8f5006e0b0 0x7f8f50070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.064+0000 7f8f677fe640 1 --2- 172.21.15.71:0/894787011 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8f5006e0b0 0x7f8f50070560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f6810cf30 tx=0x7f8f5c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:06.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.068+0000 7f8f64ff9640 1 -- 172.21.15.71:0/894787011 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8f580779c0 con 0x7f8f680666b0 2024-09-10T10:12:06.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.273+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/894787011 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8f6804b720 con 0x7f8f680666b0 2024-09-10T10:12:06.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.273+0000 7f8f64ff9640 1 -- 172.21.15.71:0/894787011 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+1799 (secure 0 0 0) 0x7f8f5807b080 con 0x7f8f680666b0 2024-09-10T10:12:06.275 INFO:teuthology.orchestra.run.smithi071.stdout:e39 2024-09-10T10:12:06.275 INFO:teuthology.orchestra.run.smithi071.stdout:btime 2024-09-10T10:12:04:256740+0000 2024-09-10T10:12:06.275 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:12:06.275 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:12:06.275 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:12:06.275 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:12:06.275 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:12:06.275 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:12:06.275 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 36 2024-09-10T10:12:06.275 INFO:teuthology.orchestra.run.smithi071.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-10T10:12:06.275 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:12:06.275 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:11:36.282149+0000 2024-09-10T10:12:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:12:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:12:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:12:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:12:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:12:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:12:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:12:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:12:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 81 2024-09-10T10:12:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T10:12:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 1 2024-09-10T10:12:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:in 0 2024-09-10T10:12:06.276 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=34416} 2024-09-10T10:12:06.277 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:12:06.277 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:12:06.277 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 1 2024-09-10T10:12:06.277 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:12:06.277 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:12:06.277 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:12:06.277 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:12:06.277 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:12:06.277 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:12:06.277 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 34416 members: 34416 2024-09-10T10:12:06.277 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:34416} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.71:6826/1701579524,v1:172.21.15.71:6827/1701579524] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:12:06.277 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:12:06.277 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:12:06.278 INFO:teuthology.orchestra.run.smithi071.stdout:Standby daemons: 2024-09-10T10:12:06.278 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:12:06.278 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{-1:34432} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.71:6828/1608732243,v1:172.21.15.71:6829/1608732243] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:12:06.278 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{-1:44373} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.107:6824/1627286097,v1:172.21.15.107:6825/1627286097] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:12:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 39 2024-09-10T10:12:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.275+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/894787011 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8f5006e0b0 msgr2=0x7f8f50070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.275+0000 7f8f6e3d3640 1 --2- 172.21.15.71:0/894787011 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8f5006e0b0 0x7f8f50070560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f6810cf30 tx=0x7f8f5c009040 comp rx=0 tx=0).stop 2024-09-10T10:12:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.275+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/894787011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f680666b0 msgr2=0x7f8f6810d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.275+0000 7f8f6e3d3640 1 --2- 172.21.15.71:0/894787011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f680666b0 0x7f8f6810d180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8f58000c00 tx=0x7f8f58009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.275+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/894787011 shutdown_connections 2024-09-10T10:12:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.275+0000 7f8f6e3d3640 1 --2- 172.21.15.71:0/894787011 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8f5006e0b0 0x7f8f50070560 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.275+0000 7f8f6e3d3640 1 --2- 172.21.15.71:0/894787011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8f680ff700 0x7f8f6810d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.275+0000 7f8f6e3d3640 1 --2- 172.21.15.71:0/894787011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f680666b0 0x7f8f6810d180 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.275+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/894787011 >> 172.21.15.71:0/894787011 conn(0x7f8f680f6c10 msgr2=0x7f8f680f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:06.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.276+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/894787011 shutdown_connections 2024-09-10T10:12:06.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.276+0000 7f8f6e3d3640 1 -- 172.21.15.71:0/894787011 wait complete. 2024-09-10T10:12:06.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.355+0000 7f9102e63640 1 -- 172.21.15.71:0/3496373103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90fc0fd820 msgr2=0x7f90fc0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.355+0000 7f9102e63640 1 --2- 172.21.15.71:0/3496373103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90fc0fd820 0x7f90fc0fdc90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f90e80048d0 tx=0x7f90e8009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.355+0000 7f9102e63640 1 -- 172.21.15.71:0/3496373103 shutdown_connections 2024-09-10T10:12:06.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.355+0000 7f9102e63640 1 --2- 172.21.15.71:0/3496373103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90fc0fd820 0x7f90fc0fdc90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.355+0000 7f9102e63640 1 --2- 172.21.15.71:0/3496373103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90fc0fc550 0x7f90fc0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.355+0000 7f9102e63640 1 -- 172.21.15.71:0/3496373103 >> 172.21.15.71:0/3496373103 conn(0x7f90fc0f7d30 msgr2=0x7f90fc0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:06.357 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:06 smithi071 ceph-mon[90773]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:06.358 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:06 smithi071 ceph-mon[90773]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:06.358 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:06 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/3160359013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:06.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.355+0000 7f9102e63640 1 -- 172.21.15.71:0/3496373103 shutdown_connections 2024-09-10T10:12:06.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.355+0000 7f9102e63640 1 -- 172.21.15.71:0/3496373103 wait complete. 2024-09-10T10:12:06.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.356+0000 7f9102e63640 1 Processor -- start 2024-09-10T10:12:06.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.356+0000 7f9102e63640 1 -- start start 2024-09-10T10:12:06.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.356+0000 7f9102e63640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90fc0fc550 0x7f90fc10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.356+0000 7f9102e63640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90fc0fd820 0x7f90fc10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.356+0000 7f9102e63640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc10dc40 con 0x7f90fc0fc550 2024-09-10T10:12:06.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.356+0000 7f9102e63640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc10e460 con 0x7f90fc0fd820 2024-09-10T10:12:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.357+0000 7f9100bff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90fc0fc550 0x7f90fc10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.357+0000 7f9100bff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90fc0fc550 0x7f90fc10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38624/0 (socket says 172.21.15.71:38624) 2024-09-10T10:12:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.357+0000 7f9100bff640 1 -- 172.21.15.71:0/3210815449 learned_addr learned my addr 172.21.15.71:0/3210815449 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.357+0000 7f90fbfff640 1 --2- 172.21.15.71:0/3210815449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90fc0fd820 0x7f90fc10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.357+0000 7f9100bff640 1 -- 172.21.15.71:0/3210815449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90fc0fd820 msgr2=0x7f90fc10d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.357+0000 7f9100bff640 1 --2- 172.21.15.71:0/3210815449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90fc0fd820 0x7f90fc10d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.357+0000 7f9100bff640 1 -- 172.21.15.71:0/3210815449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8005040 con 0x7f90fc0fc550 2024-09-10T10:12:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.357+0000 7f9100bff640 1 --2- 172.21.15.71:0/3210815449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90fc0fc550 0x7f90fc10d0b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f90f0002a50 tx=0x7f90f0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.357+0000 7f90f97fa640 1 -- 172.21.15.71:0/3210815449 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f0007c30 con 0x7f90fc0fc550 2024-09-10T10:12:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.357+0000 7f9102e63640 1 -- 172.21.15.71:0/3210815449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90fc10e6f0 con 0x7f90fc0fc550 2024-09-10T10:12:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.357+0000 7f90f97fa640 1 -- 172.21.15.71:0/3210815449 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90f000f040 con 0x7f90fc0fc550 2024-09-10T10:12:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.357+0000 7f90f97fa640 1 -- 172.21.15.71:0/3210815449 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f000da10 con 0x7f90fc0fc550 2024-09-10T10:12:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.357+0000 7f9102e63640 1 -- 172.21.15.71:0/3210815449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90fc10ec90 con 0x7f90fc0fc550 2024-09-10T10:12:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.358+0000 7f9102e63640 1 -- 172.21.15.71:0/3210815449 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90fc0fb9b0 con 0x7f90fc0fc550 2024-09-10T10:12:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.359+0000 7f90f97fa640 1 -- 172.21.15.71:0/3210815449 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f90f000dc80 con 0x7f90fc0fc550 2024-09-10T10:12:06.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.360+0000 7f90f97fa640 1 --2- 172.21.15.71:0/3210815449 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f90ec06e0b0 0x7f90ec070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.360+0000 7f90f97fa640 1 -- 172.21.15.71:0/3210815449 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f90f008d3b0 con 0x7f90fc0fc550 2024-09-10T10:12:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.360+0000 7f90fbfff640 1 --2- 172.21.15.71:0/3210815449 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f90ec06e0b0 0x7f90ec070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.360+0000 7f90fbfff640 1 --2- 172.21.15.71:0/3210815449 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f90ec06e0b0 0x7f90ec070560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f90fc10ce60 tx=0x7f90e8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:06.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.364+0000 7f90f97fa640 1 -- 172.21.15.71:0/3210815449 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f90f0056730 con 0x7f90fc0fc550 2024-09-10T10:12:06.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.545+0000 7f9102e63640 1 -- 172.21.15.71:0/3210815449 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90fc10f060 con 0x7f90ec06e0b0 2024-09-10T10:12:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.546+0000 7f90f97fa640 1 -- 172.21.15.71:0/3210815449 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f90fc10f060 con 0x7f90ec06e0b0 2024-09-10T10:12:06.548 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:12:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:12:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:12:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:12:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:12:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "osd", 2024-09-10T10:12:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "crash", 2024-09-10T10:12:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-10T10:12:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-10T10:12:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:12:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "15/21 daemons upgraded", 2024-09-10T10:12:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mds daemons", 2024-09-10T10:12:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:12:06.549 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:12:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.548+0000 7f9102e63640 1 -- 172.21.15.71:0/3210815449 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f90ec06e0b0 msgr2=0x7f90ec070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.548+0000 7f9102e63640 1 --2- 172.21.15.71:0/3210815449 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f90ec06e0b0 0x7f90ec070560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f90fc10ce60 tx=0x7f90e8035040 comp rx=0 tx=0).stop 2024-09-10T10:12:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.548+0000 7f9102e63640 1 -- 172.21.15.71:0/3210815449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90fc0fc550 msgr2=0x7f90fc10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.548+0000 7f9102e63640 1 --2- 172.21.15.71:0/3210815449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90fc0fc550 0x7f90fc10d0b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f90f0002a50 tx=0x7f90f0004600 comp rx=0 tx=0).stop 2024-09-10T10:12:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.549+0000 7f9102e63640 1 -- 172.21.15.71:0/3210815449 shutdown_connections 2024-09-10T10:12:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.549+0000 7f9102e63640 1 --2- 172.21.15.71:0/3210815449 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f90ec06e0b0 0x7f90ec070560 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.549+0000 7f9102e63640 1 --2- 172.21.15.71:0/3210815449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90fc0fd820 0x7f90fc10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.549+0000 7f9102e63640 1 --2- 172.21.15.71:0/3210815449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90fc0fc550 0x7f90fc10d0b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.549+0000 7f9102e63640 1 -- 172.21.15.71:0/3210815449 >> 172.21.15.71:0/3210815449 conn(0x7f90fc0f7d30 msgr2=0x7f90fc0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.549+0000 7f9102e63640 1 -- 172.21.15.71:0/3210815449 shutdown_connections 2024-09-10T10:12:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.549+0000 7f9102e63640 1 -- 172.21.15.71:0/3210815449 wait complete. 2024-09-10T10:12:06.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.627+0000 7f767335d640 1 -- 172.21.15.71:0/360762596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f766c0fd840 msgr2=0x7f766c0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.627+0000 7f767335d640 1 --2- 172.21.15.71:0/360762596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f766c0fd840 0x7f766c0fdcb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f76680048d0 tx=0x7f7668009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.627+0000 7f767335d640 1 -- 172.21.15.71:0/360762596 shutdown_connections 2024-09-10T10:12:06.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.627+0000 7f767335d640 1 --2- 172.21.15.71:0/360762596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f766c0fd840 0x7f766c0fdcb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.627+0000 7f767335d640 1 --2- 172.21.15.71:0/360762596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f766c0fc570 0x7f766c0fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.627+0000 7f767335d640 1 -- 172.21.15.71:0/360762596 >> 172.21.15.71:0/360762596 conn(0x7f766c0f7d30 msgr2=0x7f766c0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:06.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.627+0000 7f767335d640 1 -- 172.21.15.71:0/360762596 shutdown_connections 2024-09-10T10:12:06.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.627+0000 7f767335d640 1 -- 172.21.15.71:0/360762596 wait complete. 2024-09-10T10:12:06.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.628+0000 7f767335d640 1 Processor -- start 2024-09-10T10:12:06.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.628+0000 7f767335d640 1 -- start start 2024-09-10T10:12:06.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.628+0000 7f767335d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f766c0fc570 0x7f766c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.628+0000 7f767335d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f766c0fd840 0x7f766c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.628+0000 7f767335d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c06fff0 con 0x7f766c0fc570 2024-09-10T10:12:06.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.628+0000 7f767335d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c070130 con 0x7f766c0fd840 2024-09-10T10:12:06.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.628+0000 7f76710f9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f766c0fc570 0x7f766c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.628+0000 7f76710f9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f766c0fc570 0x7f766c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38634/0 (socket says 172.21.15.71:38634) 2024-09-10T10:12:06.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.628+0000 7f76710f9640 1 -- 172.21.15.71:0/17227323 learned_addr learned my addr 172.21.15.71:0/17227323 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:06.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.628+0000 7f76708f8640 1 --2- 172.21.15.71:0/17227323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f766c0fd840 0x7f766c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.628+0000 7f76710f9640 1 -- 172.21.15.71:0/17227323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f766c0fd840 msgr2=0x7f766c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.628+0000 7f76710f9640 1 --2- 172.21.15.71:0/17227323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f766c0fd840 0x7f766c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.628+0000 7f76710f9640 1 -- 172.21.15.71:0/17227323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7668005040 con 0x7f766c0fc570 2024-09-10T10:12:06.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.629+0000 7f76708f8640 1 --2- 172.21.15.71:0/17227323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f766c0fd840 0x7f766c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:06.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.629+0000 7f76710f9640 1 --2- 172.21.15.71:0/17227323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f766c0fc570 0x7f766c071570 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7660002a50 tx=0x7f7660004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:06.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.629+0000 7f765dffb640 1 -- 172.21.15.71:0/17227323 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7660007c30 con 0x7f766c0fc570 2024-09-10T10:12:06.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.629+0000 7f765dffb640 1 -- 172.21.15.71:0/17227323 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f766000f040 con 0x7f766c0fc570 2024-09-10T10:12:06.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.629+0000 7f767335d640 1 -- 172.21.15.71:0/17227323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c070410 con 0x7f766c0fc570 2024-09-10T10:12:06.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.629+0000 7f765dffb640 1 -- 172.21.15.71:0/17227323 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f766000da50 con 0x7f766c0fc570 2024-09-10T10:12:06.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.629+0000 7f767335d640 1 -- 172.21.15.71:0/17227323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c1150d0 con 0x7f766c0fc570 2024-09-10T10:12:06.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.630+0000 7f765dffb640 1 -- 172.21.15.71:0/17227323 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f766000dc90 con 0x7f766c0fc570 2024-09-10T10:12:06.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.630+0000 7f767335d640 1 -- 172.21.15.71:0/17227323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766c0fb9d0 con 0x7f766c0fc570 2024-09-10T10:12:06.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.631+0000 7f765dffb640 1 --2- 172.21.15.71:0/17227323 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f765806e0b0 0x7f7658070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.631+0000 7f765dffb640 1 -- 172.21.15.71:0/17227323 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f766008d330 con 0x7f766c0fc570 2024-09-10T10:12:06.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.631+0000 7f76708f8640 1 --2- 172.21.15.71:0/17227323 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f765806e0b0 0x7f7658070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.632+0000 7f76708f8640 1 --2- 172.21.15.71:0/17227323 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f765806e0b0 0x7f7658070560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7668000c00 tx=0x7f7668035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:06.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.635+0000 7f765dffb640 1 -- 172.21.15.71:0/17227323 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f76600566b0 con 0x7f766c0fc570 2024-09-10T10:12:06.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:06 smithi107 ceph-mon[79396]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:06.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:06 smithi107 ceph-mon[79396]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:06.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:06 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/3160359013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:06.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.874+0000 7f767335d640 1 -- 172.21.15.71:0/17227323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f766c115300 con 0x7f766c0fc570 2024-09-10T10:12:06.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.874+0000 7f765dffb640 1 -- 172.21.15.71:0/17227323 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7660059d70 con 0x7f766c0fc570 2024-09-10T10:12:06.876 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.876+0000 7f767335d640 1 -- 172.21.15.71:0/17227323 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f765806e0b0 msgr2=0x7f7658070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.876+0000 7f767335d640 1 --2- 172.21.15.71:0/17227323 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f765806e0b0 0x7f7658070560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7668000c00 tx=0x7f7668035040 comp rx=0 tx=0).stop 2024-09-10T10:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.876+0000 7f767335d640 1 -- 172.21.15.71:0/17227323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f766c0fc570 msgr2=0x7f766c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.876+0000 7f767335d640 1 --2- 172.21.15.71:0/17227323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f766c0fc570 0x7f766c071570 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7660002a50 tx=0x7f7660004600 comp rx=0 tx=0).stop 2024-09-10T10:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.876+0000 7f767335d640 1 -- 172.21.15.71:0/17227323 shutdown_connections 2024-09-10T10:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.876+0000 7f767335d640 1 --2- 172.21.15.71:0/17227323 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f765806e0b0 0x7f7658070560 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.876+0000 7f767335d640 1 --2- 172.21.15.71:0/17227323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f766c0fd840 0x7f766c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.876+0000 7f767335d640 1 --2- 172.21.15.71:0/17227323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f766c0fc570 0x7f766c071570 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.876+0000 7f767335d640 1 -- 172.21.15.71:0/17227323 >> 172.21.15.71:0/17227323 conn(0x7f766c0f7d30 msgr2=0x7f766c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.876+0000 7f767335d640 1 -- 172.21.15.71:0/17227323 shutdown_connections 2024-09-10T10:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:06.876+0000 7f767335d640 1 -- 172.21.15.71:0/17227323 wait complete. 2024-09-10T10:12:07.533 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:07 smithi107 ceph-mon[79396]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:07.533 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:07 smithi107 ceph-mon[79396]: pgmap v209: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:07.533 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:07 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/894787011' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:12:07.533 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:07 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:12:07.533 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:07 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/17227323' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:12:07.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:07 smithi071 ceph-mon[90773]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:07.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:07 smithi071 ceph-mon[90773]: pgmap v209: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:07.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:07 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/894787011' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:12:07.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:07 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:12:07.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:07 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/17227323' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:12:08.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:08 smithi071 ceph-mon[90773]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:08.544 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:08 smithi107 ceph-mon[79396]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:09 smithi071 ceph-mon[90773]: pgmap v210: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:12:09.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:09 smithi107 ceph-mon[79396]: pgmap v210: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:09.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:12:10.459 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:10 smithi071 ceph-mon[90773]: mds.? [v2:172.21.15.107:6826/2279749952,v1:172.21.15.107:6827/2279749952] up:boot 2024-09-10T10:12:10.460 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:10 smithi071 ceph-mon[90773]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 3 up:standby 2024-09-10T10:12:10.460 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:10 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:12:10.460 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:10 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:10.460 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:10 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:10.460 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:10 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:10.599 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:10 smithi107 ceph-mon[79396]: mds.? [v2:172.21.15.107:6826/2279749952,v1:172.21.15.107:6827/2279749952] up:boot 2024-09-10T10:12:10.599 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:10 smithi107 ceph-mon[79396]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 3 up:standby 2024-09-10T10:12:10.600 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:10 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:12:10.600 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:10 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:10.600 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:10 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:10.600 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:10 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:11.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:11 smithi107 ceph-mon[79396]: pgmap v211: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:11.669 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:11 smithi071 ceph-mon[90773]: pgmap v211: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:12.628 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:12 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:12.628 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:12 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:12.629 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:12 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:12.629 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:12 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:12.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:12 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:12.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:12 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:12.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:12 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:12.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:12 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:13.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:13 smithi107 ceph-mon[79396]: pgmap v212: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:13.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:13 smithi071 ceph-mon[90773]: pgmap v212: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:15.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: pgmap v213: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:15.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:15.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:15.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:12:15.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:12:15.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:15.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:15.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:15.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:15.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:15.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:15.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:15.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:15.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi071.omoqqq"}]: dispatch 2024-09-10T10:12:15.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi071.omoqqq"}]': finished 2024-09-10T10:12:15.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:12:15.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi071.toijsg"}]': finished 2024-09-10T10:12:15.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:12:15.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.nycoxn"}]': finished 2024-09-10T10:12:15.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:12:15.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.rvgklu"}]': finished 2024-09-10T10:12:15.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:15 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-10T10:12:15.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: pgmap v213: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:15.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:15.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:15.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:12:15.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:12:15.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:15.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:15.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:15.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:15.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:15.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:15.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:15.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:15.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi071.omoqqq"}]: dispatch 2024-09-10T10:12:15.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi071.omoqqq"}]': finished 2024-09-10T10:12:15.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi071.toijsg"}]: dispatch 2024-09-10T10:12:15.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi071.toijsg"}]': finished 2024-09-10T10:12:15.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.nycoxn"}]: dispatch 2024-09-10T10:12:15.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.nycoxn"}]': finished 2024-09-10T10:12:15.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.rvgklu"}]: dispatch 2024-09-10T10:12:15.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi107.rvgklu"}]': finished 2024-09-10T10:12:15.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:15 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-10T10:12:16.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:16 smithi107 ceph-mon[79396]: Upgrade: Setting container_image for all mds 2024-09-10T10:12:16.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:16 smithi107 ceph-mon[79396]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-10T10:12:16.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:16 smithi107 ceph-mon[79396]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:12:16.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:16 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-10T10:12:16.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:16 smithi107 ceph-mon[79396]: daemon mds.cephfs.smithi071.omoqqq assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T10:12:16.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:16 smithi107 ceph-mon[79396]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:12:16.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:16 smithi107 ceph-mon[79396]: Cluster is now healthy 2024-09-10T10:12:16.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:16 smithi107 ceph-mon[79396]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 3 up:standby 2024-09-10T10:12:16.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:16 smithi107 ceph-mon[79396]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi071.omoqqq=up:starting} 2 up:standby 2024-09-10T10:12:16.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:16 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:16.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:16 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-10T10:12:16.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:16 smithi107 ceph-mon[79396]: daemon mds.cephfs.smithi071.omoqqq is now active in filesystem cephfs as rank 1 2024-09-10T10:12:16.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:16 smithi071 ceph-mon[90773]: Upgrade: Setting container_image for all mds 2024-09-10T10:12:16.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:16 smithi071 ceph-mon[90773]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-10T10:12:16.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:16 smithi071 ceph-mon[90773]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:12:16.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:16 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-10T10:12:16.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:16 smithi071 ceph-mon[90773]: daemon mds.cephfs.smithi071.omoqqq assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T10:12:16.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:16 smithi071 ceph-mon[90773]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:12:16.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:16 smithi071 ceph-mon[90773]: Cluster is now healthy 2024-09-10T10:12:16.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:16 smithi071 ceph-mon[90773]: fsmap cephfs:1 {0=cephfs.smithi071.toijsg=up:active} 3 up:standby 2024-09-10T10:12:16.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:16 smithi071 ceph-mon[90773]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi071.omoqqq=up:starting} 2 up:standby 2024-09-10T10:12:16.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:16 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:16.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:16 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-10T10:12:16.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:16 smithi071 ceph-mon[90773]: daemon mds.cephfs.smithi071.omoqqq is now active in filesystem cephfs as rank 1 2024-09-10T10:12:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: pgmap v214: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-10T10:12:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-10T10:12:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: mds.? [v2:172.21.15.71:6828/1608732243,v1:172.21.15.71:6829/1608732243] up:active 2024-09-10T10:12:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi071.omoqqq=up:active} 2 up:standby 2024-09-10T10:12:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi071.omoqqq=up:active} 2 up:standby-replay 2024-09-10T10:12:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:17.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:17.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:17.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:17.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:17.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:17.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:17.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:17.777 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: pgmap v214: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:12:17.777 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-10T10:12:17.777 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-10T10:12:17.778 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: mds.? [v2:172.21.15.71:6828/1608732243,v1:172.21.15.71:6829/1608732243] up:active 2024-09-10T10:12:17.778 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi071.omoqqq=up:active} 2 up:standby 2024-09-10T10:12:17.778 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: fsmap cephfs:2 {0=cephfs.smithi071.toijsg=up:active,1=cephfs.smithi071.omoqqq=up:active} 2 up:standby-replay 2024-09-10T10:12:17.778 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:17.778 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:17.778 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:17.778 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:17.778 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:17.778 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:17.778 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:17.778 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:17.778 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:17.778 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:17.779 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:18.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:18 smithi071 ceph-mon[90773]: Upgrade: Setting container_image for all rgw 2024-09-10T10:12:18.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:18 smithi071 ceph-mon[90773]: Upgrade: Setting container_image for all rbd-mirror 2024-09-10T10:12:18.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:18 smithi071 ceph-mon[90773]: Upgrade: Setting container_image for all ceph-exporter 2024-09-10T10:12:18.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:18 smithi071 ceph-mon[90773]: Upgrade: Setting container_image for all iscsi 2024-09-10T10:12:18.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:18 smithi071 ceph-mon[90773]: Upgrade: Setting container_image for all nfs 2024-09-10T10:12:18.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:18 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:18.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:18 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:18.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:18 smithi071 ceph-mon[90773]: Upgrade: Setting container_image for all nvmeof 2024-09-10T10:12:18.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:18 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:18.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:18 smithi107 ceph-mon[79396]: Upgrade: Setting container_image for all rgw 2024-09-10T10:12:18.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:18 smithi107 ceph-mon[79396]: Upgrade: Setting container_image for all rbd-mirror 2024-09-10T10:12:18.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:18 smithi107 ceph-mon[79396]: Upgrade: Setting container_image for all ceph-exporter 2024-09-10T10:12:18.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:18 smithi107 ceph-mon[79396]: Upgrade: Setting container_image for all iscsi 2024-09-10T10:12:18.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:18 smithi107 ceph-mon[79396]: Upgrade: Setting container_image for all nfs 2024-09-10T10:12:18.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:18 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:18.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:18 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:18.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:18 smithi107 ceph-mon[79396]: Upgrade: Setting container_image for all nvmeof 2024-09-10T10:12:18.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:18 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:19.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:19 smithi071 ceph-mon[90773]: pgmap v215: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 85 B/s rd, 0 op/s 2024-09-10T10:12:19.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:19 smithi107 ceph-mon[79396]: pgmap v215: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 85 B/s rd, 0 op/s 2024-09-10T10:12:20.641 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:20 smithi071 ceph-mon[90773]: Upgrade: Updating node-exporter.smithi071 (1/2) 2024-09-10T10:12:20.641 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:20 smithi071 ceph-mon[90773]: Deploying daemon node-exporter.smithi071 on smithi071 2024-09-10T10:12:20.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:20 smithi107 ceph-mon[79396]: Upgrade: Updating node-exporter.smithi071 (1/2) 2024-09-10T10:12:20.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:20 smithi107 ceph-mon[79396]: Deploying daemon node-exporter.smithi071 on smithi071 2024-09-10T10:12:21.734 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:21 smithi071 ceph-mon[90773]: pgmap v216: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T10:12:21.734 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:21 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:21.734 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:21 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:21.773 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:21 smithi107 ceph-mon[79396]: pgmap v216: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T10:12:21.773 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:21 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:21.774 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:21 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:23.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:23 smithi071 ceph-mon[90773]: pgmap v217: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T10:12:23.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:23 smithi107 ceph-mon[79396]: pgmap v217: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T10:12:24.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:24 smithi107 ceph-mon[79396]: Upgrade: Updating node-exporter.smithi107 (2/2) 2024-09-10T10:12:24.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:24 smithi107 ceph-mon[79396]: Deploying daemon node-exporter.smithi107 on smithi107 2024-09-10T10:12:24.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:12:24.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:24 smithi071 ceph-mon[90773]: Upgrade: Updating node-exporter.smithi107 (2/2) 2024-09-10T10:12:24.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:24 smithi071 ceph-mon[90773]: Deploying daemon node-exporter.smithi107 on smithi107 2024-09-10T10:12:24.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:12:25.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:25 smithi107 ceph-mon[79396]: pgmap v218: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T10:12:25.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:25 smithi071 ceph-mon[90773]: pgmap v218: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T10:12:26.714 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:26.714 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:26.714 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:26.715 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:26 smithi107 ceph-mon[79396]: pgmap v219: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-10T10:12:27.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:27.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:27.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:27.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:26 smithi071 ceph-mon[90773]: pgmap v219: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-10T10:12:28.951 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:28.951 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:28.951 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:28 smithi107 ceph-mon[79396]: pgmap v220: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-10T10:12:28.951 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:28.951 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:29.038 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:29.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:29.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:28 smithi071 ceph-mon[90773]: pgmap v220: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-10T10:12:29.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:29.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:31.142 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:31.142 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:31.143 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:30 smithi071 ceph-mon[90773]: pgmap v221: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-10T10:12:31.143 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:31.143 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:31.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:31.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:31.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:30 smithi107 ceph-mon[79396]: pgmap v221: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-10T10:12:31.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:31.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:33.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:33 smithi071 ceph-mon[90773]: pgmap v222: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 85 B/s wr, 11 op/s 2024-09-10T10:12:33.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:33 smithi107 ceph-mon[79396]: pgmap v222: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 85 B/s wr, 11 op/s 2024-09-10T10:12:34.963 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:34.963 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:34.963 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:34.963 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:34.963 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:12:34.963 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:12:34.963 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:34.963 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: pgmap v223: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 3 op/s 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:34.964 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:34 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:35.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:35.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:35.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:35.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:35.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:12:35.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:12:35.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:35.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: pgmap v223: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 3 op/s 2024-09-10T10:12:35.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:35.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:35.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:35.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:35.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:35.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:35.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:35.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:35.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:35.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:35.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:35.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:35.147 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:35.148 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:34 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:36.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.958+0000 7f01419a3640 1 -- 172.21.15.71:0/4201374952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f013c0fc720 msgr2=0x7f013c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:36.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.958+0000 7f01419a3640 1 --2- 172.21.15.71:0/4201374952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f013c0fc720 0x7f013c0fcb90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f01240048d0 tx=0x7f0124009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:36.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.958+0000 7f01419a3640 1 -- 172.21.15.71:0/4201374952 shutdown_connections 2024-09-10T10:12:36.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.958+0000 7f01419a3640 1 --2- 172.21.15.71:0/4201374952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f013c0fc720 0x7f013c0fcb90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:36.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.958+0000 7f01419a3640 1 --2- 172.21.15.71:0/4201374952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f013c0fb450 0x7f013c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:36.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.958+0000 7f01419a3640 1 -- 172.21.15.71:0/4201374952 >> 172.21.15.71:0/4201374952 conn(0x7f013c0f6c10 msgr2=0x7f013c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:36.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.958+0000 7f01419a3640 1 -- 172.21.15.71:0/4201374952 shutdown_connections 2024-09-10T10:12:36.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.958+0000 7f01419a3640 1 -- 172.21.15.71:0/4201374952 wait complete. 2024-09-10T10:12:36.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.959+0000 7f01419a3640 1 Processor -- start 2024-09-10T10:12:36.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.959+0000 7f01419a3640 1 -- start start 2024-09-10T10:12:36.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.959+0000 7f01419a3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f013c0fb450 0x7f013c0ff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:36.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.959+0000 7f01419a3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f013c0fc720 0x7f013c0fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:36.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.959+0000 7f01419a3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0fdff0 con 0x7f013c0fc720 2024-09-10T10:12:36.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.959+0000 7f01419a3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0fe130 con 0x7f013c0fb450 2024-09-10T10:12:36.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.959+0000 7f013a7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f013c0fc720 0x7f013c0fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:36.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.959+0000 7f013a7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f013c0fc720 0x7f013c0fda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53466/0 (socket says 172.21.15.71:53466) 2024-09-10T10:12:36.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.959+0000 7f013a7fc640 1 -- 172.21.15.71:0/2053947241 learned_addr learned my addr 172.21.15.71:0/2053947241 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:36.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.959+0000 7f013affd640 1 --2- 172.21.15.71:0/2053947241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f013c0fb450 0x7f013c0ff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:36.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.960+0000 7f013a7fc640 1 -- 172.21.15.71:0/2053947241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f013c0fb450 msgr2=0x7f013c0ff570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:36.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.960+0000 7f013a7fc640 1 --2- 172.21.15.71:0/2053947241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f013c0fb450 0x7f013c0ff570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:36.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.960+0000 7f013a7fc640 1 -- 172.21.15.71:0/2053947241 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0124005040 con 0x7f013c0fc720 2024-09-10T10:12:36.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.960+0000 7f013a7fc640 1 --2- 172.21.15.71:0/2053947241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f013c0fc720 0x7f013c0fda60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0124000c00 tx=0x7f0124009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:36.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.960+0000 7f01337fe640 1 -- 172.21.15.71:0/2053947241 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0124038070 con 0x7f013c0fc720 2024-09-10T10:12:36.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.960+0000 7f01419a3640 1 -- 172.21.15.71:0/2053947241 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013c0fe3b0 con 0x7f013c0fc720 2024-09-10T10:12:36.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.960+0000 7f01337fe640 1 -- 172.21.15.71:0/2053947241 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0124004290 con 0x7f013c0fc720 2024-09-10T10:12:36.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.960+0000 7f01337fe640 1 -- 172.21.15.71:0/2053947241 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f012403e430 con 0x7f013c0fc720 2024-09-10T10:12:36.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.960+0000 7f01419a3640 1 -- 172.21.15.71:0/2053947241 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013c115130 con 0x7f013c0fc720 2024-09-10T10:12:36.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.961+0000 7f01419a3640 1 -- 172.21.15.71:0/2053947241 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013c04b720 con 0x7f013c0fc720 2024-09-10T10:12:36.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.962+0000 7f01337fe640 1 -- 172.21.15.71:0/2053947241 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0124030020 con 0x7f013c0fc720 2024-09-10T10:12:36.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.962+0000 7f01337fe640 1 --2- 172.21.15.71:0/2053947241 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f012806e0b0 0x7f0128070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:36.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.962+0000 7f01337fe640 1 -- 172.21.15.71:0/2053947241 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f01240add10 con 0x7f013c0fc720 2024-09-10T10:12:36.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.962+0000 7f013affd640 1 --2- 172.21.15.71:0/2053947241 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f012806e0b0 0x7f0128070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:36.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.963+0000 7f013affd640 1 --2- 172.21.15.71:0/2053947241 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f012806e0b0 0x7f0128070560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f013c0ff320 tx=0x7f013400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:36.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:36.968+0000 7f01337fe640 1 -- 172.21.15.71:0/2053947241 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0124077090 con 0x7f013c0fc720 2024-09-10T10:12:37.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.152+0000 7f01419a3640 1 -- 172.21.15.71:0/2053947241 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f013c103f80 con 0x7f012806e0b0 2024-09-10T10:12:37.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.153+0000 7f01337fe640 1 -- 172.21.15.71:0/2053947241 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f013c103f80 con 0x7f012806e0b0 2024-09-10T10:12:37.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.155+0000 7f01419a3640 1 -- 172.21.15.71:0/2053947241 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f012806e0b0 msgr2=0x7f0128070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.155+0000 7f01419a3640 1 --2- 172.21.15.71:0/2053947241 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f012806e0b0 0x7f0128070560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f013c0ff320 tx=0x7f013400b040 comp rx=0 tx=0).stop 2024-09-10T10:12:37.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.155+0000 7f01419a3640 1 -- 172.21.15.71:0/2053947241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f013c0fc720 msgr2=0x7f013c0fda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.155+0000 7f01419a3640 1 --2- 172.21.15.71:0/2053947241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f013c0fc720 0x7f013c0fda60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0124000c00 tx=0x7f0124009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.155+0000 7f01419a3640 1 -- 172.21.15.71:0/2053947241 shutdown_connections 2024-09-10T10:12:37.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.155+0000 7f01419a3640 1 --2- 172.21.15.71:0/2053947241 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f012806e0b0 0x7f0128070560 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.155+0000 7f01419a3640 1 --2- 172.21.15.71:0/2053947241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f013c0fc720 0x7f013c0fda60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.155+0000 7f01419a3640 1 --2- 172.21.15.71:0/2053947241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f013c0fb450 0x7f013c0ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.155+0000 7f01419a3640 1 -- 172.21.15.71:0/2053947241 >> 172.21.15.71:0/2053947241 conn(0x7f013c0f6c10 msgr2=0x7f013c066120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:37.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.155+0000 7f01419a3640 1 -- 172.21.15.71:0/2053947241 shutdown_connections 2024-09-10T10:12:37.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.155+0000 7f01419a3640 1 -- 172.21.15.71:0/2053947241 wait complete. 2024-09-10T10:12:37.165 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:12:37.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.235+0000 7f8c068e4640 1 -- 172.21.15.71:0/3729706733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c000fe500 msgr2=0x7f8c000fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.235+0000 7f8c068e4640 1 --2- 172.21.15.71:0/3729706733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c000fe500 0x7f8c000fa660 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8be80048d0 tx=0x7f8be8009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.235+0000 7f8c068e4640 1 -- 172.21.15.71:0/3729706733 shutdown_connections 2024-09-10T10:12:37.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.235+0000 7f8c068e4640 1 --2- 172.21.15.71:0/3729706733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c000fe500 0x7f8c000fa660 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.235+0000 7f8c068e4640 1 --2- 172.21.15.71:0/3729706733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c000fdbb0 0x7f8c000fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.235+0000 7f8c068e4640 1 -- 172.21.15.71:0/3729706733 >> 172.21.15.71:0/3729706733 conn(0x7f8c000f63b0 msgr2=0x7f8c000f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:37.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.235+0000 7f8c068e4640 1 -- 172.21.15.71:0/3729706733 shutdown_connections 2024-09-10T10:12:37.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.235+0000 7f8c068e4640 1 -- 172.21.15.71:0/3729706733 wait complete. 2024-09-10T10:12:37.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.236+0000 7f8c068e4640 1 Processor -- start 2024-09-10T10:12:37.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.236+0000 7f8c068e4640 1 -- start start 2024-09-10T10:12:37.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.236+0000 7f8c068e4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c000fdbb0 0x7f8c0010d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.236+0000 7f8c068e4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c000fe500 0x7f8c0010d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.236+0000 7f8c068e4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0010dc50 con 0x7f8c000fdbb0 2024-09-10T10:12:37.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.236+0000 7f8c068e4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0010e470 con 0x7f8c000fe500 2024-09-10T10:12:37.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.236+0000 7f8bf7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c000fdbb0 0x7f8c0010d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.236+0000 7f8bf7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c000fdbb0 0x7f8c0010d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53484/0 (socket says 172.21.15.71:53484) 2024-09-10T10:12:37.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.236+0000 7f8bf7fff640 1 -- 172.21.15.71:0/2653944347 learned_addr learned my addr 172.21.15.71:0/2653944347 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:37.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.236+0000 7f8bfffff640 1 --2- 172.21.15.71:0/2653944347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c000fe500 0x7f8c0010d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.237+0000 7f8bf7fff640 1 -- 172.21.15.71:0/2653944347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c000fe500 msgr2=0x7f8c0010d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.237+0000 7f8bf7fff640 1 --2- 172.21.15.71:0/2653944347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c000fe500 0x7f8c0010d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.237+0000 7f8bf7fff640 1 -- 172.21.15.71:0/2653944347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be8005040 con 0x7f8c000fdbb0 2024-09-10T10:12:37.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.237+0000 7f8bfffff640 1 --2- 172.21.15.71:0/2653944347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c000fe500 0x7f8c0010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:12:37.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.237+0000 7f8bf7fff640 1 --2- 172.21.15.71:0/2653944347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c000fdbb0 0x7f8c0010d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0002a50 tx=0x7f8bf0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:37.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.237+0000 7f8bfd7fa640 1 -- 172.21.15.71:0/2653944347 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bf0007c30 con 0x7f8c000fdbb0 2024-09-10T10:12:37.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.237+0000 7f8bfd7fa640 1 -- 172.21.15.71:0/2653944347 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8bf000f040 con 0x7f8c000fdbb0 2024-09-10T10:12:37.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.237+0000 7f8bfd7fa640 1 -- 172.21.15.71:0/2653944347 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bf000da90 con 0x7f8c000fdbb0 2024-09-10T10:12:37.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.237+0000 7f8c068e4640 1 -- 172.21.15.71:0/2653944347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0010e700 con 0x7f8c000fdbb0 2024-09-10T10:12:37.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.237+0000 7f8c068e4640 1 -- 172.21.15.71:0/2653944347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0010eca0 con 0x7f8c000fdbb0 2024-09-10T10:12:37.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.238+0000 7f8c068e4640 1 -- 172.21.15.71:0/2653944347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c000fa050 con 0x7f8c000fdbb0 2024-09-10T10:12:37.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.239+0000 7f8bfd7fa640 1 -- 172.21.15.71:0/2653944347 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8bf000dc30 con 0x7f8c000fdbb0 2024-09-10T10:12:37.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.239+0000 7f8bfd7fa640 1 --2- 172.21.15.71:0/2653944347 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8bec06e0b0 0x7f8bec070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.240+0000 7f8bfd7fa640 1 -- 172.21.15.71:0/2653944347 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8bf008d440 con 0x7f8c000fdbb0 2024-09-10T10:12:37.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.240+0000 7f8bfffff640 1 --2- 172.21.15.71:0/2653944347 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8bec06e0b0 0x7f8bec070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.240+0000 7f8bfffff640 1 --2- 172.21.15.71:0/2653944347 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8bec06e0b0 0x7f8bec070560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8c0010ce70 tx=0x7f8be8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:37.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.244+0000 7f8bfd7fa640 1 -- 172.21.15.71:0/2653944347 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8bf0056790 con 0x7f8c000fdbb0 2024-09-10T10:12:37.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.434+0000 7f8c068e4640 1 -- 172.21.15.71:0/2653944347 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c0010f050 con 0x7f8bec06e0b0 2024-09-10T10:12:37.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.435+0000 7f8bfd7fa640 1 -- 172.21.15.71:0/2653944347 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f8c0010f050 con 0x7f8bec06e0b0 2024-09-10T10:12:37.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.437+0000 7f8c068e4640 1 -- 172.21.15.71:0/2653944347 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8bec06e0b0 msgr2=0x7f8bec070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.437+0000 7f8c068e4640 1 --2- 172.21.15.71:0/2653944347 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8bec06e0b0 0x7f8bec070560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8c0010ce70 tx=0x7f8be8035040 comp rx=0 tx=0).stop 2024-09-10T10:12:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.437+0000 7f8c068e4640 1 -- 172.21.15.71:0/2653944347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c000fdbb0 msgr2=0x7f8c0010d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.437+0000 7f8c068e4640 1 --2- 172.21.15.71:0/2653944347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c000fdbb0 0x7f8c0010d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0002a50 tx=0x7f8bf0004600 comp rx=0 tx=0).stop 2024-09-10T10:12:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.437+0000 7f8c068e4640 1 -- 172.21.15.71:0/2653944347 shutdown_connections 2024-09-10T10:12:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.437+0000 7f8c068e4640 1 --2- 172.21.15.71:0/2653944347 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8bec06e0b0 0x7f8bec070560 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.437+0000 7f8c068e4640 1 --2- 172.21.15.71:0/2653944347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c000fe500 0x7f8c0010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.437+0000 7f8c068e4640 1 --2- 172.21.15.71:0/2653944347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c000fdbb0 0x7f8c0010d0c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.437+0000 7f8c068e4640 1 -- 172.21.15.71:0/2653944347 >> 172.21.15.71:0/2653944347 conn(0x7f8c000f63b0 msgr2=0x7f8c000f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.437+0000 7f8c068e4640 1 -- 172.21.15.71:0/2653944347 shutdown_connections 2024-09-10T10:12:37.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.437+0000 7f8c068e4640 1 -- 172.21.15.71:0/2653944347 wait complete. 2024-09-10T10:12:37.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.516+0000 7fc32ccb1640 1 -- 172.21.15.71:0/3933026087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280fd820 msgr2=0x7fc3280fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.516+0000 7fc32ccb1640 1 --2- 172.21.15.71:0/3933026087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280fd820 0x7fc3280fdc90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc3100048d0 tx=0x7fc310009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.518 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:37 smithi071 ceph-mon[90773]: Upgrade: Updating prometheus.smithi071 2024-09-10T10:12:37.518 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:37 smithi071 ceph-mon[90773]: Deploying daemon prometheus.smithi071 on smithi071 2024-09-10T10:12:37.518 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:37 smithi071 ceph-mon[90773]: pgmap v224: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 4 op/s 2024-09-10T10:12:37.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.516+0000 7fc32ccb1640 1 -- 172.21.15.71:0/3933026087 shutdown_connections 2024-09-10T10:12:37.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.516+0000 7fc32ccb1640 1 --2- 172.21.15.71:0/3933026087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280fd820 0x7fc3280fdc90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.516+0000 7fc32ccb1640 1 --2- 172.21.15.71:0/3933026087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3280fc550 0x7fc3280fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.516+0000 7fc32ccb1640 1 -- 172.21.15.71:0/3933026087 >> 172.21.15.71:0/3933026087 conn(0x7fc3280f7d30 msgr2=0x7fc3280fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:37.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.516+0000 7fc32ccb1640 1 -- 172.21.15.71:0/3933026087 shutdown_connections 2024-09-10T10:12:37.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.516+0000 7fc32ccb1640 1 -- 172.21.15.71:0/3933026087 wait complete. 2024-09-10T10:12:37.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.516+0000 7fc32ccb1640 1 Processor -- start 2024-09-10T10:12:37.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc32ccb1640 1 -- start start 2024-09-10T10:12:37.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc32ccb1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3280fc550 0x7fc328071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc32ccb1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280fd820 0x7fc32806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc32ccb1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32806fff0 con 0x7fc3280fd820 2024-09-10T10:12:37.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc32ccb1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc328070130 con 0x7fc3280fc550 2024-09-10T10:12:37.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc325d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280fd820 0x7fc32806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc325d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280fd820 0x7fc32806fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53494/0 (socket says 172.21.15.71:53494) 2024-09-10T10:12:37.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc325d9b640 1 -- 172.21.15.71:0/339077236 learned_addr learned my addr 172.21.15.71:0/339077236 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:37.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc32659c640 1 --2- 172.21.15.71:0/339077236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3280fc550 0x7fc328071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc325d9b640 1 -- 172.21.15.71:0/339077236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3280fc550 msgr2=0x7fc328071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc325d9b640 1 --2- 172.21.15.71:0/339077236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3280fc550 0x7fc328071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc325d9b640 1 -- 172.21.15.71:0/339077236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310005040 con 0x7fc3280fd820 2024-09-10T10:12:37.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc32659c640 1 --2- 172.21.15.71:0/339077236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3280fc550 0x7fc328071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:12:37.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.517+0000 7fc325d9b640 1 --2- 172.21.15.71:0/339077236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280fd820 0x7fc32806fa60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc3100043d0 tx=0x7fc310009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:37.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.518+0000 7fc31effd640 1 -- 172.21.15.71:0/339077236 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc310038070 con 0x7fc3280fd820 2024-09-10T10:12:37.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.518+0000 7fc32ccb1640 1 -- 172.21.15.71:0/339077236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3280703b0 con 0x7fc3280fd820 2024-09-10T10:12:37.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.518+0000 7fc31effd640 1 -- 172.21.15.71:0/339077236 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc31002ae90 con 0x7fc3280fd820 2024-09-10T10:12:37.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.518+0000 7fc31effd640 1 -- 172.21.15.71:0/339077236 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc31003e670 con 0x7fc3280fd820 2024-09-10T10:12:37.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.518+0000 7fc32ccb1640 1 -- 172.21.15.71:0/339077236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc328115100 con 0x7fc3280fd820 2024-09-10T10:12:37.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.519+0000 7fc32ccb1640 1 -- 172.21.15.71:0/339077236 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32804b720 con 0x7fc3280fd820 2024-09-10T10:12:37.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.519+0000 7fc31effd640 1 -- 172.21.15.71:0/339077236 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc310030020 con 0x7fc3280fd820 2024-09-10T10:12:37.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.520+0000 7fc31effd640 1 --2- 172.21.15.71:0/339077236 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc31406e0b0 0x7fc314070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.520+0000 7fc31effd640 1 -- 172.21.15.71:0/339077236 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc3100adec0 con 0x7fc3280fd820 2024-09-10T10:12:37.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.520+0000 7fc32659c640 1 --2- 172.21.15.71:0/339077236 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc31406e0b0 0x7fc314070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.520+0000 7fc32659c640 1 --2- 172.21.15.71:0/339077236 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc31406e0b0 0x7fc314070560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc318009fd0 tx=0x7fc318009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:37.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.524+0000 7fc31effd640 1 -- 172.21.15.71:0/339077236 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc310077130 con 0x7fc3280fd820 2024-09-10T10:12:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:37 smithi107 ceph-mon[79396]: Upgrade: Updating prometheus.smithi071 2024-09-10T10:12:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:37 smithi107 ceph-mon[79396]: Deploying daemon prometheus.smithi071 on smithi071 2024-09-10T10:12:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:37 smithi107 ceph-mon[79396]: pgmap v224: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 4 op/s 2024-09-10T10:12:37.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.704+0000 7fc32ccb1640 1 -- 172.21.15.71:0/339077236 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc328101c40 con 0x7fc31406e0b0 2024-09-10T10:12:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.713+0000 7fc31effd640 1 -- 172.21.15.71:0/339077236 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fc328101c40 con 0x7fc31406e0b0 2024-09-10T10:12:37.714 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:12:37.714 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (7m) 7s ago 16m 25.5M - 0.25.0 c8568f914cd2 e37fa50e9beb 2024-09-10T10:12:37.714 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (5m) 7s ago 16m 6903k - 19.1.1-305-g1cf819b7 41d671128357 5dc74ad01560 2024-09-10T10:12:37.714 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (5m) 10s ago 15m 6891k - 19.1.1-305-g1cf819b7 41d671128357 6f4355e875db 2024-09-10T10:12:37.714 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (7m) 7s ago 16m 85.9M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:12:37.715 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (64s) 7s ago 10m 15.7M - 19.1.1-305-g1cf819b7 41d671128357 6ec036debe92 2024-09-10T10:12:37.715 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (81s) 7s ago 11m 65.9M - 19.1.1-305-g1cf819b7 41d671128357 58af9b545bf4 2024-09-10T10:12:37.715 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (44s) 10s ago 11m 137M - 19.1.1-305-g1cf819b7 41d671128357 b3a09b16124b 2024-09-10T10:12:37.715 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (28s) 10s ago 10m 14.4M - 19.1.1-305-g1cf819b7 41d671128357 bdcd45e9b3e2 2024-09-10T10:12:37.715 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (7m) 7s ago 17m 506M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:12:37.715 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (6m) 10s ago 15m 442M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:12:37.715 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (6m) 7s ago 17m 52.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:12:37.715 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (6m) 10s ago 15m 38.9M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:12:37.715 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (16s) 7s ago 16m 3347k - 1.5.0 0da6a335fe13 06ab97573e3d 2024-09-10T10:12:37.715 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (12s) 10s ago 15m 3598k - 1.5.0 0da6a335fe13 c514485d2dcf 2024-09-10T10:12:37.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (5m) 7s ago 14m 106M 1557M 19.1.1-305-g1cf819b7 41d671128357 f1e9da1144c1 2024-09-10T10:12:37.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (4m) 7s ago 14m 110M 1557M 19.1.1-305-g1cf819b7 41d671128357 5afc8bef5343 2024-09-10T10:12:37.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (3m) 7s ago 13m 97.4M 1557M 19.1.1-305-g1cf819b7 41d671128357 5e5976fcfaa8 2024-09-10T10:12:37.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (3m) 10s ago 13m 116M 2581M 19.1.1-305-g1cf819b7 41d671128357 e22ee626ccd0 2024-09-10T10:12:37.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (2m) 10s ago 12m 99.5M 2581M 19.1.1-305-g1cf819b7 41d671128357 e92f23ad2c77 2024-09-10T10:12:37.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (2m) 10s ago 12m 95.1M 2581M 19.1.1-305-g1cf819b7 41d671128357 3440ee1c721e 2024-09-10T10:12:37.716 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (6m) 7s ago 15m 69.5M - 2.43.0 a07b618ecd1d 47d3ae62ce5e 2024-09-10T10:12:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.715+0000 7fc32ccb1640 1 -- 172.21.15.71:0/339077236 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc31406e0b0 msgr2=0x7fc314070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.715+0000 7fc32ccb1640 1 --2- 172.21.15.71:0/339077236 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc31406e0b0 0x7fc314070560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc318009fd0 tx=0x7fc318009e90 comp rx=0 tx=0).stop 2024-09-10T10:12:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.715+0000 7fc32ccb1640 1 -- 172.21.15.71:0/339077236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280fd820 msgr2=0x7fc32806fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.715+0000 7fc32ccb1640 1 --2- 172.21.15.71:0/339077236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280fd820 0x7fc32806fa60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc3100043d0 tx=0x7fc310009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.715+0000 7fc32ccb1640 1 -- 172.21.15.71:0/339077236 shutdown_connections 2024-09-10T10:12:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.715+0000 7fc32ccb1640 1 --2- 172.21.15.71:0/339077236 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc31406e0b0 0x7fc314070560 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.715+0000 7fc32ccb1640 1 --2- 172.21.15.71:0/339077236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280fd820 0x7fc32806fa60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.715+0000 7fc32ccb1640 1 --2- 172.21.15.71:0/339077236 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3280fc550 0x7fc328071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.715+0000 7fc32ccb1640 1 -- 172.21.15.71:0/339077236 >> 172.21.15.71:0/339077236 conn(0x7fc3280f7d30 msgr2=0x7fc3280f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.715+0000 7fc32ccb1640 1 -- 172.21.15.71:0/339077236 shutdown_connections 2024-09-10T10:12:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.715+0000 7fc32ccb1640 1 -- 172.21.15.71:0/339077236 wait complete. 2024-09-10T10:12:37.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.792+0000 7fafdbb09640 1 -- 172.21.15.71:0/2026906583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafd40fb430 msgr2=0x7fafd40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.792+0000 7fafdbb09640 1 --2- 172.21.15.71:0/2026906583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafd40fb430 0x7fafd40fb840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fafd00048d0 tx=0x7fafd0009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.792+0000 7fafdbb09640 1 -- 172.21.15.71:0/2026906583 shutdown_connections 2024-09-10T10:12:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.793+0000 7fafdbb09640 1 --2- 172.21.15.71:0/2026906583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafd40fc700 0x7fafd40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.793+0000 7fafdbb09640 1 --2- 172.21.15.71:0/2026906583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafd40fb430 0x7fafd40fb840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.793+0000 7fafdbb09640 1 -- 172.21.15.71:0/2026906583 >> 172.21.15.71:0/2026906583 conn(0x7fafd40f6c10 msgr2=0x7fafd40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.793+0000 7fafdbb09640 1 -- 172.21.15.71:0/2026906583 shutdown_connections 2024-09-10T10:12:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.793+0000 7fafdbb09640 1 -- 172.21.15.71:0/2026906583 wait complete. 2024-09-10T10:12:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.793+0000 7fafdbb09640 1 Processor -- start 2024-09-10T10:12:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.793+0000 7fafdbb09640 1 -- start start 2024-09-10T10:12:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.793+0000 7fafdbb09640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafd40fb430 0x7fafd410bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.793+0000 7fafdbb09640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafd40fc700 0x7fafd410c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.793+0000 7fafdbb09640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd410cb10 con 0x7fafd40fb430 2024-09-10T10:12:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.793+0000 7fafdbb09640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd410d330 con 0x7fafd40fc700 2024-09-10T10:12:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafd98a5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafd40fb430 0x7fafd410bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafd98a5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafd40fb430 0x7fafd410bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53518/0 (socket says 172.21.15.71:53518) 2024-09-10T10:12:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafd98a5640 1 -- 172.21.15.71:0/2984524039 learned_addr learned my addr 172.21.15.71:0/2984524039 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafd90a4640 1 --2- 172.21.15.71:0/2984524039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafd40fc700 0x7fafd410c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafd98a5640 1 -- 172.21.15.71:0/2984524039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafd40fc700 msgr2=0x7fafd410c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafd98a5640 1 --2- 172.21.15.71:0/2984524039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafd40fc700 0x7fafd410c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafd98a5640 1 -- 172.21.15.71:0/2984524039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd0005040 con 0x7fafd40fb430 2024-09-10T10:12:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafd90a4640 1 --2- 172.21.15.71:0/2984524039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafd40fc700 0x7fafd410c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:12:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafd98a5640 1 --2- 172.21.15.71:0/2984524039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafd40fb430 0x7fafd410bf80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fafd00043d0 tx=0x7fafd0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafca7fc640 1 -- 172.21.15.71:0/2984524039 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafd0038070 con 0x7fafd40fb430 2024-09-10T10:12:37.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafca7fc640 1 -- 172.21.15.71:0/2984524039 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fafd002ae90 con 0x7fafd40fb430 2024-09-10T10:12:37.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafdbb09640 1 -- 172.21.15.71:0/2984524039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd410d560 con 0x7fafd40fb430 2024-09-10T10:12:37.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafca7fc640 1 -- 172.21.15.71:0/2984524039 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafd003e670 con 0x7fafd40fb430 2024-09-10T10:12:37.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.794+0000 7fafdbb09640 1 -- 172.21.15.71:0/2984524039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd410db00 con 0x7fafd40fb430 2024-09-10T10:12:37.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.795+0000 7fafdbb09640 1 -- 172.21.15.71:0/2984524039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd40fa890 con 0x7fafd40fb430 2024-09-10T10:12:37.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.796+0000 7fafca7fc640 1 -- 172.21.15.71:0/2984524039 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fafd0030020 con 0x7fafd40fb430 2024-09-10T10:12:37.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.796+0000 7fafca7fc640 1 --2- 172.21.15.71:0/2984524039 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fafc006e0b0 0x7fafc0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.796+0000 7fafca7fc640 1 -- 172.21.15.71:0/2984524039 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fafd00ade60 con 0x7fafd40fb430 2024-09-10T10:12:37.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.796+0000 7fafd90a4640 1 --2- 172.21.15.71:0/2984524039 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fafc006e0b0 0x7fafc0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.797+0000 7fafd90a4640 1 --2- 172.21.15.71:0/2984524039 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fafc006e0b0 0x7fafc0070560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fafc4007fd0 tx=0x7fafc4009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:37.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:37.801+0000 7fafca7fc640 1 -- 172.21.15.71:0/2984524039 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fafd0077130 con 0x7fafd40fb430 2024-09-10T10:12:38.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.038+0000 7fafdbb09640 1 -- 172.21.15.71:0/2984524039 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fafd410dde0 con 0x7fafd40fb430 2024-09-10T10:12:38.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.038+0000 7fafca7fc640 1 -- 172.21.15.71:0/2984524039 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fafd007a7f0 con 0x7fafd40fb430 2024-09-10T10:12:38.040 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:12:38.040 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:12:38.040 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:12:38.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T10:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T10:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 14 2024-09-10T10:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:12:38.041 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:12:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.040+0000 7fafdbb09640 1 -- 172.21.15.71:0/2984524039 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fafc006e0b0 msgr2=0x7fafc0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.040+0000 7fafdbb09640 1 --2- 172.21.15.71:0/2984524039 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fafc006e0b0 0x7fafc0070560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fafc4007fd0 tx=0x7fafc4009e90 comp rx=0 tx=0).stop 2024-09-10T10:12:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.040+0000 7fafdbb09640 1 -- 172.21.15.71:0/2984524039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafd40fb430 msgr2=0x7fafd410bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.040+0000 7fafdbb09640 1 --2- 172.21.15.71:0/2984524039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafd40fb430 0x7fafd410bf80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fafd00043d0 tx=0x7fafd0009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.040+0000 7fafdbb09640 1 -- 172.21.15.71:0/2984524039 shutdown_connections 2024-09-10T10:12:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.040+0000 7fafdbb09640 1 --2- 172.21.15.71:0/2984524039 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fafc006e0b0 0x7fafc0070560 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.040+0000 7fafdbb09640 1 --2- 172.21.15.71:0/2984524039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fafd40fc700 0x7fafd410c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.040+0000 7fafdbb09640 1 --2- 172.21.15.71:0/2984524039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafd40fb430 0x7fafd410bf80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.040+0000 7fafdbb09640 1 -- 172.21.15.71:0/2984524039 >> 172.21.15.71:0/2984524039 conn(0x7fafd40f6c10 msgr2=0x7fafd40f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.040+0000 7fafdbb09640 1 -- 172.21.15.71:0/2984524039 shutdown_connections 2024-09-10T10:12:38.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.040+0000 7fafdbb09640 1 -- 172.21.15.71:0/2984524039 wait complete. 2024-09-10T10:12:38.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.120+0000 7f53cac4a640 1 -- 172.21.15.71:0/1510235516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c40fd810 msgr2=0x7f53c40fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.120+0000 7f53cac4a640 1 --2- 172.21.15.71:0/1510235516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c40fd810 0x7f53c40fdc80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009c50 tx=0x7f53ac004d10 comp rx=0 tx=0).stop 2024-09-10T10:12:38.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.120+0000 7f53cac4a640 1 -- 172.21.15.71:0/1510235516 shutdown_connections 2024-09-10T10:12:38.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.120+0000 7f53cac4a640 1 --2- 172.21.15.71:0/1510235516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c40fd810 0x7f53c40fdc80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.120+0000 7f53cac4a640 1 --2- 172.21.15.71:0/1510235516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c40fc540 0x7f53c40fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.120+0000 7f53cac4a640 1 -- 172.21.15.71:0/1510235516 >> 172.21.15.71:0/1510235516 conn(0x7f53c40f7ce0 msgr2=0x7f53c40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:38.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.120+0000 7f53cac4a640 1 -- 172.21.15.71:0/1510235516 shutdown_connections 2024-09-10T10:12:38.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.120+0000 7f53cac4a640 1 -- 172.21.15.71:0/1510235516 wait complete. 2024-09-10T10:12:38.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.120+0000 7f53cac4a640 1 Processor -- start 2024-09-10T10:12:38.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.121+0000 7f53cac4a640 1 -- start start 2024-09-10T10:12:38.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.121+0000 7f53cac4a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c40fc540 0x7f53c410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:38.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.121+0000 7f53cac4a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c40fd810 0x7f53c410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:38.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.121+0000 7f53cac4a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c410dc20 con 0x7f53c40fd810 2024-09-10T10:12:38.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.121+0000 7f53cac4a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c410e3f0 con 0x7f53c40fc540 2024-09-10T10:12:38.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.121+0000 7f53c3fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c40fd810 0x7f53c410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:38.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.121+0000 7f53c3fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c40fd810 0x7f53c410d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53548/0 (socket says 172.21.15.71:53548) 2024-09-10T10:12:38.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.121+0000 7f53c3fff640 1 -- 172.21.15.71:0/694673225 learned_addr learned my addr 172.21.15.71:0/694673225 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:38.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.121+0000 7f53c89e6640 1 --2- 172.21.15.71:0/694673225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c40fc540 0x7f53c410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:38.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.121+0000 7f53c3fff640 1 -- 172.21.15.71:0/694673225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c40fc540 msgr2=0x7f53c410d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.121+0000 7f53c3fff640 1 --2- 172.21.15.71:0/694673225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c40fc540 0x7f53c410d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.121+0000 7f53c3fff640 1 -- 172.21.15.71:0/694673225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac0098b0 con 0x7f53c40fd810 2024-09-10T10:12:38.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.122+0000 7f53c3fff640 1 --2- 172.21.15.71:0/694673225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c40fd810 0x7f53c410d5d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f53ac004a30 tx=0x7f53ac004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:38.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.122+0000 7f53c17fa640 1 -- 172.21.15.71:0/694673225 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53ac009710 con 0x7f53c40fd810 2024-09-10T10:12:38.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.122+0000 7f53c17fa640 1 -- 172.21.15.71:0/694673225 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f53ac032b10 con 0x7f53c40fd810 2024-09-10T10:12:38.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.122+0000 7f53cac4a640 1 -- 172.21.15.71:0/694673225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c410e620 con 0x7f53c40fd810 2024-09-10T10:12:38.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.122+0000 7f53c17fa640 1 -- 172.21.15.71:0/694673225 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53ac03db10 con 0x7f53c40fd810 2024-09-10T10:12:38.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.122+0000 7f53cac4a640 1 -- 172.21.15.71:0/694673225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c410eb40 con 0x7f53c40fd810 2024-09-10T10:12:38.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.123+0000 7f53cac4a640 1 -- 172.21.15.71:0/694673225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c40fb9a0 con 0x7f53c40fd810 2024-09-10T10:12:38.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.123+0000 7f53c17fa640 1 -- 172.21.15.71:0/694673225 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f53ac02f030 con 0x7f53c40fd810 2024-09-10T10:12:38.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.124+0000 7f53c17fa640 1 --2- 172.21.15.71:0/694673225 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f53b006e0b0 0x7f53b0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:38.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.124+0000 7f53c89e6640 1 --2- 172.21.15.71:0/694673225 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f53b006e0b0 0x7f53b0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:38.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.124+0000 7f53c17fa640 1 -- 172.21.15.71:0/694673225 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f53ac0af1d0 con 0x7f53c40fd810 2024-09-10T10:12:38.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.124+0000 7f53c89e6640 1 --2- 172.21.15.71:0/694673225 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f53b006e0b0 0x7f53b0070560 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009fd0 tx=0x7f53b400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:38.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.128+0000 7f53c17fa640 1 -- 172.21.15.71:0/694673225 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f53ac078520 con 0x7f53c40fd810 2024-09-10T10:12:38.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.342+0000 7f53cac4a640 1 -- 172.21.15.71:0/694673225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f53c410edf0 con 0x7f53c40fd810 2024-09-10T10:12:38.344 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:38 smithi071 ceph-mon[90773]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:38.344 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:38 smithi071 ceph-mon[90773]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:38.344 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:38 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2984524039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:38.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.343+0000 7f53c17fa640 1 -- 172.21.15.71:0/694673225 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+2006 (secure 0 0 0) 0x7f53ac07bbe0 con 0x7f53c40fd810 2024-09-10T10:12:38.345 INFO:teuthology.orchestra.run.smithi071.stdout:e44 2024-09-10T10:12:38.345 INFO:teuthology.orchestra.run.smithi071.stdout:btime 2024-09-10T10:12:17:347805+0000 2024-09-10T10:12:38.345 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:12:38.345 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:12:38.345 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:12:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:12:38.345 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 44 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:12:17.347793+0000 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:12:38.346 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 81 2024-09-10T10:12:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T10:12:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:12:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:12:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=34416,1=34432} 2024-09-10T10:12:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:12:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:12:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:12:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:12:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:12:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:12:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:12:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:12:38.347 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:12:38.348 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 34416 members: 34432,34416 2024-09-10T10:12:38.348 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:34416} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.71:6826/1701579524,v1:172.21.15.71:6827/1701579524] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:12:38.348 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{0:44373} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.107:6824/1627286097,v1:172.21.15.107:6825/1627286097] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:12:38.348 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{1:34432} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.71:6828/1608732243,v1:172.21.15.71:6829/1608732243] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:12:38.348 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:44397} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2279749952,v1:172.21.15.107:6827/2279749952] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:12:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:12:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:12:38.349 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 44 2024-09-10T10:12:38.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.345+0000 7f53cac4a640 1 -- 172.21.15.71:0/694673225 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f53b006e0b0 msgr2=0x7f53b0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.345+0000 7f53cac4a640 1 --2- 172.21.15.71:0/694673225 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f53b006e0b0 0x7f53b0070560 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009fd0 tx=0x7f53b400b040 comp rx=0 tx=0).stop 2024-09-10T10:12:38.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.345+0000 7f53cac4a640 1 -- 172.21.15.71:0/694673225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c40fd810 msgr2=0x7f53c410d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.345+0000 7f53cac4a640 1 --2- 172.21.15.71:0/694673225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c40fd810 0x7f53c410d5d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f53ac004a30 tx=0x7f53ac004d10 comp rx=0 tx=0).stop 2024-09-10T10:12:38.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.345+0000 7f53cac4a640 1 -- 172.21.15.71:0/694673225 shutdown_connections 2024-09-10T10:12:38.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.345+0000 7f53cac4a640 1 --2- 172.21.15.71:0/694673225 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f53b006e0b0 0x7f53b0070560 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.345+0000 7f53cac4a640 1 --2- 172.21.15.71:0/694673225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53c40fd810 0x7f53c410d5d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.345+0000 7f53cac4a640 1 --2- 172.21.15.71:0/694673225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c40fc540 0x7f53c410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.345+0000 7f53cac4a640 1 -- 172.21.15.71:0/694673225 >> 172.21.15.71:0/694673225 conn(0x7f53c40f7ce0 msgr2=0x7f53c40f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:38.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.345+0000 7f53cac4a640 1 -- 172.21.15.71:0/694673225 shutdown_connections 2024-09-10T10:12:38.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.345+0000 7f53cac4a640 1 -- 172.21.15.71:0/694673225 wait complete. 2024-09-10T10:12:38.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:38 smithi107 ceph-mon[79396]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:38.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:38 smithi107 ceph-mon[79396]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:38.396 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:38 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2984524039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:38.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.425+0000 7fb062ebf640 1 -- 172.21.15.71:0/3668656762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb05c066710 msgr2=0x7fb05c0ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.425+0000 7fb062ebf640 1 --2- 172.21.15.71:0/3668656762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb05c066710 0x7fb05c0ff160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb0500048d0 tx=0x7fb050009da0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.425+0000 7fb062ebf640 1 -- 172.21.15.71:0/3668656762 shutdown_connections 2024-09-10T10:12:38.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.425+0000 7fb062ebf640 1 --2- 172.21.15.71:0/3668656762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb05c0ff6a0 0x7fb05c101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.425+0000 7fb062ebf640 1 --2- 172.21.15.71:0/3668656762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb05c066710 0x7fb05c0ff160 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.425+0000 7fb062ebf640 1 -- 172.21.15.71:0/3668656762 >> 172.21.15.71:0/3668656762 conn(0x7fb05c0f6c10 msgr2=0x7fb05c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:38.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.425+0000 7fb062ebf640 1 -- 172.21.15.71:0/3668656762 shutdown_connections 2024-09-10T10:12:38.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.425+0000 7fb062ebf640 1 -- 172.21.15.71:0/3668656762 wait complete. 2024-09-10T10:12:38.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.426+0000 7fb062ebf640 1 Processor -- start 2024-09-10T10:12:38.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.426+0000 7fb062ebf640 1 -- start start 2024-09-10T10:12:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.426+0000 7fb062ebf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb05c066710 0x7fb05c10d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.426+0000 7fb062ebf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb05c0ff6a0 0x7fb05c10d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.426+0000 7fb062ebf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c10dd00 con 0x7fb05c0ff6a0 2024-09-10T10:12:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.426+0000 7fb062ebf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c10e4d0 con 0x7fb05c066710 2024-09-10T10:12:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.426+0000 7fb05bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb05c0ff6a0 0x7fb05c10d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.426+0000 7fb05bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb05c0ff6a0 0x7fb05c10d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53564/0 (socket says 172.21.15.71:53564) 2024-09-10T10:12:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.426+0000 7fb05bfff640 1 -- 172.21.15.71:0/2279891166 learned_addr learned my addr 172.21.15.71:0/2279891166 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.426+0000 7fb060c5b640 1 --2- 172.21.15.71:0/2279891166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb05c066710 0x7fb05c10d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.427+0000 7fb05bfff640 1 -- 172.21.15.71:0/2279891166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb05c066710 msgr2=0x7fb05c10d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.427+0000 7fb05bfff640 1 --2- 172.21.15.71:0/2279891166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb05c066710 0x7fb05c10d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.427+0000 7fb05bfff640 1 -- 172.21.15.71:0/2279891166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050005040 con 0x7fb05c0ff6a0 2024-09-10T10:12:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.427+0000 7fb05bfff640 1 --2- 172.21.15.71:0/2279891166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb05c0ff6a0 0x7fb05c10d6b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb048002a50 tx=0x7fb048004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.427+0000 7fb0597fa640 1 -- 172.21.15.71:0/2279891166 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb048007c30 con 0x7fb05c0ff6a0 2024-09-10T10:12:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.427+0000 7fb062ebf640 1 -- 172.21.15.71:0/2279891166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05c10e760 con 0x7fb05c0ff6a0 2024-09-10T10:12:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.427+0000 7fb0597fa640 1 -- 172.21.15.71:0/2279891166 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb04800f040 con 0x7fb05c0ff6a0 2024-09-10T10:12:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.427+0000 7fb0597fa640 1 -- 172.21.15.71:0/2279891166 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb04800db50 con 0x7fb05c0ff6a0 2024-09-10T10:12:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.427+0000 7fb062ebf640 1 -- 172.21.15.71:0/2279891166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05c10ed00 con 0x7fb05c0ff6a0 2024-09-10T10:12:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.428+0000 7fb062ebf640 1 -- 172.21.15.71:0/2279891166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05c0fa8b0 con 0x7fb05c0ff6a0 2024-09-10T10:12:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.429+0000 7fb0597fa640 1 -- 172.21.15.71:0/2279891166 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb04800dcb0 con 0x7fb05c0ff6a0 2024-09-10T10:12:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.429+0000 7fb0597fa640 1 --2- 172.21.15.71:0/2279891166 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb04c06e0b0 0x7fb04c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.429+0000 7fb060c5b640 1 --2- 172.21.15.71:0/2279891166 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb04c06e0b0 0x7fb04c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.429+0000 7fb0597fa640 1 -- 172.21.15.71:0/2279891166 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb04808dbb0 con 0x7fb05c0ff6a0 2024-09-10T10:12:38.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.430+0000 7fb060c5b640 1 --2- 172.21.15.71:0/2279891166 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb04c06e0b0 0x7fb04c070560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb050007ac0 tx=0x7fb050035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:38.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.434+0000 7fb0597fa640 1 -- 172.21.15.71:0/2279891166 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb048094080 con 0x7fb05c0ff6a0 2024-09-10T10:12:38.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.615+0000 7fb062ebf640 1 -- 172.21.15.71:0/2279891166 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb05c10f080 con 0x7fb04c06e0b0 2024-09-10T10:12:38.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.616+0000 7fb0597fa640 1 -- 172.21.15.71:0/2279891166 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7fb05c10f080 con 0x7fb04c06e0b0 2024-09-10T10:12:38.618 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:12:38.618 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:12:38.618 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:12:38.618 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:12:38.618 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:12:38.618 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-10T10:12:38.618 INFO:teuthology.orchestra.run.smithi071.stdout: "osd", 2024-09-10T10:12:38.618 INFO:teuthology.orchestra.run.smithi071.stdout: "mds", 2024-09-10T10:12:38.618 INFO:teuthology.orchestra.run.smithi071.stdout: "mon", 2024-09-10T10:12:38.618 INFO:teuthology.orchestra.run.smithi071.stdout: "crash" 2024-09-10T10:12:38.618 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:12:38.618 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "16/21 daemons upgraded", 2024-09-10T10:12:38.618 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-10T10:12:38.619 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:12:38.619 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:12:38.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.618+0000 7fb062ebf640 1 -- 172.21.15.71:0/2279891166 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb04c06e0b0 msgr2=0x7fb04c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.618+0000 7fb062ebf640 1 --2- 172.21.15.71:0/2279891166 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb04c06e0b0 0x7fb04c070560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb050007ac0 tx=0x7fb050035040 comp rx=0 tx=0).stop 2024-09-10T10:12:38.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.618+0000 7fb062ebf640 1 -- 172.21.15.71:0/2279891166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb05c0ff6a0 msgr2=0x7fb05c10d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.618+0000 7fb062ebf640 1 --2- 172.21.15.71:0/2279891166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb05c0ff6a0 0x7fb05c10d6b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb048002a50 tx=0x7fb048004600 comp rx=0 tx=0).stop 2024-09-10T10:12:38.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.619+0000 7fb062ebf640 1 -- 172.21.15.71:0/2279891166 shutdown_connections 2024-09-10T10:12:38.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.619+0000 7fb062ebf640 1 --2- 172.21.15.71:0/2279891166 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb04c06e0b0 0x7fb04c070560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.619+0000 7fb062ebf640 1 --2- 172.21.15.71:0/2279891166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb05c0ff6a0 0x7fb05c10d6b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.619+0000 7fb062ebf640 1 --2- 172.21.15.71:0/2279891166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb05c066710 0x7fb05c10d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.619+0000 7fb062ebf640 1 -- 172.21.15.71:0/2279891166 >> 172.21.15.71:0/2279891166 conn(0x7fb05c0f6c10 msgr2=0x7fb05c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:38.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.619+0000 7fb062ebf640 1 -- 172.21.15.71:0/2279891166 shutdown_connections 2024-09-10T10:12:38.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.619+0000 7fb062ebf640 1 -- 172.21.15.71:0/2279891166 wait complete. 2024-09-10T10:12:38.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.697+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/2696588428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5cc0fc720 msgr2=0x7fb5cc0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.697+0000 7fb5d2b6f640 1 --2- 172.21.15.71:0/2696588428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5cc0fc720 0x7fb5cc0fcb90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009c50 tx=0x7fb5bc004d10 comp rx=0 tx=0).stop 2024-09-10T10:12:38.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.698+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/2696588428 shutdown_connections 2024-09-10T10:12:38.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.698+0000 7fb5d2b6f640 1 --2- 172.21.15.71:0/2696588428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5cc0fc720 0x7fb5cc0fcb90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.698+0000 7fb5d2b6f640 1 --2- 172.21.15.71:0/2696588428 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc0fb450 0x7fb5cc0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.698+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/2696588428 >> 172.21.15.71:0/2696588428 conn(0x7fb5cc0f6c10 msgr2=0x7fb5cc0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:38.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.698+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/2696588428 shutdown_connections 2024-09-10T10:12:38.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.698+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/2696588428 wait complete. 2024-09-10T10:12:38.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.698+0000 7fb5d2b6f640 1 Processor -- start 2024-09-10T10:12:38.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.698+0000 7fb5d2b6f640 1 -- start start 2024-09-10T10:12:38.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.698+0000 7fb5d2b6f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc0fb450 0x7fb5cc10d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:38.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.698+0000 7fb5d2b6f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5cc0fc720 0x7fb5cc10d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:38.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.698+0000 7fb5d2b6f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc10e4e0 con 0x7fb5cc0fc720 2024-09-10T10:12:38.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.698+0000 7fb5d2b6f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc10e650 con 0x7fb5cc0fb450 2024-09-10T10:12:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5cbfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5cc0fc720 0x7fb5cc10d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5cbfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5cc0fc720 0x7fb5cc10d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53580/0 (socket says 172.21.15.71:53580) 2024-09-10T10:12:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5cbfff640 1 -- 172.21.15.71:0/1454063122 learned_addr learned my addr 172.21.15.71:0/1454063122 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:12:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5d090b640 1 --2- 172.21.15.71:0/1454063122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc0fb450 0x7fb5cc10d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5cbfff640 1 -- 172.21.15.71:0/1454063122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc0fb450 msgr2=0x7fb5cc10d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5cbfff640 1 --2- 172.21.15.71:0/1454063122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc0fb450 0x7fb5cc10d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5cbfff640 1 -- 172.21.15.71:0/1454063122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc0098b0 con 0x7fb5cc0fc720 2024-09-10T10:12:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5d090b640 1 --2- 172.21.15.71:0/1454063122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc0fb450 0x7fb5cc10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:12:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5cbfff640 1 --2- 172.21.15.71:0/1454063122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5cc0fc720 0x7fb5cc10d670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc004a30 tx=0x7fb5bc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5c97fa640 1 -- 172.21.15.71:0/1454063122 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5bc032850 con 0x7fb5cc0fc720 2024-09-10T10:12:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5c97fa640 1 -- 172.21.15.71:0/1454063122 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb5bc009710 con 0x7fb5cc0fc720 2024-09-10T10:12:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/1454063122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5cc10e8d0 con 0x7fb5cc0fc720 2024-09-10T10:12:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5c97fa640 1 -- 172.21.15.71:0/1454063122 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5bc03dc20 con 0x7fb5cc0fc720 2024-09-10T10:12:38.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.699+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/1454063122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5cc10edf0 con 0x7fb5cc0fc720 2024-09-10T10:12:38.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.701+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/1454063122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc0fa8b0 con 0x7fb5cc0fc720 2024-09-10T10:12:38.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.701+0000 7fb5c97fa640 1 -- 172.21.15.71:0/1454063122 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb5bc02f030 con 0x7fb5cc0fc720 2024-09-10T10:12:38.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.701+0000 7fb5c97fa640 1 --2- 172.21.15.71:0/1454063122 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb5b806e0b0 0x7fb5b8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:38.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.701+0000 7fb5c97fa640 1 -- 172.21.15.71:0/1454063122 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb5bc0af340 con 0x7fb5cc0fc720 2024-09-10T10:12:38.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.701+0000 7fb5d090b640 1 --2- 172.21.15.71:0/1454063122 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb5b806e0b0 0x7fb5b8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:38.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.702+0000 7fb5d090b640 1 --2- 172.21.15.71:0/1454063122 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb5b806e0b0 0x7fb5b8070560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4006fd0 tx=0x7fb5c4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:38.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.706+0000 7fb5c97fa640 1 -- 172.21.15.71:0/1454063122 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb5bc078610 con 0x7fb5cc0fc720 2024-09-10T10:12:38.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.937+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/1454063122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb5cc04b720 con 0x7fb5cc0fc720 2024-09-10T10:12:38.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.938+0000 7fb5c97fa640 1 -- 172.21.15.71:0/1454063122 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb5bc03d4b0 con 0x7fb5cc0fc720 2024-09-10T10:12:38.941 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:12:38.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.940+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/1454063122 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb5b806e0b0 msgr2=0x7fb5b8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.940+0000 7fb5d2b6f640 1 --2- 172.21.15.71:0/1454063122 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb5b806e0b0 0x7fb5b8070560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4006fd0 tx=0x7fb5c4008040 comp rx=0 tx=0).stop 2024-09-10T10:12:38.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.940+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/1454063122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5cc0fc720 msgr2=0x7fb5cc10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:38.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.940+0000 7fb5d2b6f640 1 --2- 172.21.15.71:0/1454063122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5cc0fc720 0x7fb5cc10d670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc004a30 tx=0x7fb5bc004d10 comp rx=0 tx=0).stop 2024-09-10T10:12:38.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.941+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/1454063122 shutdown_connections 2024-09-10T10:12:38.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.941+0000 7fb5d2b6f640 1 --2- 172.21.15.71:0/1454063122 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb5b806e0b0 0x7fb5b8070560 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.941+0000 7fb5d2b6f640 1 --2- 172.21.15.71:0/1454063122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5cc0fc720 0x7fb5cc10d670 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.941+0000 7fb5d2b6f640 1 --2- 172.21.15.71:0/1454063122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5cc0fb450 0x7fb5cc10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:38.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.941+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/1454063122 >> 172.21.15.71:0/1454063122 conn(0x7fb5cc0f6c10 msgr2=0x7fb5cc0660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:38.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.941+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/1454063122 shutdown_connections 2024-09-10T10:12:38.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:12:38.941+0000 7fb5d2b6f640 1 -- 172.21.15.71:0/1454063122 wait complete. 2024-09-10T10:12:39.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:39 smithi071 ceph-mon[90773]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:39.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:39 smithi071 ceph-mon[90773]: pgmap v225: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:12:39.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:39 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/694673225' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:12:39.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:39 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/1454063122' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:12:39.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:12:39.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:39 smithi107 ceph-mon[79396]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:39.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:39 smithi107 ceph-mon[79396]: pgmap v225: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:12:39.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:39 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/694673225' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:12:39.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:39 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/1454063122' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:12:39.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:12:40.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:40 smithi071 ceph-mon[90773]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:40.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:40 smithi107 ceph-mon[79396]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:12:41.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:41 smithi071 ceph-mon[90773]: pgmap v226: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:12:41.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:41 smithi107 ceph-mon[79396]: pgmap v226: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:12:42.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:42 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:42.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:42 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:42.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:42 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:42.704 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:42 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:42.704 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:42 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:42.704 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:42 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:43.625 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:43 smithi071 ceph-mon[90773]: pgmap v227: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:12:43.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:43 smithi107 ceph-mon[79396]: pgmap v227: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:12:45.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:45 smithi107 ceph-mon[79396]: pgmap v228: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:12:45.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:45 smithi071 ceph-mon[90773]: pgmap v228: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:12:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:46 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:46 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:46 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:46 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:46.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:46 smithi071 ceph-mon[90773]: pgmap v229: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:12:46.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:46 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:46.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:46 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:46.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:46 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:46.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:46 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:46.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:46 smithi107 ceph-mon[79396]: pgmap v229: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:12:49.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:49 smithi071 ceph-mon[90773]: pgmap v230: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:12:49.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:49 smithi107 ceph-mon[79396]: pgmap v230: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:12:50.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:50.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:50.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:12:50.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:12:50.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:50.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T10:12:50.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T10:12:50.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:50.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:50 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:50.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:50.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:12:50.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:12:50.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:50.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T10:12:50.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T10:12:50.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:50.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:50.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:50 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:12:51.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:51 smithi071 ceph-mon[90773]: pgmap v231: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:12:51.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:51 smithi107 ceph-mon[79396]: pgmap v231: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:12:52.487 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:52 smithi071 ceph-mon[90773]: Upgrade: Updating alertmanager.smithi071 2024-09-10T10:12:52.488 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:52 smithi071 ceph-mon[90773]: Deploying daemon alertmanager.smithi071 on smithi071 2024-09-10T10:12:52.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:52 smithi107 ceph-mon[79396]: Upgrade: Updating alertmanager.smithi071 2024-09-10T10:12:52.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:52 smithi107 ceph-mon[79396]: Deploying daemon alertmanager.smithi071 on smithi071 2024-09-10T10:12:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:53 smithi107 ceph-mon[79396]: pgmap v232: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:12:53.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:53 smithi071 ceph-mon[90773]: pgmap v232: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:12:54.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:12:54.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:12:55.424 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:55 smithi071 ceph-mon[90773]: pgmap v233: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:12:55.811 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:55 smithi107 ceph-mon[79396]: pgmap v233: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:12:57.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:57 smithi107 ceph-mon[79396]: pgmap v234: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:12:57.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:57.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:57.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:57 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:57.723 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:57 smithi071 ceph-mon[90773]: pgmap v234: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:12:57.724 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:57.724 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:12:57.724 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:57 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:59.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:12:59 smithi071 ceph-mon[90773]: pgmap v235: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:12:59.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:12:59 smithi107 ceph-mon[79396]: pgmap v235: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:01.665 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:01 smithi071 ceph-mon[90773]: pgmap v236: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:01.665 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:01.665 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:01.665 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:01.665 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:01 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:01.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:01 smithi107 ceph-mon[79396]: pgmap v236: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:01.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:01.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:01.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:01.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:01 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:03.741 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:03 smithi071 ceph-mon[90773]: pgmap v237: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:03.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:03 smithi107 ceph-mon[79396]: pgmap v237: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: pgmap v238: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:13:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:13:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:13:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T10:13:05.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:13:05.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.791 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:05 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: pgmap v238: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:13:05.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:05.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:05.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:13:05.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:13:05.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:05.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.898 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:05.898 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:05 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:06.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:06 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T10:13:06.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:06 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T10:13:07.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:07 smithi071 ceph-mon[90773]: Upgrade: Updating grafana.smithi071 2024-09-10T10:13:07.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:07 smithi071 ceph-mon[90773]: Deploying daemon grafana.smithi071 on smithi071 2024-09-10T10:13:07.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:07 smithi071 ceph-mon[90773]: pgmap v239: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:07.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:07 smithi107 ceph-mon[79396]: Upgrade: Updating grafana.smithi071 2024-09-10T10:13:07.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:07 smithi107 ceph-mon[79396]: Deploying daemon grafana.smithi071 on smithi071 2024-09-10T10:13:07.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:07 smithi107 ceph-mon[79396]: pgmap v239: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:09.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.049+0000 7f47796f7640 1 -- 172.21.15.71:0/958289617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47740fc700 msgr2=0x7f47740fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.049+0000 7f47796f7640 1 --2- 172.21.15.71:0/958289617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47740fc700 0x7f47740fcb70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f47680048d0 tx=0x7f4768009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.049+0000 7f47796f7640 1 -- 172.21.15.71:0/958289617 shutdown_connections 2024-09-10T10:13:09.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.049+0000 7f47796f7640 1 --2- 172.21.15.71:0/958289617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47740fc700 0x7f47740fcb70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.049+0000 7f47796f7640 1 --2- 172.21.15.71:0/958289617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47740fb430 0x7f47740fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.049+0000 7f47796f7640 1 -- 172.21.15.71:0/958289617 >> 172.21.15.71:0/958289617 conn(0x7f47740f6c10 msgr2=0x7f47740f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:09.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.049+0000 7f47796f7640 1 -- 172.21.15.71:0/958289617 shutdown_connections 2024-09-10T10:13:09.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.049+0000 7f47796f7640 1 -- 172.21.15.71:0/958289617 wait complete. 2024-09-10T10:13:09.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.051+0000 7f47796f7640 1 Processor -- start 2024-09-10T10:13:09.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.051+0000 7f47796f7640 1 -- start start 2024-09-10T10:13:09.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.051+0000 7f47796f7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47740fb430 0x7f477410fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.051+0000 7f47796f7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47740fc700 0x7f47741122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.051+0000 7f47796f7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774065c80 con 0x7f47740fb430 2024-09-10T10:13:09.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.051+0000 7f47796f7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774065df0 con 0x7f47740fc700 2024-09-10T10:13:09.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.051+0000 7f4772ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47740fb430 0x7f477410fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.051+0000 7f47727fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47740fc700 0x7f47741122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.051+0000 7f4772ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47740fb430 0x7f477410fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51944/0 (socket says 172.21.15.71:51944) 2024-09-10T10:13:09.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.051+0000 7f4772ffd640 1 -- 172.21.15.71:0/640442658 learned_addr learned my addr 172.21.15.71:0/640442658 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:13:09.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.052+0000 7f47727fc640 1 -- 172.21.15.71:0/640442658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47740fb430 msgr2=0x7f477410fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.052+0000 7f47727fc640 1 --2- 172.21.15.71:0/640442658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47740fb430 0x7f477410fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.052+0000 7f47727fc640 1 -- 172.21.15.71:0/640442658 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4768005040 con 0x7f47740fc700 2024-09-10T10:13:09.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.052+0000 7f4772ffd640 1 --2- 172.21.15.71:0/640442658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47740fb430 0x7f477410fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:09.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.052+0000 7f47727fc640 1 --2- 172.21.15.71:0/640442658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47740fc700 0x7f47741122f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f47680043d0 tx=0x7f4768009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.052+0000 7f475b7fe640 1 -- 172.21.15.71:0/640442658 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4768038070 con 0x7f47740fc700 2024-09-10T10:13:09.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.053+0000 7f475b7fe640 1 -- 172.21.15.71:0/640442658 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f476802ae90 con 0x7f47740fc700 2024-09-10T10:13:09.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.053+0000 7f475b7fe640 1 -- 172.21.15.71:0/640442658 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4768033660 con 0x7f47740fc700 2024-09-10T10:13:09.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.053+0000 7f47796f7640 1 -- 172.21.15.71:0/640442658 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4774112830 con 0x7f47740fc700 2024-09-10T10:13:09.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.053+0000 7f47796f7640 1 -- 172.21.15.71:0/640442658 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4774112dd0 con 0x7f47740fc700 2024-09-10T10:13:09.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.054+0000 7f47796f7640 1 -- 172.21.15.71:0/640442658 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47740fa890 con 0x7f47740fc700 2024-09-10T10:13:09.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.055+0000 7f475b7fe640 1 -- 172.21.15.71:0/640442658 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4768030020 con 0x7f47740fc700 2024-09-10T10:13:09.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.055+0000 7f475b7fe640 1 --2- 172.21.15.71:0/640442658 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f475c06e170 0x7f475c070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.055+0000 7f4772ffd640 1 --2- 172.21.15.71:0/640442658 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f475c06e170 0x7f475c070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.055+0000 7f475b7fe640 1 -- 172.21.15.71:0/640442658 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f47680adc20 con 0x7f47740fc700 2024-09-10T10:13:09.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.056+0000 7f4772ffd640 1 --2- 172.21.15.71:0/640442658 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f475c06e170 0x7f475c070620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4774065970 tx=0x7f476400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.060+0000 7f475b7fe640 1 -- 172.21.15.71:0/640442658 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4768077000 con 0x7f47740fc700 2024-09-10T10:13:09.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.250+0000 7f47796f7640 1 -- 172.21.15.71:0/640442658 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4774100b10 con 0x7f475c06e170 2024-09-10T10:13:09.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.252+0000 7f475b7fe640 1 -- 172.21.15.71:0/640442658 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f4774100b10 con 0x7f475c06e170 2024-09-10T10:13:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.254+0000 7f47796f7640 1 -- 172.21.15.71:0/640442658 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f475c06e170 msgr2=0x7f475c070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.254+0000 7f47796f7640 1 --2- 172.21.15.71:0/640442658 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f475c06e170 0x7f475c070620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4774065970 tx=0x7f476400b040 comp rx=0 tx=0).stop 2024-09-10T10:13:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.254+0000 7f47796f7640 1 -- 172.21.15.71:0/640442658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47740fc700 msgr2=0x7f47741122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.254+0000 7f47796f7640 1 --2- 172.21.15.71:0/640442658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47740fc700 0x7f47741122f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f47680043d0 tx=0x7f4768009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.254+0000 7f47796f7640 1 -- 172.21.15.71:0/640442658 shutdown_connections 2024-09-10T10:13:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.254+0000 7f47796f7640 1 --2- 172.21.15.71:0/640442658 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f475c06e170 0x7f475c070620 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.254+0000 7f47796f7640 1 --2- 172.21.15.71:0/640442658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47740fc700 0x7f47741122f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.254+0000 7f47796f7640 1 --2- 172.21.15.71:0/640442658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47740fb430 0x7f477410fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.254+0000 7f47796f7640 1 -- 172.21.15.71:0/640442658 >> 172.21.15.71:0/640442658 conn(0x7f47740f6c10 msgr2=0x7f47740f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:09.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.254+0000 7f47796f7640 1 -- 172.21.15.71:0/640442658 shutdown_connections 2024-09-10T10:13:09.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.254+0000 7f47796f7640 1 -- 172.21.15.71:0/640442658 wait complete. 2024-09-10T10:13:09.264 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:13:09.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.338+0000 7f9b35bc9640 1 -- 172.21.15.71:0/2441984792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300fc700 msgr2=0x7f9b300fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.338+0000 7f9b35bc9640 1 --2- 172.21.15.71:0/2441984792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300fc700 0x7f9b300fcb70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9b240048d0 tx=0x7f9b24009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.338+0000 7f9b35bc9640 1 -- 172.21.15.71:0/2441984792 shutdown_connections 2024-09-10T10:13:09.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.338+0000 7f9b35bc9640 1 --2- 172.21.15.71:0/2441984792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300fc700 0x7f9b300fcb70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.338+0000 7f9b35bc9640 1 --2- 172.21.15.71:0/2441984792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b300fb430 0x7f9b300fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.338+0000 7f9b35bc9640 1 -- 172.21.15.71:0/2441984792 >> 172.21.15.71:0/2441984792 conn(0x7f9b300f6c10 msgr2=0x7f9b300f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:09.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.338+0000 7f9b35bc9640 1 -- 172.21.15.71:0/2441984792 shutdown_connections 2024-09-10T10:13:09.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.338+0000 7f9b35bc9640 1 -- 172.21.15.71:0/2441984792 wait complete. 2024-09-10T10:13:09.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.338+0000 7f9b35bc9640 1 Processor -- start 2024-09-10T10:13:09.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.339+0000 7f9b35bc9640 1 -- start start 2024-09-10T10:13:09.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.339+0000 7f9b35bc9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b300fb430 0x7f9b3010bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.339+0000 7f9b35bc9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300fc700 0x7f9b3010c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.339+0000 7f9b35bc9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3010cad0 con 0x7f9b300fc700 2024-09-10T10:13:09.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.339+0000 7f9b35bc9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3010d2f0 con 0x7f9b300fb430 2024-09-10T10:13:09.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.339+0000 7f9b2effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300fc700 0x7f9b3010c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.339+0000 7f9b2effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300fc700 0x7f9b3010c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51964/0 (socket says 172.21.15.71:51964) 2024-09-10T10:13:09.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.339+0000 7f9b2effd640 1 -- 172.21.15.71:0/3145732926 learned_addr learned my addr 172.21.15.71:0/3145732926 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:13:09.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.339+0000 7f9b2f7fe640 1 --2- 172.21.15.71:0/3145732926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b300fb430 0x7f9b3010bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.339+0000 7f9b2effd640 1 -- 172.21.15.71:0/3145732926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b300fb430 msgr2=0x7f9b3010bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.339+0000 7f9b2effd640 1 --2- 172.21.15.71:0/3145732926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b300fb430 0x7f9b3010bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.339+0000 7f9b2effd640 1 -- 172.21.15.71:0/3145732926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b24005040 con 0x7f9b300fc700 2024-09-10T10:13:09.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.340+0000 7f9b2effd640 1 --2- 172.21.15.71:0/3145732926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300fc700 0x7f9b3010c480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9b240048a0 tx=0x7f9b24009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.340+0000 7f9b17fff640 1 -- 172.21.15.71:0/3145732926 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b2403a070 con 0x7f9b300fc700 2024-09-10T10:13:09.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.340+0000 7f9b17fff640 1 -- 172.21.15.71:0/3145732926 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9b240338c0 con 0x7f9b300fc700 2024-09-10T10:13:09.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.340+0000 7f9b17fff640 1 -- 172.21.15.71:0/3145732926 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b2403e930 con 0x7f9b300fc700 2024-09-10T10:13:09.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.340+0000 7f9b35bc9640 1 -- 172.21.15.71:0/3145732926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3010d520 con 0x7f9b300fc700 2024-09-10T10:13:09.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.340+0000 7f9b35bc9640 1 -- 172.21.15.71:0/3145732926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3010da60 con 0x7f9b300fc700 2024-09-10T10:13:09.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.341+0000 7f9b35bc9640 1 -- 172.21.15.71:0/3145732926 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b300fa890 con 0x7f9b300fc700 2024-09-10T10:13:09.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.341+0000 7f9b17fff640 1 -- 172.21.15.71:0/3145732926 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9b24030020 con 0x7f9b300fc700 2024-09-10T10:13:09.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.342+0000 7f9b17fff640 1 --2- 172.21.15.71:0/3145732926 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9b1806e0b0 0x7f9b18070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.342+0000 7f9b17fff640 1 -- 172.21.15.71:0/3145732926 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f9b240afb80 con 0x7f9b300fc700 2024-09-10T10:13:09.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.342+0000 7f9b2f7fe640 1 --2- 172.21.15.71:0/3145732926 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9b1806e0b0 0x7f9b18070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.342+0000 7f9b2f7fe640 1 --2- 172.21.15.71:0/3145732926 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9b1806e0b0 0x7f9b18070560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b20004eb0 tx=0x7f9b2000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.347+0000 7f9b17fff640 1 -- 172.21.15.71:0/3145732926 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9b24078f80 con 0x7f9b300fc700 2024-09-10T10:13:09.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.541+0000 7f9b35bc9640 1 -- 172.21.15.71:0/3145732926 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b3010de00 con 0x7f9b1806e0b0 2024-09-10T10:13:09.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.543+0000 7f9b17fff640 1 -- 172.21.15.71:0/3145732926 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f9b3010de00 con 0x7f9b1806e0b0 2024-09-10T10:13:09.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.545+0000 7f9b35bc9640 1 -- 172.21.15.71:0/3145732926 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9b1806e0b0 msgr2=0x7f9b18070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.545+0000 7f9b35bc9640 1 --2- 172.21.15.71:0/3145732926 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9b1806e0b0 0x7f9b18070560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b20004eb0 tx=0x7f9b2000b040 comp rx=0 tx=0).stop 2024-09-10T10:13:09.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.545+0000 7f9b35bc9640 1 -- 172.21.15.71:0/3145732926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300fc700 msgr2=0x7f9b3010c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.545+0000 7f9b35bc9640 1 --2- 172.21.15.71:0/3145732926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300fc700 0x7f9b3010c480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9b240048a0 tx=0x7f9b24009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.545+0000 7f9b35bc9640 1 -- 172.21.15.71:0/3145732926 shutdown_connections 2024-09-10T10:13:09.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.545+0000 7f9b35bc9640 1 --2- 172.21.15.71:0/3145732926 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9b1806e0b0 0x7f9b18070560 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.545+0000 7f9b35bc9640 1 --2- 172.21.15.71:0/3145732926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b300fc700 0x7f9b3010c480 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.545+0000 7f9b35bc9640 1 --2- 172.21.15.71:0/3145732926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b300fb430 0x7f9b3010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.545+0000 7f9b35bc9640 1 -- 172.21.15.71:0/3145732926 >> 172.21.15.71:0/3145732926 conn(0x7f9b300f6c10 msgr2=0x7f9b300f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:09.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.545+0000 7f9b35bc9640 1 -- 172.21.15.71:0/3145732926 shutdown_connections 2024-09-10T10:13:09.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.545+0000 7f9b35bc9640 1 -- 172.21.15.71:0/3145732926 wait complete. 2024-09-10T10:13:09.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.632+0000 7f022fad4640 1 -- 172.21.15.71:0/1413395355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0228065bc0 msgr2=0x7f02280ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.632+0000 7f022fad4640 1 --2- 172.21.15.71:0/1413395355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0228065bc0 0x7f02280ff1c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02240048d0 tx=0x7f0224009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.632+0000 7f022fad4640 1 -- 172.21.15.71:0/1413395355 shutdown_connections 2024-09-10T10:13:09.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.632+0000 7f022fad4640 1 --2- 172.21.15.71:0/1413395355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02280ff700 0x7f0228101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.632+0000 7f022fad4640 1 --2- 172.21.15.71:0/1413395355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0228065bc0 0x7f02280ff1c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.632+0000 7f022fad4640 1 -- 172.21.15.71:0/1413395355 >> 172.21.15.71:0/1413395355 conn(0x7f02280f6c10 msgr2=0x7f02280f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:09.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.632+0000 7f022fad4640 1 -- 172.21.15.71:0/1413395355 shutdown_connections 2024-09-10T10:13:09.635 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:09 smithi071 ceph-mon[90773]: pgmap v240: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:09.635 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:13:09.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.633+0000 7f022fad4640 1 -- 172.21.15.71:0/1413395355 wait complete. 2024-09-10T10:13:09.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.633+0000 7f022fad4640 1 Processor -- start 2024-09-10T10:13:09.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.633+0000 7f022fad4640 1 -- start start 2024-09-10T10:13:09.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.634+0000 7f022fad4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0228065bc0 0x7f02280fcb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.634+0000 7f022fad4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02280ff700 0x7f02280fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.634+0000 7f022fad4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02280fb600 con 0x7f0228065bc0 2024-09-10T10:13:09.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.634+0000 7f022fad4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02280fb740 con 0x7f02280ff700 2024-09-10T10:13:09.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.634+0000 7f022d870640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0228065bc0 0x7f02280fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.634+0000 7f022d870640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0228065bc0 0x7f02280fcb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51982/0 (socket says 172.21.15.71:51982) 2024-09-10T10:13:09.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.634+0000 7f022d870640 1 -- 172.21.15.71:0/2726570947 learned_addr learned my addr 172.21.15.71:0/2726570947 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:13:09.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.634+0000 7f022d06f640 1 --2- 172.21.15.71:0/2726570947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02280ff700 0x7f02280fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.634+0000 7f022d870640 1 -- 172.21.15.71:0/2726570947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02280ff700 msgr2=0x7f02280fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.634+0000 7f022d870640 1 --2- 172.21.15.71:0/2726570947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02280ff700 0x7f02280fb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.634+0000 7f022d870640 1 -- 172.21.15.71:0/2726570947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0224005040 con 0x7f0228065bc0 2024-09-10T10:13:09.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.634+0000 7f022d870640 1 --2- 172.21.15.71:0/2726570947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0228065bc0 0x7f02280fcb80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f022402d040 tx=0x7f0224009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.635+0000 7f021e7fc640 1 -- 172.21.15.71:0/2726570947 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0224038070 con 0x7f0228065bc0 2024-09-10T10:13:09.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.635+0000 7f021e7fc640 1 -- 172.21.15.71:0/2726570947 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f022402ae90 con 0x7f0228065bc0 2024-09-10T10:13:09.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.635+0000 7f021e7fc640 1 -- 172.21.15.71:0/2726570947 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f022403e670 con 0x7f0228065bc0 2024-09-10T10:13:09.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.635+0000 7f022fad4640 1 -- 172.21.15.71:0/2726570947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02280fb9c0 con 0x7f0228065bc0 2024-09-10T10:13:09.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.635+0000 7f022fad4640 1 -- 172.21.15.71:0/2726570947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0228115150 con 0x7f0228065bc0 2024-09-10T10:13:09.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.636+0000 7f022fad4640 1 -- 172.21.15.71:0/2726570947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02280fa890 con 0x7f0228065bc0 2024-09-10T10:13:09.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.637+0000 7f021e7fc640 1 -- 172.21.15.71:0/2726570947 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0224030020 con 0x7f0228065bc0 2024-09-10T10:13:09.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.638+0000 7f021e7fc640 1 --2- 172.21.15.71:0/2726570947 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f021406e170 0x7f0214070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.638+0000 7f021e7fc640 1 -- 172.21.15.71:0/2726570947 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f02240adbb0 con 0x7f0228065bc0 2024-09-10T10:13:09.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.638+0000 7f022d06f640 1 --2- 172.21.15.71:0/2726570947 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f021406e170 0x7f0214070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.638+0000 7f022d06f640 1 --2- 172.21.15.71:0/2726570947 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f021406e170 0x7f0214070620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0228066060 tx=0x7f021800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.643+0000 7f021e7fc640 1 -- 172.21.15.71:0/2726570947 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f02240b4080 con 0x7f0228065bc0 2024-09-10T10:13:09.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.857+0000 7f022fad4640 1 -- 172.21.15.71:0/2726570947 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f02280f8700 con 0x7f021406e170 2024-09-10T10:13:09.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.865+0000 7f021e7fc640 1 -- 172.21.15.71:0/2726570947 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f02280f8700 con 0x7f021406e170 2024-09-10T10:13:09.867 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:13:09.867 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (14s) 9s ago 16m 15.8M - 0.25.0 c8568f914cd2 a2cae604bef8 2024-09-10T10:13:09.867 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (5m) 9s ago 17m 6903k - 19.1.1-305-g1cf819b7 41d671128357 5dc74ad01560 2024-09-10T10:13:09.867 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (5m) 42s ago 16m 6891k - 19.1.1-305-g1cf819b7 41d671128357 6f4355e875db 2024-09-10T10:13:09.867 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (8m) 9s ago 16m 85.9M - 9.4.7 954c08fa6188 b0f4ccaa87a1 2024-09-10T10:13:09.867 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (96s) 9s ago 11m 16.6M - 19.1.1-305-g1cf819b7 41d671128357 6ec036debe92 2024-09-10T10:13:09.867 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (113s) 9s ago 11m 65.9M - 19.1.1-305-g1cf819b7 41d671128357 58af9b545bf4 2024-09-10T10:13:09.867 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (76s) 42s ago 11m 137M - 19.1.1-305-g1cf819b7 41d671128357 b3a09b16124b 2024-09-10T10:13:09.867 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (61s) 42s ago 11m 14.4M - 19.1.1-305-g1cf819b7 41d671128357 bdcd45e9b3e2 2024-09-10T10:13:09.867 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (7m) 9s ago 18m 508M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:13:09.868 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (7m) 42s ago 16m 442M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:13:09.868 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (6m) 9s ago 18m 55.5M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:13:09.868 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (6m) 42s ago 16m 38.9M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:13:09.868 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (49s) 9s ago 17m 7918k - 1.5.0 0da6a335fe13 06ab97573e3d 2024-09-10T10:13:09.868 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (44s) 42s ago 16m 3598k - 1.5.0 0da6a335fe13 c514485d2dcf 2024-09-10T10:13:09.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (5m) 9s ago 15m 105M 1557M 19.1.1-305-g1cf819b7 41d671128357 f1e9da1144c1 2024-09-10T10:13:09.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (4m) 9s ago 14m 110M 1557M 19.1.1-305-g1cf819b7 41d671128357 5afc8bef5343 2024-09-10T10:13:09.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (4m) 9s ago 14m 97.6M 1557M 19.1.1-305-g1cf819b7 41d671128357 5e5976fcfaa8 2024-09-10T10:13:09.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (3m) 42s ago 13m 116M 2581M 19.1.1-305-g1cf819b7 41d671128357 e22ee626ccd0 2024-09-10T10:13:09.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (3m) 42s ago 13m 99.5M 2581M 19.1.1-305-g1cf819b7 41d671128357 e92f23ad2c77 2024-09-10T10:13:09.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (2m) 42s ago 13m 95.1M 2581M 19.1.1-305-g1cf819b7 41d671128357 3440ee1c721e 2024-09-10T10:13:09.868 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (29s) 9s ago 16m 47.0M - 2.43.0 a07b618ecd1d 9ad96937a042 2024-09-10T10:13:09.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.868+0000 7f022fad4640 1 -- 172.21.15.71:0/2726570947 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f021406e170 msgr2=0x7f0214070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.868+0000 7f022fad4640 1 --2- 172.21.15.71:0/2726570947 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f021406e170 0x7f0214070620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0228066060 tx=0x7f021800b040 comp rx=0 tx=0).stop 2024-09-10T10:13:09.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.868+0000 7f022fad4640 1 -- 172.21.15.71:0/2726570947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0228065bc0 msgr2=0x7f02280fcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.868+0000 7f022fad4640 1 --2- 172.21.15.71:0/2726570947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0228065bc0 0x7f02280fcb80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f022402d040 tx=0x7f0224009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.868+0000 7f022fad4640 1 -- 172.21.15.71:0/2726570947 shutdown_connections 2024-09-10T10:13:09.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.868+0000 7f022fad4640 1 --2- 172.21.15.71:0/2726570947 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f021406e170 0x7f0214070620 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.868+0000 7f022fad4640 1 --2- 172.21.15.71:0/2726570947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02280ff700 0x7f02280fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.868+0000 7f022fad4640 1 --2- 172.21.15.71:0/2726570947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0228065bc0 0x7f02280fcb80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.868+0000 7f022fad4640 1 -- 172.21.15.71:0/2726570947 >> 172.21.15.71:0/2726570947 conn(0x7f02280f6c10 msgr2=0x7f02280f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:09.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.868+0000 7f022fad4640 1 -- 172.21.15.71:0/2726570947 shutdown_connections 2024-09-10T10:13:09.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.868+0000 7f022fad4640 1 -- 172.21.15.71:0/2726570947 wait complete. 2024-09-10T10:13:09.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:09 smithi107 ceph-mon[79396]: pgmap v240: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:09.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.951+0000 7f1e696a3640 1 -- 172.21.15.71:0/2625496133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640fb450 msgr2=0x7f1e640fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.951+0000 7f1e696a3640 1 --2- 172.21.15.71:0/2625496133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640fb450 0x7f1e640fb860 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1e540048d0 tx=0x7f1e54009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.951+0000 7f1e696a3640 1 -- 172.21.15.71:0/2625496133 shutdown_connections 2024-09-10T10:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.951+0000 7f1e696a3640 1 --2- 172.21.15.71:0/2625496133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fc720 0x7f1e640fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.951+0000 7f1e696a3640 1 --2- 172.21.15.71:0/2625496133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640fb450 0x7f1e640fb860 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.951+0000 7f1e696a3640 1 -- 172.21.15.71:0/2625496133 >> 172.21.15.71:0/2625496133 conn(0x7f1e640f6c10 msgr2=0x7f1e640f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.951+0000 7f1e696a3640 1 -- 172.21.15.71:0/2625496133 shutdown_connections 2024-09-10T10:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.951+0000 7f1e696a3640 1 -- 172.21.15.71:0/2625496133 wait complete. 2024-09-10T10:13:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.952+0000 7f1e696a3640 1 Processor -- start 2024-09-10T10:13:09.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.952+0000 7f1e696a3640 1 -- start start 2024-09-10T10:13:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.953+0000 7f1e696a3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640fb450 0x7f1e6410d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.953+0000 7f1e696a3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fc720 0x7f1e6410d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.953+0000 7f1e696a3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6410e500 con 0x7f1e640fb450 2024-09-10T10:13:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.953+0000 7f1e696a3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6410e670 con 0x7f1e640fc720 2024-09-10T10:13:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.953+0000 7f1e62ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640fb450 0x7f1e6410d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.953+0000 7f1e62ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640fb450 0x7f1e6410d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52004/0 (socket says 172.21.15.71:52004) 2024-09-10T10:13:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.953+0000 7f1e62ffd640 1 -- 172.21.15.71:0/4216899567 learned_addr learned my addr 172.21.15.71:0/4216899567 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:13:09.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.953+0000 7f1e5bfff640 1 --2- 172.21.15.71:0/4216899567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fc720 0x7f1e6410d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.954+0000 7f1e62ffd640 1 -- 172.21.15.71:0/4216899567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fc720 msgr2=0x7f1e6410d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.954+0000 7f1e62ffd640 1 --2- 172.21.15.71:0/4216899567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fc720 0x7f1e6410d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.954+0000 7f1e62ffd640 1 -- 172.21.15.71:0/4216899567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e54005040 con 0x7f1e640fb450 2024-09-10T10:13:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.954+0000 7f1e5bfff640 1 --2- 172.21.15.71:0/4216899567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fc720 0x7f1e6410d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.954+0000 7f1e62ffd640 1 --2- 172.21.15.71:0/4216899567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640fb450 0x7f1e6410d150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009900 tx=0x7f1e54009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.954+0000 7f1e5b7fe640 1 -- 172.21.15.71:0/4216899567 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e54038070 con 0x7f1e640fb450 2024-09-10T10:13:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.954+0000 7f1e696a3640 1 -- 172.21.15.71:0/4216899567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6410e8f0 con 0x7f1e640fb450 2024-09-10T10:13:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.955+0000 7f1e696a3640 1 -- 172.21.15.71:0/4216899567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6410ee90 con 0x7f1e640fb450 2024-09-10T10:13:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.955+0000 7f1e5b7fe640 1 -- 172.21.15.71:0/4216899567 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1e54033cb0 con 0x7f1e640fb450 2024-09-10T10:13:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.955+0000 7f1e5b7fe640 1 -- 172.21.15.71:0/4216899567 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e5403dbc0 con 0x7f1e640fb450 2024-09-10T10:13:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.956+0000 7f1e696a3640 1 -- 172.21.15.71:0/4216899567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e44005240 con 0x7f1e640fb450 2024-09-10T10:13:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.957+0000 7f1e5b7fe640 1 -- 172.21.15.71:0/4216899567 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1e54030020 con 0x7f1e640fb450 2024-09-10T10:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.958+0000 7f1e5b7fe640 1 --2- 172.21.15.71:0/4216899567 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f1e5006e0f0 0x7f1e500705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.958+0000 7f1e5b7fe640 1 -- 172.21.15.71:0/4216899567 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f1e540ae430 con 0x7f1e640fb450 2024-09-10T10:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.959+0000 7f1e5bfff640 1 --2- 172.21.15.71:0/4216899567 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f1e5006e0f0 0x7f1e500705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.960+0000 7f1e5bfff640 1 --2- 172.21.15.71:0/4216899567 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f1e5006e0f0 0x7f1e500705a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1e6410cf00 tx=0x7f1e4c009060 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:09.963+0000 7f1e5b7fe640 1 -- 172.21.15.71:0/4216899567 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1e54077700 con 0x7f1e640fb450 2024-09-10T10:13:10.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.218+0000 7f1e696a3640 1 -- 172.21.15.71:0/4216899567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e44005d00 con 0x7f1e640fb450 2024-09-10T10:13:10.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.219+0000 7f1e5b7fe640 1 -- 172.21.15.71:0/4216899567 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f1e5407adc0 con 0x7f1e640fb450 2024-09-10T10:13:10.221 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:13:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:13:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:13:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:13:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:13:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:13:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:13:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:13:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T10:13:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:13:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:13:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T10:13:10.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:13:10.222 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:13:10.222 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 14 2024-09-10T10:13:10.222 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:13:10.222 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:13:10.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.221+0000 7f1e696a3640 1 -- 172.21.15.71:0/4216899567 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f1e5006e0f0 msgr2=0x7f1e500705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:10.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.221+0000 7f1e696a3640 1 --2- 172.21.15.71:0/4216899567 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f1e5006e0f0 0x7f1e500705a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1e6410cf00 tx=0x7f1e4c009060 comp rx=0 tx=0).stop 2024-09-10T10:13:10.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.221+0000 7f1e696a3640 1 -- 172.21.15.71:0/4216899567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640fb450 msgr2=0x7f1e6410d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:10.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.221+0000 7f1e696a3640 1 --2- 172.21.15.71:0/4216899567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640fb450 0x7f1e6410d150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009900 tx=0x7f1e54009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.222+0000 7f1e696a3640 1 -- 172.21.15.71:0/4216899567 shutdown_connections 2024-09-10T10:13:10.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.222+0000 7f1e696a3640 1 --2- 172.21.15.71:0/4216899567 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f1e5006e0f0 0x7f1e500705a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.222+0000 7f1e696a3640 1 --2- 172.21.15.71:0/4216899567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e640fc720 0x7f1e6410d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.222+0000 7f1e696a3640 1 --2- 172.21.15.71:0/4216899567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640fb450 0x7f1e6410d150 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.222+0000 7f1e696a3640 1 -- 172.21.15.71:0/4216899567 >> 172.21.15.71:0/4216899567 conn(0x7f1e640f6c10 msgr2=0x7f1e640f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:10.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.222+0000 7f1e696a3640 1 -- 172.21.15.71:0/4216899567 shutdown_connections 2024-09-10T10:13:10.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.222+0000 7f1e696a3640 1 -- 172.21.15.71:0/4216899567 wait complete. 2024-09-10T10:13:10.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.309+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/1757874409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a280fdc30 msgr2=0x7f0a280fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.309+0000 7f0a2d3a2640 1 --2- 172.21.15.71:0/1757874409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a280fdc30 0x7f0a280fe040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0048d0 tx=0x7f0a1c009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.309+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/1757874409 shutdown_connections 2024-09-10T10:13:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.309+0000 7f0a2d3a2640 1 --2- 172.21.15.71:0/1757874409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a280fe580 0x7f0a280fa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.309+0000 7f0a2d3a2640 1 --2- 172.21.15.71:0/1757874409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a280fdc30 0x7f0a280fe040 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.309+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/1757874409 >> 172.21.15.71:0/1757874409 conn(0x7f0a280f6390 msgr2=0x7f0a280f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.309+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/1757874409 shutdown_connections 2024-09-10T10:13:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.309+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/1757874409 wait complete. 2024-09-10T10:13:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a2d3a2640 1 Processor -- start 2024-09-10T10:13:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a2d3a2640 1 -- start start 2024-09-10T10:13:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a2d3a2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a280fdc30 0x7f0a2810d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a2d3a2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a280fe580 0x7f0a2810d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a2d3a2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2810dc60 con 0x7f0a280fe580 2024-09-10T10:13:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a2d3a2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2810e480 con 0x7f0a280fdc30 2024-09-10T10:13:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a267fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a280fe580 0x7f0a2810d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a267fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a280fe580 0x7f0a2810d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52034/0 (socket says 172.21.15.71:52034) 2024-09-10T10:13:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a267fc640 1 -- 172.21.15.71:0/4083679309 learned_addr learned my addr 172.21.15.71:0/4083679309 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:13:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a26ffd640 1 --2- 172.21.15.71:0/4083679309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a280fdc30 0x7f0a2810d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:10.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a267fc640 1 -- 172.21.15.71:0/4083679309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a280fdc30 msgr2=0x7f0a2810d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:10.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a267fc640 1 --2- 172.21.15.71:0/4083679309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a280fdc30 0x7f0a2810d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a267fc640 1 -- 172.21.15.71:0/4083679309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c005040 con 0x7f0a280fe580 2024-09-10T10:13:10.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.310+0000 7f0a26ffd640 1 --2- 172.21.15.71:0/4083679309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a280fdc30 0x7f0a2810d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:13:10.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.311+0000 7f0a267fc640 1 --2- 172.21.15.71:0/4083679309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a280fe580 0x7f0a2810d610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800c760 tx=0x7f0a180043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:10.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.311+0000 7f0a0f7fe640 1 -- 172.21.15.71:0/4083679309 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a1800a790 con 0x7f0a280fe580 2024-09-10T10:13:10.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.311+0000 7f0a0f7fe640 1 -- 172.21.15.71:0/4083679309 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0a1800ad90 con 0x7f0a280fe580 2024-09-10T10:13:10.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.311+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/4083679309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2810e710 con 0x7f0a280fe580 2024-09-10T10:13:10.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.311+0000 7f0a0f7fe640 1 -- 172.21.15.71:0/4083679309 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a180113a0 con 0x7f0a280fe580 2024-09-10T10:13:10.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.311+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/4083679309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2810ecb0 con 0x7f0a280fe580 2024-09-10T10:13:10.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.312+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/4083679309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a280fa010 con 0x7f0a280fe580 2024-09-10T10:13:10.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.313+0000 7f0a0f7fe640 1 -- 172.21.15.71:0/4083679309 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0a18012400 con 0x7f0a280fe580 2024-09-10T10:13:10.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.313+0000 7f0a0f7fe640 1 --2- 172.21.15.71:0/4083679309 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f0a1006e0b0 0x7f0a10070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:10.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.313+0000 7f0a0f7fe640 1 -- 172.21.15.71:0/4083679309 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f0a1808ddb0 con 0x7f0a280fe580 2024-09-10T10:13:10.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.313+0000 7f0a26ffd640 1 --2- 172.21.15.71:0/4083679309 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f0a1006e0b0 0x7f0a10070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:10.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.314+0000 7f0a26ffd640 1 --2- 172.21.15.71:0/4083679309 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f0a1006e0b0 0x7f0a10070560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00b020 tx=0x7f0a1c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:10.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.318+0000 7f0a0f7fe640 1 -- 172.21.15.71:0/4083679309 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0a18057100 con 0x7f0a280fe580 2024-09-10T10:13:10.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.532+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/4083679309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0a2810ef70 con 0x7f0a280fe580 2024-09-10T10:13:10.534 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:10 smithi071 ceph-mon[90773]: from='client.44425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:10.534 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:10 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/4216899567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:10.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.533+0000 7f0a0f7fe640 1 -- 172.21.15.71:0/4083679309 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+2006 (secure 0 0 0) 0x7f0a1805a7c0 con 0x7f0a280fe580 2024-09-10T10:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout:e44 2024-09-10T10:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout:btime 2024-09-10T10:12:17:347805+0000 2024-09-10T10:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 44 2024-09-10T10:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:12:17.347793+0000 2024-09-10T10:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 81 2024-09-10T10:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T10:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=34416,1=34432} 2024-09-10T10:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 34416 members: 34432,34416 2024-09-10T10:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:34416} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.71:6826/1701579524,v1:172.21.15.71:6827/1701579524] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{0:44373} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.107:6824/1627286097,v1:172.21.15.107:6825/1627286097] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{1:34432} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.71:6828/1608732243,v1:172.21.15.71:6829/1608732243] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:44397} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2279749952,v1:172.21.15.107:6827/2279749952] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:13:10.539 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 44 2024-09-10T10:13:10.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.535+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/4083679309 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f0a1006e0b0 msgr2=0x7f0a10070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:10.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.535+0000 7f0a2d3a2640 1 --2- 172.21.15.71:0/4083679309 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f0a1006e0b0 0x7f0a10070560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00b020 tx=0x7f0a1c009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.535+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/4083679309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a280fe580 msgr2=0x7f0a2810d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:10.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.535+0000 7f0a2d3a2640 1 --2- 172.21.15.71:0/4083679309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a280fe580 0x7f0a2810d610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800c760 tx=0x7f0a180043c0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.535+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/4083679309 shutdown_connections 2024-09-10T10:13:10.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.535+0000 7f0a2d3a2640 1 --2- 172.21.15.71:0/4083679309 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f0a1006e0b0 0x7f0a10070560 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.535+0000 7f0a2d3a2640 1 --2- 172.21.15.71:0/4083679309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a280fe580 0x7f0a2810d610 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.535+0000 7f0a2d3a2640 1 --2- 172.21.15.71:0/4083679309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a280fdc30 0x7f0a2810d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.535+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/4083679309 >> 172.21.15.71:0/4083679309 conn(0x7f0a280f6390 msgr2=0x7f0a280f7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:10.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.536+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/4083679309 shutdown_connections 2024-09-10T10:13:10.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.536+0000 7f0a2d3a2640 1 -- 172.21.15.71:0/4083679309 wait complete. 2024-09-10T10:13:10.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.617+0000 7f9e86c0c640 1 -- 172.21.15.71:0/684277555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e80066470 msgr2=0x7f9e800ff190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:10.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.617+0000 7f9e86c0c640 1 --2- 172.21.15.71:0/684277555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e80066470 0x7f9e800ff190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9e740048d0 tx=0x7f9e74009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.617+0000 7f9e86c0c640 1 -- 172.21.15.71:0/684277555 shutdown_connections 2024-09-10T10:13:10.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.617+0000 7f9e86c0c640 1 --2- 172.21.15.71:0/684277555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e800ff6d0 0x7f9e80101ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.617+0000 7f9e86c0c640 1 --2- 172.21.15.71:0/684277555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e80066470 0x7f9e800ff190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.617+0000 7f9e86c0c640 1 -- 172.21.15.71:0/684277555 >> 172.21.15.71:0/684277555 conn(0x7f9e800f6c00 msgr2=0x7f9e800f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:10.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.617+0000 7f9e86c0c640 1 -- 172.21.15.71:0/684277555 shutdown_connections 2024-09-10T10:13:10.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.617+0000 7f9e86c0c640 1 -- 172.21.15.71:0/684277555 wait complete. 2024-09-10T10:13:10.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.618+0000 7f9e86c0c640 1 Processor -- start 2024-09-10T10:13:10.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.618+0000 7f9e86c0c640 1 -- start start 2024-09-10T10:13:10.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.618+0000 7f9e86c0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e80066470 0x7f9e800fcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:10.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.618+0000 7f9e86c0c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800ff6d0 0x7f9e800fb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:10.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.618+0000 7f9e86c0c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800fb5d0 con 0x7f9e800ff6d0 2024-09-10T10:13:10.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.618+0000 7f9e86c0c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800fb710 con 0x7f9e80066470 2024-09-10T10:13:10.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.618+0000 7f9e7ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800ff6d0 0x7f9e800fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:10.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.618+0000 7f9e7ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800ff6d0 0x7f9e800fb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52054/0 (socket says 172.21.15.71:52054) 2024-09-10T10:13:10.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.618+0000 7f9e7ffff640 1 -- 172.21.15.71:0/1944318663 learned_addr learned my addr 172.21.15.71:0/1944318663 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:13:10.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.618+0000 7f9e849a8640 1 --2- 172.21.15.71:0/1944318663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e80066470 0x7f9e800fcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:10.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.618+0000 7f9e7ffff640 1 -- 172.21.15.71:0/1944318663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e80066470 msgr2=0x7f9e800fcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:10.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.618+0000 7f9e7ffff640 1 --2- 172.21.15.71:0/1944318663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e80066470 0x7f9e800fcb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.618+0000 7f9e7ffff640 1 -- 172.21.15.71:0/1944318663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e74005040 con 0x7f9e800ff6d0 2024-09-10T10:13:10.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.619+0000 7f9e7ffff640 1 --2- 172.21.15.71:0/1944318663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800ff6d0 0x7f9e800fb090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00eb70 tx=0x7f9e6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:10.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.619+0000 7f9e7d7fa640 1 -- 172.21.15.71:0/1944318663 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e6c007c30 con 0x7f9e800ff6d0 2024-09-10T10:13:10.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.619+0000 7f9e7d7fa640 1 -- 172.21.15.71:0/1944318663 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9e6c00f040 con 0x7f9e800ff6d0 2024-09-10T10:13:10.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.619+0000 7f9e86c0c640 1 -- 172.21.15.71:0/1944318663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e800fb990 con 0x7f9e800ff6d0 2024-09-10T10:13:10.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.619+0000 7f9e7d7fa640 1 -- 172.21.15.71:0/1944318663 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e6c00ca60 con 0x7f9e800ff6d0 2024-09-10T10:13:10.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.619+0000 7f9e86c0c640 1 -- 172.21.15.71:0/1944318663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e800fbf00 con 0x7f9e800ff6d0 2024-09-10T10:13:10.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.620+0000 7f9e86c0c640 1 -- 172.21.15.71:0/1944318663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e800fa880 con 0x7f9e800ff6d0 2024-09-10T10:13:10.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.621+0000 7f9e7d7fa640 1 -- 172.21.15.71:0/1944318663 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9e6c00cbc0 con 0x7f9e800ff6d0 2024-09-10T10:13:10.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.621+0000 7f9e7d7fa640 1 --2- 172.21.15.71:0/1944318663 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9e7006e0b0 0x7f9e70070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:10.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.621+0000 7f9e7d7fa640 1 -- 172.21.15.71:0/1944318663 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f9e6c08d710 con 0x7f9e800ff6d0 2024-09-10T10:13:10.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.621+0000 7f9e849a8640 1 --2- 172.21.15.71:0/1944318663 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9e7006e0b0 0x7f9e70070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:10.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.622+0000 7f9e849a8640 1 --2- 172.21.15.71:0/1944318663 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9e7006e0b0 0x7f9e70070560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e740048a0 tx=0x7f9e74009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:10.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.626+0000 7f9e7d7fa640 1 -- 172.21.15.71:0/1944318663 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9e6c0569e0 con 0x7f9e800ff6d0 2024-09-10T10:13:10.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.878+0000 7f9e86c0c640 1 -- 172.21.15.71:0/1944318663 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e800fbf00 con 0x7f9e7006e0b0 2024-09-10T10:13:10.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.879+0000 7f9e7d7fa640 1 -- 172.21.15.71:0/1944318663 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f9e800fbf00 con 0x7f9e7006e0b0 2024-09-10T10:13:10.881 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:13:10.881 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T10:13:10.881 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-10T10:13:10.881 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T10:13:10.881 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-10T10:13:10.881 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-10T10:13:10.881 INFO:teuthology.orchestra.run.smithi071.stdout: "osd", 2024-09-10T10:13:10.881 INFO:teuthology.orchestra.run.smithi071.stdout: "mds", 2024-09-10T10:13:10.881 INFO:teuthology.orchestra.run.smithi071.stdout: "mon", 2024-09-10T10:13:10.881 INFO:teuthology.orchestra.run.smithi071.stdout: "crash" 2024-09-10T10:13:10.881 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-10T10:13:10.882 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "16/21 daemons upgraded", 2024-09-10T10:13:10.882 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading grafana daemons", 2024-09-10T10:13:10.882 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:13:10.882 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:13:10.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.882+0000 7f9e86c0c640 1 -- 172.21.15.71:0/1944318663 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9e7006e0b0 msgr2=0x7f9e70070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:10.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.882+0000 7f9e86c0c640 1 --2- 172.21.15.71:0/1944318663 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9e7006e0b0 0x7f9e70070560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e740048a0 tx=0x7f9e74009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.882+0000 7f9e86c0c640 1 -- 172.21.15.71:0/1944318663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800ff6d0 msgr2=0x7f9e800fb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:10.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.882+0000 7f9e86c0c640 1 --2- 172.21.15.71:0/1944318663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800ff6d0 0x7f9e800fb090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00eb70 tx=0x7f9e6c00b040 comp rx=0 tx=0).stop 2024-09-10T10:13:10.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.882+0000 7f9e86c0c640 1 -- 172.21.15.71:0/1944318663 shutdown_connections 2024-09-10T10:13:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.882+0000 7f9e86c0c640 1 --2- 172.21.15.71:0/1944318663 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9e7006e0b0 0x7f9e70070560 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.882+0000 7f9e86c0c640 1 --2- 172.21.15.71:0/1944318663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e800ff6d0 0x7f9e800fb090 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.882+0000 7f9e86c0c640 1 --2- 172.21.15.71:0/1944318663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9e80066470 0x7f9e800fcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.882+0000 7f9e86c0c640 1 -- 172.21.15.71:0/1944318663 >> 172.21.15.71:0/1944318663 conn(0x7f9e800f6c00 msgr2=0x7f9e800f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.882+0000 7f9e86c0c640 1 -- 172.21.15.71:0/1944318663 shutdown_connections 2024-09-10T10:13:10.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.882+0000 7f9e86c0c640 1 -- 172.21.15.71:0/1944318663 wait complete. 2024-09-10T10:13:10.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:10 smithi107 ceph-mon[79396]: from='client.44425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:10.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:10 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/4216899567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.977+0000 7fdd6b333640 1 -- 172.21.15.71:0/3707890124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd640fb430 msgr2=0x7fdd640fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.977+0000 7fdd6b333640 1 --2- 172.21.15.71:0/3707890124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd640fb430 0x7fdd640fb840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdd600048d0 tx=0x7fdd60009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.977+0000 7fdd6b333640 1 -- 172.21.15.71:0/3707890124 shutdown_connections 2024-09-10T10:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.977+0000 7fdd6b333640 1 --2- 172.21.15.71:0/3707890124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd640fc700 0x7fdd640fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.977+0000 7fdd6b333640 1 --2- 172.21.15.71:0/3707890124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd640fb430 0x7fdd640fb840 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.977+0000 7fdd6b333640 1 -- 172.21.15.71:0/3707890124 >> 172.21.15.71:0/3707890124 conn(0x7fdd640f6c10 msgr2=0x7fdd640f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.977+0000 7fdd6b333640 1 -- 172.21.15.71:0/3707890124 shutdown_connections 2024-09-10T10:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.977+0000 7fdd6b333640 1 -- 172.21.15.71:0/3707890124 wait complete. 2024-09-10T10:13:10.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.978+0000 7fdd6b333640 1 Processor -- start 2024-09-10T10:13:10.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.978+0000 7fdd6b333640 1 -- start start 2024-09-10T10:13:10.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.978+0000 7fdd6b333640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd640fb430 0x7fdd6410bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:10.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.978+0000 7fdd6b333640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd640fc700 0x7fdd6410c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:10.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.978+0000 7fdd6b333640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6410cb10 con 0x7fdd640fc700 2024-09-10T10:13:10.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.978+0000 7fdd6b333640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6410d330 con 0x7fdd640fb430 2024-09-10T10:13:10.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.978+0000 7fdd688ce640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd640fc700 0x7fdd6410c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.978+0000 7fdd688ce640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd640fc700 0x7fdd6410c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52080/0 (socket says 172.21.15.71:52080) 2024-09-10T10:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.978+0000 7fdd688ce640 1 -- 172.21.15.71:0/1115756169 learned_addr learned my addr 172.21.15.71:0/1115756169 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.979+0000 7fdd690cf640 1 --2- 172.21.15.71:0/1115756169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd640fb430 0x7fdd6410bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.979+0000 7fdd688ce640 1 -- 172.21.15.71:0/1115756169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd640fb430 msgr2=0x7fdd6410bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.979+0000 7fdd688ce640 1 --2- 172.21.15.71:0/1115756169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd640fb430 0x7fdd6410bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.979+0000 7fdd688ce640 1 -- 172.21.15.71:0/1115756169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd60005040 con 0x7fdd640fc700 2024-09-10T10:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.979+0000 7fdd688ce640 1 --2- 172.21.15.71:0/1115756169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd640fc700 0x7fdd6410c4c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdd54002a50 tx=0x7fdd54004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.979+0000 7fdd59ffb640 1 -- 172.21.15.71:0/1115756169 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd54007c30 con 0x7fdd640fc700 2024-09-10T10:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.979+0000 7fdd6b333640 1 -- 172.21.15.71:0/1115756169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6410d5c0 con 0x7fdd640fc700 2024-09-10T10:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.979+0000 7fdd59ffb640 1 -- 172.21.15.71:0/1115756169 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdd5400f040 con 0x7fdd640fc700 2024-09-10T10:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.979+0000 7fdd59ffb640 1 -- 172.21.15.71:0/1115756169 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd5400da10 con 0x7fdd640fc700 2024-09-10T10:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.980+0000 7fdd6b333640 1 -- 172.21.15.71:0/1115756169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6410db60 con 0x7fdd640fc700 2024-09-10T10:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.981+0000 7fdd6b333640 1 -- 172.21.15.71:0/1115756169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd640fa890 con 0x7fdd640fc700 2024-09-10T10:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.981+0000 7fdd59ffb640 1 -- 172.21.15.71:0/1115756169 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdd5400dc80 con 0x7fdd640fc700 2024-09-10T10:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.982+0000 7fdd59ffb640 1 --2- 172.21.15.71:0/1115756169 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fdd5006e0b0 0x7fdd50070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.982+0000 7fdd59ffb640 1 -- 172.21.15.71:0/1115756169 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fdd5408d3b0 con 0x7fdd640fc700 2024-09-10T10:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.982+0000 7fdd690cf640 1 --2- 172.21.15.71:0/1115756169 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fdd5006e0b0 0x7fdd50070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.983+0000 7fdd690cf640 1 --2- 172.21.15.71:0/1115756169 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fdd5006e0b0 0x7fdd50070560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdd60000c00 tx=0x7fdd60035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:10.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:10.988+0000 7fdd59ffb640 1 -- 172.21.15.71:0/1115756169 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdd54056730 con 0x7fdd640fc700 2024-09-10T10:13:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:11.251+0000 7fdd6b333640 1 -- 172.21.15.71:0/1115756169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdd6410de20 con 0x7fdd640fc700 2024-09-10T10:13:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:11.251+0000 7fdd59ffb640 1 -- 172.21.15.71:0/1115756169 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdd54059df0 con 0x7fdd640fc700 2024-09-10T10:13:11.253 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:13:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:11.254+0000 7fdd6b333640 1 -- 172.21.15.71:0/1115756169 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fdd5006e0b0 msgr2=0x7fdd50070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:11.254+0000 7fdd6b333640 1 --2- 172.21.15.71:0/1115756169 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fdd5006e0b0 0x7fdd50070560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdd60000c00 tx=0x7fdd60035040 comp rx=0 tx=0).stop 2024-09-10T10:13:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:11.254+0000 7fdd6b333640 1 -- 172.21.15.71:0/1115756169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd640fc700 msgr2=0x7fdd6410c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:11.254+0000 7fdd6b333640 1 --2- 172.21.15.71:0/1115756169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd640fc700 0x7fdd6410c4c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdd54002a50 tx=0x7fdd54004600 comp rx=0 tx=0).stop 2024-09-10T10:13:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:11.254+0000 7fdd6b333640 1 -- 172.21.15.71:0/1115756169 shutdown_connections 2024-09-10T10:13:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:11.254+0000 7fdd6b333640 1 --2- 172.21.15.71:0/1115756169 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fdd5006e0b0 0x7fdd50070560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:11.254+0000 7fdd6b333640 1 --2- 172.21.15.71:0/1115756169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd640fc700 0x7fdd6410c4c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:11.254+0000 7fdd6b333640 1 --2- 172.21.15.71:0/1115756169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd640fb430 0x7fdd6410bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:11.254+0000 7fdd6b333640 1 -- 172.21.15.71:0/1115756169 >> 172.21.15.71:0/1115756169 conn(0x7fdd640f6c10 msgr2=0x7fdd640f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:11.254+0000 7fdd6b333640 1 -- 172.21.15.71:0/1115756169 shutdown_connections 2024-09-10T10:13:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:11.254+0000 7fdd6b333640 1 -- 172.21.15.71:0/1115756169 wait complete. 2024-09-10T10:13:11.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:11 smithi071 ceph-mon[90773]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:11.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:11 smithi071 ceph-mon[90773]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:11.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:11 smithi071 ceph-mon[90773]: pgmap v241: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:11.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:11 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/4083679309' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:13:11.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:11 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/1115756169' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:13:11.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:11 smithi107 ceph-mon[79396]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:11.903 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:11 smithi107 ceph-mon[79396]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:11.903 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:11 smithi107 ceph-mon[79396]: pgmap v241: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:11.903 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:11 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/4083679309' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:13:11.903 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:11 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/1115756169' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:13:12.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:12 smithi071 ceph-mon[90773]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:12.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:12 smithi107 ceph-mon[79396]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:13.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:13 smithi071 ceph-mon[90773]: pgmap v242: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:13.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:13 smithi107 ceph-mon[79396]: pgmap v242: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:15.526 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:15 smithi071 ceph-mon[90773]: pgmap v243: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:13:15.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:15 smithi107 ceph-mon[79396]: pgmap v243: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:13:17.693 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:17 smithi071 ceph-mon[90773]: pgmap v244: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:17.693 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:17.693 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:17.693 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:17 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:13:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:17 smithi107 ceph-mon[79396]: pgmap v244: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:17.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:17 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:13:19.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:19 smithi071 ceph-mon[90773]: pgmap v245: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:19.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:19 smithi107 ceph-mon[79396]: pgmap v245: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:21.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:21 smithi071 ceph-mon[90773]: pgmap v246: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:21.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:21 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:21.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:21 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:21.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:21 smithi107 ceph-mon[79396]: pgmap v246: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:21.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:21 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:21.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:21 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:23.145 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:23.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:22 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:23.146 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:22 smithi107 ceph-mon[79396]: pgmap v247: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:23.288 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:23.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:22 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:23.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:22 smithi071 ceph-mon[90773]: pgmap v247: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:24.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:13:24.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:13:25.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:25 smithi071 ceph-mon[90773]: pgmap v248: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:13:25.546 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:25 smithi107 ceph-mon[79396]: pgmap v248: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:13:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:26.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:13:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:13:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T10:13:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T10:13:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:13:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: Upgrade: Finalizing container_image settings 2024-09-10T10:13:26.541 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-10T10:13:26.542 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-10T10:13:26.543 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.543 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-10T10:13:26.543 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-10T10:13:26.543 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-10T10:13:26.543 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-10T10:13:26.543 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-10T10:13:26.543 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-10T10:13:26.543 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-10T10:13:26.543 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-10T10:13:26.543 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.543 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.543 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.543 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.544 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.544 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.544 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-10T10:13:26.544 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-10T10:13:26.544 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:13:26.544 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:13:26.544 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:13:26.544 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:26.544 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:13:26.544 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:13:26.544 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:13:26.544 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:26.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:26.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:26.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:13:26.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:13:26.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:26.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T10:13:26.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T10:13:26.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:13:26.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.647 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:26.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: Upgrade: Finalizing container_image settings 2024-09-10T10:13:26.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:26.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-10T10:13:26.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-10T10:13:26.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-10T10:13:26.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-10T10:13:26.648 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-10T10:13:26.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-10T10:13:26.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-10T10:13:26.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-10T10:13:26.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-10T10:13:26.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-10T10:13:26.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-10T10:13:26.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-10T10:13:26.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-10T10:13:26.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-10T10:13:26.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-10T10:13:26.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-10T10:13:26.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-10T10:13:26.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-10T10:13:26.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-10T10:13:26.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-10T10:13:26.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-10T10:13:26.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T10:13:26.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-10T10:13:26.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-10T10:13:26.650 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:13:26.651 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:13:26.651 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:13:26.651 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:26.651 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:13:26.651 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:13:26.651 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:13:26.651 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:27.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:27 smithi071 ceph-mon[90773]: Upgrade: Complete! 2024-09-10T10:13:27.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:27 smithi071 ceph-mon[90773]: pgmap v249: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:27 smithi107 ceph-mon[79396]: Upgrade: Complete! 2024-09-10T10:13:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:27 smithi107 ceph-mon[79396]: pgmap v249: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:29.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:29 smithi071 ceph-mon[90773]: pgmap v250: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:29.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:29 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:29 smithi107 ceph-mon[79396]: pgmap v250: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:29 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:13:31.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:31 smithi071 ceph-mon[90773]: pgmap v251: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:31.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:31 smithi107 ceph-mon[79396]: pgmap v251: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:33.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:33 smithi107 ceph-mon[79396]: pgmap v252: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:33.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:33 smithi071 ceph-mon[90773]: pgmap v252: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:35.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:35 smithi107 ceph-mon[79396]: pgmap v253: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:13:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:35 smithi071 ceph-mon[90773]: pgmap v253: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:13:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:37 smithi107 ceph-mon[79396]: pgmap v254: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:37 smithi071 ceph-mon[90773]: pgmap v254: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:39.591 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:39 smithi071 ceph-mon[90773]: pgmap v255: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:39.591 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:13:39.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:39 smithi107 ceph-mon[79396]: pgmap v255: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:39.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:13:41.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.343+0000 7fd19e872640 1 -- 172.21.15.71:0/2991555360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1980fb450 msgr2=0x7fd1980fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:41.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.343+0000 7fd19e872640 1 --2- 172.21.15.71:0/2991555360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1980fb450 0x7fd1980fb860 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd1880048d0 tx=0x7fd188009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.343+0000 7fd19e872640 1 -- 172.21.15.71:0/2991555360 shutdown_connections 2024-09-10T10:13:41.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.343+0000 7fd19e872640 1 --2- 172.21.15.71:0/2991555360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1980fc720 0x7fd1980fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.343+0000 7fd19e872640 1 --2- 172.21.15.71:0/2991555360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1980fb450 0x7fd1980fb860 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.343+0000 7fd19e872640 1 -- 172.21.15.71:0/2991555360 >> 172.21.15.71:0/2991555360 conn(0x7fd1980f6c10 msgr2=0x7fd1980f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:41.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.343+0000 7fd19e872640 1 -- 172.21.15.71:0/2991555360 shutdown_connections 2024-09-10T10:13:41.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.343+0000 7fd19e872640 1 -- 172.21.15.71:0/2991555360 wait complete. 2024-09-10T10:13:41.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.344+0000 7fd19e872640 1 Processor -- start 2024-09-10T10:13:41.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.344+0000 7fd19e872640 1 -- start start 2024-09-10T10:13:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.344+0000 7fd19e872640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1980fb450 0x7fd19810d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.344+0000 7fd19e872640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1980fc720 0x7fd19810d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.344+0000 7fd19e872640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19810dcf0 con 0x7fd1980fb450 2024-09-10T10:13:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.344+0000 7fd19e872640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19810e4c0 con 0x7fd1980fc720 2024-09-10T10:13:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.344+0000 7fd197fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1980fb450 0x7fd19810d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.344+0000 7fd197fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1980fb450 0x7fd19810d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52438/0 (socket says 172.21.15.71:52438) 2024-09-10T10:13:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.344+0000 7fd197fff640 1 -- 172.21.15.71:0/789933321 learned_addr learned my addr 172.21.15.71:0/789933321 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:13:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.344+0000 7fd1977fe640 1 --2- 172.21.15.71:0/789933321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1980fc720 0x7fd19810d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.345+0000 7fd197fff640 1 -- 172.21.15.71:0/789933321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1980fc720 msgr2=0x7fd19810d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.345+0000 7fd197fff640 1 --2- 172.21.15.71:0/789933321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1980fc720 0x7fd19810d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.345+0000 7fd197fff640 1 -- 172.21.15.71:0/789933321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd188005040 con 0x7fd1980fb450 2024-09-10T10:13:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.345+0000 7fd197fff640 1 --2- 172.21.15.71:0/789933321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1980fb450 0x7fd19810d160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd1880043d0 tx=0x7fd188009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:41.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.345+0000 7fd194ff9640 1 -- 172.21.15.71:0/789933321 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd188038070 con 0x7fd1980fb450 2024-09-10T10:13:41.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.345+0000 7fd194ff9640 1 -- 172.21.15.71:0/789933321 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd18802ae90 con 0x7fd1980fb450 2024-09-10T10:13:41.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.345+0000 7fd19e872640 1 -- 172.21.15.71:0/789933321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19810e6f0 con 0x7fd1980fb450 2024-09-10T10:13:41.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.345+0000 7fd194ff9640 1 -- 172.21.15.71:0/789933321 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd18803e670 con 0x7fd1980fb450 2024-09-10T10:13:41.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.345+0000 7fd19e872640 1 -- 172.21.15.71:0/789933321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19810ec90 con 0x7fd1980fb450 2024-09-10T10:13:41.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.346+0000 7fd19e872640 1 -- 172.21.15.71:0/789933321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1980fa8b0 con 0x7fd1980fb450 2024-09-10T10:13:41.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.347+0000 7fd194ff9640 1 -- 172.21.15.71:0/789933321 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd188030020 con 0x7fd1980fb450 2024-09-10T10:13:41.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.347+0000 7fd194ff9640 1 --2- 172.21.15.71:0/789933321 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd18006e0b0 0x7fd180070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.347+0000 7fd194ff9640 1 -- 172.21.15.71:0/789933321 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd1880add90 con 0x7fd1980fb450 2024-09-10T10:13:41.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.347+0000 7fd1977fe640 1 --2- 172.21.15.71:0/789933321 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd18006e0b0 0x7fd180070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.348+0000 7fd1977fe640 1 --2- 172.21.15.71:0/789933321 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd18006e0b0 0x7fd180070560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd19810cf10 tx=0x7fd18c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:41.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.352+0000 7fd194ff9640 1 -- 172.21.15.71:0/789933321 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd188077110 con 0x7fd1980fb450 2024-09-10T10:13:41.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.539+0000 7fd19e872640 1 -- 172.21.15.71:0/789933321 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd198103ff0 con 0x7fd18006e0b0 2024-09-10T10:13:41.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.540+0000 7fd194ff9640 1 -- 172.21.15.71:0/789933321 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fd198103ff0 con 0x7fd18006e0b0 2024-09-10T10:13:41.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.542+0000 7fd19e872640 1 -- 172.21.15.71:0/789933321 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd18006e0b0 msgr2=0x7fd180070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.542+0000 7fd19e872640 1 --2- 172.21.15.71:0/789933321 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd18006e0b0 0x7fd180070560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd19810cf10 tx=0x7fd18c00b040 comp rx=0 tx=0).stop 2024-09-10T10:13:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.542+0000 7fd19e872640 1 -- 172.21.15.71:0/789933321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1980fb450 msgr2=0x7fd19810d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.542+0000 7fd19e872640 1 --2- 172.21.15.71:0/789933321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1980fb450 0x7fd19810d160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd1880043d0 tx=0x7fd188009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.542+0000 7fd19e872640 1 -- 172.21.15.71:0/789933321 shutdown_connections 2024-09-10T10:13:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.542+0000 7fd19e872640 1 --2- 172.21.15.71:0/789933321 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd18006e0b0 0x7fd180070560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.542+0000 7fd19e872640 1 --2- 172.21.15.71:0/789933321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1980fc720 0x7fd19810d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.542+0000 7fd19e872640 1 --2- 172.21.15.71:0/789933321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1980fb450 0x7fd19810d160 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.542+0000 7fd19e872640 1 -- 172.21.15.71:0/789933321 >> 172.21.15.71:0/789933321 conn(0x7fd1980f6c10 msgr2=0x7fd198066220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:41.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.542+0000 7fd19e872640 1 -- 172.21.15.71:0/789933321 shutdown_connections 2024-09-10T10:13:41.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:41.542+0000 7fd19e872640 1 -- 172.21.15.71:0/789933321 wait complete. 2024-09-10T10:13:41.553 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:41 smithi071 ceph-mon[90773]: pgmap v256: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:41.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:41 smithi107 ceph-mon[79396]: pgmap v256: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:42.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph orch ps' 2024-09-10T10:13:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:13:43.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:43 smithi071 ceph-mon[90773]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:43.540 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:43 smithi071 ceph-mon[90773]: pgmap v257: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:43.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:43 smithi107 ceph-mon[79396]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:43.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:43 smithi107 ceph-mon[79396]: pgmap v257: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:44.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.129+0000 7efcc0cd4640 1 -- 172.21.15.71:0/1308818616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc064fc0 msgr2=0x7efcbc065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:44.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.129+0000 7efcc0cd4640 1 --2- 172.21.15.71:0/1308818616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc064fc0 0x7efcbc065430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efcb00048d0 tx=0x7efcb0009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.129+0000 7efcc0cd4640 1 -- 172.21.15.71:0/1308818616 shutdown_connections 2024-09-10T10:13:44.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.129+0000 7efcc0cd4640 1 --2- 172.21.15.71:0/1308818616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc064fc0 0x7efcbc065430 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.129+0000 7efcc0cd4640 1 --2- 172.21.15.71:0/1308818616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcbc0fe460 0x7efcbc0fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.129+0000 7efcc0cd4640 1 -- 172.21.15.71:0/1308818616 >> 172.21.15.71:0/1308818616 conn(0x7efcbc0723b0 msgr2=0x7efcbc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:44.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.129+0000 7efcc0cd4640 1 -- 172.21.15.71:0/1308818616 shutdown_connections 2024-09-10T10:13:44.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.129+0000 7efcc0cd4640 1 -- 172.21.15.71:0/1308818616 wait complete. 2024-09-10T10:13:44.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcc0cd4640 1 Processor -- start 2024-09-10T10:13:44.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcc0cd4640 1 -- start start 2024-09-10T10:13:44.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcc0cd4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcbc064fc0 0x7efcbc0fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcc0cd4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc0fe460 0x7efcbc0fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcc0cd4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0fbfe0 con 0x7efcbc0fe460 2024-09-10T10:13:44.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcc0cd4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0fc150 con 0x7efcbc064fc0 2024-09-10T10:13:44.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcb9d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc0fe460 0x7efcbc0fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcb9d9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc0fe460 0x7efcbc0fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34008/0 (socket says 172.21.15.71:34008) 2024-09-10T10:13:44.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcb9d9b640 1 -- 172.21.15.71:0/985830205 learned_addr learned my addr 172.21.15.71:0/985830205 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:13:44.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcba59c640 1 --2- 172.21.15.71:0/985830205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcbc064fc0 0x7efcbc0fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcb9d9b640 1 -- 172.21.15.71:0/985830205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcbc064fc0 msgr2=0x7efcbc0fb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:44.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcb9d9b640 1 --2- 172.21.15.71:0/985830205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcbc064fc0 0x7efcbc0fb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcb9d9b640 1 -- 172.21.15.71:0/985830205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0005040 con 0x7efcbc0fe460 2024-09-10T10:13:44.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.130+0000 7efcb9d9b640 1 --2- 172.21.15.71:0/985830205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc0fe460 0x7efcbc0fbaa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efcb0003080 tx=0x7efcb0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:44.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.131+0000 7efcaaffd640 1 -- 172.21.15.71:0/985830205 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcb0038070 con 0x7efcbc0fe460 2024-09-10T10:13:44.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.131+0000 7efcc0cd4640 1 -- 172.21.15.71:0/985830205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcbc0fc3d0 con 0x7efcbc0fe460 2024-09-10T10:13:44.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.131+0000 7efcaaffd640 1 -- 172.21.15.71:0/985830205 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efcb00097e0 con 0x7efcbc0fe460 2024-09-10T10:13:44.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.131+0000 7efcaaffd640 1 -- 172.21.15.71:0/985830205 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcb003d420 con 0x7efcbc0fe460 2024-09-10T10:13:44.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.131+0000 7efcc0cd4640 1 -- 172.21.15.71:0/985830205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc119850 con 0x7efcbc0fe460 2024-09-10T10:13:44.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.132+0000 7efcc0cd4640 1 -- 172.21.15.71:0/985830205 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcbc0fdcf0 con 0x7efcbc0fe460 2024-09-10T10:13:44.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.132+0000 7efcaaffd640 1 -- 172.21.15.71:0/985830205 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efcb0030020 con 0x7efcbc0fe460 2024-09-10T10:13:44.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.132+0000 7efcaaffd640 1 --2- 172.21.15.71:0/985830205 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7efca406e0b0 0x7efca4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.133+0000 7efcaaffd640 1 -- 172.21.15.71:0/985830205 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7efcb00ae020 con 0x7efcbc0fe460 2024-09-10T10:13:44.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.133+0000 7efcba59c640 1 --2- 172.21.15.71:0/985830205 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7efca406e0b0 0x7efca4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.133+0000 7efcba59c640 1 --2- 172.21.15.71:0/985830205 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7efca406e0b0 0x7efca4070560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efcac004e40 tx=0x7efcac009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:44.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.137+0000 7efcaaffd640 1 -- 172.21.15.71:0/985830205 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efcb00772f0 con 0x7efcbc0fe460 2024-09-10T10:13:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.315+0000 7efcc0cd4640 1 -- 172.21.15.71:0/985830205 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efcbc0fc3d0 con 0x7efca406e0b0 2024-09-10T10:13:44.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.324+0000 7efcaaffd640 1 -- 172.21.15.71:0/985830205 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7efcbc0fc3d0 con 0x7efca406e0b0 2024-09-10T10:13:44.326 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:13:44.326 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (48s) 23s ago 17m 15.8M - 0.25.0 c8568f914cd2 a2cae604bef8 2024-09-10T10:13:44.327 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (6m) 23s ago 17m 6903k - 19.1.1-305-g1cf819b7 41d671128357 5dc74ad01560 2024-09-10T10:13:44.327 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (6m) 76s ago 16m 6891k - 19.1.1-305-g1cf819b7 41d671128357 6f4355e875db 2024-09-10T10:13:44.327 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (27s) 23s ago 17m 45.4M - 9.4.12 2bacad6d85d8 9e07e7b3dcf0 2024-09-10T10:13:44.327 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (2m) 23s ago 12m 17.2M - 19.1.1-305-g1cf819b7 41d671128357 6ec036debe92 2024-09-10T10:13:44.327 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (2m) 23s ago 12m 65.9M - 19.1.1-305-g1cf819b7 41d671128357 58af9b545bf4 2024-09-10T10:13:44.327 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (111s) 76s ago 12m 137M - 19.1.1-305-g1cf819b7 41d671128357 b3a09b16124b 2024-09-10T10:13:44.327 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (95s) 76s ago 12m 14.4M - 19.1.1-305-g1cf819b7 41d671128357 bdcd45e9b3e2 2024-09-10T10:13:44.327 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (8m) 23s ago 18m 515M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:13:44.327 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (7m) 76s ago 16m 442M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:13:44.327 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (7m) 23s ago 18m 56.3M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:13:44.327 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (7m) 76s ago 16m 38.9M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:13:44.327 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (83s) 23s ago 17m 8056k - 1.5.0 0da6a335fe13 06ab97573e3d 2024-09-10T10:13:44.328 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (79s) 76s ago 16m 3598k - 1.5.0 0da6a335fe13 c514485d2dcf 2024-09-10T10:13:44.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (6m) 23s ago 15m 106M 1557M 19.1.1-305-g1cf819b7 41d671128357 f1e9da1144c1 2024-09-10T10:13:44.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (5m) 23s ago 15m 110M 1557M 19.1.1-305-g1cf819b7 41d671128357 5afc8bef5343 2024-09-10T10:13:44.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (4m) 23s ago 14m 97.7M 1557M 19.1.1-305-g1cf819b7 41d671128357 5e5976fcfaa8 2024-09-10T10:13:44.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (4m) 76s ago 14m 116M 2581M 19.1.1-305-g1cf819b7 41d671128357 e22ee626ccd0 2024-09-10T10:13:44.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (3m) 76s ago 14m 99.5M 2581M 19.1.1-305-g1cf819b7 41d671128357 e92f23ad2c77 2024-09-10T10:13:44.328 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (3m) 76s ago 13m 95.1M 2581M 19.1.1-305-g1cf819b7 41d671128357 3440ee1c721e 2024-09-10T10:13:44.328 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (63s) 23s ago 17m 47.2M - 2.43.0 a07b618ecd1d 9ad96937a042 2024-09-10T10:13:44.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.326+0000 7efcc0cd4640 1 -- 172.21.15.71:0/985830205 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7efca406e0b0 msgr2=0x7efca4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:44.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.326+0000 7efcc0cd4640 1 --2- 172.21.15.71:0/985830205 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7efca406e0b0 0x7efca4070560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efcac004e40 tx=0x7efcac009040 comp rx=0 tx=0).stop 2024-09-10T10:13:44.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.326+0000 7efcc0cd4640 1 -- 172.21.15.71:0/985830205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc0fe460 msgr2=0x7efcbc0fbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:44.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.326+0000 7efcc0cd4640 1 --2- 172.21.15.71:0/985830205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc0fe460 0x7efcbc0fbaa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efcb0003080 tx=0x7efcb0009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.326+0000 7efcc0cd4640 1 -- 172.21.15.71:0/985830205 shutdown_connections 2024-09-10T10:13:44.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.326+0000 7efcc0cd4640 1 --2- 172.21.15.71:0/985830205 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7efca406e0b0 0x7efca4070560 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.326+0000 7efcc0cd4640 1 --2- 172.21.15.71:0/985830205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc0fe460 0x7efcbc0fbaa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.326+0000 7efcc0cd4640 1 --2- 172.21.15.71:0/985830205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcbc064fc0 0x7efcbc0fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.326+0000 7efcc0cd4640 1 -- 172.21.15.71:0/985830205 >> 172.21.15.71:0/985830205 conn(0x7efcbc0723b0 msgr2=0x7efcbc1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:44.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.327+0000 7efcc0cd4640 1 -- 172.21.15.71:0/985830205 shutdown_connections 2024-09-10T10:13:44.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:44.327+0000 7efcc0cd4640 1 -- 172.21.15.71:0/985830205 wait complete. 2024-09-10T10:13:45.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph orch upgrade status' 2024-09-10T10:13:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:13:45.563 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:45 smithi071 ceph-mon[90773]: pgmap v258: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:13:45.563 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:45 smithi071 ceph-mon[90773]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:45.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:45 smithi107 ceph-mon[79396]: pgmap v258: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:13:45.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:45 smithi107 ceph-mon[79396]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 -- 172.21.15.71:0/961084867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ce01025f0 msgr2=0x7f1ce01029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 --2- 172.21.15.71:0/961084867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ce01025f0 0x7f1ce01029c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0048d0 tx=0x7f1cdc009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 -- 172.21.15.71:0/961084867 shutdown_connections 2024-09-10T10:13:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 --2- 172.21.15.71:0/961084867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ce00fac60 0x7f1ce00fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 --2- 172.21.15.71:0/961084867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ce01025f0 0x7f1ce01029c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 -- 172.21.15.71:0/961084867 >> 172.21.15.71:0/961084867 conn(0x7f1ce0070c80 msgr2=0x7f1ce0071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 -- 172.21.15.71:0/961084867 shutdown_connections 2024-09-10T10:13:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 -- 172.21.15.71:0/961084867 wait complete. 2024-09-10T10:13:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 Processor -- start 2024-09-10T10:13:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 -- start start 2024-09-10T10:13:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ce00fac60 0x7f1ce01131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ce01025f0 0x7f1ce0113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce0113d10 con 0x7f1ce00fac60 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.000+0000 7f1ce7f24640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce010d150 con 0x7f1ce01025f0 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.001+0000 7f1ce5cc0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ce00fac60 0x7f1ce01131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.001+0000 7f1ce5cc0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ce00fac60 0x7f1ce01131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34024/0 (socket says 172.21.15.71:34024) 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.001+0000 7f1ce5cc0640 1 -- 172.21.15.71:0/3835100338 learned_addr learned my addr 172.21.15.71:0/3835100338 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.001+0000 7f1ce54bf640 1 --2- 172.21.15.71:0/3835100338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ce01025f0 0x7f1ce0113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.001+0000 7f1ce5cc0640 1 -- 172.21.15.71:0/3835100338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ce01025f0 msgr2=0x7f1ce0113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.001+0000 7f1ce5cc0640 1 --2- 172.21.15.71:0/3835100338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ce01025f0 0x7f1ce0113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.001+0000 7f1ce5cc0640 1 -- 172.21.15.71:0/3835100338 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc005040 con 0x7f1ce00fac60 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.001+0000 7f1ce5cc0640 1 --2- 172.21.15.71:0/3835100338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ce00fac60 0x7f1ce01131d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc000c00 tx=0x7f1cdc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.001+0000 7f1cd67fc640 1 -- 172.21.15.71:0/3835100338 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cdc038070 con 0x7f1ce00fac60 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.001+0000 7f1ce7f24640 1 -- 172.21.15.71:0/3835100338 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce010d3d0 con 0x7f1ce00fac60 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.001+0000 7f1cd67fc640 1 -- 172.21.15.71:0/3835100338 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1cdc02ade0 con 0x7f1ce00fac60 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.001+0000 7f1cd67fc640 1 -- 172.21.15.71:0/3835100338 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cdc02c7e0 con 0x7f1ce00fac60 2024-09-10T10:13:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.001+0000 7f1ce7f24640 1 -- 172.21.15.71:0/3835100338 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce010d910 con 0x7f1ce00fac60 2024-09-10T10:13:47.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.003+0000 7f1ce7f24640 1 -- 172.21.15.71:0/3835100338 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce0065810 con 0x7f1ce00fac60 2024-09-10T10:13:47.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.003+0000 7f1cd67fc640 1 -- 172.21.15.71:0/3835100338 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1cdc030020 con 0x7f1ce00fac60 2024-09-10T10:13:47.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.003+0000 7f1cd67fc640 1 --2- 172.21.15.71:0/3835100338 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f1ccc06e0b0 0x7f1ccc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.003+0000 7f1cd67fc640 1 -- 172.21.15.71:0/3835100338 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f1cdc0ad870 con 0x7f1ce00fac60 2024-09-10T10:13:47.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.004+0000 7f1ce54bf640 1 --2- 172.21.15.71:0/3835100338 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f1ccc06e0b0 0x7f1ccc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.004+0000 7f1ce54bf640 1 --2- 172.21.15.71:0/3835100338 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f1ccc06e0b0 0x7f1ccc070560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1ce010ea90 tx=0x7f1cd000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.008+0000 7f1cd67fc640 1 -- 172.21.15.71:0/3835100338 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1cdc076bf0 con 0x7f1ce00fac60 2024-09-10T10:13:47.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.189+0000 7f1ce7f24640 1 -- 172.21.15.71:0/3835100338 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ce004b720 con 0x7f1ccc06e0b0 2024-09-10T10:13:47.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.190+0000 7f1cd67fc640 1 -- 172.21.15.71:0/3835100338 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f1ce004b720 con 0x7f1ccc06e0b0 2024-09-10T10:13:47.192 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:13:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": null, 2024-09-10T10:13:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": false, 2024-09-10T10:13:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "", 2024-09-10T10:13:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-10T10:13:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": null, 2024-09-10T10:13:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "", 2024-09-10T10:13:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-10T10:13:47.193 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:13:47.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.192+0000 7f1ce7f24640 1 -- 172.21.15.71:0/3835100338 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f1ccc06e0b0 msgr2=0x7f1ccc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:47.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.192+0000 7f1ce7f24640 1 --2- 172.21.15.71:0/3835100338 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f1ccc06e0b0 0x7f1ccc070560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1ce010ea90 tx=0x7f1cd000b040 comp rx=0 tx=0).stop 2024-09-10T10:13:47.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.192+0000 7f1ce7f24640 1 -- 172.21.15.71:0/3835100338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ce00fac60 msgr2=0x7f1ce01131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:47.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.192+0000 7f1ce7f24640 1 --2- 172.21.15.71:0/3835100338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ce00fac60 0x7f1ce01131d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc000c00 tx=0x7f1cdc009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.192+0000 7f1ce7f24640 1 -- 172.21.15.71:0/3835100338 shutdown_connections 2024-09-10T10:13:47.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.192+0000 7f1ce7f24640 1 --2- 172.21.15.71:0/3835100338 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f1ccc06e0b0 0x7f1ccc070560 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.192+0000 7f1ce7f24640 1 --2- 172.21.15.71:0/3835100338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ce01025f0 0x7f1ce0113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.192+0000 7f1ce7f24640 1 --2- 172.21.15.71:0/3835100338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ce00fac60 0x7f1ce01131d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.192+0000 7f1ce7f24640 1 -- 172.21.15.71:0/3835100338 >> 172.21.15.71:0/3835100338 conn(0x7f1ce0070c80 msgr2=0x7f1ce00f9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:47.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.192+0000 7f1ce7f24640 1 -- 172.21.15.71:0/3835100338 shutdown_connections 2024-09-10T10:13:47.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:47.193+0000 7f1ce7f24640 1 -- 172.21.15.71:0/3835100338 wait complete. 2024-09-10T10:13:47.484 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:47 smithi071 ceph-mon[90773]: pgmap v259: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:47.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:47 smithi107 ceph-mon[79396]: pgmap v259: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:47.767 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph health detail' 2024-09-10T10:13:48.012 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:13:48.385 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:48 smithi071 ceph-mon[90773]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:48.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:48 smithi107 ceph-mon[79396]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:13:49.413 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:49 smithi071 ceph-mon[90773]: pgmap v260: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.631+0000 7f7f82965640 1 -- 172.21.15.71:0/3809316694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f7c0fd5a0 msgr2=0x7f7f7c0fd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.631+0000 7f7f82965640 1 --2- 172.21.15.71:0/3809316694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f7c0fd5a0 0x7f7f7c0fd970 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0048d0 tx=0x7f7f6c009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.631+0000 7f7f82965640 1 -- 172.21.15.71:0/3809316694 shutdown_connections 2024-09-10T10:13:49.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.631+0000 7f7f82965640 1 --2- 172.21.15.71:0/3809316694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f7c0fdf40 0x7f7f7c106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.631+0000 7f7f82965640 1 --2- 172.21.15.71:0/3809316694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f7c0fd5a0 0x7f7f7c0fd970 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.631+0000 7f7f82965640 1 -- 172.21.15.71:0/3809316694 >> 172.21.15.71:0/3809316694 conn(0x7f7f7c0f7000 msgr2=0x7f7f7c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:49.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.631+0000 7f7f82965640 1 -- 172.21.15.71:0/3809316694 shutdown_connections 2024-09-10T10:13:49.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.631+0000 7f7f82965640 1 -- 172.21.15.71:0/3809316694 wait complete. 2024-09-10T10:13:49.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.631+0000 7f7f82965640 1 Processor -- start 2024-09-10T10:13:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.631+0000 7f7f82965640 1 -- start start 2024-09-10T10:13:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f82965640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f7c0fd5a0 0x7f7f7c113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f82965640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f7c0fdf40 0x7f7f7c1137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f82965640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c113da0 con 0x7f7f7c0fd5a0 2024-09-10T10:13:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f82965640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c10d1e0 con 0x7f7f7c0fdf40 2024-09-10T10:13:49.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f7bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f7c0fd5a0 0x7f7f7c113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f7bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f7c0fd5a0 0x7f7f7c113260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34036/0 (socket says 172.21.15.71:34036) 2024-09-10T10:13:49.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f7bfff640 1 -- 172.21.15.71:0/3486550395 learned_addr learned my addr 172.21.15.71:0/3486550395 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:13:49.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f7b7fe640 1 --2- 172.21.15.71:0/3486550395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f7c0fdf40 0x7f7f7c1137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f7bfff640 1 -- 172.21.15.71:0/3486550395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f7c0fdf40 msgr2=0x7f7f7c1137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:49.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f7bfff640 1 --2- 172.21.15.71:0/3486550395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f7c0fdf40 0x7f7f7c1137a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f7bfff640 1 -- 172.21.15.71:0/3486550395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c005040 con 0x7f7f7c0fd5a0 2024-09-10T10:13:49.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f7b7fe640 1 --2- 172.21.15.71:0/3486550395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f7c0fdf40 0x7f7f7c1137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:13:49.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f7bfff640 1 --2- 172.21.15.71:0/3486550395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f7c0fd5a0 0x7f7f7c113260 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009ac0 tx=0x7f7f6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:49.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f78ff9640 1 -- 172.21.15.71:0/3486550395 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f6c038070 con 0x7f7f7c0fd5a0 2024-09-10T10:13:49.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f82965640 1 -- 172.21.15.71:0/3486550395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c10d460 con 0x7f7f7c0fd5a0 2024-09-10T10:13:49.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.632+0000 7f7f78ff9640 1 -- 172.21.15.71:0/3486550395 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7f6c008ed0 con 0x7f7f7c0fd5a0 2024-09-10T10:13:49.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.633+0000 7f7f78ff9640 1 -- 172.21.15.71:0/3486550395 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f6c009620 con 0x7f7f7c0fd5a0 2024-09-10T10:13:49.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.633+0000 7f7f82965640 1 -- 172.21.15.71:0/3486550395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c10d920 con 0x7f7f7c0fd5a0 2024-09-10T10:13:49.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.634+0000 7f7f82965640 1 -- 172.21.15.71:0/3486550395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7c066270 con 0x7f7f7c0fd5a0 2024-09-10T10:13:49.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.634+0000 7f7f78ff9640 1 -- 172.21.15.71:0/3486550395 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7f6c030020 con 0x7f7f7c0fd5a0 2024-09-10T10:13:49.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.635+0000 7f7f78ff9640 1 --2- 172.21.15.71:0/3486550395 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7f6406e0b0 0x7f7f64070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.635+0000 7f7f7b7fe640 1 --2- 172.21.15.71:0/3486550395 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7f6406e0b0 0x7f7f64070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.635+0000 7f7f78ff9640 1 -- 172.21.15.71:0/3486550395 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f7f6c0ae0e0 con 0x7f7f7c0fd5a0 2024-09-10T10:13:49.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.635+0000 7f7f7b7fe640 1 --2- 172.21.15.71:0/3486550395 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7f6406e0b0 0x7f7f64070560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7f70007fd0 tx=0x7f7f70009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:49.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.640+0000 7f7f78ff9640 1 -- 172.21.15.71:0/3486550395 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7f6c0773b0 con 0x7f7f7c0fd5a0 2024-09-10T10:13:49.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:49 smithi107 ceph-mon[79396]: pgmap v260: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.870+0000 7f7f82965640 1 -- 172.21.15.71:0/3486550395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7f7c0fac40 con 0x7f7f7c0fd5a0 2024-09-10T10:13:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.870+0000 7f7f78ff9640 1 -- 172.21.15.71:0/3486550395 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7f6c07aa70 con 0x7f7f7c0fd5a0 2024-09-10T10:13:49.873 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-10T10:13:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.872+0000 7f7f82965640 1 -- 172.21.15.71:0/3486550395 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7f6406e0b0 msgr2=0x7f7f64070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.872+0000 7f7f82965640 1 --2- 172.21.15.71:0/3486550395 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7f6406e0b0 0x7f7f64070560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7f70007fd0 tx=0x7f7f70009e90 comp rx=0 tx=0).stop 2024-09-10T10:13:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.872+0000 7f7f82965640 1 -- 172.21.15.71:0/3486550395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f7c0fd5a0 msgr2=0x7f7f7c113260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.872+0000 7f7f82965640 1 --2- 172.21.15.71:0/3486550395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f7c0fd5a0 0x7f7f7c113260 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009ac0 tx=0x7f7f6c009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.872+0000 7f7f82965640 1 -- 172.21.15.71:0/3486550395 shutdown_connections 2024-09-10T10:13:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.872+0000 7f7f82965640 1 --2- 172.21.15.71:0/3486550395 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7f6406e0b0 0x7f7f64070560 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.872+0000 7f7f82965640 1 --2- 172.21.15.71:0/3486550395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f7c0fdf40 0x7f7f7c1137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.872+0000 7f7f82965640 1 --2- 172.21.15.71:0/3486550395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f7c0fd5a0 0x7f7f7c113260 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.872+0000 7f7f82965640 1 -- 172.21.15.71:0/3486550395 >> 172.21.15.71:0/3486550395 conn(0x7f7f7c0f7000 msgr2=0x7f7f7c106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.872+0000 7f7f82965640 1 -- 172.21.15.71:0/3486550395 shutdown_connections 2024-09-10T10:13:49.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:49.872+0000 7f7f82965640 1 -- 172.21.15.71:0/3486550395 wait complete. 2024-09-10T10:13:50.458 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:50 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/3486550395' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:13:50.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph versions' 2024-09-10T10:13:50.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:50 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/3486550395' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T10:13:50.726 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:13:51.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:51 smithi071 ceph-mon[90773]: pgmap v261: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:51.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:51 smithi107 ceph-mon[79396]: pgmap v261: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:13:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.297+0000 7f78aa87e640 1 -- 172.21.15.71:0/1219540728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78a4102570 msgr2=0x7f78a4102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.297+0000 7f78aa87e640 1 --2- 172.21.15.71:0/1219540728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78a4102570 0x7f78a4102940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f78940048d0 tx=0x7f7894009da0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.297+0000 7f78aa87e640 1 -- 172.21.15.71:0/1219540728 shutdown_connections 2024-09-10T10:13:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.297+0000 7f78aa87e640 1 --2- 172.21.15.71:0/1219540728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a4102f10 0x7f78a40fc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.297+0000 7f78aa87e640 1 --2- 172.21.15.71:0/1219540728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78a4102570 0x7f78a4102940 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.297+0000 7f78aa87e640 1 -- 172.21.15.71:0/1219540728 >> 172.21.15.71:0/1219540728 conn(0x7f78a40f8110 msgr2=0x7f78a40fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.297+0000 7f78aa87e640 1 -- 172.21.15.71:0/1219540728 shutdown_connections 2024-09-10T10:13:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.297+0000 7f78aa87e640 1 -- 172.21.15.71:0/1219540728 wait complete. 2024-09-10T10:13:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.298+0000 7f78aa87e640 1 Processor -- start 2024-09-10T10:13:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.298+0000 7f78aa87e640 1 -- start start 2024-09-10T10:13:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.298+0000 7f78aa87e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a4102570 0x7f78a41131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.298+0000 7f78aa87e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78a4102f10 0x7f78a4113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.298+0000 7f78aa87e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4113d30 con 0x7f78a4102f10 2024-09-10T10:13:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.298+0000 7f78aa87e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a410d170 con 0x7f78a4102570 2024-09-10T10:13:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.298+0000 7f789bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78a4102f10 0x7f78a4113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.298+0000 7f789bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78a4102f10 0x7f78a4113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34044/0 (socket says 172.21.15.71:34044) 2024-09-10T10:13:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.298+0000 7f789bfff640 1 -- 172.21.15.71:0/2575251086 learned_addr learned my addr 172.21.15.71:0/2575251086 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:13:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.298+0000 7f78a3fff640 1 --2- 172.21.15.71:0/2575251086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a4102570 0x7f78a41131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.298+0000 7f789bfff640 1 -- 172.21.15.71:0/2575251086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a4102570 msgr2=0x7f78a41131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.298+0000 7f789bfff640 1 --2- 172.21.15.71:0/2575251086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a4102570 0x7f78a41131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.298+0000 7f789bfff640 1 -- 172.21.15.71:0/2575251086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7894005040 con 0x7f78a4102f10 2024-09-10T10:13:52.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.299+0000 7f789bfff640 1 --2- 172.21.15.71:0/2575251086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78a4102f10 0x7f78a4113730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f788c009af0 tx=0x7f788c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:52.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.299+0000 7f78a17fa640 1 -- 172.21.15.71:0/2575251086 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f788c007c30 con 0x7f78a4102f10 2024-09-10T10:13:52.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.299+0000 7f78a17fa640 1 -- 172.21.15.71:0/2575251086 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f788c00f040 con 0x7f78a4102f10 2024-09-10T10:13:52.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.299+0000 7f78a17fa640 1 -- 172.21.15.71:0/2575251086 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f788c00da10 con 0x7f78a4102f10 2024-09-10T10:13:52.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.299+0000 7f78aa87e640 1 -- 172.21.15.71:0/2575251086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a410d450 con 0x7f78a4102f10 2024-09-10T10:13:52.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.299+0000 7f78aa87e640 1 -- 172.21.15.71:0/2575251086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a410d9f0 con 0x7f78a4102f10 2024-09-10T10:13:52.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.300+0000 7f78aa87e640 1 -- 172.21.15.71:0/2575251086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a40fdcf0 con 0x7f78a4102f10 2024-09-10T10:13:52.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.300+0000 7f78a17fa640 1 -- 172.21.15.71:0/2575251086 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f788c009670 con 0x7f78a4102f10 2024-09-10T10:13:52.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.301+0000 7f78a17fa640 1 --2- 172.21.15.71:0/2575251086 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f789006e0b0 0x7f7890070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:52.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.301+0000 7f78a3fff640 1 --2- 172.21.15.71:0/2575251086 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f789006e0b0 0x7f7890070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:52.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.301+0000 7f78a17fa640 1 -- 172.21.15.71:0/2575251086 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f788c08da10 con 0x7f78a4102f10 2024-09-10T10:13:52.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.302+0000 7f78a3fff640 1 --2- 172.21.15.71:0/2575251086 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f789006e0b0 0x7f7890070560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7894007ac0 tx=0x7f7894035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:52.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.305+0000 7f78a17fa640 1 -- 172.21.15.71:0/2575251086 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f788c056d60 con 0x7f78a4102f10 2024-09-10T10:13:52.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.542+0000 7f78aa87e640 1 -- 172.21.15.71:0/2575251086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f78a40fbd70 con 0x7f78a4102f10 2024-09-10T10:13:52.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.543+0000 7f78a17fa640 1 -- 172.21.15.71:0/2575251086 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f788c05a420 con 0x7f78a4102f10 2024-09-10T10:13:52.544 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:13:52.544 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 14 2024-09-10T10:13:52.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:13:52.546 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:13:52.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.545+0000 7f78aa87e640 1 -- 172.21.15.71:0/2575251086 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f789006e0b0 msgr2=0x7f7890070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:52.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.545+0000 7f78aa87e640 1 --2- 172.21.15.71:0/2575251086 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f789006e0b0 0x7f7890070560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7894007ac0 tx=0x7f7894035040 comp rx=0 tx=0).stop 2024-09-10T10:13:52.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.545+0000 7f78aa87e640 1 -- 172.21.15.71:0/2575251086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78a4102f10 msgr2=0x7f78a4113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:52.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.545+0000 7f78aa87e640 1 --2- 172.21.15.71:0/2575251086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78a4102f10 0x7f78a4113730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f788c009af0 tx=0x7f788c004570 comp rx=0 tx=0).stop 2024-09-10T10:13:52.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.545+0000 7f78aa87e640 1 -- 172.21.15.71:0/2575251086 shutdown_connections 2024-09-10T10:13:52.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.545+0000 7f78aa87e640 1 --2- 172.21.15.71:0/2575251086 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f789006e0b0 0x7f7890070560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.545+0000 7f78aa87e640 1 --2- 172.21.15.71:0/2575251086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78a4102f10 0x7f78a4113730 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.545+0000 7f78aa87e640 1 --2- 172.21.15.71:0/2575251086 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78a4102570 0x7f78a41131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.545+0000 7f78aa87e640 1 -- 172.21.15.71:0/2575251086 >> 172.21.15.71:0/2575251086 conn(0x7f78a40f8110 msgr2=0x7f78a40f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:52.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.545+0000 7f78aa87e640 1 -- 172.21.15.71:0/2575251086 shutdown_connections 2024-09-10T10:13:52.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:13:52.545+0000 7f78aa87e640 1 -- 172.21.15.71:0/2575251086 wait complete. 2024-09-10T10:13:53.199 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-10T10:13:53.449 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:13:53.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:53 smithi071 ceph-mon[90773]: pgmap v262: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:53.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:53 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2575251086' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:53 smithi107 ceph-mon[79396]: pgmap v262: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:13:53.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:53 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2575251086' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:13:54.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:13:54.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:13:55.153 INFO:teuthology.orchestra.run.smithi071.stdout:wait for servicemap items w/ changing names to refresh 2024-09-10T10:13:55.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:55 smithi107 ceph-mon[79396]: pgmap v263: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:13:55.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:55 smithi071 ceph-mon[90773]: pgmap v263: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:13:55.848 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'sleep 60' 2024-09-10T10:13:56.095 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:13:57.629 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:57 smithi071 ceph-mon[90773]: pgmap v264: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-10T10:13:57.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:57 smithi107 ceph-mon[79396]: pgmap v264: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-10T10:13:59.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:13:59 smithi107 ceph-mon[79396]: pgmap v265: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:13:59.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:13:59 smithi071 ceph-mon[90773]: pgmap v265: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:14:01.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:01 smithi107 ceph-mon[79396]: pgmap v266: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:14:01.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:01 smithi071 ceph-mon[90773]: pgmap v266: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:14:03.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:03 smithi107 ceph-mon[79396]: pgmap v267: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-10T10:14:03.790 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:03 smithi071 ceph-mon[90773]: pgmap v267: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-10T10:14:05.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:05 smithi107 ceph-mon[79396]: pgmap v268: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-10T10:14:05.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:05 smithi071 ceph-mon[90773]: pgmap v268: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-10T10:14:07.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:07 smithi107 ceph-mon[79396]: pgmap v269: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-10T10:14:07.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:07 smithi071 ceph-mon[90773]: pgmap v269: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-10T10:14:09.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:09 smithi107 ceph-mon[79396]: pgmap v270: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:09.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:14:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:09 smithi071 ceph-mon[90773]: pgmap v270: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:14:11.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:11 smithi107 ceph-mon[79396]: pgmap v271: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:11.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:11 smithi071 ceph-mon[90773]: pgmap v271: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:13.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:13 smithi107 ceph-mon[79396]: pgmap v272: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:13.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:13 smithi071 ceph-mon[90773]: pgmap v272: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:15.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:15 smithi107 ceph-mon[79396]: pgmap v273: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:14:15.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:15 smithi071 ceph-mon[90773]: pgmap v273: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:14:17.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:17 smithi107 ceph-mon[79396]: pgmap v274: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:17.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:17 smithi071 ceph-mon[90773]: pgmap v274: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:19.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:19 smithi107 ceph-mon[79396]: pgmap v275: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:19.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:19 smithi071 ceph-mon[90773]: pgmap v275: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:21 smithi107 ceph-mon[79396]: pgmap v276: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:21.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:21 smithi071 ceph-mon[90773]: pgmap v276: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:23.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:23 smithi107 ceph-mon[79396]: pgmap v277: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:23.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:23 smithi071 ceph-mon[90773]: pgmap v277: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:24.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:14:24.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:14:25.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:25 smithi107 ceph-mon[79396]: pgmap v278: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:14:25.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:25 smithi071 ceph-mon[90773]: pgmap v278: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:14:26.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:14:26.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:14:26.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:14:26.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:14:26.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:14:26.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:14:26.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:14:26.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:14:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:27 smithi107 ceph-mon[79396]: pgmap v279: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:27 smithi071 ceph-mon[90773]: pgmap v279: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:29 smithi107 ceph-mon[79396]: pgmap v280: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:29.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:29 smithi071 ceph-mon[90773]: pgmap v280: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:31.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:31 smithi107 ceph-mon[79396]: pgmap v281: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:31 smithi071 ceph-mon[90773]: pgmap v281: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:33.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:33 smithi107 ceph-mon[79396]: pgmap v282: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:33 smithi071 ceph-mon[90773]: pgmap v282: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:35.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:35 smithi107 ceph-mon[79396]: pgmap v283: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:14:35.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:35 smithi071 ceph-mon[90773]: pgmap v283: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:14:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:37 smithi107 ceph-mon[79396]: pgmap v284: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:37 smithi071 ceph-mon[90773]: pgmap v284: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:39 smithi071 ceph-mon[90773]: pgmap v285: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:14:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:39 smithi107 ceph-mon[79396]: pgmap v285: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:14:41.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:41 smithi071 ceph-mon[90773]: pgmap v286: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:41.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:41 smithi107 ceph-mon[79396]: pgmap v286: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:43.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:43 smithi071 ceph-mon[90773]: pgmap v287: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:43.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:43 smithi107 ceph-mon[79396]: pgmap v287: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:45.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:45 smithi071 ceph-mon[90773]: pgmap v288: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:14:45.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:45 smithi107 ceph-mon[79396]: pgmap v288: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:14:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:47 smithi071 ceph-mon[90773]: pgmap v289: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:47.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:47 smithi107 ceph-mon[79396]: pgmap v289: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:49 smithi071 ceph-mon[90773]: pgmap v290: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:49.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:49 smithi107 ceph-mon[79396]: pgmap v290: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:51.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:51 smithi071 ceph-mon[90773]: pgmap v291: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:51.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:51 smithi107 ceph-mon[79396]: pgmap v291: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:14:53.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:53 smithi071 ceph-mon[90773]: pgmap v292: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:53.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:53 smithi107 ceph-mon[79396]: pgmap v292: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:54.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:14:54.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:14:55.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:55 smithi071 ceph-mon[90773]: pgmap v293: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:14:55.796 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:55 smithi107 ceph-mon[79396]: pgmap v293: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:14:57.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:57 smithi071 ceph-mon[90773]: pgmap v294: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:57.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:57 smithi107 ceph-mon[79396]: pgmap v294: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:14:58.401 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph orch ps' 2024-09-10T10:14:58.656 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:14:59.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:14:59 smithi071 ceph-mon[90773]: pgmap v295: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:14:59.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:14:59 smithi107 ceph-mon[79396]: pgmap v295: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:15:00.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.142+0000 7f730fd90640 1 -- 172.21.15.71:0/50627520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7308102f10 msgr2=0x7f73080fc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:00.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.142+0000 7f730fd90640 1 --2- 172.21.15.71:0/50627520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7308102f10 0x7f73080fc5d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f72f80048d0 tx=0x7f72f8009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:00.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.142+0000 7f730fd90640 1 -- 172.21.15.71:0/50627520 shutdown_connections 2024-09-10T10:15:00.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.142+0000 7f730fd90640 1 --2- 172.21.15.71:0/50627520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7308102f10 0x7f73080fc5d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:00.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.142+0000 7f730fd90640 1 --2- 172.21.15.71:0/50627520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7308102570 0x7f7308102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:00.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.142+0000 7f730fd90640 1 -- 172.21.15.71:0/50627520 >> 172.21.15.71:0/50627520 conn(0x7f73080f8110 msgr2=0x7f73080fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:00.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.142+0000 7f730fd90640 1 -- 172.21.15.71:0/50627520 shutdown_connections 2024-09-10T10:15:00.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.142+0000 7f730fd90640 1 -- 172.21.15.71:0/50627520 wait complete. 2024-09-10T10:15:00.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.143+0000 7f730fd90640 1 Processor -- start 2024-09-10T10:15:00.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.143+0000 7f730fd90640 1 -- start start 2024-09-10T10:15:00.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.143+0000 7f730fd90640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7308102570 0x7f73081131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:00.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.143+0000 7f730fd90640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7308102f10 0x7f7308113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:00.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.143+0000 7f730fd90640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7308113d10 con 0x7f7308102570 2024-09-10T10:15:00.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.143+0000 7f730fd90640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730810d150 con 0x7f7308102f10 2024-09-10T10:15:00.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.143+0000 7f730db2c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7308102570 0x7f73081131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.143+0000 7f730db2c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7308102570 0x7f73081131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36216/0 (socket says 172.21.15.71:36216) 2024-09-10T10:15:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.143+0000 7f730db2c640 1 -- 172.21.15.71:0/59922430 learned_addr learned my addr 172.21.15.71:0/59922430 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.143+0000 7f730d32b640 1 --2- 172.21.15.71:0/59922430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7308102f10 0x7f7308113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.144+0000 7f730db2c640 1 -- 172.21.15.71:0/59922430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7308102f10 msgr2=0x7f7308113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.144+0000 7f730db2c640 1 --2- 172.21.15.71:0/59922430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7308102f10 0x7f7308113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.144+0000 7f730db2c640 1 -- 172.21.15.71:0/59922430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8005040 con 0x7f7308102570 2024-09-10T10:15:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.144+0000 7f730db2c640 1 --2- 172.21.15.71:0/59922430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7308102570 0x7f73081131d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f730400c790 tx=0x7f73040043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.144+0000 7f72fe7fc640 1 -- 172.21.15.71:0/59922430 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f730400a820 con 0x7f7308102570 2024-09-10T10:15:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.144+0000 7f730fd90640 1 -- 172.21.15.71:0/59922430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730810d430 con 0x7f7308102570 2024-09-10T10:15:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.144+0000 7f72fe7fc640 1 -- 172.21.15.71:0/59922430 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f730400ae20 con 0x7f7308102570 2024-09-10T10:15:00.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.144+0000 7f72fe7fc640 1 -- 172.21.15.71:0/59922430 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73040113a0 con 0x7f7308102570 2024-09-10T10:15:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.144+0000 7f730fd90640 1 -- 172.21.15.71:0/59922430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730810d9a0 con 0x7f7308102570 2024-09-10T10:15:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.145+0000 7f730fd90640 1 -- 172.21.15.71:0/59922430 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73080fdcf0 con 0x7f7308102570 2024-09-10T10:15:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.146+0000 7f72fe7fc640 1 -- 172.21.15.71:0/59922430 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7304012400 con 0x7f7308102570 2024-09-10T10:15:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.146+0000 7f72fe7fc640 1 --2- 172.21.15.71:0/59922430 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f72f406e0b0 0x7f72f4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.146+0000 7f72fe7fc640 1 -- 172.21.15.71:0/59922430 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f730408dd60 con 0x7f7308102570 2024-09-10T10:15:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.146+0000 7f730d32b640 1 --2- 172.21.15.71:0/59922430 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f72f406e0b0 0x7f72f4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.147+0000 7f730d32b640 1 --2- 172.21.15.71:0/59922430 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f72f406e0b0 0x7f72f4070560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f72f8000c00 tx=0x7f72f8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:00.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.151+0000 7f72fe7fc640 1 -- 172.21.15.71:0/59922430 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f73040570d0 con 0x7f7308102570 2024-09-10T10:15:00.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.333+0000 7f730fd90640 1 -- 172.21.15.71:0/59922430 --> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f730804b720 con 0x7f72f406e0b0 2024-09-10T10:15:00.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.342+0000 7f72fe7fc640 1 -- 172.21.15.71:0/59922430 <== mgr.34104 v2:172.21.15.71:6800/42554039 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f730804b720 con 0x7f72f406e0b0 2024-09-10T10:15:00.345 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:15:00.345 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.smithi071 smithi071 *:9093,9094 running (2m) 99s ago 18m 15.8M - 0.25.0 c8568f914cd2 a2cae604bef8 2024-09-10T10:15:00.345 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi071 smithi071 running (7m) 99s ago 19m 6903k - 19.1.1-305-g1cf819b7 41d671128357 5dc74ad01560 2024-09-10T10:15:00.345 INFO:teuthology.orchestra.run.smithi071.stdout:crash.smithi107 smithi107 running (7m) 2m ago 18m 6891k - 19.1.1-305-g1cf819b7 41d671128357 6f4355e875db 2024-09-10T10:15:00.345 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.smithi071 smithi071 *:3000 running (103s) 99s ago 18m 45.4M - 9.4.12 2bacad6d85d8 9e07e7b3dcf0 2024-09-10T10:15:00.345 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.omoqqq smithi071 running (3m) 99s ago 13m 17.2M - 19.1.1-305-g1cf819b7 41d671128357 6ec036debe92 2024-09-10T10:15:00.345 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi071.toijsg smithi071 running (3m) 99s ago 13m 65.9M - 19.1.1-305-g1cf819b7 41d671128357 58af9b545bf4 2024-09-10T10:15:00.345 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.nycoxn smithi107 running (3m) 2m ago 13m 137M - 19.1.1-305-g1cf819b7 41d671128357 b3a09b16124b 2024-09-10T10:15:00.346 INFO:teuthology.orchestra.run.smithi071.stdout:mds.cephfs.smithi107.rvgklu smithi107 running (2m) 2m ago 13m 14.4M - 19.1.1-305-g1cf819b7 41d671128357 bdcd45e9b3e2 2024-09-10T10:15:00.346 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi071.gtqytr smithi071 *:8443,9283,8765 running (9m) 99s ago 20m 515M - 19.1.1-305-g1cf819b7 41d671128357 034c8066b69f 2024-09-10T10:15:00.346 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.smithi107.qurtcs smithi107 *:8443,9283,8765 running (8m) 2m ago 17m 442M - 19.1.1-305-g1cf819b7 41d671128357 c3033b45b846 2024-09-10T10:15:00.346 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi071 smithi071 running (8m) 99s ago 20m 56.3M 2048M 19.1.1-305-g1cf819b7 41d671128357 97acff91c24f 2024-09-10T10:15:00.346 INFO:teuthology.orchestra.run.smithi071.stdout:mon.smithi107 smithi107 running (8m) 2m ago 17m 38.9M 2048M 19.1.1-305-g1cf819b7 41d671128357 c2f3cc873b79 2024-09-10T10:15:00.346 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi071 smithi071 *:9100 running (2m) 99s ago 18m 8056k - 1.5.0 0da6a335fe13 06ab97573e3d 2024-09-10T10:15:00.346 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.smithi107 smithi107 *:9100 running (2m) 2m ago 18m 3598k - 1.5.0 0da6a335fe13 c514485d2dcf 2024-09-10T10:15:00.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (7m) 99s ago 17m 106M 1557M 19.1.1-305-g1cf819b7 41d671128357 f1e9da1144c1 2024-09-10T10:15:00.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (6m) 99s ago 16m 110M 1557M 19.1.1-305-g1cf819b7 41d671128357 5afc8bef5343 2024-09-10T10:15:00.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (6m) 99s ago 16m 97.7M 1557M 19.1.1-305-g1cf819b7 41d671128357 5e5976fcfaa8 2024-09-10T10:15:00.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi107 running (5m) 2m ago 15m 116M 2581M 19.1.1-305-g1cf819b7 41d671128357 e22ee626ccd0 2024-09-10T10:15:00.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi107 running (5m) 2m ago 15m 99.5M 2581M 19.1.1-305-g1cf819b7 41d671128357 e92f23ad2c77 2024-09-10T10:15:00.346 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi107 running (4m) 2m ago 14m 95.1M 2581M 19.1.1-305-g1cf819b7 41d671128357 3440ee1c721e 2024-09-10T10:15:00.347 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.smithi071 smithi071 *:9095 running (2m) 99s ago 18m 47.2M - 2.43.0 a07b618ecd1d 9ad96937a042 2024-09-10T10:15:00.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.344+0000 7f730fd90640 1 -- 172.21.15.71:0/59922430 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f72f406e0b0 msgr2=0x7f72f4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:00.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.344+0000 7f730fd90640 1 --2- 172.21.15.71:0/59922430 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f72f406e0b0 0x7f72f4070560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f72f8000c00 tx=0x7f72f8035040 comp rx=0 tx=0).stop 2024-09-10T10:15:00.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.344+0000 7f730fd90640 1 -- 172.21.15.71:0/59922430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7308102570 msgr2=0x7f73081131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:00.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.344+0000 7f730fd90640 1 --2- 172.21.15.71:0/59922430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7308102570 0x7f73081131d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f730400c790 tx=0x7f73040043c0 comp rx=0 tx=0).stop 2024-09-10T10:15:00.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.345+0000 7f730fd90640 1 -- 172.21.15.71:0/59922430 shutdown_connections 2024-09-10T10:15:00.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.345+0000 7f730fd90640 1 --2- 172.21.15.71:0/59922430 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f72f406e0b0 0x7f72f4070560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:00.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.345+0000 7f730fd90640 1 --2- 172.21.15.71:0/59922430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7308102f10 0x7f7308113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:00.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.345+0000 7f730fd90640 1 --2- 172.21.15.71:0/59922430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7308102570 0x7f73081131d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:00.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.345+0000 7f730fd90640 1 -- 172.21.15.71:0/59922430 >> 172.21.15.71:0/59922430 conn(0x7f73080f8110 msgr2=0x7f73080f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:00.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.345+0000 7f730fd90640 1 -- 172.21.15.71:0/59922430 shutdown_connections 2024-09-10T10:15:00.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:00.345+0000 7f730fd90640 1 -- 172.21.15.71:0/59922430 wait complete. 2024-09-10T10:15:00.967 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph versions' 2024-09-10T10:15:01.219 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:01.637 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:01 smithi071 ceph-mon[90773]: pgmap v296: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:15:01.637 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:01 smithi071 ceph-mon[90773]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:15:01.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:01 smithi107 ceph-mon[79396]: pgmap v296: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:15:01.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:01 smithi107 ceph-mon[79396]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:15:02.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 -- 172.21.15.71:0/441741464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5d0102ef0 msgr2=0x7ff5d00fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:02.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 --2- 172.21.15.71:0/441741464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5d0102ef0 0x7ff5d00fc5b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009c50 tx=0x7ff5c4004d10 comp rx=0 tx=0).stop 2024-09-10T10:15:02.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 -- 172.21.15.71:0/441741464 shutdown_connections 2024-09-10T10:15:02.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 --2- 172.21.15.71:0/441741464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5d0102ef0 0x7ff5d00fc5b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:02.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 --2- 172.21.15.71:0/441741464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5d0102550 0x7ff5d0102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:02.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 -- 172.21.15.71:0/441741464 >> 172.21.15.71:0/441741464 conn(0x7ff5d00f80f0 msgr2=0x7ff5d00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:02.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 -- 172.21.15.71:0/441741464 shutdown_connections 2024-09-10T10:15:02.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 -- 172.21.15.71:0/441741464 wait complete. 2024-09-10T10:15:02.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 Processor -- start 2024-09-10T10:15:02.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 -- start start 2024-09-10T10:15:02.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5d0102550 0x7ff5d006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:02.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5d0102ef0 0x7ff5d006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:02.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d0071850 con 0x7ff5d0102550 2024-09-10T10:15:02.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.787+0000 7ff5d82ba640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d00719c0 con 0x7ff5d0102ef0 2024-09-10T10:15:02.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.788+0000 7ff5d6056640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5d0102550 0x7ff5d006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:02.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.788+0000 7ff5d6056640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5d0102550 0x7ff5d006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36238/0 (socket says 172.21.15.71:36238) 2024-09-10T10:15:02.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.788+0000 7ff5d6056640 1 -- 172.21.15.71:0/3123727711 learned_addr learned my addr 172.21.15.71:0/3123727711 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:02.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.788+0000 7ff5d5855640 1 --2- 172.21.15.71:0/3123727711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5d0102ef0 0x7ff5d006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:02.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.788+0000 7ff5d6056640 1 -- 172.21.15.71:0/3123727711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5d0102ef0 msgr2=0x7ff5d006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:02.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.788+0000 7ff5d6056640 1 --2- 172.21.15.71:0/3123727711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5d0102ef0 0x7ff5d006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:02.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.788+0000 7ff5d6056640 1 -- 172.21.15.71:0/3123727711 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c40098b0 con 0x7ff5d0102550 2024-09-10T10:15:02.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.788+0000 7ff5d6056640 1 --2- 172.21.15.71:0/3123727711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5d0102550 0x7ff5d006fa10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800b790 tx=0x7ff5c80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:02.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.788+0000 7ff5ceffd640 1 -- 172.21.15.71:0/3123727711 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c800c700 con 0x7ff5d0102550 2024-09-10T10:15:02.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.788+0000 7ff5ceffd640 1 -- 172.21.15.71:0/3123727711 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff5c800cd00 con 0x7ff5d0102550 2024-09-10T10:15:02.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.788+0000 7ff5d82ba640 1 -- 172.21.15.71:0/3123727711 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d00705e0 con 0x7ff5d0102550 2024-09-10T10:15:02.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.788+0000 7ff5ceffd640 1 -- 172.21.15.71:0/3123727711 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c8015e70 con 0x7ff5d0102550 2024-09-10T10:15:02.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.788+0000 7ff5d82ba640 1 -- 172.21.15.71:0/3123727711 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d011e210 con 0x7ff5d0102550 2024-09-10T10:15:02.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.789+0000 7ff5d82ba640 1 -- 172.21.15.71:0/3123727711 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d00fdcd0 con 0x7ff5d0102550 2024-09-10T10:15:02.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.790+0000 7ff5ceffd640 1 -- 172.21.15.71:0/3123727711 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff5c8012070 con 0x7ff5d0102550 2024-09-10T10:15:02.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.790+0000 7ff5ceffd640 1 --2- 172.21.15.71:0/3123727711 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff5b806e0b0 0x7ff5b8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:02.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.790+0000 7ff5ceffd640 1 -- 172.21.15.71:0/3123727711 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff5c808d700 con 0x7ff5d0102550 2024-09-10T10:15:02.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.790+0000 7ff5d5855640 1 --2- 172.21.15.71:0/3123727711 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff5b806e0b0 0x7ff5b8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:02.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.791+0000 7ff5d5855640 1 --2- 172.21.15.71:0/3123727711 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff5b806e0b0 0x7ff5b8070560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009c20 tx=0x7ff5c4004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:02.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:02.794+0000 7ff5ceffd640 1 -- 172.21.15.71:0/3123727711 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff5c8056a50 con 0x7ff5d0102550 2024-09-10T10:15:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:03.030+0000 7ff5d82ba640 1 -- 172.21.15.71:0/3123727711 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff5d0071100 con 0x7ff5d0102550 2024-09-10T10:15:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:03.031+0000 7ff5ceffd640 1 -- 172.21.15.71:0/3123727711 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7ff5c805a110 con 0x7ff5d0102550 2024-09-10T10:15:03.032 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-10T10:15:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-10T10:15:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:15:03.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:15:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-10T10:15:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T10:15:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:15:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-10T10:15:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T10:15:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:15:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-10T10:15:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T10:15:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-10T10:15:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-10T10:15:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 14 2024-09-10T10:15:03.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-10T10:15:03.033 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-10T10:15:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:03.033+0000 7ff5d82ba640 1 -- 172.21.15.71:0/3123727711 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff5b806e0b0 msgr2=0x7ff5b8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:03.033+0000 7ff5d82ba640 1 --2- 172.21.15.71:0/3123727711 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff5b806e0b0 0x7ff5b8070560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009c20 tx=0x7ff5c4004d10 comp rx=0 tx=0).stop 2024-09-10T10:15:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:03.033+0000 7ff5d82ba640 1 -- 172.21.15.71:0/3123727711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5d0102550 msgr2=0x7ff5d006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:03.033+0000 7ff5d82ba640 1 --2- 172.21.15.71:0/3123727711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5d0102550 0x7ff5d006fa10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800b790 tx=0x7ff5c80091d0 comp rx=0 tx=0).stop 2024-09-10T10:15:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:03.033+0000 7ff5d82ba640 1 -- 172.21.15.71:0/3123727711 shutdown_connections 2024-09-10T10:15:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:03.033+0000 7ff5d82ba640 1 --2- 172.21.15.71:0/3123727711 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff5b806e0b0 0x7ff5b8070560 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:03.033+0000 7ff5d82ba640 1 --2- 172.21.15.71:0/3123727711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5d0102ef0 0x7ff5d006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:03.033+0000 7ff5d82ba640 1 --2- 172.21.15.71:0/3123727711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5d0102550 0x7ff5d006fa10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:03.033+0000 7ff5d82ba640 1 -- 172.21.15.71:0/3123727711 >> 172.21.15.71:0/3123727711 conn(0x7ff5d00f80f0 msgr2=0x7ff5d00f90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:03.033+0000 7ff5d82ba640 1 -- 172.21.15.71:0/3123727711 shutdown_connections 2024-09-10T10:15:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:03.033+0000 7ff5d82ba640 1 -- 172.21.15.71:0/3123727711 wait complete. 2024-09-10T10:15:03.740 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:03 smithi071 ceph-mon[90773]: pgmap v297: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-10T10:15:03.740 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:03 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/3123727711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:15:03.764 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-10T10:15:03.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:03 smithi107 ceph-mon[79396]: pgmap v297: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-10T10:15:03.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:03 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/3123727711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:15:04.012 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.617+0000 7f7edcdc3640 1 -- 172.21.15.71:0/4275225816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ed80fd580 msgr2=0x7f7ed80fd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.617+0000 7f7edcdc3640 1 --2- 172.21.15.71:0/4275225816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ed80fd580 0x7f7ed80fd950 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8004900 tx=0x7f7ec8009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.618+0000 7f7edcdc3640 1 -- 172.21.15.71:0/4275225816 shutdown_connections 2024-09-10T10:15:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.618+0000 7f7edcdc3640 1 --2- 172.21.15.71:0/4275225816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed80fdf20 0x7f7ed81065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.618+0000 7f7edcdc3640 1 --2- 172.21.15.71:0/4275225816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ed80fd580 0x7f7ed80fd950 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.618+0000 7f7edcdc3640 1 -- 172.21.15.71:0/4275225816 >> 172.21.15.71:0/4275225816 conn(0x7f7ed80f7060 msgr2=0x7f7ed80f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.618+0000 7f7edcdc3640 1 -- 172.21.15.71:0/4275225816 shutdown_connections 2024-09-10T10:15:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.618+0000 7f7edcdc3640 1 -- 172.21.15.71:0/4275225816 wait complete. 2024-09-10T10:15:05.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.618+0000 7f7edcdc3640 1 Processor -- start 2024-09-10T10:15:05.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.618+0000 7f7edcdc3640 1 -- start start 2024-09-10T10:15:05.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.618+0000 7f7edcdc3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ed80fd580 0x7f7ed8113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:05.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.618+0000 7f7edcdc3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed80fdf20 0x7f7ed81137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:05.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.618+0000 7f7edcdc3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8113db0 con 0x7f7ed80fd580 2024-09-10T10:15:05.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.618+0000 7f7edcdc3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed810d1f0 con 0x7f7ed80fdf20 2024-09-10T10:15:05.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.619+0000 7f7ed659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ed80fd580 0x7f7ed8113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:05.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.619+0000 7f7ed659c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ed80fd580 0x7f7ed8113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46198/0 (socket says 172.21.15.71:46198) 2024-09-10T10:15:05.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.619+0000 7f7ed659c640 1 -- 172.21.15.71:0/3910834028 learned_addr learned my addr 172.21.15.71:0/3910834028 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:05.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.619+0000 7f7ed5d9b640 1 --2- 172.21.15.71:0/3910834028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed80fdf20 0x7f7ed81137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:05.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.619+0000 7f7ed659c640 1 -- 172.21.15.71:0/3910834028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed80fdf20 msgr2=0x7f7ed81137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:05.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.619+0000 7f7ed659c640 1 --2- 172.21.15.71:0/3910834028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed80fdf20 0x7f7ed81137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:05.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.619+0000 7f7ed659c640 1 -- 172.21.15.71:0/3910834028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec8005040 con 0x7f7ed80fd580 2024-09-10T10:15:05.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.619+0000 7f7ed659c640 1 --2- 172.21.15.71:0/3910834028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ed80fd580 0x7f7ed8113270 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009ac0 tx=0x7f7ec8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:05.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.619+0000 7f7ec6ffd640 1 -- 172.21.15.71:0/3910834028 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ec8038070 con 0x7f7ed80fd580 2024-09-10T10:15:05.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.619+0000 7f7ec6ffd640 1 -- 172.21.15.71:0/3910834028 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7ec802ae80 con 0x7f7ed80fd580 2024-09-10T10:15:05.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.619+0000 7f7edcdc3640 1 -- 172.21.15.71:0/3910834028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed810d470 con 0x7f7ed80fd580 2024-09-10T10:15:05.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.619+0000 7f7ec6ffd640 1 -- 172.21.15.71:0/3910834028 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ec8009680 con 0x7f7ed80fd580 2024-09-10T10:15:05.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.619+0000 7f7edcdc3640 1 -- 172.21.15.71:0/3910834028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed810d930 con 0x7f7ed80fd580 2024-09-10T10:15:05.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.620+0000 7f7edcdc3640 1 -- 172.21.15.71:0/3910834028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed80662d0 con 0x7f7ed80fd580 2024-09-10T10:15:05.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.621+0000 7f7ec6ffd640 1 -- 172.21.15.71:0/3910834028 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7ec8030020 con 0x7f7ed80fd580 2024-09-10T10:15:05.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.621+0000 7f7ec6ffd640 1 --2- 172.21.15.71:0/3910834028 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7ec006e0b0 0x7f7ec0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:05.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.621+0000 7f7ec6ffd640 1 -- 172.21.15.71:0/3910834028 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f7ec80ae070 con 0x7f7ed80fd580 2024-09-10T10:15:05.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.621+0000 7f7ed5d9b640 1 --2- 172.21.15.71:0/3910834028 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7ec006e0b0 0x7f7ec0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:05.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.622+0000 7f7ed5d9b640 1 --2- 172.21.15.71:0/3910834028 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7ec006e0b0 0x7f7ec0070560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009fd0 tx=0x7f7ecc009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:05.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.626+0000 7f7ec6ffd640 1 -- 172.21.15.71:0/3910834028 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7ec80773c0 con 0x7f7ed80fd580 2024-09-10T10:15:05.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:05 smithi071 ceph-mon[90773]: pgmap v298: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-10T10:15:05.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.858+0000 7f7edcdc3640 1 -- 172.21.15.71:0/3910834028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7ed804b720 con 0x7f7ed80fd580 2024-09-10T10:15:05.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.858+0000 7f7ec6ffd640 1 -- 172.21.15.71:0/3910834028 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f7ec807aa80 con 0x7f7ed80fd580 2024-09-10T10:15:05.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.860+0000 7f7edcdc3640 1 -- 172.21.15.71:0/3910834028 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7ec006e0b0 msgr2=0x7f7ec0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:05.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.860+0000 7f7edcdc3640 1 --2- 172.21.15.71:0/3910834028 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7ec006e0b0 0x7f7ec0070560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009fd0 tx=0x7f7ecc009e50 comp rx=0 tx=0).stop 2024-09-10T10:15:05.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.860+0000 7f7edcdc3640 1 -- 172.21.15.71:0/3910834028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ed80fd580 msgr2=0x7f7ed8113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:05.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.860+0000 7f7edcdc3640 1 --2- 172.21.15.71:0/3910834028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ed80fd580 0x7f7ed8113270 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009ac0 tx=0x7f7ec8009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:05.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.861+0000 7f7edcdc3640 1 -- 172.21.15.71:0/3910834028 shutdown_connections 2024-09-10T10:15:05.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.861+0000 7f7edcdc3640 1 --2- 172.21.15.71:0/3910834028 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f7ec006e0b0 0x7f7ec0070560 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:05.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.861+0000 7f7edcdc3640 1 --2- 172.21.15.71:0/3910834028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ed80fdf20 0x7f7ed81137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:05.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.861+0000 7f7edcdc3640 1 --2- 172.21.15.71:0/3910834028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ed80fd580 0x7f7ed8113270 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:05.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.861+0000 7f7edcdc3640 1 -- 172.21.15.71:0/3910834028 >> 172.21.15.71:0/3910834028 conn(0x7f7ed80f7060 msgr2=0x7f7ed80f8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:05.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.861+0000 7f7edcdc3640 1 -- 172.21.15.71:0/3910834028 shutdown_connections 2024-09-10T10:15:05.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:05.861+0000 7f7edcdc3640 1 -- 172.21.15.71:0/3910834028 wait complete. 2024-09-10T10:15:05.872 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-10T10:15:05.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:05 smithi107 ceph-mon[79396]: pgmap v298: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-10T10:15:06.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-10T10:15:06.783 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:06.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:06 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/3910834028' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:15:06.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:06 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/3910834028' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:15:07.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:07 smithi071 ceph-mon[90773]: pgmap v299: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-10T10:15:07.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:07 smithi107 ceph-mon[79396]: pgmap v299: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-10T10:15:08.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.347+0000 7f974f66e640 1 -- 172.21.15.71:0/3015769495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9748102530 msgr2=0x7f9748102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:08.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.347+0000 7f974f66e640 1 --2- 172.21.15.71:0/3015769495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9748102530 0x7f9748102900 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f97440048d0 tx=0x7f9744009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.347+0000 7f974f66e640 1 -- 172.21.15.71:0/3015769495 shutdown_connections 2024-09-10T10:15:08.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.347+0000 7f974f66e640 1 --2- 172.21.15.71:0/3015769495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9748102ed0 0x7f97480fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.347+0000 7f974f66e640 1 --2- 172.21.15.71:0/3015769495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9748102530 0x7f9748102900 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.347+0000 7f974f66e640 1 -- 172.21.15.71:0/3015769495 >> 172.21.15.71:0/3015769495 conn(0x7f97480f80f0 msgr2=0x7f97480fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:08.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.347+0000 7f974f66e640 1 -- 172.21.15.71:0/3015769495 shutdown_connections 2024-09-10T10:15:08.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.347+0000 7f974f66e640 1 -- 172.21.15.71:0/3015769495 wait complete. 2024-09-10T10:15:08.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.347+0000 7f974f66e640 1 Processor -- start 2024-09-10T10:15:08.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.347+0000 7f974f66e640 1 -- start start 2024-09-10T10:15:08.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f974f66e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9748102530 0x7f974806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f974f66e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9748102ed0 0x7f974806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f974f66e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748070490 con 0x7f9748102530 2024-09-10T10:15:08.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f974f66e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748070600 con 0x7f9748102ed0 2024-09-10T10:15:08.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f974d40a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9748102530 0x7f974806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f974d40a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9748102530 0x7f974806fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46212/0 (socket says 172.21.15.71:46212) 2024-09-10T10:15:08.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f974d40a640 1 -- 172.21.15.71:0/1387683305 learned_addr learned my addr 172.21.15.71:0/1387683305 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:08.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f974cc09640 1 --2- 172.21.15.71:0/1387683305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9748102ed0 0x7f974806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f974d40a640 1 -- 172.21.15.71:0/1387683305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9748102ed0 msgr2=0x7f974806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:08.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f974d40a640 1 --2- 172.21.15.71:0/1387683305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9748102ed0 0x7f974806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f974d40a640 1 -- 172.21.15.71:0/1387683305 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744005040 con 0x7f9748102530 2024-09-10T10:15:08.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f974d40a640 1 --2- 172.21.15.71:0/1387683305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9748102530 0x7f974806fa10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9744003080 tx=0x7f9744009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:08.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f9739ffb640 1 -- 172.21.15.71:0/1387683305 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9744038070 con 0x7f9748102530 2024-09-10T10:15:08.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f9739ffb640 1 -- 172.21.15.71:0/1387683305 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f97440097e0 con 0x7f9748102530 2024-09-10T10:15:08.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f9739ffb640 1 -- 172.21.15.71:0/1387683305 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f974403d420 con 0x7f9748102530 2024-09-10T10:15:08.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.348+0000 7f974f66e640 1 -- 172.21.15.71:0/1387683305 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9748070830 con 0x7f9748102530 2024-09-10T10:15:08.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.349+0000 7f974f66e640 1 -- 172.21.15.71:0/1387683305 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9748119890 con 0x7f9748102530 2024-09-10T10:15:08.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.350+0000 7f974f66e640 1 -- 172.21.15.71:0/1387683305 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97480fdcb0 con 0x7f9748102530 2024-09-10T10:15:08.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.350+0000 7f9739ffb640 1 -- 172.21.15.71:0/1387683305 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9744030020 con 0x7f9748102530 2024-09-10T10:15:08.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.351+0000 7f9739ffb640 1 --2- 172.21.15.71:0/1387683305 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f973406e0b0 0x7f9734070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.351+0000 7f9739ffb640 1 -- 172.21.15.71:0/1387683305 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f97440ae0f0 con 0x7f9748102530 2024-09-10T10:15:08.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.351+0000 7f974cc09640 1 --2- 172.21.15.71:0/1387683305 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f973406e0b0 0x7f9734070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.351+0000 7f974cc09640 1 --2- 172.21.15.71:0/1387683305 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f973406e0b0 0x7f9734070560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9748071350 tx=0x7f973c004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:08.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.355+0000 7f9739ffb640 1 -- 172.21.15.71:0/1387683305 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f97440773c0 con 0x7f9748102530 2024-09-10T10:15:08.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.590+0000 7f974f66e640 1 -- 172.21.15.71:0/1387683305 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f97480fbd30 con 0x7f9748102530 2024-09-10T10:15:08.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.590+0000 7f9739ffb640 1 -- 172.21.15.71:0/1387683305 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f974407aa80 con 0x7f9748102530 2024-09-10T10:15:08.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.592+0000 7f974f66e640 1 -- 172.21.15.71:0/1387683305 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f973406e0b0 msgr2=0x7f9734070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:08.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.592+0000 7f974f66e640 1 --2- 172.21.15.71:0/1387683305 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f973406e0b0 0x7f9734070560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9748071350 tx=0x7f973c004330 comp rx=0 tx=0).stop 2024-09-10T10:15:08.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.592+0000 7f974f66e640 1 -- 172.21.15.71:0/1387683305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9748102530 msgr2=0x7f974806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:08.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.592+0000 7f974f66e640 1 --2- 172.21.15.71:0/1387683305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9748102530 0x7f974806fa10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9744003080 tx=0x7f9744009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.592+0000 7f974f66e640 1 -- 172.21.15.71:0/1387683305 shutdown_connections 2024-09-10T10:15:08.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.592+0000 7f974f66e640 1 --2- 172.21.15.71:0/1387683305 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f973406e0b0 0x7f9734070560 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.592+0000 7f974f66e640 1 --2- 172.21.15.71:0/1387683305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9748102ed0 0x7f974806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.592+0000 7f974f66e640 1 --2- 172.21.15.71:0/1387683305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9748102530 0x7f974806fa10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.592+0000 7f974f66e640 1 -- 172.21.15.71:0/1387683305 >> 172.21.15.71:0/1387683305 conn(0x7f97480f80f0 msgr2=0x7f97480f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:08.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.592+0000 7f974f66e640 1 -- 172.21.15.71:0/1387683305 shutdown_connections 2024-09-10T10:15:08.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:08.592+0000 7f974f66e640 1 -- 172.21.15.71:0/1387683305 wait complete. 2024-09-10T10:15:08.602 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)" 2024-09-10T10:15:09.393 DEBUG:teuthology.parallel:result is None 2024-09-10T10:15:09.393 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T10:15:09.406 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T10:15:09.406 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T10:15:09.654 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:09.775 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:09 smithi071 ceph-mon[90773]: pgmap v300: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:15:09.776 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:09 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/1387683305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:15:09.776 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:15:09.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:09 smithi107 ceph-mon[79396]: pgmap v300: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-10T10:15:09.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:09 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/1387683305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T10:15:09.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:15:11.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.279+0000 7ff7299f6640 1 -- 172.21.15.71:0/2470392853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7240fcf80 msgr2=0x7ff7240fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:11.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.279+0000 7ff7299f6640 1 --2- 172.21.15.71:0/2470392853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7240fcf80 0x7ff7240fd3d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff7180048d0 tx=0x7ff718009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:11.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.279+0000 7ff7299f6640 1 -- 172.21.15.71:0/2470392853 shutdown_connections 2024-09-10T10:15:11.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.279+0000 7ff7299f6640 1 --2- 172.21.15.71:0/2470392853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7240fcf80 0x7ff7240fd3d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:11.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.279+0000 7ff7299f6640 1 --2- 172.21.15.71:0/2470392853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7240fb810 0x7ff7240fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:11.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.279+0000 7ff7299f6640 1 -- 172.21.15.71:0/2470392853 >> 172.21.15.71:0/2470392853 conn(0x7ff7240723b0 msgr2=0x7ff7240727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:11.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.279+0000 7ff7299f6640 1 -- 172.21.15.71:0/2470392853 shutdown_connections 2024-09-10T10:15:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.279+0000 7ff7299f6640 1 -- 172.21.15.71:0/2470392853 wait complete. 2024-09-10T10:15:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.279+0000 7ff7299f6640 1 Processor -- start 2024-09-10T10:15:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.279+0000 7ff7299f6640 1 -- start start 2024-09-10T10:15:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff7299f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7240fb810 0x7ff7241131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff7299f6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7240fcf80 0x7ff7241136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff7299f6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff724113cf0 con 0x7ff7240fcf80 2024-09-10T10:15:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff7299f6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72410d130 con 0x7ff7240fb810 2024-09-10T10:15:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff7227fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7240fcf80 0x7ff7241136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff7227fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7240fcf80 0x7ff7241136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46226/0 (socket says 172.21.15.71:46226) 2024-09-10T10:15:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff7227fc640 1 -- 172.21.15.71:0/2899393065 learned_addr learned my addr 172.21.15.71:0/2899393065 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff722ffd640 1 --2- 172.21.15.71:0/2899393065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7240fb810 0x7ff7241131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff7227fc640 1 -- 172.21.15.71:0/2899393065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7240fb810 msgr2=0x7ff7241131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:11.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff7227fc640 1 --2- 172.21.15.71:0/2899393065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7240fb810 0x7ff7241131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:11.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff7227fc640 1 -- 172.21.15.71:0/2899393065 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718005040 con 0x7ff7240fcf80 2024-09-10T10:15:11.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff7227fc640 1 --2- 172.21.15.71:0/2899393065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7240fcf80 0x7ff7241136f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff718000c00 tx=0x7ff718009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:11.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff70b7fe640 1 -- 172.21.15.71:0/2899393065 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff718038070 con 0x7ff7240fcf80 2024-09-10T10:15:11.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff7299f6640 1 -- 172.21.15.71:0/2899393065 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72410d3b0 con 0x7ff7240fcf80 2024-09-10T10:15:11.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.280+0000 7ff70b7fe640 1 -- 172.21.15.71:0/2899393065 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff71802ade0 con 0x7ff7240fcf80 2024-09-10T10:15:11.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.281+0000 7ff70b7fe640 1 -- 172.21.15.71:0/2899393065 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff71802c7e0 con 0x7ff7240fcf80 2024-09-10T10:15:11.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.281+0000 7ff7299f6640 1 -- 172.21.15.71:0/2899393065 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72410d8f0 con 0x7ff7240fcf80 2024-09-10T10:15:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.281+0000 7ff7299f6640 1 -- 172.21.15.71:0/2899393065 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7240fcbc0 con 0x7ff7240fcf80 2024-09-10T10:15:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.282+0000 7ff70b7fe640 1 -- 172.21.15.71:0/2899393065 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff718030020 con 0x7ff7240fcf80 2024-09-10T10:15:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.282+0000 7ff70b7fe640 1 --2- 172.21.15.71:0/2899393065 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff70c06e0b0 0x7ff70c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.283+0000 7ff70b7fe640 1 -- 172.21.15.71:0/2899393065 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff7180ad870 con 0x7ff7240fcf80 2024-09-10T10:15:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.283+0000 7ff722ffd640 1 --2- 172.21.15.71:0/2899393065 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff70c06e0b0 0x7ff70c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:11.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.283+0000 7ff722ffd640 1 --2- 172.21.15.71:0/2899393065 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff70c06e0b0 0x7ff70c070560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff714004ed0 tx=0x7ff71400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:11.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.287+0000 7ff70b7fe640 1 -- 172.21.15.71:0/2899393065 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff718076bf0 con 0x7ff7240fcf80 2024-09-10T10:15:11.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.488+0000 7ff7299f6640 1 -- 172.21.15.71:0/2899393065 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff72404b720 con 0x7ff7240fcf80 2024-09-10T10:15:11.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.488+0000 7ff70b7fe640 1 -- 172.21.15.71:0/2899393065 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+2006 (secure 0 0 0) 0x7ff71807a2b0 con 0x7ff7240fcf80 2024-09-10T10:15:11.490 INFO:teuthology.orchestra.run.smithi071.stdout:e44 2024-09-10T10:15:11.490 INFO:teuthology.orchestra.run.smithi071.stdout:btime 2024-09-10T10:12:17:347805+0000 2024-09-10T10:15:11.490 INFO:teuthology.orchestra.run.smithi071.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:15:11.490 INFO:teuthology.orchestra.run.smithi071.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T10:15:11.490 INFO:teuthology.orchestra.run.smithi071.stdout:legacy client fscid: 1 2024-09-10T10:15:11.490 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:11.490 INFO:teuthology.orchestra.run.smithi071.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:15:11.491 INFO:teuthology.orchestra.run.smithi071.stdout:fs_name cephfs 2024-09-10T10:15:11.491 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 44 2024-09-10T10:15:11.491 INFO:teuthology.orchestra.run.smithi071.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:15:11.491 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-10T10:01:27.452418+0000 2024-09-10T10:15:11.491 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-09-10T10:12:17.347793+0000 2024-09-10T10:15:11.491 INFO:teuthology.orchestra.run.smithi071.stdout:tableserver 0 2024-09-10T10:15:11.491 INFO:teuthology.orchestra.run.smithi071.stdout:root 0 2024-09-10T10:15:11.491 INFO:teuthology.orchestra.run.smithi071.stdout:session_timeout 60 2024-09-10T10:15:11.491 INFO:teuthology.orchestra.run.smithi071.stdout:session_autoclose 300 2024-09-10T10:15:11.491 INFO:teuthology.orchestra.run.smithi071.stdout:max_file_size 1099511627776 2024-09-10T10:15:11.491 INFO:teuthology.orchestra.run.smithi071.stdout:max_xattr_size 65536 2024-09-10T10:15:11.491 INFO:teuthology.orchestra.run.smithi071.stdout:required_client_features {} 2024-09-10T10:15:11.492 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure 0 2024-09-10T10:15:11.492 INFO:teuthology.orchestra.run.smithi071.stdout:last_failure_osd_epoch 81 2024-09-10T10:15:11.492 INFO:teuthology.orchestra.run.smithi071.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T10:15:11.492 INFO:teuthology.orchestra.run.smithi071.stdout:max_mds 2 2024-09-10T10:15:11.492 INFO:teuthology.orchestra.run.smithi071.stdout:in 0,1 2024-09-10T10:15:11.492 INFO:teuthology.orchestra.run.smithi071.stdout:up {0=34416,1=34432} 2024-09-10T10:15:11.492 INFO:teuthology.orchestra.run.smithi071.stdout:failed 2024-09-10T10:15:11.492 INFO:teuthology.orchestra.run.smithi071.stdout:damaged 2024-09-10T10:15:11.492 INFO:teuthology.orchestra.run.smithi071.stdout:stopped 2024-09-10T10:15:11.492 INFO:teuthology.orchestra.run.smithi071.stdout:data_pools [3] 2024-09-10T10:15:11.492 INFO:teuthology.orchestra.run.smithi071.stdout:metadata_pool 2 2024-09-10T10:15:11.492 INFO:teuthology.orchestra.run.smithi071.stdout:inline_data disabled 2024-09-10T10:15:11.493 INFO:teuthology.orchestra.run.smithi071.stdout:balancer 2024-09-10T10:15:11.493 INFO:teuthology.orchestra.run.smithi071.stdout:bal_rank_mask -1 2024-09-10T10:15:11.493 INFO:teuthology.orchestra.run.smithi071.stdout:standby_count_wanted 1 2024-09-10T10:15:11.493 INFO:teuthology.orchestra.run.smithi071.stdout:qdb_cluster leader: 34416 members: 34432,34416 2024-09-10T10:15:11.493 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.toijsg{0:34416} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.71:6826/1701579524,v1:172.21.15.71:6827/1701579524] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:15:11.493 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.nycoxn{0:44373} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.107:6824/1627286097,v1:172.21.15.107:6825/1627286097] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:15:11.493 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi071.omoqqq{1:34432} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.71:6828/1608732243,v1:172.21.15.71:6829/1608732243] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:15:11.493 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.cephfs.smithi107.rvgklu{1:44397} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.107:6826/2279749952,v1:172.21.15.107:6827/2279749952] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:15:11.493 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:11.493 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:11.494 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 44 2024-09-10T10:15:11.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.490+0000 7ff7299f6640 1 -- 172.21.15.71:0/2899393065 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff70c06e0b0 msgr2=0x7ff70c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:11.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.490+0000 7ff7299f6640 1 --2- 172.21.15.71:0/2899393065 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff70c06e0b0 0x7ff70c070560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff714004ed0 tx=0x7ff71400b040 comp rx=0 tx=0).stop 2024-09-10T10:15:11.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.490+0000 7ff7299f6640 1 -- 172.21.15.71:0/2899393065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7240fcf80 msgr2=0x7ff7241136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:11.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.490+0000 7ff7299f6640 1 --2- 172.21.15.71:0/2899393065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7240fcf80 0x7ff7241136f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff718000c00 tx=0x7ff718009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:11.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.490+0000 7ff7299f6640 1 -- 172.21.15.71:0/2899393065 shutdown_connections 2024-09-10T10:15:11.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.490+0000 7ff7299f6640 1 --2- 172.21.15.71:0/2899393065 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff70c06e0b0 0x7ff70c070560 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:11.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.490+0000 7ff7299f6640 1 --2- 172.21.15.71:0/2899393065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7240fcf80 0x7ff7241136f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:11.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.490+0000 7ff7299f6640 1 --2- 172.21.15.71:0/2899393065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7240fb810 0x7ff7241131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:11.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.491+0000 7ff7299f6640 1 -- 172.21.15.71:0/2899393065 >> 172.21.15.71:0/2899393065 conn(0x7ff7240723b0 msgr2=0x7ff724065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:11.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.491+0000 7ff7299f6640 1 -- 172.21.15.71:0/2899393065 shutdown_connections 2024-09-10T10:15:11.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:11.491+0000 7ff7299f6640 1 -- 172.21.15.71:0/2899393065 wait complete. 2024-09-10T10:15:11.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:11 smithi071 ceph-mon[90773]: pgmap v301: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:11.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:11 smithi107 ceph-mon[79396]: pgmap v301: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:12.165 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-10T10:15:12.177 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:15:12.425 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:12.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:12 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2899393065' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:15:12.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:12 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2899393065' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:15:13.746 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:13 smithi071 ceph-mon[90773]: pgmap v302: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:13.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:13 smithi107 ceph-mon[79396]: pgmap v302: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:13.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.949+0000 7fed32f14640 1 -- 172.21.15.71:0/3627905490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed2c102620 msgr2=0x7fed2c1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.949+0000 7fed32f14640 1 --2- 172.21.15.71:0/3627905490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed2c102620 0x7fed2c1029f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fed14009c50 tx=0x7fed14004d10 comp rx=0 tx=0).stop 2024-09-10T10:15:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.949+0000 7fed32f14640 1 -- 172.21.15.71:0/3627905490 shutdown_connections 2024-09-10T10:15:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.949+0000 7fed32f14640 1 --2- 172.21.15.71:0/3627905490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed2c0fac80 0x7fed2c0fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.949+0000 7fed32f14640 1 --2- 172.21.15.71:0/3627905490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed2c102620 0x7fed2c1029f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.949+0000 7fed32f14640 1 -- 172.21.15.71:0/3627905490 >> 172.21.15.71:0/3627905490 conn(0x7fed2c070ce0 msgr2=0x7fed2c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.949+0000 7fed32f14640 1 -- 172.21.15.71:0/3627905490 shutdown_connections 2024-09-10T10:15:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.949+0000 7fed32f14640 1 -- 172.21.15.71:0/3627905490 wait complete. 2024-09-10T10:15:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.949+0000 7fed32f14640 1 Processor -- start 2024-09-10T10:15:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.949+0000 7fed32f14640 1 -- start start 2024-09-10T10:15:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.950+0000 7fed32f14640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed2c0fac80 0x7fed2c1131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.950+0000 7fed32f14640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed2c102620 0x7fed2c113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:13.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.950+0000 7fed32f14640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c113d00 con 0x7fed2c0fac80 2024-09-10T10:15:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.950+0000 7fed32f14640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c10d140 con 0x7fed2c102620 2024-09-10T10:15:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.950+0000 7fed30cb0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed2c0fac80 0x7fed2c1131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.950+0000 7fed30cb0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed2c0fac80 0x7fed2c1131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44940/0 (socket says 172.21.15.71:44940) 2024-09-10T10:15:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.950+0000 7fed30cb0640 1 -- 172.21.15.71:0/4083312171 learned_addr learned my addr 172.21.15.71:0/4083312171 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.950+0000 7fed2bfff640 1 --2- 172.21.15.71:0/4083312171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed2c102620 0x7fed2c113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.950+0000 7fed30cb0640 1 -- 172.21.15.71:0/4083312171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed2c102620 msgr2=0x7fed2c113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.950+0000 7fed30cb0640 1 --2- 172.21.15.71:0/4083312171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed2c102620 0x7fed2c113700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.950+0000 7fed30cb0640 1 -- 172.21.15.71:0/4083312171 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed140098b0 con 0x7fed2c0fac80 2024-09-10T10:15:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.950+0000 7fed2bfff640 1 --2- 172.21.15.71:0/4083312171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed2c102620 0x7fed2c113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.950+0000 7fed30cb0640 1 --2- 172.21.15.71:0/4083312171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed2c0fac80 0x7fed2c1131c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fed14004a30 tx=0x7fed14004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.951+0000 7fed297fa640 1 -- 172.21.15.71:0/4083312171 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed14009690 con 0x7fed2c0fac80 2024-09-10T10:15:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.951+0000 7fed32f14640 1 -- 172.21.15.71:0/4083312171 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c10d3c0 con 0x7fed2c0fac80 2024-09-10T10:15:13.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.951+0000 7fed297fa640 1 -- 172.21.15.71:0/4083312171 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fed14032b10 con 0x7fed2c0fac80 2024-09-10T10:15:13.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.951+0000 7fed297fa640 1 -- 172.21.15.71:0/4083312171 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1403daa0 con 0x7fed2c0fac80 2024-09-10T10:15:13.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.951+0000 7fed32f14640 1 -- 172.21.15.71:0/4083312171 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c10d960 con 0x7fed2c0fac80 2024-09-10T10:15:13.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.952+0000 7fed32f14640 1 -- 172.21.15.71:0/4083312171 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2c0657b0 con 0x7fed2c0fac80 2024-09-10T10:15:13.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.952+0000 7fed297fa640 1 -- 172.21.15.71:0/4083312171 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fed1402f030 con 0x7fed2c0fac80 2024-09-10T10:15:13.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.952+0000 7fed297fa640 1 --2- 172.21.15.71:0/4083312171 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fed1806e0b0 0x7fed18070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:13.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.953+0000 7fed297fa640 1 -- 172.21.15.71:0/4083312171 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fed140aed50 con 0x7fed2c0fac80 2024-09-10T10:15:13.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.953+0000 7fed2bfff640 1 --2- 172.21.15.71:0/4083312171 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fed1806e0b0 0x7fed18070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:13.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.953+0000 7fed2bfff640 1 --2- 172.21.15.71:0/4083312171 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fed1806e0b0 0x7fed18070560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed2c10ea80 tx=0x7fed1c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:13.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:13.957+0000 7fed297fa640 1 -- 172.21.15.71:0/4083312171 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fed14078020 con 0x7fed2c0fac80 2024-09-10T10:15:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:14.160+0000 7fed32f14640 1 -- 172.21.15.71:0/4083312171 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed2c04b720 con 0x7fed2c0fac80 2024-09-10T10:15:14.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:14.161+0000 7fed297fa640 1 -- 172.21.15.71:0/4083312171 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+5293 (secure 0 0 0) 0x7fed1407b6e0 con 0x7fed2c0fac80 2024-09-10T10:15:14.162 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:14.162 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":44,"btime":"2024-09-10T10:12:17:347805+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":44,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:12:17.347793+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34416,"mds_1":34432},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34432":{"gid":34432,"name":"cephfs.smithi071.omoqqq","rank":1,"incarnation":42,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6829/1608732243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1608732243},{"type":"v1","addr":"172.21.15.71:6829","nonce":1608732243}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44373":{"gid":44373,"name":"cephfs.smithi107.nycoxn","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6825/1627286097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1627286097},{"type":"v1","addr":"172.21.15.107:6825","nonce":1627286097}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44397":{"gid":44397,"name":"cephfs.smithi107.rvgklu","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6827/2279749952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2279749952},{"type":"v1","addr":"172.21.15.107:6827","nonce":2279749952}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34432,34416]},"id":1}]} 2024-09-10T10:15:14.163 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 44 2024-09-10T10:15:14.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:14.163+0000 7fed32f14640 1 -- 172.21.15.71:0/4083312171 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fed1806e0b0 msgr2=0x7fed18070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:14.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:14.163+0000 7fed32f14640 1 --2- 172.21.15.71:0/4083312171 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fed1806e0b0 0x7fed18070560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed2c10ea80 tx=0x7fed1c009040 comp rx=0 tx=0).stop 2024-09-10T10:15:14.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:14.163+0000 7fed32f14640 1 -- 172.21.15.71:0/4083312171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed2c0fac80 msgr2=0x7fed2c1131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:14.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:14.163+0000 7fed32f14640 1 --2- 172.21.15.71:0/4083312171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed2c0fac80 0x7fed2c1131c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fed14004a30 tx=0x7fed14004d10 comp rx=0 tx=0).stop 2024-09-10T10:15:14.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:14.163+0000 7fed32f14640 1 -- 172.21.15.71:0/4083312171 shutdown_connections 2024-09-10T10:15:14.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:14.163+0000 7fed32f14640 1 --2- 172.21.15.71:0/4083312171 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fed1806e0b0 0x7fed18070560 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:14.163+0000 7fed32f14640 1 --2- 172.21.15.71:0/4083312171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed2c102620 0x7fed2c113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:14.163+0000 7fed32f14640 1 --2- 172.21.15.71:0/4083312171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed2c0fac80 0x7fed2c1131c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:14.163+0000 7fed32f14640 1 -- 172.21.15.71:0/4083312171 >> 172.21.15.71:0/4083312171 conn(0x7fed2c070ce0 msgr2=0x7fed2c105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:14.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:14.163+0000 7fed32f14640 1 -- 172.21.15.71:0/4083312171 shutdown_connections 2024-09-10T10:15:14.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:14.163+0000 7fed32f14640 1 -- 172.21.15.71:0/4083312171 wait complete. 2024-09-10T10:15:14.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:14 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/4083312171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:14.863 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 20, 'max_mds': 2, 'flags': 50} 2024-09-10T10:15:14.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 21 2024-09-10T10:15:14.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:14 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/4083312171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:15.112 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:15.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:15 smithi071 ceph-mon[90773]: pgmap v303: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:15:15.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:15 smithi107 ceph-mon[79396]: pgmap v303: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:15:16.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.598+0000 7fb589782640 1 -- 172.21.15.71:0/3864657326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5840fac80 msgr2=0x7fb5840fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:16.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.598+0000 7fb589782640 1 --2- 172.21.15.71:0/3864657326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5840fac80 0x7fb5840fb0f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0048d0 tx=0x7fb56c009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:16.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.598+0000 7fb589782640 1 -- 172.21.15.71:0/3864657326 shutdown_connections 2024-09-10T10:15:16.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.598+0000 7fb589782640 1 --2- 172.21.15.71:0/3864657326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5840fac80 0x7fb5840fb0f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:16.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.598+0000 7fb589782640 1 --2- 172.21.15.71:0/3864657326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb584102620 0x7fb5841029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:16.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.598+0000 7fb589782640 1 -- 172.21.15.71:0/3864657326 >> 172.21.15.71:0/3864657326 conn(0x7fb584070ce0 msgr2=0x7fb5840710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:16.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.598+0000 7fb589782640 1 -- 172.21.15.71:0/3864657326 shutdown_connections 2024-09-10T10:15:16.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.598+0000 7fb589782640 1 -- 172.21.15.71:0/3864657326 wait complete. 2024-09-10T10:15:16.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.598+0000 7fb589782640 1 Processor -- start 2024-09-10T10:15:16.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.598+0000 7fb589782640 1 -- start start 2024-09-10T10:15:16.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb589782640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5840fac80 0x7fb5841131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:16.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb589782640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb584102620 0x7fb584113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:16.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb589782640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb584113d20 con 0x7fb5840fac80 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb589782640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58410d160 con 0x7fb584102620 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb582ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5840fac80 0x7fb5841131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb582ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5840fac80 0x7fb5841131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44964/0 (socket says 172.21.15.71:44964) 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb582ffd640 1 -- 172.21.15.71:0/4071501031 learned_addr learned my addr 172.21.15.71:0/4071501031 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb5827fc640 1 --2- 172.21.15.71:0/4071501031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb584102620 0x7fb584113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb582ffd640 1 -- 172.21.15.71:0/4071501031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb584102620 msgr2=0x7fb584113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb582ffd640 1 --2- 172.21.15.71:0/4071501031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb584102620 0x7fb584113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb582ffd640 1 -- 172.21.15.71:0/4071501031 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c005040 con 0x7fb5840fac80 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb5827fc640 1 --2- 172.21.15.71:0/4071501031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb584102620 0x7fb584113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb582ffd640 1 --2- 172.21.15.71:0/4071501031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5840fac80 0x7fb5841131e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb57400cb10 tx=0x7fb574007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb57b7fe640 1 -- 172.21.15.71:0/4071501031 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb574004200 con 0x7fb5840fac80 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb57b7fe640 1 -- 172.21.15.71:0/4071501031 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb57400acc0 con 0x7fb5840fac80 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.599+0000 7fb589782640 1 -- 172.21.15.71:0/4071501031 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58410d440 con 0x7fb5840fac80 2024-09-10T10:15:16.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.600+0000 7fb57b7fe640 1 -- 172.21.15.71:0/4071501031 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb574003cd0 con 0x7fb5840fac80 2024-09-10T10:15:16.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.600+0000 7fb589782640 1 -- 172.21.15.71:0/4071501031 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58410d9e0 con 0x7fb5840fac80 2024-09-10T10:15:16.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.601+0000 7fb589782640 1 -- 172.21.15.71:0/4071501031 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5840657b0 con 0x7fb5840fac80 2024-09-10T10:15:16.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.601+0000 7fb57b7fe640 1 -- 172.21.15.71:0/4071501031 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb57400a820 con 0x7fb5840fac80 2024-09-10T10:15:16.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.602+0000 7fb57b7fe640 1 --2- 172.21.15.71:0/4071501031 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb57006e0b0 0x7fb570070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:16.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.602+0000 7fb5827fc640 1 --2- 172.21.15.71:0/4071501031 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb57006e0b0 0x7fb570070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:16.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.602+0000 7fb57b7fe640 1 -- 172.21.15.71:0/4071501031 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb57408e340 con 0x7fb5840fac80 2024-09-10T10:15:16.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.602+0000 7fb5827fc640 1 --2- 172.21.15.71:0/4071501031 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb57006e0b0 0x7fb570070560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00b020 tx=0x7fb56c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:16.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.606+0000 7fb57b7fe640 1 -- 172.21.15.71:0/4071501031 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb574057610 con 0x7fb5840fac80 2024-09-10T10:15:16.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.807+0000 7fb589782640 1 -- 172.21.15.71:0/4071501031 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fb584074c00 con 0x7fb5840fac80 2024-09-10T10:15:16.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.808+0000 7fb57b7fe640 1 -- 172.21.15.71:0/4071501031 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v44) v1 ==== 107+0+4934 (secure 0 0 0) 0x7fb57405acd0 con 0x7fb5840fac80 2024-09-10T10:15:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:16.809 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":21,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:03:24.004737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi071.omoqqq","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.71:6829/3739086646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3739086646},{"type":"v1","addr":"172.21.15.71:6829","nonce":3739086646}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14478":{"gid":14478,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6827/1596759135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1596759135},{"type":"v1","addr":"172.21.15.71:6827","nonce":1596759135}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi107.nycoxn","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6825/2124995551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2124995551},{"type":"v1","addr":"172.21.15.107:6825","nonce":2124995551}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24279":{"gid":24279,"name":"cephfs.smithi107.rvgklu","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.107:6827/132718485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":132718485},{"type":"v1","addr":"172.21.15.107:6827","nonce":132718485}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T10:15:16.810 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 21 2024-09-10T10:15:16.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.810+0000 7fb589782640 1 -- 172.21.15.71:0/4071501031 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb57006e0b0 msgr2=0x7fb570070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:16.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.810+0000 7fb589782640 1 --2- 172.21.15.71:0/4071501031 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb57006e0b0 0x7fb570070560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00b020 tx=0x7fb56c009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:16.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.810+0000 7fb589782640 1 -- 172.21.15.71:0/4071501031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5840fac80 msgr2=0x7fb5841131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:16.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.810+0000 7fb589782640 1 --2- 172.21.15.71:0/4071501031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5840fac80 0x7fb5841131e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb57400cb10 tx=0x7fb574007ee0 comp rx=0 tx=0).stop 2024-09-10T10:15:16.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.810+0000 7fb589782640 1 -- 172.21.15.71:0/4071501031 shutdown_connections 2024-09-10T10:15:16.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.810+0000 7fb589782640 1 --2- 172.21.15.71:0/4071501031 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fb57006e0b0 0x7fb570070560 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:16.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.810+0000 7fb589782640 1 --2- 172.21.15.71:0/4071501031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb584102620 0x7fb584113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:16.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.810+0000 7fb589782640 1 --2- 172.21.15.71:0/4071501031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5840fac80 0x7fb5841131e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:16.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.810+0000 7fb589782640 1 -- 172.21.15.71:0/4071501031 >> 172.21.15.71:0/4071501031 conn(0x7fb584070ce0 msgr2=0x7fb584105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:16.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.810+0000 7fb589782640 1 -- 172.21.15.71:0/4071501031 shutdown_connections 2024-09-10T10:15:16.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:16.810+0000 7fb589782640 1 -- 172.21.15.71:0/4071501031 wait complete. 2024-09-10T10:15:17.451 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 22 2024-09-10T10:15:17.698 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:17.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:17 smithi071 ceph-mon[90773]: pgmap v304: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:17.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:17 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/4071501031' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-10T10:15:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:17 smithi107 ceph-mon[79396]: pgmap v304: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:17.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:17 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/4071501031' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-10T10:15:19.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.230+0000 7fee52d3c640 1 -- 172.21.15.71:0/3153308970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee4c0fd540 msgr2=0x7fee4c0fd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:19.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.230+0000 7fee52d3c640 1 --2- 172.21.15.71:0/3153308970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee4c0fd540 0x7fee4c0fd910 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fee44004900 tx=0x7fee44009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:19.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.230+0000 7fee52d3c640 1 -- 172.21.15.71:0/3153308970 shutdown_connections 2024-09-10T10:15:19.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.230+0000 7fee52d3c640 1 --2- 172.21.15.71:0/3153308970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee4c0fdee0 0x7fee4c1065b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:19.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.230+0000 7fee52d3c640 1 --2- 172.21.15.71:0/3153308970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee4c0fd540 0x7fee4c0fd910 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:19.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.230+0000 7fee52d3c640 1 -- 172.21.15.71:0/3153308970 >> 172.21.15.71:0/3153308970 conn(0x7fee4c0f7000 msgr2=0x7fee4c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:19.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.230+0000 7fee52d3c640 1 -- 172.21.15.71:0/3153308970 shutdown_connections 2024-09-10T10:15:19.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.230+0000 7fee52d3c640 1 -- 172.21.15.71:0/3153308970 wait complete. 2024-09-10T10:15:19.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.230+0000 7fee52d3c640 1 Processor -- start 2024-09-10T10:15:19.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.230+0000 7fee52d3c640 1 -- start start 2024-09-10T10:15:19.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee52d3c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee4c0fd540 0x7fee4c0fb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:19.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee52d3c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee4c0fdee0 0x7fee4c0fb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:19.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee52d3c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0fbf10 con 0x7fee4c0fd540 2024-09-10T10:15:19.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee52d3c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0fc080 con 0x7fee4c0fdee0 2024-09-10T10:15:19.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee50ad8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee4c0fd540 0x7fee4c0fb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:19.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee50ad8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee4c0fd540 0x7fee4c0fb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44986/0 (socket says 172.21.15.71:44986) 2024-09-10T10:15:19.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee50ad8640 1 -- 172.21.15.71:0/456331230 learned_addr learned my addr 172.21.15.71:0/456331230 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:19.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee4bfff640 1 --2- 172.21.15.71:0/456331230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee4c0fdee0 0x7fee4c0fb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:19.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee50ad8640 1 -- 172.21.15.71:0/456331230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee4c0fdee0 msgr2=0x7fee4c0fb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:19.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee50ad8640 1 --2- 172.21.15.71:0/456331230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee4c0fdee0 0x7fee4c0fb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:19.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee50ad8640 1 -- 172.21.15.71:0/456331230 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee44005040 con 0x7fee4c0fd540 2024-09-10T10:15:19.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee50ad8640 1 --2- 172.21.15.71:0/456331230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee4c0fd540 0x7fee4c0fb400 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fee44004960 tx=0x7fee44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:19.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee497fa640 1 -- 172.21.15.71:0/456331230 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee44038070 con 0x7fee4c0fd540 2024-09-10T10:15:19.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee497fa640 1 -- 172.21.15.71:0/456331230 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fee44008ed0 con 0x7fee4c0fd540 2024-09-10T10:15:19.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.231+0000 7fee52d3c640 1 -- 172.21.15.71:0/456331230 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c1195f0 con 0x7fee4c0fd540 2024-09-10T10:15:19.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.232+0000 7fee497fa640 1 -- 172.21.15.71:0/456331230 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee440095a0 con 0x7fee4c0fd540 2024-09-10T10:15:19.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.232+0000 7fee52d3c640 1 -- 172.21.15.71:0/456331230 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c119970 con 0x7fee4c0fd540 2024-09-10T10:15:19.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.232+0000 7fee52d3c640 1 -- 172.21.15.71:0/456331230 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4c0662d0 con 0x7fee4c0fd540 2024-09-10T10:15:19.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.233+0000 7fee497fa640 1 -- 172.21.15.71:0/456331230 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fee44030020 con 0x7fee4c0fd540 2024-09-10T10:15:19.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.234+0000 7fee497fa640 1 --2- 172.21.15.71:0/456331230 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fee3806e0b0 0x7fee38070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:19.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.234+0000 7fee4bfff640 1 --2- 172.21.15.71:0/456331230 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fee3806e0b0 0x7fee38070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:19.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.234+0000 7fee497fa640 1 -- 172.21.15.71:0/456331230 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fee440adb40 con 0x7fee4c0fd540 2024-09-10T10:15:19.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.234+0000 7fee4bfff640 1 --2- 172.21.15.71:0/456331230 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fee3806e0b0 0x7fee38070560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0fcd40 tx=0x7fee3c009620 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:19.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.238+0000 7fee497fa640 1 -- 172.21.15.71:0/456331230 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fee44076ed0 con 0x7fee4c0fd540 2024-09-10T10:15:19.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.439+0000 7fee52d3c640 1 -- 172.21.15.71:0/456331230 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fee4c04b750 con 0x7fee4c0fd540 2024-09-10T10:15:19.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.439+0000 7fee497fa640 1 -- 172.21.15.71:0/456331230 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v44) v1 ==== 107+0+4935 (secure 0 0 0) 0x7fee44081070 con 0x7fee4c0fd540 2024-09-10T10:15:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:19.441 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":22,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:04:19.815073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi071.omoqqq","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.71:6829/3739086646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3739086646},{"type":"v1","addr":"172.21.15.71:6829","nonce":3739086646}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14478":{"gid":14478,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6827/1596759135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1596759135},{"type":"v1","addr":"172.21.15.71:6827","nonce":1596759135}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi107.nycoxn","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6825/2124995551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2124995551},{"type":"v1","addr":"172.21.15.107:6825","nonce":2124995551}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24279":{"gid":24279,"name":"cephfs.smithi107.rvgklu","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.107:6827/132718485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":132718485},{"type":"v1","addr":"172.21.15.107:6827","nonce":132718485}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T10:15:19.441 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 22 2024-09-10T10:15:19.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.441+0000 7fee52d3c640 1 -- 172.21.15.71:0/456331230 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fee3806e0b0 msgr2=0x7fee38070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:19.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.441+0000 7fee52d3c640 1 --2- 172.21.15.71:0/456331230 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fee3806e0b0 0x7fee38070560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0fcd40 tx=0x7fee3c009620 comp rx=0 tx=0).stop 2024-09-10T10:15:19.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.441+0000 7fee52d3c640 1 -- 172.21.15.71:0/456331230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee4c0fd540 msgr2=0x7fee4c0fb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:19.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.441+0000 7fee52d3c640 1 --2- 172.21.15.71:0/456331230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee4c0fd540 0x7fee4c0fb400 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fee44004960 tx=0x7fee44009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:19.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.441+0000 7fee52d3c640 1 -- 172.21.15.71:0/456331230 shutdown_connections 2024-09-10T10:15:19.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.442+0000 7fee52d3c640 1 --2- 172.21.15.71:0/456331230 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fee3806e0b0 0x7fee38070560 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:19.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.442+0000 7fee52d3c640 1 --2- 172.21.15.71:0/456331230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee4c0fdee0 0x7fee4c0fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:19.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.442+0000 7fee52d3c640 1 --2- 172.21.15.71:0/456331230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee4c0fd540 0x7fee4c0fb400 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:19.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.442+0000 7fee52d3c640 1 -- 172.21.15.71:0/456331230 >> 172.21.15.71:0/456331230 conn(0x7fee4c0f7000 msgr2=0x7fee4c0f8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:19.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.442+0000 7fee52d3c640 1 -- 172.21.15.71:0/456331230 shutdown_connections 2024-09-10T10:15:19.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:19.442+0000 7fee52d3c640 1 -- 172.21.15.71:0/456331230 wait complete. 2024-09-10T10:15:19.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:19 smithi071 ceph-mon[90773]: pgmap v305: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:19.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:19 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/456331230' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-10T10:15:19.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:19 smithi107 ceph-mon[79396]: pgmap v305: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:19.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:19 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/456331230' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-10T10:15:20.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 23 2024-09-10T10:15:20.290 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:20.736 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:20 smithi071 ceph-mon[90773]: pgmap v306: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:20.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:20 smithi107 ceph-mon[79396]: pgmap v306: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:21.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.877+0000 7fddb7db6640 1 -- 172.21.15.71:0/868328497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddb00fabe0 msgr2=0x7fddb00fb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:21.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.877+0000 7fddb7db6640 1 --2- 172.21.15.71:0/868328497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddb00fabe0 0x7fddb00fb030 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fddac0048d0 tx=0x7fddac009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:21.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.877+0000 7fddb7db6640 1 -- 172.21.15.71:0/868328497 shutdown_connections 2024-09-10T10:15:21.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.877+0000 7fddb7db6640 1 --2- 172.21.15.71:0/868328497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddb00fabe0 0x7fddb00fb030 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:21.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.877+0000 7fddb7db6640 1 --2- 172.21.15.71:0/868328497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddb00fe460 0x7fddb00fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:21.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.877+0000 7fddb7db6640 1 -- 172.21.15.71:0/868328497 >> 172.21.15.71:0/868328497 conn(0x7fddb0071b00 msgr2=0x7fddb0071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:21.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.878+0000 7fddb7db6640 1 -- 172.21.15.71:0/868328497 shutdown_connections 2024-09-10T10:15:21.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.878+0000 7fddb7db6640 1 -- 172.21.15.71:0/868328497 wait complete. 2024-09-10T10:15:21.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.878+0000 7fddb7db6640 1 Processor -- start 2024-09-10T10:15:21.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.878+0000 7fddb7db6640 1 -- start start 2024-09-10T10:15:21.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.878+0000 7fddb7db6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddb00fabe0 0x7fddb0113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:21.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.878+0000 7fddb7db6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddb00fe460 0x7fddb0113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:21.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.878+0000 7fddb7db6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb0113d90 con 0x7fddb00fabe0 2024-09-10T10:15:21.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.878+0000 7fddb7db6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb010d1d0 con 0x7fddb00fe460 2024-09-10T10:15:21.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.878+0000 7fddb5b52640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddb00fabe0 0x7fddb0113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:21.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.878+0000 7fddb5b52640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddb00fabe0 0x7fddb0113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45006/0 (socket says 172.21.15.71:45006) 2024-09-10T10:15:21.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.878+0000 7fddb5b52640 1 -- 172.21.15.71:0/2080454960 learned_addr learned my addr 172.21.15.71:0/2080454960 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:21.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.879+0000 7fddb5351640 1 --2- 172.21.15.71:0/2080454960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddb00fe460 0x7fddb0113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:21.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.879+0000 7fddb5b52640 1 -- 172.21.15.71:0/2080454960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddb00fe460 msgr2=0x7fddb0113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:21.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.879+0000 7fddb5b52640 1 --2- 172.21.15.71:0/2080454960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddb00fe460 0x7fddb0113790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:21.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.879+0000 7fddb5b52640 1 -- 172.21.15.71:0/2080454960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac005040 con 0x7fddb00fabe0 2024-09-10T10:15:21.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.879+0000 7fddb5b52640 1 --2- 172.21.15.71:0/2080454960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddb00fabe0 0x7fddb0113250 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdda0002a50 tx=0x7fdda0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:21.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.879+0000 7fdda67fc640 1 -- 172.21.15.71:0/2080454960 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdda0007c30 con 0x7fddb00fabe0 2024-09-10T10:15:21.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.879+0000 7fdda67fc640 1 -- 172.21.15.71:0/2080454960 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdda000f040 con 0x7fddb00fabe0 2024-09-10T10:15:21.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.879+0000 7fddb7db6640 1 -- 172.21.15.71:0/2080454960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb010d4b0 con 0x7fddb00fabe0 2024-09-10T10:15:21.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.879+0000 7fdda67fc640 1 -- 172.21.15.71:0/2080454960 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdda000da90 con 0x7fddb00fabe0 2024-09-10T10:15:21.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.879+0000 7fddb7db6640 1 -- 172.21.15.71:0/2080454960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb010d9a0 con 0x7fddb00fabe0 2024-09-10T10:15:21.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.880+0000 7fddb7db6640 1 -- 172.21.15.71:0/2080454960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb0072610 con 0x7fddb00fabe0 2024-09-10T10:15:21.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.881+0000 7fdda67fc640 1 -- 172.21.15.71:0/2080454960 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdda000dd00 con 0x7fddb00fabe0 2024-09-10T10:15:21.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.881+0000 7fdda67fc640 1 --2- 172.21.15.71:0/2080454960 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fdd9c06e0b0 0x7fdd9c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:21.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.881+0000 7fdda67fc640 1 -- 172.21.15.71:0/2080454960 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fdda008d510 con 0x7fddb00fabe0 2024-09-10T10:15:21.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.881+0000 7fddb5351640 1 --2- 172.21.15.71:0/2080454960 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fdd9c06e0b0 0x7fdd9c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:21.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.882+0000 7fddb5351640 1 --2- 172.21.15.71:0/2080454960 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fdd9c06e0b0 0x7fdd9c070560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fddb00f7e90 tx=0x7fddac035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:21.886+0000 7fdda67fc640 1 -- 172.21.15.71:0/2080454960 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdda00567e0 con 0x7fddb00fabe0 2024-09-10T10:15:22.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:22.087+0000 7fddb7db6640 1 -- 172.21.15.71:0/2080454960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fddb0064d50 con 0x7fddb00fabe0 2024-09-10T10:15:22.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:22.088+0000 7fdda67fc640 1 -- 172.21.15.71:0/2080454960 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v44) v1 ==== 107+0+4949 (secure 0 0 0) 0x7fdda0059ea0 con 0x7fddb00fabe0 2024-09-10T10:15:22.089 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:22.090 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"btime":"2024-09-10T10:07:03:646253+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:07:03.646249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi071.omoqqq","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.71:6829/3739086646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3739086646},{"type":"v1","addr":"172.21.15.71:6829","nonce":3739086646}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14478":{"gid":14478,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6827/1596759135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1596759135},{"type":"v1","addr":"172.21.15.71:6827","nonce":1596759135}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi107.nycoxn","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6825/2124995551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2124995551},{"type":"v1","addr":"172.21.15.107:6825","nonce":2124995551}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24279":{"gid":24279,"name":"cephfs.smithi107.rvgklu","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.107:6827/132718485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":132718485},{"type":"v1","addr":"172.21.15.107:6827","nonce":132718485}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464,24267]},"id":1}]} 2024-09-10T10:15:22.090 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 23 2024-09-10T10:15:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:22.090+0000 7fddb7db6640 1 -- 172.21.15.71:0/2080454960 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fdd9c06e0b0 msgr2=0x7fdd9c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:22.090+0000 7fddb7db6640 1 --2- 172.21.15.71:0/2080454960 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fdd9c06e0b0 0x7fdd9c070560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fddb00f7e90 tx=0x7fddac035040 comp rx=0 tx=0).stop 2024-09-10T10:15:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:22.090+0000 7fddb7db6640 1 -- 172.21.15.71:0/2080454960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddb00fabe0 msgr2=0x7fddb0113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:22.090+0000 7fddb7db6640 1 --2- 172.21.15.71:0/2080454960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddb00fabe0 0x7fddb0113250 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdda0002a50 tx=0x7fdda0004600 comp rx=0 tx=0).stop 2024-09-10T10:15:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:22.090+0000 7fddb7db6640 1 -- 172.21.15.71:0/2080454960 shutdown_connections 2024-09-10T10:15:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:22.090+0000 7fddb7db6640 1 --2- 172.21.15.71:0/2080454960 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fdd9c06e0b0 0x7fdd9c070560 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:22.090+0000 7fddb7db6640 1 --2- 172.21.15.71:0/2080454960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fddb00fe460 0x7fddb0113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:22.090+0000 7fddb7db6640 1 --2- 172.21.15.71:0/2080454960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddb00fabe0 0x7fddb0113250 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:22.090+0000 7fddb7db6640 1 -- 172.21.15.71:0/2080454960 >> 172.21.15.71:0/2080454960 conn(0x7fddb0071b00 msgr2=0x7fddb0101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:22.090+0000 7fddb7db6640 1 -- 172.21.15.71:0/2080454960 shutdown_connections 2024-09-10T10:15:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:22.090+0000 7fddb7db6640 1 -- 172.21.15.71:0/2080454960 wait complete. 2024-09-10T10:15:22.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:22 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2080454960' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-10T10:15:22.397 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:22 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2080454960' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-10T10:15:22.731 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 24 2024-09-10T10:15:22.979 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:23.417 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:23 smithi071 ceph-mon[90773]: pgmap v307: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:23.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:23 smithi107 ceph-mon[79396]: pgmap v307: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:24.464 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:15:24.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:15:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.683+0000 7f5378ab5640 1 -- 172.21.15.71:0/108846867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5374102550 msgr2=0x7f5374102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.683+0000 7f5378ab5640 1 --2- 172.21.15.71:0/108846867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5374102550 0x7f5374102920 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f53640048d0 tx=0x7f5364009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.683+0000 7f5378ab5640 1 -- 172.21.15.71:0/108846867 shutdown_connections 2024-09-10T10:15:24.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.683+0000 7f5378ab5640 1 --2- 172.21.15.71:0/108846867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5374102ef0 0x7f53740fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.683+0000 7f5378ab5640 1 --2- 172.21.15.71:0/108846867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5374102550 0x7f5374102920 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.683+0000 7f5378ab5640 1 -- 172.21.15.71:0/108846867 >> 172.21.15.71:0/108846867 conn(0x7f53740f80f0 msgr2=0x7f53740fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.683+0000 7f5378ab5640 1 -- 172.21.15.71:0/108846867 shutdown_connections 2024-09-10T10:15:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.683+0000 7f5378ab5640 1 -- 172.21.15.71:0/108846867 wait complete. 2024-09-10T10:15:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f5378ab5640 1 Processor -- start 2024-09-10T10:15:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f5378ab5640 1 -- start start 2024-09-10T10:15:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f5378ab5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5374102550 0x7f5374113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f5378ab5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5374102ef0 0x7f5374113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f5378ab5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5374114100 con 0x7f5374102550 2024-09-10T10:15:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f5378ab5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537410d510 con 0x7f5374102ef0 2024-09-10T10:15:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f537259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5374102550 0x7f5374113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:24.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f537259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5374102550 0x7f5374113570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60504/0 (socket says 172.21.15.71:60504) 2024-09-10T10:15:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f537259c640 1 -- 172.21.15.71:0/214302922 learned_addr learned my addr 172.21.15.71:0/214302922 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f537259c640 1 -- 172.21.15.71:0/214302922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5374102ef0 msgr2=0x7f5374113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f5371d9b640 1 --2- 172.21.15.71:0/214302922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5374102ef0 0x7f5374113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f537259c640 1 --2- 172.21.15.71:0/214302922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5374102ef0 0x7f5374113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f537259c640 1 -- 172.21.15.71:0/214302922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5364005040 con 0x7f5374102550 2024-09-10T10:15:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.684+0000 7f5371d9b640 1 --2- 172.21.15.71:0/214302922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5374102ef0 0x7f5374113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.685+0000 7f537259c640 1 --2- 172.21.15.71:0/214302922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5374102550 0x7f5374113570 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5364000c00 tx=0x7f5364009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.685+0000 7f5362ffd640 1 -- 172.21.15.71:0/214302922 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5364038070 con 0x7f5374102550 2024-09-10T10:15:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.685+0000 7f5362ffd640 1 -- 172.21.15.71:0/214302922 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f536402ade0 con 0x7f5374102550 2024-09-10T10:15:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.685+0000 7f5378ab5640 1 -- 172.21.15.71:0/214302922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537410d790 con 0x7f5374102550 2024-09-10T10:15:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.685+0000 7f5362ffd640 1 -- 172.21.15.71:0/214302922 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f536402c7e0 con 0x7f5374102550 2024-09-10T10:15:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.685+0000 7f5378ab5640 1 -- 172.21.15.71:0/214302922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537410dc50 con 0x7f5374102550 2024-09-10T10:15:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.686+0000 7f5378ab5640 1 -- 172.21.15.71:0/214302922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53740fdcd0 con 0x7f5374102550 2024-09-10T10:15:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.686+0000 7f5362ffd640 1 -- 172.21.15.71:0/214302922 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5364030020 con 0x7f5374102550 2024-09-10T10:15:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.687+0000 7f5362ffd640 1 --2- 172.21.15.71:0/214302922 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f535c06e0b0 0x7f535c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.687+0000 7f5362ffd640 1 -- 172.21.15.71:0/214302922 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f53640ad870 con 0x7f5374102550 2024-09-10T10:15:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.687+0000 7f5371d9b640 1 --2- 172.21.15.71:0/214302922 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f535c06e0b0 0x7f535c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.687+0000 7f5371d9b640 1 --2- 172.21.15.71:0/214302922 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f535c06e0b0 0x7f535c070560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5368009af0 tx=0x7f536800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.691+0000 7f5362ffd640 1 -- 172.21.15.71:0/214302922 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5364076bf0 con 0x7f5374102550 2024-09-10T10:15:24.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.894+0000 7f5378ab5640 1 -- 172.21.15.71:0/214302922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f537404b7b0 con 0x7f5374102550 2024-09-10T10:15:24.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.894+0000 7f5362ffd640 1 -- 172.21.15.71:0/214302922 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v44) v1 ==== 107+0+4948 (secure 0 0 0) 0x7f536407a2b0 con 0x7f5374102550 2024-09-10T10:15:24.896 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:24.896 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":24,"btime":"2024-09-10T10:07:40:170505+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:07:39.792181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi071.omoqqq","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.71:6829/3739086646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3739086646},{"type":"v1","addr":"172.21.15.71:6829","nonce":3739086646}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14478":{"gid":14478,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6827/1596759135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1596759135},{"type":"v1","addr":"172.21.15.71:6827","nonce":1596759135}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi107.nycoxn","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6825/2124995551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2124995551},{"type":"v1","addr":"172.21.15.107:6825","nonce":2124995551}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24279":{"gid":24279,"name":"cephfs.smithi107.rvgklu","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.107:6827/132718485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":132718485},{"type":"v1","addr":"172.21.15.107:6827","nonce":132718485}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[24267,14464]},"id":1}]} 2024-09-10T10:15:24.897 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 24 2024-09-10T10:15:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.896+0000 7f5378ab5640 1 -- 172.21.15.71:0/214302922 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f535c06e0b0 msgr2=0x7f535c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.896+0000 7f5378ab5640 1 --2- 172.21.15.71:0/214302922 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f535c06e0b0 0x7f535c070560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5368009af0 tx=0x7f536800b040 comp rx=0 tx=0).stop 2024-09-10T10:15:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.896+0000 7f5378ab5640 1 -- 172.21.15.71:0/214302922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5374102550 msgr2=0x7f5374113570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.896+0000 7f5378ab5640 1 --2- 172.21.15.71:0/214302922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5374102550 0x7f5374113570 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5364000c00 tx=0x7f5364009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.897+0000 7f5378ab5640 1 -- 172.21.15.71:0/214302922 shutdown_connections 2024-09-10T10:15:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.897+0000 7f5378ab5640 1 --2- 172.21.15.71:0/214302922 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f535c06e0b0 0x7f535c070560 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.897+0000 7f5378ab5640 1 --2- 172.21.15.71:0/214302922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5374102ef0 0x7f5374113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.897+0000 7f5378ab5640 1 --2- 172.21.15.71:0/214302922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5374102550 0x7f5374113570 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.897+0000 7f5378ab5640 1 -- 172.21.15.71:0/214302922 >> 172.21.15.71:0/214302922 conn(0x7f53740f80f0 msgr2=0x7f53740f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.897+0000 7f5378ab5640 1 -- 172.21.15.71:0/214302922 shutdown_connections 2024-09-10T10:15:24.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:24.897+0000 7f5378ab5640 1 -- 172.21.15.71:0/214302922 wait complete. 2024-09-10T10:15:25.478 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:25 smithi071 ceph-mon[90773]: pgmap v308: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:15:25.478 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:25 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/214302922' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-10T10:15:25.503 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 25 2024-09-10T10:15:25.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:25 smithi107 ceph-mon[79396]: pgmap v308: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:15:25.547 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:25 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/214302922' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-10T10:15:25.753 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:26.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:26 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:15:26.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:26 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:15:27.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.323+0000 7f58d986f640 1 -- 172.21.15.71:0/3956774225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d40fe450 msgr2=0x7f58d40fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:27.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.323+0000 7f58d986f640 1 --2- 172.21.15.71:0/3956774225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d40fe450 0x7f58d40fe820 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009c50 tx=0x7f58c4004d10 comp rx=0 tx=0).stop 2024-09-10T10:15:27.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.323+0000 7f58d986f640 1 -- 172.21.15.71:0/3956774225 shutdown_connections 2024-09-10T10:15:27.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.323+0000 7f58d986f640 1 --2- 172.21.15.71:0/3956774225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d4064fe0 0x7f58d4065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.323+0000 7f58d986f640 1 --2- 172.21.15.71:0/3956774225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d40fe450 0x7f58d40fe820 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.323+0000 7f58d986f640 1 -- 172.21.15.71:0/3956774225 >> 172.21.15.71:0/3956774225 conn(0x7f58d40723b0 msgr2=0x7f58d40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:27.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.323+0000 7f58d986f640 1 -- 172.21.15.71:0/3956774225 shutdown_connections 2024-09-10T10:15:27.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.323+0000 7f58d986f640 1 -- 172.21.15.71:0/3956774225 wait complete. 2024-09-10T10:15:27.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.324+0000 7f58d986f640 1 Processor -- start 2024-09-10T10:15:27.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.324+0000 7f58d986f640 1 -- start start 2024-09-10T10:15:27.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.324+0000 7f58d986f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4064fe0 0x7f58d4113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.324+0000 7f58d986f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d40fe450 0x7f58d4113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.324+0000 7f58d986f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d4113e20 con 0x7f58d4064fe0 2024-09-10T10:15:27.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.324+0000 7f58d986f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d410d1d0 con 0x7f58d40fe450 2024-09-10T10:15:27.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.325+0000 7f58d2ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4064fe0 0x7f58d4113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.325+0000 7f58d2ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4064fe0 0x7f58d4113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60524/0 (socket says 172.21.15.71:60524) 2024-09-10T10:15:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.325+0000 7f58d2ffd640 1 -- 172.21.15.71:0/1766239499 learned_addr learned my addr 172.21.15.71:0/1766239499 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.325+0000 7f58d27fc640 1 --2- 172.21.15.71:0/1766239499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d40fe450 0x7f58d4113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.325+0000 7f58d2ffd640 1 -- 172.21.15.71:0/1766239499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d40fe450 msgr2=0x7f58d4113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.325+0000 7f58d2ffd640 1 --2- 172.21.15.71:0/1766239499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d40fe450 0x7f58d4113790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.325+0000 7f58d2ffd640 1 -- 172.21.15.71:0/1766239499 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c40098b0 con 0x7f58d4064fe0 2024-09-10T10:15:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.325+0000 7f58d2ffd640 1 --2- 172.21.15.71:0/1766239499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4064fe0 0x7f58d4113250 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f58c4004a30 tx=0x7f58c4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.325+0000 7f58bb7fe640 1 -- 172.21.15.71:0/1766239499 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58c4009690 con 0x7f58d4064fe0 2024-09-10T10:15:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.325+0000 7f58d986f640 1 -- 172.21.15.71:0/1766239499 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d410d450 con 0x7f58d4064fe0 2024-09-10T10:15:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.325+0000 7f58bb7fe640 1 -- 172.21.15.71:0/1766239499 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f58c4032b10 con 0x7f58d4064fe0 2024-09-10T10:15:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.325+0000 7f58bb7fe640 1 -- 172.21.15.71:0/1766239499 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58c403daa0 con 0x7f58d4064fe0 2024-09-10T10:15:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.325+0000 7f58d986f640 1 -- 172.21.15.71:0/1766239499 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d410d970 con 0x7f58d4064fe0 2024-09-10T10:15:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.326+0000 7f58d986f640 1 -- 172.21.15.71:0/1766239499 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d40fdce0 con 0x7f58d4064fe0 2024-09-10T10:15:27.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.327+0000 7f58bb7fe640 1 -- 172.21.15.71:0/1766239499 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f58c402f030 con 0x7f58d4064fe0 2024-09-10T10:15:27.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.327+0000 7f58bb7fe640 1 --2- 172.21.15.71:0/1766239499 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f58bc06e0b0 0x7f58bc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.327+0000 7f58bb7fe640 1 -- 172.21.15.71:0/1766239499 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f58c40aed50 con 0x7f58d4064fe0 2024-09-10T10:15:27.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.327+0000 7f58d27fc640 1 --2- 172.21.15.71:0/1766239499 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f58bc06e0b0 0x7f58bc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.328+0000 7f58d27fc640 1 --2- 172.21.15.71:0/1766239499 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f58bc06e0b0 0x7f58bc070560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58c8006fd0 tx=0x7f58c8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:27.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.332+0000 7f58bb7fe640 1 -- 172.21.15.71:0/1766239499 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f58c4078020 con 0x7f58d4064fe0 2024-09-10T10:15:27.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.535+0000 7f58d986f640 1 -- 172.21.15.71:0/1766239499 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f58d404b750 con 0x7f58d4064fe0 2024-09-10T10:15:27.537 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:27 smithi071 ceph-mon[90773]: pgmap v309: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:27.537 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:15:27.537 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:15:27.537 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:15:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.536+0000 7f58bb7fe640 1 -- 172.21.15.71:0/1766239499 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v44) v1 ==== 107+0+3376 (secure 0 0 0) 0x7f58c4041d40 con 0x7f58d4064fe0 2024-09-10T10:15:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:27.538 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"btime":"2024-09-10T10:10:35:473378+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:10:34.476236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi071.omoqqq","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.71:6829/3739086646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3739086646},{"type":"v1","addr":"172.21.15.71:6829","nonce":3739086646}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi107.nycoxn","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6825/2124995551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2124995551},{"type":"v1","addr":"172.21.15.107:6825","nonce":2124995551}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464,24267]},"id":1}]} 2024-09-10T10:15:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 25 2024-09-10T10:15:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.538+0000 7f58d986f640 1 -- 172.21.15.71:0/1766239499 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f58bc06e0b0 msgr2=0x7f58bc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.538+0000 7f58d986f640 1 --2- 172.21.15.71:0/1766239499 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f58bc06e0b0 0x7f58bc070560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58c8006fd0 tx=0x7f58c8008040 comp rx=0 tx=0).stop 2024-09-10T10:15:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.538+0000 7f58d986f640 1 -- 172.21.15.71:0/1766239499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4064fe0 msgr2=0x7f58d4113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.538+0000 7f58d986f640 1 --2- 172.21.15.71:0/1766239499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4064fe0 0x7f58d4113250 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f58c4004a30 tx=0x7f58c4004d10 comp rx=0 tx=0).stop 2024-09-10T10:15:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.538+0000 7f58d986f640 1 -- 172.21.15.71:0/1766239499 shutdown_connections 2024-09-10T10:15:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.538+0000 7f58d986f640 1 --2- 172.21.15.71:0/1766239499 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f58bc06e0b0 0x7f58bc070560 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.538+0000 7f58d986f640 1 --2- 172.21.15.71:0/1766239499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d40fe450 0x7f58d4113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.538+0000 7f58d986f640 1 --2- 172.21.15.71:0/1766239499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4064fe0 0x7f58d4113250 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.538+0000 7f58d986f640 1 -- 172.21.15.71:0/1766239499 >> 172.21.15.71:0/1766239499 conn(0x7f58d40723b0 msgr2=0x7f58d40fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.538+0000 7f58d986f640 1 -- 172.21.15.71:0/1766239499 shutdown_connections 2024-09-10T10:15:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:27.538+0000 7f58d986f640 1 -- 172.21.15.71:0/1766239499 wait complete. 2024-09-10T10:15:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:27 smithi107 ceph-mon[79396]: pgmap v309: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:15:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:15:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:15:28.150 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-10T10:15:28.150 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 26 2024-09-10T10:15:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:28.520 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:28 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/1766239499' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-10T10:15:28.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:28 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/1766239499' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-10T10:15:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:29 smithi107 ceph-mon[79396]: pgmap v310: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:29.674 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:29 smithi071 ceph-mon[90773]: pgmap v310: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:30.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.021+0000 7fd469449640 1 -- 172.21.15.71:0/2427578552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4641014b0 msgr2=0x7fd464101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:30.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.021+0000 7fd469449640 1 --2- 172.21.15.71:0/2427578552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4641014b0 0x7fd464101880 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd4540048d0 tx=0x7fd454009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.021+0000 7fd469449640 1 -- 172.21.15.71:0/2427578552 shutdown_connections 2024-09-10T10:15:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.021+0000 7fd469449640 1 --2- 172.21.15.71:0/2427578552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4640fb470 0x7fd4640fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.021+0000 7fd469449640 1 --2- 172.21.15.71:0/2427578552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4641014b0 0x7fd464101880 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.021+0000 7fd469449640 1 -- 172.21.15.71:0/2427578552 >> 172.21.15.71:0/2427578552 conn(0x7fd4640f7030 msgr2=0x7fd4640f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.021+0000 7fd469449640 1 -- 172.21.15.71:0/2427578552 shutdown_connections 2024-09-10T10:15:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.021+0000 7fd469449640 1 -- 172.21.15.71:0/2427578552 wait complete. 2024-09-10T10:15:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.022+0000 7fd469449640 1 Processor -- start 2024-09-10T10:15:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.022+0000 7fd469449640 1 -- start start 2024-09-10T10:15:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.022+0000 7fd469449640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4640fb470 0x7fd46410e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.022+0000 7fd469449640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4641014b0 0x7fd46410e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.022+0000 7fd469449640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46410ed20 con 0x7fd4641014b0 2024-09-10T10:15:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.022+0000 7fd469449640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46410ee90 con 0x7fd4640fb470 2024-09-10T10:15:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.022+0000 7fd4627fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4641014b0 0x7fd46410e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.023+0000 7fd4627fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4641014b0 0x7fd46410e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60538/0 (socket says 172.21.15.71:60538) 2024-09-10T10:15:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.023+0000 7fd4627fc640 1 -- 172.21.15.71:0/2967090126 learned_addr learned my addr 172.21.15.71:0/2967090126 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.023+0000 7fd462ffd640 1 --2- 172.21.15.71:0/2967090126 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4640fb470 0x7fd46410e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.023+0000 7fd4627fc640 1 -- 172.21.15.71:0/2967090126 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4640fb470 msgr2=0x7fd46410e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.023+0000 7fd4627fc640 1 --2- 172.21.15.71:0/2967090126 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4640fb470 0x7fd46410e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.023+0000 7fd4627fc640 1 -- 172.21.15.71:0/2967090126 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd454005040 con 0x7fd4641014b0 2024-09-10T10:15:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.023+0000 7fd4627fc640 1 --2- 172.21.15.71:0/2967090126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4641014b0 0x7fd46410e7e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c810 tx=0x7fd4580043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.023+0000 7fd44b7fe640 1 -- 172.21.15.71:0/2967090126 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd45800a7a0 con 0x7fd4641014b0 2024-09-10T10:15:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.023+0000 7fd44b7fe640 1 -- 172.21.15.71:0/2967090126 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd45800ada0 con 0x7fd4641014b0 2024-09-10T10:15:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.023+0000 7fd44b7fe640 1 -- 172.21.15.71:0/2967090126 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd458011380 con 0x7fd4641014b0 2024-09-10T10:15:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.023+0000 7fd469449640 1 -- 172.21.15.71:0/2967090126 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd464117170 con 0x7fd4641014b0 2024-09-10T10:15:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.023+0000 7fd469449640 1 -- 172.21.15.71:0/2967090126 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd464117690 con 0x7fd4641014b0 2024-09-10T10:15:30.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.024+0000 7fd469449640 1 -- 172.21.15.71:0/2967090126 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4640fcbb0 con 0x7fd4641014b0 2024-09-10T10:15:30.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.025+0000 7fd44b7fe640 1 -- 172.21.15.71:0/2967090126 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd4580127d0 con 0x7fd4641014b0 2024-09-10T10:15:30.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.025+0000 7fd44b7fe640 1 --2- 172.21.15.71:0/2967090126 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd44c06e0b0 0x7fd44c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.025+0000 7fd44b7fe640 1 -- 172.21.15.71:0/2967090126 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd45808e120 con 0x7fd4641014b0 2024-09-10T10:15:30.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.025+0000 7fd462ffd640 1 --2- 172.21.15.71:0/2967090126 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd44c06e0b0 0x7fd44c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.026+0000 7fd462ffd640 1 --2- 172.21.15.71:0/2967090126 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd44c06e0b0 0x7fd44c070560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd454009ac0 tx=0x7fd454035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:30.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.030+0000 7fd44b7fe640 1 -- 172.21.15.71:0/2967090126 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd45805af20 con 0x7fd4641014b0 2024-09-10T10:15:30.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.230+0000 7fd469449640 1 -- 172.21.15.71:0/2967090126 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fd46404b720 con 0x7fd4641014b0 2024-09-10T10:15:30.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.231+0000 7fd44b7fe640 1 -- 172.21.15.71:0/2967090126 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v44) v1 ==== 107+0+4936 (secure 0 0 0) 0x7fd45805aab0 con 0x7fd4641014b0 2024-09-10T10:15:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:30.232 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":26,"btime":"2024-09-10T10:10:36:489274+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi071.toijsg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6827/1437303195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1437303195},{"type":"v1","addr":"172.21.15.71:6827","nonce":1437303195}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44315,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3716221026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3716221026},{"type":"v1","addr":"172.21.15.107:6827","nonce":3716221026}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:10:35.622373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14464,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi071.omoqqq","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.71:6829/3739086646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3739086646},{"type":"v1","addr":"172.21.15.71:6829","nonce":3739086646}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi107.nycoxn","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6825/2124995551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2124995551},{"type":"v1","addr":"172.21.15.107:6825","nonce":2124995551}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[24267,14464]},"id":1}]} 2024-09-10T10:15:30.233 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 26 2024-09-10T10:15:30.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.232+0000 7fd469449640 1 -- 172.21.15.71:0/2967090126 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd44c06e0b0 msgr2=0x7fd44c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:30.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.232+0000 7fd469449640 1 --2- 172.21.15.71:0/2967090126 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd44c06e0b0 0x7fd44c070560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd454009ac0 tx=0x7fd454035040 comp rx=0 tx=0).stop 2024-09-10T10:15:30.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.233+0000 7fd469449640 1 -- 172.21.15.71:0/2967090126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4641014b0 msgr2=0x7fd46410e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:30.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.233+0000 7fd469449640 1 --2- 172.21.15.71:0/2967090126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4641014b0 0x7fd46410e7e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c810 tx=0x7fd4580043c0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.233+0000 7fd469449640 1 -- 172.21.15.71:0/2967090126 shutdown_connections 2024-09-10T10:15:30.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.233+0000 7fd469449640 1 --2- 172.21.15.71:0/2967090126 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fd44c06e0b0 0x7fd44c070560 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.233+0000 7fd469449640 1 --2- 172.21.15.71:0/2967090126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4641014b0 0x7fd46410e7e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.233+0000 7fd469449640 1 --2- 172.21.15.71:0/2967090126 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4640fb470 0x7fd46410e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.233+0000 7fd469449640 1 -- 172.21.15.71:0/2967090126 >> 172.21.15.71:0/2967090126 conn(0x7fd4640f7030 msgr2=0x7fd4640f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:30.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.233+0000 7fd469449640 1 -- 172.21.15.71:0/2967090126 shutdown_connections 2024-09-10T10:15:30.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:30.233+0000 7fd469449640 1 -- 172.21.15.71:0/2967090126 wait complete. 2024-09-10T10:15:30.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:30 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2967090126' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-10T10:15:30.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:30 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2967090126' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-10T10:15:30.841 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-09-10T10:15:30.841 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-10T10:15:30.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 27 2024-09-10T10:15:31.086 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:31.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:31 smithi071 ceph-mon[90773]: pgmap v311: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:31.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:31 smithi107 ceph-mon[79396]: pgmap v311: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:32.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.726+0000 7f71d3e7e640 1 -- 172.21.15.71:0/3702609419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71cc0fb810 msgr2=0x7f71cc0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:32.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.726+0000 7f71d3e7e640 1 --2- 172.21.15.71:0/3702609419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71cc0fb810 0x7f71cc0fbbe0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f71c40048d0 tx=0x7f71c4009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:32.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.726+0000 7f71d3e7e640 1 -- 172.21.15.71:0/3702609419 shutdown_connections 2024-09-10T10:15:32.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.726+0000 7f71d3e7e640 1 --2- 172.21.15.71:0/3702609419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71cc0fcf80 0x7f71cc0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:32.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.726+0000 7f71d3e7e640 1 --2- 172.21.15.71:0/3702609419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71cc0fb810 0x7f71cc0fbbe0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:32.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.726+0000 7f71d3e7e640 1 -- 172.21.15.71:0/3702609419 >> 172.21.15.71:0/3702609419 conn(0x7f71cc0723b0 msgr2=0x7f71cc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:32.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.726+0000 7f71d3e7e640 1 -- 172.21.15.71:0/3702609419 shutdown_connections 2024-09-10T10:15:32.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.726+0000 7f71d3e7e640 1 -- 172.21.15.71:0/3702609419 wait complete. 2024-09-10T10:15:32.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.726+0000 7f71d3e7e640 1 Processor -- start 2024-09-10T10:15:32.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.726+0000 7f71d3e7e640 1 -- start start 2024-09-10T10:15:32.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d3e7e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71cc0fb810 0x7f71cc10e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:32.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d3e7e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71cc0fcf80 0x7f71cc10e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:32.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d3e7e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc10ed70 con 0x7f71cc0fb810 2024-09-10T10:15:32.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d3e7e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc10eee0 con 0x7f71cc0fcf80 2024-09-10T10:15:32.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d1c1a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71cc0fb810 0x7f71cc10e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:32.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d1c1a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71cc0fb810 0x7f71cc10e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60562/0 (socket says 172.21.15.71:60562) 2024-09-10T10:15:32.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d1c1a640 1 -- 172.21.15.71:0/1371276320 learned_addr learned my addr 172.21.15.71:0/1371276320 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:32.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d1419640 1 --2- 172.21.15.71:0/1371276320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71cc0fcf80 0x7f71cc10e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:32.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d1c1a640 1 -- 172.21.15.71:0/1371276320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71cc0fcf80 msgr2=0x7f71cc10e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:32.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d1c1a640 1 --2- 172.21.15.71:0/1371276320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71cc0fcf80 0x7f71cc10e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:32.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d1c1a640 1 -- 172.21.15.71:0/1371276320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4005040 con 0x7f71cc0fb810 2024-09-10T10:15:32.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d1419640 1 --2- 172.21.15.71:0/1371276320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71cc0fcf80 0x7f71cc10e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:32.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d1c1a640 1 --2- 172.21.15.71:0/1371276320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71cc0fb810 0x7f71cc10e1a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f71c4003080 tx=0x7f71c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:32.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71ca7fc640 1 -- 172.21.15.71:0/1371276320 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c4038070 con 0x7f71cc0fb810 2024-09-10T10:15:32.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71ca7fc640 1 -- 172.21.15.71:0/1371276320 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f71c402ade0 con 0x7f71cc0fb810 2024-09-10T10:15:32.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d3e7e640 1 -- 172.21.15.71:0/1371276320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71cc117210 con 0x7f71cc0fb810 2024-09-10T10:15:32.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71ca7fc640 1 -- 172.21.15.71:0/1371276320 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c402c880 con 0x7f71cc0fb810 2024-09-10T10:15:32.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.727+0000 7f71d3e7e640 1 -- 172.21.15.71:0/1371276320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc117620 con 0x7f71cc0fb810 2024-09-10T10:15:32.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.729+0000 7f71d3e7e640 1 -- 172.21.15.71:0/1371276320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71cc0fcbc0 con 0x7f71cc0fb810 2024-09-10T10:15:32.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.729+0000 7f71ca7fc640 1 -- 172.21.15.71:0/1371276320 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f71c4030020 con 0x7f71cc0fb810 2024-09-10T10:15:32.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.730+0000 7f71ca7fc640 1 --2- 172.21.15.71:0/1371276320 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f71b406e0b0 0x7f71b4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:32.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.730+0000 7f71ca7fc640 1 -- 172.21.15.71:0/1371276320 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f71c40adbf0 con 0x7f71cc0fb810 2024-09-10T10:15:32.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.730+0000 7f71d1419640 1 --2- 172.21.15.71:0/1371276320 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f71b406e0b0 0x7f71b4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:32.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.730+0000 7f71d1419640 1 --2- 172.21.15.71:0/1371276320 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f71b406e0b0 0x7f71b4070560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f71c0006fd0 tx=0x7f71c0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:32.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.734+0000 7f71ca7fc640 1 -- 172.21.15.71:0/1371276320 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f71c4076f40 con 0x7f71cc0fb810 2024-09-10T10:15:32.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.938+0000 7f71d3e7e640 1 -- 172.21.15.71:0/1371276320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f71cc072ec0 con 0x7f71cc0fb810 2024-09-10T10:15:32.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.939+0000 7f71ca7fc640 1 -- 172.21.15.71:0/1371276320 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v44) v1 ==== 107+0+4932 (secure 0 0 0) 0x7f71c407a600 con 0x7f71cc0fb810 2024-09-10T10:15:32.941 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:32.941 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"btime":"2024-09-10T10:10:36:493430+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi071.toijsg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6827/1437303195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1437303195},{"type":"v1","addr":"172.21.15.71:6827","nonce":1437303195}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44315,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3716221026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3716221026},{"type":"v1","addr":"172.21.15.107:6827","nonce":3716221026}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:10:36.493427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14464,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi071.omoqqq","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.71:6829/3739086646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3739086646},{"type":"v1","addr":"172.21.15.71:6829","nonce":3739086646}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi107.nycoxn","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.107:6825/2124995551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2124995551},{"type":"v1","addr":"172.21.15.107:6825","nonce":2124995551}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-10T10:15:32.941 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 27 2024-09-10T10:15:32.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.941+0000 7f71d3e7e640 1 -- 172.21.15.71:0/1371276320 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f71b406e0b0 msgr2=0x7f71b4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:32.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.941+0000 7f71d3e7e640 1 --2- 172.21.15.71:0/1371276320 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f71b406e0b0 0x7f71b4070560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f71c0006fd0 tx=0x7f71c0008040 comp rx=0 tx=0).stop 2024-09-10T10:15:32.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.941+0000 7f71d3e7e640 1 -- 172.21.15.71:0/1371276320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71cc0fb810 msgr2=0x7f71cc10e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:32.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.941+0000 7f71d3e7e640 1 --2- 172.21.15.71:0/1371276320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71cc0fb810 0x7f71cc10e1a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f71c4003080 tx=0x7f71c4009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:32.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.941+0000 7f71d3e7e640 1 -- 172.21.15.71:0/1371276320 shutdown_connections 2024-09-10T10:15:32.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.941+0000 7f71d3e7e640 1 --2- 172.21.15.71:0/1371276320 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f71b406e0b0 0x7f71b4070560 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:32.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.941+0000 7f71d3e7e640 1 --2- 172.21.15.71:0/1371276320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71cc0fcf80 0x7f71cc10e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:32.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.941+0000 7f71d3e7e640 1 --2- 172.21.15.71:0/1371276320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71cc0fb810 0x7f71cc10e1a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:32.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.941+0000 7f71d3e7e640 1 -- 172.21.15.71:0/1371276320 >> 172.21.15.71:0/1371276320 conn(0x7f71cc0723b0 msgr2=0x7f71cc0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:32.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.941+0000 7f71d3e7e640 1 -- 172.21.15.71:0/1371276320 shutdown_connections 2024-09-10T10:15:32.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:32.941+0000 7f71d3e7e640 1 -- 172.21.15.71:0/1371276320 wait complete. 2024-09-10T10:15:33.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:33 smithi071 ceph-mon[90773]: pgmap v312: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:33.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:33 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/1371276320' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-10T10:15:33.591 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-09-10T10:15:33.592 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-10T10:15:33.592 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 28 2024-09-10T10:15:33.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:33 smithi107 ceph-mon[79396]: pgmap v312: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:33.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:33 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/1371276320' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-10T10:15:33.852 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:35.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.357+0000 7f2529648640 1 -- 172.21.15.71:0/1377783023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2524065c10 msgr2=0x7f25240fe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:35.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.357+0000 7f2529648640 1 --2- 172.21.15.71:0/1377783023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2524065c10 0x7f25240fe0d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f25180048d0 tx=0x7f2518009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.357+0000 7f2529648640 1 -- 172.21.15.71:0/1377783023 shutdown_connections 2024-09-10T10:15:35.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.357+0000 7f2529648640 1 --2- 172.21.15.71:0/1377783023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2524065c10 0x7f25240fe0d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.357+0000 7f2529648640 1 --2- 172.21.15.71:0/1377783023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2524065300 0x7f25240656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.357+0000 7f2529648640 1 -- 172.21.15.71:0/1377783023 >> 172.21.15.71:0/1377783023 conn(0x7f25240723b0 msgr2=0x7f25240727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:35.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.357+0000 7f2529648640 1 -- 172.21.15.71:0/1377783023 shutdown_connections 2024-09-10T10:15:35.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.357+0000 7f2529648640 1 -- 172.21.15.71:0/1377783023 wait complete. 2024-09-10T10:15:35.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.358+0000 7f2529648640 1 Processor -- start 2024-09-10T10:15:35.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.358+0000 7f2529648640 1 -- start start 2024-09-10T10:15:35.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f2529648640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2524065300 0x7f25241153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f2529648640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2524065c10 0x7f2524115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f2529648640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2524115f10 con 0x7f2524065300 2024-09-10T10:15:35.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f2529648640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252410f350 con 0x7f2524065c10 2024-09-10T10:15:35.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f2522ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2524065300 0x7f25241153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f2522ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2524065300 0x7f25241153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59216/0 (socket says 172.21.15.71:59216) 2024-09-10T10:15:35.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f2522ffd640 1 -- 172.21.15.71:0/121671263 learned_addr learned my addr 172.21.15.71:0/121671263 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:35.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f25227fc640 1 --2- 172.21.15.71:0/121671263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2524065c10 0x7f2524115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f2522ffd640 1 -- 172.21.15.71:0/121671263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2524065c10 msgr2=0x7f2524115910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:35.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f2522ffd640 1 --2- 172.21.15.71:0/121671263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2524065c10 0x7f2524115910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f2522ffd640 1 -- 172.21.15.71:0/121671263 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518005040 con 0x7f2524065300 2024-09-10T10:15:35.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f2522ffd640 1 --2- 172.21.15.71:0/121671263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2524065300 0x7f25241153d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2514002a50 tx=0x7f2514004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:35.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f250b7fe640 1 -- 172.21.15.71:0/121671263 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2514007c30 con 0x7f2524065300 2024-09-10T10:15:35.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f2529648640 1 -- 172.21.15.71:0/121671263 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252410f630 con 0x7f2524065300 2024-09-10T10:15:35.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f250b7fe640 1 -- 172.21.15.71:0/121671263 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f251400f040 con 0x7f2524065300 2024-09-10T10:15:35.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.359+0000 7f250b7fe640 1 -- 172.21.15.71:0/121671263 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f251400da10 con 0x7f2524065300 2024-09-10T10:15:35.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.360+0000 7f2529648640 1 -- 172.21.15.71:0/121671263 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252410fba0 con 0x7f2524065300 2024-09-10T10:15:35.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.360+0000 7f2529648640 1 -- 172.21.15.71:0/121671263 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25240fdce0 con 0x7f2524065300 2024-09-10T10:15:35.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.361+0000 7f250b7fe640 1 -- 172.21.15.71:0/121671263 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f251400dc80 con 0x7f2524065300 2024-09-10T10:15:35.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.361+0000 7f250b7fe640 1 --2- 172.21.15.71:0/121671263 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f250c06e0b0 0x7f250c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.362+0000 7f250b7fe640 1 -- 172.21.15.71:0/121671263 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f251408d3b0 con 0x7f2524065300 2024-09-10T10:15:35.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.362+0000 7f25227fc640 1 --2- 172.21.15.71:0/121671263 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f250c06e0b0 0x7f250c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.362+0000 7f25227fc640 1 --2- 172.21.15.71:0/121671263 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f250c06e0b0 0x7f250c070560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2518009ac0 tx=0x7f2518035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:35.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.366+0000 7f250b7fe640 1 -- 172.21.15.71:0/121671263 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2514056730 con 0x7f2524065300 2024-09-10T10:15:35.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:35 smithi071 ceph-mon[90773]: pgmap v313: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:15:35.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.565+0000 7f2529648640 1 -- 172.21.15.71:0/121671263 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f252404b780 con 0x7f2524065300 2024-09-10T10:15:35.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.566+0000 7f250b7fe640 1 -- 172.21.15.71:0/121671263 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v44) v1 ==== 107+0+4134 (secure 0 0 0) 0x7f2514059df0 con 0x7f2524065300 2024-09-10T10:15:35.567 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:35.567 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":28,"btime":"2024-09-10T10:11:00:244908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi071.toijsg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6827/1437303195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1437303195},{"type":"v1","addr":"172.21.15.71:6827","nonce":1437303195}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44315,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3716221026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3716221026},{"type":"v1","addr":"172.21.15.107:6827","nonce":3716221026}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:10:59.796932+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi071.omoqqq","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.71:6829/3739086646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3739086646},{"type":"v1","addr":"172.21.15.71:6829","nonce":3739086646}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-10T10:15:35.567 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 28 2024-09-10T10:15:35.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.568+0000 7f2529648640 1 -- 172.21.15.71:0/121671263 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f250c06e0b0 msgr2=0x7f250c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:35.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.568+0000 7f2529648640 1 --2- 172.21.15.71:0/121671263 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f250c06e0b0 0x7f250c070560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2518009ac0 tx=0x7f2518035040 comp rx=0 tx=0).stop 2024-09-10T10:15:35.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.568+0000 7f2529648640 1 -- 172.21.15.71:0/121671263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2524065300 msgr2=0x7f25241153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:35.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.568+0000 7f2529648640 1 --2- 172.21.15.71:0/121671263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2524065300 0x7f25241153d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2514002a50 tx=0x7f2514004600 comp rx=0 tx=0).stop 2024-09-10T10:15:35.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.568+0000 7f2529648640 1 -- 172.21.15.71:0/121671263 shutdown_connections 2024-09-10T10:15:35.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.568+0000 7f2529648640 1 --2- 172.21.15.71:0/121671263 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f250c06e0b0 0x7f250c070560 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.568+0000 7f2529648640 1 --2- 172.21.15.71:0/121671263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2524065c10 0x7f2524115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.568+0000 7f2529648640 1 --2- 172.21.15.71:0/121671263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2524065300 0x7f25241153d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.568+0000 7f2529648640 1 -- 172.21.15.71:0/121671263 >> 172.21.15.71:0/121671263 conn(0x7f25240723b0 msgr2=0x7f25241011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:35.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.568+0000 7f2529648640 1 -- 172.21.15.71:0/121671263 shutdown_connections 2024-09-10T10:15:35.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:35.568+0000 7f2529648640 1 -- 172.21.15.71:0/121671263 wait complete. 2024-09-10T10:15:35.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:35 smithi107 ceph-mon[79396]: pgmap v313: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:15:36.168 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-09-10T10:15:36.168 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-10T10:15:36.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 29 2024-09-10T10:15:36.418 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:36.577 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:36 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/121671263' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-10T10:15:36.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:36 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/121671263' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-10T10:15:37.521 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:37 smithi071 ceph-mon[90773]: pgmap v314: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:37 smithi107 ceph-mon[79396]: pgmap v314: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:38.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.057+0000 7fab7a011640 1 -- 172.21.15.71:0/672079668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab740fcf80 msgr2=0x7fab740fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:38.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.057+0000 7fab7a011640 1 --2- 172.21.15.71:0/672079668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab740fcf80 0x7fab740fd3d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009c50 tx=0x7fab5c004d10 comp rx=0 tx=0).stop 2024-09-10T10:15:38.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.057+0000 7fab7a011640 1 -- 172.21.15.71:0/672079668 shutdown_connections 2024-09-10T10:15:38.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.057+0000 7fab7a011640 1 --2- 172.21.15.71:0/672079668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab740fcf80 0x7fab740fd3d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.057+0000 7fab7a011640 1 --2- 172.21.15.71:0/672079668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab740fb810 0x7fab740fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.057+0000 7fab7a011640 1 -- 172.21.15.71:0/672079668 >> 172.21.15.71:0/672079668 conn(0x7fab740723b0 msgr2=0x7fab740727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:38.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.057+0000 7fab7a011640 1 -- 172.21.15.71:0/672079668 shutdown_connections 2024-09-10T10:15:38.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.057+0000 7fab7a011640 1 -- 172.21.15.71:0/672079668 wait complete. 2024-09-10T10:15:38.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.057+0000 7fab7a011640 1 Processor -- start 2024-09-10T10:15:38.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.058+0000 7fab7a011640 1 -- start start 2024-09-10T10:15:38.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.058+0000 7fab7a011640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab740fb810 0x7fab74112140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:38.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.058+0000 7fab7a011640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab740fcf80 0x7fab74112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:38.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.058+0000 7fab7a011640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab74112d10 con 0x7fab740fb810 2024-09-10T10:15:38.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.058+0000 7fab7a011640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7410c100 con 0x7fab740fcf80 2024-09-10T10:15:38.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.058+0000 7fab737fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab740fb810 0x7fab74112140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:38.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.058+0000 7fab737fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab740fb810 0x7fab74112140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59226/0 (socket says 172.21.15.71:59226) 2024-09-10T10:15:38.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.058+0000 7fab737fe640 1 -- 172.21.15.71:0/1173039392 learned_addr learned my addr 172.21.15.71:0/1173039392 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:38.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.058+0000 7fab72ffd640 1 --2- 172.21.15.71:0/1173039392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab740fcf80 0x7fab74112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:38.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.058+0000 7fab737fe640 1 -- 172.21.15.71:0/1173039392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab740fcf80 msgr2=0x7fab74112680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:38.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.058+0000 7fab737fe640 1 --2- 172.21.15.71:0/1173039392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab740fcf80 0x7fab74112680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.058+0000 7fab737fe640 1 -- 172.21.15.71:0/1173039392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c0098b0 con 0x7fab740fb810 2024-09-10T10:15:38.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.058+0000 7fab72ffd640 1 --2- 172.21.15.71:0/1173039392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab740fcf80 0x7fab74112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:15:38.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.059+0000 7fab737fe640 1 --2- 172.21.15.71:0/1173039392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab740fb810 0x7fab74112140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00b790 tx=0x7fab6c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:38.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.059+0000 7fab6bfff640 1 -- 172.21.15.71:0/1173039392 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab6c00c700 con 0x7fab740fb810 2024-09-10T10:15:38.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.059+0000 7fab7a011640 1 -- 172.21.15.71:0/1173039392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7410c3e0 con 0x7fab740fb810 2024-09-10T10:15:38.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.059+0000 7fab6bfff640 1 -- 172.21.15.71:0/1173039392 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fab6c00cd00 con 0x7fab740fb810 2024-09-10T10:15:38.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.059+0000 7fab6bfff640 1 -- 172.21.15.71:0/1173039392 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab6c015e70 con 0x7fab740fb810 2024-09-10T10:15:38.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.059+0000 7fab7a011640 1 -- 172.21.15.71:0/1173039392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7410c900 con 0x7fab740fb810 2024-09-10T10:15:38.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.060+0000 7fab7a011640 1 -- 172.21.15.71:0/1173039392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab740fcbc0 con 0x7fab740fb810 2024-09-10T10:15:38.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.060+0000 7fab6bfff640 1 -- 172.21.15.71:0/1173039392 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fab6c012070 con 0x7fab740fb810 2024-09-10T10:15:38.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.061+0000 7fab6bfff640 1 --2- 172.21.15.71:0/1173039392 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fab6006e0b0 0x7fab60070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:38.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.061+0000 7fab6bfff640 1 -- 172.21.15.71:0/1173039392 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fab6c08d7c0 con 0x7fab740fb810 2024-09-10T10:15:38.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.061+0000 7fab72ffd640 1 --2- 172.21.15.71:0/1173039392 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fab6006e0b0 0x7fab60070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:38.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.061+0000 7fab72ffd640 1 --2- 172.21.15.71:0/1173039392 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fab6006e0b0 0x7fab60070560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fab7410da40 tx=0x7fab5c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:38.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.065+0000 7fab6bfff640 1 -- 172.21.15.71:0/1173039392 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fab6c056a90 con 0x7fab740fb810 2024-09-10T10:15:38.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.266+0000 7fab7a011640 1 -- 172.21.15.71:0/1173039392 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fab7404b7b0 con 0x7fab740fb810 2024-09-10T10:15:38.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.267+0000 7fab6bfff640 1 -- 172.21.15.71:0/1173039392 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v44) v1 ==== 107+0+4916 (secure 0 0 0) 0x7fab6c05a150 con 0x7fab740fb810 2024-09-10T10:15:38.268 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:38.268 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":29,"btime":"2024-09-10T10:11:01:249365+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi071.toijsg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6827/1437303195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1437303195},{"type":"v1","addr":"172.21.15.71:6827","nonce":1437303195}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44315,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3716221026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3716221026},{"type":"v1","addr":"172.21.15.107:6827","nonce":3716221026}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1526152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1526152997},{"type":"v1","addr":"172.21.15.107:6825","nonce":1526152997}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:10:59.796932+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi071.omoqqq","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.71:6829/3739086646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3739086646},{"type":"v1","addr":"172.21.15.71:6829","nonce":3739086646}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-10T10:15:38.268 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 29 2024-09-10T10:15:38.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.269+0000 7fab7a011640 1 -- 172.21.15.71:0/1173039392 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fab6006e0b0 msgr2=0x7fab60070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:38.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.269+0000 7fab7a011640 1 --2- 172.21.15.71:0/1173039392 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fab6006e0b0 0x7fab60070560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fab7410da40 tx=0x7fab5c004d10 comp rx=0 tx=0).stop 2024-09-10T10:15:38.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.269+0000 7fab7a011640 1 -- 172.21.15.71:0/1173039392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab740fb810 msgr2=0x7fab74112140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:38.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.269+0000 7fab7a011640 1 --2- 172.21.15.71:0/1173039392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab740fb810 0x7fab74112140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00b790 tx=0x7fab6c0091d0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.269+0000 7fab7a011640 1 -- 172.21.15.71:0/1173039392 shutdown_connections 2024-09-10T10:15:38.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.269+0000 7fab7a011640 1 --2- 172.21.15.71:0/1173039392 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fab6006e0b0 0x7fab60070560 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.269+0000 7fab7a011640 1 --2- 172.21.15.71:0/1173039392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab740fcf80 0x7fab74112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.269+0000 7fab7a011640 1 --2- 172.21.15.71:0/1173039392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab740fb810 0x7fab74112140 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.269+0000 7fab7a011640 1 -- 172.21.15.71:0/1173039392 >> 172.21.15.71:0/1173039392 conn(0x7fab740723b0 msgr2=0x7fab740fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:38.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.269+0000 7fab7a011640 1 -- 172.21.15.71:0/1173039392 shutdown_connections 2024-09-10T10:15:38.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:38.269+0000 7fab7a011640 1 -- 172.21.15.71:0/1173039392 wait complete. 2024-09-10T10:15:38.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:38 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/1173039392' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-10T10:15:38.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:38 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/1173039392' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-10T10:15:38.907 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-09-10T10:15:38.907 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-10T10:15:38.907 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 30 2024-09-10T10:15:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:39.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:39 smithi071 ceph-mon[90773]: pgmap v315: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:39.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:15:39.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:39 smithi107 ceph-mon[79396]: pgmap v315: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:39.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:15:40.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.910+0000 7fc831059640 1 -- 172.21.15.71:0/967290142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0fdf20 msgr2=0x7fc82c106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:40.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.910+0000 7fc831059640 1 --2- 172.21.15.71:0/967290142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0fdf20 0x7fc82c106560 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc8200048d0 tx=0x7fc820009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.910+0000 7fc831059640 1 -- 172.21.15.71:0/967290142 shutdown_connections 2024-09-10T10:15:40.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.910+0000 7fc831059640 1 --2- 172.21.15.71:0/967290142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0fdf20 0x7fc82c106560 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.910+0000 7fc831059640 1 --2- 172.21.15.71:0/967290142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc82c0fd580 0x7fc82c0fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.910+0000 7fc831059640 1 -- 172.21.15.71:0/967290142 >> 172.21.15.71:0/967290142 conn(0x7fc82c0f7010 msgr2=0x7fc82c0f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:40.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.910+0000 7fc831059640 1 -- 172.21.15.71:0/967290142 shutdown_connections 2024-09-10T10:15:40.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.910+0000 7fc831059640 1 -- 172.21.15.71:0/967290142 wait complete. 2024-09-10T10:15:40.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.910+0000 7fc831059640 1 Processor -- start 2024-09-10T10:15:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.910+0000 7fc831059640 1 -- start start 2024-09-10T10:15:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc831059640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc82c0fd580 0x7fc82c113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc831059640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0fdf20 0x7fc82c1137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc831059640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c113e60 con 0x7fc82c0fdf20 2024-09-10T10:15:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc831059640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c10d210 con 0x7fc82c0fd580 2024-09-10T10:15:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc82a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0fdf20 0x7fc82c1137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc82a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0fdf20 0x7fc82c1137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59234/0 (socket says 172.21.15.71:59234) 2024-09-10T10:15:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc82a59c640 1 -- 172.21.15.71:0/4012267200 learned_addr learned my addr 172.21.15.71:0/4012267200 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc82ad9d640 1 --2- 172.21.15.71:0/4012267200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc82c0fd580 0x7fc82c113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc82a59c640 1 -- 172.21.15.71:0/4012267200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc82c0fd580 msgr2=0x7fc82c113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc82a59c640 1 --2- 172.21.15.71:0/4012267200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc82c0fd580 0x7fc82c113290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc82a59c640 1 -- 172.21.15.71:0/4012267200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc820005040 con 0x7fc82c0fdf20 2024-09-10T10:15:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc82ad9d640 1 --2- 172.21.15.71:0/4012267200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc82c0fd580 0x7fc82c113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc82a59c640 1 --2- 172.21.15.71:0/4012267200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0fdf20 0x7fc82c1137d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc820003080 tx=0x7fc820009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.911+0000 7fc8137fe640 1 -- 172.21.15.71:0/4012267200 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc820038070 con 0x7fc82c0fdf20 2024-09-10T10:15:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.912+0000 7fc8137fe640 1 -- 172.21.15.71:0/4012267200 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc8200097e0 con 0x7fc82c0fdf20 2024-09-10T10:15:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.912+0000 7fc831059640 1 -- 172.21.15.71:0/4012267200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82c10d490 con 0x7fc82c0fdf20 2024-09-10T10:15:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.912+0000 7fc8137fe640 1 -- 172.21.15.71:0/4012267200 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc82003d420 con 0x7fc82c0fdf20 2024-09-10T10:15:40.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.912+0000 7fc831059640 1 -- 172.21.15.71:0/4012267200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82c10d950 con 0x7fc82c0fdf20 2024-09-10T10:15:40.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.913+0000 7fc831059640 1 -- 172.21.15.71:0/4012267200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82c0663b0 con 0x7fc82c0fdf20 2024-09-10T10:15:40.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.913+0000 7fc8137fe640 1 -- 172.21.15.71:0/4012267200 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc820030020 con 0x7fc82c0fdf20 2024-09-10T10:15:40.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.914+0000 7fc8137fe640 1 --2- 172.21.15.71:0/4012267200 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc81406e0b0 0x7fc814070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.914+0000 7fc8137fe640 1 -- 172.21.15.71:0/4012267200 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc8200ae130 con 0x7fc82c0fdf20 2024-09-10T10:15:40.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.914+0000 7fc82ad9d640 1 --2- 172.21.15.71:0/4012267200 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc81406e0b0 0x7fc814070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.914+0000 7fc82ad9d640 1 --2- 172.21.15.71:0/4012267200 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc81406e0b0 0x7fc814070560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc81c006fd0 tx=0x7fc81c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:40.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:40.918+0000 7fc8137fe640 1 -- 172.21.15.71:0/4012267200 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc820077400 con 0x7fc82c0fdf20 2024-09-10T10:15:41.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:41.120+0000 7fc831059640 1 -- 172.21.15.71:0/4012267200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fc82c1095e0 con 0x7fc82c0fdf20 2024-09-10T10:15:41.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:41.121+0000 7fc8137fe640 1 -- 172.21.15.71:0/4012267200 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v44) v1 ==== 107+0+4137 (secure 0 0 0) 0x7fc82007aac0 con 0x7fc82c0fdf20 2024-09-10T10:15:41.123 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:41.123 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":30,"btime":"2024-09-10T10:11:11:299177+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44315,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3716221026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3716221026},{"type":"v1","addr":"172.21.15.107:6827","nonce":3716221026}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1526152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1526152997},{"type":"v1","addr":"172.21.15.107:6825","nonce":1526152997}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:10:59.796932+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi071.omoqqq","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.71:6829/3739086646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3739086646},{"type":"v1","addr":"172.21.15.71:6829","nonce":3739086646}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-10T10:15:41.124 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 30 2024-09-10T10:15:41.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:41.123+0000 7fc831059640 1 -- 172.21.15.71:0/4012267200 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc81406e0b0 msgr2=0x7fc814070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:41.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:41.123+0000 7fc831059640 1 --2- 172.21.15.71:0/4012267200 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc81406e0b0 0x7fc814070560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc81c006fd0 tx=0x7fc81c008040 comp rx=0 tx=0).stop 2024-09-10T10:15:41.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:41.123+0000 7fc831059640 1 -- 172.21.15.71:0/4012267200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0fdf20 msgr2=0x7fc82c1137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:41.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:41.123+0000 7fc831059640 1 --2- 172.21.15.71:0/4012267200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0fdf20 0x7fc82c1137d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc820003080 tx=0x7fc820009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:41.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:41.123+0000 7fc831059640 1 -- 172.21.15.71:0/4012267200 shutdown_connections 2024-09-10T10:15:41.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:41.123+0000 7fc831059640 1 --2- 172.21.15.71:0/4012267200 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc81406e0b0 0x7fc814070560 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:41.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:41.123+0000 7fc831059640 1 --2- 172.21.15.71:0/4012267200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0fdf20 0x7fc82c1137d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:41.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:41.123+0000 7fc831059640 1 --2- 172.21.15.71:0/4012267200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc82c0fd580 0x7fc82c113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:41.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:41.123+0000 7fc831059640 1 -- 172.21.15.71:0/4012267200 >> 172.21.15.71:0/4012267200 conn(0x7fc82c0f7010 msgr2=0x7fc82c0f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:41.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:41.123+0000 7fc831059640 1 -- 172.21.15.71:0/4012267200 shutdown_connections 2024-09-10T10:15:41.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:41.123+0000 7fc831059640 1 -- 172.21.15.71:0/4012267200 wait complete. 2024-09-10T10:15:41.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:41 smithi071 ceph-mon[90773]: pgmap v316: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:41.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:41 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/4012267200' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-10T10:15:41.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:41 smithi107 ceph-mon[79396]: pgmap v316: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:41.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:41 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/4012267200' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-10T10:15:41.788 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-09-10T10:15:41.788 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-10T10:15:41.788 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 31 2024-09-10T10:15:42.032 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:43.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:43 smithi071 ceph-mon[90773]: pgmap v317: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.641+0000 7f3abd7a0640 1 -- 172.21.15.71:0/1874273750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ab8102680 msgr2=0x7f3ab8102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.641+0000 7f3abd7a0640 1 --2- 172.21.15.71:0/1874273750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ab8102680 0x7f3ab8102a50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3aa80048d0 tx=0x7f3aa8009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.641+0000 7f3abd7a0640 1 -- 172.21.15.71:0/1874273750 shutdown_connections 2024-09-10T10:15:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.641+0000 7f3abd7a0640 1 --2- 172.21.15.71:0/1874273750 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab80fabd0 0x7f3ab80fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.641+0000 7f3abd7a0640 1 --2- 172.21.15.71:0/1874273750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ab8102680 0x7f3ab8102a50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.641+0000 7f3abd7a0640 1 -- 172.21.15.71:0/1874273750 >> 172.21.15.71:0/1874273750 conn(0x7f3ab8071ac0 msgr2=0x7f3ab8071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.641+0000 7f3abd7a0640 1 -- 172.21.15.71:0/1874273750 shutdown_connections 2024-09-10T10:15:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.641+0000 7f3abd7a0640 1 -- 172.21.15.71:0/1874273750 wait complete. 2024-09-10T10:15:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.642+0000 7f3abd7a0640 1 Processor -- start 2024-09-10T10:15:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.642+0000 7f3abd7a0640 1 -- start start 2024-09-10T10:15:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.642+0000 7f3abd7a0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ab80fabd0 0x7f3ab81132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.642+0000 7f3abd7a0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8102680 0x7f3ab81137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.642+0000 7f3abd7a0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab8113df0 con 0x7f3ab80fabd0 2024-09-10T10:15:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.642+0000 7f3abd7a0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab810d230 con 0x7f3ab8102680 2024-09-10T10:15:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.642+0000 7f3ab6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ab80fabd0 0x7f3ab81132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.642+0000 7f3ab6ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ab80fabd0 0x7f3ab81132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36950/0 (socket says 172.21.15.71:36950) 2024-09-10T10:15:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.642+0000 7f3ab6ffd640 1 -- 172.21.15.71:0/513747925 learned_addr learned my addr 172.21.15.71:0/513747925 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.642+0000 7f3ab67fc640 1 --2- 172.21.15.71:0/513747925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8102680 0x7f3ab81137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.642+0000 7f3ab6ffd640 1 -- 172.21.15.71:0/513747925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8102680 msgr2=0x7f3ab81137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.642+0000 7f3ab6ffd640 1 --2- 172.21.15.71:0/513747925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8102680 0x7f3ab81137f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.642+0000 7f3ab6ffd640 1 -- 172.21.15.71:0/513747925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa8005040 con 0x7f3ab80fabd0 2024-09-10T10:15:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.643+0000 7f3ab6ffd640 1 --2- 172.21.15.71:0/513747925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ab80fabd0 0x7f3ab81132b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8003080 tx=0x7f3aa8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.643+0000 7f3a9f7fe640 1 -- 172.21.15.71:0/513747925 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3aa8038070 con 0x7f3ab80fabd0 2024-09-10T10:15:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.643+0000 7f3a9f7fe640 1 -- 172.21.15.71:0/513747925 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3aa80097e0 con 0x7f3ab80fabd0 2024-09-10T10:15:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.643+0000 7f3abd7a0640 1 -- 172.21.15.71:0/513747925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab810d4b0 con 0x7f3ab80fabd0 2024-09-10T10:15:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.643+0000 7f3a9f7fe640 1 -- 172.21.15.71:0/513747925 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3aa803d420 con 0x7f3ab80fabd0 2024-09-10T10:15:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.643+0000 7f3abd7a0640 1 -- 172.21.15.71:0/513747925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab810d9f0 con 0x7f3ab80fabd0 2024-09-10T10:15:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.644+0000 7f3abd7a0640 1 -- 172.21.15.71:0/513747925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab80725d0 con 0x7f3ab80fabd0 2024-09-10T10:15:43.649 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:43 smithi107 ceph-mon[79396]: pgmap v317: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:43.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.644+0000 7f3a9f7fe640 1 -- 172.21.15.71:0/513747925 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3aa8030020 con 0x7f3ab80fabd0 2024-09-10T10:15:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.645+0000 7f3a9f7fe640 1 --2- 172.21.15.71:0/513747925 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3aa006e0b0 0x7f3aa0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.645+0000 7f3a9f7fe640 1 -- 172.21.15.71:0/513747925 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f3aa80ae0c0 con 0x7f3ab80fabd0 2024-09-10T10:15:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.645+0000 7f3ab67fc640 1 --2- 172.21.15.71:0/513747925 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3aa006e0b0 0x7f3aa0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:43.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.645+0000 7f3ab67fc640 1 --2- 172.21.15.71:0/513747925 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3aa006e0b0 0x7f3aa0070560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3ab810eb70 tx=0x7f3aac009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:43.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.649+0000 7f3a9f7fe640 1 -- 172.21.15.71:0/513747925 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3aa8077410 con 0x7f3ab80fabd0 2024-09-10T10:15:43.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.849+0000 7f3abd7a0640 1 -- 172.21.15.71:0/513747925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f3ab804b720 con 0x7f3ab80fabd0 2024-09-10T10:15:43.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.850+0000 7f3a9f7fe640 1 -- 172.21.15.71:0/513747925 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v44) v1 ==== 107+0+4984 (secure 0 0 0) 0x7f3aa807aad0 con 0x7f3ab80fabd0 2024-09-10T10:15:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:43.853 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":31,"btime":"2024-09-10T10:11:17:318055+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44315,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3716221026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3716221026},{"type":"v1","addr":"172.21.15.107:6827","nonce":3716221026}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1526152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1526152997},{"type":"v1","addr":"172.21.15.107:6825","nonce":1526152997}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:10:59.796932+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi071.omoqqq","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.71:6829/3739086646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3739086646},{"type":"v1","addr":"172.21.15.71:6829","nonce":3739086646}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-10T10:15:43.853 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 31 2024-09-10T10:15:43.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.852+0000 7f3abd7a0640 1 -- 172.21.15.71:0/513747925 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3aa006e0b0 msgr2=0x7f3aa0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:43.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.852+0000 7f3abd7a0640 1 --2- 172.21.15.71:0/513747925 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3aa006e0b0 0x7f3aa0070560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3ab810eb70 tx=0x7f3aac009040 comp rx=0 tx=0).stop 2024-09-10T10:15:43.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.852+0000 7f3abd7a0640 1 -- 172.21.15.71:0/513747925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ab80fabd0 msgr2=0x7f3ab81132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:43.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.852+0000 7f3abd7a0640 1 --2- 172.21.15.71:0/513747925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ab80fabd0 0x7f3ab81132b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8003080 tx=0x7f3aa8009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:43.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.852+0000 7f3abd7a0640 1 -- 172.21.15.71:0/513747925 shutdown_connections 2024-09-10T10:15:43.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.852+0000 7f3abd7a0640 1 --2- 172.21.15.71:0/513747925 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3aa006e0b0 0x7f3aa0070560 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:43.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.852+0000 7f3abd7a0640 1 --2- 172.21.15.71:0/513747925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ab8102680 0x7f3ab81137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:43.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.852+0000 7f3abd7a0640 1 --2- 172.21.15.71:0/513747925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ab80fabd0 0x7f3ab81132b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:43.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.852+0000 7f3abd7a0640 1 -- 172.21.15.71:0/513747925 >> 172.21.15.71:0/513747925 conn(0x7f3ab8071ac0 msgr2=0x7f3ab8105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:43.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.852+0000 7f3abd7a0640 1 -- 172.21.15.71:0/513747925 shutdown_connections 2024-09-10T10:15:43.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:43.852+0000 7f3abd7a0640 1 -- 172.21.15.71:0/513747925 wait complete. 2024-09-10T10:15:44.444 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:44 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/513747925' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-10T10:15:44.468 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-09-10T10:15:44.469 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-10T10:15:44.469 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 32 2024-09-10T10:15:44.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:44 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/513747925' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-10T10:15:44.715 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:45.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:45 smithi071 ceph-mon[90773]: pgmap v318: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:15:45.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:45 smithi107 ceph-mon[79396]: pgmap v318: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:15:46.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.320+0000 7f56e6d16640 1 -- 172.21.15.71:0/2290166396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e00fe460 msgr2=0x7f56e00fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:46.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.320+0000 7f56e6d16640 1 --2- 172.21.15.71:0/2290166396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e00fe460 0x7f56e00fe830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f56d00048d0 tx=0x7f56d0009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:46.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.320+0000 7f56e6d16640 1 -- 172.21.15.71:0/2290166396 shutdown_connections 2024-09-10T10:15:46.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.320+0000 7f56e6d16640 1 --2- 172.21.15.71:0/2290166396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56e0064fc0 0x7f56e0065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:46.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.320+0000 7f56e6d16640 1 --2- 172.21.15.71:0/2290166396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e00fe460 0x7f56e00fe830 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:46.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.320+0000 7f56e6d16640 1 -- 172.21.15.71:0/2290166396 >> 172.21.15.71:0/2290166396 conn(0x7f56e00723b0 msgr2=0x7f56e00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:46.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.320+0000 7f56e6d16640 1 -- 172.21.15.71:0/2290166396 shutdown_connections 2024-09-10T10:15:46.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.320+0000 7f56e6d16640 1 -- 172.21.15.71:0/2290166396 wait complete. 2024-09-10T10:15:46.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.320+0000 7f56e6d16640 1 Processor -- start 2024-09-10T10:15:46.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.320+0000 7f56e6d16640 1 -- start start 2024-09-10T10:15:46.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.321+0000 7f56e6d16640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e0064fc0 0x7f56e0113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:46.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.321+0000 7f56e6d16640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56e00fe460 0x7f56e0113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:46.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.321+0000 7f56e6d16640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0113dd0 con 0x7f56e0064fc0 2024-09-10T10:15:46.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.321+0000 7f56e6d16640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e010d180 con 0x7f56e00fe460 2024-09-10T10:15:46.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.321+0000 7f56e4ab2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e0064fc0 0x7f56e0113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:46.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.321+0000 7f56e4ab2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e0064fc0 0x7f56e0113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36980/0 (socket says 172.21.15.71:36980) 2024-09-10T10:15:46.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.321+0000 7f56e4ab2640 1 -- 172.21.15.71:0/2139293409 learned_addr learned my addr 172.21.15.71:0/2139293409 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:46.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.321+0000 7f56e4ab2640 1 -- 172.21.15.71:0/2139293409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56e00fe460 msgr2=0x7f56e0113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:46.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.321+0000 7f56e4ab2640 1 --2- 172.21.15.71:0/2139293409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56e00fe460 0x7f56e0113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:46.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.321+0000 7f56e4ab2640 1 -- 172.21.15.71:0/2139293409 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d0005040 con 0x7f56e0064fc0 2024-09-10T10:15:46.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.321+0000 7f56e4ab2640 1 --2- 172.21.15.71:0/2139293409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e0064fc0 0x7f56e0113200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56d0003080 tx=0x7f56d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:46.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.322+0000 7f56dd7fa640 1 -- 172.21.15.71:0/2139293409 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56d0038070 con 0x7f56e0064fc0 2024-09-10T10:15:46.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.322+0000 7f56dd7fa640 1 -- 172.21.15.71:0/2139293409 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f56d00097e0 con 0x7f56e0064fc0 2024-09-10T10:15:46.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.322+0000 7f56e6d16640 1 -- 172.21.15.71:0/2139293409 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e010d400 con 0x7f56e0064fc0 2024-09-10T10:15:46.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.322+0000 7f56dd7fa640 1 -- 172.21.15.71:0/2139293409 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56d003d420 con 0x7f56e0064fc0 2024-09-10T10:15:46.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.322+0000 7f56e6d16640 1 -- 172.21.15.71:0/2139293409 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e010d8c0 con 0x7f56e0064fc0 2024-09-10T10:15:46.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.323+0000 7f56e6d16640 1 -- 172.21.15.71:0/2139293409 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e00fdcf0 con 0x7f56e0064fc0 2024-09-10T10:15:46.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.323+0000 7f56dd7fa640 1 -- 172.21.15.71:0/2139293409 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f56d0030020 con 0x7f56e0064fc0 2024-09-10T10:15:46.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.323+0000 7f56dd7fa640 1 --2- 172.21.15.71:0/2139293409 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f56cc06e0b0 0x7f56cc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:46.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.324+0000 7f56dd7fa640 1 -- 172.21.15.71:0/2139293409 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f56d00ae1a0 con 0x7f56e0064fc0 2024-09-10T10:15:46.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.324+0000 7f56dffff640 1 --2- 172.21.15.71:0/2139293409 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f56cc06e0b0 0x7f56cc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:46.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.324+0000 7f56dffff640 1 --2- 172.21.15.71:0/2139293409 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f56cc06e0b0 0x7f56cc070560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f56e010eac0 tx=0x7f56c8006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:46.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.328+0000 7f56dd7fa640 1 -- 172.21.15.71:0/2139293409 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f56d0077470 con 0x7f56e0064fc0 2024-09-10T10:15:46.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.530+0000 7f56e6d16640 1 -- 172.21.15.71:0/2139293409 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f56e010e870 con 0x7f56e0064fc0 2024-09-10T10:15:46.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.531+0000 7f56dd7fa640 1 -- 172.21.15.71:0/2139293409 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v44) v1 ==== 107+0+4186 (secure 0 0 0) 0x7f56d007ab30 con 0x7f56e0064fc0 2024-09-10T10:15:46.534 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:46.534 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":32,"btime":"2024-09-10T10:11:28:472699+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44315,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3716221026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3716221026},{"type":"v1","addr":"172.21.15.107:6827","nonce":3716221026}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1526152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1526152997},{"type":"v1","addr":"172.21.15.107:6825","nonce":1526152997}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:11:28.472697+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T10:15:46.534 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 32 2024-09-10T10:15:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.534+0000 7f56e6d16640 1 -- 172.21.15.71:0/2139293409 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f56cc06e0b0 msgr2=0x7f56cc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.534+0000 7f56e6d16640 1 --2- 172.21.15.71:0/2139293409 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f56cc06e0b0 0x7f56cc070560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f56e010eac0 tx=0x7f56c8006d20 comp rx=0 tx=0).stop 2024-09-10T10:15:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.534+0000 7f56e6d16640 1 -- 172.21.15.71:0/2139293409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e0064fc0 msgr2=0x7f56e0113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.534+0000 7f56e6d16640 1 --2- 172.21.15.71:0/2139293409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e0064fc0 0x7f56e0113200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56d0003080 tx=0x7f56d0009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.534+0000 7f56e6d16640 1 -- 172.21.15.71:0/2139293409 shutdown_connections 2024-09-10T10:15:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.534+0000 7f56e6d16640 1 --2- 172.21.15.71:0/2139293409 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f56cc06e0b0 0x7f56cc070560 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.534+0000 7f56e6d16640 1 --2- 172.21.15.71:0/2139293409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56e00fe460 0x7f56e0113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.534+0000 7f56e6d16640 1 --2- 172.21.15.71:0/2139293409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56e0064fc0 0x7f56e0113200 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.534+0000 7f56e6d16640 1 -- 172.21.15.71:0/2139293409 >> 172.21.15.71:0/2139293409 conn(0x7f56e00723b0 msgr2=0x7f56e0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.534+0000 7f56e6d16640 1 -- 172.21.15.71:0/2139293409 shutdown_connections 2024-09-10T10:15:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:46.534+0000 7f56e6d16640 1 -- 172.21.15.71:0/2139293409 wait complete. 2024-09-10T10:15:47.156 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-09-10T10:15:47.157 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-10T10:15:47.157 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 33 2024-09-10T10:15:47.402 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:47.524 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:47 smithi071 ceph-mon[90773]: pgmap v319: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:47.524 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:47 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2139293409' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-10T10:15:47.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:47 smithi107 ceph-mon[79396]: pgmap v319: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:47.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:47 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2139293409' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-10T10:15:49.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.054+0000 7fa734fa4640 1 -- 172.21.15.71:0/1054135793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7301014e0 msgr2=0x7fa7301018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:49.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.054+0000 7fa734fa4640 1 --2- 172.21.15.71:0/1054135793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7301014e0 0x7fa7301018b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa728009c50 tx=0x7fa728004d10 comp rx=0 tx=0).stop 2024-09-10T10:15:49.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.054+0000 7fa734fa4640 1 -- 172.21.15.71:0/1054135793 shutdown_connections 2024-09-10T10:15:49.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.054+0000 7fa734fa4640 1 --2- 172.21.15.71:0/1054135793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7300fb4a0 0x7fa7300fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.054+0000 7fa734fa4640 1 --2- 172.21.15.71:0/1054135793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7301014e0 0x7fa7301018b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.054+0000 7fa734fa4640 1 -- 172.21.15.71:0/1054135793 >> 172.21.15.71:0/1054135793 conn(0x7fa7300f7060 msgr2=0x7fa7300f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.054+0000 7fa734fa4640 1 -- 172.21.15.71:0/1054135793 shutdown_connections 2024-09-10T10:15:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.054+0000 7fa734fa4640 1 -- 172.21.15.71:0/1054135793 wait complete. 2024-09-10T10:15:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.054+0000 7fa734fa4640 1 Processor -- start 2024-09-10T10:15:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa734fa4640 1 -- start start 2024-09-10T10:15:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa734fa4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7300fb4a0 0x7fa7301120c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa734fa4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7301014e0 0x7fa730112600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa734fa4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa730112c00 con 0x7fa7300fb4a0 2024-09-10T10:15:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa734fa4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73010c040 con 0x7fa7301014e0 2024-09-10T10:15:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa72e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7300fb4a0 0x7fa7301120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa72e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7300fb4a0 0x7fa7301120c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37002/0 (socket says 172.21.15.71:37002) 2024-09-10T10:15:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa72e59c640 1 -- 172.21.15.71:0/2615301361 learned_addr learned my addr 172.21.15.71:0/2615301361 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa72dd9b640 1 --2- 172.21.15.71:0/2615301361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7301014e0 0x7fa730112600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa72e59c640 1 -- 172.21.15.71:0/2615301361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7301014e0 msgr2=0x7fa730112600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa72e59c640 1 --2- 172.21.15.71:0/2615301361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7301014e0 0x7fa730112600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa72e59c640 1 -- 172.21.15.71:0/2615301361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7280098b0 con 0x7fa7300fb4a0 2024-09-10T10:15:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa72e59c640 1 --2- 172.21.15.71:0/2615301361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7300fb4a0 0x7fa7301120c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa728004a30 tx=0x7fa728004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa726ffd640 1 -- 172.21.15.71:0/2615301361 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa728009690 con 0x7fa7300fb4a0 2024-09-10T10:15:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa726ffd640 1 -- 172.21.15.71:0/2615301361 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa728032b10 con 0x7fa7300fb4a0 2024-09-10T10:15:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa734fa4640 1 -- 172.21.15.71:0/2615301361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73010c2c0 con 0x7fa7300fb4a0 2024-09-10T10:15:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.055+0000 7fa726ffd640 1 -- 172.21.15.71:0/2615301361 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa72803daa0 con 0x7fa7300fb4a0 2024-09-10T10:15:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.056+0000 7fa734fa4640 1 -- 172.21.15.71:0/2615301361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73010c860 con 0x7fa7300fb4a0 2024-09-10T10:15:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.057+0000 7fa734fa4640 1 -- 172.21.15.71:0/2615301361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7300fcbe0 con 0x7fa7300fb4a0 2024-09-10T10:15:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.057+0000 7fa726ffd640 1 -- 172.21.15.71:0/2615301361 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa72802f030 con 0x7fa7300fb4a0 2024-09-10T10:15:49.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.058+0000 7fa726ffd640 1 --2- 172.21.15.71:0/2615301361 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa71c06e0b0 0x7fa71c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:49.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.058+0000 7fa726ffd640 1 -- 172.21.15.71:0/2615301361 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa7280aed50 con 0x7fa7300fb4a0 2024-09-10T10:15:49.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.058+0000 7fa72dd9b640 1 --2- 172.21.15.71:0/2615301361 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa71c06e0b0 0x7fa71c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:49.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.058+0000 7fa72dd9b640 1 --2- 172.21.15.71:0/2615301361 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa71c06e0b0 0x7fa71c070560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa73010d980 tx=0x7fa718009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:49.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.062+0000 7fa726ffd640 1 -- 172.21.15.71:0/2615301361 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa728078020 con 0x7fa7300fb4a0 2024-09-10T10:15:49.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.262+0000 7fa734fa4640 1 -- 172.21.15.71:0/2615301361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fa7300fac60 con 0x7fa7300fb4a0 2024-09-10T10:15:49.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.263+0000 7fa726ffd640 1 -- 172.21.15.71:0/2615301361 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v44) v1 ==== 107+0+4265 (secure 0 0 0) 0x7fa72807b6e0 con 0x7fa7300fb4a0 2024-09-10T10:15:49.264 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:49.264 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":33,"btime":"2024-09-10T10:11:28:481338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44315,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3716221026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3716221026},{"type":"v1","addr":"172.21.15.107:6827","nonce":3716221026}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1526152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1526152997},{"type":"v1","addr":"172.21.15.107:6825","nonce":1526152997}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:11:28.481324+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T10:15:49.264 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 33 2024-09-10T10:15:49.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.265+0000 7fa734fa4640 1 -- 172.21.15.71:0/2615301361 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa71c06e0b0 msgr2=0x7fa71c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:49.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.265+0000 7fa734fa4640 1 --2- 172.21.15.71:0/2615301361 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa71c06e0b0 0x7fa71c070560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa73010d980 tx=0x7fa718009040 comp rx=0 tx=0).stop 2024-09-10T10:15:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.265+0000 7fa734fa4640 1 -- 172.21.15.71:0/2615301361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7300fb4a0 msgr2=0x7fa7301120c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.265+0000 7fa734fa4640 1 --2- 172.21.15.71:0/2615301361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7300fb4a0 0x7fa7301120c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa728004a30 tx=0x7fa728004d10 comp rx=0 tx=0).stop 2024-09-10T10:15:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.265+0000 7fa734fa4640 1 -- 172.21.15.71:0/2615301361 shutdown_connections 2024-09-10T10:15:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.265+0000 7fa734fa4640 1 --2- 172.21.15.71:0/2615301361 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa71c06e0b0 0x7fa71c070560 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.265+0000 7fa734fa4640 1 --2- 172.21.15.71:0/2615301361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7301014e0 0x7fa730112600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.265+0000 7fa734fa4640 1 --2- 172.21.15.71:0/2615301361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa7300fb4a0 0x7fa7301120c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.265+0000 7fa734fa4640 1 -- 172.21.15.71:0/2615301361 >> 172.21.15.71:0/2615301361 conn(0x7fa7300f7060 msgr2=0x7fa7300f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.265+0000 7fa734fa4640 1 -- 172.21.15.71:0/2615301361 shutdown_connections 2024-09-10T10:15:49.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:49.265+0000 7fa734fa4640 1 -- 172.21.15.71:0/2615301361 wait complete. 2024-09-10T10:15:49.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:49 smithi071 ceph-mon[90773]: pgmap v320: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:49.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:49 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2615301361' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-10T10:15:49.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:49 smithi107 ceph-mon[79396]: pgmap v320: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:49.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:49 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2615301361' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-10T10:15:49.905 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-09-10T10:15:49.906 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-10T10:15:49.906 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 34 2024-09-10T10:15:50.155 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:51.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:51 smithi071 ceph-mon[90773]: pgmap v321: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:51.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:51 smithi107 ceph-mon[79396]: pgmap v321: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:51.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.783+0000 7f9860c48640 1 -- 172.21.15.71:0/1070508484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f985c102f20 msgr2=0x7f985c0fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:51.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.783+0000 7f9860c48640 1 --2- 172.21.15.71:0/1070508484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f985c102f20 0x7f985c0fc5e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9850009c50 tx=0x7f9850004d10 comp rx=0 tx=0).stop 2024-09-10T10:15:51.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.783+0000 7f9860c48640 1 -- 172.21.15.71:0/1070508484 shutdown_connections 2024-09-10T10:15:51.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.783+0000 7f9860c48640 1 --2- 172.21.15.71:0/1070508484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f985c102f20 0x7f985c0fc5e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:51.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.783+0000 7f9860c48640 1 --2- 172.21.15.71:0/1070508484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c102580 0x7f985c102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:51.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.783+0000 7f9860c48640 1 -- 172.21.15.71:0/1070508484 >> 172.21.15.71:0/1070508484 conn(0x7f985c0f81a0 msgr2=0x7f985c0fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:51.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.783+0000 7f9860c48640 1 -- 172.21.15.71:0/1070508484 shutdown_connections 2024-09-10T10:15:51.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.783+0000 7f9860c48640 1 -- 172.21.15.71:0/1070508484 wait complete. 2024-09-10T10:15:51.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.783+0000 7f9860c48640 1 Processor -- start 2024-09-10T10:15:51.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.784+0000 7f9860c48640 1 -- start start 2024-09-10T10:15:51.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.784+0000 7f9860c48640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f985c102580 0x7f985c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:51.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.784+0000 7f9860c48640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c102f20 0x7f985c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:51.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.784+0000 7f9860c48640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c070520 con 0x7f985c102580 2024-09-10T10:15:51.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.784+0000 7f9860c48640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c070690 con 0x7f985c102f20 2024-09-10T10:15:51.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.784+0000 7f985a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f985c102580 0x7f985c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:51.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.784+0000 7f985a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f985c102580 0x7f985c06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37016/0 (socket says 172.21.15.71:37016) 2024-09-10T10:15:51.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.784+0000 7f985a59c640 1 -- 172.21.15.71:0/927078663 learned_addr learned my addr 172.21.15.71:0/927078663 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:51.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.784+0000 7f9859d9b640 1 --2- 172.21.15.71:0/927078663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c102f20 0x7f985c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:51.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.784+0000 7f985a59c640 1 -- 172.21.15.71:0/927078663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c102f20 msgr2=0x7f985c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:51.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.784+0000 7f985a59c640 1 --2- 172.21.15.71:0/927078663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c102f20 0x7f985c06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:51.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.784+0000 7f985a59c640 1 -- 172.21.15.71:0/927078663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98500098b0 con 0x7f985c102580 2024-09-10T10:15:51.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.784+0000 7f985a59c640 1 --2- 172.21.15.71:0/927078663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f985c102580 0x7f985c06fa10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f985400b790 tx=0x7f98540091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:51.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.785+0000 7f984affd640 1 -- 172.21.15.71:0/927078663 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f985400c700 con 0x7f985c102580 2024-09-10T10:15:51.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.785+0000 7f984affd640 1 -- 172.21.15.71:0/927078663 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f985400cd00 con 0x7f985c102580 2024-09-10T10:15:51.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.785+0000 7f9860c48640 1 -- 172.21.15.71:0/927078663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c1195c0 con 0x7f985c102580 2024-09-10T10:15:51.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.785+0000 7f984affd640 1 -- 172.21.15.71:0/927078663 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9854015e70 con 0x7f985c102580 2024-09-10T10:15:51.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.785+0000 7f9860c48640 1 -- 172.21.15.71:0/927078663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c1199b0 con 0x7f985c102580 2024-09-10T10:15:51.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.786+0000 7f9860c48640 1 -- 172.21.15.71:0/927078663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c0fdd00 con 0x7f985c102580 2024-09-10T10:15:51.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.786+0000 7f984affd640 1 -- 172.21.15.71:0/927078663 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9854012070 con 0x7f985c102580 2024-09-10T10:15:51.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.786+0000 7f984affd640 1 --2- 172.21.15.71:0/927078663 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f984406e0b0 0x7f9844070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:51.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.787+0000 7f984affd640 1 -- 172.21.15.71:0/927078663 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f985408d500 con 0x7f985c102580 2024-09-10T10:15:51.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.787+0000 7f9859d9b640 1 --2- 172.21.15.71:0/927078663 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f984406e0b0 0x7f9844070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:51.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.787+0000 7f9859d9b640 1 --2- 172.21.15.71:0/927078663 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f984406e0b0 0x7f9844070560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9850009c20 tx=0x7f9850004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:51.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.791+0000 7f984affd640 1 -- 172.21.15.71:0/927078663 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9854056850 con 0x7f985c102580 2024-09-10T10:15:51.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.989+0000 7f9860c48640 1 -- 172.21.15.71:0/927078663 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f985c04b7b0 con 0x7f985c102580 2024-09-10T10:15:51.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.989+0000 7f984affd640 1 -- 172.21.15.71:0/927078663 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v44) v1 ==== 107+0+5115 (secure 0 0 0) 0x7f9854059f10 con 0x7f985c102580 2024-09-10T10:15:51.991 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:51.991 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":34,"btime":"2024-09-10T10:11:34:275325+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi071.omoqqq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6829/1608732243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1608732243},{"type":"v1","addr":"172.21.15.71:6829","nonce":1608732243}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44315,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3716221026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3716221026},{"type":"v1","addr":"172.21.15.107:6827","nonce":3716221026}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1526152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1526152997},{"type":"v1","addr":"172.21.15.107:6825","nonce":1526152997}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:11:33.614209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":33,"state":"up:reconnect","state_seq":6,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T10:15:51.991 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 34 2024-09-10T10:15:51.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.992+0000 7f9860c48640 1 -- 172.21.15.71:0/927078663 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f984406e0b0 msgr2=0x7f9844070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:51.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.992+0000 7f9860c48640 1 --2- 172.21.15.71:0/927078663 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f984406e0b0 0x7f9844070560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9850009c20 tx=0x7f9850004d10 comp rx=0 tx=0).stop 2024-09-10T10:15:51.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.992+0000 7f9860c48640 1 -- 172.21.15.71:0/927078663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f985c102580 msgr2=0x7f985c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:51.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.992+0000 7f9860c48640 1 --2- 172.21.15.71:0/927078663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f985c102580 0x7f985c06fa10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f985400b790 tx=0x7f98540091d0 comp rx=0 tx=0).stop 2024-09-10T10:15:51.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.992+0000 7f9860c48640 1 -- 172.21.15.71:0/927078663 shutdown_connections 2024-09-10T10:15:51.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.992+0000 7f9860c48640 1 --2- 172.21.15.71:0/927078663 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f984406e0b0 0x7f9844070560 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:51.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.992+0000 7f9860c48640 1 --2- 172.21.15.71:0/927078663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f985c102f20 0x7f985c06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:51.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.992+0000 7f9860c48640 1 --2- 172.21.15.71:0/927078663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f985c102580 0x7f985c06fa10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:51.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.992+0000 7f9860c48640 1 -- 172.21.15.71:0/927078663 >> 172.21.15.71:0/927078663 conn(0x7f985c0f81a0 msgr2=0x7f985c0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:51.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.992+0000 7f9860c48640 1 -- 172.21.15.71:0/927078663 shutdown_connections 2024-09-10T10:15:51.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:51.992+0000 7f9860c48640 1 -- 172.21.15.71:0/927078663 wait complete. 2024-09-10T10:15:52.609 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:52 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/927078663' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-10T10:15:52.633 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-09-10T10:15:52.634 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-10T10:15:52.634 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 35 2024-09-10T10:15:52.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:52 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/927078663' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-10T10:15:52.878 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:53.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:53 smithi071 ceph-mon[90773]: pgmap v322: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:53 smithi107 ceph-mon[79396]: pgmap v322: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:54.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.562+0000 7f6a87623640 1 -- 172.21.15.71:0/3642929521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a80065300 msgr2=0x7f6a800656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:54.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.562+0000 7f6a87623640 1 --2- 172.21.15.71:0/3642929521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a80065300 0x7f6a800656d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0048d0 tx=0x7f6a7c009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:54.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.562+0000 7f6a87623640 1 -- 172.21.15.71:0/3642929521 shutdown_connections 2024-09-10T10:15:54.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.562+0000 7f6a87623640 1 --2- 172.21.15.71:0/3642929521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a80065c10 0x7f6a800fe0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:54.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.562+0000 7f6a87623640 1 --2- 172.21.15.71:0/3642929521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a80065300 0x7f6a800656d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:54.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.562+0000 7f6a87623640 1 -- 172.21.15.71:0/3642929521 >> 172.21.15.71:0/3642929521 conn(0x7f6a800723b0 msgr2=0x7f6a800727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:54.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.562+0000 7f6a87623640 1 -- 172.21.15.71:0/3642929521 shutdown_connections 2024-09-10T10:15:54.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.562+0000 7f6a87623640 1 -- 172.21.15.71:0/3642929521 wait complete. 2024-09-10T10:15:54.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.562+0000 7f6a87623640 1 Processor -- start 2024-09-10T10:15:54.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.562+0000 7f6a87623640 1 -- start start 2024-09-10T10:15:54.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.563+0000 7f6a87623640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a80065300 0x7f6a800fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:54.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.563+0000 7f6a87623640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a80065c10 0x7f6a800fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:54.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.563+0000 7f6a87623640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800fc070 con 0x7f6a80065300 2024-09-10T10:15:54.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.563+0000 7f6a87623640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800fc1e0 con 0x7f6a80065c10 2024-09-10T10:15:54.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.563+0000 7f6a853bf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a80065300 0x7f6a800fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:54.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.563+0000 7f6a853bf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a80065300 0x7f6a800fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60872/0 (socket says 172.21.15.71:60872) 2024-09-10T10:15:54.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.563+0000 7f6a853bf640 1 -- 172.21.15.71:0/2967262336 learned_addr learned my addr 172.21.15.71:0/2967262336 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.563+0000 7f6a84bbe640 1 --2- 172.21.15.71:0/2967262336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a80065c10 0x7f6a800fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.563+0000 7f6a853bf640 1 -- 172.21.15.71:0/2967262336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a80065c10 msgr2=0x7f6a800fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.563+0000 7f6a853bf640 1 --2- 172.21.15.71:0/2967262336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a80065c10 0x7f6a800fbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.563+0000 7f6a853bf640 1 -- 172.21.15.71:0/2967262336 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c005040 con 0x7f6a80065300 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.563+0000 7f6a853bf640 1 --2- 172.21.15.71:0/2967262336 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a80065300 0x7f6a800fb560 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c003080 tx=0x7f6a7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.563+0000 7f6a71ffb640 1 -- 172.21.15.71:0/2967262336 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a7c038070 con 0x7f6a80065300 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.564+0000 7f6a71ffb640 1 -- 172.21.15.71:0/2967262336 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6a7c0097e0 con 0x7f6a80065300 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.564+0000 7f6a87623640 1 -- 172.21.15.71:0/2967262336 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a80119550 con 0x7f6a80065300 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.564+0000 7f6a71ffb640 1 -- 172.21.15.71:0/2967262336 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a7c03d420 con 0x7f6a80065300 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.564+0000 7f6a87623640 1 -- 172.21.15.71:0/2967262336 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a801198d0 con 0x7f6a80065300 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.565+0000 7f6a87623640 1 -- 172.21.15.71:0/2967262336 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a800fdce0 con 0x7f6a80065300 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.565+0000 7f6a71ffb640 1 -- 172.21.15.71:0/2967262336 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6a7c030020 con 0x7f6a80065300 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.566+0000 7f6a71ffb640 1 --2- 172.21.15.71:0/2967262336 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6a6c06e0b0 0x7f6a6c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:54.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.566+0000 7f6a71ffb640 1 -- 172.21.15.71:0/2967262336 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f6a7c0ae1a0 con 0x7f6a80065300 2024-09-10T10:15:54.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.566+0000 7f6a84bbe640 1 --2- 172.21.15.71:0/2967262336 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6a6c06e0b0 0x7f6a6c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:54.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.566+0000 7f6a84bbe640 1 --2- 172.21.15.71:0/2967262336 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6a6c06e0b0 0x7f6a6c070560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6a74006fd0 tx=0x7f6a74008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:54.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.570+0000 7f6a71ffb640 1 -- 172.21.15.71:0/2967262336 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6a7c077470 con 0x7f6a80065300 2024-09-10T10:15:54.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:15:54.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.772+0000 7f6a87623640 1 -- 172.21.15.71:0/2967262336 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f6a8004b750 con 0x7f6a80065300 2024-09-10T10:15:54.774 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:15:54.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.773+0000 7f6a71ffb640 1 -- 172.21.15.71:0/2967262336 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v44) v1 ==== 107+0+5112 (secure 0 0 0) 0x7f6a7c07ab30 con 0x7f6a80065300 2024-09-10T10:15:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:54.775 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":35,"btime":"2024-09-10T10:11:35:276663+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi071.omoqqq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6829/1608732243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1608732243},{"type":"v1","addr":"172.21.15.71:6829","nonce":1608732243}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44315,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3716221026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3716221026},{"type":"v1","addr":"172.21.15.107:6827","nonce":3716221026}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1526152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1526152997},{"type":"v1","addr":"172.21.15.107:6825","nonce":1526152997}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:11:34.279877+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":33,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T10:15:54.775 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 35 2024-09-10T10:15:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.775+0000 7f6a87623640 1 -- 172.21.15.71:0/2967262336 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6a6c06e0b0 msgr2=0x7f6a6c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.775+0000 7f6a87623640 1 --2- 172.21.15.71:0/2967262336 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6a6c06e0b0 0x7f6a6c070560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6a74006fd0 tx=0x7f6a74008040 comp rx=0 tx=0).stop 2024-09-10T10:15:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.775+0000 7f6a87623640 1 -- 172.21.15.71:0/2967262336 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a80065300 msgr2=0x7f6a800fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.775+0000 7f6a87623640 1 --2- 172.21.15.71:0/2967262336 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a80065300 0x7f6a800fb560 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c003080 tx=0x7f6a7c009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.775+0000 7f6a87623640 1 -- 172.21.15.71:0/2967262336 shutdown_connections 2024-09-10T10:15:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.775+0000 7f6a87623640 1 --2- 172.21.15.71:0/2967262336 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f6a6c06e0b0 0x7f6a6c070560 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.775+0000 7f6a87623640 1 --2- 172.21.15.71:0/2967262336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a80065c10 0x7f6a800fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.775+0000 7f6a87623640 1 --2- 172.21.15.71:0/2967262336 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a80065300 0x7f6a800fb560 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.775+0000 7f6a87623640 1 -- 172.21.15.71:0/2967262336 >> 172.21.15.71:0/2967262336 conn(0x7f6a800723b0 msgr2=0x7f6a80105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.776+0000 7f6a87623640 1 -- 172.21.15.71:0/2967262336 shutdown_connections 2024-09-10T10:15:54.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:54.776+0000 7f6a87623640 1 -- 172.21.15.71:0/2967262336 wait complete. 2024-09-10T10:15:55.374 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-09-10T10:15:55.374 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-10T10:15:55.375 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 36 2024-09-10T10:15:55.624 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:55.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:55 smithi107 ceph-mon[79396]: pgmap v323: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:15:55.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:55 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2967262336' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-10T10:15:55.745 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:55 smithi071 ceph-mon[90773]: pgmap v323: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:15:55.746 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:55 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2967262336' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-10T10:15:57.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.191+0000 7fc0234ca640 1 -- 172.21.15.71:0/3298661789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc01c102530 msgr2=0x7fc01c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:57.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.191+0000 7fc0234ca640 1 --2- 172.21.15.71:0/3298661789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc01c102530 0x7fc01c102900 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc0180048d0 tx=0x7fc018009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:57.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.191+0000 7fc0234ca640 1 -- 172.21.15.71:0/3298661789 shutdown_connections 2024-09-10T10:15:57.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.191+0000 7fc0234ca640 1 --2- 172.21.15.71:0/3298661789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c102ed0 0x7fc01c0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:57.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.191+0000 7fc0234ca640 1 --2- 172.21.15.71:0/3298661789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc01c102530 0x7fc01c102900 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:57.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.191+0000 7fc0234ca640 1 -- 172.21.15.71:0/3298661789 >> 172.21.15.71:0/3298661789 conn(0x7fc01c0f8110 msgr2=0x7fc01c0fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:57.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.191+0000 7fc0234ca640 1 -- 172.21.15.71:0/3298661789 shutdown_connections 2024-09-10T10:15:57.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.191+0000 7fc0234ca640 1 -- 172.21.15.71:0/3298661789 wait complete. 2024-09-10T10:15:57.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.191+0000 7fc0234ca640 1 Processor -- start 2024-09-10T10:15:57.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.191+0000 7fc0234ca640 1 -- start start 2024-09-10T10:15:57.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc0234ca640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c102530 0x7fc01c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:57.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc0234ca640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc01c102ed0 0x7fc01c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:57.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc0234ca640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c070520 con 0x7fc01c102ed0 2024-09-10T10:15:57.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc0234ca640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c070690 con 0x7fc01c102530 2024-09-10T10:15:57.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc020a65640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc01c102ed0 0x7fc01c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:57.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc020a65640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc01c102ed0 0x7fc01c06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60888/0 (socket says 172.21.15.71:60888) 2024-09-10T10:15:57.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc020a65640 1 -- 172.21.15.71:0/1241527238 learned_addr learned my addr 172.21.15.71:0/1241527238 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:57.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc021266640 1 --2- 172.21.15.71:0/1241527238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c102530 0x7fc01c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:57.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc020a65640 1 -- 172.21.15.71:0/1241527238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c102530 msgr2=0x7fc01c06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:57.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc020a65640 1 --2- 172.21.15.71:0/1241527238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c102530 0x7fc01c06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:57.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc020a65640 1 -- 172.21.15.71:0/1241527238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc018005040 con 0x7fc01c102ed0 2024-09-10T10:15:57.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc020a65640 1 --2- 172.21.15.71:0/1241527238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc01c102ed0 0x7fc01c06ff50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00b540 tx=0x7fc00c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:57.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc011ffb640 1 -- 172.21.15.71:0/1241527238 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc00c00f6f0 con 0x7fc01c102ed0 2024-09-10T10:15:57.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc011ffb640 1 -- 172.21.15.71:0/1241527238 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc00c00fcf0 con 0x7fc01c102ed0 2024-09-10T10:15:57.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc0234ca640 1 -- 172.21.15.71:0/1241527238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c119590 con 0x7fc01c102ed0 2024-09-10T10:15:57.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.192+0000 7fc011ffb640 1 -- 172.21.15.71:0/1241527238 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc00c011e80 con 0x7fc01c102ed0 2024-09-10T10:15:57.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.193+0000 7fc0234ca640 1 -- 172.21.15.71:0/1241527238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c1199d0 con 0x7fc01c102ed0 2024-09-10T10:15:57.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.194+0000 7fc0234ca640 1 -- 172.21.15.71:0/1241527238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c0fdcb0 con 0x7fc01c102ed0 2024-09-10T10:15:57.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.194+0000 7fc011ffb640 1 -- 172.21.15.71:0/1241527238 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc00c0116b0 con 0x7fc01c102ed0 2024-09-10T10:15:57.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.194+0000 7fc011ffb640 1 --2- 172.21.15.71:0/1241527238 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc00806e0b0 0x7fc008070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:57.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.195+0000 7fc011ffb640 1 -- 172.21.15.71:0/1241527238 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc00c08db00 con 0x7fc01c102ed0 2024-09-10T10:15:57.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.195+0000 7fc021266640 1 --2- 172.21.15.71:0/1241527238 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc00806e0b0 0x7fc008070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:57.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.195+0000 7fc021266640 1 --2- 172.21.15.71:0/1241527238 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc00806e0b0 0x7fc008070560 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc0180043d0 tx=0x7fc018009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:57.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.199+0000 7fc011ffb640 1 -- 172.21.15.71:0/1241527238 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc00c056e50 con 0x7fc01c102ed0 2024-09-10T10:15:57.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.404+0000 7fc0234ca640 1 -- 172.21.15.71:0/1241527238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7fc01c109640 con 0x7fc01c102ed0 2024-09-10T10:15:57.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.405+0000 7fc011ffb640 1 -- 172.21.15.71:0/1241527238 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v44) v1 ==== 107+0+5121 (secure 0 0 0) 0x7fc00c05a510 con 0x7fc01c102ed0 2024-09-10T10:15:57.406 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:15:57.406 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":36,"btime":"2024-09-10T10:11:36:282151+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi071.omoqqq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6829/1608732243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1608732243},{"type":"v1","addr":"172.21.15.71:6829","nonce":1608732243}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44315,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3716221026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3716221026},{"type":"v1","addr":"172.21.15.107:6827","nonce":3716221026}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1526152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1526152997},{"type":"v1","addr":"172.21.15.107:6825","nonce":1526152997}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:11:36.282149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-10T10:15:57.407 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 36 2024-09-10T10:15:57.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.407+0000 7fc0234ca640 1 -- 172.21.15.71:0/1241527238 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc00806e0b0 msgr2=0x7fc008070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:57.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.407+0000 7fc0234ca640 1 --2- 172.21.15.71:0/1241527238 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc00806e0b0 0x7fc008070560 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc0180043d0 tx=0x7fc018009da0 comp rx=0 tx=0).stop 2024-09-10T10:15:57.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.407+0000 7fc0234ca640 1 -- 172.21.15.71:0/1241527238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc01c102ed0 msgr2=0x7fc01c06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:57.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.407+0000 7fc0234ca640 1 --2- 172.21.15.71:0/1241527238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc01c102ed0 0x7fc01c06ff50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00b540 tx=0x7fc00c0091a0 comp rx=0 tx=0).stop 2024-09-10T10:15:57.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.407+0000 7fc0234ca640 1 -- 172.21.15.71:0/1241527238 shutdown_connections 2024-09-10T10:15:57.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.407+0000 7fc0234ca640 1 --2- 172.21.15.71:0/1241527238 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fc00806e0b0 0x7fc008070560 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:57.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.407+0000 7fc0234ca640 1 --2- 172.21.15.71:0/1241527238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc01c102ed0 0x7fc01c06ff50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:57.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.407+0000 7fc0234ca640 1 --2- 172.21.15.71:0/1241527238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc01c102530 0x7fc01c06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:57.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.407+0000 7fc0234ca640 1 -- 172.21.15.71:0/1241527238 >> 172.21.15.71:0/1241527238 conn(0x7fc01c0f8110 msgr2=0x7fc01c0f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:57.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.407+0000 7fc0234ca640 1 -- 172.21.15.71:0/1241527238 shutdown_connections 2024-09-10T10:15:57.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:57.407+0000 7fc0234ca640 1 -- 172.21.15.71:0/1241527238 wait complete. 2024-09-10T10:15:57.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:57 smithi107 ceph-mon[79396]: pgmap v324: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:57.777 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:57 smithi071 ceph-mon[90773]: pgmap v324: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:15:58.037 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-09-10T10:15:58.037 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-09-10T10:15:58.037 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 37 2024-09-10T10:15:58.284 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:15:58.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:58 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/1241527238' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-10T10:15:58.656 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:58 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/1241527238' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-10T10:15:59.638 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:15:59 smithi071 ceph-mon[90773]: pgmap v325: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:59.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:15:59 smithi107 ceph-mon[79396]: pgmap v325: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:15:59.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.864+0000 7fee798b7640 1 -- 172.21.15.71:0/3095183344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee74102530 msgr2=0x7fee74102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:59.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.864+0000 7fee798b7640 1 --2- 172.21.15.71:0/3095183344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee74102530 0x7fee74102900 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fee64009c50 tx=0x7fee64004d10 comp rx=0 tx=0).stop 2024-09-10T10:15:59.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.864+0000 7fee798b7640 1 -- 172.21.15.71:0/3095183344 shutdown_connections 2024-09-10T10:15:59.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.864+0000 7fee798b7640 1 --2- 172.21.15.71:0/3095183344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee74102ed0 0x7fee740fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:59.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.864+0000 7fee798b7640 1 --2- 172.21.15.71:0/3095183344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee74102530 0x7fee74102900 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:59.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.864+0000 7fee798b7640 1 -- 172.21.15.71:0/3095183344 >> 172.21.15.71:0/3095183344 conn(0x7fee740f80f0 msgr2=0x7fee740fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.864+0000 7fee798b7640 1 -- 172.21.15.71:0/3095183344 shutdown_connections 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.864+0000 7fee798b7640 1 -- 172.21.15.71:0/3095183344 wait complete. 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.864+0000 7fee798b7640 1 Processor -- start 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.864+0000 7fee798b7640 1 -- start start 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee798b7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee74102530 0x7fee74113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee798b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee74102ed0 0x7fee74113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee798b7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee74113d80 con 0x7fee74102530 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee798b7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7410d1c0 con 0x7fee74102ed0 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee72ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee74102530 0x7fee74113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee72ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee74102530 0x7fee74113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60914/0 (socket says 172.21.15.71:60914) 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee72ffd640 1 -- 172.21.15.71:0/1254477958 learned_addr learned my addr 172.21.15.71:0/1254477958 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee727fc640 1 --2- 172.21.15.71:0/1254477958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee74102ed0 0x7fee74113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee72ffd640 1 -- 172.21.15.71:0/1254477958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee74102ed0 msgr2=0x7fee74113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:59.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee72ffd640 1 --2- 172.21.15.71:0/1254477958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee74102ed0 0x7fee74113780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:59.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee72ffd640 1 -- 172.21.15.71:0/1254477958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee640098b0 con 0x7fee74102530 2024-09-10T10:15:59.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee72ffd640 1 --2- 172.21.15.71:0/1254477958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee74102530 0x7fee74113240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fee64004750 tx=0x7fee64004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:59.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee5b7fe640 1 -- 172.21.15.71:0/1254477958 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee64009610 con 0x7fee74102530 2024-09-10T10:15:59.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.865+0000 7fee5b7fe640 1 -- 172.21.15.71:0/1254477958 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fee64032b10 con 0x7fee74102530 2024-09-10T10:15:59.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.866+0000 7fee5b7fe640 1 -- 172.21.15.71:0/1254477958 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee6403d990 con 0x7fee74102530 2024-09-10T10:15:59.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.866+0000 7fee798b7640 1 -- 172.21.15.71:0/1254477958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7410d440 con 0x7fee74102530 2024-09-10T10:15:59.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.866+0000 7fee798b7640 1 -- 172.21.15.71:0/1254477958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7410d990 con 0x7fee74102530 2024-09-10T10:15:59.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.866+0000 7fee798b7640 1 -- 172.21.15.71:0/1254477958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee740fdcb0 con 0x7fee74102530 2024-09-10T10:15:59.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.867+0000 7fee5b7fe640 1 -- 172.21.15.71:0/1254477958 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fee6402f030 con 0x7fee74102530 2024-09-10T10:15:59.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.867+0000 7fee5b7fe640 1 --2- 172.21.15.71:0/1254477958 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fee5c06e0b0 0x7fee5c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:59.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.868+0000 7fee5b7fe640 1 -- 172.21.15.71:0/1254477958 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fee640aed60 con 0x7fee74102530 2024-09-10T10:15:59.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.868+0000 7fee727fc640 1 --2- 172.21.15.71:0/1254477958 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fee5c06e0b0 0x7fee5c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:59.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.868+0000 7fee727fc640 1 --2- 172.21.15.71:0/1254477958 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fee5c06e0b0 0x7fee5c070560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fee68007fd0 tx=0x7fee68009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:59.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:15:59.872+0000 7fee5b7fe640 1 -- 172.21.15.71:0/1254477958 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fee64078030 con 0x7fee74102530 2024-09-10T10:16:00.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:00.083+0000 7fee798b7640 1 -- 172.21.15.71:0/1254477958 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fee740fbd30 con 0x7fee74102530 2024-09-10T10:16:00.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:00.084+0000 7fee5b7fe640 1 -- 172.21.15.71:0/1254477958 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v44) v1 ==== 107+0+4339 (secure 0 0 0) 0x7fee6407b6f0 con 0x7fee74102530 2024-09-10T10:16:00.085 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:16:00.085 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":37,"btime":"2024-09-10T10:11:48:366366+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi071.omoqqq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6829/1608732243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1608732243},{"type":"v1","addr":"172.21.15.71:6829","nonce":1608732243}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44315,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3716221026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3716221026},{"type":"v1","addr":"172.21.15.107:6827","nonce":3716221026}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:11:36.282149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-10T10:16:00.086 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 37 2024-09-10T10:16:00.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:00.086+0000 7fee798b7640 1 -- 172.21.15.71:0/1254477958 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fee5c06e0b0 msgr2=0x7fee5c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:00.086+0000 7fee798b7640 1 --2- 172.21.15.71:0/1254477958 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fee5c06e0b0 0x7fee5c070560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fee68007fd0 tx=0x7fee68009e90 comp rx=0 tx=0).stop 2024-09-10T10:16:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:00.086+0000 7fee798b7640 1 -- 172.21.15.71:0/1254477958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee74102530 msgr2=0x7fee74113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:00.086+0000 7fee798b7640 1 --2- 172.21.15.71:0/1254477958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee74102530 0x7fee74113240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fee64004750 tx=0x7fee64004d10 comp rx=0 tx=0).stop 2024-09-10T10:16:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:00.086+0000 7fee798b7640 1 -- 172.21.15.71:0/1254477958 shutdown_connections 2024-09-10T10:16:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:00.086+0000 7fee798b7640 1 --2- 172.21.15.71:0/1254477958 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fee5c06e0b0 0x7fee5c070560 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:00.086+0000 7fee798b7640 1 --2- 172.21.15.71:0/1254477958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee74102ed0 0x7fee74113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:00.086+0000 7fee798b7640 1 --2- 172.21.15.71:0/1254477958 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee74102530 0x7fee74113240 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:00.086+0000 7fee798b7640 1 -- 172.21.15.71:0/1254477958 >> 172.21.15.71:0/1254477958 conn(0x7fee740f80f0 msgr2=0x7fee740f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:00.086+0000 7fee798b7640 1 -- 172.21.15.71:0/1254477958 shutdown_connections 2024-09-10T10:16:00.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:00.086+0000 7fee798b7640 1 -- 172.21.15.71:0/1254477958 wait complete. 2024-09-10T10:16:00.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:00 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/1254477958' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-10T10:16:00.667 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:00 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/1254477958' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-10T10:16:00.692 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-09-10T10:16:00.692 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-09-10T10:16:00.692 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 38 2024-09-10T10:16:00.938 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:16:01.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:01 smithi107 ceph-mon[79396]: pgmap v326: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:01.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:01 smithi071 ceph-mon[90773]: pgmap v326: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:02.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.586+0000 7f9ca5220640 1 -- 172.21.15.71:0/530955657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca00fb000 msgr2=0x7f9ca00fb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:02.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.586+0000 7f9ca5220640 1 --2- 172.21.15.71:0/530955657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca00fb000 0x7f9ca00fb3d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009c50 tx=0x7f9c90004d10 comp rx=0 tx=0).stop 2024-09-10T10:16:02.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.587+0000 7f9ca5220640 1 -- 172.21.15.71:0/530955657 shutdown_connections 2024-09-10T10:16:02.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.587+0000 7f9ca5220640 1 --2- 172.21.15.71:0/530955657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ca00fc780 0x7f9ca00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.587+0000 7f9ca5220640 1 --2- 172.21.15.71:0/530955657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca00fb000 0x7f9ca00fb3d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.587+0000 7f9ca5220640 1 -- 172.21.15.71:0/530955657 >> 172.21.15.71:0/530955657 conn(0x7f9ca0071b00 msgr2=0x7f9ca0071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:02.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.587+0000 7f9ca5220640 1 -- 172.21.15.71:0/530955657 shutdown_connections 2024-09-10T10:16:02.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.587+0000 7f9ca5220640 1 -- 172.21.15.71:0/530955657 wait complete. 2024-09-10T10:16:02.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.587+0000 7f9ca5220640 1 Processor -- start 2024-09-10T10:16:02.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.587+0000 7f9ca5220640 1 -- start start 2024-09-10T10:16:02.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9ca5220640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ca00fb000 0x7f9ca010e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9ca5220640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca00fc780 0x7f9ca010e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9ca5220640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca010ed90 con 0x7f9ca00fc780 2024-09-10T10:16:02.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9ca5220640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca010ef00 con 0x7f9ca00fb000 2024-09-10T10:16:02.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9c9e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca00fc780 0x7f9ca010e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9c9e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca00fc780 0x7f9ca010e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60928/0 (socket says 172.21.15.71:60928) 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9c9e59c640 1 -- 172.21.15.71:0/3651336478 learned_addr learned my addr 172.21.15.71:0/3651336478 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9c9ed9d640 1 --2- 172.21.15.71:0/3651336478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ca00fb000 0x7f9ca010e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9c9e59c640 1 -- 172.21.15.71:0/3651336478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ca00fb000 msgr2=0x7f9ca010e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9c9e59c640 1 --2- 172.21.15.71:0/3651336478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ca00fb000 0x7f9ca010e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9c9e59c640 1 -- 172.21.15.71:0/3651336478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c900098b0 con 0x7f9ca00fc780 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9c9e59c640 1 --2- 172.21.15.71:0/3651336478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca00fc780 0x7f9ca010e850 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400b790 tx=0x7f9c940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9c877fe640 1 -- 172.21.15.71:0/3651336478 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c9400c700 con 0x7f9ca00fc780 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.588+0000 7f9c877fe640 1 -- 172.21.15.71:0/3651336478 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9c9400cd00 con 0x7f9ca00fc780 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.589+0000 7f9ca5220640 1 -- 172.21.15.71:0/3651336478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca0117240 con 0x7f9ca00fc780 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.589+0000 7f9c877fe640 1 -- 172.21.15.71:0/3651336478 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c94013370 con 0x7f9ca00fc780 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.589+0000 7f9ca5220640 1 -- 172.21.15.71:0/3651336478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca0117760 con 0x7f9ca00fc780 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.589+0000 7f9ca5220640 1 -- 172.21.15.71:0/3651336478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca00fc320 con 0x7f9ca00fc780 2024-09-10T10:16:02.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.590+0000 7f9c877fe640 1 -- 172.21.15.71:0/3651336478 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9c94012070 con 0x7f9ca00fc780 2024-09-10T10:16:02.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.590+0000 7f9c877fe640 1 --2- 172.21.15.71:0/3651336478 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9c8806e0b0 0x7f9c88070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.591+0000 7f9c877fe640 1 -- 172.21.15.71:0/3651336478 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f9c9408d780 con 0x7f9ca00fc780 2024-09-10T10:16:02.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.591+0000 7f9c9ed9d640 1 --2- 172.21.15.71:0/3651336478 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9c8806e0b0 0x7f9c88070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.591+0000 7f9c9ed9d640 1 --2- 172.21.15.71:0/3651336478 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9c8806e0b0 0x7f9c88070560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009c20 tx=0x7f9c90004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:02.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.595+0000 7f9c877fe640 1 -- 172.21.15.71:0/3651336478 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9c94056a50 con 0x7f9ca00fc780 2024-09-10T10:16:02.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.796+0000 7f9ca5220640 1 -- 172.21.15.71:0/3651336478 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f9ca004b720 con 0x7f9ca00fc780 2024-09-10T10:16:02.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.796+0000 7f9c877fe640 1 -- 172.21.15.71:0/3651336478 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v44) v1 ==== 107+0+5189 (secure 0 0 0) 0x7f9c9405a110 con 0x7f9ca00fc780 2024-09-10T10:16:02.798 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:16:02.798 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":38,"btime":"2024-09-10T10:11:54:375353+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi071.omoqqq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6829/1608732243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1608732243},{"type":"v1","addr":"172.21.15.71:6829","nonce":1608732243}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44315,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/3716221026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3716221026},{"type":"v1","addr":"172.21.15.107:6827","nonce":3716221026}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44373,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1627286097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1627286097},{"type":"v1","addr":"172.21.15.107:6825","nonce":1627286097}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:11:36.282149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-10T10:16:02.798 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 38 2024-09-10T10:16:02.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.798+0000 7f9ca5220640 1 -- 172.21.15.71:0/3651336478 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9c8806e0b0 msgr2=0x7f9c88070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:02.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.798+0000 7f9ca5220640 1 --2- 172.21.15.71:0/3651336478 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9c8806e0b0 0x7f9c88070560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009c20 tx=0x7f9c90004d10 comp rx=0 tx=0).stop 2024-09-10T10:16:02.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.798+0000 7f9ca5220640 1 -- 172.21.15.71:0/3651336478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca00fc780 msgr2=0x7f9ca010e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:02.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.798+0000 7f9ca5220640 1 --2- 172.21.15.71:0/3651336478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca00fc780 0x7f9ca010e850 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400b790 tx=0x7f9c940091d0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.798+0000 7f9ca5220640 1 -- 172.21.15.71:0/3651336478 shutdown_connections 2024-09-10T10:16:02.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.798+0000 7f9ca5220640 1 --2- 172.21.15.71:0/3651336478 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f9c8806e0b0 0x7f9c88070560 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.798+0000 7f9ca5220640 1 --2- 172.21.15.71:0/3651336478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ca00fc780 0x7f9ca010e850 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.798+0000 7f9ca5220640 1 --2- 172.21.15.71:0/3651336478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ca00fb000 0x7f9ca010e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.798+0000 7f9ca5220640 1 -- 172.21.15.71:0/3651336478 >> 172.21.15.71:0/3651336478 conn(0x7f9ca0071b00 msgr2=0x7f9ca01042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:02.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.799+0000 7f9ca5220640 1 -- 172.21.15.71:0/3651336478 shutdown_connections 2024-09-10T10:16:02.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:02.799+0000 7f9ca5220640 1 -- 172.21.15.71:0/3651336478 wait complete. 2024-09-10T10:16:03.441 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-09-10T10:16:03.441 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 38 2024-09-10T10:16:03.441 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 39 2024-09-10T10:16:03.698 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:16:03.710 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:03 smithi071 ceph-mon[90773]: pgmap v327: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:03.710 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:03 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/3651336478' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-10T10:16:03.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:03 smithi107 ceph-mon[79396]: pgmap v327: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:03.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:03 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/3651336478' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-10T10:16:05.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.327+0000 7f8efc171640 1 -- 172.21.15.71:0/2705363729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ef40fdf20 msgr2=0x7f8ef41065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:05.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.327+0000 7f8efc171640 1 --2- 172.21.15.71:0/2705363729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ef40fdf20 0x7f8ef41065f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8004900 tx=0x7f8ee8009da0 comp rx=0 tx=0).stop 2024-09-10T10:16:05.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.327+0000 7f8efc171640 1 -- 172.21.15.71:0/2705363729 shutdown_connections 2024-09-10T10:16:05.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.327+0000 7f8efc171640 1 --2- 172.21.15.71:0/2705363729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ef40fdf20 0x7f8ef41065f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:05.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.327+0000 7f8efc171640 1 --2- 172.21.15.71:0/2705363729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ef40fd580 0x7f8ef40fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:05.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.327+0000 7f8efc171640 1 -- 172.21.15.71:0/2705363729 >> 172.21.15.71:0/2705363729 conn(0x7f8ef40f7060 msgr2=0x7f8ef40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:05.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.327+0000 7f8efc171640 1 -- 172.21.15.71:0/2705363729 shutdown_connections 2024-09-10T10:16:05.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.327+0000 7f8efc171640 1 -- 172.21.15.71:0/2705363729 wait complete. 2024-09-10T10:16:05.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8efc171640 1 Processor -- start 2024-09-10T10:16:05.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8efc171640 1 -- start start 2024-09-10T10:16:05.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8efc171640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ef40fd580 0x7f8ef4113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:05.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8efc171640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ef40fdf20 0x7f8ef41137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:05.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8efc171640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4113dd0 con 0x7f8ef40fdf20 2024-09-10T10:16:05.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8efc171640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef410d210 con 0x7f8ef40fd580 2024-09-10T10:16:05.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8ef970c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ef40fdf20 0x7f8ef41137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:05.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8ef970c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ef40fdf20 0x7f8ef41137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43504/0 (socket says 172.21.15.71:43504) 2024-09-10T10:16:05.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8ef970c640 1 -- 172.21.15.71:0/4075518116 learned_addr learned my addr 172.21.15.71:0/4075518116 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:16:05.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8ef9f0d640 1 --2- 172.21.15.71:0/4075518116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ef40fd580 0x7f8ef4113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:05.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8ef970c640 1 -- 172.21.15.71:0/4075518116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ef40fd580 msgr2=0x7f8ef4113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:05.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8ef970c640 1 --2- 172.21.15.71:0/4075518116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ef40fd580 0x7f8ef4113290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:05.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8ef970c640 1 -- 172.21.15.71:0/4075518116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee8005040 con 0x7f8ef40fdf20 2024-09-10T10:16:05.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.328+0000 7f8ef970c640 1 --2- 172.21.15.71:0/4075518116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ef40fdf20 0x7f8ef41137d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8004960 tx=0x7f8ee8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:05.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.329+0000 7f8ef27fc640 1 -- 172.21.15.71:0/4075518116 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ee8038070 con 0x7f8ef40fdf20 2024-09-10T10:16:05.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.329+0000 7f8ef27fc640 1 -- 172.21.15.71:0/4075518116 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ee8008ed0 con 0x7f8ef40fdf20 2024-09-10T10:16:05.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.329+0000 7f8efc171640 1 -- 172.21.15.71:0/4075518116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef410d490 con 0x7f8ef40fdf20 2024-09-10T10:16:05.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.329+0000 7f8ef27fc640 1 -- 172.21.15.71:0/4075518116 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ee80095a0 con 0x7f8ef40fdf20 2024-09-10T10:16:05.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.329+0000 7f8efc171640 1 -- 172.21.15.71:0/4075518116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef410d950 con 0x7f8ef40fdf20 2024-09-10T10:16:05.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.330+0000 7f8efc171640 1 -- 172.21.15.71:0/4075518116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef40662d0 con 0x7f8ef40fdf20 2024-09-10T10:16:05.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.330+0000 7f8ef27fc640 1 -- 172.21.15.71:0/4075518116 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8ee8030020 con 0x7f8ef40fdf20 2024-09-10T10:16:05.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.331+0000 7f8ef27fc640 1 --2- 172.21.15.71:0/4075518116 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8edc06e0b0 0x7f8edc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:05.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.331+0000 7f8ef9f0d640 1 --2- 172.21.15.71:0/4075518116 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8edc06e0b0 0x7f8edc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:05.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.331+0000 7f8ef27fc640 1 -- 172.21.15.71:0/4075518116 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8ee80ada20 con 0x7f8ef40fdf20 2024-09-10T10:16:05.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.331+0000 7f8ef9f0d640 1 --2- 172.21.15.71:0/4075518116 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8edc06e0b0 0x7f8edc070560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4004550 tx=0x7f8ee4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:05.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.335+0000 7f8ef27fc640 1 -- 172.21.15.71:0/4075518116 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8ee8076ee0 con 0x7f8ef40fdf20 2024-09-10T10:16:05.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.539+0000 7f8efc171640 1 -- 172.21.15.71:0/4075518116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7f8ef4109580 con 0x7f8ef40fdf20 2024-09-10T10:16:05.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.540+0000 7f8ef27fc640 1 -- 172.21.15.71:0/4075518116 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v44) v1 ==== 107+0+4407 (secure 0 0 0) 0x7f8ee807a5a0 con 0x7f8ef40fdf20 2024-09-10T10:16:05.541 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:16:05.542 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":39,"btime":"2024-09-10T10:12:04:256740+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi071.omoqqq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6829/1608732243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1608732243},{"type":"v1","addr":"172.21.15.71:6829","nonce":1608732243}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44373,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1627286097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1627286097},{"type":"v1","addr":"172.21.15.107:6825","nonce":1627286097}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:11:36.282149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-10T10:16:05.542 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 39 2024-09-10T10:16:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.542+0000 7f8efc171640 1 -- 172.21.15.71:0/4075518116 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8edc06e0b0 msgr2=0x7f8edc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.542+0000 7f8efc171640 1 --2- 172.21.15.71:0/4075518116 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8edc06e0b0 0x7f8edc070560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4004550 tx=0x7f8ee4009040 comp rx=0 tx=0).stop 2024-09-10T10:16:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.542+0000 7f8efc171640 1 -- 172.21.15.71:0/4075518116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ef40fdf20 msgr2=0x7f8ef41137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.542+0000 7f8efc171640 1 --2- 172.21.15.71:0/4075518116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ef40fdf20 0x7f8ef41137d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8004960 tx=0x7f8ee8009da0 comp rx=0 tx=0).stop 2024-09-10T10:16:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.542+0000 7f8efc171640 1 -- 172.21.15.71:0/4075518116 shutdown_connections 2024-09-10T10:16:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.542+0000 7f8efc171640 1 --2- 172.21.15.71:0/4075518116 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f8edc06e0b0 0x7f8edc070560 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.542+0000 7f8efc171640 1 --2- 172.21.15.71:0/4075518116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ef40fdf20 0x7f8ef41137d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.542+0000 7f8efc171640 1 --2- 172.21.15.71:0/4075518116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ef40fd580 0x7f8ef4113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.542+0000 7f8efc171640 1 -- 172.21.15.71:0/4075518116 >> 172.21.15.71:0/4075518116 conn(0x7f8ef40f7060 msgr2=0x7f8ef40f85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.542+0000 7f8efc171640 1 -- 172.21.15.71:0/4075518116 shutdown_connections 2024-09-10T10:16:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:05.542+0000 7f8efc171640 1 -- 172.21.15.71:0/4075518116 wait complete. 2024-09-10T10:16:05.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:05 smithi071 ceph-mon[90773]: pgmap v328: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:16:05.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:05 smithi107 ceph-mon[79396]: pgmap v328: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:16:06.145 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-09-10T10:16:06.145 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 39 2024-09-10T10:16:06.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 40 2024-09-10T10:16:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:16:06.757 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:06 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/4075518116' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-10T10:16:06.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:06 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/4075518116' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-10T10:16:07.698 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:07 smithi071 ceph-mon[90773]: pgmap v329: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:07.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:07 smithi107 ceph-mon[79396]: pgmap v329: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:07.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.939+0000 7f60575c6640 1 -- 172.21.15.71:0/2880786698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6050102f00 msgr2=0x7f60500fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:07.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.939+0000 7f60575c6640 1 --2- 172.21.15.71:0/2880786698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6050102f00 0x7f60500fc5c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f60400048d0 tx=0x7f6040009da0 comp rx=0 tx=0).stop 2024-09-10T10:16:07.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.939+0000 7f60575c6640 1 -- 172.21.15.71:0/2880786698 shutdown_connections 2024-09-10T10:16:07.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.940+0000 7f60575c6640 1 --2- 172.21.15.71:0/2880786698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6050102f00 0x7f60500fc5c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:07.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.940+0000 7f60575c6640 1 --2- 172.21.15.71:0/2880786698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6050102560 0x7f6050102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:07.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.940+0000 7f60575c6640 1 -- 172.21.15.71:0/2880786698 >> 172.21.15.71:0/2880786698 conn(0x7f60500f8120 msgr2=0x7f60500fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:07.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.940+0000 7f60575c6640 1 -- 172.21.15.71:0/2880786698 shutdown_connections 2024-09-10T10:16:07.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.940+0000 7f60575c6640 1 -- 172.21.15.71:0/2880786698 wait complete. 2024-09-10T10:16:07.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.940+0000 7f60575c6640 1 Processor -- start 2024-09-10T10:16:07.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.940+0000 7f60575c6640 1 -- start start 2024-09-10T10:16:07.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.940+0000 7f60575c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6050102560 0x7f605006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:07.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.940+0000 7f60575c6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6050102f00 0x7f605006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:07.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.940+0000 7f60575c6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6050070490 con 0x7f6050102560 2024-09-10T10:16:07.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.940+0000 7f60575c6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6050070600 con 0x7f6050102f00 2024-09-10T10:16:07.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.940+0000 7f6055362640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6050102560 0x7f605006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:07.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.940+0000 7f6055362640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6050102560 0x7f605006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43516/0 (socket says 172.21.15.71:43516) 2024-09-10T10:16:07.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.941+0000 7f6055362640 1 -- 172.21.15.71:0/1205603047 learned_addr learned my addr 172.21.15.71:0/1205603047 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:16:07.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.941+0000 7f6054b61640 1 --2- 172.21.15.71:0/1205603047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6050102f00 0x7f605006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:07.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.941+0000 7f6055362640 1 -- 172.21.15.71:0/1205603047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6050102f00 msgr2=0x7f605006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:07.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.941+0000 7f6055362640 1 --2- 172.21.15.71:0/1205603047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6050102f00 0x7f605006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:07.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.941+0000 7f6055362640 1 -- 172.21.15.71:0/1205603047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6040005040 con 0x7f6050102560 2024-09-10T10:16:07.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.941+0000 7f6054b61640 1 --2- 172.21.15.71:0/1205603047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6050102f00 0x7f605006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:16:07.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.941+0000 7f6055362640 1 --2- 172.21.15.71:0/1205603047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6050102560 0x7f605006fa10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f604c00eb70 tx=0x7f604c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:07.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.941+0000 7f6045ffb640 1 -- 172.21.15.71:0/1205603047 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f604c007c30 con 0x7f6050102560 2024-09-10T10:16:07.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.941+0000 7f6045ffb640 1 -- 172.21.15.71:0/1205603047 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f604c00f040 con 0x7f6050102560 2024-09-10T10:16:07.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.941+0000 7f60575c6640 1 -- 172.21.15.71:0/1205603047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6050070830 con 0x7f6050102560 2024-09-10T10:16:07.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.941+0000 7f6045ffb640 1 -- 172.21.15.71:0/1205603047 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f604c0094e0 con 0x7f6050102560 2024-09-10T10:16:07.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.941+0000 7f60575c6640 1 -- 172.21.15.71:0/1205603047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60501198d0 con 0x7f6050102560 2024-09-10T10:16:07.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.942+0000 7f60575c6640 1 -- 172.21.15.71:0/1205603047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60500fdce0 con 0x7f6050102560 2024-09-10T10:16:07.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.943+0000 7f6045ffb640 1 -- 172.21.15.71:0/1205603047 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f604c009660 con 0x7f6050102560 2024-09-10T10:16:07.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.943+0000 7f6045ffb640 1 --2- 172.21.15.71:0/1205603047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f603c06e0b0 0x7f603c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:07.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.943+0000 7f6045ffb640 1 -- 172.21.15.71:0/1205603047 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f604c08d980 con 0x7f6050102560 2024-09-10T10:16:07.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.943+0000 7f6054b61640 1 --2- 172.21.15.71:0/1205603047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f603c06e0b0 0x7f603c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:07.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.944+0000 7f6054b61640 1 --2- 172.21.15.71:0/1205603047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f603c06e0b0 0x7f603c070560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6040009ac0 tx=0x7f6040009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:07.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:07.948+0000 7f6045ffb640 1 -- 172.21.15.71:0/1205603047 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f604c056c50 con 0x7f6050102560 2024-09-10T10:16:08.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:08.148+0000 7f60575c6640 1 -- 172.21.15.71:0/1205603047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f6050071100 con 0x7f6050102560 2024-09-10T10:16:08.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:08.149+0000 7f6045ffb640 1 -- 172.21.15.71:0/1205603047 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v44) v1 ==== 107+0+5257 (secure 0 0 0) 0x7f604c05a310 con 0x7f6050102560 2024-09-10T10:16:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:16:08.151 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":40,"btime":"2024-09-10T10:12:09:272697+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi071.omoqqq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6829/1608732243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1608732243},{"type":"v1","addr":"172.21.15.71:6829","nonce":1608732243}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44373,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1627286097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1627286097},{"type":"v1","addr":"172.21.15.107:6825","nonce":1627286097}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44397,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/2279749952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2279749952},{"type":"v1","addr":"172.21.15.107:6827","nonce":2279749952}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:11:36.282149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-10T10:16:08.151 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 40 2024-09-10T10:16:08.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:08.151+0000 7f60575c6640 1 -- 172.21.15.71:0/1205603047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f603c06e0b0 msgr2=0x7f603c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:08.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:08.151+0000 7f60575c6640 1 --2- 172.21.15.71:0/1205603047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f603c06e0b0 0x7f603c070560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6040009ac0 tx=0x7f6040009da0 comp rx=0 tx=0).stop 2024-09-10T10:16:08.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:08.151+0000 7f60575c6640 1 -- 172.21.15.71:0/1205603047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6050102560 msgr2=0x7f605006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:08.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:08.151+0000 7f60575c6640 1 --2- 172.21.15.71:0/1205603047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6050102560 0x7f605006fa10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f604c00eb70 tx=0x7f604c00b040 comp rx=0 tx=0).stop 2024-09-10T10:16:08.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:08.151+0000 7f60575c6640 1 -- 172.21.15.71:0/1205603047 shutdown_connections 2024-09-10T10:16:08.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:08.151+0000 7f60575c6640 1 --2- 172.21.15.71:0/1205603047 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f603c06e0b0 0x7f603c070560 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:08.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:08.151+0000 7f60575c6640 1 --2- 172.21.15.71:0/1205603047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6050102f00 0x7f605006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:08.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:08.151+0000 7f60575c6640 1 --2- 172.21.15.71:0/1205603047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6050102560 0x7f605006fa10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:08.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:08.151+0000 7f60575c6640 1 -- 172.21.15.71:0/1205603047 >> 172.21.15.71:0/1205603047 conn(0x7f60500f8120 msgr2=0x7f60500f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:08.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:08.151+0000 7f60575c6640 1 -- 172.21.15.71:0/1205603047 shutdown_connections 2024-09-10T10:16:08.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:08.151+0000 7f60575c6640 1 -- 172.21.15.71:0/1205603047 wait complete. 2024-09-10T10:16:08.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:08 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/1205603047' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-10T10:16:08.843 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-09-10T10:16:08.843 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 40 2024-09-10T10:16:08.843 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 41 2024-09-10T10:16:08.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:08 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/1205603047' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-10T10:16:09.099 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:16:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:09 smithi071 ceph-mon[90773]: pgmap v330: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:09.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:16:09.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:09 smithi107 ceph-mon[79396]: pgmap v330: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:09.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:16:10.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.796+0000 7f3ae47c9640 1 -- 172.21.15.71:0/2025571759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3adc102ef0 msgr2=0x7f3adc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:10.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.796+0000 7f3ae47c9640 1 --2- 172.21.15.71:0/2025571759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3adc102ef0 0x7f3adc0fc5b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00048d0 tx=0x7f3ad0009da0 comp rx=0 tx=0).stop 2024-09-10T10:16:10.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.796+0000 7f3ae47c9640 1 -- 172.21.15.71:0/2025571759 shutdown_connections 2024-09-10T10:16:10.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.796+0000 7f3ae47c9640 1 --2- 172.21.15.71:0/2025571759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3adc102ef0 0x7f3adc0fc5b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:10.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.796+0000 7f3ae47c9640 1 --2- 172.21.15.71:0/2025571759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3adc102550 0x7f3adc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:10.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.796+0000 7f3ae47c9640 1 -- 172.21.15.71:0/2025571759 >> 172.21.15.71:0/2025571759 conn(0x7f3adc0f80f0 msgr2=0x7f3adc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:10.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.796+0000 7f3ae47c9640 1 -- 172.21.15.71:0/2025571759 shutdown_connections 2024-09-10T10:16:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.796+0000 7f3ae47c9640 1 -- 172.21.15.71:0/2025571759 wait complete. 2024-09-10T10:16:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.796+0000 7f3ae47c9640 1 Processor -- start 2024-09-10T10:16:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.796+0000 7f3ae47c9640 1 -- start start 2024-09-10T10:16:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae47c9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3adc102550 0x7f3adc06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae47c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3adc102ef0 0x7f3adc06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae47c9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc070490 con 0x7f3adc102550 2024-09-10T10:16:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae47c9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc070600 con 0x7f3adc102ef0 2024-09-10T10:16:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae2565640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3adc102550 0x7f3adc06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae2565640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3adc102550 0x7f3adc06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43538/0 (socket says 172.21.15.71:43538) 2024-09-10T10:16:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae2565640 1 -- 172.21.15.71:0/642350890 learned_addr learned my addr 172.21.15.71:0/642350890 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:16:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae1d64640 1 --2- 172.21.15.71:0/642350890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3adc102ef0 0x7f3adc06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae2565640 1 -- 172.21.15.71:0/642350890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3adc102ef0 msgr2=0x7f3adc06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:10.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae2565640 1 --2- 172.21.15.71:0/642350890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3adc102ef0 0x7f3adc06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae2565640 1 -- 172.21.15.71:0/642350890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad0005040 con 0x7f3adc102550 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae2565640 1 --2- 172.21.15.71:0/642350890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3adc102550 0x7f3adc06fa10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8002a50 tx=0x7f3ad8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3aceffd640 1 -- 172.21.15.71:0/642350890 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad8007c30 con 0x7f3adc102550 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3aceffd640 1 -- 172.21.15.71:0/642350890 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ad800f040 con 0x7f3adc102550 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae47c9640 1 -- 172.21.15.71:0/642350890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3adc070890 con 0x7f3adc102550 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3aceffd640 1 -- 172.21.15.71:0/642350890 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad800db50 con 0x7f3adc102550 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.797+0000 7f3ae47c9640 1 -- 172.21.15.71:0/642350890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3adc119c00 con 0x7f3adc102550 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.798+0000 7f3ae47c9640 1 -- 172.21.15.71:0/642350890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc0fdcd0 con 0x7f3adc102550 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.799+0000 7f3aceffd640 1 -- 172.21.15.71:0/642350890 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3ad800dcb0 con 0x7f3adc102550 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.799+0000 7f3aceffd640 1 --2- 172.21.15.71:0/642350890 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3ac806e0b0 0x7f3ac8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.799+0000 7f3aceffd640 1 -- 172.21.15.71:0/642350890 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f3ad808dbe0 con 0x7f3adc102550 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.799+0000 7f3ae1d64640 1 --2- 172.21.15.71:0/642350890 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3ac806e0b0 0x7f3ac8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.800+0000 7f3ae1d64640 1 --2- 172.21.15.71:0/642350890 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3ac806e0b0 0x7f3ac8070560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0000c00 tx=0x7f3ad0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:10.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:10.804+0000 7f3aceffd640 1 -- 172.21.15.71:0/642350890 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3ad8056eb0 con 0x7f3adc102550 2024-09-10T10:16:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:11.007+0000 7f3ae47c9640 1 -- 172.21.15.71:0/642350890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f3adc0fbd50 con 0x7f3adc102550 2024-09-10T10:16:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:11.008+0000 7f3aceffd640 1 -- 172.21.15.71:0/642350890 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v44) v1 ==== 107+0+5257 (secure 0 0 0) 0x7f3ad805a570 con 0x7f3adc102550 2024-09-10T10:16:11.009 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:16:11.009 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":41,"btime":"2024-09-10T10:12:16:332854+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34432,"name":"cephfs.smithi071.omoqqq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6829/1608732243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1608732243},{"type":"v1","addr":"172.21.15.71:6829","nonce":1608732243}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44373,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1627286097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1627286097},{"type":"v1","addr":"172.21.15.107:6825","nonce":1627286097}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44397,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/2279749952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2279749952},{"type":"v1","addr":"172.21.15.107:6827","nonce":2279749952}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:12:15.335757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-10T10:16:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 41 2024-09-10T10:16:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:11.010+0000 7f3ae47c9640 1 -- 172.21.15.71:0/642350890 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3ac806e0b0 msgr2=0x7f3ac8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:11.010+0000 7f3ae47c9640 1 --2- 172.21.15.71:0/642350890 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3ac806e0b0 0x7f3ac8070560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0000c00 tx=0x7f3ad0035040 comp rx=0 tx=0).stop 2024-09-10T10:16:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:11.010+0000 7f3ae47c9640 1 -- 172.21.15.71:0/642350890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3adc102550 msgr2=0x7f3adc06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:11.010+0000 7f3ae47c9640 1 --2- 172.21.15.71:0/642350890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3adc102550 0x7f3adc06fa10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8002a50 tx=0x7f3ad8004600 comp rx=0 tx=0).stop 2024-09-10T10:16:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:11.010+0000 7f3ae47c9640 1 -- 172.21.15.71:0/642350890 shutdown_connections 2024-09-10T10:16:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:11.010+0000 7f3ae47c9640 1 --2- 172.21.15.71:0/642350890 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f3ac806e0b0 0x7f3ac8070560 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:11.010+0000 7f3ae47c9640 1 --2- 172.21.15.71:0/642350890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3adc102ef0 0x7f3adc06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:11.010+0000 7f3ae47c9640 1 --2- 172.21.15.71:0/642350890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3adc102550 0x7f3adc06fa10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:11.010+0000 7f3ae47c9640 1 -- 172.21.15.71:0/642350890 >> 172.21.15.71:0/642350890 conn(0x7f3adc0f80f0 msgr2=0x7f3adc0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:11.010+0000 7f3ae47c9640 1 -- 172.21.15.71:0/642350890 shutdown_connections 2024-09-10T10:16:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:11.010+0000 7f3ae47c9640 1 -- 172.21.15.71:0/642350890 wait complete. 2024-09-10T10:16:11.708 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:11 smithi071 ceph-mon[90773]: pgmap v331: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:11.708 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:11 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/642350890' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-10T10:16:11.732 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 41 2024-09-10T10:16:11.732 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 42 2024-09-10T10:16:11.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:11 smithi107 ceph-mon[79396]: pgmap v331: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:11.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:11 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/642350890' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-10T10:16:11.978 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:16:13.518 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:13 smithi071 ceph-mon[90773]: pgmap v332: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:13.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.593+0000 7ff127b2b640 1 -- 172.21.15.71:0/3899001644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff12006fff0 msgr2=0x7ff120070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:13.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.593+0000 7ff127b2b640 1 --2- 172.21.15.71:0/3899001644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff12006fff0 0x7ff120070460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff1100048d0 tx=0x7ff110009da0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.593+0000 7ff127b2b640 1 -- 172.21.15.71:0/3899001644 shutdown_connections 2024-09-10T10:16:13.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.594+0000 7ff127b2b640 1 --2- 172.21.15.71:0/3899001644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff12006fff0 0x7ff120070460 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.594+0000 7ff127b2b640 1 --2- 172.21.15.71:0/3899001644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1200716e0 0x7ff12006fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.594+0000 7ff127b2b640 1 -- 172.21.15.71:0/3899001644 >> 172.21.15.71:0/3899001644 conn(0x7ff1200f80f0 msgr2=0x7ff1200fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:13.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.594+0000 7ff127b2b640 1 -- 172.21.15.71:0/3899001644 shutdown_connections 2024-09-10T10:16:13.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.594+0000 7ff127b2b640 1 -- 172.21.15.71:0/3899001644 wait complete. 2024-09-10T10:16:13.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.594+0000 7ff127b2b640 1 Processor -- start 2024-09-10T10:16:13.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.594+0000 7ff127b2b640 1 -- start start 2024-09-10T10:16:13.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.594+0000 7ff127b2b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff12006fff0 0x7ff120119c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.594+0000 7ff127b2b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1200716e0 0x7ff12011a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.594+0000 7ff127b2b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12011a750 con 0x7ff1200716e0 2024-09-10T10:16:13.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.594+0000 7ff127b2b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff120113b90 con 0x7ff12006fff0 2024-09-10T10:16:13.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff1250c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1200716e0 0x7ff12011a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff1250c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1200716e0 0x7ff12011a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45912/0 (socket says 172.21.15.71:45912) 2024-09-10T10:16:13.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff1250c6640 1 -- 172.21.15.71:0/2452266767 learned_addr learned my addr 172.21.15.71:0/2452266767 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:16:13.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff1258c7640 1 --2- 172.21.15.71:0/2452266767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff12006fff0 0x7ff120119c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff1250c6640 1 -- 172.21.15.71:0/2452266767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff12006fff0 msgr2=0x7ff120119c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:13.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff1250c6640 1 --2- 172.21.15.71:0/2452266767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff12006fff0 0x7ff120119c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff1250c6640 1 -- 172.21.15.71:0/2452266767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff110005040 con 0x7ff1200716e0 2024-09-10T10:16:13.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff1258c7640 1 --2- 172.21.15.71:0/2452266767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff12006fff0 0x7ff120119c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:16:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff1250c6640 1 --2- 172.21.15.71:0/2452266767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1200716e0 0x7ff12011a150 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff110003080 tx=0x7ff110009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff1167fc640 1 -- 172.21.15.71:0/2452266767 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff110038070 con 0x7ff1200716e0 2024-09-10T10:16:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff1167fc640 1 -- 172.21.15.71:0/2452266767 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff110032b20 con 0x7ff1200716e0 2024-09-10T10:16:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff127b2b640 1 -- 172.21.15.71:0/2452266767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff120113e10 con 0x7ff1200716e0 2024-09-10T10:16:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff1167fc640 1 -- 172.21.15.71:0/2452266767 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff11003d9e0 con 0x7ff1200716e0 2024-09-10T10:16:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.595+0000 7ff127b2b640 1 -- 172.21.15.71:0/2452266767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1201142d0 con 0x7ff1200716e0 2024-09-10T10:16:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.596+0000 7ff127b2b640 1 -- 172.21.15.71:0/2452266767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1200711f0 con 0x7ff1200716e0 2024-09-10T10:16:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.597+0000 7ff1167fc640 1 -- 172.21.15.71:0/2452266767 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff110030020 con 0x7ff1200716e0 2024-09-10T10:16:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.597+0000 7ff1167fc640 1 --2- 172.21.15.71:0/2452266767 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff10c06e0b0 0x7ff10c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.597+0000 7ff1167fc640 1 -- 172.21.15.71:0/2452266767 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff1100ae590 con 0x7ff1200716e0 2024-09-10T10:16:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.597+0000 7ff1258c7640 1 --2- 172.21.15.71:0/2452266767 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff10c06e0b0 0x7ff10c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.598+0000 7ff1258c7640 1 --2- 172.21.15.71:0/2452266767 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff10c06e0b0 0x7ff10c070560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff11c004c60 tx=0x7ff11c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:13.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.602+0000 7ff1167fc640 1 -- 172.21.15.71:0/2452266767 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff110077860 con 0x7ff1200716e0 2024-09-10T10:16:13.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.806+0000 7ff127b2b640 1 -- 172.21.15.71:0/2452266767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7ff12010fb20 con 0x7ff1200716e0 2024-09-10T10:16:13.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.806+0000 7ff1167fc640 1 -- 172.21.15.71:0/2452266767 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v44) v1 ==== 107+0+5274 (secure 0 0 0) 0x7ff11007af20 con 0x7ff1200716e0 2024-09-10T10:16:13.808 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:16:13.808 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":42,"btime":"2024-09-10T10:12:16:337692+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44373,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1627286097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1627286097},{"type":"v1","addr":"172.21.15.107:6825","nonce":1627286097}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44397,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/2279749952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2279749952},{"type":"v1","addr":"172.21.15.107:6827","nonce":2279749952}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:12:16.337679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34416,"mds_1":34432},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34432":{"gid":34432,"name":"cephfs.smithi071.omoqqq","rank":1,"incarnation":42,"state":"up:starting","state_seq":1,"addr":"172.21.15.71:6829/1608732243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1608732243},{"type":"v1","addr":"172.21.15.71:6829","nonce":1608732243}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-10T10:16:13.808 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 42 2024-09-10T10:16:13.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.808+0000 7ff127b2b640 1 -- 172.21.15.71:0/2452266767 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff10c06e0b0 msgr2=0x7ff10c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:13.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.808+0000 7ff127b2b640 1 --2- 172.21.15.71:0/2452266767 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff10c06e0b0 0x7ff10c070560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff11c004c60 tx=0x7ff11c009040 comp rx=0 tx=0).stop 2024-09-10T10:16:13.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.808+0000 7ff127b2b640 1 -- 172.21.15.71:0/2452266767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1200716e0 msgr2=0x7ff12011a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:13.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.808+0000 7ff127b2b640 1 --2- 172.21.15.71:0/2452266767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1200716e0 0x7ff12011a150 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff110003080 tx=0x7ff110009da0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.809+0000 7ff127b2b640 1 -- 172.21.15.71:0/2452266767 shutdown_connections 2024-09-10T10:16:13.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.809+0000 7ff127b2b640 1 --2- 172.21.15.71:0/2452266767 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7ff10c06e0b0 0x7ff10c070560 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.809+0000 7ff127b2b640 1 --2- 172.21.15.71:0/2452266767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1200716e0 0x7ff12011a150 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.809+0000 7ff127b2b640 1 --2- 172.21.15.71:0/2452266767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff12006fff0 0x7ff120119c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.809+0000 7ff127b2b640 1 -- 172.21.15.71:0/2452266767 >> 172.21.15.71:0/2452266767 conn(0x7ff1200f80f0 msgr2=0x7ff1200f9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:13.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.809+0000 7ff127b2b640 1 -- 172.21.15.71:0/2452266767 shutdown_connections 2024-09-10T10:16:13.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:13.809+0000 7ff127b2b640 1 -- 172.21.15.71:0/2452266767 wait complete. 2024-09-10T10:16:13.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:13 smithi107 ceph-mon[79396]: pgmap v332: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:14.607 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 42 2024-09-10T10:16:14.607 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 43 2024-09-10T10:16:14.753 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:14 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2452266767' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-10T10:16:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:16:14.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:14 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2452266767' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-10T10:16:15.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:15 smithi071 ceph-mon[90773]: pgmap v333: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:16:15.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:15 smithi107 ceph-mon[79396]: pgmap v333: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.423+0000 7f3988093640 1 -- 172.21.15.71:0/2994663424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39801014e0 msgr2=0x7f39801018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.423+0000 7f3988093640 1 --2- 172.21.15.71:0/2994663424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39801014e0 0x7f39801018b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f39780048d0 tx=0x7f3978009da0 comp rx=0 tx=0).stop 2024-09-10T10:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.423+0000 7f3988093640 1 -- 172.21.15.71:0/2994663424 shutdown_connections 2024-09-10T10:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.423+0000 7f3988093640 1 --2- 172.21.15.71:0/2994663424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39800fb4a0 0x7f39800fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.423+0000 7f3988093640 1 --2- 172.21.15.71:0/2994663424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39801014e0 0x7f39801018b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.423+0000 7f3988093640 1 -- 172.21.15.71:0/2994663424 >> 172.21.15.71:0/2994663424 conn(0x7f39800f7060 msgr2=0x7f39800f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.423+0000 7f3988093640 1 -- 172.21.15.71:0/2994663424 shutdown_connections 2024-09-10T10:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.423+0000 7f3988093640 1 -- 172.21.15.71:0/2994663424 wait complete. 2024-09-10T10:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.424+0000 7f3988093640 1 Processor -- start 2024-09-10T10:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.424+0000 7f3988093640 1 -- start start 2024-09-10T10:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.424+0000 7f3988093640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39800fb4a0 0x7f39801131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.424+0000 7f3988093640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39801014e0 0x7f39801136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.424+0000 7f3988093640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3980113ce0 con 0x7f39801014e0 2024-09-10T10:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.424+0000 7f3988093640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398010d120 con 0x7f39800fb4a0 2024-09-10T10:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.424+0000 7f398562e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39801014e0 0x7f39801136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.424+0000 7f398562e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39801014e0 0x7f39801136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45930/0 (socket says 172.21.15.71:45930) 2024-09-10T10:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.424+0000 7f398562e640 1 -- 172.21.15.71:0/2408638456 learned_addr learned my addr 172.21.15.71:0/2408638456 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.424+0000 7f398562e640 1 -- 172.21.15.71:0/2408638456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39800fb4a0 msgr2=0x7f39801131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.424+0000 7f398562e640 1 --2- 172.21.15.71:0/2408638456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39800fb4a0 0x7f39801131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.425+0000 7f398562e640 1 -- 172.21.15.71:0/2408638456 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3978005040 con 0x7f39801014e0 2024-09-10T10:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.425+0000 7f398562e640 1 --2- 172.21.15.71:0/2408638456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39801014e0 0x7f39801136e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f397400c830 tx=0x7f3974004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.425+0000 7f397e7fc640 1 -- 172.21.15.71:0/2408638456 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f397400a850 con 0x7f39801014e0 2024-09-10T10:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.425+0000 7f397e7fc640 1 -- 172.21.15.71:0/2408638456 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f397400ae50 con 0x7f39801014e0 2024-09-10T10:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.425+0000 7f397e7fc640 1 -- 172.21.15.71:0/2408638456 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39740113a0 con 0x7f39801014e0 2024-09-10T10:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.425+0000 7f3988093640 1 -- 172.21.15.71:0/2408638456 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398010d400 con 0x7f39801014e0 2024-09-10T10:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.425+0000 7f3988093640 1 -- 172.21.15.71:0/2408638456 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398010d9a0 con 0x7f39801014e0 2024-09-10T10:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.426+0000 7f3988093640 1 -- 172.21.15.71:0/2408638456 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39800fcbe0 con 0x7f39801014e0 2024-09-10T10:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.426+0000 7f397e7fc640 1 -- 172.21.15.71:0/2408638456 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3974012400 con 0x7f39801014e0 2024-09-10T10:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.427+0000 7f397e7fc640 1 --2- 172.21.15.71:0/2408638456 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f396806e0b0 0x7f3968070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.427+0000 7f397e7fc640 1 -- 172.21.15.71:0/2408638456 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f397408dd40 con 0x7f39801014e0 2024-09-10T10:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.427+0000 7f3985e2f640 1 --2- 172.21.15.71:0/2408638456 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f396806e0b0 0x7f3968070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.427+0000 7f3985e2f640 1 --2- 172.21.15.71:0/2408638456 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f396806e0b0 0x7f3968070560 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f39780043d0 tx=0x7f3978009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.431+0000 7f397e7fc640 1 -- 172.21.15.71:0/2408638456 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3974057130 con 0x7f39801014e0 2024-09-10T10:16:16.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.635+0000 7f3988093640 1 -- 172.21.15.71:0/2408638456 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 43, "format": "json"} v 0) v1 -- 0x7f39800fac60 con 0x7f39801014e0 2024-09-10T10:16:16.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.636+0000 7f397e7fc640 1 -- 172.21.15.71:0/2408638456 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 43, "format": "json"}]=0 dumped fsmap epoch 43 v44) v1 ==== 107+0+5278 (secure 0 0 0) 0x7f397405a7f0 con 0x7f39801014e0 2024-09-10T10:16:16.637 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-10T10:16:16.638 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":43,"btime":"2024-09-10T10:12:17:342612+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44373,"name":"cephfs.smithi107.nycoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6825/1627286097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1627286097},{"type":"v1","addr":"172.21.15.107:6825","nonce":1627286097}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44397,"name":"cephfs.smithi107.rvgklu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6827/2279749952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2279749952},{"type":"v1","addr":"172.21.15.107:6827","nonce":2279749952}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:01:27.452418+0000","modified":"2024-09-10T10:12:17.342608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34416,"mds_1":34432},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi071.toijsg","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6827/1701579524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1701579524},{"type":"v1","addr":"172.21.15.71:6827","nonce":1701579524}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34432":{"gid":34432,"name":"cephfs.smithi071.omoqqq","rank":1,"incarnation":42,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6829/1608732243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1608732243},{"type":"v1","addr":"172.21.15.71:6829","nonce":1608732243}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416,34432]},"id":1}]} 2024-09-10T10:16:16.638 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 43 2024-09-10T10:16:16.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.638+0000 7f3988093640 1 -- 172.21.15.71:0/2408638456 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f396806e0b0 msgr2=0x7f3968070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.638+0000 7f3988093640 1 --2- 172.21.15.71:0/2408638456 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f396806e0b0 0x7f3968070560 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f39780043d0 tx=0x7f3978009da0 comp rx=0 tx=0).stop 2024-09-10T10:16:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.638+0000 7f3988093640 1 -- 172.21.15.71:0/2408638456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39801014e0 msgr2=0x7f39801136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.638+0000 7f3988093640 1 --2- 172.21.15.71:0/2408638456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39801014e0 0x7f39801136e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f397400c830 tx=0x7f3974004430 comp rx=0 tx=0).stop 2024-09-10T10:16:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.638+0000 7f3988093640 1 -- 172.21.15.71:0/2408638456 shutdown_connections 2024-09-10T10:16:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.638+0000 7f3988093640 1 --2- 172.21.15.71:0/2408638456 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f396806e0b0 0x7f3968070560 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.638+0000 7f3988093640 1 --2- 172.21.15.71:0/2408638456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39801014e0 0x7f39801136e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.638+0000 7f3988093640 1 --2- 172.21.15.71:0/2408638456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f39800fb4a0 0x7f39801131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.638+0000 7f3988093640 1 -- 172.21.15.71:0/2408638456 >> 172.21.15.71:0/2408638456 conn(0x7f39800f7060 msgr2=0x7f3980065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.638+0000 7f3988093640 1 -- 172.21.15.71:0/2408638456 shutdown_connections 2024-09-10T10:16:16.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:16.638+0000 7f3988093640 1 -- 172.21.15.71:0/2408638456 wait complete. 2024-09-10T10:16:17.235 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-10T10:16:17.246 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-10T10:16:17.246 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T10:16:17.247 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T10:16:17.265 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T10:16:17.265 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T10:16:17.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T10:16:17.606 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:16:17.728 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:17 smithi071 ceph-mon[90773]: pgmap v334: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:17.728 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:17 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/2408638456' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-09-10T10:16:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:17 smithi107 ceph-mon[79396]: pgmap v334: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:17.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:17 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/2408638456' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-09-10T10:16:19.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.247+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/3459247220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e4406fff0 msgr2=0x7f4e44070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:19.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.247+0000 7f4e4c0f6640 1 --2- 172.21.15.71:0/3459247220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e4406fff0 0x7f4e44070460 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4e340048d0 tx=0x7f4e34009da0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.247+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/3459247220 shutdown_connections 2024-09-10T10:16:19.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.247+0000 7f4e4c0f6640 1 --2- 172.21.15.71:0/3459247220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e4406fff0 0x7f4e44070460 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.247+0000 7f4e4c0f6640 1 --2- 172.21.15.71:0/3459247220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e440716e0 0x7f4e4406fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.247+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/3459247220 >> 172.21.15.71:0/3459247220 conn(0x7f4e440f8120 msgr2=0x7f4e440fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.247+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/3459247220 shutdown_connections 2024-09-10T10:16:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.247+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/3459247220 wait complete. 2024-09-10T10:16:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e4c0f6640 1 Processor -- start 2024-09-10T10:16:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e4c0f6640 1 -- start start 2024-09-10T10:16:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e4c0f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e4406fff0 0x7f4e44119840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e4c0f6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440716e0 0x7f4e44119d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e4c0f6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4411a3d0 con 0x7f4e440716e0 2024-09-10T10:16:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e4c0f6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e441137e0 con 0x7f4e4406fff0 2024-09-10T10:16:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e49691640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440716e0 0x7f4e44119d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e49691640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440716e0 0x7f4e44119d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45944/0 (socket says 172.21.15.71:45944) 2024-09-10T10:16:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e49691640 1 -- 172.21.15.71:0/376948693 learned_addr learned my addr 172.21.15.71:0/376948693 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:16:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e49691640 1 -- 172.21.15.71:0/376948693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e4406fff0 msgr2=0x7f4e44119840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:19.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e49e92640 1 --2- 172.21.15.71:0/376948693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e4406fff0 0x7f4e44119840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e49691640 1 --2- 172.21.15.71:0/376948693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e4406fff0 0x7f4e44119840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e49691640 1 -- 172.21.15.71:0/376948693 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e34005040 con 0x7f4e440716e0 2024-09-10T10:16:19.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.248+0000 7f4e49691640 1 --2- 172.21.15.71:0/376948693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440716e0 0x7f4e44119d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4e34003080 tx=0x7f4e34009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:19.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.249+0000 7f4e3a7fc640 1 -- 172.21.15.71:0/376948693 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e34038070 con 0x7f4e440716e0 2024-09-10T10:16:19.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.249+0000 7f4e3a7fc640 1 -- 172.21.15.71:0/376948693 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4e34032b20 con 0x7f4e440716e0 2024-09-10T10:16:19.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.249+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/376948693 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e44113a60 con 0x7f4e440716e0 2024-09-10T10:16:19.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.249+0000 7f4e3a7fc640 1 -- 172.21.15.71:0/376948693 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e3403d990 con 0x7f4e440716e0 2024-09-10T10:16:19.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.249+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/376948693 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e44113f20 con 0x7f4e440716e0 2024-09-10T10:16:19.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.250+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/376948693 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e440711f0 con 0x7f4e440716e0 2024-09-10T10:16:19.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.250+0000 7f4e3a7fc640 1 -- 172.21.15.71:0/376948693 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4e34030020 con 0x7f4e440716e0 2024-09-10T10:16:19.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.251+0000 7f4e3a7fc640 1 --2- 172.21.15.71:0/376948693 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4e3006e0b0 0x7f4e30070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.251+0000 7f4e3a7fc640 1 -- 172.21.15.71:0/376948693 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4e340ae5d0 con 0x7f4e440716e0 2024-09-10T10:16:19.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.251+0000 7f4e49e92640 1 --2- 172.21.15.71:0/376948693 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4e3006e0b0 0x7f4e30070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.251+0000 7f4e49e92640 1 --2- 172.21.15.71:0/376948693 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4e3006e0b0 0x7f4e30070560 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4e40007fd0 tx=0x7f4e40009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:19.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.255+0000 7f4e3a7fc640 1 -- 172.21.15.71:0/376948693 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4e340778a0 con 0x7f4e440716e0 2024-09-10T10:16:19.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.439+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/376948693 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4e4410fb30 con 0x7f4e440716e0 2024-09-10T10:16:19.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.439+0000 7f4e3a7fc640 1 -- 172.21.15.71:0/376948693 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v83) v1 ==== 81+0+2420 (secure 0 0 0) 0x7f4e34077030 con 0x7f4e440716e0 2024-09-10T10:16:19.441 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6829/3739086646 2024-09-11T10:11:28.472460+0000 2024-09-10T10:16:19.441 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6828/3739086646 2024-09-11T10:11:28.472460+0000 2024-09-10T10:16:19.441 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1355485688 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:19.441 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6800/3747026928 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:19.441 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/3009180901 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:19.441 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/2956242698 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:19.441 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:6829/591375611 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:19.441 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:6828/591375611 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1476291167 2024-09-11T09:56:44.302013+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1666739758 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6827/652614206 2024-09-11T10:01:42.665042+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/3250999617 2024-09-11T09:55:05.910028+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/3813664805 2024-09-11T09:55:42.210023+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/3312099981 2024-09-11T09:56:44.302013+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/2038279395 2024-09-11T09:55:42.210023+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/3064565600 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6800/4098346293 2024-09-11T09:55:42.210023+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6826/652614206 2024-09-11T10:01:42.665042+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6801/4098346293 2024-09-11T09:55:42.210023+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6801/89381066 2024-09-11T09:55:05.910028+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6801/404028021 2024-09-11T09:56:44.302013+0000 2024-09-10T10:16:19.442 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:0/765056569 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/2371616045 2024-09-11T09:55:05.910028+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:0/65695236 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6800/404028021 2024-09-11T09:56:44.302013+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6800/89381066 2024-09-11T09:55:05.910028+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:0/2493054364 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:0/819473158 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/4274762125 2024-09-11T10:04:22.779077+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/2519859872 2024-09-11T09:55:05.910028+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6801/1474777768 2024-09-11T10:04:22.779077+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1432096412 2024-09-11T10:04:22.779077+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6801/3747026928 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6800/1474777768 2024-09-11T10:04:22.779077+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1946576539 2024-09-11T10:04:22.779077+0000 2024-09-10T10:16:19.443 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:0/1459047852 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:19.444 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1378435278 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:19.444 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1970727630 2024-09-11T09:55:42.210023+0000 2024-09-10T10:16:19.444 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/3597519826 2024-09-11T10:04:22.779077+0000 2024-09-10T10:16:19.444 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:0/1200041182 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:19.444 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/2738930401 2024-09-11T09:56:44.302013+0000 2024-09-10T10:16:19.445 INFO:teuthology.orchestra.run.smithi071.stderr:listed 41 entries 2024-09-10T10:16:19.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.442+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/376948693 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4e3006e0b0 msgr2=0x7f4e30070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:19.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.442+0000 7f4e4c0f6640 1 --2- 172.21.15.71:0/376948693 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4e3006e0b0 0x7f4e30070560 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4e40007fd0 tx=0x7f4e40009040 comp rx=0 tx=0).stop 2024-09-10T10:16:19.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.442+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/376948693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440716e0 msgr2=0x7f4e44119d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:19.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.442+0000 7f4e4c0f6640 1 --2- 172.21.15.71:0/376948693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440716e0 0x7f4e44119d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4e34003080 tx=0x7f4e34009da0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.442+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/376948693 shutdown_connections 2024-09-10T10:16:19.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.442+0000 7f4e4c0f6640 1 --2- 172.21.15.71:0/376948693 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7f4e3006e0b0 0x7f4e30070560 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.442+0000 7f4e4c0f6640 1 --2- 172.21.15.71:0/376948693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440716e0 0x7f4e44119d80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.442+0000 7f4e4c0f6640 1 --2- 172.21.15.71:0/376948693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e4406fff0 0x7f4e44119840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.442+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/376948693 >> 172.21.15.71:0/376948693 conn(0x7f4e440f8120 msgr2=0x7f4e4410b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:19.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.442+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/376948693 shutdown_connections 2024-09-10T10:16:19.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:19.442+0000 7f4e4c0f6640 1 -- 172.21.15.71:0/376948693 wait complete. 2024-09-10T10:16:19.740 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:19 smithi071 ceph-mon[90773]: pgmap v335: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:19.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:19 smithi107 ceph-mon[79396]: pgmap v335: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:20.023 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-10T10:16:20.024 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T10:16:20.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T10:16:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/mon.smithi071/config 2024-09-10T10:16:20.768 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:20 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/376948693' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:16:20.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:20 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/376948693' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:16:21.720 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:21 smithi071 ceph-mon[90773]: pgmap v336: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:21.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:21 smithi107 ceph-mon[79396]: pgmap v336: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.917+0000 7fa37a2c7640 1 -- 172.21.15.71:0/2246614667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3741014e0 msgr2=0x7fa3741018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.917+0000 7fa37a2c7640 1 --2- 172.21.15.71:0/2246614667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3741014e0 0x7fa3741018b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa3640048d0 tx=0x7fa364009da0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.917+0000 7fa37a2c7640 1 -- 172.21.15.71:0/2246614667 shutdown_connections 2024-09-10T10:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.917+0000 7fa37a2c7640 1 --2- 172.21.15.71:0/2246614667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3740fb4a0 0x7fa3740fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.917+0000 7fa37a2c7640 1 --2- 172.21.15.71:0/2246614667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3741014e0 0x7fa3741018b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.917+0000 7fa37a2c7640 1 -- 172.21.15.71:0/2246614667 >> 172.21.15.71:0/2246614667 conn(0x7fa3740f7060 msgr2=0x7fa3740f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.917+0000 7fa37a2c7640 1 -- 172.21.15.71:0/2246614667 shutdown_connections 2024-09-10T10:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.917+0000 7fa37a2c7640 1 -- 172.21.15.71:0/2246614667 wait complete. 2024-09-10T10:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.918+0000 7fa37a2c7640 1 Processor -- start 2024-09-10T10:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.918+0000 7fa37a2c7640 1 -- start start 2024-09-10T10:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.918+0000 7fa37a2c7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3740fb4a0 0x7fa374113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.918+0000 7fa37a2c7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3741014e0 0x7fa374113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.918+0000 7fa37a2c7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa374113df0 con 0x7fa3741014e0 2024-09-10T10:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.918+0000 7fa37a2c7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37410d1a0 con 0x7fa3740fb4a0 2024-09-10T10:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.918+0000 7fa36bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3741014e0 0x7fa374113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.918+0000 7fa36bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3741014e0 0x7fa374113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45972/0 (socket says 172.21.15.71:45972) 2024-09-10T10:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.918+0000 7fa36bfff640 1 -- 172.21.15.71:0/3439658972 learned_addr learned my addr 172.21.15.71:0/3439658972 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-10T10:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.919+0000 7fa36bfff640 1 -- 172.21.15.71:0/3439658972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3740fb4a0 msgr2=0x7fa374113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.919+0000 7fa36bfff640 1 --2- 172.21.15.71:0/3439658972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3740fb4a0 0x7fa374113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.919+0000 7fa36bfff640 1 -- 172.21.15.71:0/3439658972 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa364005040 con 0x7fa3741014e0 2024-09-10T10:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.919+0000 7fa36bfff640 1 --2- 172.21.15.71:0/3439658972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3741014e0 0x7fa374113760 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00b790 tx=0x7fa35c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.919+0000 7fa3717fa640 1 -- 172.21.15.71:0/3439658972 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa35c00c700 con 0x7fa3741014e0 2024-09-10T10:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.919+0000 7fa37a2c7640 1 -- 172.21.15.71:0/3439658972 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37410d480 con 0x7fa3741014e0 2024-09-10T10:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.919+0000 7fa3717fa640 1 -- 172.21.15.71:0/3439658972 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa35c00cd00 con 0x7fa3741014e0 2024-09-10T10:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.919+0000 7fa3717fa640 1 -- 172.21.15.71:0/3439658972 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa35c015e70 con 0x7fa3741014e0 2024-09-10T10:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.919+0000 7fa37a2c7640 1 -- 172.21.15.71:0/3439658972 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37410d9a0 con 0x7fa3741014e0 2024-09-10T10:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.920+0000 7fa37a2c7640 1 -- 172.21.15.71:0/3439658972 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3740fcbe0 con 0x7fa3741014e0 2024-09-10T10:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.920+0000 7fa3717fa640 1 -- 172.21.15.71:0/3439658972 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa35c012070 con 0x7fa3741014e0 2024-09-10T10:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.921+0000 7fa3717fa640 1 --2- 172.21.15.71:0/3439658972 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa36006e0b0 0x7fa360070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.921+0000 7fa3717fa640 1 -- 172.21.15.71:0/3439658972 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa35c08d800 con 0x7fa3741014e0 2024-09-10T10:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.921+0000 7fa373fff640 1 --2- 172.21.15.71:0/3439658972 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa36006e0b0 0x7fa360070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.921+0000 7fa373fff640 1 --2- 172.21.15.71:0/3439658972 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa36006e0b0 0x7fa360070560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa3640043d0 tx=0x7fa364009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:21.925+0000 7fa3717fa640 1 -- 172.21.15.71:0/3439658972 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa35c056ad0 con 0x7fa3741014e0 2024-09-10T10:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:22.105+0000 7fa37a2c7640 1 -- 172.21.15.71:0/3439658972 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa374108540 con 0x7fa3741014e0 2024-09-10T10:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:22.106+0000 7fa3717fa640 1 -- 172.21.15.71:0/3439658972 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v83) v1 ==== 81+0+2420 (secure 0 0 0) 0x7fa35c05a190 con 0x7fa3741014e0 2024-09-10T10:16:22.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6829/3739086646 2024-09-11T10:11:28.472460+0000 2024-09-10T10:16:22.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6828/3739086646 2024-09-11T10:11:28.472460+0000 2024-09-10T10:16:22.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1355485688 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:22.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6800/3747026928 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:22.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/3009180901 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:22.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/2956242698 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:22.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:6829/591375611 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:22.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:6828/591375611 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:22.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1476291167 2024-09-11T09:56:44.302013+0000 2024-09-10T10:16:22.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1666739758 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:22.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6827/652614206 2024-09-11T10:01:42.665042+0000 2024-09-10T10:16:22.109 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/3250999617 2024-09-11T09:55:05.910028+0000 2024-09-10T10:16:22.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/3813664805 2024-09-11T09:55:42.210023+0000 2024-09-10T10:16:22.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/3312099981 2024-09-11T09:56:44.302013+0000 2024-09-10T10:16:22.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/2038279395 2024-09-11T09:55:42.210023+0000 2024-09-10T10:16:22.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/3064565600 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:22.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6800/4098346293 2024-09-11T09:55:42.210023+0000 2024-09-10T10:16:22.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6826/652614206 2024-09-11T10:01:42.665042+0000 2024-09-10T10:16:22.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6801/4098346293 2024-09-11T09:55:42.210023+0000 2024-09-10T10:16:22.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6801/89381066 2024-09-11T09:55:05.910028+0000 2024-09-10T10:16:22.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6801/404028021 2024-09-11T09:56:44.302013+0000 2024-09-10T10:16:22.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:0/765056569 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:22.110 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/2371616045 2024-09-11T09:55:05.910028+0000 2024-09-10T10:16:22.111 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:0/65695236 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:22.111 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6800/404028021 2024-09-11T09:56:44.302013+0000 2024-09-10T10:16:22.111 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6800/89381066 2024-09-11T09:55:05.910028+0000 2024-09-10T10:16:22.111 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:0/2493054364 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:22.111 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:0/819473158 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:22.111 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/4274762125 2024-09-11T10:04:22.779077+0000 2024-09-10T10:16:22.111 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/2519859872 2024-09-11T09:55:05.910028+0000 2024-09-10T10:16:22.111 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6801/1474777768 2024-09-11T10:04:22.779077+0000 2024-09-10T10:16:22.111 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1432096412 2024-09-11T10:04:22.779077+0000 2024-09-10T10:16:22.111 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6801/3747026928 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:22.111 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:6800/1474777768 2024-09-11T10:04:22.779077+0000 2024-09-10T10:16:22.111 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1946576539 2024-09-11T10:04:22.779077+0000 2024-09-10T10:16:22.111 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:0/1459047852 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:22.112 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1378435278 2024-09-11T10:06:24.104040+0000 2024-09-10T10:16:22.112 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/1970727630 2024-09-11T09:55:42.210023+0000 2024-09-10T10:16:22.112 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/3597519826 2024-09-11T10:04:22.779077+0000 2024-09-10T10:16:22.112 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.107:0/1200041182 2024-09-11T10:05:44.089768+0000 2024-09-10T10:16:22.112 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71:0/2738930401 2024-09-11T09:56:44.302013+0000 2024-09-10T10:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:listed 41 entries 2024-09-10T10:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:22.108+0000 7fa37a2c7640 1 -- 172.21.15.71:0/3439658972 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa36006e0b0 msgr2=0x7fa360070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:22.108+0000 7fa37a2c7640 1 --2- 172.21.15.71:0/3439658972 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa36006e0b0 0x7fa360070560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa3640043d0 tx=0x7fa364009da0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:22.108+0000 7fa37a2c7640 1 -- 172.21.15.71:0/3439658972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3741014e0 msgr2=0x7fa374113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:22.108+0000 7fa37a2c7640 1 --2- 172.21.15.71:0/3439658972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3741014e0 0x7fa374113760 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00b790 tx=0x7fa35c0091d0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:22.108+0000 7fa37a2c7640 1 -- 172.21.15.71:0/3439658972 shutdown_connections 2024-09-10T10:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:22.108+0000 7fa37a2c7640 1 --2- 172.21.15.71:0/3439658972 >> [v2:172.21.15.71:6800/42554039,v1:172.21.15.71:6801/42554039] conn(0x7fa36006e0b0 0x7fa360070560 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:22.108+0000 7fa37a2c7640 1 --2- 172.21.15.71:0/3439658972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3741014e0 0x7fa374113760 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:22.108+0000 7fa37a2c7640 1 --2- 172.21.15.71:0/3439658972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3740fb4a0 0x7fa374113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:22.108+0000 7fa37a2c7640 1 -- 172.21.15.71:0/3439658972 >> 172.21.15.71:0/3439658972 conn(0x7fa3740f7060 msgr2=0x7fa3740f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:22.108+0000 7fa37a2c7640 1 -- 172.21.15.71:0/3439658972 shutdown_connections 2024-09-10T10:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-10T10:16:22.108+0000 7fa37a2c7640 1 -- 172.21.15.71:0/3439658972 wait complete. 2024-09-10T10:16:22.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:22 smithi071 ceph-mon[90773]: from='client.? 172.21.15.71:0/3439658972' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:16:22.864 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2024-09-10T10:16:22.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:16:22.864 DEBUG:teuthology.orchestra.run.smithi071:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T10:16:22.892 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T10:16:22.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:22 smithi107 ceph-mon[79396]: from='client.? 172.21.15.71:0/3439658972' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:16:23.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:23 smithi071 ceph-mon[90773]: pgmap v337: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:23.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:23 smithi107 ceph-mon[79396]: pgmap v337: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:24.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:16:24.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:16:25.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:25 smithi071 ceph-mon[90773]: pgmap v338: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:16:25.796 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:25 smithi107 ceph-mon[79396]: pgmap v338: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:16:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:27 smithi071 ceph-mon[90773]: pgmap v339: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:16:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:16:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:16:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:16:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:27 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:16:27.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:27 smithi107 ceph-mon[79396]: pgmap v339: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:27.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:16:27.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:16:27.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:16:27.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:16:27.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:27 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:16:28.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:16:28.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:16:29.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:29 smithi071 ceph-mon[90773]: pgmap v340: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:29.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:29 smithi107 ceph-mon[79396]: pgmap v340: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:31 smithi071 ceph-mon[90773]: pgmap v341: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:31.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:31 smithi107 ceph-mon[79396]: pgmap v341: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:33 smithi071 ceph-mon[90773]: pgmap v342: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:33.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:33 smithi107 ceph-mon[79396]: pgmap v342: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:35 smithi071 ceph-mon[90773]: pgmap v343: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:16:35.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:35 smithi107 ceph-mon[79396]: pgmap v343: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:16:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:37 smithi071 ceph-mon[90773]: pgmap v344: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:37.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:37 smithi107 ceph-mon[79396]: pgmap v344: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:39 smithi071 ceph-mon[90773]: pgmap v345: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:16:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:39 smithi107 ceph-mon[79396]: pgmap v345: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:16:41.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:41 smithi071 ceph-mon[90773]: pgmap v346: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:41.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:41 smithi107 ceph-mon[79396]: pgmap v346: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:43 smithi071 ceph-mon[90773]: pgmap v347: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:43.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:43 smithi107 ceph-mon[79396]: pgmap v347: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:45.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:45 smithi071 ceph-mon[90773]: pgmap v348: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:16:45.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:45 smithi107 ceph-mon[79396]: pgmap v348: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:16:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:47 smithi071 ceph-mon[90773]: pgmap v349: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:47.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:47 smithi107 ceph-mon[79396]: pgmap v349: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:49.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:49 smithi107 ceph-mon[79396]: pgmap v350: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:49.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:49 smithi071 ceph-mon[90773]: pgmap v350: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:51.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:51 smithi107 ceph-mon[79396]: pgmap v351: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:51.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:51 smithi071 ceph-mon[90773]: pgmap v351: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:53 smithi107 ceph-mon[79396]: pgmap v352: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:53.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:53 smithi071 ceph-mon[90773]: pgmap v352: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:54.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:16:54.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:16:55.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:55 smithi107 ceph-mon[79396]: pgmap v353: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:16:55.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:55 smithi071 ceph-mon[90773]: pgmap v353: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:16:57.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:57 smithi107 ceph-mon[79396]: pgmap v354: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:57.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:57 smithi071 ceph-mon[90773]: pgmap v354: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:16:59.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:16:59 smithi107 ceph-mon[79396]: pgmap v355: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:16:59.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:16:59 smithi071 ceph-mon[90773]: pgmap v355: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:01.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:01 smithi107 ceph-mon[79396]: pgmap v356: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:01.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:01 smithi071 ceph-mon[90773]: pgmap v356: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:03.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:03 smithi107 ceph-mon[79396]: pgmap v357: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:03.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:03 smithi071 ceph-mon[90773]: pgmap v357: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:05.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:05 smithi107 ceph-mon[79396]: pgmap v358: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:17:05.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:05 smithi071 ceph-mon[90773]: pgmap v358: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:17:07.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:07 smithi107 ceph-mon[79396]: pgmap v359: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:07.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:07 smithi071 ceph-mon[90773]: pgmap v359: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:09.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:09 smithi107 ceph-mon[79396]: pgmap v360: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:09.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:17:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:09 smithi071 ceph-mon[90773]: pgmap v360: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:17:11.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:11 smithi107 ceph-mon[79396]: pgmap v361: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:11.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:11 smithi071 ceph-mon[90773]: pgmap v361: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:13.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:13 smithi107 ceph-mon[79396]: pgmap v362: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:13.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:13 smithi071 ceph-mon[90773]: pgmap v362: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:15.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:15 smithi107 ceph-mon[79396]: pgmap v363: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:17:15.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:15 smithi071 ceph-mon[90773]: pgmap v363: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:17:17.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:17 smithi107 ceph-mon[79396]: pgmap v364: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:17.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:17 smithi071 ceph-mon[90773]: pgmap v364: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:19.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:19 smithi107 ceph-mon[79396]: pgmap v365: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:19.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:19 smithi071 ceph-mon[90773]: pgmap v365: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:21.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:21 smithi107 ceph-mon[79396]: pgmap v366: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:21.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:21 smithi071 ceph-mon[90773]: pgmap v366: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:23.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:23 smithi107 ceph-mon[79396]: pgmap v367: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:23.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:23 smithi071 ceph-mon[90773]: pgmap v367: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:24.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:17:24.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:17:25.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:25 smithi107 ceph-mon[79396]: pgmap v368: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:17:25.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:25 smithi071 ceph-mon[90773]: pgmap v368: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:17:27.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:27 smithi107 ceph-mon[79396]: pgmap v369: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:27.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:27 smithi071 ceph-mon[90773]: pgmap v369: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:28.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:17:28.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:17:28.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:17:28.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:17:28.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:17:28.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:17:28.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:17:28.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:17:28.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:17:28.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:17:28.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:17:28.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:17:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:29 smithi107 ceph-mon[79396]: pgmap v370: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:29 smithi071 ceph-mon[90773]: pgmap v370: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:31.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:31 smithi107 ceph-mon[79396]: pgmap v371: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:31 smithi071 ceph-mon[90773]: pgmap v371: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:33.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:33 smithi107 ceph-mon[79396]: pgmap v372: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:33.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:33 smithi071 ceph-mon[90773]: pgmap v372: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:35 smithi071 ceph-mon[90773]: pgmap v373: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:17:35.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:35 smithi107 ceph-mon[79396]: pgmap v373: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:17:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:37 smithi071 ceph-mon[90773]: pgmap v374: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:37.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:37 smithi107 ceph-mon[79396]: pgmap v374: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:39 smithi071 ceph-mon[90773]: pgmap v375: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:17:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:39 smithi107 ceph-mon[79396]: pgmap v375: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:17:41.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:41 smithi071 ceph-mon[90773]: pgmap v376: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:41.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:41 smithi107 ceph-mon[79396]: pgmap v376: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:43.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:43 smithi071 ceph-mon[90773]: pgmap v377: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:43.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:43 smithi107 ceph-mon[79396]: pgmap v377: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:45.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:45 smithi071 ceph-mon[90773]: pgmap v378: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:17:45.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:45 smithi107 ceph-mon[79396]: pgmap v378: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:17:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:47 smithi071 ceph-mon[90773]: pgmap v379: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:47.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:47 smithi107 ceph-mon[79396]: pgmap v379: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:49 smithi071 ceph-mon[90773]: pgmap v380: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:49.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:49 smithi107 ceph-mon[79396]: pgmap v380: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:51.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:51 smithi071 ceph-mon[90773]: pgmap v381: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:51.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:51 smithi107 ceph-mon[79396]: pgmap v381: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:53.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:53 smithi071 ceph-mon[90773]: pgmap v382: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:53.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:53 smithi107 ceph-mon[79396]: pgmap v382: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:54.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:17:54.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:17:55.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:55 smithi071 ceph-mon[90773]: pgmap v383: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:17:55.796 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:55 smithi107 ceph-mon[79396]: pgmap v383: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:17:57.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:57 smithi071 ceph-mon[90773]: pgmap v384: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:57.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:57 smithi107 ceph-mon[79396]: pgmap v384: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:17:59.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:17:59 smithi071 ceph-mon[90773]: pgmap v385: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:17:59.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:17:59 smithi107 ceph-mon[79396]: pgmap v385: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:01.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:01 smithi071 ceph-mon[90773]: pgmap v386: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:01.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:01 smithi107 ceph-mon[79396]: pgmap v386: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:03.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:03 smithi071 ceph-mon[90773]: pgmap v387: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:03.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:03 smithi107 ceph-mon[79396]: pgmap v387: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:05 smithi071 ceph-mon[90773]: pgmap v388: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:18:05.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:05 smithi107 ceph-mon[79396]: pgmap v388: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:18:07.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:07 smithi071 ceph-mon[90773]: pgmap v389: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:07.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:07 smithi107 ceph-mon[79396]: pgmap v389: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:09 smithi071 ceph-mon[90773]: pgmap v390: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:18:09.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:09 smithi107 ceph-mon[79396]: pgmap v390: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:09.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:18:11.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:11 smithi071 ceph-mon[90773]: pgmap v391: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:11.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:11 smithi107 ceph-mon[79396]: pgmap v391: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:13.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:13 smithi071 ceph-mon[90773]: pgmap v392: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:13.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:13 smithi107 ceph-mon[79396]: pgmap v392: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:15.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:15 smithi071 ceph-mon[90773]: pgmap v393: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:18:15.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:15 smithi107 ceph-mon[79396]: pgmap v393: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:18:17.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:17 smithi071 ceph-mon[90773]: pgmap v394: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:17 smithi107 ceph-mon[79396]: pgmap v394: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:19.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:19 smithi071 ceph-mon[90773]: pgmap v395: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:19.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:19 smithi107 ceph-mon[79396]: pgmap v395: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:21.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:21 smithi071 ceph-mon[90773]: pgmap v396: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:21.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:21 smithi107 ceph-mon[79396]: pgmap v396: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:23.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:23 smithi071 ceph-mon[90773]: pgmap v397: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:23.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:23 smithi107 ceph-mon[79396]: pgmap v397: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:24.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:18:24.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:18:25.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:25 smithi071 ceph-mon[90773]: pgmap v398: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:18:25.796 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:25 smithi107 ceph-mon[79396]: pgmap v398: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:18:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:27 smithi071 ceph-mon[90773]: pgmap v399: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:27.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:27 smithi107 ceph-mon[79396]: pgmap v399: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:28.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:28 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:18:28.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:28 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:18:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:29 smithi071 ceph-mon[90773]: pgmap v400: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:29 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:18:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:29 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:18:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:29 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:18:29.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:29 smithi107 ceph-mon[79396]: pgmap v400: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:29.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:29 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:18:29.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:29 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:18:29.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:29 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:18:31.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:31 smithi071 ceph-mon[90773]: pgmap v401: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:31.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:31 smithi107 ceph-mon[79396]: pgmap v401: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:33 smithi071 ceph-mon[90773]: pgmap v402: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:33.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:33 smithi107 ceph-mon[79396]: pgmap v402: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:35.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:35 smithi071 ceph-mon[90773]: pgmap v403: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:18:35.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:35 smithi107 ceph-mon[79396]: pgmap v403: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:18:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:37 smithi071 ceph-mon[90773]: pgmap v404: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:37.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:37 smithi107 ceph-mon[79396]: pgmap v404: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:39.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:39 smithi071 ceph-mon[90773]: pgmap v405: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:18:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:39 smithi107 ceph-mon[79396]: pgmap v405: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:18:41.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:41 smithi071 ceph-mon[90773]: pgmap v406: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:41.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:41 smithi107 ceph-mon[79396]: pgmap v406: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:43 smithi071 ceph-mon[90773]: pgmap v407: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:43.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:43 smithi107 ceph-mon[79396]: pgmap v407: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:44.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:44 smithi107 ceph-mon[79396]: pgmap v408: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:18:45.039 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:44 smithi071 ceph-mon[90773]: pgmap v408: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:18:47.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:47 smithi107 ceph-mon[79396]: pgmap v409: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:47 smithi071 ceph-mon[90773]: pgmap v409: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:49.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:49 smithi107 ceph-mon[79396]: pgmap v410: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:49.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:49 smithi071 ceph-mon[90773]: pgmap v410: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:51.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:51 smithi107 ceph-mon[79396]: pgmap v411: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:51.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:51 smithi071 ceph-mon[90773]: pgmap v411: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:53.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:53 smithi107 ceph-mon[79396]: pgmap v412: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:53.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:53 smithi071 ceph-mon[90773]: pgmap v412: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:54.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:18:54.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:18:55.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:55 smithi107 ceph-mon[79396]: pgmap v413: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:18:55.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:55 smithi071 ceph-mon[90773]: pgmap v413: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:18:57.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:57 smithi107 ceph-mon[79396]: pgmap v414: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:57.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:57 smithi071 ceph-mon[90773]: pgmap v414: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:18:59.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:18:59 smithi107 ceph-mon[79396]: pgmap v415: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:18:59.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:18:59 smithi071 ceph-mon[90773]: pgmap v415: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:01.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:01 smithi107 ceph-mon[79396]: pgmap v416: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:01.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:01 smithi071 ceph-mon[90773]: pgmap v416: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:03.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:03 smithi107 ceph-mon[79396]: pgmap v417: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:03.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:03 smithi071 ceph-mon[90773]: pgmap v417: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:05.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:05 smithi107 ceph-mon[79396]: pgmap v418: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:19:05.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:05 smithi071 ceph-mon[90773]: pgmap v418: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:19:07.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:07 smithi107 ceph-mon[79396]: pgmap v419: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:07.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:07 smithi071 ceph-mon[90773]: pgmap v419: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:09.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:09 smithi107 ceph-mon[79396]: pgmap v420: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:09.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:19:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:09 smithi071 ceph-mon[90773]: pgmap v420: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:19:11.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:11 smithi107 ceph-mon[79396]: pgmap v421: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:11.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:11 smithi071 ceph-mon[90773]: pgmap v421: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:13.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:13 smithi071 ceph-mon[90773]: pgmap v422: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:13.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:13 smithi107 ceph-mon[79396]: pgmap v422: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:15.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:15 smithi071 ceph-mon[90773]: pgmap v423: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:19:15.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:15 smithi107 ceph-mon[79396]: pgmap v423: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:19:17.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:17 smithi071 ceph-mon[90773]: pgmap v424: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:17 smithi107 ceph-mon[79396]: pgmap v424: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:19.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:19 smithi071 ceph-mon[90773]: pgmap v425: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:19.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:19 smithi107 ceph-mon[79396]: pgmap v425: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:21.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:21 smithi071 ceph-mon[90773]: pgmap v426: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:21.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:21 smithi107 ceph-mon[79396]: pgmap v426: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:23.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:23 smithi071 ceph-mon[90773]: pgmap v427: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:23.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:23 smithi107 ceph-mon[79396]: pgmap v427: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:24.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:19:24.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:19:25.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:25 smithi071 ceph-mon[90773]: pgmap v428: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:19:25.796 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:25 smithi107 ceph-mon[79396]: pgmap v428: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:19:27.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:27 smithi071 ceph-mon[90773]: pgmap v429: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:27.976 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:27 smithi107 ceph-mon[79396]: pgmap v429: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:29.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:29 smithi071 ceph-mon[90773]: pgmap v430: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:29 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:19:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:29 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:19:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:29 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:19:29.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:29 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:19:29.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:29 smithi107 ceph-mon[79396]: pgmap v430: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:29.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:29 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:19:29.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:29 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:19:29.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:29 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:19:29.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:29 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:19:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:31 smithi071 ceph-mon[90773]: pgmap v431: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:31.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:31 smithi107 ceph-mon[79396]: pgmap v431: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:33.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:33 smithi071 ceph-mon[90773]: pgmap v432: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:33.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:33 smithi107 ceph-mon[79396]: pgmap v432: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:35.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:35 smithi071 ceph-mon[90773]: pgmap v433: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:19:35.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:35 smithi107 ceph-mon[79396]: pgmap v433: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:19:37.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:37 smithi071 ceph-mon[90773]: pgmap v434: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:37.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:37 smithi107 ceph-mon[79396]: pgmap v434: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:39 smithi071 ceph-mon[90773]: pgmap v435: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:19:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:39 smithi107 ceph-mon[79396]: pgmap v435: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:19:41.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:41 smithi071 ceph-mon[90773]: pgmap v436: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:41.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:41 smithi107 ceph-mon[79396]: pgmap v436: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:43.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:43 smithi071 ceph-mon[90773]: pgmap v437: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:43.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:43 smithi107 ceph-mon[79396]: pgmap v437: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:45.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:45 smithi071 ceph-mon[90773]: pgmap v438: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:19:45.897 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:45 smithi107 ceph-mon[79396]: pgmap v438: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:19:47.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:47 smithi071 ceph-mon[90773]: pgmap v439: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:47.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:47 smithi107 ceph-mon[79396]: pgmap v439: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:49 smithi071 ceph-mon[90773]: pgmap v440: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:49.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:49 smithi107 ceph-mon[79396]: pgmap v440: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:51.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:51 smithi071 ceph-mon[90773]: pgmap v441: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:51.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:51 smithi107 ceph-mon[79396]: pgmap v441: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:53.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:53 smithi071 ceph-mon[90773]: pgmap v442: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:53.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:53 smithi107 ceph-mon[79396]: pgmap v442: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:54.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:19:54.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:19:55.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:55 smithi071 ceph-mon[90773]: pgmap v443: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:19:55.796 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:55 smithi107 ceph-mon[79396]: pgmap v443: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:19:57.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:57 smithi071 ceph-mon[90773]: pgmap v444: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:57.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:57 smithi107 ceph-mon[79396]: pgmap v444: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:19:59.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:19:59 smithi071 ceph-mon[90773]: pgmap v445: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:19:59.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:19:59 smithi107 ceph-mon[79396]: pgmap v445: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:00.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:00 smithi071 ceph-mon[90773]: overall HEALTH_OK 2024-09-10T10:20:00.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:00 smithi107 ceph-mon[79396]: overall HEALTH_OK 2024-09-10T10:20:01.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:01 smithi071 ceph-mon[90773]: pgmap v446: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:01.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:01 smithi107 ceph-mon[79396]: pgmap v446: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:03.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:03 smithi071 ceph-mon[90773]: pgmap v447: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:03.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:03 smithi107 ceph-mon[79396]: pgmap v447: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:05.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:05 smithi071 ceph-mon[90773]: pgmap v448: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:20:05.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:05 smithi107 ceph-mon[79396]: pgmap v448: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:20:07.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:07 smithi071 ceph-mon[90773]: pgmap v449: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:07.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:07 smithi107 ceph-mon[79396]: pgmap v449: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:09 smithi071 ceph-mon[90773]: pgmap v450: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:09.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:20:09.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:09 smithi107 ceph-mon[79396]: pgmap v450: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:09.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:20:11.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:11 smithi071 ceph-mon[90773]: pgmap v451: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:11.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:11 smithi107 ceph-mon[79396]: pgmap v451: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:13.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:13 smithi071 ceph-mon[90773]: pgmap v452: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:13.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:13 smithi107 ceph-mon[79396]: pgmap v452: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:15.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:15 smithi071 ceph-mon[90773]: pgmap v453: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:20:15.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:15 smithi107 ceph-mon[79396]: pgmap v453: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:20:17.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:17 smithi071 ceph-mon[90773]: pgmap v454: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:17 smithi107 ceph-mon[79396]: pgmap v454: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:19.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:19 smithi071 ceph-mon[90773]: pgmap v455: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:19.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:19 smithi107 ceph-mon[79396]: pgmap v455: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:21.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:21 smithi071 ceph-mon[90773]: pgmap v456: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:21.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:21 smithi107 ceph-mon[79396]: pgmap v456: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:23.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:23 smithi071 ceph-mon[90773]: pgmap v457: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:23.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:23 smithi107 ceph-mon[79396]: pgmap v457: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:24.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:24 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:20:24.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:24 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:20:25.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:25 smithi071 ceph-mon[90773]: pgmap v458: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:20:25.796 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:25 smithi107 ceph-mon[79396]: pgmap v458: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:20:26.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:26 smithi071 ceph-mon[90773]: pgmap v459: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:26.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:26 smithi107 ceph-mon[79396]: pgmap v459: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:29.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:29 smithi107 ceph-mon[79396]: pgmap v460: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:29.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:29 smithi071 ceph-mon[90773]: pgmap v460: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:30.538 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:20:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:20:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:20:30.539 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:30 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:20:30.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:20:30.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:20:30.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:20:30.646 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:30 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' 2024-09-10T10:20:31.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:31 smithi107 ceph-mon[79396]: pgmap v461: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:31.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:31 smithi071 ceph-mon[90773]: pgmap v461: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:33.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:33 smithi107 ceph-mon[79396]: pgmap v462: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:33.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:33 smithi071 ceph-mon[90773]: pgmap v462: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:35.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:35 smithi107 ceph-mon[79396]: pgmap v463: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:20:35.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:35 smithi071 ceph-mon[90773]: pgmap v463: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:20:37.645 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:37 smithi107 ceph-mon[79396]: pgmap v464: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:37.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:37 smithi071 ceph-mon[90773]: pgmap v464: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:39 smithi071 ceph-mon[90773]: pgmap v465: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:39.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:39 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:20:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:39 smithi107 ceph-mon[79396]: pgmap v465: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:39.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:39 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:20:41.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:41 smithi071 ceph-mon[90773]: pgmap v466: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:41.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:41 smithi107 ceph-mon[79396]: pgmap v466: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:43.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:43 smithi071 ceph-mon[90773]: pgmap v467: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:43.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:43 smithi107 ceph-mon[79396]: pgmap v467: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:45.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:45 smithi071 ceph-mon[90773]: pgmap v468: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:20:45.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:45 smithi107 ceph-mon[79396]: pgmap v468: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:20:47.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:47 smithi071 ceph-mon[90773]: pgmap v469: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:47.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:47 smithi107 ceph-mon[79396]: pgmap v469: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:49.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:49 smithi071 ceph-mon[90773]: pgmap v470: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:49.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:49 smithi107 ceph-mon[79396]: pgmap v470: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:51.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:51 smithi071 ceph-mon[90773]: pgmap v471: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:51.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:51 smithi107 ceph-mon[79396]: pgmap v471: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:53.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:53 smithi071 ceph-mon[90773]: pgmap v472: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:53.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:53 smithi107 ceph-mon[79396]: pgmap v472: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:54.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:54 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:20:54.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:54 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:20:55.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:55 smithi071 ceph-mon[90773]: pgmap v473: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:20:55.796 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:55 smithi107 ceph-mon[79396]: pgmap v473: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:20:57.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:57 smithi071 ceph-mon[90773]: pgmap v474: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:57.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:57 smithi107 ceph-mon[79396]: pgmap v474: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:20:59.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:20:59 smithi071 ceph-mon[90773]: pgmap v475: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:20:59.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:20:59 smithi107 ceph-mon[79396]: pgmap v475: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:21:01.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:01 smithi071 ceph-mon[90773]: pgmap v476: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:21:01.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:01 smithi107 ceph-mon[79396]: pgmap v476: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:21:03.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:03 smithi071 ceph-mon[90773]: pgmap v477: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:21:03.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:03 smithi107 ceph-mon[79396]: pgmap v477: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:21:05.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:05 smithi071 ceph-mon[90773]: pgmap v478: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:21:05.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:05 smithi107 ceph-mon[79396]: pgmap v478: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:21:07.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:07 smithi071 ceph-mon[90773]: pgmap v479: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:21:07.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:07 smithi107 ceph-mon[79396]: pgmap v479: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:21:09.792 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:09 smithi071 ceph-mon[90773]: pgmap v480: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:21:09.792 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:09 smithi071 ceph-mon[90773]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:21:09.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:09 smithi107 ceph-mon[79396]: pgmap v480: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:21:09.896 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:09 smithi107 ceph-mon[79396]: from='mgr.34104 172.21.15.71:0/3222583834' entity='mgr.smithi071.gtqytr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T10:21:11.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:11 smithi071 ceph-mon[90773]: pgmap v481: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:21:11.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:11 smithi107 ceph-mon[79396]: pgmap v481: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:21:13.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:13 smithi071 ceph-mon[90773]: pgmap v482: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:21:13.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:13 smithi107 ceph-mon[79396]: pgmap v482: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:21:15.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:15 smithi071 ceph-mon[90773]: pgmap v483: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:21:15.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:15 smithi107 ceph-mon[79396]: pgmap v483: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-10T10:21:17.789 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:17 smithi071 ceph-mon[90773]: pgmap v484: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:21:17.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:17 smithi107 ceph-mon[79396]: pgmap v484: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-10T10:21:19.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:19 smithi071 ceph-mon[90773]: pgmap v485: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:21:19.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:19 smithi107 ceph-mon[79396]: pgmap v485: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:21:21.788 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:21 smithi071 ceph-mon[90773]: pgmap v486: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:21:21.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:21 smithi107 ceph-mon[79396]: pgmap v486: 65 pgs: 65 active+clean; 138 MiB data, 645 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-10T10:21:21.959 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-10T10:21:21.959 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-10T10:21:21.961 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T10:21:21.973 INFO:tasks.cephadm:Teardown begin 2024-09-10T10:21:21.973 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-10T10:21:21.974 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:21:22.008 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:21:22.041 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T10:21:22.042 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T10:21:22.067 DEBUG:teuthology.orchestra.run.smithi107:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T10:21:22.099 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T10:21:22.100 INFO:tasks.cephadm.mon.smithi071:Stopping mon.smithi071... 2024-09-10T10:21:22.100 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi071 2024-09-10T10:21:22.289 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:22 smithi071 systemd[1]: Stopping Ceph mon.smithi071 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:21:22.658 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:22 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071[90769]: 2024-09-10T10:21:22.414+0000 7f6851880640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi071 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:21:22.658 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:22 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071[90769]: 2024-09-10T10:21:22.414+0000 7f6851880640 -1 mon.smithi071@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T10:21:22.658 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:22 smithi071 podman[148818]: 2024-09-10 10:21:22.476212594 +0000 UTC m=+0.171477680 container died 97acff91c24f4b98c57570c1fead91cc7d7de9255b4c7cae256efcd21d150f37 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T10:21:23.273 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:22 smithi071 podman[148818]: 2024-09-10 10:21:22.923337695 +0000 UTC m=+0.618602771 container cleanup 97acff91c24f4b98c57570c1fead91cc7d7de9255b4c7cae256efcd21d150f37 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux ) 2024-09-10T10:21:23.273 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:22 smithi071 bash[148818]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071 2024-09-10T10:21:23.274 INFO:journalctl@ceph.mon.smithi071.smithi071.stdout:Sep 10 10:21:23 smithi071 podman[148829]: 2024-09-10 10:21:23.07496326 +0000 UTC m=+0.599227511 container remove 97acff91c24f4b98c57570c1fead91cc7d7de9255b4c7cae256efcd21d150f37 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi071, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0) 2024-09-10T10:21:23.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi071.service' 2024-09-10T10:21:23.330 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:21:23.330 INFO:tasks.cephadm.mon.smithi071:Stopped mon.smithi071 2024-09-10T10:21:23.331 INFO:tasks.cephadm.mon.smithi107:Stopping mon.smithi107... 2024-09-10T10:21:23.331 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi107 2024-09-10T10:21:23.625 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:23 smithi107 systemd[1]: Stopping Ceph mon.smithi107 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:21:23.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:23 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107[79392]: 2024-09-10T10:21:23.624+0000 7f05e53f1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi107 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:21:23.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:23 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107[79392]: 2024-09-10T10:21:23.624+0000 7f05e53f1640 -1 mon.smithi107@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T10:21:23.895 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:23 smithi107 podman[116242]: 2024-09-10 10:21:23.808568087 +0000 UTC m=+0.281165703 container died c2f3cc873b797044a5cf58e6b5d87eea6e269cbf329185f06b1da54d13fb99c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-10T10:21:24.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:24 smithi107 podman[116242]: 2024-09-10 10:21:24.316954238 +0000 UTC m=+0.789551855 container cleanup c2f3cc873b797044a5cf58e6b5d87eea6e269cbf329185f06b1da54d13fb99c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T10:21:24.395 INFO:journalctl@ceph.mon.smithi107.smithi107.stdout:Sep 10 10:21:24 smithi107 bash[116242]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-mon-smithi107 2024-09-10T10:21:24.738 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@mon.smithi107.service' 2024-09-10T10:21:24.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:21:24.786 INFO:tasks.cephadm.mon.smithi107:Stopped mon.smithi107 2024-09-10T10:21:24.786 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T10:21:24.786 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.0 2024-09-10T10:21:25.078 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:24 smithi071 systemd[1]: Stopping Ceph osd.0 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:21:25.539 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:25 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0[99288]: 2024-09-10T10:21:25.076+0000 7fd11b572640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:21:25.539 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:25 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0[99288]: 2024-09-10T10:21:25.076+0000 7fd11b572640 -1 osd.0 83 *** Got signal Terminated *** 2024-09-10T10:21:25.539 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:25 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0[99288]: 2024-09-10T10:21:25.076+0000 7fd11b572640 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:21:30.755 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:30 smithi071 podman[148951]: 2024-09-10 10:21:30.464211229 +0000 UTC m=+5.479984825 container died f1e9da1144c1afa06905ce2a8191338e457c22dcadd7f799d40213675bbc94cd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T10:21:31.039 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:30 smithi071 podman[148951]: 2024-09-10 10:21:30.852114213 +0000 UTC m=+5.867887810 container cleanup f1e9da1144c1afa06905ce2a8191338e457c22dcadd7f799d40213675bbc94cd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T10:21:31.039 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:30 smithi071 bash[148951]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0 2024-09-10T10:21:31.476 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:31 smithi071 podman[148968]: 2024-09-10 10:21:31.128562443 +0000 UTC m=+0.659273985 container remove f1e9da1144c1afa06905ce2a8191338e457c22dcadd7f799d40213675bbc94cd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:21:31.728 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:31 smithi071 podman[149059]: 2024-09-10 10:21:31.378765312 +0000 UTC m=+0.016802462 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:21:31.728 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:31 smithi071 podman[149059]: 2024-09-10 10:21:31.491479912 +0000 UTC m=+0.129517104 container create 81d5b301aad6d1b279076760df0cffe2a3bc83b7406b385a796b08a4e668b535 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T10:21:31.728 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:31 smithi071 podman[149059]: 2024-09-10 10:21:31.724027136 +0000 UTC m=+0.362064291 container init 81d5b301aad6d1b279076760df0cffe2a3bc83b7406b385a796b08a4e668b535 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-10T10:21:32.039 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:31 smithi071 podman[149059]: 2024-09-10 10:21:31.72733474 +0000 UTC m=+0.365371892 container start 81d5b301aad6d1b279076760df0cffe2a3bc83b7406b385a796b08a4e668b535 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T10:21:32.039 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:31 smithi071 podman[149059]: 2024-09-10 10:21:31.807187787 +0000 UTC m=+0.445224941 container attach 81d5b301aad6d1b279076760df0cffe2a3bc83b7406b385a796b08a4e668b535 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:21:32.039 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 10 10:21:31 smithi071 podman[149059]: 2024-09-10 10:21:31.919513969 +0000 UTC m=+0.557551116 container died 81d5b301aad6d1b279076760df0cffe2a3bc83b7406b385a796b08a4e668b535 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:21:32.625 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T10:21:32.666 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:21:32.666 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T10:21:32.666 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T10:21:32.666 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.1 2024-09-10T10:21:32.883 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:32 smithi071 systemd[1]: Stopping Ceph osd.1 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:21:33.288 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:32 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1[104636]: 2024-09-10T10:21:32.987+0000 7fd150f7e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:21:33.289 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:32 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1[104636]: 2024-09-10T10:21:32.987+0000 7fd150f7e640 -1 osd.1 83 *** Got signal Terminated *** 2024-09-10T10:21:33.289 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:32 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1[104636]: 2024-09-10T10:21:32.987+0000 7fd150f7e640 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:21:38.789 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:38 smithi071 podman[149162]: 2024-09-10 10:21:38.53387566 +0000 UTC m=+5.641248479 container died 5afc8bef534339d4527db13901d2784cd9c36db1c1100c49fe975e7080709662 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:21:39.190 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:38 smithi071 podman[149162]: 2024-09-10 10:21:38.888795532 +0000 UTC m=+5.996168348 container cleanup 5afc8bef534339d4527db13901d2784cd9c36db1c1100c49fe975e7080709662 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T10:21:39.190 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:38 smithi071 bash[149162]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1 2024-09-10T10:21:39.516 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:39 smithi071 podman[149187]: 2024-09-10 10:21:39.18998945 +0000 UTC m=+0.653733134 container remove 5afc8bef534339d4527db13901d2784cd9c36db1c1100c49fe975e7080709662 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T10:21:39.777 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:39 smithi071 podman[149278]: 2024-09-10 10:21:39.418679329 +0000 UTC m=+0.015929564 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:21:39.777 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:39 smithi071 podman[149278]: 2024-09-10 10:21:39.532566912 +0000 UTC m=+0.129817143 container create dae1bdf785ea88711d619ce7387d9864e42256ad0746a6842baf12d4458fac28 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2) 2024-09-10T10:21:39.777 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:39 smithi071 podman[149278]: 2024-09-10 10:21:39.776987923 +0000 UTC m=+0.374238163 container init dae1bdf785ea88711d619ce7387d9864e42256ad0746a6842baf12d4458fac28 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-10T10:21:40.039 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:39 smithi071 podman[149278]: 2024-09-10 10:21:39.78084738 +0000 UTC m=+0.378097610 container start dae1bdf785ea88711d619ce7387d9864e42256ad0746a6842baf12d4458fac28 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T10:21:40.039 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:39 smithi071 podman[149278]: 2024-09-10 10:21:39.885107226 +0000 UTC m=+0.482357460 container attach dae1bdf785ea88711d619ce7387d9864e42256ad0746a6842baf12d4458fac28 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:21:40.039 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 10 10:21:39 smithi071 podman[149278]: 2024-09-10 10:21:39.971259594 +0000 UTC m=+0.568509825 container died dae1bdf785ea88711d619ce7387d9864e42256ad0746a6842baf12d4458fac28 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T10:21:40.587 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T10:21:40.629 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:21:40.629 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T10:21:40.630 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T10:21:40.630 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.2 2024-09-10T10:21:40.959 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:40 smithi071 systemd[1]: Stopping Ceph osd.2 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:21:41.288 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:40 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2[110012]: 2024-09-10T10:21:40.957+0000 7fb6f82db640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:21:41.289 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:40 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2[110012]: 2024-09-10T10:21:40.957+0000 7fb6f82db640 -1 osd.2 83 *** Got signal Terminated *** 2024-09-10T10:21:41.289 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:40 smithi071 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2[110012]: 2024-09-10T10:21:40.957+0000 7fb6f82db640 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:21:46.777 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:46 smithi071 podman[149382]: 2024-09-10 10:21:46.452856201 +0000 UTC m=+5.599308031 container died 5e5976fcfaa81727e959c26080e1594e5c70fe50c6f5c56dfcdddafccdaa9737 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T10:21:47.041 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:46 smithi071 podman[149382]: 2024-09-10 10:21:46.874459983 +0000 UTC m=+6.020911806 container cleanup 5e5976fcfaa81727e959c26080e1594e5c70fe50c6f5c56dfcdddafccdaa9737 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T10:21:47.041 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:46 smithi071 bash[149382]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2 2024-09-10T10:21:47.483 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:47 smithi071 podman[149398]: 2024-09-10 10:21:47.083897471 +0000 UTC m=+0.623056864 container remove 5e5976fcfaa81727e959c26080e1594e5c70fe50c6f5c56dfcdddafccdaa9737 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2) 2024-09-10T10:21:47.735 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:47 smithi071 podman[149486]: 2024-09-10 10:21:47.385545811 +0000 UTC m=+0.016520998 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:21:47.735 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:47 smithi071 podman[149486]: 2024-09-10 10:21:47.502590123 +0000 UTC m=+0.133565347 container create 9528782b5c1447d2f6cbe82c02ac507fa2dec2549746c0a6211c379c000cf9ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T10:21:47.735 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:47 smithi071 podman[149486]: 2024-09-10 10:21:47.734350676 +0000 UTC m=+0.365325858 container init 9528782b5c1447d2f6cbe82c02ac507fa2dec2549746c0a6211c379c000cf9ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T10:21:48.038 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:47 smithi071 podman[149486]: 2024-09-10 10:21:47.73786882 +0000 UTC m=+0.368844005 container start 9528782b5c1447d2f6cbe82c02ac507fa2dec2549746c0a6211c379c000cf9ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T10:21:48.039 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:47 smithi071 podman[149486]: 2024-09-10 10:21:47.812293855 +0000 UTC m=+0.443269062 container attach 9528782b5c1447d2f6cbe82c02ac507fa2dec2549746c0a6211c379c000cf9ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-10T10:21:48.039 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 10 10:21:47 smithi071 podman[149486]: 2024-09-10 10:21:47.935602108 +0000 UTC m=+0.566577295 container died 9528782b5c1447d2f6cbe82c02ac507fa2dec2549746c0a6211c379c000cf9ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T10:21:48.596 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T10:21:48.637 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:21:48.637 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T10:21:48.637 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T10:21:48.637 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.3 2024-09-10T10:21:48.935 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:48 smithi107 systemd[1]: Stopping Ceph osd.3 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:21:49.388 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:48 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[88740]: 2024-09-10T10:21:48.934+0000 7f5d60acd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:21:49.388 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:48 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[88740]: 2024-09-10T10:21:48.934+0000 7f5d60acd640 -1 osd.3 83 *** Got signal Terminated *** 2024-09-10T10:21:49.388 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:48 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[88740]: 2024-09-10T10:21:48.934+0000 7f5d60acd640 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:21:51.312 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:21:51 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:21:51.058+0000 7fe656153640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:26.075672+0000 front 2024-09-10T10:21:26.075548+0000 (oldest deadline 2024-09-10T10:21:50.775474+0000) 2024-09-10T10:21:51.645 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:21:51 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:21:51.311+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:21:51.646 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:51 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[88740]: 2024-09-10T10:21:51.371+0000 7f5d590ca640 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:28.283066+0000 front 2024-09-10T10:21:28.283262+0000 (oldest deadline 2024-09-10T10:21:51.182885+0000) 2024-09-10T10:21:52.371 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:21:52 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:21:52.295+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:21:52.371 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:21:52 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:21:52.047+0000 7fe656153640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:26.075672+0000 front 2024-09-10T10:21:26.075548+0000 (oldest deadline 2024-09-10T10:21:50.775474+0000) 2024-09-10T10:21:52.645 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:52 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[88740]: 2024-09-10T10:21:52.370+0000 7f5d590ca640 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:28.283066+0000 front 2024-09-10T10:21:28.283262+0000 (oldest deadline 2024-09-10T10:21:51.182885+0000) 2024-09-10T10:21:53.322 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:21:53 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:21:53.008+0000 7fe656153640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:26.075672+0000 front 2024-09-10T10:21:26.075548+0000 (oldest deadline 2024-09-10T10:21:50.775474+0000) 2024-09-10T10:21:53.645 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:21:53 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:21:53.321+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:21:53.645 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:53 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3[88740]: 2024-09-10T10:21:53.368+0000 7f5d590ca640 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:28.283066+0000 front 2024-09-10T10:21:28.283262+0000 (oldest deadline 2024-09-10T10:21:51.182885+0000) 2024-09-10T10:21:54.315 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:21:54 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:21:54.050+0000 7fe656153640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:26.075672+0000 front 2024-09-10T10:21:26.075548+0000 (oldest deadline 2024-09-10T10:21:50.775474+0000) 2024-09-10T10:21:54.645 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:21:54 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:21:54.313+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:21:54.646 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:54 smithi107 podman[116363]: 2024-09-10 10:21:54.461425911 +0000 UTC m=+5.629271964 container died e22ee626ccd010f75e29a705f624a1c29db3da771140f5b570409258df028908 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T10:21:55.087 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:54 smithi107 podman[116363]: 2024-09-10 10:21:54.826871 +0000 UTC m=+5.994717023 container cleanup e22ee626ccd010f75e29a705f624a1c29db3da771140f5b570409258df028908 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T10:21:55.088 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:54 smithi107 bash[116363]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3 2024-09-10T10:21:55.395 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:21:55 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:21:55.100+0000 7fe656153640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:26.075672+0000 front 2024-09-10T10:21:26.075548+0000 (oldest deadline 2024-09-10T10:21:50.775474+0000) 2024-09-10T10:21:55.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:21:55 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:21:55.268+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:21:55.396 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:55 smithi107 podman[116392]: 2024-09-10 10:21:55.086434861 +0000 UTC m=+0.618460791 container remove e22ee626ccd010f75e29a705f624a1c29db3da771140f5b570409258df028908 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:21:55.757 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:55 smithi107 podman[116483]: 2024-09-10 10:21:55.437471352 +0000 UTC m=+0.109025002 container create c0865019787db60729edb23fccdbf36ba52dc879befc6553f0a634ee93e155d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T10:21:55.757 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:55 smithi107 podman[116483]: 2024-09-10 10:21:55.344195272 +0000 UTC m=+0.015748879 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:21:55.757 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:55 smithi107 podman[116483]: 2024-09-10 10:21:55.681456954 +0000 UTC m=+0.353010561 container init c0865019787db60729edb23fccdbf36ba52dc879befc6553f0a634ee93e155d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:21:55.757 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:55 smithi107 podman[116483]: 2024-09-10 10:21:55.684699997 +0000 UTC m=+0.356253603 container start c0865019787db60729edb23fccdbf36ba52dc879befc6553f0a634ee93e155d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T10:21:55.757 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:55 smithi107 podman[116483]: 2024-09-10 10:21:55.756480317 +0000 UTC m=+0.428033936 container attach c0865019787db60729edb23fccdbf36ba52dc879befc6553f0a634ee93e155d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:21:56.072 INFO:journalctl@ceph.osd.3.smithi107.stdout:Sep 10 10:21:55 smithi107 podman[116483]: 2024-09-10 10:21:55.877770964 +0000 UTC m=+0.549324574 container died c0865019787db60729edb23fccdbf36ba52dc879befc6553f0a634ee93e155d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T10:21:56.396 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:21:56 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:21:56.070+0000 7fe656153640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:26.075672+0000 front 2024-09-10T10:21:26.075548+0000 (oldest deadline 2024-09-10T10:21:50.775474+0000) 2024-09-10T10:21:56.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:21:56 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:21:56.219+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:21:56.438 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T10:21:56.478 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:21:56.479 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T10:21:56.479 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T10:21:56.479 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.4 2024-09-10T10:21:56.806 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:21:56 smithi107 systemd[1]: Stopping Ceph osd.4 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:21:57.145 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:21:56 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:21:56.803+0000 7fe659b4e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:21:57.145 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:21:56 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:21:56.803+0000 7fe659b4e640 -1 osd.4 83 *** Got signal Terminated *** 2024-09-10T10:21:57.145 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:21:56 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:21:56.803+0000 7fe659b4e640 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:21:57.146 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:21:57 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:21:57.033+0000 7fe656153640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:26.075672+0000 front 2024-09-10T10:21:26.075548+0000 (oldest deadline 2024-09-10T10:21:50.775474+0000) 2024-09-10T10:21:57.645 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:21:57 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:21:57.179+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:21:58.395 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:21:58 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:21:58.083+0000 7fe656153640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:26.075672+0000 front 2024-09-10T10:21:26.075548+0000 (oldest deadline 2024-09-10T10:21:50.775474+0000) 2024-09-10T10:21:58.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:21:58 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:21:58.222+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:21:59.395 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:21:59 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:21:59.099+0000 7fe656153640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:26.075672+0000 front 2024-09-10T10:21:26.075548+0000 (oldest deadline 2024-09-10T10:21:50.775474+0000) 2024-09-10T10:21:59.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:21:59 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:21:59.193+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:21:59.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:21:59 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:21:59.193+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6814 osd.1 since back 2024-09-10T10:21:37.587101+0000 front 2024-09-10T10:21:37.587144+0000 (oldest deadline 2024-09-10T10:21:58.687102+0000) 2024-09-10T10:22:00.395 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:22:00 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:22:00.142+0000 7fe656153640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:26.075672+0000 front 2024-09-10T10:21:26.075548+0000 (oldest deadline 2024-09-10T10:21:50.775474+0000) 2024-09-10T10:22:00.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:00 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:00.219+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:22:00.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:00 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:00.219+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6814 osd.1 since back 2024-09-10T10:21:37.587101+0000 front 2024-09-10T10:21:37.587144+0000 (oldest deadline 2024-09-10T10:21:58.687102+0000) 2024-09-10T10:22:01.645 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:22:01 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4[93584]: 2024-09-10T10:22:01.174+0000 7fe656153640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:26.075672+0000 front 2024-09-10T10:21:26.075548+0000 (oldest deadline 2024-09-10T10:21:50.775474+0000) 2024-09-10T10:22:01.646 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:01 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:01.255+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:22:01.646 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:01 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:01.255+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6814 osd.1 since back 2024-09-10T10:21:37.587101+0000 front 2024-09-10T10:21:37.587144+0000 (oldest deadline 2024-09-10T10:21:58.687102+0000) 2024-09-10T10:22:02.395 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:22:02 smithi107 podman[116586]: 2024-09-10 10:22:02.126488443 +0000 UTC m=+5.429475510 container died e92f23ad2c773e0afc75a67e0813420bffacc244b43a5f0ae009cbe410bc989c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T10:22:02.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:02 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:02.227+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:22:02.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:02 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:02.227+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6814 osd.1 since back 2024-09-10T10:21:37.587101+0000 front 2024-09-10T10:21:37.587144+0000 (oldest deadline 2024-09-10T10:21:58.687102+0000) 2024-09-10T10:22:02.748 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:22:02 smithi107 podman[116586]: 2024-09-10 10:22:02.521109392 +0000 UTC m=+5.824096462 container cleanup e92f23ad2c773e0afc75a67e0813420bffacc244b43a5f0ae009cbe410bc989c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T10:22:02.748 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:22:02 smithi107 bash[116586]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4 2024-09-10T10:22:03.057 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:22:02 smithi107 podman[116603]: 2024-09-10 10:22:02.747481359 +0000 UTC m=+0.614810067 container remove e92f23ad2c773e0afc75a67e0813420bffacc244b43a5f0ae009cbe410bc989c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:22:03.393 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:03 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:03.202+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:22:03.393 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:03 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:03.202+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6814 osd.1 since back 2024-09-10T10:21:37.587101+0000 front 2024-09-10T10:21:37.587144+0000 (oldest deadline 2024-09-10T10:21:58.687102+0000) 2024-09-10T10:22:03.393 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:22:03 smithi107 podman[116695]: 2024-09-10 10:22:03.056687785 +0000 UTC m=+0.104169230 container create 2c0889dec4a8efa4d3cf505c51f331b28075367b9664f4111d0acb4194bb4a89 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:22:03.394 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:22:03 smithi107 podman[116695]: 2024-09-10 10:22:02.967983179 +0000 UTC m=+0.015464640 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:22:03.394 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:22:03 smithi107 podman[116695]: 2024-09-10 10:22:03.301209514 +0000 UTC m=+0.348690959 container init 2c0889dec4a8efa4d3cf505c51f331b28075367b9664f4111d0acb4194bb4a89 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:22:03.394 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:22:03 smithi107 podman[116695]: 2024-09-10 10:22:03.304512957 +0000 UTC m=+0.351994404 container start 2c0889dec4a8efa4d3cf505c51f331b28075367b9664f4111d0acb4194bb4a89 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T10:22:03.394 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:22:03 smithi107 podman[116695]: 2024-09-10 10:22:03.392673664 +0000 UTC m=+0.440155119 container attach 2c0889dec4a8efa4d3cf505c51f331b28075367b9664f4111d0acb4194bb4a89 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T10:22:03.646 INFO:journalctl@ceph.osd.4.smithi107.stdout:Sep 10 10:22:03 smithi107 podman[116695]: 2024-09-10 10:22:03.491218333 +0000 UTC m=+0.538699781 container died 2c0889dec4a8efa4d3cf505c51f331b28075367b9664f4111d0acb4194bb4a89 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:22:04.053 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T10:22:04.094 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:22:04.094 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T10:22:04.094 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T10:22:04.094 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.5 2024-09-10T10:22:04.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:04 smithi107 systemd[1]: Stopping Ceph osd.5 for 9dae8622-6f5a-11ef-bcea-c7b262605968... 2024-09-10T10:22:04.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:04 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:04.180+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:22:04.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:04 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:04.180+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6814 osd.1 since back 2024-09-10T10:21:37.587101+0000 front 2024-09-10T10:21:37.587144+0000 (oldest deadline 2024-09-10T10:21:58.687102+0000) 2024-09-10T10:22:04.895 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:04 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:04.429+0000 7f9088fdc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:22:04.895 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:04 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:04.429+0000 7f9088fdc640 -1 osd.5 83 *** Got signal Terminated *** 2024-09-10T10:22:04.896 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:04 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:04.429+0000 7f9088fdc640 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:22:05.645 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:05 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:05.206+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:22:05.646 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:05 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:05.206+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6814 osd.1 since back 2024-09-10T10:21:37.587101+0000 front 2024-09-10T10:21:37.587144+0000 (oldest deadline 2024-09-10T10:21:58.687102+0000) 2024-09-10T10:22:06.493 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:06 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:06.182+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:22:06.493 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:06 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:06.182+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6814 osd.1 since back 2024-09-10T10:21:37.587101+0000 front 2024-09-10T10:21:37.587144+0000 (oldest deadline 2024-09-10T10:21:58.687102+0000) 2024-09-10T10:22:07.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:07 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:07.139+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:22:07.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:07 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:07.139+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6814 osd.1 since back 2024-09-10T10:21:37.587101+0000 front 2024-09-10T10:21:37.587144+0000 (oldest deadline 2024-09-10T10:21:58.687102+0000) 2024-09-10T10:22:07.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:07 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:07.139+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6822 osd.2 since back 2024-09-10T10:21:44.588001+0000 front 2024-09-10T10:21:44.588015+0000 (oldest deadline 2024-09-10T10:22:06.887941+0000) 2024-09-10T10:22:08.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:08 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:08.114+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:22:08.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:08 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:08.114+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6814 osd.1 since back 2024-09-10T10:21:37.587101+0000 front 2024-09-10T10:21:37.587144+0000 (oldest deadline 2024-09-10T10:21:58.687102+0000) 2024-09-10T10:22:08.396 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:08 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:08.114+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6822 osd.2 since back 2024-09-10T10:21:44.588001+0000 front 2024-09-10T10:21:44.588015+0000 (oldest deadline 2024-09-10T10:22:06.887941+0000) 2024-09-10T10:22:09.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:09 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:09.127+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6806 osd.0 since back 2024-09-10T10:21:24.884964+0000 front 2024-09-10T10:21:24.884913+0000 (oldest deadline 2024-09-10T10:21:50.685218+0000) 2024-09-10T10:22:09.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:09 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:09.127+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6814 osd.1 since back 2024-09-10T10:21:37.587101+0000 front 2024-09-10T10:21:37.587144+0000 (oldest deadline 2024-09-10T10:21:58.687102+0000) 2024-09-10T10:22:09.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:09 smithi107 ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5[98870]: 2024-09-10T10:22:09.127+0000 7f90855e1640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.71:6822 osd.2 since back 2024-09-10T10:21:44.588001+0000 front 2024-09-10T10:21:44.588015+0000 (oldest deadline 2024-09-10T10:22:06.887941+0000) 2024-09-10T10:22:10.092 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:09 smithi107 podman[116798]: 2024-09-10 10:22:09.832212932 +0000 UTC m=+5.516424449 container died 3440ee1c721ec21914d35b843b4d8dfff13653127ebeda2a619ca920f7c90dbd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T10:22:10.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:10 smithi107 podman[116798]: 2024-09-10 10:22:10.190770485 +0000 UTC m=+5.874982001 container cleanup 3440ee1c721ec21914d35b843b4d8dfff13653127ebeda2a619ca920f7c90dbd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T10:22:10.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:10 smithi107 bash[116798]: ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5 2024-09-10T10:22:10.800 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:10 smithi107 podman[116815]: 2024-09-10 10:22:10.475422144 +0000 UTC m=+0.640438757 container remove 3440ee1c721ec21914d35b843b4d8dfff13653127ebeda2a619ca920f7c90dbd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T10:22:11.120 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:10 smithi107 podman[116904]: 2024-09-10 10:22:10.70298619 +0000 UTC m=+0.015839746 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:22:11.121 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:10 smithi107 podman[116904]: 2024-09-10 10:22:10.80121365 +0000 UTC m=+0.114067206 container create b71f0d05e43d7e63715265c90f7c3c60881dbc07c96d5737018a60e1d04ab4c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T10:22:11.121 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:11 smithi107 podman[116904]: 2024-09-10 10:22:11.037091646 +0000 UTC m=+0.349945201 container init b71f0d05e43d7e63715265c90f7c3c60881dbc07c96d5737018a60e1d04ab4c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T10:22:11.121 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:11 smithi107 podman[116904]: 2024-09-10 10:22:11.040334085 +0000 UTC m=+0.353187646 container start b71f0d05e43d7e63715265c90f7c3c60881dbc07c96d5737018a60e1d04ab4c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:22:11.121 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:11 smithi107 podman[116904]: 2024-09-10 10:22:11.120351847 +0000 UTC m=+0.433205403 container attach b71f0d05e43d7e63715265c90f7c3c60881dbc07c96d5737018a60e1d04ab4c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:22:11.395 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:11 smithi107 podman[116904]: 2024-09-10 10:22:11.224478452 +0000 UTC m=+0.537332009 container died b71f0d05e43d7e63715265c90f7c3c60881dbc07c96d5737018a60e1d04ab4c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:22:11.760 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 10 10:22:11 smithi107 podman[116927]: 2024-09-10 10:22:11.748969884 +0000 UTC m=+0.518171746 container remove b71f0d05e43d7e63715265c90f7c3c60881dbc07c96d5737018a60e1d04ab4c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-9dae8622-6f5a-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2) 2024-09-10T10:22:11.765 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9dae8622-6f5a-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T10:22:11.802 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:22:11.803 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T10:22:11.803 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T10:22:14.967 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[73967]: fuse finished with error 0 and tester_r 0 2024-09-10T10:22:35.003 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T10:22:46.980 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:22:47.010 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:22:47.038 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T10:22:47.041 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899010/remote/smithi071/crash 2024-09-10T10:22:47.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/crash -- . 2024-09-10T10:22:47.075 INFO:teuthology.orchestra.run.smithi071.stderr:tar: /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T10:22:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:tar: Error is not recoverable: exiting now 2024-09-10T10:22:47.078 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899010/remote/smithi107/crash 2024-09-10T10:22:47.079 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/crash -- . 2024-09-10T10:22:47.102 INFO:teuthology.orchestra.run.smithi107.stderr:tar: /var/lib/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T10:22:47.102 INFO:teuthology.orchestra.run.smithi107.stderr:tar: Error is not recoverable: exiting now 2024-09-10T10:22:47.103 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T10:22:47.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-10T10:22:47.155 INFO:teuthology.orchestra.run.smithi071.stdout:2024-09-10T10:10:00.000225+0000 mon.smithi071 (mon.0) 434 : cluster [WRN] osd.4 (root=default,host=smithi107) is down 2024-09-10T10:22:47.155 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-10T10:22:47.155 INFO:tasks.cephadm:Compressing logs... 2024-09-10T10:22:47.155 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T10:22:47.198 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T10:22:47.220 INFO:teuthology.orchestra.run.smithi071.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T10:22:47.220 INFO:teuthology.orchestra.run.smithi071.stderr:: No such file or directory 2024-09-10T10:22:47.220 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T10:22:47.221 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T10:22:47.221 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mon.smithi071.log 2024-09-10T10:22:47.222 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T10:22:47.222 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mon.smithi071.log: gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T10:22:47.222 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi071.omoqqq.log 2024-09-10T10:22:47.222 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T10:22:47.226 INFO:teuthology.orchestra.run.smithi107.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi107.nycoxn.log 2024-09-10T10:22:47.226 INFO:teuthology.orchestra.run.smithi107.stderr:: No such file or directory 2024-09-10T10:22:47.226 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T10:22:47.226 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T10:22:47.226 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi107.nycoxn.log: /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T10:22:47.226 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mon.smithi107.log 2024-09-10T10:22:47.226 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T10:22:47.226 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mon.smithi107.log: gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mgr.smithi107.qurtcs.log 2024-09-10T10:22:47.227 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi107.rvgklu.log 2024-09-10T10:22:47.227 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mgr.smithi107.qurtcs.log: gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T10:22:47.227 INFO:teuthology.orchestra.run.smithi107.stderr: 85.3% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T10:22:47.227 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi071.omoqqq.log: /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.2.log: 86.4% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T10:22:47.227 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mgr.smithi071.gtqytr.log 2024-09-10T10:22:47.228 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.log 2024-09-10T10:22:47.228 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mgr.smithi071.gtqytr.log: 91.3% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T10:22:47.228 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi107.rvgklu.log: 91.5% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T10:22:47.233 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi071.toijsg.log 2024-09-10T10:22:47.235 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.log 2024-09-10T10:22:47.236 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T10:22:47.236 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.log: 88.4% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T10:22:47.239 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.log: 88.5% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T10:22:47.239 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-10T10:22:47.243 INFO:teuthology.orchestra.run.smithi071.stderr: 91.1% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T10:22:47.244 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-10T10:22:47.244 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi071.toijsg.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T10:22:47.245 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.3.log: 91.1% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T10:22:47.256 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T10:22:47.274 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.1.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T10:22:47.285 INFO:teuthology.orchestra.run.smithi107.stderr: 89.7% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mgr.smithi107.qurtcs.log.gz 2024-09-10T10:22:47.317 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T10:22:47.618 INFO:teuthology.orchestra.run.smithi071.stderr: 89.0% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mgr.smithi071.gtqytr.log.gz 2024-09-10T10:22:47.671 INFO:teuthology.orchestra.run.smithi107.stderr: 92.5% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mon.smithi107.log.gz 2024-09-10T10:22:48.449 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mon.smithi071.log.gz 2024-09-10T10:22:50.590 INFO:teuthology.orchestra.run.smithi107.stderr: 95.3% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi107.rvgklu.log.gz 2024-09-10T10:22:51.773 INFO:teuthology.orchestra.run.smithi071.stderr: 93.3% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T10:22:52.322 INFO:teuthology.orchestra.run.smithi107.stderr: 93.3% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T10:22:52.440 INFO:teuthology.orchestra.run.smithi071.stderr: 93.4% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T10:22:53.413 INFO:teuthology.orchestra.run.smithi071.stderr: 93.3% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T10:22:53.938 INFO:teuthology.orchestra.run.smithi107.stderr: 93.5% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T10:22:55.132 INFO:teuthology.orchestra.run.smithi107.stderr: 93.4% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T10:22:56.473 INFO:teuthology.orchestra.run.smithi071.stderr: 95.1% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi071.toijsg.log.gz 2024-09-10T10:23:01.256 INFO:teuthology.orchestra.run.smithi107.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-10T10:23:01.256 INFO:teuthology.orchestra.run.smithi107.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-10T10:23:03.019 INFO:teuthology.orchestra.run.smithi071.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-10T10:23:32.079 INFO:teuthology.orchestra.run.smithi107.stderr: 93.5% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi107.nycoxn.log.gz 2024-09-10T10:23:32.081 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-10T10:23:32.081 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m44.868s 2024-09-10T10:23:32.082 INFO:teuthology.orchestra.run.smithi107.stderr:user 1m19.704s 2024-09-10T10:23:32.082 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m2.533s 2024-09-10T10:23:33.562 INFO:teuthology.orchestra.run.smithi071.stderr: 93.2% -- replaced with /var/log/ceph/9dae8622-6f5a-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi071.omoqqq.log.gz 2024-09-10T10:23:33.564 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-10T10:23:33.565 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m46.354s 2024-09-10T10:23:33.565 INFO:teuthology.orchestra.run.smithi071.stderr:user 1m25.895s 2024-09-10T10:23:33.565 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m2.839s 2024-09-10T10:23:33.565 INFO:tasks.cephadm:Archiving logs... 2024-09-10T10:23:33.566 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899010/remote/smithi071/log 2024-09-10T10:23:33.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T10:23:45.356 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899010/remote/smithi107/log 2024-09-10T10:23:45.357 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T10:23:56.942 INFO:tasks.cephadm:Removing cluster... 2024-09-10T10:23:56.942 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 --force 2024-09-10T10:23:57.498 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9dae8622-6f5a-11ef-bcea-c7b262605968 --force 2024-09-10T10:23:58.081 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T10:23:58.082 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T10:23:58.099 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T10:23:58.115 INFO:tasks.cephadm:Teardown complete 2024-09-10T10:23:58.115 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T10:23:58.126 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-10T10:23:58.127 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T10:23:58.127 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T10:23:58.142 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T10:23:58.229 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T10:23:58.240 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T10:23:58.241 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:23:58.244 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:23:58.256 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:23:58.258 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:23:58.261 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:23:58.261 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-10T10:23:58.261 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 -375us[ -366us] +/- 44ms 2024-09-10T10:23:58.262 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 +398us[ +398us] +/- 59ms 2024-09-10T10:23:58.262 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +190us[ +190us] +/- 72ms 2024-09-10T10:23:58.262 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:58.262 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:23:58.263 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-10T10:23:58.263 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 -389us[ -377us] +/- 44ms 2024-09-10T10:23:58.263 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 +390us[ +390us] +/- 59ms 2024-09-10T10:23:58.263 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +171us[ +183us] +/- 72ms 2024-09-10T10:23:58.263 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:58.264 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T10:23:58.280 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T10:23:58.281 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T10:23:58.291 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T10:23:58.387 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T10:23:58.462 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:23:58.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:23:58.492 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:23:58.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:23:58.521 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T10:23:58.532 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T10:23:58.542 INFO:teuthology.task.internal:Duration was 2151.949018 seconds 2024-09-10T10:23:58.542 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T10:23:58.552 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T10:23:58.552 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T10:23:58.554 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T10:23:58.591 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:23:58.599 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:23:58.940 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T10:23:58.940 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-09-10T10:23:58.940 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T10:23:58.961 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-09-10T10:23:58.961 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T10:23:59.003 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T10:23:59.003 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T10:23:59.005 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T10:23:59.089 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T10:23:59.089 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T10:23:59.092 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T10:23:59.771 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T10:23:59.783 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T10:23:59.783 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T10:23:59.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T10:23:59.833 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T10:23:59.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:23:59.850 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:23:59.871 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-09-10T10:23:59.897 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-09-10T10:23:59.939 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:23:59.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:23:59.962 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:23:59.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:23:59.995 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T10:24:00.006 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T10:24:00.008 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899010/remote/smithi071 2024-09-10T10:24:00.008 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T10:24:00.058 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899010/remote/smithi107 2024-09-10T10:24:00.058 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T10:24:00.096 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T10:24:00.097 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T10:24:00.099 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T10:24:00.145 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T10:24:00.156 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T10:24:00.156 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T10:24:00.168 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T10:24:00.168 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T10:24:00.171 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T10:24:00.183 INFO:teuthology.orchestra.run.smithi071.stdout: 265324 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 10 10:24 /home/ubuntu/cephtest 2024-09-10T10:24:00.183 INFO:teuthology.orchestra.run.smithi071.stdout: 540874 4 d--------- 2 ubuntu ubuntu 4096 Sep 10 10:02 /home/ubuntu/cephtest/mnt.0 2024-09-10T10:24:00.184 INFO:teuthology.orchestra.run.smithi071.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-10T10:24:00.184 INFO:teuthology.orchestra.run.smithi071.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-10T10:24:00.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:24:00.188 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi071 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-10T10:24:00.193 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T10:24:00.205 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T10:24:00.218 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-10T10:24:00.221 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2151.949018239975 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_rishabh@teuthology status: fail success: false 2024-09-10T10:24:00.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T10:24:00.300 INFO:teuthology.run:FAIL